2024-02-15T18:06:45.506 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-15T18:06:45.506 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672 --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} --name lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi --owner scheduled_lflores@teuthology --verbose -- /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672/orig.config.yaml 2024-02-15T18:06:45.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T18:06:45.649 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672 branch: wip-yuri10-testing-2024-02-08-0854-pacific description: rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} email: null first_in_suite: false job_id: '7561672' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific v16.2.4 ' name: lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri10-testing-2024-02-08-0854-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(PG_DEGRADED\) - Degraded data redundancy - \(PG_ - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-tracker-64343-pacific sha1: bedfc49c6a823fb0ff75911e476e1f3cb464ad3e owner: scheduled_lflores@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 964 sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-tracker-64343-pacific suite_path: /home/teuthworker/src/github.com_ljflores_ceph_bedfc49c6a823fb0ff75911e476e1f3cb464ad3e/qa suite_relpath: qa suite_repo: https://github.com/ljflores/ceph.git suite_sha1: bedfc49c6a823fb0ff75911e476e1f3cb464ad3e targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLp96ZRxQN9N+nH0qrq0TEywwWP32HcKsQuOKtxOu8hH12MvrhU7+yZ+awHgK64KBGnoKlNadKXVduU2+hRz6NI= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGUvwgyOe28lqMqMlRL7eAi84fSEoBjU5lI2ulahbQK5RRWkr0mgW0q1/gMr1/UKChD3vDp6gYEvlgIHfjzzcKg= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - pexec: clients: - sudo modprobe -r ceph - sudo modprobe ceph disable_send_metrics=on - install: exclude_packages: - ceph-volume tag: v16.2.4 - print: '**** done install task...' - cephadm: avoid_pacific_features: true cephadm_branch: v16.2.4 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v16.2.4 roleless: true - print: '**** done starting v16.2.4' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-15_17:32:20 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: lflores verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-15T18:06:45.649 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ljflores_ceph_bedfc49c6a823fb0ff75911e476e1f3cb464ad3e/qa; will attempt to use it 2024-02-15T18:06:45.650 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ljflores_ceph_bedfc49c6a823fb0ff75911e476e1f3cb464ad3e/qa/tasks 2024-02-15T18:06:45.650 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-15T18:06:45.652 INFO:teuthology.task.internal:Checking packages... 2024-02-15T18:06:45.676 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0e714d9a4bd2a821113e6318adb87bd06cf81ec1' 2024-02-15T18:06:45.676 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-15T18:06:45.676 INFO:teuthology.packaging:ref: None 2024-02-15T18:06:45.676 INFO:teuthology.packaging:tag: None 2024-02-15T18:06:45.676 INFO:teuthology.packaging:branch: wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-15T18:06:45.676 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:06:45.677 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-15T18:06:45.822 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-521.g0e714d9a 2024-02-15T18:06:45.824 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-15T18:06:45.830 INFO:teuthology.task.internal:no buildpackages task found 2024-02-15T18:06:45.830 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-15T18:06:45.864 INFO:teuthology.task.internal:Saving configuration 2024-02-15T18:06:45.884 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-15T18:06:45.889 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T18:06:45.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 18:02:03.844136', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLp96ZRxQN9N+nH0qrq0TEywwWP32HcKsQuOKtxOu8hH12MvrhU7+yZ+awHgK64KBGnoKlNadKXVduU2+hRz6NI='} 2024-02-15T18:06:45.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 18:02:03.845875', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGUvwgyOe28lqMqMlRL7eAi84fSEoBjU5lI2ulahbQK5RRWkr0mgW0q1/gMr1/UKChD3vDp6gYEvlgIHfjzzcKg='} 2024-02-15T18:06:45.933 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-15T18:06:45.939 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-15T18:06:45.939 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-15T18:06:45.939 INFO:teuthology.run_tasks:Running task console_log... 2024-02-15T18:06:46.025 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f415d908f70>, signals=[15]) 2024-02-15T18:06:46.025 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-15T18:06:46.031 INFO:teuthology.task.internal:Opening connections... 2024-02-15T18:06:46.031 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:06:46.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:06:46.108 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T18:06:46.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:06:46.180 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-15T18:06:46.185 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-02-15T18:06:46.208 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-02-15T18:06:46.209 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-02-15T18:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-02-15T18:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2024-02-15T18:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-02-15T18:06:46.271 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-02-15T18:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2024-02-15T18:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2024-02-15T18:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-15T18:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-02-15T18:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-15T18:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-02-15T18:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T18:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-15T18:06:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T18:06:46.273 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-02-15T18:06:46.295 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-02-15T18:06:46.317 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-02-15T18:06:46.318 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-02-15T18:06:46.380 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-02-15T18:06:46.380 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2024-02-15T18:06:46.380 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-15T18:06:46.381 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-15T18:06:46.381 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-02-15T18:06:46.403 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-15T18:06:46.411 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-15T18:06:46.447 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-15T18:06:46.447 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-02-15T18:06:46.450 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-02-15T18:06:46.470 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-15T18:06:46.474 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-15T18:06:46.474 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-02-15T18:06:46.511 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-02-15T18:06:46.547 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-15T18:06:46.603 INFO:teuthology.run_tasks:Running task kernel... 2024-02-15T18:06:46.617 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-15T18:06:46.617 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-15T18:06:46.618 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T18:06:46.618 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-15T18:06:46.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:06:46.639 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-02-15T18:06:46.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:06:46.640 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-02-15T18:06:46.699 INFO:teuthology.orchestra.run.smithi131.stdout:4.18.0-489.el8.x86_64 2024-02-15T18:06:46.700 INFO:teuthology.task.kernel:Running kernel on smithi131: 4.18.0-489.el8.x86_64 2024-02-15T18:06:46.700 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y kernel 2024-02-15T18:06:46.701 INFO:teuthology.orchestra.run.smithi033.stdout:4.18.0-489.el8.x86_64 2024-02-15T18:06:46.702 INFO:teuthology.task.kernel:Running kernel on smithi033: 4.18.0-489.el8.x86_64 2024-02-15T18:06:46.702 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2024-02-15T18:07:41.124 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 8 - AppStream 536 kB/s | 27 MB 00:51 2024-02-15T18:07:46.848 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 10 MB 00:00 2024-02-15T18:07:49.173 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 8 - Extras 28 kB/s | 18 kB 00:00 2024-02-15T18:07:49.766 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.9 kB 00:00 2024-02-15T18:07:50.090 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2024-02-15T18:07:51.176 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2024-02-15T18:07:55.134 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 407 kB/s | 24 kB 00:00 2024-02-15T18:07:58.315 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-15T18:07:58.315 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-15T18:07:58.433 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:07:58.434 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:07:58.434 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:07:58.434 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:07:58.434 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:07:58.434 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-15T18:07:58.434 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:07:58.434 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-15T18:07:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-15T18:07:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:07:58.435 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:07:58.435 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:07:58.435 INFO:teuthology.orchestra.run.smithi033.stdout:Install 3 Packages 2024-02-15T18:07:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:07:58.435 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 90 M 2024-02-15T18:07:58.436 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 97 M 2024-02-15T18:07:58.436 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:07:58.844 INFO:teuthology.orchestra.run.smithi033.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 28 MB/s | 10 MB 00:00 2024-02-15T18:07:59.503 INFO:teuthology.orchestra.run.smithi033.stdout:(2/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 35 MB/s | 36 MB 00:01 2024-02-15T18:07:59.953 INFO:teuthology.orchestra.run.smithi033.stdout:(3/3): kernel-core-4.18.0-539.el8.x86_64.rpm 29 MB/s | 43 MB 00:01 2024-02-15T18:07:59.953 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:07:59.953 INFO:teuthology.orchestra.run.smithi033.stdout:Total 59 MB/s | 90 MB 00:01 2024-02-15T18:08:00.665 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:08:01.109 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:08:02.424 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:08:02.453 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:08:04.324 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - AppStream 371 kB/s | 27 MB 01:15 2024-02-15T18:08:05.358 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:08:05.851 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-15T18:08:09.608 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-15T18:08:09.682 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - BaseOS 18 MB/s | 10 MB 00:00 2024-02-15T18:08:09.992 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-15T18:08:11.700 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2024-02-15T18:08:12.208 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2024-02-15T18:08:12.460 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-02-15T18:08:13.677 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-15T18:08:13.936 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-02-15T18:08:13.970 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:17.719 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 326 kB/s | 24 kB 00:00 2024-02-15T18:08:20.724 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-15T18:08:20.725 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-15T18:08:20.846 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout:Install 3 Packages 2024-02-15T18:08:20.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:08:20.848 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 90 M 2024-02-15T18:08:20.848 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 97 M 2024-02-15T18:08:20.848 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:08:21.254 INFO:teuthology.orchestra.run.smithi131.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 28 MB/s | 10 MB 00:00 2024-02-15T18:08:21.871 INFO:teuthology.orchestra.run.smithi131.stdout:(2/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 37 MB/s | 36 MB 00:00 2024-02-15T18:08:22.338 INFO:teuthology.orchestra.run.smithi131.stdout:(3/3): kernel-core-4.18.0-539.el8.x86_64.rpm 30 MB/s | 43 MB 00:01 2024-02-15T18:08:22.339 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:08:22.339 INFO:teuthology.orchestra.run.smithi131.stdout:Total 60 MB/s | 90 MB 00:01 2024-02-15T18:08:23.025 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:08:23.443 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:08:23.443 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:08:24.682 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:08:24.703 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:08:27.473 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:08:28.030 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-15T18:08:31.638 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-15T18:08:32.038 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-15T18:08:35.473 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-15T18:08:35.788 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:37.344 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:37.369 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:37.729 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:37.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-15T18:08:37.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-15T18:08:38.254 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:38.254 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:08:38.254 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:08:38.254 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-15T18:08:38.254 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-15T18:08:38.254 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:08:38.254 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:08:38.401 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T18:08:38.629 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-15T18:08:38.629 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-15T18:08:38.629 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-15T18:08:38.629 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T18:08:38.629 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T18:08:38.629 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-15T18:08:38.630 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T18:08:38.630 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T18:08:38.849 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-15T18:08:38.850 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-15T18:08:38.850 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -qi grub2-tools 2024-02-15T18:08:38.884 INFO:teuthology.orchestra.run.smithi033.stdout:Name : grub2-tools 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Epoch : 1 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Version : 2.02 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Release : 129.el8 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: x86_64 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Group : System Environment/Base 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Size : 9265586 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:License : GPLv3+ 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Relocations : (not relocatable) 2024-02-15T18:08:38.885 INFO:teuthology.orchestra.run.smithi033.stdout:Packager : CentOS BuildSystem 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout:Vendor : CentOS 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout:Summary : Support tools for GRUB. 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout:Description : 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout:hardware devices. 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:08:38.886 INFO:teuthology.orchestra.run.smithi033.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T18:08:38.887 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T18:08:38.887 INFO:teuthology.task.kernel:Updating grub on smithi033 to boot 4.18.0-539.el8.x86_64 2024-02-15T18:08:38.887 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T18:08:40.392 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2024-02-15T18:08:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:done 2024-02-15T18:08:42.833 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-02-15T18:08:42.861 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.NdiZD0pzZF 2024-02-15T18:08:42.861 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NdiZD0pzZF 2024-02-15T18:08:42.934 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.NdiZD0pzZF 2024-02-15T18:08:43.201 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.NdiZD0pzZF is 6KB 2024-02-15T18:08:43.250 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.NdiZD0pzZF 2024-02-15T18:08:43.267 DEBUG:teuthology.orchestra.run.smithi033:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T18:08:43.342 INFO:teuthology.orchestra.run.smithi033.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-15T18:08:43.343 INFO:teuthology.orchestra.run.smithi033.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-15T18:08:43.343 INFO:teuthology.orchestra.run.smithi033.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-15T18:08:43.343 INFO:teuthology.orchestra.run.smithi033.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-15T18:08:43.344 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-15T18:08:43.504 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2024-02-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:57.669 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-15T18:08:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:08:58.692 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T18:08:58.910 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-15T18:08:58.910 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-15T18:08:58.911 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-15T18:08:58.911 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-15T18:08:58.911 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-15T18:08:58.911 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-15T18:08:58.911 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2024-02-15T18:08:58.911 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2024-02-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-15T18:08:59.121 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-15T18:08:59.121 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2024-02-15T18:08:59.154 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2024-02-15T18:08:59.154 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2024-02-15T18:08:59.154 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.02 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 129.el8 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Group : System Environment/Base 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 9265586 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Relocations : (not relocatable) 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : CentOS BuildSystem 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : CentOS 2024-02-15T18:08:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-15T18:08:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2024-02-15T18:08:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2024-02-15T18:08:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:08:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-15T18:08:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-15T18:08:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-15T18:08:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2024-02-15T18:08:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:08:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2024-02-15T18:08:59.157 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-15T18:08:59.157 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 4.18.0-539.el8.x86_64 2024-02-15T18:08:59.157 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-15T18:09:00.888 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-02-15T18:09:02.856 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-02-15T18:09:02.857 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-02-15T18:09:02.890 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.N0e1mDe52S 2024-02-15T18:09:02.890 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.N0e1mDe52S 2024-02-15T18:09:02.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.N0e1mDe52S 2024-02-15T18:09:03.087 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.N0e1mDe52S is 6KB 2024-02-15T18:09:03.135 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.N0e1mDe52S 2024-02-15T18:09:03.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2024-02-15T18:09:03.238 INFO:teuthology.orchestra.run.smithi131.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-15T18:09:03.238 INFO:teuthology.orchestra.run.smithi131.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-15T18:09:03.238 INFO:teuthology.orchestra.run.smithi131.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-15T18:09:03.238 INFO:teuthology.orchestra.run.smithi131.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-15T18:09:03.239 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-15T18:09:03.340 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-02-15T18:09:13.516 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-15T18:09:13.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T18:09:13.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:09:33.360 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-15T18:09:33.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T18:09:33.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:09:51.932 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-02-15T18:10:00.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T18:10:00.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:10:13.532 DEBUG:teuthology.orchestra.remote:timed out 2024-02-15T18:10:22.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T18:10:22.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:10:22.920 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-02-15T18:10:23.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T18:10:23.197 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-539.el8.x86_64"... 2024-02-15T18:10:23.197 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-02-15T18:10:23.218 INFO:teuthology.orchestra.run.smithi033.stdout:4.18.0-539.el8.x86_64 2024-02-15T18:10:23.219 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-15T18:10:23.219 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T18:10:23.219 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T18:10:24.219 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-15T18:10:24.220 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T18:10:24.303 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2024-02-15T18:10:24.314 DEBUG:teuthology.parallel:result is None 2024-02-15T18:11:00.945 DEBUG:teuthology.orchestra.remote:timed out 2024-02-15T18:11:12.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T18:11:12.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:11:13.281 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-02-15T18:11:13.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T18:11:13.569 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-539.el8.x86_64"... 2024-02-15T18:11:13.569 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-02-15T18:11:13.587 INFO:teuthology.orchestra.run.smithi131.stdout:4.18.0-539.el8.x86_64 2024-02-15T18:11:13.587 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-15T18:11:13.587 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-15T18:11:13.587 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-15T18:11:14.588 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-15T18:11:14.589 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-15T18:11:14.651 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-02-15T18:11:14.665 DEBUG:teuthology.parallel:result is None 2024-02-15T18:11:14.665 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-15T18:11:14.673 INFO:teuthology.task.internal:Creating test directory... 2024-02-15T18:11:14.673 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T18:11:14.676 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-15T18:11:14.696 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-15T18:11:14.708 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-15T18:11:14.759 INFO:teuthology.task.internal:Creating archive directory... 2024-02-15T18:11:14.759 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T18:11:14.761 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-15T18:11:14.799 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-15T18:11:14.807 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-15T18:11:14.808 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T18:11:14.837 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-15T18:11:14.877 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T18:11:14.878 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T18:11:14.888 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T18:11:14.889 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-15T18:11:14.891 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-15T18:11:14.898 INFO:teuthology.task.internal:Configuring sudo... 2024-02-15T18:11:14.899 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T18:11:14.934 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-15T18:11:14.964 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-15T18:11:14.973 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-15T18:11:14.974 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T18:11:15.007 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-15T18:11:15.026 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T18:11:15.115 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T18:11:15.168 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T18:11:15.255 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T18:11:15.300 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:11:15.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T18:11:15.370 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T18:11:15.419 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-15T18:11:15.475 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T18:11:15.560 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-15T18:11:15.604 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:11:15.604 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-15T18:11:15.672 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-02-15T18:11:15.674 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-02-15T18:11:15.743 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T18:11:15.767 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T18:11:16.067 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-15T18:11:16.075 INFO:teuthology.task.internal:Starting timer... 2024-02-15T18:11:16.075 INFO:teuthology.run_tasks:Running task pcp... 2024-02-15T18:11:16.104 INFO:teuthology.run_tasks:Running task selinux... 2024-02-15T18:11:16.152 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-15T18:11:16.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-02-15T18:11:16.253 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-02-15T18:11:16.255 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2024-02-15T18:11:16.335 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2024-02-15T18:11:16.336 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-15T18:11:16.337 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-02-15T18:11:16.392 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-02-15T18:11:16.393 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2024-02-15T18:11:16.445 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2024-02-15T18:11:16.445 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive'} 2024-02-15T18:11:16.445 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T18:11:16.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:11:16.476 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T18:11:16.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:11:16.504 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-15T18:11:16.504 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-02-15T18:11:16.546 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2024-02-15T18:11:16.573 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-15T18:11:16.584 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-15T18:11:16.591 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-15T18:11:16.772 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-15T18:11:16.787 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-15T18:11:16.788 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-15T18:17:20.001 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2024-02-15T18:17:20.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T18:17:20.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:17:20.083 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-02-15T18:17:20.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-02-15T18:17:20.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T18:17:20.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-15T18:17:20.182 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-02-15T18:17:20.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-02-15T18:17:20.250 INFO:teuthology.run_tasks:Running task clock... 2024-02-15T18:17:20.263 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-15T18:17:20.264 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T18:17:20.264 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T18:17:20.267 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-15T18:17:20.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T18:17:20.300 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T18:17:20.315 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T18:17:20.320 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-15T18:17:20.334 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-15T18:17:20.390 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-02-15T18:17:20.399 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2024-02-15T18:17:20.402 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-02-15T18:17:20.410 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2024-02-15T18:17:20.416 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T18:17:20.424 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-15T18:17:20.430 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T18:17:20.438 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-15T18:17:20.501 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2024-02-15T18:17:20.503 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2024-02-15T18:17:20.504 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T18:17:20.504 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-02-15T18:17:20.504 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:17:20.504 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:17:20.504 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:17:20.504 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:17:20.506 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T18:17:20.507 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-02-15T18:17:20.507 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:17:20.507 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:17:20.507 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:17:20.507 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:17:20.508 INFO:teuthology.run_tasks:Running task pexec... 2024-02-15T18:17:20.517 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-15T18:17:20.518 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:17:20.518 DEBUG:teuthology.orchestra.run.smithi033:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-15T18:17:20.518 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T18:17:20.518 DEBUG:teuthology.orchestra.run.smithi131:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-15T18:17:21.332 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:40 ago on Thu 15 Feb 2024 06:15:41 PM UTC. 2024-02-15T18:17:21.367 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:31 ago on Thu 15 Feb 2024 06:15:50 PM UTC. 2024-02-15T18:17:23.353 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:17:23.354 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:17:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:17:23.354 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:17:23.354 INFO:teuthology.orchestra.run.smithi131.stdout:Resetting modules: 2024-02-15T18:17:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: container-tools 2024-02-15T18:17:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:17:23.354 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:17:23.355 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:17:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:17:23.564 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:17:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:17:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:17:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:17:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:Resetting modules: 2024-02-15T18:17:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: container-tools 2024-02-15T18:17:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:17:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:17:23.565 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:17:23.565 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:17:23.619 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:17:23.824 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:17:24.496 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:43 ago on Thu 15 Feb 2024 06:15:41 PM UTC. 2024-02-15T18:17:24.733 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:34 ago on Thu 15 Feb 2024 06:15:50 PM UTC. 2024-02-15T18:17:26.515 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout:Installing group/module packages: 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: crun x86_64 1.14-1.module_el8+871+552be958 appstream 257 k 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: netavark x86_64 2:1.10.2-1.module_el8+885+7da147f3 appstream 4.3 M 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-15T18:17:26.551 INFO:teuthology.orchestra.run.smithi131.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout:Installing module profiles: 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout: container-tools/common 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout:Enabling module streams: 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout: container-tools rhel8 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:17:26.552 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:17:26.553 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:17:26.553 INFO:teuthology.orchestra.run.smithi131.stdout:Install 13 Packages 2024-02-15T18:17:26.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:17:26.553 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 28 M 2024-02-15T18:17:26.553 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 92 M 2024-02-15T18:17:26.553 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:17:26.894 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:17:26.933 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:17:26.933 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T18:17:26.933 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:17:26.933 INFO:teuthology.orchestra.run.smithi033.stdout:Installing group/module packages: 2024-02-15T18:17:26.933 INFO:teuthology.orchestra.run.smithi033.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-15T18:17:26.933 INFO:teuthology.orchestra.run.smithi033.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-15T18:17:26.933 INFO:teuthology.orchestra.run.smithi033.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: crun x86_64 1.14-1.module_el8+871+552be958 appstream 257 k 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: netavark x86_64 2:1.10.2-1.module_el8+885+7da147f3 appstream 4.3 M 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout:Installing module profiles: 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: container-tools/common 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:17:26.934 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling module streams: 2024-02-15T18:17:26.935 INFO:teuthology.orchestra.run.smithi033.stdout: container-tools rhel8 2024-02-15T18:17:26.935 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:17:26.935 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:17:26.935 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:17:26.935 INFO:teuthology.orchestra.run.smithi033.stdout:Install 13 Packages 2024-02-15T18:17:26.935 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:17:26.935 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 28 M 2024-02-15T18:17:26.935 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 92 M 2024-02-15T18:17:26.936 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:17:27.260 INFO:teuthology.orchestra.run.smithi131.stdout:(1/13): cockpit-podman-83-1.module_el8+847+7863 1.1 MB/s | 688 kB 00:00 2024-02-15T18:17:27.335 INFO:teuthology.orchestra.run.smithi131.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 505 kB/s | 38 kB 00:00 2024-02-15T18:17:27.502 INFO:teuthology.orchestra.run.smithi131.stdout:(3/13): crun-1.14-1.module_el8+871+552be958.x86 1.5 MB/s | 257 kB 00:00 2024-02-15T18:17:27.603 INFO:teuthology.orchestra.run.smithi131.stdout:(4/13): aardvark-dns-1.10.0-1.module_el8+871+55 1.0 MB/s | 1.0 MB 00:00 2024-02-15T18:17:27.736 INFO:teuthology.orchestra.run.smithi131.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 1.3 MB/s | 180 kB 00:00 2024-02-15T18:17:27.811 INFO:teuthology.orchestra.run.smithi131.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 330 kB/s | 25 kB 00:00 2024-02-15T18:17:27.903 INFO:teuthology.orchestra.run.smithi131.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.0 MB/s | 94 kB 00:00 2024-02-15T18:17:28.093 INFO:teuthology.orchestra.run.smithi033.stdout:(1/13): cockpit-podman-83-1.module_el8+847+7863 763 kB/s | 688 kB 00:00 2024-02-15T18:17:28.175 INFO:teuthology.orchestra.run.smithi033.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 464 kB/s | 38 kB 00:00 2024-02-15T18:17:28.417 INFO:teuthology.orchestra.run.smithi033.stdout:(3/13): aardvark-dns-1.10.0-1.module_el8+871+55 841 kB/s | 1.0 MB 00:01 2024-02-15T18:17:28.442 INFO:teuthology.orchestra.run.smithi033.stdout:(4/13): crun-1.14-1.module_el8+871+552be958.x86 962 kB/s | 257 kB 00:00 2024-02-15T18:17:28.676 INFO:teuthology.orchestra.run.smithi033.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 773 kB/s | 180 kB 00:00 2024-02-15T18:17:28.768 INFO:teuthology.orchestra.run.smithi033.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 269 kB/s | 25 kB 00:00 2024-02-15T18:17:28.910 INFO:teuthology.orchestra.run.smithi033.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 663 kB/s | 94 kB 00:00 2024-02-15T18:17:29.387 INFO:teuthology.orchestra.run.smithi131.stdout:(8/13): netavark-1.10.2-1.module_el8+885+7da147 2.3 MB/s | 4.3 MB 00:01 2024-02-15T18:17:30.410 INFO:teuthology.orchestra.run.smithi033.stdout:(8/13): netavark-1.10.2-1.module_el8+885+7da147 2.2 MB/s | 4.3 MB 00:01 2024-02-15T18:17:31.070 INFO:teuthology.orchestra.run.smithi131.stdout:(9/13): toolbox-0.0.99.5-1.module_el8+847+7863d 1.5 MB/s | 2.5 MB 00:01 2024-02-15T18:17:31.246 INFO:teuthology.orchestra.run.smithi131.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 301 kB/s | 53 kB 00:00 2024-02-15T18:17:31.340 INFO:teuthology.orchestra.run.smithi131.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 447 kB/s | 41 kB 00:00 2024-02-15T18:17:31.568 INFO:teuthology.orchestra.run.smithi033.stdout:(9/13): toolbox-0.0.99.5-1.module_el8+847+7863d 2.2 MB/s | 2.5 MB 00:01 2024-02-15T18:17:31.652 INFO:teuthology.orchestra.run.smithi033.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 633 kB/s | 53 kB 00:00 2024-02-15T18:17:31.744 INFO:teuthology.orchestra.run.smithi033.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 446 kB/s | 41 kB 00:00 2024-02-15T18:17:32.979 INFO:teuthology.orchestra.run.smithi131.stdout:(12/13): buildah-1.33.5-1.module_el8+885+7da147 1.5 MB/s | 9.7 MB 00:06 2024-02-15T18:17:34.563 INFO:teuthology.orchestra.run.smithi131.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 1.3 MB/s | 8.8 MB 00:06 2024-02-15T18:17:34.563 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:17:34.563 INFO:teuthology.orchestra.run.smithi131.stdout:Total 3.5 MB/s | 28 MB 00:08 2024-02-15T18:17:34.839 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:17:34.859 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:17:34.860 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:17:35.122 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:17:35.125 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:17:35.835 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:17:36.635 INFO:teuthology.orchestra.run.smithi033.stdout:(12/13): buildah-1.33.5-1.module_el8+885+7da147 1.0 MB/s | 9.7 MB 00:09 2024-02-15T18:17:36.827 INFO:teuthology.orchestra.run.smithi033.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 1.1 MB/s | 8.8 MB 00:07 2024-02-15T18:17:36.827 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:17:36.827 INFO:teuthology.orchestra.run.smithi033.stdout:Total 2.8 MB/s | 28 MB 00:09 2024-02-15T18:17:36.951 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-15T18:17:37.109 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:17:37.131 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:17:37.132 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:17:37.137 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-02-15T18:17:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-02-15T18:17:37.408 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:17:37.412 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:17:37.490 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-02-15T18:17:37.725 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-02-15T18:17:38.278 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-02-15T18:17:38.776 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:17:39.255 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 7/13 2024-02-15T18:17:39.494 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 8/13 2024-02-15T18:17:39.689 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : crun-1.14-1.module_el8+871+552be958.x86_64 9/13 2024-02-15T18:17:39.787 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-15T18:17:39.992 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-02-15T18:17:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-02-15T18:17:40.203 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-02-15T18:17:40.335 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-15T18:17:40.439 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-02-15T18:17:40.594 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-15T18:17:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-02-15T18:17:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-15T18:17:41.213 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-15T18:17:41.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-02-15T18:17:41.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/13 2024-02-15T18:17:41.213 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/13 2024-02-15T18:17:41.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-15T18:17:41.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : crun-1.14-1.module_el8+871+552be958.x86_64 5/13 2024-02-15T18:17:41.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 6/13 2024-02-15T18:17:41.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-02-15T18:17:41.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-15T18:17:41.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-15T18:17:41.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-02-15T18:17:41.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-15T18:17:41.214 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-15T18:17:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-02-15T18:17:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: crun-1.14-1.module_el8+871+552be958.x86_64 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-15T18:17:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-15T18:17:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-15T18:17:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-15T18:17:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-15T18:17:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-15T18:17:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-15T18:17:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:17:41.791 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:17:42.062 DEBUG:teuthology.parallel:result is None 2024-02-15T18:17:42.390 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 7/13 2024-02-15T18:17:42.636 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 8/13 2024-02-15T18:17:42.885 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : crun-1.14-1.module_el8+871+552be958.x86_64 9/13 2024-02-15T18:17:43.366 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-02-15T18:17:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-15T18:17:43.939 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-15T18:17:44.135 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-15T18:17:44.581 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-15T18:17:44.581 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-02-15T18:17:44.581 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/13 2024-02-15T18:17:44.581 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/13 2024-02-15T18:17:44.581 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-15T18:17:44.582 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : crun-1.14-1.module_el8+871+552be958.x86_64 5/13 2024-02-15T18:17:44.582 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 6/13 2024-02-15T18:17:44.582 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-02-15T18:17:44.582 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-15T18:17:44.582 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-15T18:17:44.582 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-02-15T18:17:44.582 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-15T18:17:44.582 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: crun-1.14-1.module_el8+871+552be958.x86_64 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-15T18:17:45.256 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-15T18:17:45.257 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-15T18:17:45.257 INFO:teuthology.orchestra.run.smithi033.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-15T18:17:45.257 INFO:teuthology.orchestra.run.smithi033.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-15T18:17:45.257 INFO:teuthology.orchestra.run.smithi033.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-15T18:17:45.257 INFO:teuthology.orchestra.run.smithi033.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-15T18:17:45.257 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:17:45.257 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:17:45.541 DEBUG:teuthology.parallel:result is None 2024-02-15T18:17:45.541 INFO:teuthology.run_tasks:Running task pexec... 2024-02-15T18:17:45.551 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-15T18:17:45.551 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:17:45.551 DEBUG:teuthology.orchestra.run.smithi033:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-15T18:17:45.552 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T18:17:45.552 DEBUG:teuthology.orchestra.run.smithi131:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-15T18:17:45.715 DEBUG:teuthology.parallel:result is None 2024-02-15T18:17:45.784 DEBUG:teuthology.parallel:result is None 2024-02-15T18:17:45.785 INFO:teuthology.run_tasks:Running task install... 2024-02-15T18:17:45.793 DEBUG:teuthology.task.install:project ceph 2024-02-15T18:17:45.793 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'}} 2024-02-15T18:17:45.793 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v16.2.4', 'flavor': 'default', 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'} 2024-02-15T18:17:45.793 INFO:teuthology.task.install:Using flavor: default 2024-02-15T18:17:45.800 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-15T18:17:45.800 INFO:teuthology.task.install:extra packages: [] 2024-02-15T18:17:45.801 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1', 'tag': 'v16.2.4', 'wait_for_package': False} 2024-02-15T18:17:45.801 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:17:45.801 INFO:teuthology.packaging:ref: None 2024-02-15T18:17:45.801 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:17:45.801 INFO:teuthology.packaging:branch: None 2024-02-15T18:17:45.801 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:17:46.107 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:17:46.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:17:46.110 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1', 'tag': 'v16.2.4', 'wait_for_package': False} 2024-02-15T18:17:46.111 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:17:46.111 INFO:teuthology.packaging:ref: None 2024-02-15T18:17:46.111 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:17:46.111 INFO:teuthology.packaging:branch: None 2024-02-15T18:17:46.111 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:17:46.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:17:46.257 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2024-02-15T18:17:46.258 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2024-02-15T18:17:46.261 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2024-02-15T18:17:46.261 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2024-02-15T18:17:46.298 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T18:17:46.298 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:17:46.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T18:17:46.313 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-15T18:17:46.313 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:17:46.313 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-15T18:17:46.333 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T18:17:46.334 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:17:46.334 INFO:teuthology.packaging:ref: None 2024-02-15T18:17:46.334 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:17:46.334 INFO:teuthology.packaging:branch: None 2024-02-15T18:17:46.334 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:17:46.334 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T18:17:46.346 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-15T18:17:46.346 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:17:46.346 INFO:teuthology.packaging:ref: None 2024-02-15T18:17:46.347 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:17:46.347 INFO:teuthology.packaging:branch: None 2024-02-15T18:17:46.347 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:17:46.347 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-15T18:17:46.406 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T18:17:46.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-15T18:17:46.488 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T18:17:46.503 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-15T18:17:46.556 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2024-02-15T18:17:46.557 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2024-02-15T18:17:46.572 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-02-15T18:17:46.574 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-02-15T18:17:46.822 INFO:teuthology.orchestra.run.smithi131.stdout:76 files removed 2024-02-15T18:17:46.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw 2024-02-15T18:17:46.869 INFO:teuthology.orchestra.run.smithi033.stdout:76 files removed 2024-02-15T18:17:46.901 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw 2024-02-15T18:17:47.331 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 951 kB/s | 74 kB 00:00 2024-02-15T18:17:47.412 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 894 kB/s | 74 kB 00:00 2024-02-15T18:17:47.457 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 173 kB/s | 15 kB 00:00 2024-02-15T18:17:47.554 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 150 kB/s | 15 kB 00:00 2024-02-15T18:17:47.557 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2024-02-15T18:17:47.647 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 29 kB/s | 1.7 kB 00:00 2024-02-15T18:17:56.988 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 8 - AppStream 2.9 MB/s | 27 MB 00:09 2024-02-15T18:17:58.032 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - AppStream 2.6 MB/s | 27 MB 00:10 2024-02-15T18:18:02.981 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-02-15T18:18:03.290 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - BaseOS 25 MB/s | 10 MB 00:00 2024-02-15T18:18:04.948 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 8 - Extras 62 kB/s | 18 kB 00:00 2024-02-15T18:18:05.324 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - Extras 39 kB/s | 18 kB 00:00 2024-02-15T18:18:05.528 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.9 kB 00:00 2024-02-15T18:18:06.042 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.9 kB 00:00 2024-02-15T18:18:06.466 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 8 - PowerTools 5.8 MB/s | 4.8 MB 00:00 2024-02-15T18:18:07.076 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 8 - PowerTools 5.1 MB/s | 4.8 MB 00:00 2024-02-15T18:18:07.701 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2024-02-15T18:18:08.128 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-02-15T18:18:08.887 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2024-02-15T18:18:09.627 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 16 MB 00:01 2024-02-15T18:18:12.879 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 122 kB/s | 24 kB 00:00 2024-02-15T18:18:13.619 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 515 kB/s | 24 kB 00:00 2024-02-15T18:18:16.468 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:18:16.471 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:18:16.471 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-02-15T18:18:16.471 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:18:16.471 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:18:16.471 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2024-02-15T18:18:16.471 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-02-15T18:18:16.471 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2024-02-15T18:18:16.471 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2024-02-15T18:18:16.471 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj x86_64 1.6.1-1.el8 appstream 145 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2024-02-15T18:18:16.472 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout:Install 25 Packages 2024-02-15T18:18:16.473 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 2 Packages 2024-02-15T18:18:16.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:18:16.474 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 59 M 2024-02-15T18:18:16.474 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:18:16.914 INFO:teuthology.orchestra.run.smithi131.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 47 MB/s | 6.0 MB 00:00 2024-02-15T18:18:16.939 INFO:teuthology.orchestra.run.smithi131.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-02-15T18:18:16.981 INFO:teuthology.orchestra.run.smithi131.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 19 MB/s | 801 kB 00:00 2024-02-15T18:18:17.015 INFO:teuthology.orchestra.run.smithi131.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 14 MB/s | 486 kB 00:00 2024-02-15T18:18:17.116 INFO:teuthology.orchestra.run.smithi131.stdout:(5/27): librgw2-16.2.4-0.el8.x86_64.rpm 41 MB/s | 4.1 MB 00:00 2024-02-15T18:18:17.132 INFO:teuthology.orchestra.run.smithi131.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 2.6 MB/s | 44 kB 00:00 2024-02-15T18:18:17.166 INFO:teuthology.orchestra.run.smithi131.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 2.3 MB/s | 80 kB 00:00 2024-02-15T18:18:17.191 INFO:teuthology.orchestra.run.smithi131.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 8.4 MB/s | 213 kB 00:00 2024-02-15T18:18:17.217 INFO:teuthology.orchestra.run.smithi131.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 15 MB/s | 387 kB 00:00 2024-02-15T18:18:17.242 INFO:teuthology.orchestra.run.smithi131.stdout:(10/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 14 MB/s | 368 kB 00:00 2024-02-15T18:18:17.267 INFO:teuthology.orchestra.run.smithi131.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2024-02-15T18:18:17.404 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:18:17.407 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.6.1-1.el8 appstream 145 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2024-02-15T18:18:17.408 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2024-02-15T18:18:17.409 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2024-02-15T18:18:17.410 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:18:17.410 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:18:17.410 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:18:17.410 INFO:teuthology.orchestra.run.smithi033.stdout:Install 25 Packages 2024-02-15T18:18:17.410 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 2 Packages 2024-02-15T18:18:17.410 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:18:17.411 INFO:teuthology.orchestra.run.smithi131.stdout:(12/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 20 MB/s | 13 MB 00:00 2024-02-15T18:18:17.411 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 59 M 2024-02-15T18:18:17.411 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:18:17.677 INFO:teuthology.orchestra.run.smithi131.stdout:(13/27): ceph-common-16.2.4-0.el8.x86_64.rpm 27 MB/s | 24 MB 00:00 2024-02-15T18:18:17.701 INFO:teuthology.orchestra.run.smithi131.stdout:(14/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 335 kB/s | 145 kB 00:00 2024-02-15T18:18:17.777 INFO:teuthology.orchestra.run.smithi131.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 585 kB/s | 44 kB 00:00 2024-02-15T18:18:17.919 INFO:teuthology.orchestra.run.smithi131.stdout:(16/27): daxctl-libs-71.1-7.el8.x86_64.rpm 298 kB/s | 42 kB 00:00 2024-02-15T18:18:17.944 INFO:teuthology.orchestra.run.smithi131.stdout:(17/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 971 kB/s | 259 kB 00:00 2024-02-15T18:18:17.970 INFO:teuthology.orchestra.run.smithi131.stdout:(18/27): librabbitmq-0.9.0-5.el8.x86_64.rpm 930 kB/s | 47 kB 00:00 2024-02-15T18:18:17.995 INFO:teuthology.orchestra.run.smithi131.stdout:(19/27): librdkafka-1.6.1-1.el8.x86_64.rpm 1.1 MB/s | 677 kB 00:00 2024-02-15T18:18:18.054 INFO:teuthology.orchestra.run.smithi131.stdout:(20/27): ndctl-libs-71.1-7.el8.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-02-15T18:18:18.056 INFO:teuthology.orchestra.run.smithi033.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 32 MB/s | 6.0 MB 00:00 2024-02-15T18:18:18.088 INFO:teuthology.orchestra.run.smithi033.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 779 kB/s | 25 kB 00:00 2024-02-15T18:18:18.112 INFO:teuthology.orchestra.run.smithi131.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 819 kB/s | 116 kB 00:00 2024-02-15T18:18:18.121 INFO:teuthology.orchestra.run.smithi033.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 23 MB/s | 801 kB 00:00 2024-02-15T18:18:18.146 INFO:teuthology.orchestra.run.smithi131.stdout:(22/27): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2024-02-15T18:18:18.155 INFO:teuthology.orchestra.run.smithi033.stdout:(4/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 14 MB/s | 486 kB 00:00 2024-02-15T18:18:18.171 INFO:teuthology.orchestra.run.smithi131.stdout:(23/27): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2024-02-15T18:18:18.196 INFO:teuthology.orchestra.run.smithi131.stdout:(24/27): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-02-15T18:18:18.222 INFO:teuthology.orchestra.run.smithi131.stdout:(25/27): leveldb-1.22-1.el8.x86_64.rpm 1.1 MB/s | 181 kB 00:00 2024-02-15T18:18:18.255 INFO:teuthology.orchestra.run.smithi033.stdout:(5/27): librgw2-16.2.4-0.el8.x86_64.rpm 41 MB/s | 4.1 MB 00:00 2024-02-15T18:18:18.281 INFO:teuthology.orchestra.run.smithi033.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 1.7 MB/s | 44 kB 00:00 2024-02-15T18:18:18.305 INFO:teuthology.orchestra.run.smithi131.stdout:(26/27): librados2-16.2.4-0.el8.x86_64.rpm 28 MB/s | 3.7 MB 00:00 2024-02-15T18:18:18.372 INFO:teuthology.orchestra.run.smithi131.stdout:(27/27): librbd1-16.2.4-0.el8.x86_64.rpm 23 MB/s | 4.0 MB 00:00 2024-02-15T18:18:18.374 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:18:18.375 INFO:teuthology.orchestra.run.smithi131.stdout:Total 31 MB/s | 59 MB 00:01 2024-02-15T18:18:18.381 INFO:teuthology.orchestra.run.smithi033.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 798 kB/s | 80 kB 00:00 2024-02-15T18:18:18.406 INFO:teuthology.orchestra.run.smithi033.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 8.3 MB/s | 213 kB 00:00 2024-02-15T18:18:18.440 INFO:teuthology.orchestra.run.smithi033.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 11 MB/s | 387 kB 00:00 2024-02-15T18:18:18.446 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:18:18.474 INFO:teuthology.orchestra.run.smithi033.stdout:(10/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 11 MB/s | 368 kB 00:00 2024-02-15T18:18:18.495 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:18:18.495 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:18:18.499 INFO:teuthology.orchestra.run.smithi033.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2024-02-15T18:18:18.658 INFO:teuthology.orchestra.run.smithi033.stdout:(12/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 16 MB/s | 13 MB 00:00 2024-02-15T18:18:18.844 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:18:18.847 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:18:18.975 INFO:teuthology.orchestra.run.smithi033.stdout:(13/27): ceph-common-16.2.4-0.el8.x86_64.rpm 22 MB/s | 24 MB 00:01 2024-02-15T18:18:19.000 INFO:teuthology.orchestra.run.smithi033.stdout:(14/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 290 kB/s | 145 kB 00:00 2024-02-15T18:18:19.084 INFO:teuthology.orchestra.run.smithi033.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 526 kB/s | 44 kB 00:00 2024-02-15T18:18:19.167 INFO:teuthology.orchestra.run.smithi033.stdout:(16/27): librdkafka-1.6.1-1.el8.x86_64.rpm 1.3 MB/s | 677 kB 00:00 2024-02-15T18:18:19.204 INFO:teuthology.orchestra.run.smithi033.stdout:(17/27): daxctl-libs-71.1-7.el8.x86_64.rpm 350 kB/s | 42 kB 00:00 2024-02-15T18:18:19.226 INFO:teuthology.orchestra.run.smithi033.stdout:(18/27): librabbitmq-0.9.0-5.el8.x86_64.rpm 803 kB/s | 47 kB 00:00 2024-02-15T18:18:19.268 INFO:teuthology.orchestra.run.smithi033.stdout:(19/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 886 kB/s | 259 kB 00:00 2024-02-15T18:18:19.302 INFO:teuthology.orchestra.run.smithi033.stdout:(20/27): ndctl-libs-71.1-7.el8.x86_64.rpm 827 kB/s | 80 kB 00:00 2024-02-15T18:18:19.369 INFO:teuthology.orchestra.run.smithi033.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 817 kB/s | 116 kB 00:00 2024-02-15T18:18:19.411 INFO:teuthology.orchestra.run.smithi033.stdout:(22/27): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2024-02-15T18:18:19.466 INFO:teuthology.orchestra.run.smithi033.stdout:(23/27): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2024-02-15T18:18:19.495 INFO:teuthology.orchestra.run.smithi033.stdout:(24/27): leveldb-1.22-1.el8.x86_64.rpm 939 kB/s | 181 kB 00:00 2024-02-15T18:18:19.520 INFO:teuthology.orchestra.run.smithi033.stdout:(25/27): libunwind-1.3.1-3.el8.x86_64.rpm 688 kB/s | 75 kB 00:00 2024-02-15T18:18:19.612 INFO:teuthology.orchestra.run.smithi033.stdout:(26/27): librados2-16.2.4-0.el8.x86_64.rpm 26 MB/s | 3.7 MB 00:00 2024-02-15T18:18:19.670 INFO:teuthology.orchestra.run.smithi033.stdout:(27/27): librbd1-16.2.4-0.el8.x86_64.rpm 23 MB/s | 4.0 MB 00:00 2024-02-15T18:18:19.673 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:18:19.673 INFO:teuthology.orchestra.run.smithi033.stdout:Total 26 MB/s | 59 MB 00:02 2024-02-15T18:18:19.743 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:18:19.796 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:18:19.796 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:18:19.961 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:18:20.152 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2024-02-15T18:18:20.160 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:18:20.163 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:18:20.357 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2024-02-15T18:18:20.533 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2024-02-15T18:18:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2024-02-15T18:18:21.167 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:18:21.266 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:18:21.377 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:18:21.500 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2024-02-15T18:18:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2024-02-15T18:18:21.675 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:18:21.736 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:18:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2024-02-15T18:18:21.961 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/29 2024-02-15T18:18:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2024-02-15T18:18:22.395 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2024-02-15T18:18:22.534 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/29 2024-02-15T18:18:22.579 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:18:22.700 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:18:22.705 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:18:22.775 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:18:22.946 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2024-02-15T18:18:22.988 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2024-02-15T18:18:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:18:23.150 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 11/29 2024-02-15T18:18:23.198 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:18:23.216 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 11/29 2024-02-15T18:18:23.413 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2024-02-15T18:18:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/29 2024-02-15T18:18:23.576 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2024-02-15T18:18:23.758 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 14/29 2024-02-15T18:18:23.835 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 14/29 2024-02-15T18:18:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:18:24.003 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/29 2024-02-15T18:18:24.154 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:18:24.228 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:18:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:18:24.459 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2024-02-15T18:18:24.608 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2024-02-15T18:18:24.637 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 11/29 2024-02-15T18:18:24.700 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 11/29 2024-02-15T18:18:24.716 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2024-02-15T18:18:24.886 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2024-02-15T18:18:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2024-02-15T18:18:25.072 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2024-02-15T18:18:25.160 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2024-02-15T18:18:25.247 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 14/29 2024-02-15T18:18:25.333 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2024-02-15T18:18:25.348 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 14/29 2024-02-15T18:18:25.402 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2024-02-15T18:18:25.503 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:18:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2024-02-15T18:18:25.826 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2024-02-15T18:18:25.990 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2024-02-15T18:18:26.012 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:18:26.200 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2024-02-15T18:18:26.220 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2024-02-15T18:18:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2024-02-15T18:18:26.516 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2024-02-15T18:18:26.741 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2024-02-15T18:18:26.895 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2024-02-15T18:18:27.002 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2024-02-15T18:18:27.208 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2024-02-15T18:18:27.435 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2024-02-15T18:18:27.634 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2024-02-15T18:18:27.845 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2024-02-15T18:18:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:18:28.975 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:18:29.673 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:18:29.973 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2024-02-15T18:18:30.080 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2024-02-15T18:18:30.216 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:18:30.611 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:18:30.837 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:18:31.578 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2024-02-15T18:18:31.872 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2024-02-15T18:18:31.968 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2024-02-15T18:18:32.136 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /run 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2024-02-15T18:18:49.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:18:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2024-02-15T18:18:50.894 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2024-02-15T18:18:50.894 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2024-02-15T18:18:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2024-02-15T18:18:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:18:51.835 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:18:51.835 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2024-02-15T18:18:51.835 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2024-02-15T18:18:51.835 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2024-02-15T18:18:51.835 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:18:51.836 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 18/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 19/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 20/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2024-02-15T18:18:51.837 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2024-02-15T18:18:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:18:52.113 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-02-15T18:18:52.114 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-02-15T18:18:52.114 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2024-02-15T18:18:52.114 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /run 2024-02-15T18:18:52.114 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-02-15T18:18:52.114 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-02-15T18:18:52.114 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-02-15T18:18:52.114 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-02-15T18:18:52.114 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2024-02-15T18:18:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:18:52.665 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:18:52.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:18:52.665 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-02-15T18:18:52.665 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: daxctl-libs-71.1-7.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: fmt-6.2.1-1.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: leveldb-1.22-1.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-15T18:18:52.666 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj-1.6.1-1.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: ndctl-libs-71.1-7.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.667 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:52.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:18:52.668 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:18:52.953 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-test 2024-02-15T18:18:53.544 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2024-02-15T18:18:53.625 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2024-02-15T18:18:53.625 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2024-02-15T18:18:53.713 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:41 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:18:53.852 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2024-02-15T18:18:53.852 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:18:54.546 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2024-02-15T18:18:54.547 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 15/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 18/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 19/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 20/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2024-02-15T18:18:54.548 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2024-02-15T18:18:55.271 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:18:55.272 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:18:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:18:55.272 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:18:55.272 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:18:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2024-02-15T18:18:55.272 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout:Install 6 Packages 2024-02-15T18:18:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:18:55.274 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 53 M 2024-02-15T18:18:55.274 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 229 M 2024-02-15T18:18:55.274 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:18:55.428 INFO:teuthology.orchestra.run.smithi131.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 2.4 MB/s | 169 kB 00:00 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout: daxctl-libs-71.1-7.el8.x86_64 2024-02-15T18:18:55.475 INFO:teuthology.orchestra.run.smithi033.stdout: fmt-6.2.1-1.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: leveldb-1.22-1.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.6.1-1.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: ndctl-libs-71.1-7.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.476 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.477 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-15T18:18:55.477 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.477 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.477 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2024-02-15T18:18:55.477 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:18:55.477 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:18:55.820 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-test 2024-02-15T18:18:56.079 INFO:teuthology.orchestra.run.smithi131.stdout:(2/6): ceph-test-16.2.4-0.el8.x86_64.rpm 72 MB/s | 52 MB 00:00 2024-02-15T18:18:56.104 INFO:teuthology.orchestra.run.smithi131.stdout:(3/6): jq-1.6-8.el8.x86_64.rpm 273 kB/s | 203 kB 00:00 2024-02-15T18:18:56.129 INFO:teuthology.orchestra.run.smithi131.stdout:(4/6): oniguruma-6.8.2-3.el8.x86_64.rpm 269 kB/s | 188 kB 00:00 2024-02-15T18:18:56.213 INFO:teuthology.orchestra.run.smithi131.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 652 kB/s | 71 kB 00:00 2024-02-15T18:18:56.463 INFO:teuthology.orchestra.run.smithi131.stdout:(6/6): socat-1.7.4.1-1.el8.x86_64.rpm 842 kB/s | 323 kB 00:00 2024-02-15T18:18:56.464 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:18:56.464 INFO:teuthology.orchestra.run.smithi131.stdout:Total 44 MB/s | 53 MB 00:01 2024-02-15T18:18:56.506 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:18:56.527 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:18:56.527 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:18:56.608 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:43 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:18:56.837 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:18:56.840 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:18:57.314 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:18:57.547 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-15T18:18:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-15T18:18:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-15T18:18:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-15T18:18:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-15T18:18:58.281 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-15T18:18:58.282 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-15T18:18:58.283 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-15T18:18:58.283 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:18:58.283 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:18:58.283 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:18:58.283 INFO:teuthology.orchestra.run.smithi033.stdout:Install 6 Packages 2024-02-15T18:18:58.283 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:18:58.283 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 53 M 2024-02-15T18:18:58.284 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 229 M 2024-02-15T18:18:58.284 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:18:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2024-02-15T18:18:58.399 INFO:teuthology.orchestra.run.smithi033.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 2.4 MB/s | 169 kB 00:00 2024-02-15T18:18:59.083 INFO:teuthology.orchestra.run.smithi033.stdout:(2/6): ceph-test-16.2.4-0.el8.x86_64.rpm 69 MB/s | 52 MB 00:00 2024-02-15T18:18:59.108 INFO:teuthology.orchestra.run.smithi033.stdout:(3/6): jq-1.6-8.el8.x86_64.rpm 261 kB/s | 203 kB 00:00 2024-02-15T18:18:59.133 INFO:teuthology.orchestra.run.smithi033.stdout:(4/6): oniguruma-6.8.2-3.el8.x86_64.rpm 256 kB/s | 188 kB 00:00 2024-02-15T18:18:59.292 INFO:teuthology.orchestra.run.smithi033.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 384 kB/s | 71 kB 00:00 2024-02-15T18:18:59.425 INFO:teuthology.orchestra.run.smithi033.stdout:(6/6): socat-1.7.4.1-1.el8.x86_64.rpm 943 kB/s | 323 kB 00:00 2024-02-15T18:18:59.427 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:18:59.428 INFO:teuthology.orchestra.run.smithi033.stdout:Total 46 MB/s | 53 MB 00:01 2024-02-15T18:18:59.470 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:18:59.493 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:18:59.494 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:18:59.832 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:18:59.835 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:19:00.345 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:19:00.545 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-15T18:19:00.761 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-15T18:19:00.923 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-15T18:19:00.989 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-15T18:19:01.186 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-15T18:19:01.331 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2024-02-15T18:19:03.191 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2024-02-15T18:19:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2024-02-15T18:19:03.717 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2024-02-15T18:19:03.718 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2024-02-15T18:19:03.718 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2024-02-15T18:19:03.718 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-15T18:19:03.718 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-15T18:19:03.718 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-15T18:19:04.192 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-15T18:19:04.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:04.192 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:19:04.193 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-02-15T18:19:04.193 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-02-15T18:19:04.193 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-02-15T18:19:04.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:04.193 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:19:04.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph 2024-02-15T18:19:05.160 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:53 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:19:06.554 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2024-02-15T18:19:06.707 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:19:06.710 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:06.710 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-02-15T18:19:06.710 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:06.711 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:19:06.711 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2024-02-15T18:19:06.711 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:19:06.711 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2024-02-15T18:19:06.711 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2024-02-15T18:19:06.711 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2024-02-15T18:19:06.711 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2024-02-15T18:19:06.711 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-15T18:19:06.712 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-15T18:19:06.713 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-15T18:19:06.714 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-15T18:19:06.714 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-15T18:19:06.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:06.714 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:19:06.714 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:06.714 INFO:teuthology.orchestra.run.smithi131.stdout:Install 32 Packages 2024-02-15T18:19:06.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:06.715 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 31 M 2024-02-15T18:19:06.715 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 111 M 2024-02-15T18:19:06.715 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:19:06.821 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2024-02-15T18:19:07.121 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2024-02-15T18:19:07.121 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2024-02-15T18:19:07.121 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2024-02-15T18:19:07.121 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-15T18:19:07.121 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-15T18:19:07.121 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-15T18:19:07.545 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-15T18:19:07.545 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:07.545 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:19:07.546 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-02-15T18:19:07.546 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-02-15T18:19:07.546 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-02-15T18:19:07.546 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:07.546 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:19:07.755 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph 2024-02-15T18:19:08.332 INFO:teuthology.orchestra.run.smithi131.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 120 kB/s | 6.3 kB 00:00 2024-02-15T18:19:08.391 INFO:teuthology.orchestra.run.smithi131.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-02-15T18:19:08.450 INFO:teuthology.orchestra.run.smithi131.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-02-15T18:19:08.483 INFO:teuthology.orchestra.run.smithi131.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 6.5 MB/s | 220 kB 00:00 2024-02-15T18:19:08.539 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:55 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:19:08.584 INFO:teuthology.orchestra.run.smithi131.stdout:(5/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 20 MB/s | 5.0 MB 00:00 2024-02-15T18:19:08.826 INFO:teuthology.orchestra.run.smithi131.stdout:(6/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 42 MB/s | 18 MB 00:00 2024-02-15T18:19:08.909 INFO:teuthology.orchestra.run.smithi131.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 369 kB/s | 157 kB 00:00 2024-02-15T18:19:09.018 INFO:teuthology.orchestra.run.smithi131.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 89 kB/s | 39 kB 00:00 2024-02-15T18:19:09.068 INFO:teuthology.orchestra.run.smithi131.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 359 kB/s | 57 kB 00:00 2024-02-15T18:19:09.135 INFO:teuthology.orchestra.run.smithi131.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 334 kB/s | 103 kB 00:00 2024-02-15T18:19:09.203 INFO:teuthology.orchestra.run.smithi131.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.8 MB/s | 249 kB 00:00 2024-02-15T18:19:09.253 INFO:teuthology.orchestra.run.smithi131.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2024-02-15T18:19:09.286 INFO:teuthology.orchestra.run.smithi131.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 4.2 MB/s | 641 kB 00:00 2024-02-15T18:19:09.337 INFO:teuthology.orchestra.run.smithi131.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 523 kB/s | 44 kB 00:00 2024-02-15T18:19:09.362 INFO:teuthology.orchestra.run.smithi131.stdout:(15/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.3 MB/s | 457 kB 00:00 2024-02-15T18:19:09.416 INFO:teuthology.orchestra.run.smithi131.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.4 MB/s | 185 kB 00:00 2024-02-15T18:19:09.446 INFO:teuthology.orchestra.run.smithi131.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.5 MB/s | 173 kB 00:00 2024-02-15T18:19:09.463 INFO:teuthology.orchestra.run.smithi131.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 240 kB/s | 11 kB 00:00 2024-02-15T18:19:09.480 INFO:teuthology.orchestra.run.smithi131.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 527 kB/s | 18 kB 00:00 2024-02-15T18:19:09.497 INFO:teuthology.orchestra.run.smithi131.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 1.4 MB/s | 49 kB 00:00 2024-02-15T18:19:09.513 INFO:teuthology.orchestra.run.smithi131.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.7 MB/s | 59 kB 00:00 2024-02-15T18:19:09.539 INFO:teuthology.orchestra.run.smithi131.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.1 MB/s | 384 kB 00:00 2024-02-15T18:19:09.556 INFO:teuthology.orchestra.run.smithi131.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 372 kB/s | 16 kB 00:00 2024-02-15T18:19:09.573 INFO:teuthology.orchestra.run.smithi131.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 559 kB/s | 19 kB 00:00 2024-02-15T18:19:09.590 INFO:teuthology.orchestra.run.smithi131.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 716 kB/s | 24 kB 00:00 2024-02-15T18:19:09.615 INFO:teuthology.orchestra.run.smithi131.stdout:(26/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.3 MB/s | 283 kB 00:00 2024-02-15T18:19:09.632 INFO:teuthology.orchestra.run.smithi131.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 496 kB/s | 29 kB 00:00 2024-02-15T18:19:09.649 INFO:teuthology.orchestra.run.smithi131.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 468 kB/s | 27 kB 00:00 2024-02-15T18:19:09.674 INFO:teuthology.orchestra.run.smithi131.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 4.2 MB/s | 255 kB 00:00 2024-02-15T18:19:09.700 INFO:teuthology.orchestra.run.smithi131.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 3.7 MB/s | 251 kB 00:00 2024-02-15T18:19:09.717 INFO:teuthology.orchestra.run.smithi131.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 551 kB/s | 23 kB 00:00 2024-02-15T18:19:09.742 INFO:teuthology.orchestra.run.smithi131.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 925 kB/s | 85 kB 00:00 2024-02-15T18:19:09.743 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:09.744 INFO:teuthology.orchestra.run.smithi131.stdout:Total 10 MB/s | 31 MB 00:03 2024-02-15T18:19:09.825 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:19:09.863 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:19:09.864 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:19:10.200 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:19:10.203 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:19:10.209 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2024-02-15T18:19:10.213 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-15T18:19:10.214 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-15T18:19:10.215 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:10.216 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:19:10.216 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:10.216 INFO:teuthology.orchestra.run.smithi033.stdout:Install 32 Packages 2024-02-15T18:19:10.216 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:10.216 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 31 M 2024-02-15T18:19:10.216 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 111 M 2024-02-15T18:19:10.216 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:19:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:19:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-15T18:19:11.717 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-15T18:19:11.943 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-15T18:19:12.044 INFO:teuthology.orchestra.run.smithi033.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 125 kB/s | 6.3 kB 00:00 2024-02-15T18:19:12.121 INFO:teuthology.orchestra.run.smithi033.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-02-15T18:19:12.140 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-15T18:19:12.186 INFO:teuthology.orchestra.run.smithi033.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-02-15T18:19:12.220 INFO:teuthology.orchestra.run.smithi033.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 6.5 MB/s | 220 kB 00:00 2024-02-15T18:19:12.305 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-15T18:19:12.320 INFO:teuthology.orchestra.run.smithi033.stdout:(5/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 18 MB/s | 5.0 MB 00:00 2024-02-15T18:19:12.452 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-15T18:19:12.588 INFO:teuthology.orchestra.run.smithi033.stdout:(6/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 39 MB/s | 18 MB 00:00 2024-02-15T18:19:12.612 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-15T18:19:12.612 INFO:teuthology.orchestra.run.smithi033.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 133 kB/s | 39 kB 00:00 2024-02-15T18:19:12.663 INFO:teuthology.orchestra.run.smithi033.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 355 kB/s | 157 kB 00:00 2024-02-15T18:19:12.696 INFO:teuthology.orchestra.run.smithi033.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 683 kB/s | 57 kB 00:00 2024-02-15T18:19:12.772 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-15T18:19:12.814 INFO:teuthology.orchestra.run.smithi033.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 458 kB/s | 103 kB 00:00 2024-02-15T18:19:12.847 INFO:teuthology.orchestra.run.smithi033.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.6 MB/s | 249 kB 00:00 2024-02-15T18:19:12.923 INFO:teuthology.orchestra.run.smithi033.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 1.4 MB/s | 109 kB 00:00 2024-02-15T18:19:12.973 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-15T18:19:13.006 INFO:teuthology.orchestra.run.smithi033.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 3.3 MB/s | 641 kB 00:00 2024-02-15T18:19:13.031 INFO:teuthology.orchestra.run.smithi033.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 406 kB/s | 44 kB 00:00 2024-02-15T18:19:13.057 INFO:teuthology.orchestra.run.smithi033.stdout:(15/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.1 MB/s | 457 kB 00:00 2024-02-15T18:19:13.090 INFO:teuthology.orchestra.run.smithi033.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.9 MB/s | 173 kB 00:00 2024-02-15T18:19:13.115 INFO:teuthology.orchestra.run.smithi033.stdout:(17/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.7 MB/s | 185 kB 00:00 2024-02-15T18:19:13.133 INFO:teuthology.orchestra.run.smithi033.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 265 kB/s | 11 kB 00:00 2024-02-15T18:19:13.149 INFO:teuthology.orchestra.run.smithi033.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 524 kB/s | 18 kB 00:00 2024-02-15T18:19:13.185 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-15T18:19:13.200 INFO:teuthology.orchestra.run.smithi033.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 729 kB/s | 49 kB 00:00 2024-02-15T18:19:13.225 INFO:teuthology.orchestra.run.smithi033.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 782 kB/s | 59 kB 00:00 2024-02-15T18:19:13.250 INFO:teuthology.orchestra.run.smithi033.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.9 MB/s | 384 kB 00:00 2024-02-15T18:19:13.276 INFO:teuthology.orchestra.run.smithi033.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2024-02-15T18:19:13.301 INFO:teuthology.orchestra.run.smithi033.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 372 kB/s | 19 kB 00:00 2024-02-15T18:19:13.326 INFO:teuthology.orchestra.run.smithi033.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2024-02-15T18:19:13.352 INFO:teuthology.orchestra.run.smithi033.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 316 kB/s | 24 kB 00:00 2024-02-15T18:19:13.372 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-15T18:19:13.377 INFO:teuthology.orchestra.run.smithi033.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 388 kB/s | 29 kB 00:00 2024-02-15T18:19:13.403 INFO:teuthology.orchestra.run.smithi033.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2024-02-15T18:19:13.463 INFO:teuthology.orchestra.run.smithi033.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.2 MB/s | 255 kB 00:00 2024-02-15T18:19:13.494 INFO:teuthology.orchestra.run.smithi033.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.1 MB/s | 251 kB 00:00 2024-02-15T18:19:13.520 INFO:teuthology.orchestra.run.smithi033.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 410 kB/s | 23 kB 00:00 2024-02-15T18:19:13.545 INFO:teuthology.orchestra.run.smithi033.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 602 kB/s | 85 kB 00:00 2024-02-15T18:19:13.546 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:13.546 INFO:teuthology.orchestra.run.smithi033.stdout:Total 9.3 MB/s | 31 MB 00:03 2024-02-15T18:19:13.604 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-15T18:19:13.633 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:19:13.674 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:19:13.674 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:19:13.972 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-15T18:19:14.023 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:19:14.027 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:19:14.228 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-15T18:19:14.416 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-15T18:19:14.641 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-15T18:19:14.801 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-15T18:19:15.076 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-15T18:19:15.222 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:19:15.280 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-15T18:19:15.464 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-15T18:19:15.477 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-15T18:19:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-15T18:19:15.698 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-15T18:19:15.908 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-15T18:19:15.979 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-15T18:19:16.112 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-15T18:19:16.219 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-15T18:19:16.365 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-15T18:19:16.433 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-15T18:19:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-15T18:19:16.701 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-15T18:19:16.791 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-15T18:19:16.991 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-15T18:19:16.993 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-15T18:19:17.172 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-15T18:19:17.380 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2024-02-15T18:19:17.542 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-15T18:19:17.582 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2024-02-15T18:19:17.772 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-15T18:19:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-15T18:19:18.362 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-15T18:19:18.641 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-15T18:19:18.828 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-15T18:19:19.077 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-15T18:19:19.132 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2024-02-15T18:19:19.247 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-15T18:19:19.391 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2024-02-15T18:19:19.563 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-15T18:19:19.802 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-15T18:19:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2024-02-15T18:19:19.999 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-15T18:19:20.065 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2024-02-15T18:19:20.209 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-15T18:19:20.289 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2024-02-15T18:19:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-15T18:19:20.475 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2024-02-15T18:19:20.492 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2024-02-15T18:19:20.632 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2024-02-15T18:19:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-15T18:19:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-15T18:19:21.075 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2024-02-15T18:19:21.076 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2024-02-15T18:19:21.076 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2024-02-15T18:19:21.076 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2024-02-15T18:19:21.076 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2024-02-15T18:19:21.076 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2024-02-15T18:19:21.076 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2024-02-15T18:19:21.076 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-15T18:19:21.076 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-15T18:19:21.076 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-15T18:19:21.077 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-15T18:19:21.078 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-15T18:19:21.398 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-15T18:19:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-15T18:19:21.927 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-15T18:19:21.928 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-2.6-1.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-15T18:19:21.929 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:21.930 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:19:22.144 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2024-02-15T18:19:22.225 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-base 2024-02-15T18:19:22.372 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2024-02-15T18:19:22.980 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:10 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:19:24.012 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2024-02-15T18:19:24.230 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2024-02-15T18:19:24.472 INFO:teuthology.orchestra.run.smithi131.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:19:24.519 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:19:24.520 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-02-15T18:19:24.520 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:19:24.632 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install cephadm 2024-02-15T18:19:24.691 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2024-02-15T18:19:24.930 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2024-02-15T18:19:25.166 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2024-02-15T18:19:25.369 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2024-02-15T18:19:25.379 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:13 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:19:25.387 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2024-02-15T18:19:25.536 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2024-02-15T18:19:25.969 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2024-02-15T18:19:25.969 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-15T18:19:25.970 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-15T18:19:25.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-15T18:19:25.972 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-15T18:19:25.972 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-15T18:19:25.972 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-15T18:19:26.931 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:19:26.932 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:26.932 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:19:26.932 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:26.932 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:19:26.932 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2024-02-15T18:19:26.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:26.932 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:19:26.933 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:26.933 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-02-15T18:19:26.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:26.933 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 71 k 2024-02-15T18:19:26.933 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 290 k 2024-02-15T18:19:26.933 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:19:27.013 INFO:teuthology.orchestra.run.smithi131.stdout:cephadm-16.2.4-0.el8.noarch.rpm 889 kB/s | 71 kB 00:00 2024-02-15T18:19:27.013 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:27.014 INFO:teuthology.orchestra.run.smithi131.stdout:Total 876 kB/s | 71 kB 00:00 2024-02-15T18:19:27.014 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:19:27.020 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:19:27.020 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:19:27.022 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:19:27.025 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:19:27.076 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:19:27.104 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-15T18:19:27.104 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:27.104 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:19:27.104 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:27.104 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:27.104 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:27.104 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-2.6-1.el8.noarch 2024-02-15T18:19:27.105 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:27.106 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:19:27.504 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-base 2024-02-15T18:19:27.584 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:19:27.760 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:19:27.994 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:19:28.298 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:15 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:19:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:19:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:28.359 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:19:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:16.2.4-0.el8.noarch 2024-02-15T18:19:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:28.359 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:19:28.616 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T18:19:29.377 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:17 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:19:29.927 INFO:teuthology.orchestra.run.smithi033.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:19:29.977 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:19:29.979 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T18:19:29.979 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:19:30.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install cephadm 2024-02-15T18:19:30.870 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:17 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:19:30.929 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:19:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:30.930 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2024-02-15T18:19:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:19:30.930 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2024-02-15T18:19:30.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:30.930 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:19:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-02-15T18:19:30.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 163 k 2024-02-15T18:19:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 587 k 2024-02-15T18:19:30.931 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:19:30.980 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 3.3 MB/s | 163 kB 00:00 2024-02-15T18:19:30.980 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:30.981 INFO:teuthology.orchestra.run.smithi131.stdout:Total 3.2 MB/s | 163 kB 00:00 2024-02-15T18:19:30.981 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:19:30.991 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:19:30.991 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:19:31.038 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:19:31.041 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:19:31.156 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:19:31.373 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:19:31.784 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:19:32.164 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:19:32.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:32.165 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:19:32.165 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:32.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:32.165 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:19:32.410 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr 2024-02-15T18:19:32.528 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:19:32.529 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:32.529 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:19:32.529 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:32.529 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:19:32.529 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2024-02-15T18:19:32.529 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:32.529 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:19:32.530 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:32.530 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T18:19:32.530 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:32.530 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 71 k 2024-02-15T18:19:32.530 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 290 k 2024-02-15T18:19:32.530 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:19:32.826 INFO:teuthology.orchestra.run.smithi033.stdout:cephadm-16.2.4-0.el8.noarch.rpm 241 kB/s | 71 kB 00:00 2024-02-15T18:19:32.827 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:32.827 INFO:teuthology.orchestra.run.smithi033.stdout:Total 240 kB/s | 71 kB 00:00 2024-02-15T18:19:32.827 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:19:32.835 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:19:32.835 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:19:32.837 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:19:32.840 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:19:32.921 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:19:33.177 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:21 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:19:33.453 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:19:33.609 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:19:33.845 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:19:34.245 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2024-02-15T18:19:34.246 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:34.246 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:19:34.246 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:16.2.4-0.el8.noarch 2024-02-15T18:19:34.246 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:34.246 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:19:34.479 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-immutable-object-cache 2024-02-15T18:19:34.693 INFO:teuthology.orchestra.run.smithi131.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:19:34.739 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:19:34.740 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-02-15T18:19:34.741 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:19:34.858 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T18:19:35.270 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:22 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:19:35.619 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:23 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:19:36.926 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:19:36.927 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:36.927 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repo Size 2024-02-15T18:19:36.927 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 163 k 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 587 k 2024-02-15T18:19:36.928 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:19:36.988 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 2.7 MB/s | 163 kB 00:00 2024-02-15T18:19:36.989 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:36.989 INFO:teuthology.orchestra.run.smithi033.stdout:Total 2.6 MB/s | 163 kB 00:00 2024-02-15T18:19:36.989 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:19:37.001 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:19:37.001 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:19:37.052 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:19:37.055 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:19:37.163 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:19:37.170 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:19:37.171 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:37.171 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-02-15T18:19:37.171 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:37.171 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:19:37.171 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2024-02-15T18:19:37.171 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:19:37.171 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2024-02-15T18:19:37.172 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2024-02-15T18:19:37.172 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-15T18:19:37.172 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-15T18:19:37.172 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-15T18:19:37.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:37.172 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:19:37.172 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:19:37.172 INFO:teuthology.orchestra.run.smithi131.stdout:Install 6 Packages 2024-02-15T18:19:37.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:37.173 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 3.0 M 2024-02-15T18:19:37.173 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 15 M 2024-02-15T18:19:37.173 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:19:37.367 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:19:37.768 INFO:teuthology.orchestra.run.smithi131.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 451 kB/s | 24 kB 00:00 2024-02-15T18:19:37.785 INFO:teuthology.orchestra.run.smithi131.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 127 kB/s | 8.9 kB 00:00 2024-02-15T18:19:37.805 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:19:37.843 INFO:teuthology.orchestra.run.smithi131.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 21 MB/s | 2.7 MB 00:00 2024-02-15T18:19:38.127 INFO:teuthology.orchestra.run.smithi131.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 98 kB/s | 34 kB 00:00 2024-02-15T18:19:38.361 INFO:teuthology.orchestra.run.smithi131.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 380 kB/s | 196 kB 00:00 2024-02-15T18:19:38.872 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2024-02-15T18:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:19:39.069 INFO:teuthology.orchestra.run.smithi131.stdout:(6/6): python3-jwt-1.6.1-2.el8.noarch.rpm 33 kB/s | 43 kB 00:01 2024-02-15T18:19:39.073 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:39.073 INFO:teuthology.orchestra.run.smithi131.stdout:Total 1.6 MB/s | 3.0 MB 00:01 2024-02-15T18:19:39.084 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:19:39.095 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:19:39.095 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:19:39.272 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:19:39.275 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:19:39.545 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:19:39.785 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-15T18:19:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-15T18:19:40.105 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr 2024-02-15T18:19:40.231 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-15T18:19:40.352 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2024-02-15T18:19:40.899 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:27 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:19:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2024-02-15T18:19:42.070 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:19:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:19:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2024-02-15T18:19:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2024-02-15T18:19:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2024-02-15T18:19:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-15T18:19:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-15T18:19:42.509 INFO:teuthology.orchestra.run.smithi033.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:19:42.560 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:19:42.561 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T18:19:42.561 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:19:42.668 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-dashboard 2024-02-15T18:19:42.742 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-15T18:19:42.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:42.742 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:19:42.742 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2024-02-15T18:19:42.743 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2024-02-15T18:19:42.743 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2024-02-15T18:19:42.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-15T18:19:42.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-15T18:19:42.743 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-15T18:19:42.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:42.743 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:19:42.875 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T18:19:43.451 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:30 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:19:43.635 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:31 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:19:45.121 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:19:45.122 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:45.122 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T18:19:45.122 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:45.122 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:19:45.122 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout:Install 6 Packages 2024-02-15T18:19:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:45.124 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 3.0 M 2024-02-15T18:19:45.124 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 15 M 2024-02-15T18:19:45.124 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:19:45.183 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================ 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================ 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-15T18:19:45.185 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-15T18:19:45.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:45.186 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:19:45.186 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================ 2024-02-15T18:19:45.186 INFO:teuthology.orchestra.run.smithi131.stdout:Install 8 Packages 2024-02-15T18:19:45.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:45.186 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 37 M 2024-02-15T18:19:45.187 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 210 M 2024-02-15T18:19:45.187 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:19:45.250 INFO:teuthology.orchestra.run.smithi033.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 479 kB/s | 24 kB 00:00 2024-02-15T18:19:45.304 INFO:teuthology.orchestra.run.smithi033.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 85 kB/s | 8.9 kB 00:00 2024-02-15T18:19:45.375 INFO:teuthology.orchestra.run.smithi033.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 15 MB/s | 2.7 MB 00:00 2024-02-15T18:19:45.460 INFO:teuthology.orchestra.run.smithi033.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 204 kB/s | 43 kB 00:00 2024-02-15T18:19:45.501 INFO:teuthology.orchestra.run.smithi033.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 171 kB/s | 34 kB 00:00 2024-02-15T18:19:45.560 INFO:teuthology.orchestra.run.smithi131.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 58 MB/s | 8.6 MB 00:00 2024-02-15T18:19:45.593 INFO:teuthology.orchestra.run.smithi033.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 925 kB/s | 196 kB 00:00 2024-02-15T18:19:45.595 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:45.596 INFO:teuthology.orchestra.run.smithi033.stdout:Total 6.2 MB/s | 3.0 MB 00:00 2024-02-15T18:19:45.606 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:19:45.616 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:19:45.616 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:19:45.793 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:19:45.797 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:19:46.109 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:19:46.315 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-15T18:19:46.577 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-15T18:19:46.793 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-15T18:19:46.843 INFO:teuthology.orchestra.run.smithi131.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 2.9 MB/s | 3.7 MB 00:01 2024-02-15T18:19:46.931 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2024-02-15T18:19:47.004 INFO:teuthology.orchestra.run.smithi131.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.4 MB/s | 225 kB 00:00 2024-02-15T18:19:47.170 INFO:teuthology.orchestra.run.smithi131.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 2.8 MB/s | 4.9 MB 00:01 2024-02-15T18:19:47.337 INFO:teuthology.orchestra.run.smithi131.stdout:(5/8): openblas-0.3.15-4.el8.x86_64.rpm 2.5 MB/s | 4.7 MB 00:01 2024-02-15T18:19:47.522 INFO:teuthology.orchestra.run.smithi131.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 936 kB/s | 172 kB 00:00 2024-02-15T18:19:47.547 INFO:teuthology.orchestra.run.smithi131.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.7 MB/s | 645 kB 00:00 2024-02-15T18:19:48.057 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2024-02-15T18:19:48.359 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:19:48.654 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:19:48.654 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2024-02-15T18:19:48.654 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2024-02-15T18:19:48.655 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2024-02-15T18:19:48.655 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-15T18:19:48.655 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-15T18:19:49.060 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:49.061 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:19:49.197 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-15T18:19:49.990 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:36 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:19:50.006 INFO:teuthology.orchestra.run.smithi131.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 4.7 MB/s | 14 MB 00:03 2024-02-15T18:19:50.006 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:50.006 INFO:teuthology.orchestra.run.smithi131.stdout:Total 7.7 MB/s | 37 MB 00:04 2024-02-15T18:19:50.239 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:19:50.257 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:19:50.257 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:19:50.586 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:19:50.589 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:19:51.201 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:19:51.319 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-15T18:19:51.439 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-15T18:19:51.599 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-15T18:19:51.652 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout:============================================================================================ 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout:============================================================================================ 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-15T18:19:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-15T18:19:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-15T18:19:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-15T18:19:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-15T18:19:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:51.654 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:19:51.654 INFO:teuthology.orchestra.run.smithi033.stdout:============================================================================================ 2024-02-15T18:19:51.654 INFO:teuthology.orchestra.run.smithi033.stdout:Install 8 Packages 2024-02-15T18:19:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:19:51.655 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 37 M 2024-02-15T18:19:51.655 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 210 M 2024-02-15T18:19:51.655 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:19:52.191 INFO:teuthology.orchestra.run.smithi033.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 55 MB/s | 8.6 MB 00:00 2024-02-15T18:19:52.212 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-15T18:19:52.419 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:19:52.874 INFO:teuthology.orchestra.run.smithi033.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 5.8 MB/s | 4.9 MB 00:00 2024-02-15T18:19:52.941 INFO:teuthology.orchestra.run.smithi033.stdout:(3/8): openblas-0.3.15-4.el8.x86_64.rpm 5.2 MB/s | 4.7 MB 00:00 2024-02-15T18:19:52.966 INFO:teuthology.orchestra.run.smithi033.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.4 MB/s | 225 kB 00:00 2024-02-15T18:19:53.025 INFO:teuthology.orchestra.run.smithi033.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 4.5 MB/s | 3.7 MB 00:00 2024-02-15T18:19:53.033 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:19:53.142 INFO:teuthology.orchestra.run.smithi033.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2024-02-15T18:19:53.192 INFO:teuthology.orchestra.run.smithi033.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.8 MB/s | 645 kB 00:00 2024-02-15T18:19:53.428 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-15T18:19:54.043 INFO:teuthology.orchestra.run.smithi033.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 13 MB/s | 14 MB 00:01 2024-02-15T18:19:54.043 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:19:54.043 INFO:teuthology.orchestra.run.smithi033.stdout:Total 16 MB/s | 37 MB 00:02 2024-02-15T18:19:54.126 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-15T18:19:54.284 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:19:54.304 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:19:54.304 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:19:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-15T18:19:54.649 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:19:54.652 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:19:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-15T18:19:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:19:55.497 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-15T18:19:55.733 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-15T18:19:55.995 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-15T18:19:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-15T18:19:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-15T18:19:57.305 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:19:57.830 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-15T18:19:57.962 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:19:58.054 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2024-02-15T18:19:58.249 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-15T18:19:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2024-02-15T18:19:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2024-02-15T18:19:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-15T18:19:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:19:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-15T18:19:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-15T18:19:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-15T18:19:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-15T18:19:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-15T18:19:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-15T18:19:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:19:58.783 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:19:58.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-rook 2024-02-15T18:19:58.992 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-15T18:19:59.473 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-15T18:19:59.655 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:47 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:19:59.749 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-15T18:20:01.210 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-15T18:20:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout:Install 13 Packages 2024-02-15T18:20:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:01.214 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 1.9 M 2024-02-15T18:20:01.214 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 24 M 2024-02-15T18:20:01.214 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:20:01.646 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-15T18:20:01.822 INFO:teuthology.orchestra.run.smithi131.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 738 kB/s | 27 kB 00:00 2024-02-15T18:20:01.905 INFO:teuthology.orchestra.run.smithi131.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 167 kB/s | 20 kB 00:00 2024-02-15T18:20:01.930 INFO:teuthology.orchestra.run.smithi131.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 183 kB/s | 27 kB 00:00 2024-02-15T18:20:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 756 kB/s | 126 kB 00:00 2024-02-15T18:20:02.006 INFO:teuthology.orchestra.run.smithi131.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.1 MB/s | 110 kB 00:00 2024-02-15T18:20:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.3 MB/s | 155 kB 00:00 2024-02-15T18:20:02.082 INFO:teuthology.orchestra.run.smithi131.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 460 kB/s | 43 kB 00:00 2024-02-15T18:20:02.316 INFO:teuthology.orchestra.run.smithi131.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 107 kB/s | 33 kB 00:00 2024-02-15T18:20:02.341 INFO:teuthology.orchestra.run.smithi131.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 56 kB/s | 16 kB 00:00 2024-02-15T18:20:02.475 INFO:teuthology.orchestra.run.smithi131.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 209 kB/s | 81 kB 00:00 2024-02-15T18:20:02.541 INFO:teuthology.orchestra.run.smithi131.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 320 kB/s | 64 kB 00:00 2024-02-15T18:20:02.617 INFO:teuthology.orchestra.run.smithi131.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 432 kB/s | 61 kB 00:00 2024-02-15T18:20:02.842 INFO:teuthology.orchestra.run.smithi131.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.2 MB/s | 1.2 MB 00:00 2024-02-15T18:20:02.845 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:02.845 INFO:teuthology.orchestra.run.smithi131.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2024-02-15T18:20:02.903 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:20:02.918 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:20:02.919 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:20:03.006 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:20:03.009 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:20:03.044 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-15T18:20:03.406 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2024-02-15T18:20:03.551 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:20:03.738 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2024-02-15T18:20:03.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2024-02-15T18:20:03.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-15T18:20:03.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-15T18:20:03.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-15T18:20:03.738 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-15T18:20:03.739 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-15T18:20:03.739 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-15T18:20:03.803 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-15T18:20:04.010 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-15T18:20:04.216 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-15T18:20:04.216 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:04.216 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:20:04.216 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2024-02-15T18:20:04.216 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-15T18:20:04.217 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-15T18:20:04.217 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-15T18:20:04.217 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-15T18:20:04.217 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-15T18:20:04.217 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-15T18:20:04.217 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-15T18:20:04.217 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:04.217 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:04.228 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-15T18:20:04.331 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-rook 2024-02-15T18:20:04.458 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-15T18:20:04.657 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-15T18:20:04.890 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-15T18:20:05.127 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:52 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:05.192 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-15T18:20:05.432 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-15T18:20:06.472 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-15T18:20:06.732 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-15T18:20:06.784 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:06.786 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:06.786 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T18:20:06.786 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:06.786 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:20:06.786 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2024-02-15T18:20:06.786 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:06.787 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:20:06.788 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:06.788 INFO:teuthology.orchestra.run.smithi033.stdout:Install 13 Packages 2024-02-15T18:20:06.788 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:06.788 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 1.9 M 2024-02-15T18:20:06.788 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 24 M 2024-02-15T18:20:06.788 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:20:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-15T18:20:07.116 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-15T18:20:07.300 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-15T18:20:07.599 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-15T18:20:07.600 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-15T18:20:07.600 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-15T18:20:07.600 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-15T18:20:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-15T18:20:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:08.040 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:20:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2024-02-15T18:20:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-15T18:20:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-15T18:20:08.040 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:08.041 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:08.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T18:20:08.258 INFO:teuthology.orchestra.run.smithi033.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 693 kB/s | 27 kB 00:00 2024-02-15T18:20:08.350 INFO:teuthology.orchestra.run.smithi033.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 153 kB/s | 20 kB 00:00 2024-02-15T18:20:08.375 INFO:teuthology.orchestra.run.smithi033.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 170 kB/s | 27 kB 00:00 2024-02-15T18:20:08.434 INFO:teuthology.orchestra.run.smithi033.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.3 MB/s | 110 kB 00:00 2024-02-15T18:20:08.467 INFO:teuthology.orchestra.run.smithi033.stdout:(5/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 605 kB/s | 126 kB 00:00 2024-02-15T18:20:08.501 INFO:teuthology.orchestra.run.smithi033.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.2 MB/s | 155 kB 00:00 2024-02-15T18:20:08.543 INFO:teuthology.orchestra.run.smithi033.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 390 kB/s | 43 kB 00:00 2024-02-15T18:20:08.752 INFO:teuthology.orchestra.run.smithi033.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 116 kB/s | 33 kB 00:00 2024-02-15T18:20:08.785 INFO:teuthology.orchestra.run.smithi033.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 57 kB/s | 16 kB 00:00 2024-02-15T18:20:08.917 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:56 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:08.961 INFO:teuthology.orchestra.run.smithi033.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 195 kB/s | 81 kB 00:00 2024-02-15T18:20:09.028 INFO:teuthology.orchestra.run.smithi033.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 265 kB/s | 64 kB 00:00 2024-02-15T18:20:09.061 INFO:teuthology.orchestra.run.smithi033.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 613 kB/s | 61 kB 00:00 2024-02-15T18:20:09.411 INFO:teuthology.orchestra.run.smithi033.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.8 MB/s | 1.2 MB 00:00 2024-02-15T18:20:09.412 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:09.412 INFO:teuthology.orchestra.run.smithi033.stdout:Total 746 kB/s | 1.9 MB 00:02 2024-02-15T18:20:09.473 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:20:09.490 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:20:09.490 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:20:09.585 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:20:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:20:10.175 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:20:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-15T18:20:10.453 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:10.454 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:10.454 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-02-15T18:20:10.454 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:10.454 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:20:10.454 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2024-02-15T18:20:10.455 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:20:10.455 INFO:teuthology.orchestra.run.smithi131.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-15T18:20:10.455 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-15T18:20:10.455 INFO:teuthology.orchestra.run.smithi131.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-15T18:20:10.455 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-15T18:20:10.455 INFO:teuthology.orchestra.run.smithi131.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-15T18:20:10.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:10.455 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:20:10.456 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:10.456 INFO:teuthology.orchestra.run.smithi131.stdout:Install 6 Packages 2024-02-15T18:20:10.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:10.457 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 5.9 M 2024-02-15T18:20:10.457 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 24 M 2024-02-15T18:20:10.457 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:20:10.600 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-15T18:20:10.832 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-15T18:20:11.077 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-15T18:20:11.250 INFO:teuthology.orchestra.run.smithi131.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 1.9 MB/s | 89 kB 00:00 2024-02-15T18:20:11.294 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-15T18:20:11.530 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-15T18:20:11.567 INFO:teuthology.orchestra.run.smithi131.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 67 kB/s | 21 kB 00:00 2024-02-15T18:20:11.676 INFO:teuthology.orchestra.run.smithi131.stdout:(3/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 1.2 MB/s | 578 kB 00:00 2024-02-15T18:20:11.855 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-15T18:20:11.935 INFO:teuthology.orchestra.run.smithi131.stdout:(4/6): python3-execnet-1.7.1-1.el8.noarch.rpm 968 kB/s | 355 kB 00:00 2024-02-15T18:20:12.068 INFO:teuthology.orchestra.run.smithi131.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 125 kB/s | 49 kB 00:00 2024-02-15T18:20:12.096 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-15T18:20:12.760 INFO:teuthology.orchestra.run.smithi131.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 3.1 MB/s | 4.8 MB 00:01 2024-02-15T18:20:12.763 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:12.763 INFO:teuthology.orchestra.run.smithi131.stdout:Total 2.5 MB/s | 5.9 MB 00:02 2024-02-15T18:20:12.816 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:20:12.827 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:20:12.827 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:20:12.932 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:20:12.935 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:20:13.194 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-15T18:20:13.204 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:20:13.481 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-15T18:20:13.493 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-15T18:20:13.721 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-15T18:20:13.886 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-15T18:20:14.077 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2024-02-15T18:20:14.372 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-15T18:20:14.425 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-15T18:20:14.426 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-15T18:20:15.038 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-15T18:20:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:15.039 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:20:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2024-02-15T18:20:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-15T18:20:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-15T18:20:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-15T18:20:15.039 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-15T18:20:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-15T18:20:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-15T18:20:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-15T18:20:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-15T18:20:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-15T18:20:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-15T18:20:15.040 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-15T18:20:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-15T18:20:15.041 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:15.041 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:15.172 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-cephadm 2024-02-15T18:20:15.296 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-15T18:20:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-15T18:20:15.870 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-15T18:20:15.973 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:02 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:16.057 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:20:16.346 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:20:16.346 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2024-02-15T18:20:16.346 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-15T18:20:16.346 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-15T18:20:16.346 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-15T18:20:16.346 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-15T18:20:16.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-15T18:20:16.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:16.751 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:20:16.751 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2024-02-15T18:20:16.751 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2024-02-15T18:20:16.751 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.10.1-4.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2024-02-15T18:20:16.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:16.752 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:16.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-fuse 2024-02-15T18:20:17.648 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:05 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:17.680 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:17.681 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:17.682 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-02-15T18:20:17.682 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:17.682 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:20:17.682 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2024-02-15T18:20:17.682 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:20:17.682 INFO:teuthology.orchestra.run.smithi033.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-15T18:20:17.682 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-15T18:20:17.683 INFO:teuthology.orchestra.run.smithi033.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-15T18:20:17.683 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-15T18:20:17.683 INFO:teuthology.orchestra.run.smithi033.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-15T18:20:17.683 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:17.683 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:20:17.683 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:17.683 INFO:teuthology.orchestra.run.smithi033.stdout:Install 6 Packages 2024-02-15T18:20:17.683 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:17.684 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 5.9 M 2024-02-15T18:20:17.684 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 24 M 2024-02-15T18:20:17.685 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:20:17.828 INFO:teuthology.orchestra.run.smithi033.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 2.4 MB/s | 89 kB 00:00 2024-02-15T18:20:18.053 INFO:teuthology.orchestra.run.smithi033.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 94 kB/s | 21 kB 00:00 2024-02-15T18:20:18.295 INFO:teuthology.orchestra.run.smithi033.stdout:(3/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 1.1 MB/s | 578 kB 00:00 2024-02-15T18:20:18.472 INFO:teuthology.orchestra.run.smithi033.stdout:(4/6): python3-execnet-1.7.1-1.el8.noarch.rpm 848 kB/s | 355 kB 00:00 2024-02-15T18:20:18.645 INFO:teuthology.orchestra.run.smithi033.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 139 kB/s | 49 kB 00:00 2024-02-15T18:20:19.137 INFO:teuthology.orchestra.run.smithi033.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 3.6 MB/s | 4.8 MB 00:01 2024-02-15T18:20:19.140 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:19.140 INFO:teuthology.orchestra.run.smithi033.stdout:Total 4.0 MB/s | 5.9 MB 00:01 2024-02-15T18:20:19.195 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:20:19.201 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:19.202 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:19.202 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:19.202 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:19.202 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:20:19.202 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2024-02-15T18:20:19.202 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-02-15T18:20:19.202 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-15T18:20:19.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:19.203 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:20:19.203 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:19.203 INFO:teuthology.orchestra.run.smithi131.stdout:Install 2 Packages 2024-02-15T18:20:19.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:19.203 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 968 k 2024-02-15T18:20:19.203 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 3.2 M 2024-02-15T18:20:19.203 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:20:19.206 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:20:19.206 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:20:19.305 INFO:teuthology.orchestra.run.smithi131.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 15 MB/s | 885 kB 00:00 2024-02-15T18:20:19.325 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:20:19.328 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:20:19.389 INFO:teuthology.orchestra.run.smithi131.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 587 kB/s | 83 kB 00:00 2024-02-15T18:20:19.389 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:19.389 INFO:teuthology.orchestra.run.smithi131.stdout:Total 5.1 MB/s | 968 kB 00:00 2024-02-15T18:20:19.399 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:20:19.420 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:20:19.420 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:20:19.506 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:20:19.509 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:20:19.606 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:20:19.685 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:20:19.916 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-15T18:20:19.948 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-15T18:20:20.165 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2024-02-15T18:20:20.378 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-15T18:20:20.562 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2024-02-15T18:20:20.562 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2024-02-15T18:20:20.953 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-15T18:20:20.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:20.953 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:20:20.954 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-15T18:20:20.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:20.954 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:21.190 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install librados-devel 2024-02-15T18:20:21.367 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-15T18:20:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-15T18:20:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-15T18:20:21.955 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:09 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:22.301 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:20:22.619 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2024-02-15T18:20:22.619 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2024-02-15T18:20:22.619 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-15T18:20:22.619 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-15T18:20:22.619 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-15T18:20:22.619 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-15T18:20:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-15T18:20:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:23.343 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:20:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2024-02-15T18:20:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2024-02-15T18:20:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.10.1-4.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2024-02-15T18:20:23.343 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:23.344 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:23.486 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-fuse 2024-02-15T18:20:23.516 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:23.516 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 131 k 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 439 k 2024-02-15T18:20:23.517 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:20:23.552 INFO:teuthology.orchestra.run.smithi131.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 3.7 MB/s | 131 kB 00:00 2024-02-15T18:20:23.553 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:23.553 INFO:teuthology.orchestra.run.smithi131.stdout:Total 3.6 MB/s | 131 kB 00:00 2024-02-15T18:20:23.553 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:20:23.558 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:20:23.558 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:20:23.607 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:20:23.610 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:20:23.727 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:20:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:24.264 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:24.281 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:11 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:24.917 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:20:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2024-02-15T18:20:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:24.917 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:25.939 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:25.940 INFO:teuthology.orchestra.run.smithi033.stdout:Install 2 Packages 2024-02-15T18:20:25.941 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:25.941 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 968 k 2024-02-15T18:20:25.941 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 3.2 M 2024-02-15T18:20:25.941 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:20:26.115 INFO:teuthology.orchestra.run.smithi033.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 12 MB/s | 885 kB 00:00 2024-02-15T18:20:26.198 INFO:teuthology.orchestra.run.smithi033.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 526 kB/s | 83 kB 00:00 2024-02-15T18:20:26.199 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:26.199 INFO:teuthology.orchestra.run.smithi033.stdout:Total 3.7 MB/s | 968 kB 00:00 2024-02-15T18:20:26.212 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:20:26.231 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:20:26.231 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:20:26.323 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:20:26.326 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:20:26.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install libcephfs2 2024-02-15T18:20:26.541 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:20:26.830 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-15T18:20:27.180 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2024-02-15T18:20:27.324 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:15 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:27.605 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2024-02-15T18:20:27.605 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2024-02-15T18:20:28.006 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-15T18:20:28.006 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:28.006 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:20:28.006 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-15T18:20:28.006 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:28.006 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:28.803 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install librados-devel 2024-02-15T18:20:28.821 INFO:teuthology.orchestra.run.smithi131.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:28.870 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:28.871 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-02-15T18:20:28.871 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:28.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install libcephfs-devel 2024-02-15T18:20:29.603 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:16 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:29.739 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:17 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:31.266 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:31.266 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:31.266 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:31.267 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:31.267 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:20:31.267 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2024-02-15T18:20:31.267 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:31.267 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:20:31.267 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:31.267 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T18:20:31.267 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:31.268 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 131 k 2024-02-15T18:20:31.268 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 439 k 2024-02-15T18:20:31.268 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:20:31.306 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:31.307 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:31.307 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:31.307 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:31.308 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:20:31.308 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2024-02-15T18:20:31.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:31.308 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:20:31.308 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:31.308 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-02-15T18:20:31.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:31.309 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 24 k 2024-02-15T18:20:31.309 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 94 k 2024-02-15T18:20:31.309 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:20:31.320 INFO:teuthology.orchestra.run.smithi033.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 2.5 MB/s | 131 kB 00:00 2024-02-15T18:20:31.321 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:31.321 INFO:teuthology.orchestra.run.smithi033.stdout:Total 2.4 MB/s | 131 kB 00:00 2024-02-15T18:20:31.321 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:20:31.327 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:20:31.327 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:20:31.352 INFO:teuthology.orchestra.run.smithi131.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 553 kB/s | 24 kB 00:00 2024-02-15T18:20:31.353 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:31.353 INFO:teuthology.orchestra.run.smithi131.stdout:Total 539 kB/s | 24 kB 00:00 2024-02-15T18:20:31.353 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:20:31.356 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:20:31.356 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:20:31.358 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:20:31.361 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:20:31.380 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:20:31.383 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:20:31.410 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:20:31.509 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:20:31.774 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:32.065 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:32.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:32.443 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:32.443 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:20:32.443 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2024-02-15T18:20:32.443 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:32.443 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:32.551 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:32.701 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install libcephfs2 2024-02-15T18:20:32.901 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:32.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:32.901 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:20:32.901 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2024-02-15T18:20:32.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:32.901 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:33.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install librados2 2024-02-15T18:20:33.498 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:20 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:33.775 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:21 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:35.124 INFO:teuthology.orchestra.run.smithi033.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:35.175 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:35.176 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T18:20:35.176 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:35.292 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:35.339 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:35.340 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-02-15T18:20:35.340 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:35.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install librbd1 2024-02-15T18:20:35.453 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install libcephfs-devel 2024-02-15T18:20:36.203 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:24 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:36.245 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:23 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:37.711 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:37.757 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:37.758 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-02-15T18:20:37.759 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:37.907 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T18:20:37.908 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:37.909 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 24 k 2024-02-15T18:20:37.909 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 94 k 2024-02-15T18:20:37.909 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:20:37.952 INFO:teuthology.orchestra.run.smithi033.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 562 kB/s | 24 kB 00:00 2024-02-15T18:20:37.953 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:37.953 INFO:teuthology.orchestra.run.smithi033.stdout:Total 546 kB/s | 24 kB 00:00 2024-02-15T18:20:37.953 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:20:37.957 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:20:37.957 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:20:37.959 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:20:37.963 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:20:38.038 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:20:38.140 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-rados 2024-02-15T18:20:38.265 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:38.547 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:38.897 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:26 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:38.927 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:38.927 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:38.927 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:20:38.928 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2024-02-15T18:20:38.928 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:38.928 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:39.049 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install librados2 2024-02-15T18:20:39.839 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:26 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:40.381 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:40.428 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:40.429 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-02-15T18:20:40.429 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:40.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-rgw 2024-02-15T18:20:41.296 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:29 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:41.450 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:41.500 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:41.501 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T18:20:41.501 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:41.613 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install librbd1 2024-02-15T18:20:42.407 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:29 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:42.806 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:42.852 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:42.853 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-02-15T18:20:42.854 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:42.962 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-cephfs 2024-02-15T18:20:43.718 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:31 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:44.020 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:44.071 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:44.072 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T18:20:44.072 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:44.176 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-rados 2024-02-15T18:20:44.967 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:31 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:45.228 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:45.274 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:45.276 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-02-15T18:20:45.276 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:45.377 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-rbd 2024-02-15T18:20:46.131 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:34 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:46.584 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:46.635 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:46.637 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T18:20:46.637 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:46.741 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-rgw 2024-02-15T18:20:47.530 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:34 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:47.601 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:47.648 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:47.649 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-02-15T18:20:47.649 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:47.753 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install rbd-fuse 2024-02-15T18:20:48.511 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:36 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:49.136 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:49.187 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:49.188 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T18:20:49.188 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:49.296 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-cephfs 2024-02-15T18:20:50.063 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:50.064 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:50.064 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:50.064 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:50.064 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:20:50.064 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2024-02-15T18:20:50.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:50.065 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:20:50.065 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:50.065 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-02-15T18:20:50.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:50.065 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 89 k 2024-02-15T18:20:50.065 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 298 k 2024-02-15T18:20:50.065 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:20:50.087 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:37 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:50.109 INFO:teuthology.orchestra.run.smithi131.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 2.0 MB/s | 89 kB 00:00 2024-02-15T18:20:50.109 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:50.110 INFO:teuthology.orchestra.run.smithi131.stdout:Total 1.9 MB/s | 89 kB 00:00 2024-02-15T18:20:50.110 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:20:50.120 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:20:50.120 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:20:50.169 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:20:50.172 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:20:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:20:50.476 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:51.172 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:20:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2024-02-15T18:20:51.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:51.172 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:51.422 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install rbd-mirror 2024-02-15T18:20:51.693 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:51.743 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:51.744 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T18:20:51.744 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:51.864 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-rbd 2024-02-15T18:20:52.189 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:40 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:52.653 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:39 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:53.744 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:53.744 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:20:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2024-02-15T18:20:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:53.744 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:20:53.744 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:53.744 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-02-15T18:20:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 3.7 M 2024-02-15T18:20:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 18 M 2024-02-15T18:20:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:20:53.829 INFO:teuthology.orchestra.run.smithi131.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 44 MB/s | 3.7 MB 00:00 2024-02-15T18:20:53.829 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:53.830 INFO:teuthology.orchestra.run.smithi131.stdout:Total 43 MB/s | 3.7 MB 00:00 2024-02-15T18:20:53.830 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:20:53.842 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:20:53.842 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:20:53.904 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:20:53.907 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:20:54.265 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2024-02-15T18:20:54.315 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:54.317 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-02-15T18:20:54.317 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:54.383 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:20:54.410 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install rbd-fuse 2024-02-15T18:20:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:55.007 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:55.204 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:42 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:55.382 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:20:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2024-02-15T18:20:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:55.383 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:55.626 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install rbd-nbd 2024-02-15T18:20:56.392 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:44 ago on Thu 15 Feb 2024 06:18:12 PM UTC. 2024-02-15T18:20:56.879 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:20:56.880 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:56.880 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:56.880 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:20:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2024-02-15T18:20:56.880 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:56.881 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:20:56.881 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:20:56.881 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T18:20:56.881 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:56.881 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 89 k 2024-02-15T18:20:56.881 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 298 k 2024-02-15T18:20:56.881 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:20:56.925 INFO:teuthology.orchestra.run.smithi033.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 2.0 MB/s | 89 kB 00:00 2024-02-15T18:20:56.926 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:56.926 INFO:teuthology.orchestra.run.smithi033.stdout:Total 1.9 MB/s | 89 kB 00:00 2024-02-15T18:20:56.926 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:20:56.937 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:20:56.937 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:20:56.990 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:20:56.993 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:20:57.099 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:20:57.286 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:57.615 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-02-15T18:20:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-02-15T18:20:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-02-15T18:20:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2024-02-15T18:20:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-02-15T18:20:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-02-15T18:20:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-02-15T18:20:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 173 k 2024-02-15T18:20:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 649 k 2024-02-15T18:20:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-02-15T18:20:58.008 INFO:teuthology.orchestra.run.smithi131.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 3.0 MB/s | 173 kB 00:00 2024-02-15T18:20:58.008 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:20:58.009 INFO:teuthology.orchestra.run.smithi131.stdout:Total 3.0 MB/s | 173 kB 00:00 2024-02-15T18:20:58.009 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-02-15T18:20:58.019 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-02-15T18:20:58.019 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-02-15T18:20:58.022 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:58.022 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:58.022 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:20:58.022 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2024-02-15T18:20:58.022 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:20:58.022 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:20:58.068 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-02-15T18:20:58.071 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-02-15T18:20:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-02-15T18:20:58.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install rbd-mirror 2024-02-15T18:20:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:59.060 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:46 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:20:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:20:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:59.082 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-02-15T18:20:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2024-02-15T18:20:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:20:59.082 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-02-15T18:20:59.292 DEBUG:teuthology.parallel:result is None 2024-02-15T18:21:00.722 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:21:00.722 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:21:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:21:00.722 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:21:00.722 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:21:00.722 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2024-02-15T18:21:00.723 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:21:00.723 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:21:00.723 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:21:00.723 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T18:21:00.723 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:21:00.723 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 3.7 M 2024-02-15T18:21:00.724 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 18 M 2024-02-15T18:21:00.724 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:21:00.861 INFO:teuthology.orchestra.run.smithi033.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 27 MB/s | 3.7 MB 00:00 2024-02-15T18:21:00.862 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:21:00.862 INFO:teuthology.orchestra.run.smithi033.stdout:Total 27 MB/s | 3.7 MB 00:00 2024-02-15T18:21:00.862 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:21:00.875 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:21:00.875 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:21:00.943 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:21:00.946 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:21:01.432 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:21:01.678 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:21:02.109 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:21:02.567 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:21:02.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:21:02.567 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:21:02.567 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2024-02-15T18:21:02.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:21:02.567 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:21:02.820 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install rbd-nbd 2024-02-15T18:21:03.625 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:50 ago on Thu 15 Feb 2024 06:18:13 PM UTC. 2024-02-15T18:21:05.301 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-02-15T18:21:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:21:05.302 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-02-15T18:21:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:21:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-02-15T18:21:05.302 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2024-02-15T18:21:05.302 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:21:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-02-15T18:21:05.302 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-02-15T18:21:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2024-02-15T18:21:05.303 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:21:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 173 k 2024-02-15T18:21:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 649 k 2024-02-15T18:21:05.303 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-02-15T18:21:05.357 INFO:teuthology.orchestra.run.smithi033.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 3.2 MB/s | 173 kB 00:00 2024-02-15T18:21:05.357 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-02-15T18:21:05.357 INFO:teuthology.orchestra.run.smithi033.stdout:Total 3.1 MB/s | 173 kB 00:00 2024-02-15T18:21:05.358 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-02-15T18:21:05.369 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-02-15T18:21:05.369 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-02-15T18:21:05.422 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-02-15T18:21:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-02-15T18:21:05.542 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-02-15T18:21:05.807 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:21:06.145 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:21:06.570 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2024-02-15T18:21:06.571 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:21:06.571 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-02-15T18:21:06.571 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2024-02-15T18:21:06.571 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:21:06.571 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-02-15T18:21:06.877 DEBUG:teuthology.parallel:result is None 2024-02-15T18:21:06.877 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:21:06.877 INFO:teuthology.packaging:ref: None 2024-02-15T18:21:06.877 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:21:06.877 INFO:teuthology.packaging:branch: None 2024-02-15T18:21:06.878 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:21:06.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:21:07.138 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T18:21:07.161 INFO:teuthology.orchestra.run.smithi033.stdout:16.2.4-0.el8 2024-02-15T18:21:07.162 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2024-02-15T18:21:07.162 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2024-02-15T18:21:07.164 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-15T18:21:07.164 INFO:teuthology.packaging:ref: None 2024-02-15T18:21:07.164 INFO:teuthology.packaging:tag: v16.2.4 2024-02-15T18:21:07.164 INFO:teuthology.packaging:branch: None 2024-02-15T18:21:07.164 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:21:07.165 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2024-02-15T18:21:07.299 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-15T18:21:07.328 INFO:teuthology.orchestra.run.smithi131.stdout:16.2.4-0.el8 2024-02-15T18:21:07.328 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2024-02-15T18:21:07.328 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2024-02-15T18:21:07.330 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-15T18:21:07.330 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:21:07.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T18:21:07.361 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:21:07.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-15T18:21:07.401 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-15T18:21:07.401 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:21:07.401 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T18:21:07.431 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T18:21:07.500 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:21:07.500 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-02-15T18:21:07.531 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-15T18:21:07.600 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-15T18:21:07.600 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:21:07.600 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T18:21:07.629 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T18:21:07.699 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:21:07.699 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-15T18:21:07.728 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-15T18:21:07.798 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-15T18:21:07.798 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:21:07.798 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T18:21:07.827 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T18:21:07.896 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:21:07.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-02-15T18:21:07.925 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-15T18:21:07.993 INFO:teuthology.run_tasks:Running task print... 2024-02-15T18:21:08.003 INFO:teuthology.task.print:**** done install task... 2024-02-15T18:21:08.004 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-15T18:21:08.098 INFO:tasks.cephadm:Config: {'avoid_pacific_features': True, 'cephadm_branch': 'v16.2.4', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v16.2.4', 'roleless': True, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(PG_DEGRADED\\)', 'Degraded data redundancy', '\\(PG_', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'} 2024-02-15T18:21:08.098 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v16.2.4 2024-02-15T18:21:08.099 INFO:tasks.cephadm:Cluster fsid is fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:08.099 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-15T18:21:08.099 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-15T18:21:08.099 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi033': '172.21.15.33', 'mon.smithi131': '172.21.15.131'} 2024-02-15T18:21:08.099 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-15T18:21:08.099 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname $(hostname -s) 2024-02-15T18:21:08.131 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname $(hostname -s) 2024-02-15T18:21:08.160 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v16.2.4)... 2024-02-15T18:21:08.160 DEBUG:teuthology.orchestra.run.smithi033:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-15T18:21:08.475 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Feb 15 18:21 /home/ubuntu/cephtest/cephadm 2024-02-15T18:21:08.475 DEBUG:teuthology.orchestra.run.smithi131:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-15T18:21:08.688 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Feb 15 18:21 /home/ubuntu/cephtest/cephadm 2024-02-15T18:21:08.689 DEBUG:teuthology.orchestra.run.smithi033:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-15T18:21:08.712 DEBUG:teuthology.orchestra.run.smithi131:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-15T18:21:08.743 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph 2024-02-15T18:21:08.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph 2024-02-15T18:21:08.816 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /etc/ceph 2024-02-15T18:21:08.857 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /etc/ceph 2024-02-15T18:21:08.887 INFO:tasks.cephadm:Writing seed config... 2024-02-15T18:21:08.888 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-15T18:21:08.888 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-15T18:21:08.888 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-15T18:21:08.888 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-15T18:21:08.888 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-15T18:21:08.888 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-15T18:21:08.888 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-15T18:21:08.889 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-15T18:21:08.890 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-15T18:21:08.891 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-15T18:21:08.891 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-15T18:21:08.891 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-15T18:21:08.891 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:21:08.891 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-15T18:21:08.918 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = fd0b1c90-cc2e-11ee-95ba-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-15T18:21:08.919 DEBUG:teuthology.orchestra.run.smithi033:mon.smithi033> sudo journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033.service 2024-02-15T18:21:08.961 INFO:tasks.cephadm:Bootstrapping... 2024-02-15T18:21:08.961 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 -v bootstrap --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.33 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:21:08.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:-- Logs begin at Thu 2024-02-15 18:09:56 UTC. -- 2024-02-15T18:21:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2024-02-15T18:21:10.250 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: 4.9.3-dev 2024-02-15T18:21:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying podman|docker is present... 2024-02-15T18:21:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2024-02-15T18:21:10.284 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: 4.9.3-dev 2024-02-15T18:21:10.293 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying lvm2 is present... 2024-02-15T18:21:10.293 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying time synchronization is in place... 2024-02-15T18:21:10.293 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chrony.service 2024-02-15T18:21:10.301 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-15T18:21:10.302 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chrony.service 2024-02-15T18:21:10.308 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2024-02-15T18:21:10.309 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chronyd.service 2024-02-15T18:21:10.315 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: enabled 2024-02-15T18:21:10.315 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chronyd.service 2024-02-15T18:21:10.321 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: active 2024-02-15T18:21:10.322 INFO:teuthology.orchestra.run.smithi033.stderr:Unit chronyd.service is enabled and running 2024-02-15T18:21:10.322 INFO:teuthology.orchestra.run.smithi033.stderr:Repeating the final host check... 2024-02-15T18:21:10.322 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2024-02-15T18:21:10.344 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: 4.9.3-dev 2024-02-15T18:21:10.358 INFO:teuthology.orchestra.run.smithi033.stderr:podman|docker (/bin/podman) is present 2024-02-15T18:21:10.358 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl is present 2024-02-15T18:21:10.358 INFO:teuthology.orchestra.run.smithi033.stderr:lvcreate is present 2024-02-15T18:21:10.358 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chrony.service 2024-02-15T18:21:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-15T18:21:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chrony.service 2024-02-15T18:21:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2024-02-15T18:21:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chronyd.service 2024-02-15T18:21:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: enabled 2024-02-15T18:21:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chronyd.service 2024-02-15T18:21:10.383 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: active 2024-02-15T18:21:10.384 INFO:teuthology.orchestra.run.smithi033.stderr:Unit chronyd.service is enabled and running 2024-02-15T18:21:10.384 INFO:teuthology.orchestra.run.smithi033.stderr:Host looks OK 2024-02-15T18:21:10.384 INFO:teuthology.orchestra.run.smithi033.stderr:Cluster fsid: fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:10.384 INFO:teuthology.orchestra.run.smithi033.stderr:Acquiring lock 140250813172200 on /run/cephadm/fd0b1c90-cc2e-11ee-95ba-87774f69a715.lock 2024-02-15T18:21:10.384 INFO:teuthology.orchestra.run.smithi033.stderr:Lock 140250813172200 acquired on /run/cephadm/fd0b1c90-cc2e-11ee-95ba-87774f69a715.lock 2024-02-15T18:21:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying IP 172.21.15.33 port 3300 ... 2024-02-15T18:21:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying IP 172.21.15.33 port 6789 ... 2024-02-15T18:21:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:Base mon IP is 172.21.15.33, final addrv is [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-02-15T18:21:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /sbin/ip route ls 2024-02-15T18:21:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.33 metric 100 2024-02-15T18:21:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.33 metric 100 2024-02-15T18:21:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /sbin/ip -6 route ls 2024-02-15T18:21:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-02-15T18:21:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-02-15T18:21:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1695sec hoplimit 64 pref medium 2024-02-15T18:21:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /sbin/ip -6 addr ls 2024-02-15T18:21:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-15T18:21:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-02-15T18:21:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-15T18:21:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-15T18:21:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-02-15T18:21:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-15T18:21:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:Mon IP 172.21.15.33 is in CIDR network 172.21.0.0/20 2024-02-15T18:21:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-15T18:21:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2024-02-15T18:21:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman pull docker.io/ceph/ceph:v16.2.4 2024-02-15T18:21:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Trying to pull docker.io/ceph/ceph:v16.2.4... 2024-02-15T18:21:17.131 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Getting image source signatures 2024-02-15T18:21:17.134 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Copying blob sha256:551101690791055467b1840be133b2e6b029d263771bc6c46a96bb7acdacac39 2024-02-15T18:21:17.134 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Copying blob sha256:7a0437f04f83f084b7ed68ad9c4a4947e12fc4e1b006b38129bac89114ec3621 2024-02-15T18:21:36.322 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Copying config sha256:8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2024-02-15T18:21:36.439 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Writing manifest to image destination 2024-02-15T18:21:36.743 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: 8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2024-02-15T18:21:36.754 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --version 2024-02-15T18:21:37.551 INFO:teuthology.orchestra.run.smithi033.stderr:ceph: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2024-02-15T18:21:38.151 INFO:teuthology.orchestra.run.smithi033.stderr:Ceph version: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2024-02-15T18:21:38.151 INFO:teuthology.orchestra.run.smithi033.stderr:Extracting ceph user uid/gid from container image... 2024-02-15T18:21:38.151 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 -c %u %g /var/lib/ceph 2024-02-15T18:21:38.701 INFO:teuthology.orchestra.run.smithi033.stderr:stat: 167 167 2024-02-15T18:21:39.259 INFO:teuthology.orchestra.run.smithi033.stderr:Creating initial keys... 2024-02-15T18:21:39.259 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2024-02-15T18:21:39.806 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-authtool: AQAzVs5ls+PyKBAAC7zsidjkxH4MNVIL6SAoQg== 2024-02-15T18:21:40.303 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2024-02-15T18:21:40.745 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-authtool: AQA0Vs5lnGCRJhAAcGNPiHgdtvh1kYuTW6XpCA== 2024-02-15T18:21:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2024-02-15T18:21:42.001 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-authtool: AQA1Vs5lgsIINxAAV1lVrjXn/5JbMW7Xl36pxw== 2024-02-15T18:21:42.618 INFO:teuthology.orchestra.run.smithi033.stderr:Creating initial monmap... 2024-02-15T18:21:42.618 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmpj8oxcxav:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --create --clobber --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 --addv smithi033 [v2:172.21.15.33:3300,v1:172.21.15.33:6789] /tmp/monmap 2024-02-15T18:21:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-15T18:21:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-15T18:21:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:monmaptool for smithi033 [v2:172.21.15.33:3300,v1:172.21.15.33:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-15T18:21:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: set fsid to fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-15T18:21:43.772 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:21:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:Creating mon... 2024-02-15T18:21:43.773 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033:/var/lib/ceph/mon/ceph-smithi033:z -v /tmp/ceph-tmp_1ce665f:/tmp/keyring:z -v /tmp/ceph-tmpj8oxcxav:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --mkfs -i smithi033 --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.310+0000 7f9565ead700 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.311+0000 7f9565ead700 1 imported monmap: 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: epoch 0 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: last_changed 2024-02-15T18:21:43.086424+0000 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: created 2024-02-15T18:21:43.086424+0000 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.smithi033 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.437 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.311+0000 7f9565ead700 0 /usr/bin/ceph-mon: set fsid to fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: RocksDB version: 6.8.1 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Compile date May 13 2021 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: DB SUMMARY 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi033/store.db dir, Total Num: 0, files: 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi033/store.db: 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.error_if_exists: 0 2024-02-15T18:21:44.438 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.create_if_missing: 1 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.paranoid_checks: 1 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.env: 0x55e6ea2c31c0 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.fs: Posix File System 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.info_log: 0x55e6ec56eec0 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.statistics: (nil) 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.use_fsync: 0 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_log_file_size: 0 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.allow_fallocate: 1 2024-02-15T18:21:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.use_direct_reads: 0 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.create_missing_column_families: 0 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.db_log_dir: 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi033/store.db 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_subcompactions: 1 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_background_flushes: -1 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T18:21:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.advise_random_on_open: 1 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.write_buffer_manager: 0x55e6ec575530 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.rate_limiter: (nil) 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.unordered_write: 0 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T18:21:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.row_cache: None 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.wal_filter: None 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.preserve_deletes: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.two_write_queues: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.manual_wal_flush: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.atomic_flush: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.log_readahead_size: 0 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-15T18:21:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_background_jobs: 2 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_background_compactions: -1 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_total_wal_size: 0 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.max_open_files: -1 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.bytes_per_sync: 0 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-15T18:21:44.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Compression algorithms supported: 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: kZSTD supported: 0 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: kXpressCompression supported: 0 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: kLZ4Compression supported: 1 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: kBZip2Compression supported: 0 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: kZlibCompression supported: 1 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: kSnappyCompression supported: 1 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.312+0000 7f9565ead700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000001 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-15T18:21:44.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.merge_operator: 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_filter: None 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_filter_factory: None 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e6ec487cb8) 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: index_type: 0 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-02-15T18:21:44.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: checksum: 1 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache: 0x55e6ec4bcd10 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-02-15T18:21:44.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: format_version: 2 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_align: 0 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compression: NoCompression 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T18:21:44.447 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.num_levels: 7 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compression_opts.level: 32767 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T18:21:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compression_opts.enabled: false 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T18:21:44.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.arena_block_size: 4194304 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T18:21:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.table_properties_collectors: 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.inplace_update_support: 0 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.bloom_locality: 0 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.max_successive_merges: 0 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-15T18:21:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.force_consistency_checks: 0 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.ttl: 2592000 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.313+0000 7f9565ead700 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.314+0000 7f9565ead700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.314+0000 7f9565ead700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.314+0000 7f9565ead700 4 rocksdb: DB pointer 0x55e6ec581800 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.315+0000 7f954ed46700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.315+0000 7f954ed46700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-02-15T18:21:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.453 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:21:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:21:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:21:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:21:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:21:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:21:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2024-02-15T18:21:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.316+0000 7f9565ead700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-02-15T18:21:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.316+0000 7f9565ead700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-02-15T18:21:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2024-02-15T18:21:44.316+0000 7f9565ead700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi033 for mon.smithi033 2024-02-15T18:21:45.055 INFO:teuthology.orchestra.run.smithi033.stderr:create mon.smithi033 on 2024-02-15T18:21:45.055 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:45.062 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl disable ceph.target 2024-02-15T18:21:45.070 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-02-15T18:21:45.167 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph.target 2024-02-15T18:21:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-15T18:21:45.259 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph.target 2024-02-15T18:21:45.266 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715.target 2024-02-15T18:21:45.272 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715.target. 2024-02-15T18:21:45.272 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715.target. 2024-02-15T18:21:45.356 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715.target 2024-02-15T18:21:45.361 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl daemon-reload 2024-02-15T18:21:45.452 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033 2024-02-15T18:21:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl reset-failed ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033 2024-02-15T18:21:45.485 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to reset failed state of unit ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033.service: Unit ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033.service not loaded. 2024-02-15T18:21:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033 2024-02-15T18:21:45.493 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715.target.wants/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033.service → /etc/systemd/system/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@.service. 2024-02-15T18:21:45.584 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033 2024-02-15T18:21:45.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:45 smithi033 systemd[1]: Starting Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:21:46.152 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled firewalld.service 2024-02-15T18:21:46.160 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: disabled 2024-02-15T18:21:46.161 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active firewalld.service 2024-02-15T18:21:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2024-02-15T18:21:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld.service is not enabled 2024-02-15T18:21:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to enable service . firewalld.service is not available 2024-02-15T18:21:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[]>. firewalld.service is not available 2024-02-15T18:21:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mon to start... 2024-02-15T18:21:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mon... 2024-02-15T18:21:46.170 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033:/var/lib/ceph/mon/ceph-smithi033:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status 2024-02-15T18:21:46.434 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: cluster 2024-02-15T18:21:46.103254+0000 mon.smithi033 (mon.0) 0 : [INF] mkfs fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:46.434 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: cluster 2024-02-15T18:21:46.086512+0000 mon.smithi033 (mon.0) 1 : cluster [INF] mon.smithi033 is new leader, mons smithi033 in quorum (ranks 0) 2024-02-15T18:21:46.435 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:46 smithi033 bash[37700]: 7b498e8680d89267ec35daf82bbc5ac5ada78dd0e305fb66be0d78ac06fb5f9f 2024-02-15T18:21:46.435 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:46 smithi033 systemd[1]: Started Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:21:46.738 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.738+0000 7f2b4939f700 1 Processor -- start 2024-02-15T18:21:46.739 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.738+0000 7f2b4939f700 1 -- start start 2024-02-15T18:21:46.739 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.738+0000 7f2b4939f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b44100d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:46.739 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.738+0000 7f2b4939f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440fc710 con 0x7f2b440703b0 2024-02-15T18:21:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.738+0000 7f2b42ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b44100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.738+0000 7f2b42ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b44100d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57314/0 (socket says 172.21.15.33:57314) 2024-02-15T18:21:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.738+0000 7f2b42ffd700 1 -- 172.21.15.33:0/821785296 learned_addr learned my addr 172.21.15.33:0/821785296 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.739+0000 7f2b42ffd700 1 -- 172.21.15.33:0/821785296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44101210 con 0x7f2b440703b0 2024-02-15T18:21:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.739+0000 7f2b42ffd700 1 --2- 172.21.15.33:0/821785296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b44100d20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f2b3400b5f0 tx=0x7f2b34006ee0).ready entity=mon.0 client_cookie=af8cedabdc5e78fb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:46.740 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.739+0000 7f2b41ffb700 1 -- 172.21.15.33:0/821785296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b3400d600 con 0x7f2b440703b0 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.739+0000 7f2b41ffb700 1 -- 172.21.15.33:0/821785296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3400d760 con 0x7f2b440703b0 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.739+0000 7f2b41ffb700 1 -- 172.21.15.33:0/821785296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b3400da30 con 0x7f2b440703b0 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.740+0000 7f2b4939f700 1 -- 172.21.15.33:0/821785296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 msgr2=0x7f2b44100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.740+0000 7f2b4939f700 1 --2- 172.21.15.33:0/821785296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b44100d20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f2b3400b5f0 tx=0x7f2b34006ee0).stop 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.740+0000 7f2b4939f700 1 -- 172.21.15.33:0/821785296 shutdown_connections 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.740+0000 7f2b4939f700 1 --2- 172.21.15.33:0/821785296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b44100d20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.740+0000 7f2b4939f700 1 -- 172.21.15.33:0/821785296 >> 172.21.15.33:0/821785296 conn(0x7f2b440f63c0 msgr2=0x7f2b440f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.740+0000 7f2b4939f700 1 -- 172.21.15.33:0/821785296 shutdown_connections 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.740+0000 7f2b4939f700 1 -- 172.21.15.33:0/821785296 wait complete. 2024-02-15T18:21:46.742 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.741+0000 7f2b4939f700 1 Processor -- start 2024-02-15T18:21:46.743 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.741+0000 7f2b4939f700 1 -- start start 2024-02-15T18:21:46.743 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.741+0000 7f2b4939f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b4410c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:46.743 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.741+0000 7f2b4939f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4410c8d0 con 0x7f2b440703b0 2024-02-15T18:21:46.743 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.741+0000 7f2b42ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b4410c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:46.743 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.741+0000 7f2b42ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b4410c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57322/0 (socket says 172.21.15.33:57322) 2024-02-15T18:21:46.743 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.741+0000 7f2b42ffd700 1 -- 172.21.15.33:0/1821087837 learned_addr learned my addr 172.21.15.33:0/1821087837 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:46.743 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.741+0000 7f2b42ffd700 1 -- 172.21.15.33:0/1821087837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3400b200 con 0x7f2b440703b0 2024-02-15T18:21:46.743 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.742+0000 7f2b42ffd700 1 --2- 172.21.15.33:0/1821087837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b4410c3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f2b34006c70 tx=0x7f2b34016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:46.743 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.742+0000 7f2b2b7fe700 1 -- 172.21.15.33:0/1821087837 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b34011b40 con 0x7f2b440703b0 2024-02-15T18:21:46.744 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.742+0000 7f2b2b7fe700 1 -- 172.21.15.33:0/1821087837 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34011ca0 con 0x7f2b440703b0 2024-02-15T18:21:46.744 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.742+0000 7f2b4939f700 1 -- 172.21.15.33:0/1821087837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4410cad0 con 0x7f2b440703b0 2024-02-15T18:21:46.744 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.742+0000 7f2b2b7fe700 1 -- 172.21.15.33:0/1821087837 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b3401d430 con 0x7f2b440703b0 2024-02-15T18:21:46.744 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.742+0000 7f2b4939f700 1 -- 172.21.15.33:0/1821087837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4410cf60 con 0x7f2b440703b0 2024-02-15T18:21:46.744 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.742+0000 7f2b2b7fe700 1 -- 172.21.15.33:0/1821087837 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f2b3400f070 con 0x7f2b440703b0 2024-02-15T18:21:46.744 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.742+0000 7f2b2b7fe700 1 -- 172.21.15.33:0/1821087837 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f2b34027460 con 0x7f2b440703b0 2024-02-15T18:21:46.744 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.743+0000 7f2b4939f700 1 -- 172.21.15.33:0/1821087837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b44045ad0 con 0x7f2b440703b0 2024-02-15T18:21:46.745 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.745+0000 7f2b2b7fe700 1 -- 172.21.15.33:0/1821087837 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f2b34016070 con 0x7f2b440703b0 2024-02-15T18:21:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.815+0000 7f2b4939f700 1 -- 172.21.15.33:0/1821087837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f2b4410e470 con 0x7f2b440703b0 2024-02-15T18:21:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.815+0000 7f2b2b7fe700 1 -- 172.21.15.33:0/1821087837 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f2b34036070 con 0x7f2b440703b0 2024-02-15T18:21:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: cluster: 2024-02-15T18:21:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: id: fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-02-15T18:21:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: services: 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi033 (age 0.714302s) 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mgr: no daemons active 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: data: 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: pgs: 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.816+0000 7f2b4939f700 1 -- 172.21.15.33:0/1821087837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 msgr2=0x7f2b4410c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.816+0000 7f2b4939f700 1 --2- 172.21.15.33:0/1821087837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b4410c3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f2b34006c70 tx=0x7f2b34016000).stop 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.816+0000 7f2b4939f700 1 -- 172.21.15.33:0/1821087837 shutdown_connections 2024-02-15T18:21:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.816+0000 7f2b4939f700 1 --2- 172.21.15.33:0/1821087837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b440703b0 0x7f2b4410c3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.816+0000 7f2b4939f700 1 -- 172.21.15.33:0/1821087837 >> 172.21.15.33:0/1821087837 conn(0x7f2b440f63c0 msgr2=0x7f2b440f80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.816+0000 7f2b4939f700 1 -- 172.21.15.33:0/1821087837 shutdown_connections 2024-02-15T18:21:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:46.816+0000 7f2b4939f700 1 -- 172.21.15.33:0/1821087837 wait complete. 2024-02-15T18:21:47.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: cluster 2024-02-15T18:21:46.102041+0000 mon.smithi033 (mon.0) 2 : cluster [INF] mon.smithi033 is new leader, mons smithi033 in quorum (ranks 0) 2024-02-15T18:21:47.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: cluster 2024-02-15T18:21:46.102229+0000 mon.smithi033 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} 2024-02-15T18:21:47.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: cluster 2024-02-15T18:21:46.105097+0000 mon.smithi033 (mon.0) 4 : cluster [DBG] fsmap 2024-02-15T18:21:47.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: cluster 2024-02-15T18:21:46.107857+0000 mon.smithi033 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-15T18:21:47.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: cluster 2024-02-15T18:21:46.108336+0000 mon.smithi033 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-15T18:21:47.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: audit 2024-02-15T18:21:46.816314+0000 mon.smithi033 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.33:0/1821087837' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-15T18:21:47.584 INFO:teuthology.orchestra.run.smithi033.stderr:mon is available 2024-02-15T18:21:47.584 INFO:teuthology.orchestra.run.smithi033.stderr:Assimilating anything we can from ceph.conf... 2024-02-15T18:21:47.584 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z -v /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033:/var/lib/ceph/mon/ceph-smithi033:z docker.io/ceph/ceph:v16.2.4 config assimilate-conf -i /var/lib/ceph/mon/ceph-smithi033/config 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.140+0000 7f50f81a3700 1 Processor -- start 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.140+0000 7f50f81a3700 1 -- start start 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f81a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f81a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00fc8c0 con 0x7f50f00703b0 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f5f3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f5f3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f0100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57338/0 (socket says 172.21.15.33:57338) 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f5f3f700 1 -- 172.21.15.33:0/3178802563 learned_addr learned my addr 172.21.15.33:0/3178802563 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f5f3f700 1 -- 172.21.15.33:0/3178802563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f01013c0 con 0x7f50f00703b0 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f5f3f700 1 --2- 172.21.15.33:0/3178802563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f0100ed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f50ec00b5f0 tx=0x7f50ec006ee0).ready entity=mon.0 client_cookie=c128e6c5c3ed1c36 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:48.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f4f3d700 1 -- 172.21.15.33:0/3178802563 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50ec00d600 con 0x7f50f00703b0 2024-02-15T18:21:48.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f4f3d700 1 -- 172.21.15.33:0/3178802563 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec00d760 con 0x7f50f00703b0 2024-02-15T18:21:48.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.141+0000 7f50f4f3d700 1 -- 172.21.15.33:0/3178802563 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50ec00da30 con 0x7f50f00703b0 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.142+0000 7f50f81a3700 1 -- 172.21.15.33:0/3178802563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 msgr2=0x7f50f0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.142+0000 7f50f81a3700 1 --2- 172.21.15.33:0/3178802563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f0100ed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f50ec00b5f0 tx=0x7f50ec006ee0).stop 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.142+0000 7f50f81a3700 1 -- 172.21.15.33:0/3178802563 shutdown_connections 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.142+0000 7f50f81a3700 1 --2- 172.21.15.33:0/3178802563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f0100ed0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.142+0000 7f50f81a3700 1 -- 172.21.15.33:0/3178802563 >> 172.21.15.33:0/3178802563 conn(0x7f50f00f6530 msgr2=0x7f50f00f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.142+0000 7f50f81a3700 1 -- 172.21.15.33:0/3178802563 shutdown_connections 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.142+0000 7f50f81a3700 1 -- 172.21.15.33:0/3178802563 wait complete. 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.143+0000 7f50f81a3700 1 Processor -- start 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.143+0000 7f50f81a3700 1 -- start start 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.143+0000 7f50f81a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f010c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.143+0000 7f50f81a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f010ca40 con 0x7f50f00703b0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.143+0000 7f50f5f3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f010c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.143+0000 7f50f5f3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f010c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57354/0 (socket says 172.21.15.33:57354) 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.143+0000 7f50f5f3f700 1 -- 172.21.15.33:0/2789155563 learned_addr learned my addr 172.21.15.33:0/2789155563 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.144+0000 7f50f5f3f700 1 -- 172.21.15.33:0/2789155563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec00b200 con 0x7f50f00703b0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.144+0000 7f50f5f3f700 1 --2- 172.21.15.33:0/2789155563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f010c550 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f50ec006c70 tx=0x7f50ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.144+0000 7f50e27fc700 1 -- 172.21.15.33:0/2789155563 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50ec011b40 con 0x7f50f00703b0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.144+0000 7f50e27fc700 1 -- 172.21.15.33:0/2789155563 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec011ca0 con 0x7f50f00703b0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.144+0000 7f50f81a3700 1 -- 172.21.15.33:0/2789155563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f010cc40 con 0x7f50f00703b0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.144+0000 7f50e27fc700 1 -- 172.21.15.33:0/2789155563 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50ec01d430 con 0x7f50f00703b0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.144+0000 7f50f81a3700 1 -- 172.21.15.33:0/2789155563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f010d0d0 con 0x7f50f00703b0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.144+0000 7f50e27fc700 1 -- 172.21.15.33:0/2789155563 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f50ec00f070 con 0x7f50f00703b0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.144+0000 7f50e27fc700 1 -- 172.21.15.33:0/2789155563 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f50ec0277d0 con 0x7f50f00703b0 2024-02-15T18:21:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.145+0000 7f50f81a3700 1 -- 172.21.15.33:0/2789155563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f0045ad0 con 0x7f50f00703b0 2024-02-15T18:21:48.147 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.147+0000 7f50e27fc700 1 -- 172.21.15.33:0/2789155563 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f50ec016070 con 0x7f50f00703b0 2024-02-15T18:21:48.214 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.214+0000 7f50f81a3700 1 -- 172.21.15.33:0/2789155563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f50f0106190 con 0x7f50f00703b0 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.218+0000 7f50e27fc700 1 -- 172.21.15.33:0/2789155563 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f50ec01d710 con 0x7f50f00703b0 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.218+0000 7f50e27fc700 1 -- 172.21.15.33:0/2789155563 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+489 (secure 0 0 0) 0x7f50ec036020 con 0x7f50f00703b0 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [global] 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: fsid = fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-15T18:21:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [mgr] 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [osd] 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_memory_target_autotune = true 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.219+0000 7f50f81a3700 1 -- 172.21.15.33:0/2789155563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 msgr2=0x7f50f010c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.219+0000 7f50f81a3700 1 --2- 172.21.15.33:0/2789155563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f010c550 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f50ec006c70 tx=0x7f50ec016000).stop 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.219+0000 7f50f81a3700 1 -- 172.21.15.33:0/2789155563 shutdown_connections 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.219+0000 7f50f81a3700 1 --2- 172.21.15.33:0/2789155563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50f00703b0 0x7f50f010c550 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.219+0000 7f50f81a3700 1 -- 172.21.15.33:0/2789155563 >> 172.21.15.33:0/2789155563 conn(0x7f50f00f6530 msgr2=0x7f50f00f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.219+0000 7f50f81a3700 1 -- 172.21.15.33:0/2789155563 shutdown_connections 2024-02-15T18:21:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:48.219+0000 7f50f81a3700 1 -- 172.21.15.33:0/2789155563 wait complete. 2024-02-15T18:21:48.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: audit 2024-02-15T18:21:48.215264+0000 mon.smithi033 (mon.0) 8 : audit [INF] from='client.? 172.21.15.33:0/2789155563' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-15T18:21:48.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: audit 2024-02-15T18:21:48.218842+0000 mon.smithi033 (mon.0) 9 : audit [INF] from='client.? 172.21.15.33:0/2789155563' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-15T18:21:48.857 INFO:teuthology.orchestra.run.smithi033.stderr:Generating new minimal ceph.conf... 2024-02-15T18:21:48.857 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z -v /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033:/var/lib/ceph/mon/ceph-smithi033:z docker.io/ceph/ceph:v16.2.4 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-smithi033/config 2024-02-15T18:21:49.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.428+0000 7f4c9532e700 1 Processor -- start 2024-02-15T18:21:49.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.428+0000 7f4c9532e700 1 -- start start 2024-02-15T18:21:49.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.428+0000 7f4c9532e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:49.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.428+0000 7f4c9532e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900fef80 con 0x7f4c900703f0 2024-02-15T18:21:49.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.429+0000 7f4c8effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:49.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.429+0000 7f4c8effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57364/0 (socket says 172.21.15.33:57364) 2024-02-15T18:21:49.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.429+0000 7f4c8effd700 1 -- 172.21.15.33:0/392743575 learned_addr learned my addr 172.21.15.33:0/392743575 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:49.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.429+0000 7f4c8effd700 1 -- 172.21.15.33:0/392743575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900ff0c0 con 0x7f4c900703f0 2024-02-15T18:21:49.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.429+0000 7f4c8effd700 1 --2- 172.21.15.33:0/392743575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fea90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f4c7800b5f0 tx=0x7f4c78006ee0).ready entity=mon.0 client_cookie=9f5dd64195c62418 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:49.431 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.429+0000 7f4c8dffb700 1 -- 172.21.15.33:0/392743575 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c7800d600 con 0x7f4c900703f0 2024-02-15T18:21:49.431 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.429+0000 7f4c8dffb700 1 -- 172.21.15.33:0/392743575 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f4c7800dbf0 con 0x7f4c900703f0 2024-02-15T18:21:49.431 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.429+0000 7f4c8dffb700 1 -- 172.21.15.33:0/392743575 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c78011ce0 con 0x7f4c900703f0 2024-02-15T18:21:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.430+0000 7f4c9532e700 1 -- 172.21.15.33:0/392743575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 msgr2=0x7f4c900fea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.430+0000 7f4c9532e700 1 --2- 172.21.15.33:0/392743575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fea90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f4c7800b5f0 tx=0x7f4c78006ee0).stop 2024-02-15T18:21:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.430+0000 7f4c9532e700 1 -- 172.21.15.33:0/392743575 shutdown_connections 2024-02-15T18:21:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.430+0000 7f4c9532e700 1 --2- 172.21.15.33:0/392743575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fea90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.430+0000 7f4c9532e700 1 -- 172.21.15.33:0/392743575 >> 172.21.15.33:0/392743575 conn(0x7f4c900f6530 msgr2=0x7f4c900f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.430+0000 7f4c9532e700 1 -- 172.21.15.33:0/392743575 shutdown_connections 2024-02-15T18:21:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.430+0000 7f4c9532e700 1 -- 172.21.15.33:0/392743575 wait complete. 2024-02-15T18:21:49.432 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.431+0000 7f4c9532e700 1 Processor -- start 2024-02-15T18:21:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.431+0000 7f4c9532e700 1 -- start start 2024-02-15T18:21:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.431+0000 7f4c9532e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.431+0000 7f4c9532e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900fa990 con 0x7f4c900703f0 2024-02-15T18:21:49.433 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.431+0000 7f4c8effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.431+0000 7f4c8effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57366/0 (socket says 172.21.15.33:57366) 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.431+0000 7f4c8effd700 1 -- 172.21.15.33:0/1562200508 learned_addr learned my addr 172.21.15.33:0/1562200508 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.431+0000 7f4c8effd700 1 -- 172.21.15.33:0/1562200508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7800b200 con 0x7f4c900703f0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.432+0000 7f4c8effd700 1 --2- 172.21.15.33:0/1562200508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fc510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f4c78011ed0 tx=0x7f4c78006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.432+0000 7f4c877fe700 1 -- 172.21.15.33:0/1562200508 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c7801b570 con 0x7f4c900703f0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.432+0000 7f4c9532e700 1 -- 172.21.15.33:0/1562200508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c900fab30 con 0x7f4c900703f0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.432+0000 7f4c877fe700 1 -- 172.21.15.33:0/1562200508 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f4c7801bb60 con 0x7f4c900703f0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.432+0000 7f4c877fe700 1 -- 172.21.15.33:0/1562200508 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4c7801aad0 con 0x7f4c900703f0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.432+0000 7f4c9532e700 1 -- 172.21.15.33:0/1562200508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c900fafc0 con 0x7f4c900703f0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.432+0000 7f4c877fe700 1 -- 172.21.15.33:0/1562200508 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f4c7800f070 con 0x7f4c900703f0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.432+0000 7f4c877fe700 1 -- 172.21.15.33:0/1562200508 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4c78025d00 con 0x7f4c900703f0 2024-02-15T18:21:49.434 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.433+0000 7f4c9532e700 1 -- 172.21.15.33:0/1562200508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c90045ad0 con 0x7f4c900703f0 2024-02-15T18:21:49.435 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.436+0000 7f4c877fe700 1 -- 172.21.15.33:0/1562200508 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f4c78016070 con 0x7f4c900703f0 2024-02-15T18:21:49.503 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.503+0000 7f4c9532e700 1 -- 172.21.15.33:0/1562200508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4c900008d0 con 0x7f4c900703f0 2024-02-15T18:21:49.503 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.504+0000 7f4c877fe700 1 -- 172.21.15.33:0/1562200508 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f4c78006a70 con 0x7f4c900703f0 2024-02-15T18:21:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.504+0000 7f4c9532e700 1 -- 172.21.15.33:0/1562200508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 msgr2=0x7f4c900fc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.504+0000 7f4c9532e700 1 --2- 172.21.15.33:0/1562200508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fc510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f4c78011ed0 tx=0x7f4c78006ee0).stop 2024-02-15T18:21:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.504+0000 7f4c9532e700 1 -- 172.21.15.33:0/1562200508 shutdown_connections 2024-02-15T18:21:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.504+0000 7f4c9532e700 1 --2- 172.21.15.33:0/1562200508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c900703f0 0x7f4c900fc510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.504+0000 7f4c9532e700 1 -- 172.21.15.33:0/1562200508 >> 172.21.15.33:0/1562200508 conn(0x7f4c900f6530 msgr2=0x7f4c900f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.504+0000 7f4c9532e700 1 -- 172.21.15.33:0/1562200508 shutdown_connections 2024-02-15T18:21:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:49.504+0000 7f4c9532e700 1 -- 172.21.15.33:0/1562200508 wait complete. 2024-02-15T18:21:49.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: audit 2024-02-15T18:21:49.504571+0000 mon.smithi033 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.33:0/1562200508' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:Restarting the monitor... 2024-02-15T18:21:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl restart ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033 2024-02-15T18:21:50.523 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:50 smithi033 systemd[1]: Stopping Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:21:50.523 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: debug 2024-02-15T18:21:50.237+0000 7ff5f80c3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi033 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:21:50.523 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[37715]: debug 2024-02-15T18:21:50.238+0000 7ff5f80c3700 -1 mon.smithi033@0(leader) e1 *** Got Signal Terminated *** 2024-02-15T18:21:50.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:50 smithi033 podman[38040]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033 2024-02-15T18:21:51.306 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:50 smithi033 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033.service: Succeeded. 2024-02-15T18:21:51.306 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:50 smithi033 systemd[1]: Stopped Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:21:51.306 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:50 smithi033 systemd[1]: Starting Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:21:53.559 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.211+0000 7fd5b737f700 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-15T18:21:53.559 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.211+0000 7fd5b737f700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2024-02-15T18:21:53.559 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.211+0000 7fd5b737f700 0 pidfile_write: ignore empty --pid-file 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.216+0000 7fd5b737f700 0 load: jerasure load: lrc load: isa 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: RocksDB version: 6.8.1 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Compile date May 13 2021 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: DB SUMMARY 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: CURRENT file: CURRENT 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: IDENTITY file: IDENTITY 2024-02-15T18:21:53.560 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi033/store.db dir, Total Num: 1, files: 000004.sst 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi033/store.db: 000006.log size: 98708 ; 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.error_if_exists: 0 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.create_if_missing: 0 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.paranoid_checks: 1 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.env: 0x558d7ad281c0 2024-02-15T18:21:53.561 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.fs: Posix File System 2024-02-15T18:21:53.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.info_log: 0x558d7b847960 2024-02-15T18:21:53.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-15T18:21:53.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.statistics: (nil) 2024-02-15T18:21:53.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.use_fsync: 0 2024-02-15T18:21:53.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_log_file_size: 0 2024-02-15T18:21:53.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T18:21:53.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T18:21:53.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-15T18:21:53.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.allow_fallocate: 1 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.use_direct_reads: 0 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.create_missing_column_families: 0 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.db_log_dir: 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi033/store.db 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_subcompactions: 1 2024-02-15T18:21:53.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_background_flushes: -1 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.advise_random_on_open: 1 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.write_buffer_manager: 0x558d7c4bc030 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T18:21:53.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.rate_limiter: (nil) 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.unordered_write: 0 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T18:21:53.565 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.row_cache: None 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.wal_filter: None 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.preserve_deletes: 0 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.two_write_queues: 0 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.manual_wal_flush: 0 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.atomic_flush: 0 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T18:21:53.566 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.log_readahead_size: 0 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_background_jobs: 2 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_background_compactions: -1 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_total_wal_size: 0 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_open_files: -1 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.bytes_per_sync: 0 2024-02-15T18:21:53.567 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Compression algorithms supported: 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: kZSTD supported: 0 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: kXpressCompression supported: 0 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: kLZ4Compression supported: 1 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: kBZip2Compression supported: 0 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: kZlibCompression supported: 1 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: kSnappyCompression supported: 1 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T18:21:53.568 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000005 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.merge_operator: 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_filter: None 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_filter_factory: None 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558d7b75fcb0) 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cache_index_and_filter_blocks: 1 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T18:21:53.569 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: pin_top_level_index_and_filter: 1 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: index_type: 0 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: data_block_index_type: 0 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: index_shortening: 1 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: data_block_hash_table_util_ratio: 0.750000 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: hash_index_allow_collision: 1 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: checksum: 1 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: no_block_cache: 0 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: block_cache: 0x558d7b794f10 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: block_cache_name: BinnedLRUCache 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: block_cache_options: 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: capacity : 536870912 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: num_shard_bits : 4 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: strict_capacity_limit : 0 2024-02-15T18:21:53.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: high_pri_pool_ratio: 0.000 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: block_cache_compressed: (nil) 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: persistent_cache: (nil) 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: block_size: 4096 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: block_size_deviation: 10 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: block_restart_interval: 16 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: index_block_restart_interval: 1 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: metadata_block_size: 4096 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: partition_filters: 0 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: use_delta_encoding: 1 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: whole_key_filtering: 1 2024-02-15T18:21:53.571 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: verify_compression: 0 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: read_amp_bytes_per_bit: 0 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: format_version: 2 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: enable_index_compression: 1 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: block_align: 0 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compression: NoCompression 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-15T18:21:53.572 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-15T18:21:53.573 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T18:21:53.573 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.num_levels: 7 2024-02-15T18:21:53.573 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T18:21:53.573 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T18:21:53.573 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T18:21:53.573 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T18:21:53.573 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T18:21:53.573 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compression_opts.level: 32767 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compression_opts.enabled: false 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T18:21:53.574 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T18:21:53.575 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.arena_block_size: 4194304 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T18:21:53.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.table_properties_collectors: 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.inplace_update_support: 0 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.bloom_locality: 0 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.max_successive_merges: 0 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-15T18:21:53.577 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.force_consistency_checks: 0 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.ttl: 2592000 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.217+0000 7fd5b737f700 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.218+0000 7fd5b737f700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.218+0000 7fd5b737f700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.218+0000 7fd5b737f700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021313218932, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.218+0000 7fd5b737f700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.218+0000 7fd5b737f700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.219+0000 7fd5b737f700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021313219945, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 94282, "table_properties": {"data_size": 92370, "index_size": 389, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12563, "raw_average_key_size": 49, "raw_value_size": 85401, "raw_average_value_size": 336, "num_data_blocks": 12, "num_entries": 254, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708021313, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.219+0000 7fd5b737f700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-02-15T18:21:53.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.219+0000 7fd5b737f700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021313220413, "job": 1, "event": "recovery_finished"} 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.220+0000 7fd5b737f700 4 rocksdb: DB pointer 0x558d7b859800 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.220+0000 7fd59e197700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.220+0000 7fd59e197700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ** DB Stats ** 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ** Compaction Stats [default] ** 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: L0 2/0 93.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.8 0.00 0.00 1 0.001 0 0 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Sum 2/0 93.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.8 0.00 0.00 1 0.001 0 0 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.8 0.00 0.00 1 0.001 0 0 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ** Compaction Stats [default] ** 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.8 0.00 0.00 1 0.001 0 0 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:21:53.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Cumulative compaction: 0.00 GB write, 27.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Interval compaction: 0.00 GB write, 27.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ** Compaction Stats [default] ** 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:21:53.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: L0 2/0 93.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.8 0.00 0.00 1 0.001 0 0 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Sum 2/0 93.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.8 0.00 0.00 1 0.001 0 0 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ** Compaction Stats [default] ** 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.8 0.00 0.00 1 0.001 0 0 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:21:53.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Cumulative compaction: 0.00 GB write, 27.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.221+0000 7fd5b737f700 0 starting mon.smithi033 rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi033 fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.222+0000 7fd5b737f700 1 mon.smithi033@-1(???) e1 preinit fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.222+0000 7fd5b737f700 0 mon.smithi033@-1(???).mds e1 new map 2024-02-15T18:21:53.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.222+0000 7fd5b737f700 0 mon.smithi033@-1(???).mds e1 print_map 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: e1 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: legacy client fscid: -1 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: No filesystems configured 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.222+0000 7fd5b737f700 0 mon.smithi033@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.222+0000 7fd5b737f700 0 mon.smithi033@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.222+0000 7fd5b737f700 0 mon.smithi033@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T18:21:53.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.222+0000 7fd5b737f700 0 mon.smithi033@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T18:21:53.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:21:49.504571+0000 mon.smithi033 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.33:0/1562200508' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:21:53.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:21:53.222+0000 7fd5b737f700 1 mon.smithi033@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-15T18:21:53.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:21:53.240421+0000 mon.smithi033 (mon.0) 1 : cluster [INF] mon.smithi033 is new leader, mons smithi033 in quorum (ranks 0) 2024-02-15T18:21:53.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:21:53.240468+0000 mon.smithi033 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} 2024-02-15T18:21:53.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:21:53.240507+0000 mon.smithi033 (mon.0) 3 : cluster [DBG] fsmap 2024-02-15T18:21:53.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:21:53.240536+0000 mon.smithi033 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-15T18:21:53.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:21:53.240930+0000 mon.smithi033 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-15T18:21:53.836 INFO:teuthology.orchestra.run.smithi033.stderr:Setting mon public_network to 172.21.0.0/20 2024-02-15T18:21:53.837 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mon public_network 172.21.0.0/20 2024-02-15T18:21:54.096 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 bash[38111]: 04c43c0cba2108843df23fbb04e6e6ecadc562defbb04148e2d65d8b85ad7ca5 2024-02-15T18:21:54.096 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:53 smithi033 systemd[1]: Started Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:21:54.478 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.478+0000 7f05e3458700 1 Processor -- start 2024-02-15T18:21:54.478 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.478+0000 7f05e3458700 1 -- start start 2024-02-15T18:21:54.478 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.478+0000 7f05e3458700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:54.479 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.478+0000 7f05e3458700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0fc6e0 con 0x7f05dc0703d0 2024-02-15T18:21:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.479+0000 7f05e2456700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.479+0000 7f05e2456700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc100cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57368/0 (socket says 172.21.15.33:57368) 2024-02-15T18:21:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.479+0000 7f05e2456700 1 -- 172.21.15.33:0/422995198 learned_addr learned my addr 172.21.15.33:0/422995198 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.479+0000 7f05e2456700 1 -- 172.21.15.33:0/422995198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc1011e0 con 0x7f05dc0703d0 2024-02-15T18:21:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.479+0000 7f05e2456700 1 --2- 172.21.15.33:0/422995198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc100cf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f05d800b5f0 tx=0x7f05d8006ee0).ready entity=mon.0 client_cookie=9cc92588405e2c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e1454700 1 -- 172.21.15.33:0/422995198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d800d600 con 0x7f05dc0703d0 2024-02-15T18:21:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e1454700 1 -- 172.21.15.33:0/422995198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f05d800dbf0 con 0x7f05dc0703d0 2024-02-15T18:21:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e1454700 1 -- 172.21.15.33:0/422995198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d8011cb0 con 0x7f05dc0703d0 2024-02-15T18:21:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e3458700 1 -- 172.21.15.33:0/422995198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 msgr2=0x7f05dc100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:54.481 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e3458700 1 --2- 172.21.15.33:0/422995198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc100cf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f05d800b5f0 tx=0x7f05d8006ee0).stop 2024-02-15T18:21:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e3458700 1 -- 172.21.15.33:0/422995198 shutdown_connections 2024-02-15T18:21:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e3458700 1 --2- 172.21.15.33:0/422995198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc100cf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e3458700 1 -- 172.21.15.33:0/422995198 >> 172.21.15.33:0/422995198 conn(0x7f05dc0f6390 msgr2=0x7f05dc0f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e3458700 1 -- 172.21.15.33:0/422995198 shutdown_connections 2024-02-15T18:21:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.480+0000 7f05e3458700 1 -- 172.21.15.33:0/422995198 wait complete. 2024-02-15T18:21:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.481+0000 7f05e3458700 1 Processor -- start 2024-02-15T18:21:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.481+0000 7f05e3458700 1 -- start start 2024-02-15T18:21:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.481+0000 7f05e3458700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc10cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.481+0000 7f05e3458700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc10d090 con 0x7f05dc0703d0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.481+0000 7f05e2456700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc10cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.481+0000 7f05e2456700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc10cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57384/0 (socket says 172.21.15.33:57384) 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.481+0000 7f05e2456700 1 -- 172.21.15.33:0/774234930 learned_addr learned my addr 172.21.15.33:0/774234930 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.482+0000 7f05e2456700 1 -- 172.21.15.33:0/774234930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d800b200 con 0x7f05dc0703d0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.482+0000 7f05e2456700 1 --2- 172.21.15.33:0/774234930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc10cba0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f05d8006a20 tx=0x7f05d8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.482+0000 7f05caffd700 1 -- 172.21.15.33:0/774234930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d801b570 con 0x7f05dc0703d0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.482+0000 7f05caffd700 1 -- 172.21.15.33:0/774234930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f05d801bb60 con 0x7f05dc0703d0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.482+0000 7f05e3458700 1 -- 172.21.15.33:0/774234930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc10d290 con 0x7f05dc0703d0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.482+0000 7f05caffd700 1 -- 172.21.15.33:0/774234930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d801aa20 con 0x7f05dc0703d0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.482+0000 7f05e3458700 1 -- 172.21.15.33:0/774234930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc10d720 con 0x7f05dc0703d0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.482+0000 7f05caffd700 1 -- 172.21.15.33:0/774234930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f05d800f070 con 0x7f05dc0703d0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.482+0000 7f05caffd700 1 -- 172.21.15.33:0/774234930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f05d8025d00 con 0x7f05dc0703d0 2024-02-15T18:21:54.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.483+0000 7f05e3458700 1 -- 172.21.15.33:0/774234930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc045ad0 con 0x7f05dc0703d0 2024-02-15T18:21:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.485+0000 7f05caffd700 1 -- 172.21.15.33:0/774234930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f05d8016070 con 0x7f05dc0703d0 2024-02-15T18:21:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.553+0000 7f05e3458700 1 -- 172.21.15.33:0/774234930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f05dc101e60 con 0x7f05dc0703d0 2024-02-15T18:21:54.554 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.555+0000 7f05caffd700 1 -- 172.21.15.33:0/774234930 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f05d8025460 con 0x7f05dc0703d0 2024-02-15T18:21:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.556+0000 7f05e3458700 1 -- 172.21.15.33:0/774234930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 msgr2=0x7f05dc10cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.556+0000 7f05e3458700 1 --2- 172.21.15.33:0/774234930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc10cba0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f05d8006a20 tx=0x7f05d8006ee0).stop 2024-02-15T18:21:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.556+0000 7f05e3458700 1 -- 172.21.15.33:0/774234930 shutdown_connections 2024-02-15T18:21:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.556+0000 7f05e3458700 1 --2- 172.21.15.33:0/774234930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05dc0703d0 0x7f05dc10cba0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.556+0000 7f05e3458700 1 -- 172.21.15.33:0/774234930 >> 172.21.15.33:0/774234930 conn(0x7f05dc0f6390 msgr2=0x7f05dc0f7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.556+0000 7f05e3458700 1 -- 172.21.15.33:0/774234930 shutdown_connections 2024-02-15T18:21:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:54.556+0000 7f05e3458700 1 -- 172.21.15.33:0/774234930 wait complete. 2024-02-15T18:21:55.366 INFO:teuthology.orchestra.run.smithi033.stderr:Wrote config to /etc/ceph/ceph.conf 2024-02-15T18:21:55.366 INFO:teuthology.orchestra.run.smithi033.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:21:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:Creating mgr... 2024-02-15T18:21:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying port 9283 ... 2024-02-15T18:21:55.370 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl daemon-reload 2024-02-15T18:21:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mgr.smithi033.apxevf 2024-02-15T18:21:55.506 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl reset-failed ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mgr.smithi033.apxevf 2024-02-15T18:21:55.512 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to reset failed state of unit ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mgr.smithi033.apxevf.service: Unit ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mgr.smithi033.apxevf.service not loaded. 2024-02-15T18:21:55.512 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mgr.smithi033.apxevf 2024-02-15T18:21:55.518 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715.target.wants/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mgr.smithi033.apxevf.service → /etc/systemd/system/ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@.service. 2024-02-15T18:21:55.608 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mgr.smithi033.apxevf 2024-02-15T18:21:55.619 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:21:54.555929+0000 mon.smithi033 (mon.0) 6 : audit [INF] from='client.? 172.21.15.33:0/774234930' entity='client.admin' 2024-02-15T18:21:56.246 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled firewalld.service 2024-02-15T18:21:56.255 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: disabled 2024-02-15T18:21:56.256 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active firewalld.service 2024-02-15T18:21:56.263 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2024-02-15T18:21:56.264 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld.service is not enabled 2024-02-15T18:21:56.264 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to enable service . firewalld.service is not available 2024-02-15T18:21:56.264 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[]>. firewalld.service is not available 2024-02-15T18:21:56.264 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled firewalld.service 2024-02-15T18:21:56.272 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: disabled 2024-02-15T18:21:56.272 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active firewalld.service 2024-02-15T18:21:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2024-02-15T18:21:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld.service is not enabled 2024-02-15T18:21:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-15T18:21:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr to start... 2024-02-15T18:21:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr... 2024-02-15T18:21:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2024-02-15T18:21:56.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.824+0000 7f740d465700 1 Processor -- start 2024-02-15T18:21:56.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.825+0000 7f740d465700 1 -- start start 2024-02-15T18:21:56.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.825+0000 7f740d465700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f7408100eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:56.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.825+0000 7f740d465700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74080fc8a0 con 0x7f74080703d0 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.825+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f7408100eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.825+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f7408100eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48976/0 (socket says 172.21.15.33:48976) 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.825+0000 7f7406ffd700 1 -- 172.21.15.33:0/1883245 learned_addr learned my addr 172.21.15.33:0/1883245 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.826+0000 7f7406ffd700 1 -- 172.21.15.33:0/1883245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74081013a0 con 0x7f74080703d0 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.826+0000 7f7406ffd700 1 --2- 172.21.15.33:0/1883245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f7408100eb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f73f800b5f0 tx=0x7f73f8006ee0).ready entity=mon.0 client_cookie=d65ef2458d6f04f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.826+0000 7f7405ffb700 1 -- 172.21.15.33:0/1883245 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f800d600 con 0x7f74080703d0 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.826+0000 7f7405ffb700 1 -- 172.21.15.33:0/1883245 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f73f800dbf0 con 0x7f74080703d0 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.826+0000 7f7405ffb700 1 -- 172.21.15.33:0/1883245 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f8011cb0 con 0x7f74080703d0 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.827+0000 7f740d465700 1 -- 172.21.15.33:0/1883245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 msgr2=0x7f7408100eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:56.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.827+0000 7f740d465700 1 --2- 172.21.15.33:0/1883245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f7408100eb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f73f800b5f0 tx=0x7f73f8006ee0).stop 2024-02-15T18:21:56.829 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.827+0000 7f740d465700 1 -- 172.21.15.33:0/1883245 shutdown_connections 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.827+0000 7f740d465700 1 --2- 172.21.15.33:0/1883245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f7408100eb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.827+0000 7f740d465700 1 -- 172.21.15.33:0/1883245 >> 172.21.15.33:0/1883245 conn(0x7f74080f6530 msgr2=0x7f74080f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.827+0000 7f740d465700 1 -- 172.21.15.33:0/1883245 shutdown_connections 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.827+0000 7f740d465700 1 -- 172.21.15.33:0/1883245 wait complete. 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.827+0000 7f740d465700 1 Processor -- start 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.827+0000 7f740d465700 1 -- start start 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f740d465700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f740810cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f740d465700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740810d2a0 con 0x7f74080703d0 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f740810cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f740810cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48982/0 (socket says 172.21.15.33:48982) 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f7406ffd700 1 -- 172.21.15.33:0/1669193851 learned_addr learned my addr 172.21.15.33:0/1669193851 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:21:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f7406ffd700 1 -- 172.21.15.33:0/1669193851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f800b200 con 0x7f74080703d0 2024-02-15T18:21:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f7406ffd700 1 --2- 172.21.15.33:0/1669193851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f740810cdb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f73f8006a20 tx=0x7f73f8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:21:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f73ef7fe700 1 -- 172.21.15.33:0/1669193851 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f801b570 con 0x7f74080703d0 2024-02-15T18:21:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f740d465700 1 -- 172.21.15.33:0/1669193851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740810d4a0 con 0x7f74080703d0 2024-02-15T18:21:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f73ef7fe700 1 -- 172.21.15.33:0/1669193851 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f73f801bb60 con 0x7f74080703d0 2024-02-15T18:21:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f73ef7fe700 1 -- 172.21.15.33:0/1669193851 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f801aa20 con 0x7f74080703d0 2024-02-15T18:21:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.828+0000 7f740d465700 1 -- 172.21.15.33:0/1669193851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740810e0e0 con 0x7f74080703d0 2024-02-15T18:21:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.829+0000 7f73ef7fe700 1 -- 172.21.15.33:0/1669193851 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f73f800f070 con 0x7f74080703d0 2024-02-15T18:21:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.829+0000 7f73ef7fe700 1 -- 172.21.15.33:0/1669193851 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f73f8025de0 con 0x7f74080703d0 2024-02-15T18:21:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.829+0000 7f740d465700 1 -- 172.21.15.33:0/1669193851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740810d930 con 0x7f74080703d0 2024-02-15T18:21:56.833 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.832+0000 7f73ef7fe700 1 -- 172.21.15.33:0/1669193851 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f73f8016070 con 0x7f74080703d0 2024-02-15T18:21:56.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.902+0000 7f740d465700 1 -- 172.21.15.33:0/1669193851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f74081020c0 con 0x7f74080703d0 2024-02-15T18:21:56.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.903+0000 7f73ef7fe700 1 -- 172.21.15.33:0/1669193851 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f73f8025460 con 0x7f74080703d0 2024-02-15T18:21:56.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2024-02-15T18:21:56.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "fd0b1c90-cc2e-11ee-95ba-87774f69a715", 2024-02-15T18:21:56.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2024-02-15T18:21:56.904 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-15T18:21:56.904 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2024-02-15T18:21:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2024-02-15T18:21:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:21:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-15T18:21:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2024-02-15T18:21:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2024-02-15T18:21:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2024-02-15T18:21:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-15T18:21:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "smithi033" 2024-02-15T18:21:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2024-02-15T18:21:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 3, 2024-02-15T18:21:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2024-02-15T18:21:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:21:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-15T18:21:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-15T18:21:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-15T18:21:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": false, 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2024-02-15T18:21:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2024-02-15T18:21:46.103613+0000", 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-15T18:21:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2024-02-15T18:21:56.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.903+0000 7f740d465700 1 -- 172.21.15.33:0/1669193851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 msgr2=0x7f740810cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:21:56.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.903+0000 7f740d465700 1 --2- 172.21.15.33:0/1669193851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f740810cdb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f73f8006a20 tx=0x7f73f8006ee0).stop 2024-02-15T18:21:56.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.904+0000 7f740d465700 1 -- 172.21.15.33:0/1669193851 shutdown_connections 2024-02-15T18:21:56.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.904+0000 7f740d465700 1 --2- 172.21.15.33:0/1669193851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080703d0 0x7f740810cdb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:21:56.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.904+0000 7f740d465700 1 -- 172.21.15.33:0/1669193851 >> 172.21.15.33:0/1669193851 conn(0x7f74080f6530 msgr2=0x7f74080f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:21:56.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.904+0000 7f740d465700 1 -- 172.21.15.33:0/1669193851 shutdown_connections 2024-02-15T18:21:56.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:21:56.904+0000 7f740d465700 1 -- 172.21.15.33:0/1669193851 wait complete. 2024-02-15T18:21:57.282 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:21:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:21:56.903524+0000 mon.smithi033 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.33:0/1669193851' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T18:21:57.542 INFO:teuthology.orchestra.run.smithi033.stderr:mgr not available, waiting (1/15)... 2024-02-15T18:21:59.545 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2024-02-15T18:22:00.137 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.135+0000 7f0e1053e700 1 Processor -- start 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.135+0000 7f0e1053e700 1 -- start start 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.135+0000 7f0e1053e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080feab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.135+0000 7f0e1053e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080fefa0 con 0x7f0e080703d0 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.136+0000 7f0e0e2da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.136+0000 7f0e0e2da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080feab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48996/0 (socket says 172.21.15.33:48996) 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.136+0000 7f0e0e2da700 1 -- 172.21.15.33:0/4182012055 learned_addr learned my addr 172.21.15.33:0/4182012055 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.136+0000 7f0e0e2da700 1 -- 172.21.15.33:0/4182012055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e080ff0e0 con 0x7f0e080703d0 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.136+0000 7f0e0e2da700 1 --2- 172.21.15.33:0/4182012055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080feab0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f0e0400b5f0 tx=0x7f0e04006ee0).ready entity=mon.0 client_cookie=7ce7600201048ef1 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.136+0000 7f0e0d2d8700 1 -- 172.21.15.33:0/4182012055 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e0400d600 con 0x7f0e080703d0 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.136+0000 7f0e0d2d8700 1 -- 172.21.15.33:0/4182012055 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f0e0400dbf0 con 0x7f0e080703d0 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.136+0000 7f0e0d2d8700 1 -- 172.21.15.33:0/4182012055 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e04011cb0 con 0x7f0e080703d0 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.137+0000 7f0e1053e700 1 -- 172.21.15.33:0/4182012055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 msgr2=0x7f0e080feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.137+0000 7f0e1053e700 1 --2- 172.21.15.33:0/4182012055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080feab0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f0e0400b5f0 tx=0x7f0e04006ee0).stop 2024-02-15T18:22:00.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.137+0000 7f0e1053e700 1 -- 172.21.15.33:0/4182012055 shutdown_connections 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.137+0000 7f0e1053e700 1 --2- 172.21.15.33:0/4182012055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080feab0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.137+0000 7f0e1053e700 1 -- 172.21.15.33:0/4182012055 >> 172.21.15.33:0/4182012055 conn(0x7f0e080f6530 msgr2=0x7f0e080f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.137+0000 7f0e1053e700 1 -- 172.21.15.33:0/4182012055 shutdown_connections 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.137+0000 7f0e1053e700 1 -- 172.21.15.33:0/4182012055 wait complete. 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.137+0000 7f0e1053e700 1 Processor -- start 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.138+0000 7f0e1053e700 1 -- start start 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.138+0000 7f0e1053e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080fc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.138+0000 7f0e1053e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080fa9b0 con 0x7f0e080703d0 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.138+0000 7f0e0e2da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:00.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.138+0000 7f0e0e2da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080fc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49000/0 (socket says 172.21.15.33:49000) 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.138+0000 7f0e0e2da700 1 -- 172.21.15.33:0/3234752632 learned_addr learned my addr 172.21.15.33:0/3234752632 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.138+0000 7f0e0e2da700 1 -- 172.21.15.33:0/3234752632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0400b200 con 0x7f0e080703d0 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.138+0000 7f0e0e2da700 1 --2- 172.21.15.33:0/3234752632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080fc530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0e04006c70 tx=0x7f0e04006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.139+0000 7f0df6ffd700 1 -- 172.21.15.33:0/3234752632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e04011400 con 0x7f0e080703d0 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.139+0000 7f0df6ffd700 1 -- 172.21.15.33:0/3234752632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f0e0401b8a0 con 0x7f0e080703d0 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.139+0000 7f0e1053e700 1 -- 172.21.15.33:0/3234752632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e080fab50 con 0x7f0e080703d0 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.139+0000 7f0e1053e700 1 -- 172.21.15.33:0/3234752632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e080fafe0 con 0x7f0e080703d0 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.139+0000 7f0df6ffd700 1 -- 172.21.15.33:0/3234752632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e0401a7c0 con 0x7f0e080703d0 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.139+0000 7f0df6ffd700 1 -- 172.21.15.33:0/3234752632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f0e0400f070 con 0x7f0e080703d0 2024-02-15T18:22:00.140 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.139+0000 7f0df6ffd700 1 -- 172.21.15.33:0/3234752632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0e04025c30 con 0x7f0e080703d0 2024-02-15T18:22:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.140+0000 7f0e1053e700 1 -- 172.21.15.33:0/3234752632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de8004fa0 con 0x7f0e080703d0 2024-02-15T18:22:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.142+0000 7f0df6ffd700 1 -- 172.21.15.33:0/3234752632 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f0e04016070 con 0x7f0e080703d0 2024-02-15T18:22:00.220 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.213+0000 7f0e1053e700 1 -- 172.21.15.33:0/3234752632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0de8005670 con 0x7f0e080703d0 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.214+0000 7f0df6ffd700 1 -- 172.21.15.33:0/3234752632 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f0e04025460 con 0x7f0e080703d0 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "fd0b1c90-cc2e-11ee-95ba-87774f69a715", 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2024-02-15T18:22:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "smithi033" 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 6, 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-15T18:22:00.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-15T18:22:00.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": false, 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2024-02-15T18:21:46.103613+0000", 2024-02-15T18:22:00.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.214+0000 7f0e1053e700 1 -- 172.21.15.33:0/3234752632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 msgr2=0x7f0e080fc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.214+0000 7f0e1053e700 1 --2- 172.21.15.33:0/3234752632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080fc530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f0e04006c70 tx=0x7f0e04006ee0).stop 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.214+0000 7f0e1053e700 1 -- 172.21.15.33:0/3234752632 shutdown_connections 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.214+0000 7f0e1053e700 1 --2- 172.21.15.33:0/3234752632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e080703d0 0x7f0e080fc530 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.214+0000 7f0e1053e700 1 -- 172.21.15.33:0/3234752632 >> 172.21.15.33:0/3234752632 conn(0x7f0e080f6530 msgr2=0x7f0e080f7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.215+0000 7f0e1053e700 1 -- 172.21.15.33:0/3234752632 shutdown_connections 2024-02-15T18:22:00.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:00.215+0000 7f0e1053e700 1 -- 172.21.15.33:0/3234752632 wait complete. 2024-02-15T18:22:00.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:00.214506+0000 mon.smithi033 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.33:0/3234752632' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T18:22:00.916 INFO:teuthology.orchestra.run.smithi033.stderr:mgr not available, waiting (2/15)... 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:01.372027+0000 mon.smithi033 (mon.0) 9 : cluster [INF] Activating manager daemon smithi033.apxevf 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:01.374465+0000 mon.smithi033 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi033.apxevf(active, starting, since 0.0025322s) 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.375347+0000 mon.smithi033 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.375538+0000 mon.smithi033 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.375677+0000 mon.smithi033 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.375812+0000 mon.smithi033 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.376397+0000 mon.smithi033 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi033.apxevf", "id": "smithi033.apxevf"}]: dispatch 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:01.389918+0000 mon.smithi033 (mon.0) 16 : cluster [INF] Manager daemon smithi033.apxevf is now available 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.397271+0000 mon.smithi033 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.402680+0000 mon.smithi033 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:22:01.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.403807+0000 mon.smithi033 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:22:01.807 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.408641+0000 mon.smithi033 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:01.807 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:01.410404+0000 mon.smithi033 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.33:0/1555237263' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:02.918 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.468+0000 7f3c57d82700 1 Processor -- start 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.468+0000 7f3c57d82700 1 -- start start 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.468+0000 7f3c57d82700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c500fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.468+0000 7f3c57d82700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500fc7b0 con 0x7f3c500fbea0 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.468+0000 7f3c55b1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c500fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.468+0000 7f3c55b1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c500fc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49058/0 (socket says 172.21.15.33:49058) 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.468+0000 7f3c55b1e700 1 -- 172.21.15.33:0/2105242351 learned_addr learned my addr 172.21.15.33:0/2105242351 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.469+0000 7f3c55b1e700 1 -- 172.21.15.33:0/2105242351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c500fc8f0 con 0x7f3c500fbea0 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.469+0000 7f3c55b1e700 1 --2- 172.21.15.33:0/2105242351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c500fc2c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3c4c00b5f0 tx=0x7f3c4c006ee0).ready entity=mon.0 client_cookie=7c814fe2294550e server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.469+0000 7f3c54b1c700 1 -- 172.21.15.33:0/2105242351 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c4c00d600 con 0x7f3c500fbea0 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.469+0000 7f3c54b1c700 1 -- 172.21.15.33:0/2105242351 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f3c4c00dbf0 con 0x7f3c500fbea0 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.469+0000 7f3c54b1c700 1 -- 172.21.15.33:0/2105242351 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c4c011cb0 con 0x7f3c500fbea0 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.469+0000 7f3c57d82700 1 -- 172.21.15.33:0/2105242351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 msgr2=0x7f3c500fc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.469+0000 7f3c57d82700 1 --2- 172.21.15.33:0/2105242351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c500fc2c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3c4c00b5f0 tx=0x7f3c4c006ee0).stop 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.470+0000 7f3c57d82700 1 -- 172.21.15.33:0/2105242351 shutdown_connections 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.470+0000 7f3c57d82700 1 --2- 172.21.15.33:0/2105242351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c500fc2c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.470+0000 7f3c57d82700 1 -- 172.21.15.33:0/2105242351 >> 172.21.15.33:0/2105242351 conn(0x7f3c500f76a0 msgr2=0x7f3c500f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.470+0000 7f3c57d82700 1 -- 172.21.15.33:0/2105242351 shutdown_connections 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.470+0000 7f3c57d82700 1 -- 172.21.15.33:0/2105242351 wait complete. 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.470+0000 7f3c57d82700 1 Processor -- start 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.470+0000 7f3c57d82700 1 -- start start 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.470+0000 7f3c57d82700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c5010ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.470+0000 7f3c57d82700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5010d2f0 con 0x7f3c500fbea0 2024-02-15T18:22:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c55b1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c5010ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c55b1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c5010ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49070/0 (socket says 172.21.15.33:49070) 2024-02-15T18:22:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c55b1e700 1 -- 172.21.15.33:0/3563036725 learned_addr learned my addr 172.21.15.33:0/3563036725 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c55b1e700 1 -- 172.21.15.33:0/3563036725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c00b200 con 0x7f3c500fbea0 2024-02-15T18:22:03.474 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c55b1e700 1 --2- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c5010ce00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3c4c00bf40 tx=0x7f3c4c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:03.474 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c3e7fc700 1 -- 172.21.15.33:0/3563036725 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c4c01b570 con 0x7f3c500fbea0 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5010d4f0 con 0x7f3c500fbea0 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c3e7fc700 1 -- 172.21.15.33:0/3563036725 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f3c4c01bb60 con 0x7f3c500fbea0 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c3e7fc700 1 -- 172.21.15.33:0/3563036725 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c4c01aa20 con 0x7f3c500fbea0 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.471+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5010e100 con 0x7f3c500fbea0 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.472+0000 7f3c3e7fc700 1 -- 172.21.15.33:0/3563036725 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 3) v1 ==== 36029+0+0 (secure 0 0 0) 0x7f3c4c00f070 con 0x7f3c500fbea0 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.472+0000 7f3c3e7fc700 1 --2- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f3c3802fd10 0x7f3c380321d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.472+0000 7f3c3e7fc700 1 -- 172.21.15.33:0/3563036725 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3c4c0412b0 con 0x7f3c500fbea0 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.472+0000 7f3c5531d700 1 --2- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f3c3802fd10 0x7f3c380321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.472+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c50059100 con 0x7f3c500fbea0 2024-02-15T18:22:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.473+0000 7f3c5531d700 1 --2- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f3c3802fd10 0x7f3c380321d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3c400096a0 tx=0x7f3c40006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.477+0000 7f3c3e7fc700 1 -- 172.21.15.33:0/3563036725 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3c4c016070 con 0x7f3c500fbea0 2024-02-15T18:22:03.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:02.377905+0000 mon.smithi033 (mon.0) 22 : cluster [DBG] mgrmap e3: smithi033.apxevf(active, since 1.00597s) 2024-02-15T18:22:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.693+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3c500fdc30 con 0x7f3c500fbea0 2024-02-15T18:22:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.693+0000 7f3c3e7fc700 1 -- 172.21.15.33:0/3563036725 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f3c4c010360 con 0x7f3c500fbea0 2024-02-15T18:22:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2024-02-15T18:22:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "fd0b1c90-cc2e-11ee-95ba-87774f69a715", 2024-02-15T18:22:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2024-02-15T18:22:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-15T18:22:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2024-02-15T18:22:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "smithi033" 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 10, 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-15T18:22:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-15T18:22:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": true, 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-15T18:22:03.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2024-02-15T18:21:46.103613+0000", 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f3c3802fd10 msgr2=0x7f3c380321d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:03.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 --2- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f3c3802fd10 0x7f3c380321d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3c400096a0 tx=0x7f3c40006b40).stop 2024-02-15T18:22:03.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 msgr2=0x7f3c5010ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:03.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 --2- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c5010ce00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3c4c00bf40 tx=0x7f3c4c006ee0).stop 2024-02-15T18:22:03.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 shutdown_connections 2024-02-15T18:22:03.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 --2- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f3c3802fd10 0x7f3c380321d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:03.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 --2- 172.21.15.33:0/3563036725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c500fbea0 0x7f3c5010ce00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:03.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 >> 172.21.15.33:0/3563036725 conn(0x7f3c500f76a0 msgr2=0x7f3c500f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:03.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 shutdown_connections 2024-02-15T18:22:03.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:03.695+0000 7f3c57d82700 1 -- 172.21.15.33:0/3563036725 wait complete. 2024-02-15T18:22:04.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:03.694181+0000 mon.smithi033 (mon.0) 23 : audit [DBG] from='client.? 172.21.15.33:0/3563036725' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-15T18:22:05.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:04.380347+0000 mon.smithi033 (mon.0) 24 : cluster [DBG] mgrmap e4: smithi033.apxevf(active, since 3s) 2024-02-15T18:22:07.131 INFO:teuthology.orchestra.run.smithi033.stderr:mgr is available 2024-02-15T18:22:07.131 INFO:teuthology.orchestra.run.smithi033.stderr:Enabling cephadm module... 2024-02-15T18:22:07.131 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable cephadm 2024-02-15T18:22:11.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.652+0000 7f10a5b71700 1 Processor -- start 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.652+0000 7f10a5b71700 1 -- start start 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.652+0000 7f10a5b71700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.652+0000 7f10a5b71700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00fc8c0 con 0x7f10a00703b0 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.653+0000 7f109f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.653+0000 7f109f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a0100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39546/0 (socket says 172.21.15.33:39546) 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.653+0000 7f109f7fe700 1 -- 172.21.15.33:0/3198651915 learned_addr learned my addr 172.21.15.33:0/3198651915 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.653+0000 7f109f7fe700 1 -- 172.21.15.33:0/3198651915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a01013c0 con 0x7f10a00703b0 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.653+0000 7f109f7fe700 1 --2- 172.21.15.33:0/3198651915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a0100ed0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f109000b5f0 tx=0x7f1090006ee0).ready entity=mon.0 client_cookie=2be77852237b6e09 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.653+0000 7f109e7fc700 1 -- 172.21.15.33:0/3198651915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f109000d600 con 0x7f10a00703b0 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.653+0000 7f109e7fc700 1 -- 172.21.15.33:0/3198651915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f109000dbf0 con 0x7f10a00703b0 2024-02-15T18:22:11.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.653+0000 7f109e7fc700 1 -- 172.21.15.33:0/3198651915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1090011cb0 con 0x7f10a00703b0 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.654+0000 7f10a5b71700 1 -- 172.21.15.33:0/3198651915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 msgr2=0x7f10a0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.654+0000 7f10a5b71700 1 --2- 172.21.15.33:0/3198651915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a0100ed0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f109000b5f0 tx=0x7f1090006ee0).stop 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.654+0000 7f10a5b71700 1 -- 172.21.15.33:0/3198651915 shutdown_connections 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.654+0000 7f10a5b71700 1 --2- 172.21.15.33:0/3198651915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a0100ed0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.654+0000 7f10a5b71700 1 -- 172.21.15.33:0/3198651915 >> 172.21.15.33:0/3198651915 conn(0x7f10a00f6530 msgr2=0x7f10a00f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.654+0000 7f10a5b71700 1 -- 172.21.15.33:0/3198651915 shutdown_connections 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.654+0000 7f10a5b71700 1 -- 172.21.15.33:0/3198651915 wait complete. 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.654+0000 7f10a5b71700 1 Processor -- start 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.655+0000 7f10a5b71700 1 -- start start 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.655+0000 7f10a5b71700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a010cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.655+0000 7f10a5b71700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a010d270 con 0x7f10a00703b0 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.655+0000 7f109f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a010cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.655+0000 7f109f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a010cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39560/0 (socket says 172.21.15.33:39560) 2024-02-15T18:22:11.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.655+0000 7f109f7fe700 1 -- 172.21.15.33:0/3342599253 learned_addr learned my addr 172.21.15.33:0/3342599253 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.655+0000 7f109f7fe700 1 -- 172.21.15.33:0/3342599253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109000b200 con 0x7f10a00703b0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.655+0000 7f109f7fe700 1 --2- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a010cd80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f1090006800 tx=0x7f1090006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.656+0000 7f1087fff700 1 -- 172.21.15.33:0/3342599253 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f109001b570 con 0x7f10a00703b0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.656+0000 7f1087fff700 1 -- 172.21.15.33:0/3342599253 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f109001bb60 con 0x7f10a00703b0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.656+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a010d470 con 0x7f10a00703b0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.656+0000 7f1087fff700 1 -- 172.21.15.33:0/3342599253 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f109001a9f0 con 0x7f10a00703b0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.656+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a010e080 con 0x7f10a00703b0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.656+0000 7f1087fff700 1 -- 172.21.15.33:0/3342599253 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 36109+0+0 (secure 0 0 0) 0x7f109000f070 con 0x7f10a00703b0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.657+0000 7f1087fff700 1 --2- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f108c02fe10 0x7f108c0322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.657+0000 7f1087fff700 1 -- 172.21.15.33:0/3342599253 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f10900412a0 con 0x7f10a00703b0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.657+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0059100 con 0x7f10a00703b0 2024-02-15T18:22:11.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.657+0000 7f109effd700 1 --2- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f108c02fe10 0x7f108c0322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.657+0000 7f109effd700 1 --2- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f108c02fe10 0x7f108c0322d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f10940096a0 tx=0x7f1094006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.661+0000 7f1087fff700 1 -- 172.21.15.33:0/3342599253 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1090016070 con 0x7f10a00703b0 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.861+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f10a01020e0 con 0x7f10a00703b0 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.913+0000 7f1087fff700 1 -- 172.21.15.33:0/3342599253 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f109001ab50 con 0x7f10a00703b0 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.915+0000 7f1087fff700 1 -- 172.21.15.33:0/3342599253 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f10900243c0 con 0x7f10a00703b0 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.916+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f108c02fe10 msgr2=0x7f108c0322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.916+0000 7f10a5b71700 1 --2- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f108c02fe10 0x7f108c0322d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f10940096a0 tx=0x7f1094006b40).stop 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.917+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 msgr2=0x7f10a010cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.917+0000 7f10a5b71700 1 --2- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a010cd80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f1090006800 tx=0x7f1090006ee0).stop 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.917+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 shutdown_connections 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.917+0000 7f10a5b71700 1 --2- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f108c02fe10 0x7f108c0322d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.917+0000 7f10a5b71700 1 --2- 172.21.15.33:0/3342599253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00703b0 0x7f10a010cd80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.917+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 >> 172.21.15.33:0/3342599253 conn(0x7f10a00f6530 msgr2=0x7f10a00f7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:11.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.917+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 shutdown_connections 2024-02-15T18:22:11.201 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:10.917+0000 7f10a5b71700 1 -- 172.21.15.33:0/3342599253 wait complete. 2024-02-15T18:22:11.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:10.862534+0000 mon.smithi033 (mon.0) 25 : audit [INF] from='client.? 172.21.15.33:0/3342599253' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-15T18:22:12.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:10.915808+0000 mon.smithi033 (mon.0) 26 : audit [INF] from='client.? 172.21.15.33:0/3342599253' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-15T18:22:12.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:10.915861+0000 mon.smithi033 (mon.0) 27 : cluster [DBG] mgrmap e5: smithi033.apxevf(active, since 9s) 2024-02-15T18:22:14.962 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2024-02-15T18:22:15.554 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.553+0000 7f9d06b4e700 1 Processor -- start 2024-02-15T18:22:15.554 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.553+0000 7f9d06b4e700 1 -- start start 2024-02-15T18:22:15.554 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.553+0000 7f9d06b4e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d00100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:15.555 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.553+0000 7f9d06b4e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000fc8c0 con 0x7f9d000703b0 2024-02-15T18:22:15.555 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.553+0000 7f9d048ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d00100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:15.555 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.553+0000 7f9d048ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d00100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55444/0 (socket says 172.21.15.33:55444) 2024-02-15T18:22:15.555 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.553+0000 7f9d048ea700 1 -- 172.21.15.33:0/2834268611 learned_addr learned my addr 172.21.15.33:0/2834268611 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:15.555 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.554+0000 7f9d048ea700 1 -- 172.21.15.33:0/2834268611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d001013c0 con 0x7f9d000703b0 2024-02-15T18:22:15.555 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.554+0000 7f9d048ea700 1 --2- 172.21.15.33:0/2834268611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d00100ed0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9cf400b5f0 tx=0x7f9cf4006ee0).ready entity=mon.0 client_cookie=2e7f61c11fd8b7c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:15.558 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.554+0000 7f9cff7fe700 1 -- 172.21.15.33:0/2834268611 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cf400d600 con 0x7f9d000703b0 2024-02-15T18:22:15.558 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.554+0000 7f9cff7fe700 1 -- 172.21.15.33:0/2834268611 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f9cf400dbf0 con 0x7f9d000703b0 2024-02-15T18:22:15.558 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.554+0000 7f9cff7fe700 1 -- 172.21.15.33:0/2834268611 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cf4011cb0 con 0x7f9d000703b0 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.555+0000 7f9d06b4e700 1 -- 172.21.15.33:0/2834268611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 msgr2=0x7f9d00100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.555+0000 7f9d06b4e700 1 --2- 172.21.15.33:0/2834268611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d00100ed0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9cf400b5f0 tx=0x7f9cf4006ee0).stop 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.555+0000 7f9d06b4e700 1 -- 172.21.15.33:0/2834268611 shutdown_connections 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.555+0000 7f9d06b4e700 1 --2- 172.21.15.33:0/2834268611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d00100ed0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.555+0000 7f9d06b4e700 1 -- 172.21.15.33:0/2834268611 >> 172.21.15.33:0/2834268611 conn(0x7f9d000f6530 msgr2=0x7f9d000f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.555+0000 7f9d06b4e700 1 -- 172.21.15.33:0/2834268611 shutdown_connections 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.555+0000 7f9d06b4e700 1 -- 172.21.15.33:0/2834268611 wait complete. 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.556+0000 7f9d06b4e700 1 Processor -- start 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.556+0000 7f9d06b4e700 1 -- start start 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.556+0000 7f9d06b4e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d0010cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.556+0000 7f9d06b4e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0010d270 con 0x7f9d000703b0 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.556+0000 7f9d048ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d0010cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.556+0000 7f9d048ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d0010cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55446/0 (socket says 172.21.15.33:55446) 2024-02-15T18:22:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.556+0000 7f9d048ea700 1 -- 172.21.15.33:0/3104984489 learned_addr learned my addr 172.21.15.33:0/3104984489 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.557+0000 7f9d048ea700 1 -- 172.21.15.33:0/3104984489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf400b200 con 0x7f9d000703b0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.557+0000 7f9d048ea700 1 --2- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d0010cd80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9cf4006800 tx=0x7f9cf4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.557+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3104984489 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cf401b570 con 0x7f9d000703b0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.557+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3104984489 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f9cf401bb60 con 0x7f9d000703b0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.557+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0010d470 con 0x7f9d000703b0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.557+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3104984489 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cf401a9f0 con 0x7f9d000703b0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.557+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0010e080 con 0x7f9d000703b0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.558+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3104984489 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f9cf400f070 con 0x7f9d000703b0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.558+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d00059100 con 0x7f9d000703b0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.558+0000 7f9cfd7fa700 1 --2- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f9ce402fe10 0x7f9ce40322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.558+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3104984489 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f9cf4041470 con 0x7f9d000703b0 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.558+0000 7f9cfffff700 1 -- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f9ce402fe10 msgr2=0x7f9ce40322d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2905208543 2024-02-15T18:22:15.560 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.558+0000 7f9cfffff700 1 --2- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f9ce402fe10 0x7f9ce40322d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:22:15.563 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.563+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3104984489 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9cf4019cd0 con 0x7f9d000703b0 2024-02-15T18:22:15.760 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.760+0000 7f9cfffff700 1 -- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f9ce402fe10 msgr2=0x7f9ce40322d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2905208543 2024-02-15T18:22:15.760 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.760+0000 7f9cfffff700 1 --2- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f9ce402fe10 0x7f9ce40322d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-15T18:22:15.761 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.761+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9d001021c0 con 0x7f9d000703b0 2024-02-15T18:22:15.761 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.761+0000 7f9cfd7fa700 1 -- 172.21.15.33:0/3104984489 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f9cf4016070 con 0x7f9d000703b0 2024-02-15T18:22:15.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2024-02-15T18:22:15.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 5, 2024-02-15T18:22:15.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": true, 2024-02-15T18:22:15.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "active_name": "smithi033.apxevf", 2024-02-15T18:22:15.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-15T18:22:15.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2024-02-15T18:22:15.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f9ce402fe10 msgr2=0x7f9ce40322d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:22:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 --2- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f9ce402fe10 0x7f9ce40322d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 msgr2=0x7f9d0010cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 --2- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d0010cd80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9cf4006800 tx=0x7f9cf4006ee0).stop 2024-02-15T18:22:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 shutdown_connections 2024-02-15T18:22:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 --2- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:6800/2905208543,v1:172.21.15.33:6801/2905208543] conn(0x7f9ce402fe10 0x7f9ce40322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 --2- 172.21.15.33:0/3104984489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d000703b0 0x7f9d0010cd80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 >> 172.21.15.33:0/3104984489 conn(0x7f9d000f6530 msgr2=0x7f9d000f7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 shutdown_connections 2024-02-15T18:22:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:15.763+0000 7f9d06b4e700 1 -- 172.21.15.33:0/3104984489 wait complete. 2024-02-15T18:22:16.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:15.762054+0000 mon.smithi033 (mon.0) 28 : audit [DBG] from='client.? 172.21.15.33:0/3104984489' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-15T18:22:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for the mgr to restart... 2024-02-15T18:22:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr epoch 5... 2024-02-15T18:22:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2024-02-15T18:22:17.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:16.059963+0000 mon.smithi033 (mon.0) 29 : cluster [INF] Active manager daemon smithi033.apxevf restarted 2024-02-15T18:22:17.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:16.060353+0000 mon.smithi033 (mon.0) 30 : cluster [INF] Activating manager daemon smithi033.apxevf 2024-02-15T18:22:17.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:16.063103+0000 mon.smithi033 (mon.0) 31 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-15T18:22:17.141 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.137+0000 7f9469201700 1 Processor -- start 2024-02-15T18:22:17.141 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.137+0000 7f9469201700 1 -- start start 2024-02-15T18:22:17.141 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.137+0000 7f9469201700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:17.141 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.137+0000 7f9469201700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640fedd0 con 0x7f94640703f0 2024-02-15T18:22:17.141 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.137+0000 7f9462d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:17.141 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.137+0000 7f9462d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fe8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55502/0 (socket says 172.21.15.33:55502) 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.137+0000 7f9462d9d700 1 -- 172.21.15.33:0/843187779 learned_addr learned my addr 172.21.15.33:0/843187779 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.138+0000 7f9462d9d700 1 -- 172.21.15.33:0/843187779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640fef10 con 0x7f94640703f0 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.138+0000 7f9462d9d700 1 --2- 172.21.15.33:0/843187779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fe8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f945400b5f0 tx=0x7f9454006ee0).ready entity=mon.0 client_cookie=1844c2523350bde5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.138+0000 7f9461d9b700 1 -- 172.21.15.33:0/843187779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f945400d600 con 0x7f94640703f0 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.138+0000 7f9461d9b700 1 -- 172.21.15.33:0/843187779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f945400dbf0 con 0x7f94640703f0 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.138+0000 7f9461d9b700 1 -- 172.21.15.33:0/843187779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9454011ce0 con 0x7f94640703f0 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.138+0000 7f9469201700 1 -- 172.21.15.33:0/843187779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 msgr2=0x7f94640fe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.138+0000 7f9469201700 1 --2- 172.21.15.33:0/843187779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fe8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f945400b5f0 tx=0x7f9454006ee0).stop 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.139+0000 7f9469201700 1 -- 172.21.15.33:0/843187779 shutdown_connections 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.139+0000 7f9469201700 1 --2- 172.21.15.33:0/843187779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fe8e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.139+0000 7f9469201700 1 -- 172.21.15.33:0/843187779 >> 172.21.15.33:0/843187779 conn(0x7f94640f63c0 msgr2=0x7f94640f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.139+0000 7f9469201700 1 -- 172.21.15.33:0/843187779 shutdown_connections 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.139+0000 7f9469201700 1 -- 172.21.15.33:0/843187779 wait complete. 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.139+0000 7f9469201700 1 Processor -- start 2024-02-15T18:22:17.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.139+0000 7f9469201700 1 -- start start 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.139+0000 7f9469201700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.139+0000 7f9469201700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640fa7e0 con 0x7f94640703f0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f9462d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f9462d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55506/0 (socket says 172.21.15.33:55506) 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f9462d9d700 1 -- 172.21.15.33:0/3482706470 learned_addr learned my addr 172.21.15.33:0/3482706470 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f9462d9d700 1 -- 172.21.15.33:0/3482706470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945400b200 con 0x7f94640703f0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f9462d9d700 1 --2- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fc360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f94540115c0 tx=0x7f9454006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f944b7fe700 1 -- 172.21.15.33:0/3482706470 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f945401b410 con 0x7f94640703f0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f944b7fe700 1 -- 172.21.15.33:0/3482706470 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f945401ba00 con 0x7f94640703f0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f944b7fe700 1 -- 172.21.15.33:0/3482706470 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f945401aaa0 con 0x7f94640703f0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f9469201700 1 -- 172.21.15.33:0/3482706470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94640fa980 con 0x7f94640703f0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.140+0000 7f9469201700 1 -- 172.21.15.33:0/3482706470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94640fae10 con 0x7f94640703f0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.141+0000 7f944b7fe700 1 -- 172.21.15.33:0/3482706470 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 35970+0+0 (secure 0 0 0) 0x7f945400f070 con 0x7f94640703f0 2024-02-15T18:22:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.141+0000 7f944b7fe700 1 -- 172.21.15.33:0/3482706470 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f9454040e40 con 0x7f94640703f0 2024-02-15T18:22:17.822 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.821+0000 7f944b7fe700 1 -- 172.21.15.33:0/3482706470 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 7) v1 ==== 36040+0+0 (secure 0 0 0) 0x7f945401bb70 con 0x7f94640703f0 2024-02-15T18:22:17.822 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.821+0000 7f944b7fe700 1 --2- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f9450030b60 0x7f9450032f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:17.822 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.821+0000 7f944b7fe700 1 -- 172.21.15.33:0/3482706470 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9450033440 con 0x7f9450030b60 2024-02-15T18:22:17.822 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.822+0000 7f946259c700 1 --2- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f9450030b60 0x7f9450032f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:17.822 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.822+0000 7f946259c700 1 --2- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f9450030b60 0x7f9450032f50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f94580096a0 tx=0x7f9458006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:17.823 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.823+0000 7f944b7fe700 1 -- 172.21.15.33:0/3482706470 <== mgr.14114 v2:172.21.15.33:6800/3962763243 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f9450033440 con 0x7f9450030b60 2024-02-15T18:22:17.829 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.829+0000 7f9469201700 1 -- 172.21.15.33:0/3482706470 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f9464059100 con 0x7f9450030b60 2024-02-15T18:22:17.830 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.829+0000 7f944b7fe700 1 -- 172.21.15.33:0/3482706470 <== mgr.14114 v2:172.21.15.33:6800/3962763243 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9464059100 con 0x7f9450030b60 2024-02-15T18:22:17.830 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2024-02-15T18:22:17.830 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-02-15T18:22:17.830 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "initialized": true 2024-02-15T18:22:17.830 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2024-02-15T18:22:17.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 -- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f9450030b60 msgr2=0x7f9450032f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:17.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 --2- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f9450030b60 0x7f9450032f50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f94580096a0 tx=0x7f9458006b40).stop 2024-02-15T18:22:17.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 -- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 msgr2=0x7f94640fc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:17.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 --2- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fc360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f94540115c0 tx=0x7f9454006ee0).stop 2024-02-15T18:22:17.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 -- 172.21.15.33:0/3482706470 shutdown_connections 2024-02-15T18:22:17.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 --2- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f9450030b60 0x7f9450032f50 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:17.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 --2- 172.21.15.33:0/3482706470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94640703f0 0x7f94640fc360 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:17.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 -- 172.21.15.33:0/3482706470 >> 172.21.15.33:0/3482706470 conn(0x7f94640f63c0 msgr2=0x7f94640f7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:17.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 -- 172.21.15.33:0/3482706470 shutdown_connections 2024-02-15T18:22:17.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:17.830+0000 7f9469201700 1 -- 172.21.15.33:0/3482706470 wait complete. 2024-02-15T18:22:18.191 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:16.817667+0000 mon.smithi033 (mon.0) 32 : cluster [DBG] mgrmap e6: smithi033.apxevf(active, starting, since 0.757378s) 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.819067+0000 mon.smithi033 (mon.0) 33 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.819840+0000 mon.smithi033 (mon.0) 34 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi033.apxevf", "id": "smithi033.apxevf"}]: dispatch 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.820742+0000 mon.smithi033 (mon.0) 35 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.820935+0000 mon.smithi033 (mon.0) 36 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.821102+0000 mon.smithi033 (mon.0) 37 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:16.835573+0000 mon.smithi033 (mon.0) 38 : cluster [INF] Manager daemon smithi033.apxevf is now available 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.850249+0000 mon.smithi033 (mon.0) 39 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.853160+0000 mon.smithi033 (mon.0) 40 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.855842+0000 mon.smithi033 (mon.0) 41 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.953083+0000 mon.smithi033 (mon.0) 42 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:18.192 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.953744+0000 mon.smithi033 (mon.0) 43 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:18.193 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.955756+0000 mon.smithi033 (mon.0) 44 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:18.193 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.957162+0000 mon.smithi033 (mon.0) 45 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:18.193 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.967404+0000 mon.smithi033 (mon.0) 46 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:22:18.193 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:16.968657+0000 mon.smithi033 (mon.0) 47 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:22:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:mgr epoch 5 is available 2024-02-15T18:22:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:Setting orchestrator backend to cephadm... 2024-02-15T18:22:18.461 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch set backend cephadm 2024-02-15T18:22:19.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:17.823532+0000 mgr.smithi033.apxevf (mgr.14114) 1 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-15T18:22:19.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:17.824312+0000 mon.smithi033 (mon.0) 48 : cluster [DBG] mgrmap e7: smithi033.apxevf(active, since 1.76402s) 2024-02-15T18:22:19.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:17.830449+0000 mgr.smithi033.apxevf (mgr.14114) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.157+0000 7f3af90f7700 1 Processor -- start 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.157+0000 7f3af90f7700 1 -- start start 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.157+0000 7f3af90f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af40fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.157+0000 7f3af90f7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af40fedc0 con 0x7f3af40703f0 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.157+0000 7f3af3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af40fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.157+0000 7f3af3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af40fe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55508/0 (socket says 172.21.15.33:55508) 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.157+0000 7f3af3fff700 1 -- 172.21.15.33:0/373103730 learned_addr learned my addr 172.21.15.33:0/373103730 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.158+0000 7f3af3fff700 1 -- 172.21.15.33:0/373103730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af40fef00 con 0x7f3af40703f0 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.158+0000 7f3af3fff700 1 --2- 172.21.15.33:0/373103730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af40fe8d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3ae400b5f0 tx=0x7f3ae4006ee0).ready entity=mon.0 client_cookie=890bc8d7a530ace9 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.158+0000 7f3af2ffd700 1 -- 172.21.15.33:0/373103730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ae400d600 con 0x7f3af40703f0 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.158+0000 7f3af2ffd700 1 -- 172.21.15.33:0/373103730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f3ae400dbf0 con 0x7f3af40703f0 2024-02-15T18:22:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.158+0000 7f3af2ffd700 1 -- 172.21.15.33:0/373103730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ae4011ce0 con 0x7f3af40703f0 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.158+0000 7f3af90f7700 1 -- 172.21.15.33:0/373103730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 msgr2=0x7f3af40fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.158+0000 7f3af90f7700 1 --2- 172.21.15.33:0/373103730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af40fe8d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3ae400b5f0 tx=0x7f3ae4006ee0).stop 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.159+0000 7f3af90f7700 1 -- 172.21.15.33:0/373103730 shutdown_connections 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.159+0000 7f3af90f7700 1 --2- 172.21.15.33:0/373103730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af40fe8d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.159+0000 7f3af90f7700 1 -- 172.21.15.33:0/373103730 >> 172.21.15.33:0/373103730 conn(0x7f3af40f6390 msgr2=0x7f3af40f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.159+0000 7f3af90f7700 1 -- 172.21.15.33:0/373103730 shutdown_connections 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.159+0000 7f3af90f7700 1 -- 172.21.15.33:0/373103730 wait complete. 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.159+0000 7f3af90f7700 1 Processor -- start 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.159+0000 7f3af90f7700 1 -- start start 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.159+0000 7f3af90f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af410cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.159+0000 7f3af90f7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af410d070 con 0x7f3af40703f0 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af410cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af410cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55524/0 (socket says 172.21.15.33:55524) 2024-02-15T18:22:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af3fff700 1 -- 172.21.15.33:0/1160380283 learned_addr learned my addr 172.21.15.33:0/1160380283 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af3fff700 1 -- 172.21.15.33:0/1160380283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae400b200 con 0x7f3af40703f0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af3fff700 1 --2- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af410cb80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f3ae4011ed0 tx=0x7f3ae4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af0ff9700 1 -- 172.21.15.33:0/1160380283 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ae401b570 con 0x7f3af40703f0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af0ff9700 1 -- 172.21.15.33:0/1160380283 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f3ae401bb60 con 0x7f3af40703f0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af410d270 con 0x7f3af40703f0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af0ff9700 1 -- 172.21.15.33:0/1160380283 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ae401aad0 con 0x7f3af40703f0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.160+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af410d700 con 0x7f3af40703f0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.161+0000 7f3af0ff9700 1 -- 172.21.15.33:0/1160380283 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f3ae400f070 con 0x7f3af40703f0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.161+0000 7f3af0ff9700 1 --2- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f3ad402fe70 0x7f3ad4032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.161+0000 7f3af0ff9700 1 -- 172.21.15.33:0/1160380283 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f3ae40413d0 con 0x7f3af40703f0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.161+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af4045ad0 con 0x7f3af40703f0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.161+0000 7f3af37fe700 1 --2- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f3ad402fe70 0x7f3ad4032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:19.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.162+0000 7f3af37fe700 1 --2- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f3ad402fe70 0x7f3ad4032330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f3adc0096a0 tx=0x7f3adc006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:19.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.166+0000 7f3af0ff9700 1 -- 172.21.15.33:0/1160380283 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3ae4016070 con 0x7f3af40703f0 2024-02-15T18:22:19.355 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.355+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f3af410df60 con 0x7f3ad402fe70 2024-02-15T18:22:19.360 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.360+0000 7f3af0ff9700 1 -- 172.21.15.33:0/1160380283 <== mgr.14114 v2:172.21.15.33:6800/3962763243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3af410df60 con 0x7f3ad402fe70 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f3ad402fe70 msgr2=0x7f3ad4032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 --2- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f3ad402fe70 0x7f3ad4032330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f3adc0096a0 tx=0x7f3adc006b40).stop 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 msgr2=0x7f3af410cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 --2- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af410cb80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f3ae4011ed0 tx=0x7f3ae4006ee0).stop 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 shutdown_connections 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 --2- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f3ad402fe70 0x7f3ad4032330 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 --2- 172.21.15.33:0/1160380283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3af40703f0 0x7f3af410cb80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 >> 172.21.15.33:0/1160380283 conn(0x7f3af40f6390 msgr2=0x7f3af40f7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 shutdown_connections 2024-02-15T18:22:19.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:19.362+0000 7f3af90f7700 1 -- 172.21.15.33:0/1160380283 wait complete. 2024-02-15T18:22:19.984 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm set-user root 2024-02-15T18:22:19.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:18.827095+0000 mon.smithi033 (mon.0) 49 : cluster [DBG] mgrmap e8: smithi033.apxevf(active, since 2s) 2024-02-15T18:22:19.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:19.360882+0000 mon.smithi033 (mon.0) 50 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:19.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:19.364521+0000 mon.smithi033 (mon.0) 51 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.557+0000 7fc430429700 1 Processor -- start 2024-02-15T18:22:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.557+0000 7fc430429700 1 -- start start 2024-02-15T18:22:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc430429700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc428100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc430429700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4280fc8c0 con 0x7fc4280703b0 2024-02-15T18:22:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc42e1c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc428100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc42e1c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc428100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55530/0 (socket says 172.21.15.33:55530) 2024-02-15T18:22:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc42e1c5700 1 -- 172.21.15.33:0/2592895350 learned_addr learned my addr 172.21.15.33:0/2592895350 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc42e1c5700 1 -- 172.21.15.33:0/2592895350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4281013c0 con 0x7fc4280703b0 2024-02-15T18:22:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc42e1c5700 1 --2- 172.21.15.33:0/2592895350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc428100ed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc42400b5f0 tx=0x7fc424006ee0).ready entity=mon.0 client_cookie=74283cefaad1eb1f server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc42d1c3700 1 -- 172.21.15.33:0/2592895350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc42400d600 con 0x7fc4280703b0 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc42d1c3700 1 -- 172.21.15.33:0/2592895350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fc42400dbf0 con 0x7fc4280703b0 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.558+0000 7fc42d1c3700 1 -- 172.21.15.33:0/2592895350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc424011cb0 con 0x7fc4280703b0 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.559+0000 7fc430429700 1 -- 172.21.15.33:0/2592895350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 msgr2=0x7fc428100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.559+0000 7fc430429700 1 --2- 172.21.15.33:0/2592895350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc428100ed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc42400b5f0 tx=0x7fc424006ee0).stop 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.559+0000 7fc430429700 1 -- 172.21.15.33:0/2592895350 shutdown_connections 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.559+0000 7fc430429700 1 --2- 172.21.15.33:0/2592895350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc428100ed0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.559+0000 7fc430429700 1 -- 172.21.15.33:0/2592895350 >> 172.21.15.33:0/2592895350 conn(0x7fc4280f6530 msgr2=0x7fc4280f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.559+0000 7fc430429700 1 -- 172.21.15.33:0/2592895350 shutdown_connections 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.559+0000 7fc430429700 1 -- 172.21.15.33:0/2592895350 wait complete. 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.559+0000 7fc430429700 1 Processor -- start 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc430429700 1 -- start start 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc430429700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc42810cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc430429700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42810d270 con 0x7fc4280703b0 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc42e1c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc42810cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc42e1c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc42810cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55546/0 (socket says 172.21.15.33:55546) 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc42e1c5700 1 -- 172.21.15.33:0/231036827 learned_addr learned my addr 172.21.15.33:0/231036827 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc42e1c5700 1 -- 172.21.15.33:0/231036827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42400b200 con 0x7fc4280703b0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc42e1c5700 1 --2- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc42810cd80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc424006800 tx=0x7fc424006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc41affd700 1 -- 172.21.15.33:0/231036827 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc42401b570 con 0x7fc4280703b0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc41affd700 1 -- 172.21.15.33:0/231036827 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fc42401bb60 con 0x7fc4280703b0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42810d470 con 0x7fc4280703b0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc41affd700 1 -- 172.21.15.33:0/231036827 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc42401a9f0 con 0x7fc4280703b0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.560+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42810e080 con 0x7fc4280703b0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.561+0000 7fc41affd700 1 -- 172.21.15.33:0/231036827 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fc42400f070 con 0x7fc4280703b0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.561+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc428059100 con 0x7fc4280703b0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.561+0000 7fc41affd700 1 --2- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fc41002fe10 0x7fc4100322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.561+0000 7fc41affd700 1 -- 172.21.15.33:0/231036827 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fc4240414d0 con 0x7fc4280703b0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.562+0000 7fc42d9c4700 1 --2- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fc41002fe10 0x7fc4100322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.562+0000 7fc42d9c4700 1 --2- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fc41002fe10 0x7fc4100322d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc41c0096a0 tx=0x7fc41c006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:20.575 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.566+0000 7fc41affd700 1 -- 172.21.15.33:0/231036827 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc424010360 con 0x7fc4280703b0 2024-02-15T18:22:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.729+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fc42810e380 con 0x7fc41002fe10 2024-02-15T18:22:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.729+0000 7fc41affd700 1 -- 172.21.15.33:0/231036827 <== mgr.14114 v2:172.21.15.33:6800/3962763243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fc42810e380 con 0x7fc41002fe10 2024-02-15T18:22:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: value unchanged 2024-02-15T18:22:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fc41002fe10 msgr2=0x7fc4100322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 --2- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fc41002fe10 0x7fc4100322d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc41c0096a0 tx=0x7fc41c006b40).stop 2024-02-15T18:22:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 msgr2=0x7fc42810cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 --2- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc42810cd80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc424006800 tx=0x7fc424006ee0).stop 2024-02-15T18:22:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 shutdown_connections 2024-02-15T18:22:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 --2- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fc41002fe10 0x7fc4100322d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 --2- 172.21.15.33:0/231036827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4280703b0 0x7fc42810cd80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 >> 172.21.15.33:0/231036827 conn(0x7fc4280f6530 msgr2=0x7fc4280f7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:20.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 shutdown_connections 2024-02-15T18:22:20.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:20.731+0000 7fc430429700 1 -- 172.21.15.33:0/231036827 wait complete. 2024-02-15T18:22:21.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:19.356998+0000 mgr.smithi033.apxevf (mgr.14114) 3 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:21.408 INFO:teuthology.orchestra.run.smithi033.stderr:Generating ssh key... 2024-02-15T18:22:21.408 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm generate-key 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.051+0000 7f1d2ffff700 1 Processor -- start 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.051+0000 7f1d2ffff700 1 -- start start 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.051+0000 7f1d2ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d300fe890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.051+0000 7f1d2ffff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300fed80 con 0x7f1d30070430 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.051+0000 7f1d2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d300fe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.051+0000 7f1d2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d300fe890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55554/0 (socket says 172.21.15.33:55554) 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.051+0000 7f1d2effd700 1 -- 172.21.15.33:0/1967822727 learned_addr learned my addr 172.21.15.33:0/1967822727 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.052+0000 7f1d2effd700 1 -- 172.21.15.33:0/1967822727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300feec0 con 0x7f1d30070430 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.052+0000 7f1d2effd700 1 --2- 172.21.15.33:0/1967822727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d300fe890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1d2000b5f0 tx=0x7f1d20006ee0).ready entity=mon.0 client_cookie=d5b5beb1c722248 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.052+0000 7f1d2dffb700 1 -- 172.21.15.33:0/1967822727 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d2000d600 con 0x7f1d30070430 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.052+0000 7f1d2dffb700 1 -- 172.21.15.33:0/1967822727 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f1d2000dbf0 con 0x7f1d30070430 2024-02-15T18:22:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.052+0000 7f1d2dffb700 1 -- 172.21.15.33:0/1967822727 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d20011cb0 con 0x7f1d30070430 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.053+0000 7f1d2ffff700 1 -- 172.21.15.33:0/1967822727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 msgr2=0x7f1d300fe890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.053+0000 7f1d2ffff700 1 --2- 172.21.15.33:0/1967822727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d300fe890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1d2000b5f0 tx=0x7f1d20006ee0).stop 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.053+0000 7f1d2ffff700 1 -- 172.21.15.33:0/1967822727 shutdown_connections 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.053+0000 7f1d2ffff700 1 --2- 172.21.15.33:0/1967822727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d300fe890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.053+0000 7f1d2ffff700 1 -- 172.21.15.33:0/1967822727 >> 172.21.15.33:0/1967822727 conn(0x7f1d300f6390 msgr2=0x7f1d300f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.053+0000 7f1d2ffff700 1 -- 172.21.15.33:0/1967822727 shutdown_connections 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.053+0000 7f1d2ffff700 1 -- 172.21.15.33:0/1967822727 wait complete. 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.054+0000 7f1d2ffff700 1 Processor -- start 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.054+0000 7f1d2ffff700 1 -- start start 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.054+0000 7f1d2ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d3010a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.054+0000 7f1d2ffff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3010aec0 con 0x7f1d30070430 2024-02-15T18:22:22.057 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:20.730416+0000 mgr.smithi033.apxevf (mgr.14114) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.054+0000 7f1d2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d3010a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.054+0000 7f1d2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d3010a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55560/0 (socket says 172.21.15.33:55560) 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.054+0000 7f1d2effd700 1 -- 172.21.15.33:0/742783183 learned_addr learned my addr 172.21.15.33:0/742783183 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.054+0000 7f1d2effd700 1 -- 172.21.15.33:0/742783183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2000b200 con 0x7f1d30070430 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.054+0000 7f1d2effd700 1 --2- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d3010a9d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1d2000df90 tx=0x7f1d20006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.055+0000 7f1d277fe700 1 -- 172.21.15.33:0/742783183 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d2001b410 con 0x7f1d30070430 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.055+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3010b0c0 con 0x7f1d30070430 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.055+0000 7f1d277fe700 1 -- 172.21.15.33:0/742783183 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f1d2001ba00 con 0x7f1d30070430 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.055+0000 7f1d277fe700 1 -- 172.21.15.33:0/742783183 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d2001aa30 con 0x7f1d30070430 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.055+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3010b550 con 0x7f1d30070430 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.056+0000 7f1d277fe700 1 -- 172.21.15.33:0/742783183 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f1d2000f070 con 0x7f1d30070430 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.056+0000 7f1d277fe700 1 --2- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f1d1002fe10 0x7f1d100322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:22.059 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.056+0000 7f1d277fe700 1 -- 172.21.15.33:0/742783183 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f1d200411f0 con 0x7f1d30070430 2024-02-15T18:22:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.056+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d30045ad0 con 0x7f1d30070430 2024-02-15T18:22:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.056+0000 7f1d2e7fc700 1 --2- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f1d1002fe10 0x7f1d100322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.056+0000 7f1d2e7fc700 1 --2- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f1d1002fe10 0x7f1d100322d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1d180096a0 tx=0x7f1d18006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.060+0000 7f1d277fe700 1 -- 172.21.15.33:0/742783183 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1d20016070 con 0x7f1d30070430 2024-02-15T18:22:22.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.221+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d3010bdb0 con 0x7f1d1002fe10 2024-02-15T18:22:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.531+0000 7f1d277fe700 1 -- 172.21.15.33:0/742783183 <== mgr.14114 v2:172.21.15.33:6800/3962763243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1d3010bdb0 con 0x7f1d1002fe10 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f1d1002fe10 msgr2=0x7f1d100322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 --2- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f1d1002fe10 0x7f1d100322d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1d180096a0 tx=0x7f1d18006b40).stop 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 msgr2=0x7f1d3010a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 --2- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d3010a9d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1d2000df90 tx=0x7f1d20006ee0).stop 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 shutdown_connections 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 --2- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f1d1002fe10 0x7f1d100322d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 --2- 172.21.15.33:0/742783183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d30070430 0x7f1d3010a9d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 >> 172.21.15.33:0/742783183 conn(0x7f1d300f6390 msgr2=0x7f1d300f7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 shutdown_connections 2024-02-15T18:22:22.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:22.533+0000 7f1d2ffff700 1 -- 172.21.15.33:0/742783183 wait complete. 2024-02-15T18:22:23.106 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm get-pub-key 2024-02-15T18:22:23.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.727+0000 7f17a8907700 1 Processor -- start 2024-02-15T18:22:23.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.727+0000 7f17a8907700 1 -- start start 2024-02-15T18:22:23.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.727+0000 7f17a8907700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:23.732 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.727+0000 7f17a8907700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40fc7b0 con 0x7f17a40fbea0 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.728+0000 7f17a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.728+0000 7f17a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40fc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55570/0 (socket says 172.21.15.33:55570) 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.728+0000 7f17a259c700 1 -- 172.21.15.33:0/3315040722 learned_addr learned my addr 172.21.15.33:0/3315040722 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.728+0000 7f17a259c700 1 -- 172.21.15.33:0/3315040722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40fc8f0 con 0x7f17a40fbea0 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.728+0000 7f17a259c700 1 --2- 172.21.15.33:0/3315040722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40fc2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f179800b5f0 tx=0x7f1798006ee0).ready entity=mon.0 client_cookie=cc6b59b185f123fb server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.728+0000 7f17a159a700 1 -- 172.21.15.33:0/3315040722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f179800d600 con 0x7f17a40fbea0 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.728+0000 7f17a159a700 1 -- 172.21.15.33:0/3315040722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f179800dbf0 con 0x7f17a40fbea0 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.728+0000 7f17a159a700 1 -- 172.21.15.33:0/3315040722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1798011cb0 con 0x7f17a40fbea0 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.729+0000 7f17a8907700 1 -- 172.21.15.33:0/3315040722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 msgr2=0x7f17a40fc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.729+0000 7f17a8907700 1 --2- 172.21.15.33:0/3315040722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40fc2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f179800b5f0 tx=0x7f1798006ee0).stop 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.729+0000 7f17a8907700 1 -- 172.21.15.33:0/3315040722 shutdown_connections 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.729+0000 7f17a8907700 1 --2- 172.21.15.33:0/3315040722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40fc2c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.729+0000 7f17a8907700 1 -- 172.21.15.33:0/3315040722 >> 172.21.15.33:0/3315040722 conn(0x7f17a40f76a0 msgr2=0x7f17a40f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:23.733 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.729+0000 7f17a8907700 1 -- 172.21.15.33:0/3315040722 shutdown_connections 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.729+0000 7f17a8907700 1 -- 172.21.15.33:0/3315040722 wait complete. 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.729+0000 7f17a8907700 1 Processor -- start 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a8907700 1 -- start start 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a8907700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40725e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a8907700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4070a60 con 0x7f17a40fbea0 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40725e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55578/0 (socket says 172.21.15.33:55578) 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a259c700 1 -- 172.21.15.33:0/1127014528 learned_addr learned my addr 172.21.15.33:0/1127014528 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a259c700 1 -- 172.21.15.33:0/1127014528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179800b200 con 0x7f17a40fbea0 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a259c700 1 --2- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40725e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1798002f40 tx=0x7f1798006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f1792ffd700 1 -- 172.21.15.33:0/1127014528 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f179801b410 con 0x7f17a40fbea0 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f1792ffd700 1 -- 172.21.15.33:0/1127014528 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f179801ba00 con 0x7f17a40fbea0 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f1792ffd700 1 -- 172.21.15.33:0/1127014528 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f179801a980 con 0x7f17a40fbea0 2024-02-15T18:22:23.734 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a4070c00 con 0x7f17a40fbea0 2024-02-15T18:22:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.730+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a4071090 con 0x7f17a40fbea0 2024-02-15T18:22:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.731+0000 7f1792ffd700 1 -- 172.21.15.33:0/1127014528 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f179800f070 con 0x7f17a40fbea0 2024-02-15T18:22:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.731+0000 7f1792ffd700 1 --2- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f178802fe70 0x7f1788032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.731+0000 7f1792ffd700 1 -- 172.21.15.33:0/1127014528 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f1798041490 con 0x7f17a40fbea0 2024-02-15T18:22:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.732+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a4045ad0 con 0x7f17a40fbea0 2024-02-15T18:22:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.732+0000 7f17a1d9b700 1 --2- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f178802fe70 0x7f1788032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:23.735 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.732+0000 7f17a1d9b700 1 --2- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f178802fe70 0x7f1788032330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f17940096a0 tx=0x7f1794006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:23.737 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.736+0000 7f1792ffd700 1 -- 172.21.15.33:0/1127014528 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1798016080 con 0x7f17a40fbea0 2024-02-15T18:22:23.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:22:22.223536+0000 mgr.smithi033.apxevf (mgr.14114) 6 : cephadm [INF] Generating ssh key... 2024-02-15T18:22:23.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:22.528072+0000 mon.smithi033 (mon.0) 52 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:23.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:22.532625+0000 mon.smithi033 (mon.0) 53 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.895+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f17a4104bf0 con 0x7f178802fe70 2024-02-15T18:22:23.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.896+0000 7f1792ffd700 1 -- 172.21.15.33:0/1127014528 <== mgr.14114 v2:172.21.15.33:6800/3962763243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f17a4104bf0 con 0x7f178802fe70 2024-02-15T18:22:23.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0fTsCbfwBO/PrDrTzOA4pTLMxfbIgD2eJQY0b+k4lO8L/cl7VYJSnbn6mq7Sc/wD364evjexvGO2ZHUuFRWZITkgPnb456qFHVAswz/lkljppfFJr/GHNKmIX1nDpMBEwkfoGOAOToSRzvprlPbv+hLidgGZcRyInG61X8ss9p3ezwAXIcq8bsDCnsB0BIc2bFrdmD6PF73PDhqSdOv6s7cdbiSV6bULpjhif+ViQ28NY8UoevvdjBV3wlGE5e8mrKRht4OVQ+GfWOkBQdxDvvfZz3DfJig3hADmAf+L82byIPv0ingbvYECZEExTyhmZqQx1y/S4qeidjpKc7f7DYLY6rxtjTwC+d9/Idw8kq3H2wCQnFn3IKvNnW3PvP8fd/9Atd62Y1qV8vthThiuJ7EvhQWVa6jqH1F8UazIS0rmYrefuNO828opbey4dwir8QzDO1Vx8lUS2y9RijxvMjMUuPtzKIi1LY+sAm77hn42KON3Gl5W1UyukNuP1lwc= ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:22:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.897+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f178802fe70 msgr2=0x7f1788032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.897+0000 7f17a8907700 1 --2- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f178802fe70 0x7f1788032330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f17940096a0 tx=0x7f1794006b40).stop 2024-02-15T18:22:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.897+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 msgr2=0x7f17a40725e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.897+0000 7f17a8907700 1 --2- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40725e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1798002f40 tx=0x7f1798006ee0).stop 2024-02-15T18:22:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.897+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 shutdown_connections 2024-02-15T18:22:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.897+0000 7f17a8907700 1 --2- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f178802fe70 0x7f1788032330 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:23.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.897+0000 7f17a8907700 1 --2- 172.21.15.33:0/1127014528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a40fbea0 0x7f17a40725e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:23.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.897+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 >> 172.21.15.33:0/1127014528 conn(0x7f17a40f76a0 msgr2=0x7f17a40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:23.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.897+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 shutdown_connections 2024-02-15T18:22:23.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:23.898+0000 7f17a8907700 1 -- 172.21.15.33:0/1127014528 wait complete. 2024-02-15T18:22:24.656 INFO:teuthology.orchestra.run.smithi033.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-15T18:22:24.656 INFO:teuthology.orchestra.run.smithi033.stderr:Adding key to root@localhost authorized_keys... 2024-02-15T18:22:24.657 INFO:teuthology.orchestra.run.smithi033.stderr:Adding host smithi033... 2024-02-15T18:22:24.657 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch host add smithi033 172.21.15.33 2024-02-15T18:22:24.658 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:23.897726+0000 mgr.smithi033.apxevf (mgr.14114) 7 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:25.540 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.537+0000 7f02664ca700 1 Processor -- start 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.537+0000 7f02664ca700 1 -- start start 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.537+0000 7f02664ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.537+0000 7f02664ca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02600fef40 con 0x7f0260070430 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.537+0000 7f025ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.537+0000 7f025ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48832/0 (socket says 172.21.15.33:48832) 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.537+0000 7f025ffff700 1 -- 172.21.15.33:0/261001598 learned_addr learned my addr 172.21.15.33:0/261001598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.537+0000 7f025ffff700 1 -- 172.21.15.33:0/261001598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02600ff080 con 0x7f0260070430 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.537+0000 7f025ffff700 1 --2- 172.21.15.33:0/261001598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fea50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f025000b5f0 tx=0x7f0250006ee0).ready entity=mon.0 client_cookie=3e8087fcd6be898b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f025effd700 1 -- 172.21.15.33:0/261001598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f025000d600 con 0x7f0260070430 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f025effd700 1 -- 172.21.15.33:0/261001598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f025000dbf0 con 0x7f0260070430 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f025effd700 1 -- 172.21.15.33:0/261001598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0250011cb0 con 0x7f0260070430 2024-02-15T18:22:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f02664ca700 1 -- 172.21.15.33:0/261001598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 msgr2=0x7f02600fea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f02664ca700 1 --2- 172.21.15.33:0/261001598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fea50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f025000b5f0 tx=0x7f0250006ee0).stop 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f02664ca700 1 -- 172.21.15.33:0/261001598 shutdown_connections 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f02664ca700 1 --2- 172.21.15.33:0/261001598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fea50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f02664ca700 1 -- 172.21.15.33:0/261001598 >> 172.21.15.33:0/261001598 conn(0x7f02600f6530 msgr2=0x7f02600f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f02664ca700 1 -- 172.21.15.33:0/261001598 shutdown_connections 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.538+0000 7f02664ca700 1 -- 172.21.15.33:0/261001598 wait complete. 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.539+0000 7f02664ca700 1 Processor -- start 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.539+0000 7f02664ca700 1 -- start start 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.539+0000 7f02664ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.539+0000 7f02664ca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02600fa950 con 0x7f0260070430 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f025ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f025ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48848/0 (socket says 172.21.15.33:48848) 2024-02-15T18:22:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f025ffff700 1 -- 172.21.15.33:0/1157131686 learned_addr learned my addr 172.21.15.33:0/1157131686 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f025ffff700 1 -- 172.21.15.33:0/1157131686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025000b200 con 0x7f0260070430 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f025ffff700 1 --2- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fc4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f025000df90 tx=0x7f0250006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f025cff9700 1 -- 172.21.15.33:0/1157131686 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f025001b410 con 0x7f0260070430 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f025cff9700 1 -- 172.21.15.33:0/1157131686 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f025001ba00 con 0x7f0260070430 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02600faaf0 con 0x7f0260070430 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f025cff9700 1 -- 172.21.15.33:0/1157131686 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f025001aa30 con 0x7f0260070430 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.540+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02600faf80 con 0x7f0260070430 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.541+0000 7f025cff9700 1 -- 172.21.15.33:0/1157131686 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f025000f070 con 0x7f0260070430 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.541+0000 7f025cff9700 1 --2- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f024c02fe70 0x7f024c032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.541+0000 7f025cff9700 1 -- 172.21.15.33:0/1157131686 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f0250041190 con 0x7f0260070430 2024-02-15T18:22:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.541+0000 7f025f7fe700 1 --2- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f024c02fe70 0x7f024c032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.541+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0260059100 con 0x7f0260070430 2024-02-15T18:22:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.542+0000 7f025f7fe700 1 --2- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f024c02fe70 0x7f024c032330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f02540096a0 tx=0x7f0254006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:25.547 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.546+0000 7f025cff9700 1 -- 172.21.15.33:0/1157131686 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0250016070 con 0x7f0260070430 2024-02-15T18:22:25.729 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:25.728+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}) v1 -- 0x7f02600ffe30 con 0x7f024c02fe70 2024-02-15T18:22:26.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:25.730841+0000 mgr.smithi033.apxevf (mgr.14114) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:26.342 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Added host 'smithi033' 2024-02-15T18:22:26.342 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.340+0000 7f025cff9700 1 -- 172.21.15.33:0/1157131686 <== mgr.14114 v2:172.21.15.33:6800/3962763243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f02600ffe30 con 0x7f024c02fe70 2024-02-15T18:22:26.344 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f024c02fe70 msgr2=0x7f024c032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 --2- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f024c02fe70 0x7f024c032330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f02540096a0 tx=0x7f0254006b40).stop 2024-02-15T18:22:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 msgr2=0x7f02600fc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 --2- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fc4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f025000df90 tx=0x7f0250006ee0).stop 2024-02-15T18:22:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 shutdown_connections 2024-02-15T18:22:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 --2- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f024c02fe70 0x7f024c032330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 --2- 172.21.15.33:0/1157131686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0260070430 0x7f02600fc4d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 >> 172.21.15.33:0/1157131686 conn(0x7f02600f6530 msgr2=0x7f02600f7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 shutdown_connections 2024-02-15T18:22:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:26.343+0000 7f02664ca700 1 -- 172.21.15.33:0/1157131686 wait complete. 2024-02-15T18:22:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying mon service with default placement... 2024-02-15T18:22:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mon 2024-02-15T18:22:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.525+0000 7f8ee63d7700 1 Processor -- start 2024-02-15T18:22:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.526+0000 7f8ee63d7700 1 -- start start 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.526+0000 7f8ee63d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.526+0000 7f8ee63d7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00fef80 con 0x7f8ee00703f0 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.526+0000 7f8edffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.526+0000 7f8edffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48854/0 (socket says 172.21.15.33:48854) 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.526+0000 7f8edffff700 1 -- 172.21.15.33:0/1976734842 learned_addr learned my addr 172.21.15.33:0/1976734842 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.526+0000 7f8edffff700 1 -- 172.21.15.33:0/1976734842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee00ff0c0 con 0x7f8ee00703f0 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.526+0000 7f8edffff700 1 --2- 172.21.15.33:0/1976734842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fea90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8ed000b5f0 tx=0x7f8ed0006ee0).ready entity=mon.0 client_cookie=40ba0f77ebb3e808 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8edeffd700 1 -- 172.21.15.33:0/1976734842 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ed000d600 con 0x7f8ee00703f0 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8edeffd700 1 -- 172.21.15.33:0/1976734842 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f8ed000dbf0 con 0x7f8ee00703f0 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8edeffd700 1 -- 172.21.15.33:0/1976734842 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ed0011ce0 con 0x7f8ee00703f0 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8ee63d7700 1 -- 172.21.15.33:0/1976734842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 msgr2=0x7f8ee00fea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8ee63d7700 1 --2- 172.21.15.33:0/1976734842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fea90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8ed000b5f0 tx=0x7f8ed0006ee0).stop 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8ee63d7700 1 -- 172.21.15.33:0/1976734842 shutdown_connections 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8ee63d7700 1 --2- 172.21.15.33:0/1976734842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fea90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8ee63d7700 1 -- 172.21.15.33:0/1976734842 >> 172.21.15.33:0/1976734842 conn(0x7f8ee00f6530 msgr2=0x7f8ee00f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8ee63d7700 1 -- 172.21.15.33:0/1976734842 shutdown_connections 2024-02-15T18:22:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.527+0000 7f8ee63d7700 1 -- 172.21.15.33:0/1976734842 wait complete. 2024-02-15T18:22:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.528+0000 7f8ee63d7700 1 Processor -- start 2024-02-15T18:22:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.528+0000 7f8ee63d7700 1 -- start start 2024-02-15T18:22:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.528+0000 7f8ee63d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.528+0000 7f8ee63d7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00fa990 con 0x7f8ee00703f0 2024-02-15T18:22:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.528+0000 7f8edffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.528+0000 7f8edffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48866/0 (socket says 172.21.15.33:48866) 2024-02-15T18:22:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.528+0000 7f8edffff700 1 -- 172.21.15.33:0/2728204258 learned_addr learned my addr 172.21.15.33:0/2728204258 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.529+0000 7f8edffff700 1 -- 172.21.15.33:0/2728204258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed000b200 con 0x7f8ee00703f0 2024-02-15T18:22:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.529+0000 7f8edffff700 1 --2- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fc510 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8ed0011ed0 tx=0x7f8ed0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.529+0000 7f8edcff9700 1 -- 172.21.15.33:0/2728204258 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ed001b570 con 0x7f8ee00703f0 2024-02-15T18:22:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.529+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee00fab30 con 0x7f8ee00703f0 2024-02-15T18:22:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.529+0000 7f8edcff9700 1 -- 172.21.15.33:0/2728204258 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f8ed001bb60 con 0x7f8ee00703f0 2024-02-15T18:22:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.529+0000 7f8edcff9700 1 -- 172.21.15.33:0/2728204258 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ed001aad0 con 0x7f8ee00703f0 2024-02-15T18:22:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.529+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee00fafc0 con 0x7f8ee00703f0 2024-02-15T18:22:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.530+0000 7f8edcff9700 1 -- 172.21.15.33:0/2728204258 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f8ed000f070 con 0x7f8ee00703f0 2024-02-15T18:22:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.530+0000 7f8edcff9700 1 --2- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f8ecc02fe10 0x7f8ecc0322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.530+0000 7f8edcff9700 1 -- 172.21.15.33:0/2728204258 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f8ed00422e0 con 0x7f8ee00703f0 2024-02-15T18:22:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.530+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee0045ad0 con 0x7f8ee00703f0 2024-02-15T18:22:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.530+0000 7f8edf7fe700 1 --2- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f8ecc02fe10 0x7f8ecc0322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.531+0000 7f8edf7fe700 1 --2- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f8ecc02fe10 0x7f8ecc0322d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8ed40096a0 tx=0x7f8ed4006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:27.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.535+0000 7f8edcff9700 1 -- 172.21.15.33:0/2728204258 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8ed0016070 con 0x7f8ee00703f0 2024-02-15T18:22:27.721 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.720+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ee0104b70 con 0x7f8ecc02fe10 2024-02-15T18:22:27.725 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.724+0000 7f8edcff9700 1 -- 172.21.15.33:0/2728204258 <== mgr.14114 v2:172.21.15.33:6800/3962763243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8ee0104b70 con 0x7f8ecc02fe10 2024-02-15T18:22:27.725 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled mon update... 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.726+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f8ecc02fe10 msgr2=0x7f8ecc0322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.726+0000 7f8ee63d7700 1 --2- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f8ecc02fe10 0x7f8ecc0322d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8ed40096a0 tx=0x7f8ed4006b40).stop 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.726+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 msgr2=0x7f8ee00fc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.726+0000 7f8ee63d7700 1 --2- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fc510 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8ed0011ed0 tx=0x7f8ed0006ee0).stop 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.726+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 shutdown_connections 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.726+0000 7f8ee63d7700 1 --2- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f8ecc02fe10 0x7f8ecc0322d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.726+0000 7f8ee63d7700 1 --2- 172.21.15.33:0/2728204258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee00703f0 0x7f8ee00fc510 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.726+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 >> 172.21.15.33:0/2728204258 conn(0x7f8ee00f6530 msgr2=0x7f8ee00f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.727+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 shutdown_connections 2024-02-15T18:22:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:27.727+0000 7f8ee63d7700 1 -- 172.21.15.33:0/2728204258 wait complete. 2024-02-15T18:22:27.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:26.341494+0000 mon.smithi033 (mon.0) 54 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:27.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:22:26.341813+0000 mgr.smithi033.apxevf (mgr.14114) 9 : cephadm [INF] Added host smithi033 2024-02-15T18:22:27.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:26.342063+0000 mon.smithi033 (mon.0) 55 : audit [DBG] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:28.312 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying mgr service with default placement... 2024-02-15T18:22:28.312 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mgr 2024-02-15T18:22:28.824 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.816+0000 7f05ccb52700 1 Processor -- start 2024-02-15T18:22:28.824 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.816+0000 7f05ccb52700 1 -- start start 2024-02-15T18:22:28.824 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05ccb52700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c80fea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05ccb52700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80fef40 con 0x7f05c8070430 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c80fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c80fea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48880/0 (socket says 172.21.15.33:48880) 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05c659c700 1 -- 172.21.15.33:0/2504892707 learned_addr learned my addr 172.21.15.33:0/2504892707 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05c659c700 1 -- 172.21.15.33:0/2504892707 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80ff080 con 0x7f05c8070430 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05c659c700 1 --2- 172.21.15.33:0/2504892707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c80fea50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f05b800b5f0 tx=0x7f05b8006ee0).ready entity=mon.0 client_cookie=86102d8f07ffad65 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05c559a700 1 -- 172.21.15.33:0/2504892707 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05b800d600 con 0x7f05c8070430 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05c559a700 1 -- 172.21.15.33:0/2504892707 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f05b800dbf0 con 0x7f05c8070430 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.817+0000 7f05c559a700 1 -- 172.21.15.33:0/2504892707 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05b8011cb0 con 0x7f05c8070430 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.818+0000 7f05ccb52700 1 -- 172.21.15.33:0/2504892707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 msgr2=0x7f05c80fea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.818+0000 7f05ccb52700 1 --2- 172.21.15.33:0/2504892707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c80fea50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f05b800b5f0 tx=0x7f05b8006ee0).stop 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.818+0000 7f05ccb52700 1 -- 172.21.15.33:0/2504892707 shutdown_connections 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.818+0000 7f05ccb52700 1 --2- 172.21.15.33:0/2504892707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c80fea50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:28.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.818+0000 7f05ccb52700 1 -- 172.21.15.33:0/2504892707 >> 172.21.15.33:0/2504892707 conn(0x7f05c80f6530 msgr2=0x7f05c80f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.818+0000 7f05ccb52700 1 -- 172.21.15.33:0/2504892707 shutdown_connections 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.818+0000 7f05ccb52700 1 -- 172.21.15.33:0/2504892707 wait complete. 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.818+0000 7f05ccb52700 1 Processor -- start 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.818+0000 7f05ccb52700 1 -- start start 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05ccb52700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c810ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05ccb52700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c810b030 con 0x7f05c8070430 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c810ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c810ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48896/0 (socket says 172.21.15.33:48896) 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05c659c700 1 -- 172.21.15.33:0/865633543 learned_addr learned my addr 172.21.15.33:0/865633543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05c659c700 1 -- 172.21.15.33:0/865633543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b800b200 con 0x7f05c8070430 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05c659c700 1 --2- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c810ab40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f05b8006800 tx=0x7f05b8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05beffd700 1 -- 172.21.15.33:0/865633543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05b801b570 con 0x7f05c8070430 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05beffd700 1 -- 172.21.15.33:0/865633543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f05b801bb60 con 0x7f05c8070430 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c810b230 con 0x7f05c8070430 2024-02-15T18:22:28.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05beffd700 1 -- 172.21.15.33:0/865633543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05b801a9f0 con 0x7f05c8070430 2024-02-15T18:22:28.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.819+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c810b6c0 con 0x7f05c8070430 2024-02-15T18:22:28.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.820+0000 7f05beffd700 1 -- 172.21.15.33:0/865633543 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f05b800f070 con 0x7f05c8070430 2024-02-15T18:22:28.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.820+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c8045ad0 con 0x7f05c8070430 2024-02-15T18:22:28.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.820+0000 7f05beffd700 1 --2- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f05a802fe10 0x7f05a80322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:28.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.821+0000 7f05beffd700 1 -- 172.21.15.33:0/865633543 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f05b8041450 con 0x7f05c8070430 2024-02-15T18:22:28.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.821+0000 7f05c5d9b700 1 --2- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f05a802fe10 0x7f05a80322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:28.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.821+0000 7f05c5d9b700 1 --2- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f05a802fe10 0x7f05a80322d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f05b00096a0 tx=0x7f05b0006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:28.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:28.825+0000 7f05beffd700 1 -- 172.21.15.33:0/865633543 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f05b8019cd0 con 0x7f05c8070430 2024-02-15T18:22:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.010+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f05c810bf20 con 0x7f05a802fe10 2024-02-15T18:22:29.014 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.013+0000 7f05beffd700 1 -- 172.21.15.33:0/865633543 <== mgr.14114 v2:172.21.15.33:6800/3962763243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f05c810bf20 con 0x7f05a802fe10 2024-02-15T18:22:29.014 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.015+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f05a802fe10 msgr2=0x7f05a80322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.015+0000 7f05ccb52700 1 --2- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f05a802fe10 0x7f05a80322d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f05b00096a0 tx=0x7f05b0006b40).stop 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.015+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 msgr2=0x7f05c810ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.015+0000 7f05ccb52700 1 --2- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c810ab40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f05b8006800 tx=0x7f05b8006ee0).stop 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.015+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 shutdown_connections 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.015+0000 7f05ccb52700 1 --2- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f05a802fe10 0x7f05a80322d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.015+0000 7f05ccb52700 1 --2- 172.21.15.33:0/865633543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05c8070430 0x7f05c810ab40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.015+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 >> 172.21.15.33:0/865633543 conn(0x7f05c80f6530 msgr2=0x7f05c80f7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.016+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 shutdown_connections 2024-02-15T18:22:29.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:29.016+0000 7f05ccb52700 1 -- 172.21.15.33:0/865633543 wait complete. 2024-02-15T18:22:29.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:27.723262+0000 mgr.smithi033.apxevf (mgr.14114) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:29.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:22:27.723991+0000 mgr.smithi033.apxevf (mgr.14114) 11 : cephadm [INF] Saving service mon spec with placement count:5 2024-02-15T18:22:29.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:27.726126+0000 mon.smithi033 (mon.0) 56 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying crash service with default placement... 2024-02-15T18:22:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply crash 2024-02-15T18:22:30.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.282+0000 7f15246dc700 1 Processor -- start 2024-02-15T18:22:30.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.282+0000 7f15246dc700 1 -- start start 2024-02-15T18:22:30.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.282+0000 7f15246dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.282+0000 7f15246dc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c0fc8c0 con 0x7f151c0703b0 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.283+0000 7f1522478700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.283+0000 7f1522478700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48912/0 (socket says 172.21.15.33:48912) 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.283+0000 7f1522478700 1 -- 172.21.15.33:0/3270354432 learned_addr learned my addr 172.21.15.33:0/3270354432 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.283+0000 7f1522478700 1 -- 172.21.15.33:0/3270354432 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c1013c0 con 0x7f151c0703b0 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.283+0000 7f1522478700 1 --2- 172.21.15.33:0/3270354432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c100ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f150c00b5f0 tx=0x7f150c006ee0).ready entity=mon.0 client_cookie=c0fa83de79e80e9b server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.283+0000 7f1521476700 1 -- 172.21.15.33:0/3270354432 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c00d600 con 0x7f151c0703b0 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.283+0000 7f1521476700 1 -- 172.21.15.33:0/3270354432 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f150c00dbf0 con 0x7f151c0703b0 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.283+0000 7f1521476700 1 -- 172.21.15.33:0/3270354432 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c011cb0 con 0x7f151c0703b0 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.284+0000 7f15246dc700 1 -- 172.21.15.33:0/3270354432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 msgr2=0x7f151c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.284+0000 7f15246dc700 1 --2- 172.21.15.33:0/3270354432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c100ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f150c00b5f0 tx=0x7f150c006ee0).stop 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.284+0000 7f15246dc700 1 -- 172.21.15.33:0/3270354432 shutdown_connections 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.284+0000 7f15246dc700 1 --2- 172.21.15.33:0/3270354432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c100ed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.284+0000 7f15246dc700 1 -- 172.21.15.33:0/3270354432 >> 172.21.15.33:0/3270354432 conn(0x7f151c0f6530 msgr2=0x7f151c0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.284+0000 7f15246dc700 1 -- 172.21.15.33:0/3270354432 shutdown_connections 2024-02-15T18:22:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.284+0000 7f15246dc700 1 -- 172.21.15.33:0/3270354432 wait complete. 2024-02-15T18:22:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.285+0000 7f15246dc700 1 Processor -- start 2024-02-15T18:22:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.285+0000 7f15246dc700 1 -- start start 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.285+0000 7f15246dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c10cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.285+0000 7f15246dc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c10d270 con 0x7f151c0703b0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.285+0000 7f1522478700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c10cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.285+0000 7f1522478700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c10cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48924/0 (socket says 172.21.15.33:48924) 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.285+0000 7f1522478700 1 -- 172.21.15.33:0/3655182479 learned_addr learned my addr 172.21.15.33:0/3655182479 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.285+0000 7f1522478700 1 -- 172.21.15.33:0/3655182479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c00b200 con 0x7f151c0703b0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.285+0000 7f1522478700 1 --2- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c10cd80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f150c006800 tx=0x7f150c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.286+0000 7f150affd700 1 -- 172.21.15.33:0/3655182479 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c01b570 con 0x7f151c0703b0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.286+0000 7f150affd700 1 -- 172.21.15.33:0/3655182479 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f150c01bb60 con 0x7f151c0703b0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.286+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c10d470 con 0x7f151c0703b0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.286+0000 7f150affd700 1 -- 172.21.15.33:0/3655182479 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c01a9f0 con 0x7f151c0703b0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.286+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c10e080 con 0x7f151c0703b0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.286+0000 7f150affd700 1 -- 172.21.15.33:0/3655182479 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f150c00f070 con 0x7f151c0703b0 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.287+0000 7f150affd700 1 --2- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f150402fe70 0x7f1504032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.287+0000 7f150affd700 1 -- 172.21.15.33:0/3655182479 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f150c0413e0 con 0x7f151c0703b0 2024-02-15T18:22:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.287+0000 7f1521c77700 1 --2- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f150402fe70 0x7f1504032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.287+0000 7f1521c77700 1 --2- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f150402fe70 0x7f1504032330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f15180096a0 tx=0x7f1518006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.287+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c059100 con 0x7f151c0703b0 2024-02-15T18:22:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.291+0000 7f150affd700 1 -- 172.21.15.33:0/3655182479 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f150c016070 con 0x7f151c0703b0 2024-02-15T18:22:30.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:29.012395+0000 mgr.smithi033.apxevf (mgr.14114) 12 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:30.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:22:29.012948+0000 mgr.smithi033.apxevf (mgr.14114) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2024-02-15T18:22:30.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:29.015088+0000 mon.smithi033 (mon.0) 57 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:30.477 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.476+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f151c102110 con 0x7f150402fe70 2024-02-15T18:22:30.481 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.480+0000 7f150affd700 1 -- 172.21.15.33:0/3655182479 <== mgr.14114 v2:172.21.15.33:6800/3962763243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f151c102110 con 0x7f150402fe70 2024-02-15T18:22:30.481 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled crash update... 2024-02-15T18:22:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.482+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f150402fe70 msgr2=0x7f1504032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.482+0000 7f15246dc700 1 --2- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f150402fe70 0x7f1504032330 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f15180096a0 tx=0x7f1518006b40).stop 2024-02-15T18:22:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.482+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 msgr2=0x7f151c10cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.482+0000 7f15246dc700 1 --2- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c10cd80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f150c006800 tx=0x7f150c006ee0).stop 2024-02-15T18:22:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.482+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 shutdown_connections 2024-02-15T18:22:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.482+0000 7f15246dc700 1 --2- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7f150402fe70 0x7f1504032330 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.482+0000 7f15246dc700 1 --2- 172.21.15.33:0/3655182479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f151c0703b0 0x7f151c10cd80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.482+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 >> 172.21.15.33:0/3655182479 conn(0x7f151c0f6530 msgr2=0x7f151c0f7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.483+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 shutdown_connections 2024-02-15T18:22:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:30.483+0000 7f15246dc700 1 -- 172.21.15.33:0/3655182479 wait complete. 2024-02-15T18:22:31.167 INFO:teuthology.orchestra.run.smithi033.stderr:Enabling mgr prometheus module... 2024-02-15T18:22:31.167 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable prometheus 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.744+0000 7faa4a98e700 1 Processor -- start 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.744+0000 7faa4a98e700 1 -- start start 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.745+0000 7faa4a98e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa44100eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.745+0000 7faa4a98e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa440fc8a0 con 0x7faa440703d0 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.745+0000 7faa43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa44100eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.745+0000 7faa43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa44100eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48928/0 (socket says 172.21.15.33:48928) 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.745+0000 7faa43fff700 1 -- 172.21.15.33:0/2697577504 learned_addr learned my addr 172.21.15.33:0/2697577504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.745+0000 7faa43fff700 1 -- 172.21.15.33:0/2697577504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa441013a0 con 0x7faa440703d0 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.745+0000 7faa43fff700 1 --2- 172.21.15.33:0/2697577504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa44100eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faa3400b5f0 tx=0x7faa34006ee0).ready entity=mon.0 client_cookie=9898f451e13efdc6 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:31.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.745+0000 7faa42ffd700 1 -- 172.21.15.33:0/2697577504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa3400d600 con 0x7faa440703d0 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.746+0000 7faa42ffd700 1 -- 172.21.15.33:0/2697577504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7faa3400dbf0 con 0x7faa440703d0 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.746+0000 7faa42ffd700 1 -- 172.21.15.33:0/2697577504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa34011cb0 con 0x7faa440703d0 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.746+0000 7faa4a98e700 1 -- 172.21.15.33:0/2697577504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 msgr2=0x7faa44100eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.746+0000 7faa4a98e700 1 --2- 172.21.15.33:0/2697577504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa44100eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faa3400b5f0 tx=0x7faa34006ee0).stop 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.746+0000 7faa4a98e700 1 -- 172.21.15.33:0/2697577504 shutdown_connections 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.746+0000 7faa4a98e700 1 --2- 172.21.15.33:0/2697577504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa44100eb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.746+0000 7faa4a98e700 1 -- 172.21.15.33:0/2697577504 >> 172.21.15.33:0/2697577504 conn(0x7faa440f6530 msgr2=0x7faa440f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.747+0000 7faa4a98e700 1 -- 172.21.15.33:0/2697577504 shutdown_connections 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.747+0000 7faa4a98e700 1 -- 172.21.15.33:0/2697577504 wait complete. 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.747+0000 7faa4a98e700 1 Processor -- start 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa4a98e700 1 -- start start 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa4a98e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa4410ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa4a98e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4410d330 con 0x7faa440703d0 2024-02-15T18:22:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa4410ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa4410ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48936/0 (socket says 172.21.15.33:48936) 2024-02-15T18:22:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa43fff700 1 -- 172.21.15.33:0/1598447222 learned_addr learned my addr 172.21.15.33:0/1598447222 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa43fff700 1 -- 172.21.15.33:0/1598447222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3400b200 con 0x7faa440703d0 2024-02-15T18:22:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa43fff700 1 --2- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa4410ce40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faa34006800 tx=0x7faa34006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa40ff9700 1 -- 172.21.15.33:0/1598447222 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa3401b570 con 0x7faa440703d0 2024-02-15T18:22:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa40ff9700 1 -- 172.21.15.33:0/1598447222 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7faa3401bb60 con 0x7faa440703d0 2024-02-15T18:22:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4410d530 con 0x7faa440703d0 2024-02-15T18:22:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.748+0000 7faa40ff9700 1 -- 172.21.15.33:0/1598447222 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa3401a940 con 0x7faa440703d0 2024-02-15T18:22:31.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.749+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4410e140 con 0x7faa440703d0 2024-02-15T18:22:31.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.749+0000 7faa40ff9700 1 -- 172.21.15.33:0/1598447222 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7faa3400f070 con 0x7faa440703d0 2024-02-15T18:22:31.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.750+0000 7faa40ff9700 1 --2- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7faa3002fe70 0x7faa30032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:31.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.749+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa44059100 con 0x7faa440703d0 2024-02-15T18:22:31.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.750+0000 7faa40ff9700 1 -- 172.21.15.33:0/1598447222 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7faa34041350 con 0x7faa440703d0 2024-02-15T18:22:31.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.750+0000 7faa437fe700 1 --2- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7faa3002fe70 0x7faa30032330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:31.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.750+0000 7faa437fe700 1 --2- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7faa3002fe70 0x7faa30032330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7faa380096a0 tx=0x7faa38006b40).ready entity=mgr.14114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.754+0000 7faa40ff9700 1 -- 172.21.15.33:0/1598447222 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7faa34016070 con 0x7faa440703d0 2024-02-15T18:22:31.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:30.478929+0000 mgr.smithi033.apxevf (mgr.14114) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:31.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:22:30.479557+0000 mgr.smithi033.apxevf (mgr.14114) 15 : cephadm [INF] Saving service crash spec with placement * 2024-02-15T18:22:31.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:30.481833+0000 mon.smithi033 (mon.0) 58 : audit [INF] from='mgr.14114 172.21.15.33:0/1946375051' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:31.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:31.950+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "prometheus"} v 0) v1 -- 0x7faa44045ad0 con 0x7faa440703d0 2024-02-15T18:22:32.484 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.483+0000 7faa40ff9700 1 -- 172.21.15.33:0/1598447222 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7faa3401bcd0 con 0x7faa440703d0 2024-02-15T18:22:32.485 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.485+0000 7faa40ff9700 1 -- 172.21.15.33:0/1598447222 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "prometheus"}]=0 v9) v1 ==== 89+0+0 (secure 0 0 0) 0x7faa34010360 con 0x7faa440703d0 2024-02-15T18:22:32.488 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.487+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7faa3002fe70 msgr2=0x7faa30032330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:32.488 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.487+0000 7faa4a98e700 1 --2- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7faa3002fe70 0x7faa30032330 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7faa380096a0 tx=0x7faa38006b40).stop 2024-02-15T18:22:32.488 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.487+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 msgr2=0x7faa4410ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:32.489 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.487+0000 7faa4a98e700 1 --2- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa4410ce40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7faa34006800 tx=0x7faa34006ee0).stop 2024-02-15T18:22:32.489 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.487+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 shutdown_connections 2024-02-15T18:22:32.489 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.487+0000 7faa4a98e700 1 --2- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7faa3002fe70 0x7faa30032330 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:32.489 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.487+0000 7faa4a98e700 1 --2- 172.21.15.33:0/1598447222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440703d0 0x7faa4410ce40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:32.489 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.487+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 >> 172.21.15.33:0/1598447222 conn(0x7faa440f6530 msgr2=0x7faa440f7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:32.489 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.488+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 shutdown_connections 2024-02-15T18:22:32.489 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:32.488+0000 7faa4a98e700 1 -- 172.21.15.33:0/1598447222 wait complete. 2024-02-15T18:22:32.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:31.952550+0000 mon.smithi033 (mon.0) 59 : audit [INF] from='client.? 172.21.15.33:0/1598447222' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-15T18:22:33.215 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying prometheus service with default placement... 2024-02-15T18:22:33.216 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply prometheus 2024-02-15T18:22:33.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:32.486738+0000 mon.smithi033 (mon.0) 60 : audit [INF] from='client.? 172.21.15.33:0/1598447222' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-15T18:22:33.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:32.486799+0000 mon.smithi033 (mon.0) 61 : cluster [DBG] mgrmap e9: smithi033.apxevf(active, since 16s) 2024-02-15T18:22:33.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.850+0000 7fe749efe700 1 Processor -- start 2024-02-15T18:22:33.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.850+0000 7fe749efe700 1 -- start start 2024-02-15T18:22:33.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.850+0000 7fe749efe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe7440fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:33.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.850+0000 7fe749efe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440fb6a0 con 0x7fe7440fad90 2024-02-15T18:22:33.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.851+0000 7fe7437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe7440fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:33.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.851+0000 7fe7437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe7440fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48966/0 (socket says 172.21.15.33:48966) 2024-02-15T18:22:33.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.851+0000 7fe7437fe700 1 -- 172.21.15.33:0/1531252968 learned_addr learned my addr 172.21.15.33:0/1531252968 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:33.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.851+0000 7fe7437fe700 1 -- 172.21.15.33:0/1531252968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440fb7e0 con 0x7fe7440fad90 2024-02-15T18:22:33.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.851+0000 7fe7437fe700 1 --2- 172.21.15.33:0/1531252968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe7440fb1b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe73400b5f0 tx=0x7fe734006ee0).ready entity=mon.0 client_cookie=e36d92544f9103b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:33.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.851+0000 7fe7427fc700 1 -- 172.21.15.33:0/1531252968 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe73400d600 con 0x7fe7440fad90 2024-02-15T18:22:33.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.851+0000 7fe7427fc700 1 -- 172.21.15.33:0/1531252968 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fe73400dbf0 con 0x7fe7440fad90 2024-02-15T18:22:33.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.851+0000 7fe7427fc700 1 -- 172.21.15.33:0/1531252968 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe734011cb0 con 0x7fe7440fad90 2024-02-15T18:22:33.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.852+0000 7fe749efe700 1 -- 172.21.15.33:0/1531252968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 msgr2=0x7fe7440fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.852+0000 7fe749efe700 1 --2- 172.21.15.33:0/1531252968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe7440fb1b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe73400b5f0 tx=0x7fe734006ee0).stop 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.852+0000 7fe749efe700 1 -- 172.21.15.33:0/1531252968 shutdown_connections 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.852+0000 7fe749efe700 1 --2- 172.21.15.33:0/1531252968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe7440fb1b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.852+0000 7fe749efe700 1 -- 172.21.15.33:0/1531252968 >> 172.21.15.33:0/1531252968 conn(0x7fe7440f6530 msgr2=0x7fe7440f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.852+0000 7fe749efe700 1 -- 172.21.15.33:0/1531252968 shutdown_connections 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.852+0000 7fe749efe700 1 -- 172.21.15.33:0/1531252968 wait complete. 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.853+0000 7fe749efe700 1 Processor -- start 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.853+0000 7fe749efe700 1 -- start start 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.853+0000 7fe749efe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe74410cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.853+0000 7fe749efe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74410d280 con 0x7fe7440fad90 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.853+0000 7fe7437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe74410cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.853+0000 7fe7437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe74410cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48974/0 (socket says 172.21.15.33:48974) 2024-02-15T18:22:33.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.853+0000 7fe7437fe700 1 -- 172.21.15.33:0/1962072215 learned_addr learned my addr 172.21.15.33:0/1962072215 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:33.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.854+0000 7fe7437fe700 1 -- 172.21.15.33:0/1962072215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73400b200 con 0x7fe7440fad90 2024-02-15T18:22:33.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.854+0000 7fe7437fe700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe74410cd90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe734011ea0 tx=0x7fe734006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:33.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.854+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe73401b570 con 0x7fe7440fad90 2024-02-15T18:22:33.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.854+0000 7fe749efe700 1 -- 172.21.15.33:0/1962072215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74410d480 con 0x7fe7440fad90 2024-02-15T18:22:33.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.854+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fe73401bb60 con 0x7fe7440fad90 2024-02-15T18:22:33.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.854+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe73401a8d0 con 0x7fe7440fad90 2024-02-15T18:22:33.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.854+0000 7fe749efe700 1 -- 172.21.15.33:0/1962072215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74410e090 con 0x7fe7440fad90 2024-02-15T18:22:33.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.855+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7fe73400f070 con 0x7fe7440fad90 2024-02-15T18:22:33.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.855+0000 7fe72bfff700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 0x7fe730032330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:33.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.855+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fe7340416d0 con 0x7fe7440fad90 2024-02-15T18:22:33.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.855+0000 7fe742ffd700 1 -- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 msgr2=0x7fe730032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3962763243 2024-02-15T18:22:33.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.855+0000 7fe729ffb700 1 -- 172.21.15.33:0/1962072215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c004fa0 con 0x7fe7440fad90 2024-02-15T18:22:33.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.855+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 0x7fe730032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:22:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:33.863+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe734016080 con 0x7fe7440fad90 2024-02-15T18:22:34.055 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:34.054+0000 7fe729ffb700 1 -- 172.21.15.33:0/1962072215 --> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fe71c002a50 con 0x7fe73002fe70 2024-02-15T18:22:34.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:34.056+0000 7fe742ffd700 1 -- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 msgr2=0x7fe730032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3962763243 2024-02-15T18:22:34.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:34.056+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 0x7fe730032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-15T18:22:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:34.457+0000 7fe742ffd700 1 -- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 msgr2=0x7fe730032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3962763243 2024-02-15T18:22:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:34.457+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 0x7fe730032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-02-15T18:22:35.259 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:35.258+0000 7fe742ffd700 1 -- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 msgr2=0x7fe730032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3962763243 2024-02-15T18:22:35.259 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:35.258+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 0x7fe730032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-02-15T18:22:36.861 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:36.859+0000 7fe742ffd700 1 -- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 msgr2=0x7fe730032330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3962763243 2024-02-15T18:22:36.861 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:36.859+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 0x7fe730032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-02-15T18:22:37.756 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:37.755+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 10) v1 ==== 35984+0+0 (secure 0 0 0) 0x7fe734025980 con 0x7fe7440fad90 2024-02-15T18:22:37.756 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:37.755+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 msgr2=0x7fe730032330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:22:37.756 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:37.755+0000 7fe72bfff700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 0x7fe730032330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:38.011 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:37.704542+0000 mon.smithi033 (mon.0) 62 : cluster [INF] Active manager daemon smithi033.apxevf restarted 2024-02-15T18:22:38.011 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:37.704941+0000 mon.smithi033 (mon.0) 63 : cluster [INF] Activating manager daemon smithi033.apxevf 2024-02-15T18:22:38.011 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:37.706666+0000 mon.smithi033 (mon.0) 64 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-15T18:22:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.761+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mgrmap(e 11) v1 ==== 36054+0+0 (secure 0 0 0) 0x7fe734043870 con 0x7fe7440fad90 2024-02-15T18:22:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.761+0000 7fe72bfff700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fe730033ce0 0x7fe7300360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.761+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 --> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fe71c002a50 con 0x7fe730033ce0 2024-02-15T18:22:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.762+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fe730033ce0 0x7fe7300360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.762+0000 7fe742ffd700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fe730033ce0 0x7fe7300360d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fe7380036d0 tx=0x7fe738006cb0).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.768+0000 7fe72bfff700 1 -- 172.21.15.33:0/1962072215 <== mgr.14142 v2:172.21.15.33:6800/1651162060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fe71c002a50 con 0x7fe730033ce0 2024-02-15T18:22:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled prometheus update... 2024-02-15T18:22:38.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.770+0000 7fe729ffb700 1 -- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fe730033ce0 msgr2=0x7fe7300360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:38.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.770+0000 7fe729ffb700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fe730033ce0 0x7fe7300360d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fe7380036d0 tx=0x7fe738006cb0).stop 2024-02-15T18:22:38.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.770+0000 7fe729ffb700 1 -- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 msgr2=0x7fe74410cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:38.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.770+0000 7fe729ffb700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe74410cd90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe734011ea0 tx=0x7fe734006ee0).stop 2024-02-15T18:22:38.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.770+0000 7fe729ffb700 1 -- 172.21.15.33:0/1962072215 shutdown_connections 2024-02-15T18:22:38.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.770+0000 7fe729ffb700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fe730033ce0 0x7fe7300360d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:38.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.770+0000 7fe729ffb700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7440fad90 0x7fe74410cd90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:38.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.770+0000 7fe729ffb700 1 --2- 172.21.15.33:0/1962072215 >> [v2:172.21.15.33:6800/3962763243,v1:172.21.15.33:6801/3962763243] conn(0x7fe73002fe70 0x7fe730032330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:38.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.770+0000 7fe729ffb700 1 -- 172.21.15.33:0/1962072215 >> 172.21.15.33:0/1962072215 conn(0x7fe7440f6530 msgr2=0x7fe7440700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:38.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.771+0000 7fe729ffb700 1 -- 172.21.15.33:0/1962072215 shutdown_connections 2024-02-15T18:22:38.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:38.771+0000 7fe729ffb700 1 -- 172.21.15.33:0/1962072215 wait complete. 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:37.757303+0000 mon.smithi033 (mon.0) 65 : cluster [DBG] mgrmap e10: smithi033.apxevf(active, starting, since 0.0524421s) 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:37.760068+0000 mon.smithi033 (mon.0) 66 : audit [DBG] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:37.760716+0000 mon.smithi033 (mon.0) 67 : audit [DBG] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi033.apxevf", "id": "smithi033.apxevf"}]: dispatch 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:37.761392+0000 mon.smithi033 (mon.0) 68 : audit [DBG] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:37.761566+0000 mon.smithi033 (mon.0) 69 : audit [DBG] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:37.761728+0000 mon.smithi033 (mon.0) 70 : audit [DBG] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:37.775218+0000 mon.smithi033 (mon.0) 71 : cluster [INF] Manager daemon smithi033.apxevf is now available 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:37.878581+0000 mon.smithi033 (mon.0) 72 : audit [DBG] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:37.880343+0000 mon.smithi033 (mon.0) 73 : audit [DBG] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:37.894870+0000 mon.smithi033 (mon.0) 74 : audit [INF] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:22:39.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:37.897890+0000 mon.smithi033 (mon.0) 75 : audit [INF] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:22:39.467 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying grafana service with default placement... 2024-02-15T18:22:39.468 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply grafana 2024-02-15T18:22:40.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:38.765222+0000 mon.smithi033 (mon.0) 76 : cluster [DBG] mgrmap e11: smithi033.apxevf(active, since 1.06036s) 2024-02-15T18:22:40.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:22:38.766398+0000 mgr.smithi033.apxevf (mgr.14142) 2 : cephadm [INF] Saving service prometheus spec with placement count:1 2024-02-15T18:22:40.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:38.769291+0000 mon.smithi033 (mon.0) 77 : audit [INF] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.079+0000 7f08aa545700 1 Processor -- start 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.080+0000 7f08aa545700 1 -- start start 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.080+0000 7f08aa545700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a40feb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.080+0000 7f08aa545700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4070790 con 0x7f08a4070370 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.080+0000 7f08a3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a40feb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.080+0000 7f08a3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a40feb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41002/0 (socket says 172.21.15.33:41002) 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.080+0000 7f08a3fff700 1 -- 172.21.15.33:0/3247256011 learned_addr learned my addr 172.21.15.33:0/3247256011 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.080+0000 7f08a3fff700 1 -- 172.21.15.33:0/3247256011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40ff000 con 0x7f08a4070370 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.080+0000 7f08a3fff700 1 --2- 172.21.15.33:0/3247256011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a40feb10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f089400b5f0 tx=0x7f0894006ee0).ready entity=mon.0 client_cookie=7428b489e8288d49 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:40.083 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.081+0000 7f08a2ffd700 1 -- 172.21.15.33:0/3247256011 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f089400d600 con 0x7f08a4070370 2024-02-15T18:22:40.084 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.081+0000 7f08a2ffd700 1 -- 172.21.15.33:0/3247256011 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f089400dbf0 con 0x7f08a4070370 2024-02-15T18:22:40.084 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.081+0000 7f08a2ffd700 1 -- 172.21.15.33:0/3247256011 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0894011cb0 con 0x7f08a4070370 2024-02-15T18:22:40.084 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.081+0000 7f08aa545700 1 -- 172.21.15.33:0/3247256011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 msgr2=0x7f08a40feb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:40.084 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.081+0000 7f08aa545700 1 --2- 172.21.15.33:0/3247256011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a40feb10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f089400b5f0 tx=0x7f0894006ee0).stop 2024-02-15T18:22:40.084 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.081+0000 7f08aa545700 1 -- 172.21.15.33:0/3247256011 shutdown_connections 2024-02-15T18:22:40.084 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.081+0000 7f08aa545700 1 --2- 172.21.15.33:0/3247256011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a40feb10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:40.084 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.082+0000 7f08aa545700 1 -- 172.21.15.33:0/3247256011 >> 172.21.15.33:0/3247256011 conn(0x7f08a40f6530 msgr2=0x7f08a40f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:40.086 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.082+0000 7f08aa545700 1 -- 172.21.15.33:0/3247256011 shutdown_connections 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.082+0000 7f08aa545700 1 -- 172.21.15.33:0/3247256011 wait complete. 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.082+0000 7f08aa545700 1 Processor -- start 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.083+0000 7f08aa545700 1 -- start start 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.083+0000 7f08aa545700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a410ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.083+0000 7f08aa545700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a410b020 con 0x7f08a4070370 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.083+0000 7f08a3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a410ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.083+0000 7f08a3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a410ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41008/0 (socket says 172.21.15.33:41008) 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.083+0000 7f08a3fff700 1 -- 172.21.15.33:0/1185902481 learned_addr learned my addr 172.21.15.33:0/1185902481 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.083+0000 7f08a3fff700 1 -- 172.21.15.33:0/1185902481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089400b200 con 0x7f08a4070370 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.083+0000 7f08a3fff700 1 --2- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a410ab30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0894006800 tx=0x7f0894006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.084+0000 7f08a0ff9700 1 -- 172.21.15.33:0/1185902481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f089401b570 con 0x7f08a4070370 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.084+0000 7f08a0ff9700 1 -- 172.21.15.33:0/1185902481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f089401bb60 con 0x7f08a4070370 2024-02-15T18:22:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.084+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a410b220 con 0x7f08a4070370 2024-02-15T18:22:40.088 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.084+0000 7f08a0ff9700 1 -- 172.21.15.33:0/1185902481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f089401a9f0 con 0x7f08a4070370 2024-02-15T18:22:40.088 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.084+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a410b6b0 con 0x7f08a4070370 2024-02-15T18:22:40.088 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.085+0000 7f08a0ff9700 1 -- 172.21.15.33:0/1185902481 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f089400f070 con 0x7f08a4070370 2024-02-15T18:22:40.088 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.085+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a4045ad0 con 0x7f08a4070370 2024-02-15T18:22:40.088 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.085+0000 7f08a0ff9700 1 --2- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f089002ff20 0x7f08900323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:40.088 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.085+0000 7f08a0ff9700 1 -- 172.21.15.33:0/1185902481 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f0894041610 con 0x7f08a4070370 2024-02-15T18:22:40.088 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.085+0000 7f08a37fe700 1 --2- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f089002ff20 0x7f08900323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:40.088 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.085+0000 7f08a37fe700 1 --2- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f089002ff20 0x7f08900323e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f08980096a0 tx=0x7f0898006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:40.090 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.089+0000 7f08a0ff9700 1 -- 172.21.15.33:0/1185902481 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0894022310 con 0x7f08a4070370 2024-02-15T18:22:40.278 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.277+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 --> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f08a410bf10 con 0x7f089002ff20 2024-02-15T18:22:40.283 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.282+0000 7f08a0ff9700 1 -- 172.21.15.33:0/1185902481 <== mgr.14142 v2:172.21.15.33:6800/1651162060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f08a410bf10 con 0x7f089002ff20 2024-02-15T18:22:40.283 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled grafana update... 2024-02-15T18:22:40.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.283+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f089002ff20 msgr2=0x7f08900323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:40.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.283+0000 7f08aa545700 1 --2- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f089002ff20 0x7f08900323e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f08980096a0 tx=0x7f0898006b40).stop 2024-02-15T18:22:40.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.283+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 msgr2=0x7f08a410ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:40.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.283+0000 7f08aa545700 1 --2- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a410ab30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f0894006800 tx=0x7f0894006ee0).stop 2024-02-15T18:22:40.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.283+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 shutdown_connections 2024-02-15T18:22:40.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.283+0000 7f08aa545700 1 --2- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f089002ff20 0x7f08900323e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:40.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.283+0000 7f08aa545700 1 --2- 172.21.15.33:0/1185902481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08a4070370 0x7f08a410ab30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:40.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.283+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 >> 172.21.15.33:0/1185902481 conn(0x7f08a40f6530 msgr2=0x7f08a40f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:40.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.284+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 shutdown_connections 2024-02-15T18:22:40.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:40.284+0000 7f08aa545700 1 -- 172.21.15.33:0/1185902481 wait complete. 2024-02-15T18:22:41.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:39.771635+0000 mon.smithi033 (mon.0) 78 : cluster [DBG] mgrmap e12: smithi033.apxevf(active, since 2s) 2024-02-15T18:22:41.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:40.279891+0000 mgr.smithi033.apxevf (mgr.14142) 3 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:41.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:22:40.280386+0000 mgr.smithi033.apxevf (mgr.14142) 4 : cephadm [INF] Saving service grafana spec with placement count:1 2024-02-15T18:22:41.056 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:40.283570+0000 mon.smithi033 (mon.0) 79 : audit [INF] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:41.174 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying node-exporter service with default placement... 2024-02-15T18:22:41.174 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply node-exporter 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.771+0000 7f3e7f304700 1 Processor -- start 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.771+0000 7f3e7f304700 1 -- start start 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.771+0000 7f3e7f304700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e780fea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.772+0000 7f3e7f304700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780fef40 con 0x7f3e78070430 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.772+0000 7f3e7d0a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e780fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.772+0000 7f3e7d0a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e780fea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41014/0 (socket says 172.21.15.33:41014) 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.772+0000 7f3e7d0a0700 1 -- 172.21.15.33:0/2355446218 learned_addr learned my addr 172.21.15.33:0/2355446218 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.772+0000 7f3e7d0a0700 1 -- 172.21.15.33:0/2355446218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780ff080 con 0x7f3e78070430 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.772+0000 7f3e7d0a0700 1 --2- 172.21.15.33:0/2355446218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e780fea50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3e6800b5f0 tx=0x7f3e68006ee0).ready entity=mon.0 client_cookie=b5df3f544ff353ac server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.772+0000 7f3e67fff700 1 -- 172.21.15.33:0/2355446218 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e6800d600 con 0x7f3e78070430 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.772+0000 7f3e67fff700 1 -- 172.21.15.33:0/2355446218 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f3e6800dbf0 con 0x7f3e78070430 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.772+0000 7f3e67fff700 1 -- 172.21.15.33:0/2355446218 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e68011cb0 con 0x7f3e78070430 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.773+0000 7f3e7f304700 1 -- 172.21.15.33:0/2355446218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 msgr2=0x7f3e780fea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.773+0000 7f3e7f304700 1 --2- 172.21.15.33:0/2355446218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e780fea50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3e6800b5f0 tx=0x7f3e68006ee0).stop 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.773+0000 7f3e7f304700 1 -- 172.21.15.33:0/2355446218 shutdown_connections 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.773+0000 7f3e7f304700 1 --2- 172.21.15.33:0/2355446218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e780fea50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.773+0000 7f3e7f304700 1 -- 172.21.15.33:0/2355446218 >> 172.21.15.33:0/2355446218 conn(0x7f3e780f6530 msgr2=0x7f3e780f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.773+0000 7f3e7f304700 1 -- 172.21.15.33:0/2355446218 shutdown_connections 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.773+0000 7f3e7f304700 1 -- 172.21.15.33:0/2355446218 wait complete. 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7f304700 1 Processor -- start 2024-02-15T18:22:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7f304700 1 -- start start 2024-02-15T18:22:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7f304700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e7810ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7f304700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7810b080 con 0x7f3e78070430 2024-02-15T18:22:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7d0a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e7810ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:41.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7d0a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e7810ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41016/0 (socket says 172.21.15.33:41016) 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7d0a0700 1 -- 172.21.15.33:0/3666681103 learned_addr learned my addr 172.21.15.33:0/3666681103 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7d0a0700 1 -- 172.21.15.33:0/3666681103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6800b200 con 0x7f3e78070430 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7d0a0700 1 --2- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e7810ab90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3e6800df90 tx=0x7f3e68006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e65ffb700 1 -- 172.21.15.33:0/3666681103 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e6801b410 con 0x7f3e78070430 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7810b280 con 0x7f3e78070430 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e65ffb700 1 -- 172.21.15.33:0/3666681103 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f3e6801ba00 con 0x7f3e78070430 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.774+0000 7f3e65ffb700 1 -- 172.21.15.33:0/3666681103 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e6801aa30 con 0x7f3e78070430 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.775+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7810b710 con 0x7f3e78070430 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.776+0000 7f3e65ffb700 1 -- 172.21.15.33:0/3666681103 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f3e6800f070 con 0x7f3e78070430 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.776+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e78045ad0 con 0x7f3e78070430 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.776+0000 7f3e65ffb700 1 --2- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f3e6002ff20 0x7f3e600323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.776+0000 7f3e65ffb700 1 -- 172.21.15.33:0/3666681103 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f3e680412f0 con 0x7f3e78070430 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.776+0000 7f3e7c89f700 1 --2- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f3e6002ff20 0x7f3e600323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:41.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.776+0000 7f3e7c89f700 1 --2- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f3e6002ff20 0x7f3e600323e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3e740096a0 tx=0x7f3e74006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:41.781 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.780+0000 7f3e65ffb700 1 -- 172.21.15.33:0/3666681103 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3e68022310 con 0x7f3e78070430 2024-02-15T18:22:41.969 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.968+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 --> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e7810c030 con 0x7f3e6002ff20 2024-02-15T18:22:41.973 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.972+0000 7f3e65ffb700 1 -- 172.21.15.33:0/3666681103 <== mgr.14142 v2:172.21.15.33:6800/1651162060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f3e7810c030 con 0x7f3e6002ff20 2024-02-15T18:22:41.973 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f3e6002ff20 msgr2=0x7f3e600323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 --2- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f3e6002ff20 0x7f3e600323e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3e740096a0 tx=0x7f3e74006b40).stop 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 msgr2=0x7f3e7810ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 --2- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e7810ab90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3e6800df90 tx=0x7f3e68006ee0).stop 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 shutdown_connections 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 --2- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f3e6002ff20 0x7f3e600323e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 --2- 172.21.15.33:0/3666681103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e78070430 0x7f3e7810ab90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 >> 172.21.15.33:0/3666681103 conn(0x7f3e780f6530 msgr2=0x7f3e780f7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 shutdown_connections 2024-02-15T18:22:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:41.974+0000 7f3e7f304700 1 -- 172.21.15.33:0/3666681103 wait complete. 2024-02-15T18:22:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying alertmanager service with default placement... 2024-02-15T18:22:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply alertmanager 2024-02-15T18:22:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 Processor -- start 2024-02-15T18:22:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 -- start start 2024-02-15T18:22:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c040faf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c040fb440 con 0x7f9c040fab30 2024-02-15T18:22:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c02d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c040faf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c02d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c040faf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41018/0 (socket says 172.21.15.33:41018) 2024-02-15T18:22:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c02d9d700 1 -- 172.21.15.33:0/2368183367 learned_addr learned my addr 172.21.15.33:0/2368183367 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c02d9d700 1 -- 172.21.15.33:0/2368183367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c040fb580 con 0x7f9c040fab30 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c02d9d700 1 --2- 172.21.15.33:0/2368183367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c040faf50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f9bf400b870 tx=0x7f9bf4006f70).ready entity=mon.0 client_cookie=147ecdfa500f1096 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c01d9b700 1 -- 172.21.15.33:0/2368183367 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf400da20 con 0x7f9c040fab30 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c01d9b700 1 -- 172.21.15.33:0/2368183367 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f9bf4010470 con 0x7f9c040fab30 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c01d9b700 1 -- 172.21.15.33:0/2368183367 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf400f5b0 con 0x7f9c040fab30 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 -- 172.21.15.33:0/2368183367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 msgr2=0x7f9c040faf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 --2- 172.21.15.33:0/2368183367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c040faf50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f9bf400b870 tx=0x7f9bf4006f70).stop 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 -- 172.21.15.33:0/2368183367 shutdown_connections 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 --2- 172.21.15.33:0/2368183367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c040faf50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 -- 172.21.15.33:0/2368183367 >> 172.21.15.33:0/2368183367 conn(0x7f9c040f6390 msgr2=0x7f9c040f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 -- 172.21.15.33:0/2368183367 shutdown_connections 2024-02-15T18:22:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.104+0000 7f9c089f1700 1 -- 172.21.15.33:0/2368183367 wait complete. 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.105+0000 7f9c089f1700 1 Processor -- start 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.105+0000 7f9c089f1700 1 -- start start 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9c089f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c04108750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9c089f1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04108c40 con 0x7f9c040fab30 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9c02d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c04108750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9c02d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c04108750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41024/0 (socket says 172.21.15.33:41024) 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9c02d9d700 1 -- 172.21.15.33:0/1987358359 learned_addr learned my addr 172.21.15.33:0/1987358359 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9c02d9d700 1 -- 172.21.15.33:0/1987358359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf400b480 con 0x7f9c040fab30 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9c02d9d700 1 --2- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c04108750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9bf4006800 tx=0x7f9bf4006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9beb7fe700 1 -- 172.21.15.33:0/1987358359 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf400f3d0 con 0x7f9c040fab30 2024-02-15T18:22:43.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9beb7fe700 1 -- 172.21.15.33:0/1987358359 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f9bf400fd00 con 0x7f9c040fab30 2024-02-15T18:22:43.111 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9beb7fe700 1 -- 172.21.15.33:0/1987358359 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bf4019d00 con 0x7f9c040fab30 2024-02-15T18:22:43.111 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c04108e40 con 0x7f9c040fab30 2024-02-15T18:22:43.111 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.106+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c041092d0 con 0x7f9c040fab30 2024-02-15T18:22:43.111 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.107+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c04045ad0 con 0x7f9c040fab30 2024-02-15T18:22:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.108+0000 7f9beb7fe700 1 -- 172.21.15.33:0/1987358359 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f9bf4016030 con 0x7f9c040fab30 2024-02-15T18:22:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.108+0000 7f9beb7fe700 1 --2- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f9bf002ff20 0x7f9bf00323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.108+0000 7f9beb7fe700 1 -- 172.21.15.33:0/1987358359 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f9bf4044240 con 0x7f9c040fab30 2024-02-15T18:22:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.108+0000 7f9c0259c700 1 --2- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f9bf002ff20 0x7f9bf00323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.108+0000 7f9c0259c700 1 --2- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f9bf002ff20 0x7f9bf00323e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9bf80096a0 tx=0x7f9bf8006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.112+0000 7f9beb7fe700 1 -- 172.21.15.33:0/1987358359 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9bf400fe70 con 0x7f9c040fab30 2024-02-15T18:22:43.302 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.301+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 --> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c04109b30 con 0x7f9bf002ff20 2024-02-15T18:22:43.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:41.971173+0000 mgr.smithi033.apxevf (mgr.14142) 5 : audit [DBG] from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:43.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:22:41.971834+0000 mgr.smithi033.apxevf (mgr.14142) 6 : cephadm [INF] Saving service node-exporter spec with placement * 2024-02-15T18:22:43.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:41.974088+0000 mon.smithi033 (mon.0) 80 : audit [INF] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:43.306 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.305+0000 7f9beb7fe700 1 -- 172.21.15.33:0/1987358359 <== mgr.14142 v2:172.21.15.33:6800/1651162060 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f9c04109b30 con 0x7f9bf002ff20 2024-02-15T18:22:43.306 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2024-02-15T18:22:43.308 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.306+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f9bf002ff20 msgr2=0x7f9bf00323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:43.308 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.306+0000 7f9c089f1700 1 --2- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f9bf002ff20 0x7f9bf00323e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9bf80096a0 tx=0x7f9bf8006b40).stop 2024-02-15T18:22:43.308 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.306+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 msgr2=0x7f9c04108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:43.308 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.306+0000 7f9c089f1700 1 --2- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c04108750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9bf4006800 tx=0x7f9bf4006f70).stop 2024-02-15T18:22:43.308 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.307+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 shutdown_connections 2024-02-15T18:22:43.308 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.307+0000 7f9c089f1700 1 --2- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f9bf002ff20 0x7f9bf00323e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:43.309 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.307+0000 7f9c089f1700 1 --2- 172.21.15.33:0/1987358359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c040fab30 0x7f9c04108750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:43.309 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.307+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 >> 172.21.15.33:0/1987358359 conn(0x7f9c040f6390 msgr2=0x7f9c040ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:43.309 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.307+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 shutdown_connections 2024-02-15T18:22:43.309 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:43.307+0000 7f9c089f1700 1 -- 172.21.15.33:0/1987358359 wait complete. 2024-02-15T18:22:44.013 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/cephadm/container_init True --force 2024-02-15T18:22:44.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:43.303828+0000 mgr.smithi033.apxevf (mgr.14142) 7 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:44.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:22:43.304366+0000 mgr.smithi033.apxevf (mgr.14142) 8 : cephadm [INF] Saving service alertmanager spec with placement count:1 2024-02-15T18:22:44.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:43.306416+0000 mon.smithi033 (mon.0) 81 : audit [INF] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:44.615 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.612+0000 7f4f4af5b700 1 Processor -- start 2024-02-15T18:22:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.612+0000 7f4f4af5b700 1 -- start start 2024-02-15T18:22:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.612+0000 7f4f4af5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f44070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.612+0000 7f4f4af5b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f44072940 con 0x7f4f44072520 2024-02-15T18:22:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.612+0000 7f4f48cf7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f44070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.613+0000 7f4f48cf7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f44070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41036/0 (socket says 172.21.15.33:41036) 2024-02-15T18:22:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.613+0000 7f4f48cf7700 1 -- 172.21.15.33:0/3839893394 learned_addr learned my addr 172.21.15.33:0/3839893394 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.613+0000 7f4f48cf7700 1 -- 172.21.15.33:0/3839893394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f44070fb0 con 0x7f4f44072520 2024-02-15T18:22:44.616 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.613+0000 7f4f48cf7700 1 --2- 172.21.15.33:0/3839893394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f44070ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4f3400b5f0 tx=0x7f4f34006ee0).ready entity=mon.0 client_cookie=3becff239911ed2d server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.613+0000 7f4f437fe700 1 -- 172.21.15.33:0/3839893394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f3400d600 con 0x7f4f44072520 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.613+0000 7f4f437fe700 1 -- 172.21.15.33:0/3839893394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f4f3400dbf0 con 0x7f4f44072520 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.613+0000 7f4f437fe700 1 -- 172.21.15.33:0/3839893394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f34011cb0 con 0x7f4f44072520 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.614+0000 7f4f4af5b700 1 -- 172.21.15.33:0/3839893394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 msgr2=0x7f4f44070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.614+0000 7f4f4af5b700 1 --2- 172.21.15.33:0/3839893394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f44070ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4f3400b5f0 tx=0x7f4f34006ee0).stop 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.614+0000 7f4f4af5b700 1 -- 172.21.15.33:0/3839893394 shutdown_connections 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.614+0000 7f4f4af5b700 1 --2- 172.21.15.33:0/3839893394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f44070ac0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.614+0000 7f4f4af5b700 1 -- 172.21.15.33:0/3839893394 >> 172.21.15.33:0/3839893394 conn(0x7f4f440f76a0 msgr2=0x7f4f440f9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.614+0000 7f4f4af5b700 1 -- 172.21.15.33:0/3839893394 shutdown_connections 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.614+0000 7f4f4af5b700 1 -- 172.21.15.33:0/3839893394 wait complete. 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.614+0000 7f4f4af5b700 1 Processor -- start 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.614+0000 7f4f4af5b700 1 -- start start 2024-02-15T18:22:44.617 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.615+0000 7f4f4af5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f4410ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.615+0000 7f4f4af5b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4410d3a0 con 0x7f4f44072520 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.615+0000 7f4f48cf7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f4410ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.615+0000 7f4f48cf7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f4410ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41044/0 (socket says 172.21.15.33:41044) 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.615+0000 7f4f48cf7700 1 -- 172.21.15.33:0/1838871197 learned_addr learned my addr 172.21.15.33:0/1838871197 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.615+0000 7f4f48cf7700 1 -- 172.21.15.33:0/1838871197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3400b200 con 0x7f4f44072520 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.615+0000 7f4f48cf7700 1 --2- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f4410ceb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4f3400dfc0 tx=0x7f4f34006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.615+0000 7f4f417fa700 1 -- 172.21.15.33:0/1838871197 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f3401b410 con 0x7f4f44072520 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.616+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4410d5a0 con 0x7f4f44072520 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.616+0000 7f4f417fa700 1 -- 172.21.15.33:0/1838871197 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7f4f3401ba00 con 0x7f4f44072520 2024-02-15T18:22:44.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.616+0000 7f4f417fa700 1 -- 172.21.15.33:0/1838871197 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f3401a990 con 0x7f4f44072520 2024-02-15T18:22:44.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.616+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4410e150 con 0x7f4f44072520 2024-02-15T18:22:44.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.616+0000 7f4f417fa700 1 -- 172.21.15.33:0/1838871197 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f4f3400f070 con 0x7f4f44072520 2024-02-15T18:22:44.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.616+0000 7f4f417fa700 1 --2- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f4f3002ff20 0x7f4f300323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:44.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.617+0000 7f4f417fa700 1 -- 172.21.15.33:0/1838871197 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f4f34041520 con 0x7f4f44072520 2024-02-15T18:22:44.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.617+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f44059100 con 0x7f4f44072520 2024-02-15T18:22:44.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.617+0000 7f4f43fff700 1 --2- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f4f3002ff20 0x7f4f300323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:44.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.617+0000 7f4f43fff700 1 --2- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f4f3002ff20 0x7f4f300323e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f4f380096a0 tx=0x7f4f38006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:44.621 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.621+0000 7f4f417fa700 1 -- 172.21.15.33:0/1838871197 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4f34016070 con 0x7f4f44072520 2024-02-15T18:22:44.781 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.781+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f4f44102180 con 0x7f4f44072520 2024-02-15T18:22:44.783 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.784+0000 7f4f417fa700 1 -- 172.21.15.33:0/1838871197 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v8)=0 v8) v1 ==== 142+0+0 (secure 0 0 0) 0x7f4f34010360 con 0x7f4f44072520 2024-02-15T18:22:44.786 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.785+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f4f3002ff20 msgr2=0x7f4f300323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:44.786 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.785+0000 7f4f4af5b700 1 --2- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f4f3002ff20 0x7f4f300323e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f4f380096a0 tx=0x7f4f38006b40).stop 2024-02-15T18:22:44.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.786+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 msgr2=0x7f4f4410ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:44.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.786+0000 7f4f4af5b700 1 --2- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f4410ceb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4f3400dfc0 tx=0x7f4f34006ee0).stop 2024-02-15T18:22:44.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.786+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 shutdown_connections 2024-02-15T18:22:44.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.786+0000 7f4f4af5b700 1 --2- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f4f3002ff20 0x7f4f300323e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:44.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.786+0000 7f4f4af5b700 1 --2- 172.21.15.33:0/1838871197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f44072520 0x7f4f4410ceb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:44.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.786+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 >> 172.21.15.33:0/1838871197 conn(0x7f4f440f76a0 msgr2=0x7f4f440f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:44.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.786+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 shutdown_connections 2024-02-15T18:22:44.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:44.786+0000 7f4f4af5b700 1 -- 172.21.15.33:0/1838871197 wait complete. 2024-02-15T18:22:45.714 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/dashboard/ssl_server_port 8443 2024-02-15T18:22:45.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:44.784654+0000 mon.smithi033 (mon.0) 82 : audit [INF] from='client.? 172.21.15.33:0/1838871197' entity='client.admin' 2024-02-15T18:22:46.342 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.341+0000 7fa1a3505700 1 Processor -- start 2024-02-15T18:22:46.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.342+0000 7fa1a3505700 1 -- start start 2024-02-15T18:22:46.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.342+0000 7fa1a3505700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:46.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.342+0000 7fa1a3505700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0fc8c0 con 0x7fa19c0703b0 2024-02-15T18:22:46.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.342+0000 7fa1a12a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:46.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.342+0000 7fa1a12a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53440/0 (socket says 172.21.15.33:53440) 2024-02-15T18:22:46.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.342+0000 7fa1a12a1700 1 -- 172.21.15.33:0/4239734389 learned_addr learned my addr 172.21.15.33:0/4239734389 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:46.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.342+0000 7fa1a12a1700 1 -- 172.21.15.33:0/4239734389 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c1013c0 con 0x7fa19c0703b0 2024-02-15T18:22:46.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa1a12a1700 1 --2- 172.21.15.33:0/4239734389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c100ed0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa198009960 tx=0x7fa1980092d0).ready entity=mon.0 client_cookie=ad75b24f5e46f899 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:46.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa18bfff700 1 -- 172.21.15.33:0/4239734389 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa19800b9c0 con 0x7fa19c0703b0 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa18bfff700 1 -- 172.21.15.33:0/4239734389 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fa198011400 con 0x7fa19c0703b0 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa18bfff700 1 -- 172.21.15.33:0/4239734389 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa198010580 con 0x7fa19c0703b0 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa1a3505700 1 -- 172.21.15.33:0/4239734389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 msgr2=0x7fa19c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa1a3505700 1 --2- 172.21.15.33:0/4239734389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c100ed0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa198009960 tx=0x7fa1980092d0).stop 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa1a3505700 1 -- 172.21.15.33:0/4239734389 shutdown_connections 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa1a3505700 1 --2- 172.21.15.33:0/4239734389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c100ed0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa1a3505700 1 -- 172.21.15.33:0/4239734389 >> 172.21.15.33:0/4239734389 conn(0x7fa19c0f6530 msgr2=0x7fa19c0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.343+0000 7fa1a3505700 1 -- 172.21.15.33:0/4239734389 shutdown_connections 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.344+0000 7fa1a3505700 1 -- 172.21.15.33:0/4239734389 wait complete. 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.344+0000 7fa1a3505700 1 Processor -- start 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.344+0000 7fa1a3505700 1 -- start start 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.344+0000 7fa1a3505700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c10cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.344+0000 7fa1a3505700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c10d270 con 0x7fa19c0703b0 2024-02-15T18:22:46.345 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.344+0000 7fa1a12a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c10cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:46.346 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.344+0000 7fa1a12a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c10cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53454/0 (socket says 172.21.15.33:53454) 2024-02-15T18:22:46.346 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.344+0000 7fa1a12a1700 1 -- 172.21.15.33:0/2556792961 learned_addr learned my addr 172.21.15.33:0/2556792961 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:46.346 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.345+0000 7fa1a12a1700 1 -- 172.21.15.33:0/2556792961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198009570 con 0x7fa19c0703b0 2024-02-15T18:22:46.346 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.345+0000 7fa1a12a1700 1 --2- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c10cd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa19800bd90 tx=0x7fa198011f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:46.346 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.345+0000 7fa189ffb700 1 -- 172.21.15.33:0/2556792961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1980108d0 con 0x7fa19c0703b0 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.345+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c10d470 con 0x7fa19c0703b0 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.345+0000 7fa189ffb700 1 -- 172.21.15.33:0/2556792961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7fa198010ec0 con 0x7fa19c0703b0 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.345+0000 7fa189ffb700 1 -- 172.21.15.33:0/2556792961 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa19801ada0 con 0x7fa19c0703b0 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.345+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c10e080 con 0x7fa19c0703b0 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.346+0000 7fa189ffb700 1 -- 172.21.15.33:0/2556792961 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7fa19800f070 con 0x7fa19c0703b0 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.346+0000 7fa189ffb700 1 --2- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fa18402ff20 0x7fa1840323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.346+0000 7fa189ffb700 1 -- 172.21.15.33:0/2556792961 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fa198041c70 con 0x7fa19c0703b0 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.346+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c059100 con 0x7fa19c0703b0 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.346+0000 7fa1a0aa0700 1 --2- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fa18402ff20 0x7fa1840323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:46.347 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.347+0000 7fa1a0aa0700 1 --2- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fa18402ff20 0x7fa1840323e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fa18c0096a0 tx=0x7fa18c006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:46.350 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.351+0000 7fa189ffb700 1 -- 172.21.15.33:0/2556792961 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa198018500 con 0x7fa19c0703b0 2024-02-15T18:22:46.513 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.513+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fa19c045ad0 con 0x7fa19c0703b0 2024-02-15T18:22:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.516+0000 7fa189ffb700 1 -- 172.21.15.33:0/2556792961 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v9)=0 v9) v1 ==== 130+0+0 (secure 0 0 0) 0x7fa198018320 con 0x7fa19c0703b0 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fa18402ff20 msgr2=0x7fa1840323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 --2- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fa18402ff20 0x7fa1840323e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fa18c0096a0 tx=0x7fa18c006b40).stop 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 msgr2=0x7fa19c10cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 --2- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c10cd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa19800bd90 tx=0x7fa198011f90).stop 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 shutdown_connections 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 --2- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7fa18402ff20 0x7fa1840323e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 --2- 172.21.15.33:0/2556792961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa19c0703b0 0x7fa19c10cd80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 >> 172.21.15.33:0/2556792961 conn(0x7fa19c0f6530 msgr2=0x7fa19c0f7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 shutdown_connections 2024-02-15T18:22:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:46.518+0000 7fa1a3505700 1 -- 172.21.15.33:0/2556792961 wait complete. 2024-02-15T18:22:47.422 INFO:teuthology.orchestra.run.smithi033.stderr:Enabling the dashboard module... 2024-02-15T18:22:47.422 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable dashboard 2024-02-15T18:22:47.691 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:46.516994+0000 mon.smithi033 (mon.0) 83 : audit [INF] from='client.? 172.21.15.33:0/2556792961' entity='client.admin' 2024-02-15T18:22:48.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.103+0000 7ffa3de84700 1 Processor -- start 2024-02-15T18:22:48.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.103+0000 7ffa3de84700 1 -- start start 2024-02-15T18:22:48.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.103+0000 7ffa3de84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa380fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:48.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.103+0000 7ffa3de84700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380fedc0 con 0x7ffa380703f0 2024-02-15T18:22:48.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.103+0000 7ffa3ce82700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa380fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:48.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.103+0000 7ffa3ce82700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa380fe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53460/0 (socket says 172.21.15.33:53460) 2024-02-15T18:22:48.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.103+0000 7ffa3ce82700 1 -- 172.21.15.33:0/1805447815 learned_addr learned my addr 172.21.15.33:0/1805447815 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:48.105 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.104+0000 7ffa3ce82700 1 -- 172.21.15.33:0/1805447815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380fef00 con 0x7ffa380703f0 2024-02-15T18:22:48.105 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.104+0000 7ffa3ce82700 1 --2- 172.21.15.33:0/1805447815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa380fe8d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ffa2c00b5f0 tx=0x7ffa2c006ee0).ready entity=mon.0 client_cookie=1f617fbb768c408a server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:48.105 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.104+0000 7ffa377fe700 1 -- 172.21.15.33:0/1805447815 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa2c00d600 con 0x7ffa380703f0 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.104+0000 7ffa377fe700 1 -- 172.21.15.33:0/1805447815 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7ffa2c00dbf0 con 0x7ffa380703f0 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.104+0000 7ffa377fe700 1 -- 172.21.15.33:0/1805447815 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa2c011ce0 con 0x7ffa380703f0 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.104+0000 7ffa3de84700 1 -- 172.21.15.33:0/1805447815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 msgr2=0x7ffa380fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.104+0000 7ffa3de84700 1 --2- 172.21.15.33:0/1805447815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa380fe8d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ffa2c00b5f0 tx=0x7ffa2c006ee0).stop 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.104+0000 7ffa3de84700 1 -- 172.21.15.33:0/1805447815 shutdown_connections 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.104+0000 7ffa3de84700 1 --2- 172.21.15.33:0/1805447815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa380fe8d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.105+0000 7ffa3de84700 1 -- 172.21.15.33:0/1805447815 >> 172.21.15.33:0/1805447815 conn(0x7ffa380f6390 msgr2=0x7ffa380f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.105+0000 7ffa3de84700 1 -- 172.21.15.33:0/1805447815 shutdown_connections 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.105+0000 7ffa3de84700 1 -- 172.21.15.33:0/1805447815 wait complete. 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.105+0000 7ffa3de84700 1 Processor -- start 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.105+0000 7ffa3de84700 1 -- start start 2024-02-15T18:22:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.105+0000 7ffa3de84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa3810a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:48.107 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.105+0000 7ffa3de84700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3810ae70 con 0x7ffa380703f0 2024-02-15T18:22:48.107 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa3ce82700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa3810a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:48.107 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa3ce82700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa3810a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53464/0 (socket says 172.21.15.33:53464) 2024-02-15T18:22:48.107 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa3ce82700 1 -- 172.21.15.33:0/3927634997 learned_addr learned my addr 172.21.15.33:0/3927634997 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa3ce82700 1 -- 172.21.15.33:0/3927634997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c00b200 con 0x7ffa380703f0 2024-02-15T18:22:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa3ce82700 1 --2- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa3810a980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ffa2c011ed0 tx=0x7ffa2c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa357fa700 1 -- 172.21.15.33:0/3927634997 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa2c01b570 con 0x7ffa380703f0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa357fa700 1 -- 172.21.15.33:0/3927634997 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1045+0+0 (secure 0 0 0) 0x7ffa2c01bb60 con 0x7ffa380703f0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3810b070 con 0x7ffa380703f0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa357fa700 1 -- 172.21.15.33:0/3927634997 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa2c01aad0 con 0x7ffa380703f0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.106+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3810b500 con 0x7ffa380703f0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.107+0000 7ffa357fa700 1 -- 172.21.15.33:0/3927634997 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7ffa2c00f070 con 0x7ffa380703f0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.107+0000 7ffa357fa700 1 --2- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7ffa1c02ff20 0x7ffa1c0323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.107+0000 7ffa357fa700 1 -- 172.21.15.33:0/3927634997 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7ffa2c041510 con 0x7ffa380703f0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.107+0000 7ffa37fff700 1 --2- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7ffa1c02ff20 0x7ffa1c0323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.108+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa38045ad0 con 0x7ffa380703f0 2024-02-15T18:22:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.108+0000 7ffa37fff700 1 --2- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7ffa1c02ff20 0x7ffa1c0323e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ffa240096a0 tx=0x7ffa24006b40).ready entity=mgr.14142 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:48.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.112+0000 7ffa357fa700 1 -- 172.21.15.33:0/3927634997 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ffa2c016070 con 0x7ffa380703f0 2024-02-15T18:22:48.311 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.311+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7ffa38104970 con 0x7ffa380703f0 2024-02-15T18:22:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:48.523+0000 7ffa357fa700 1 -- 172.21.15.33:0/3927634997 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa2c022eb0 con 0x7ffa380703f0 2024-02-15T18:22:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.240+0000 7ffa357fa700 1 -- 172.21.15.33:0/3927634997 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7ffa2c025980 con 0x7ffa380703f0 2024-02-15T18:22:49.241 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.241+0000 7ffa357fa700 1 -- 172.21.15.33:0/3927634997 <== mon.0 v2:172.21.15.33:3300/0 9 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v13) v1 ==== 88+0+0 (secure 0 0 0) 0x7ffa2c010570 con 0x7ffa380703f0 2024-02-15T18:22:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7ffa1c02ff20 msgr2=0x7ffa1c0323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 --2- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7ffa1c02ff20 0x7ffa1c0323e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ffa240096a0 tx=0x7ffa24006b40).stop 2024-02-15T18:22:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 msgr2=0x7ffa3810a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 --2- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa3810a980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ffa2c011ed0 tx=0x7ffa2c006ee0).stop 2024-02-15T18:22:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 shutdown_connections 2024-02-15T18:22:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 --2- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7ffa1c02ff20 0x7ffa1c0323e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 --2- 172.21.15.33:0/3927634997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa380703f0 0x7ffa3810a980 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 >> 172.21.15.33:0/3927634997 conn(0x7ffa380f6390 msgr2=0x7ffa380f7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 shutdown_connections 2024-02-15T18:22:49.245 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:49.243+0000 7ffa3de84700 1 -- 172.21.15.33:0/3927634997 wait complete. 2024-02-15T18:22:49.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:48.311988+0000 mon.smithi033 (mon.0) 84 : audit [INF] from='client.? 172.21.15.33:0/3927634997' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-15T18:22:49.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:48.524258+0000 mon.smithi033 (mon.0) 85 : audit [INF] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:49.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:48.751104+0000 mon.smithi033 (mon.0) 86 : audit [INF] from='mgr.14142 172.21.15.33:0/571668084' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:50.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:49.242318+0000 mon.smithi033 (mon.0) 87 : audit [INF] from='client.? 172.21.15.33:0/3927634997' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-15T18:22:50.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:49.242364+0000 mon.smithi033 (mon.0) 88 : cluster [DBG] mgrmap e13: smithi033.apxevf(active, since 11s) 2024-02-15T18:22:50.689 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2024-02-15T18:22:51.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.307+0000 7feb884b2700 1 Processor -- start 2024-02-15T18:22:51.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.307+0000 7feb884b2700 1 -- start start 2024-02-15T18:22:51.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.307+0000 7feb884b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:51.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.307+0000 7feb884b2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800fef80 con 0x7feb800703f0 2024-02-15T18:22:51.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.307+0000 7feb8624e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:51.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.307+0000 7feb8624e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53500/0 (socket says 172.21.15.33:53500) 2024-02-15T18:22:51.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.307+0000 7feb8624e700 1 -- 172.21.15.33:0/1923505622 learned_addr learned my addr 172.21.15.33:0/1923505622 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:51.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.308+0000 7feb8624e700 1 -- 172.21.15.33:0/1923505622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb800ff0c0 con 0x7feb800703f0 2024-02-15T18:22:51.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.308+0000 7feb8624e700 1 --2- 172.21.15.33:0/1923505622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fea90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7feb7c00b5f0 tx=0x7feb7c006ee0).ready entity=mon.0 client_cookie=318bd290df2edae server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.308+0000 7feb8524c700 1 -- 172.21.15.33:0/1923505622 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb7c00d600 con 0x7feb800703f0 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.308+0000 7feb8524c700 1 -- 172.21.15.33:0/1923505622 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb7c00dc30 con 0x7feb800703f0 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.308+0000 7feb8524c700 1 -- 172.21.15.33:0/1923505622 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb7c011d60 con 0x7feb800703f0 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.309+0000 7feb884b2700 1 -- 172.21.15.33:0/1923505622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 msgr2=0x7feb800fea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.309+0000 7feb884b2700 1 --2- 172.21.15.33:0/1923505622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fea90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7feb7c00b5f0 tx=0x7feb7c006ee0).stop 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.309+0000 7feb884b2700 1 -- 172.21.15.33:0/1923505622 shutdown_connections 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.309+0000 7feb884b2700 1 --2- 172.21.15.33:0/1923505622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fea90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.309+0000 7feb884b2700 1 -- 172.21.15.33:0/1923505622 >> 172.21.15.33:0/1923505622 conn(0x7feb800f6530 msgr2=0x7feb800f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.309+0000 7feb884b2700 1 -- 172.21.15.33:0/1923505622 shutdown_connections 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.309+0000 7feb884b2700 1 -- 172.21.15.33:0/1923505622 wait complete. 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.309+0000 7feb884b2700 1 Processor -- start 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.310+0000 7feb884b2700 1 -- start start 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.310+0000 7feb884b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.310+0000 7feb884b2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800fa990 con 0x7feb800703f0 2024-02-15T18:22:51.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.310+0000 7feb8624e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.310+0000 7feb8624e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53504/0 (socket says 172.21.15.33:53504) 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.310+0000 7feb8624e700 1 -- 172.21.15.33:0/1549701210 learned_addr learned my addr 172.21.15.33:0/1549701210 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.310+0000 7feb8624e700 1 -- 172.21.15.33:0/1549701210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c00b200 con 0x7feb800703f0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.310+0000 7feb8624e700 1 --2- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fc510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7feb7c00e040 tx=0x7feb7c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.310+0000 7feb6effd700 1 -- 172.21.15.33:0/1549701210 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb7c011e10 con 0x7feb800703f0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.311+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb800fab30 con 0x7feb800703f0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.311+0000 7feb6effd700 1 -- 172.21.15.33:0/1549701210 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb7c01b8e0 con 0x7feb800703f0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.311+0000 7feb6effd700 1 -- 172.21.15.33:0/1549701210 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb7c01a930 con 0x7feb800703f0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.311+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb800fafc0 con 0x7feb800703f0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.311+0000 7feb6effd700 1 -- 172.21.15.33:0/1549701210 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7feb7c00f070 con 0x7feb800703f0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.312+0000 7feb6effd700 1 --2- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7feb6802ff70 0x7feb68032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.312+0000 7feb6effd700 1 -- 172.21.15.33:0/1549701210 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7feb7c040f20 con 0x7feb800703f0 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.312+0000 7feb85a4d700 1 -- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7feb6802ff70 msgr2=0x7feb68032430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1651162060 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.312+0000 7feb85a4d700 1 --2- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7feb6802ff70 0x7feb68032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:22:51.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.312+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb80059100 con 0x7feb800703f0 2024-02-15T18:22:51.316 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.316+0000 7feb6effd700 1 -- 172.21.15.33:0/1549701210 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7feb7c016070 con 0x7feb800703f0 2024-02-15T18:22:51.513 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.513+0000 7feb85a4d700 1 -- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7feb6802ff70 msgr2=0x7feb68032430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1651162060 2024-02-15T18:22:51.513 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.513+0000 7feb85a4d700 1 --2- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7feb6802ff70 0x7feb68032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-15T18:22:51.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.544+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7feb800ffe70 con 0x7feb800703f0 2024-02-15T18:22:51.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.544+0000 7feb6effd700 1 -- 172.21.15.33:0/1549701210 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v13) v1 ==== 56+0+104 (secure 0 0 0) 0x7feb7c0109b0 con 0x7feb800703f0 2024-02-15T18:22:51.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2024-02-15T18:22:51.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 13, 2024-02-15T18:22:51.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": true, 2024-02-15T18:22:51.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "active_name": "smithi033.apxevf", 2024-02-15T18:22:51.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-15T18:22:51.545 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2024-02-15T18:22:51.547 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7feb6802ff70 msgr2=0x7feb68032430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:22:51.547 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 --2- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7feb6802ff70 0x7feb68032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:51.547 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 msgr2=0x7feb800fc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:51.547 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 --2- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fc510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7feb7c00e040 tx=0x7feb7c006ee0).stop 2024-02-15T18:22:51.547 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 shutdown_connections 2024-02-15T18:22:51.547 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 --2- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7feb6802ff70 0x7feb68032430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:51.548 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 --2- 172.21.15.33:0/1549701210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb800703f0 0x7feb800fc510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:51.548 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 >> 172.21.15.33:0/1549701210 conn(0x7feb800f6530 msgr2=0x7feb800f7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:51.548 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 shutdown_connections 2024-02-15T18:22:51.548 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:51.546+0000 7feb884b2700 1 -- 172.21.15.33:0/1549701210 wait complete. 2024-02-15T18:22:51.917 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:51.545347+0000 mon.smithi033 (mon.0) 89 : audit [DBG] from='client.? 172.21.15.33:0/1549701210' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-15T18:22:52.279 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for the mgr to restart... 2024-02-15T18:22:52.279 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr epoch 13... 2024-02-15T18:22:52.279 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2024-02-15T18:22:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.850+0000 7f2eb46d1700 1 Processor -- start 2024-02-15T18:22:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.850+0000 7f2eb46d1700 1 -- start start 2024-02-15T18:22:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.850+0000 7f2eb46d1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac0fea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.850+0000 7f2eb46d1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0fef80 con 0x7f2eac0703f0 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.851+0000 7f2eb246d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac0fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.851+0000 7f2eb246d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac0fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53510/0 (socket says 172.21.15.33:53510) 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.851+0000 7f2eb246d700 1 -- 172.21.15.33:0/2764794481 learned_addr learned my addr 172.21.15.33:0/2764794481 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.851+0000 7f2eb246d700 1 -- 172.21.15.33:0/2764794481 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0ff0c0 con 0x7f2eac0703f0 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.851+0000 7f2eb246d700 1 --2- 172.21.15.33:0/2764794481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac0fea90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2e9c00b5f0 tx=0x7f2e9c006ee0).ready entity=mon.0 client_cookie=4b8dfd35ff9f27b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.851+0000 7f2eb146b700 1 -- 172.21.15.33:0/2764794481 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e9c00d600 con 0x7f2eac0703f0 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.851+0000 7f2eb146b700 1 -- 172.21.15.33:0/2764794481 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e9c00dc30 con 0x7f2eac0703f0 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.851+0000 7f2eb146b700 1 -- 172.21.15.33:0/2764794481 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e9c011d60 con 0x7f2eac0703f0 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.852+0000 7f2eb46d1700 1 -- 172.21.15.33:0/2764794481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 msgr2=0x7f2eac0fea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.852+0000 7f2eb46d1700 1 --2- 172.21.15.33:0/2764794481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac0fea90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2e9c00b5f0 tx=0x7f2e9c006ee0).stop 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.852+0000 7f2eb46d1700 1 -- 172.21.15.33:0/2764794481 shutdown_connections 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.852+0000 7f2eb46d1700 1 --2- 172.21.15.33:0/2764794481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac0fea90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.852+0000 7f2eb46d1700 1 -- 172.21.15.33:0/2764794481 >> 172.21.15.33:0/2764794481 conn(0x7f2eac0f6530 msgr2=0x7f2eac0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.852+0000 7f2eb46d1700 1 -- 172.21.15.33:0/2764794481 shutdown_connections 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.852+0000 7f2eb46d1700 1 -- 172.21.15.33:0/2764794481 wait complete. 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.853+0000 7f2eb46d1700 1 Processor -- start 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.853+0000 7f2eb46d1700 1 -- start start 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.853+0000 7f2eb46d1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac10ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.853+0000 7f2eb46d1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac10b0f0 con 0x7f2eac0703f0 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.853+0000 7f2eb246d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac10ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.853+0000 7f2eb246d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac10ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53514/0 (socket says 172.21.15.33:53514) 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.853+0000 7f2eb246d700 1 -- 172.21.15.33:0/611978809 learned_addr learned my addr 172.21.15.33:0/611978809 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.853+0000 7f2eb246d700 1 -- 172.21.15.33:0/611978809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c00b200 con 0x7f2eac0703f0 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.853+0000 7f2eb246d700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac10ac00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2e9c00e040 tx=0x7f2e9c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.854+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e9c011e10 con 0x7f2eac0703f0 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.854+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e9c01b8e0 con 0x7f2eac0703f0 2024-02-15T18:22:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.854+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac10b2f0 con 0x7f2eac0703f0 2024-02-15T18:22:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.854+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e9c01a930 con 0x7f2eac0703f0 2024-02-15T18:22:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.854+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac10b780 con 0x7f2eac0703f0 2024-02-15T18:22:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.854+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f2e9c00f070 con 0x7f2eac0703f0 2024-02-15T18:22:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.855+0000 7f2e9affd700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 0x7f2e94032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.855+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 --> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2eac059100 con 0x7f2e9402ff70 2024-02-15T18:22:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.855+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f2e9c041f60 con 0x7f2eac0703f0 2024-02-15T18:22:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.855+0000 7f2eb1c6c700 1 -- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 msgr2=0x7f2e94032430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1651162060 2024-02-15T18:22:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:52.855+0000 7f2eb1c6c700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 0x7f2e94032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:22:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:53.056+0000 7f2eb1c6c700 1 -- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 msgr2=0x7f2e94032430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1651162060 2024-02-15T18:22:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:53.056+0000 7f2eb1c6c700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 0x7f2e94032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-15T18:22:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:53.457+0000 7f2eb1c6c700 1 -- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 msgr2=0x7f2e94032430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1651162060 2024-02-15T18:22:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:53.457+0000 7f2eb1c6c700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 0x7f2e94032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-02-15T18:22:54.258 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:54.258+0000 7f2eb1c6c700 1 -- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 msgr2=0x7f2e94032430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/1651162060 2024-02-15T18:22:54.258 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:54.258+0000 7f2eb1c6c700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 0x7f2e94032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-02-15T18:22:54.499 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:54.498+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 14) v1 ==== 35997+0+0 (secure 0 0 0) 0x7f2e9c024930 con 0x7f2eac0703f0 2024-02-15T18:22:54.499 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:54.499+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 msgr2=0x7f2e94032430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:22:54.499 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:54.499+0000 7f2e9affd700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 0x7f2e94032430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:54.753 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:54.446670+0000 mon.smithi033 (mon.0) 90 : cluster [INF] Active manager daemon smithi033.apxevf restarted 2024-02-15T18:22:54.753 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:54.447193+0000 mon.smithi033 (mon.0) 91 : cluster [INF] Activating manager daemon smithi033.apxevf 2024-02-15T18:22:54.753 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:54.449422+0000 mon.smithi033 (mon.0) 92 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-15T18:22:55.506 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.505+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 15) v1 ==== 36067+0+0 (secure 0 0 0) 0x7f2e9c01b5e0 con 0x7f2eac0703f0 2024-02-15T18:22:55.507 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.506+0000 7f2e9affd700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2e94033a50 0x7f2e94035e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:55.507 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.506+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2eac059100 con 0x7f2e94033a50 2024-02-15T18:22:55.507 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.506+0000 7f2eb1c6c700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2e94033a50 0x7f2e94035e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:55.507 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.507+0000 7f2eb1c6c700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2e94033a50 0x7f2e94035e40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f2ea80036d0 tx=0x7f2ea8006ca0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:55.507 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.507+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f2eac059100 con 0x7f2e94033a50 2024-02-15T18:22:55.513 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.513+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2eac045ad0 con 0x7f2e94033a50 2024-02-15T18:22:55.515 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2e9affd700 1 -- 172.21.15.33:0/611978809 <== mgr.14162 v2:172.21.15.33:6800/1351334089 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f2eac045ad0 con 0x7f2e94033a50 2024-02-15T18:22:55.515 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2e94033a50 msgr2=0x7f2e94035e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:55.515 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2e94033a50 0x7f2e94035e40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f2ea80036d0 tx=0x7f2ea8006ca0).stop 2024-02-15T18:22:55.515 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 msgr2=0x7f2eac10ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:55.515 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac10ac00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2e9c00e040 tx=0x7f2e9c006ee0).stop 2024-02-15T18:22:55.516 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 shutdown_connections 2024-02-15T18:22:55.516 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2e94033a50 0x7f2e94035e40 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:55.516 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0703f0 0x7f2eac10ac00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:55.516 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 --2- 172.21.15.33:0/611978809 >> [v2:172.21.15.33:6800/1651162060,v1:172.21.15.33:6801/1651162060] conn(0x7f2e9402ff70 0x7f2e94032430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:22:55.517 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 >> 172.21.15.33:0/611978809 conn(0x7f2eac0f6530 msgr2=0x7f2eac0f7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:55.517 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.514+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 shutdown_connections 2024-02-15T18:22:55.517 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:55.515+0000 7f2eb46d1700 1 -- 172.21.15.33:0/611978809 wait complete. 2024-02-15T18:22:55.517 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2024-02-15T18:22:55.517 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap_epoch": 15, 2024-02-15T18:22:55.517 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "initialized": true 2024-02-15T18:22:55.517 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2024-02-15T18:22:55.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:54.500472+0000 mon.smithi033 (mon.0) 93 : cluster [DBG] mgrmap e14: smithi033.apxevf(active, starting, since 0.0534027s) 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:54.501599+0000 mon.smithi033 (mon.0) 94 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:54.503927+0000 mon.smithi033 (mon.0) 95 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi033.apxevf", "id": "smithi033.apxevf"}]: dispatch 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:54.504247+0000 mon.smithi033 (mon.0) 96 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:54.504465+0000 mon.smithi033 (mon.0) 97 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:54.504667+0000 mon.smithi033 (mon.0) 98 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:54.518280+0000 mon.smithi033 (mon.0) 99 : cluster [INF] Manager daemon smithi033.apxevf is now available 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:54.621624+0000 mon.smithi033 (mon.0) 100 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:54.623608+0000 mon.smithi033 (mon.0) 101 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:54.646046+0000 mon.smithi033 (mon.0) 102 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:22:55.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:54.650214+0000 mon.smithi033 (mon.0) 103 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:22:56.572 INFO:teuthology.orchestra.run.smithi033.stderr:mgr epoch 13 is available 2024-02-15T18:22:56.573 INFO:teuthology.orchestra.run.smithi033.stderr:Generating a dashboard self-signed certificate... 2024-02-15T18:22:56.573 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 dashboard create-self-signed-cert 2024-02-15T18:22:56.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:55.508120+0000 mgr.smithi033.apxevf (mgr.14162) 1 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-15T18:22:56.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:55.508406+0000 mon.smithi033 (mon.0) 104 : cluster [DBG] mgrmap e15: smithi033.apxevf(active, since 1.06134s) 2024-02-15T18:22:56.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:55.514874+0000 mgr.smithi033.apxevf (mgr.14162) 2 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-15T18:22:57.181 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.177+0000 7efd28439700 1 Processor -- start 2024-02-15T18:22:57.181 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.177+0000 7efd28439700 1 -- start start 2024-02-15T18:22:57.181 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.177+0000 7efd28439700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd200fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:57.181 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.177+0000 7efd28439700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200fb6a0 con 0x7efd200fad90 2024-02-15T18:22:57.181 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.177+0000 7efd261d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd200fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:57.181 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.178+0000 7efd261d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd200fb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32768/0 (socket says 172.21.15.33:32768) 2024-02-15T18:22:57.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.178+0000 7efd261d5700 1 -- 172.21.15.33:0/1559702491 learned_addr learned my addr 172.21.15.33:0/1559702491 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:57.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.178+0000 7efd261d5700 1 -- 172.21.15.33:0/1559702491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd200fb7e0 con 0x7efd200fad90 2024-02-15T18:22:57.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.178+0000 7efd261d5700 1 --2- 172.21.15.33:0/1559702491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd200fb1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efd1000b5f0 tx=0x7efd10006ee0).ready entity=mon.0 client_cookie=664b19a9ffd91a50 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:57.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.178+0000 7efd251d3700 1 -- 172.21.15.33:0/1559702491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd1000d600 con 0x7efd200fad90 2024-02-15T18:22:57.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.178+0000 7efd251d3700 1 -- 172.21.15.33:0/1559702491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd1000dc30 con 0x7efd200fad90 2024-02-15T18:22:57.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.178+0000 7efd251d3700 1 -- 172.21.15.33:0/1559702491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd10011d30 con 0x7efd200fad90 2024-02-15T18:22:57.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.178+0000 7efd28439700 1 -- 172.21.15.33:0/1559702491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 msgr2=0x7efd200fb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:57.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.178+0000 7efd28439700 1 --2- 172.21.15.33:0/1559702491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd200fb1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efd1000b5f0 tx=0x7efd10006ee0).stop 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.179+0000 7efd28439700 1 -- 172.21.15.33:0/1559702491 shutdown_connections 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.179+0000 7efd28439700 1 --2- 172.21.15.33:0/1559702491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd200fb1b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.179+0000 7efd28439700 1 -- 172.21.15.33:0/1559702491 >> 172.21.15.33:0/1559702491 conn(0x7efd200f6530 msgr2=0x7efd200f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.179+0000 7efd28439700 1 -- 172.21.15.33:0/1559702491 shutdown_connections 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.179+0000 7efd28439700 1 -- 172.21.15.33:0/1559702491 wait complete. 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.179+0000 7efd28439700 1 Processor -- start 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.179+0000 7efd28439700 1 -- start start 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.179+0000 7efd28439700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd201010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.179+0000 7efd28439700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200ff530 con 0x7efd200fad90 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd261d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd201010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd261d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd201010b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32774/0 (socket says 172.21.15.33:32774) 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd261d5700 1 -- 172.21.15.33:0/1421583498 learned_addr learned my addr 172.21.15.33:0/1421583498 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:57.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd261d5700 1 -- 172.21.15.33:0/1421583498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1000b200 con 0x7efd200fad90 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd261d5700 1 --2- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd201010b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7efd10006b80 tx=0x7efd10006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd0effd700 1 -- 172.21.15.33:0/1421583498 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd1000da60 con 0x7efd200fad90 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd0effd700 1 -- 172.21.15.33:0/1421583498 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd1001b8e0 con 0x7efd200fad90 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd200ff6d0 con 0x7efd200fad90 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd0effd700 1 -- 172.21.15.33:0/1421583498 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd1001a960 con 0x7efd200fad90 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.180+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd200ffb60 con 0x7efd200fad90 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.181+0000 7efd0effd700 1 -- 172.21.15.33:0/1421583498 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7efd1000f070 con 0x7efd200fad90 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.181+0000 7efd0effd700 1 --2- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7efd0802ffc0 0x7efd08032480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.181+0000 7efd0effd700 1 -- 172.21.15.33:0/1421583498 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7efd10041560 con 0x7efd200fad90 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.181+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd20045ad0 con 0x7efd200fad90 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.181+0000 7efd259d4700 1 --2- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7efd0802ffc0 0x7efd08032480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:57.186 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.182+0000 7efd259d4700 1 --2- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7efd0802ffc0 0x7efd08032480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7efd1c0096a0 tx=0x7efd1c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:57.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.189+0000 7efd0effd700 1 -- 172.21.15.33:0/1421583498 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7efd10016070 con 0x7efd200fad90 2024-02-15T18:22:57.360 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.360+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7efd20104ce0 con 0x7efd0802ffc0 2024-02-15T18:22:57.405 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.405+0000 7efd0effd700 1 -- 172.21.15.33:0/1421583498 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7efd20104ce0 con 0x7efd0802ffc0 2024-02-15T18:22:57.405 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Self-signed certificate created 2024-02-15T18:22:57.407 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.406+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7efd0802ffc0 msgr2=0x7efd08032480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:57.407 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.406+0000 7efd28439700 1 --2- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7efd0802ffc0 0x7efd08032480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7efd1c0096a0 tx=0x7efd1c006b40).stop 2024-02-15T18:22:57.407 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.406+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 msgr2=0x7efd201010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:57.407 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.406+0000 7efd28439700 1 --2- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd201010b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7efd10006b80 tx=0x7efd10006ee0).stop 2024-02-15T18:22:57.407 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.406+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 shutdown_connections 2024-02-15T18:22:57.407 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.406+0000 7efd28439700 1 --2- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7efd0802ffc0 0x7efd08032480 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:57.407 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.406+0000 7efd28439700 1 --2- 172.21.15.33:0/1421583498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd200fad90 0x7efd201010b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:57.408 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.406+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 >> 172.21.15.33:0/1421583498 conn(0x7efd200f6530 msgr2=0x7efd20070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:57.408 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.406+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 shutdown_connections 2024-02-15T18:22:57.408 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:57.407+0000 7efd28439700 1 -- 172.21.15.33:0/1421583498 wait complete. 2024-02-15T18:22:57.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:22:56.511623+0000 mon.smithi033 (mon.0) 105 : cluster [DBG] mgrmap e16: smithi033.apxevf(active, since 2s) 2024-02-15T18:22:57.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:56.884524+0000 mon.smithi033 (mon.0) 106 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:57.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:57.402879+0000 mon.smithi033 (mon.0) 107 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:57.750 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:57.405401+0000 mon.smithi033 (mon.0) 108 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:22:58.491 INFO:teuthology.orchestra.run.smithi033.stderr:Creating initial admin user... 2024-02-15T18:22:58.491 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp5zbv6_vb:/tmp/dashboard.pw:z docker.io/ceph/ceph:v16.2.4 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2024-02-15T18:22:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.140+0000 7f0eca816700 1 Processor -- start 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.140+0000 7f0eca816700 1 -- start start 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.140+0000 7f0eca816700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec4100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.140+0000 7f0eca816700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40fc990 con 0x7f0ec4070400 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.141+0000 7f0ec3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec4100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.141+0000 7f0ec3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec4100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32786/0 (socket says 172.21.15.33:32786) 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.141+0000 7f0ec3fff700 1 -- 172.21.15.33:0/777786715 learned_addr learned my addr 172.21.15.33:0/777786715 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.141+0000 7f0ec3fff700 1 -- 172.21.15.33:0/777786715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4101490 con 0x7f0ec4070400 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.141+0000 7f0ec3fff700 1 --2- 172.21.15.33:0/777786715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec4100fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0eb400b5f0 tx=0x7f0eb4006ee0).ready entity=mon.0 client_cookie=5a3cd16bb4c03061 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.141+0000 7f0ec2ffd700 1 -- 172.21.15.33:0/777786715 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0eb400d600 con 0x7f0ec4070400 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.141+0000 7f0ec2ffd700 1 -- 172.21.15.33:0/777786715 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0eb400dc30 con 0x7f0ec4070400 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.141+0000 7f0ec2ffd700 1 -- 172.21.15.33:0/777786715 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0eb4011d30 con 0x7f0ec4070400 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.142+0000 7f0eca816700 1 -- 172.21.15.33:0/777786715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 msgr2=0x7f0ec4100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.142+0000 7f0eca816700 1 --2- 172.21.15.33:0/777786715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec4100fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0eb400b5f0 tx=0x7f0eb4006ee0).stop 2024-02-15T18:22:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.142+0000 7f0eca816700 1 -- 172.21.15.33:0/777786715 shutdown_connections 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.142+0000 7f0eca816700 1 --2- 172.21.15.33:0/777786715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec4100fa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.142+0000 7f0eca816700 1 -- 172.21.15.33:0/777786715 >> 172.21.15.33:0/777786715 conn(0x7f0ec40f65c0 msgr2=0x7f0ec40f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.142+0000 7f0eca816700 1 -- 172.21.15.33:0/777786715 shutdown_connections 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.142+0000 7f0eca816700 1 -- 172.21.15.33:0/777786715 wait complete. 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.142+0000 7f0eca816700 1 Processor -- start 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0eca816700 1 -- start start 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0eca816700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec410ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0eca816700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec410d340 con 0x7f0ec4070400 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0ec3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec410ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0ec3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec410ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32790/0 (socket says 172.21.15.33:32790) 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0ec3fff700 1 -- 172.21.15.33:0/2683995456 learned_addr learned my addr 172.21.15.33:0/2683995456 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0ec3fff700 1 -- 172.21.15.33:0/2683995456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb400b200 con 0x7f0ec4070400 2024-02-15T18:22:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0ec3fff700 1 --2- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec410ce50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0eb4011f20 tx=0x7f0eb4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0ec0ff9700 1 -- 172.21.15.33:0/2683995456 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0eb400d960 con 0x7f0ec4070400 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec410d540 con 0x7f0ec4070400 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0ec0ff9700 1 -- 172.21.15.33:0/2683995456 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0eb400dac0 con 0x7f0ec4070400 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0ec0ff9700 1 -- 172.21.15.33:0/2683995456 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0eb401a850 con 0x7f0ec4070400 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.143+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec410e150 con 0x7f0ec4070400 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.144+0000 7f0ec0ff9700 1 -- 172.21.15.33:0/2683995456 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f0eb400f070 con 0x7f0ec4070400 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.144+0000 7f0ec0ff9700 1 --2- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0eb002ff70 0x7f0eb0032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.144+0000 7f0ec0ff9700 1 -- 172.21.15.33:0/2683995456 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f0eb4041440 con 0x7f0ec4070400 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.144+0000 7f0ec37fe700 1 --2- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0eb002ff70 0x7f0eb0032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.145+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec4059100 con 0x7f0ec4070400 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.145+0000 7f0ec37fe700 1 --2- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0eb002ff70 0x7f0eb0032430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f0eb80096a0 tx=0x7f0eb8006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.149+0000 7f0ec0ff9700 1 -- 172.21.15.33:0/2683995456 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0eb4016070 con 0x7f0ec4070400 2024-02-15T18:22:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.330+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0ec4058f20 con 0x7f0eb002ff70 2024-02-15T18:22:59.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:22:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:57.361267+0000 mgr.smithi033.apxevf (mgr.14162) 3 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:22:59.575 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.576+0000 7f0ec0ff9700 1 -- 172.21.15.33:0/2683995456 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f0ec4058f20 con 0x7f0eb002ff70 2024-02-15T18:22:59.576 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$dTYvOi0bxezauCcU1JXX4OI5YV0rzn4DEy9K8wpaUnvRY4XMpd./C", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708021379, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-15T18:22:59.578 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.577+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0eb002ff70 msgr2=0x7f0eb0032430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:59.578 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.577+0000 7f0eca816700 1 --2- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0eb002ff70 0x7f0eb0032430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f0eb80096a0 tx=0x7f0eb8006b40).stop 2024-02-15T18:22:59.578 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.577+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 msgr2=0x7f0ec410ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:22:59.578 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.577+0000 7f0eca816700 1 --2- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec410ce50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0eb4011f20 tx=0x7f0eb4006ee0).stop 2024-02-15T18:22:59.578 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.577+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 shutdown_connections 2024-02-15T18:22:59.579 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.577+0000 7f0eca816700 1 --2- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0eb002ff70 0x7f0eb0032430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:59.579 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.578+0000 7f0eca816700 1 --2- 172.21.15.33:0/2683995456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ec4070400 0x7f0ec410ce50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:22:59.579 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.578+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 >> 172.21.15.33:0/2683995456 conn(0x7f0ec40f65c0 msgr2=0x7f0ec40f7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:22:59.579 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.578+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 shutdown_connections 2024-02-15T18:22:59.579 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:22:59.578+0000 7f0eca816700 1 -- 172.21.15.33:0/2683995456 wait complete. 2024-02-15T18:23:00.325 INFO:teuthology.orchestra.run.smithi033.stderr:Fetching dashboard port number... 2024-02-15T18:23:00.325 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpy4qjmxys:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp5lf3t_03:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config get mgr mgr/dashboard/ssl_server_port 2024-02-15T18:23:00.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:59.331788+0000 mgr.smithi033.apxevf (mgr.14162) 4 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:00.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:22:59.576566+0000 mon.smithi033 (mon.0) 109 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.945+0000 7f5c827ba700 1 Processor -- start 2024-02-15T18:23:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.945+0000 7f5c827ba700 1 -- start start 2024-02-15T18:23:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.945+0000 7f5c827ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c0feab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.945+0000 7f5c827ba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0fefa0 con 0x7f5c7c0703d0 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.946+0000 7f5c7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c0feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.946+0000 7f5c7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c0feab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32796/0 (socket says 172.21.15.33:32796) 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.946+0000 7f5c7bfff700 1 -- 172.21.15.33:0/1232323001 learned_addr learned my addr 172.21.15.33:0/1232323001 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.946+0000 7f5c7bfff700 1 -- 172.21.15.33:0/1232323001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c0ff0e0 con 0x7f5c7c0703d0 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.946+0000 7f5c7bfff700 1 --2- 172.21.15.33:0/1232323001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c0feab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5c6c00b5f0 tx=0x7f5c6c006ee0).ready entity=mon.0 client_cookie=2caaf8a066a6b103 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.946+0000 7f5c7affd700 1 -- 172.21.15.33:0/1232323001 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6c00d600 con 0x7f5c7c0703d0 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.946+0000 7f5c7affd700 1 -- 172.21.15.33:0/1232323001 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c6c00dc30 con 0x7f5c7c0703d0 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.946+0000 7f5c7affd700 1 -- 172.21.15.33:0/1232323001 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6c011d30 con 0x7f5c7c0703d0 2024-02-15T18:23:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.947+0000 7f5c827ba700 1 -- 172.21.15.33:0/1232323001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 msgr2=0x7f5c7c0feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.947+0000 7f5c827ba700 1 --2- 172.21.15.33:0/1232323001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c0feab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5c6c00b5f0 tx=0x7f5c6c006ee0).stop 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.947+0000 7f5c827ba700 1 -- 172.21.15.33:0/1232323001 shutdown_connections 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.947+0000 7f5c827ba700 1 --2- 172.21.15.33:0/1232323001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c0feab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.947+0000 7f5c827ba700 1 -- 172.21.15.33:0/1232323001 >> 172.21.15.33:0/1232323001 conn(0x7f5c7c0f6530 msgr2=0x7f5c7c0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.947+0000 7f5c827ba700 1 -- 172.21.15.33:0/1232323001 shutdown_connections 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.947+0000 7f5c827ba700 1 -- 172.21.15.33:0/1232323001 wait complete. 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.947+0000 7f5c827ba700 1 Processor -- start 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.948+0000 7f5c827ba700 1 -- start start 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.948+0000 7f5c827ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c10abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.948+0000 7f5c827ba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c10b0d0 con 0x7f5c7c0703d0 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.948+0000 7f5c7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c10abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.948+0000 7f5c7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c10abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32812/0 (socket says 172.21.15.33:32812) 2024-02-15T18:23:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.948+0000 7f5c7bfff700 1 -- 172.21.15.33:0/3522905576 learned_addr learned my addr 172.21.15.33:0/3522905576 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:23:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.948+0000 7f5c7bfff700 1 -- 172.21.15.33:0/3522905576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c00b200 con 0x7f5c7c0703d0 2024-02-15T18:23:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.948+0000 7f5c7bfff700 1 --2- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c10abe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5c6c00c010 tx=0x7f5c6c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.949+0000 7f5c78ff9700 1 -- 172.21.15.33:0/3522905576 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6c00da60 con 0x7f5c7c0703d0 2024-02-15T18:23:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.949+0000 7f5c78ff9700 1 -- 172.21.15.33:0/3522905576 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c6c01b8e0 con 0x7f5c7c0703d0 2024-02-15T18:23:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.949+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c10b2d0 con 0x7f5c7c0703d0 2024-02-15T18:23:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.949+0000 7f5c78ff9700 1 -- 172.21.15.33:0/3522905576 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6c01a990 con 0x7f5c7c0703d0 2024-02-15T18:23:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.949+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c10b760 con 0x7f5c7c0703d0 2024-02-15T18:23:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.949+0000 7f5c78ff9700 1 -- 172.21.15.33:0/3522905576 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f5c6c00f070 con 0x7f5c7c0703d0 2024-02-15T18:23:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.950+0000 7f5c78ff9700 1 --2- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f5c5c030070 0x7f5c5c032530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.950+0000 7f5c78ff9700 1 -- 172.21.15.33:0/3522905576 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f5c6c0415a0 con 0x7f5c7c0703d0 2024-02-15T18:23:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.950+0000 7f5c7b7fe700 1 --2- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f5c5c030070 0x7f5c5c032530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.950+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c045ad0 con 0x7f5c7c0703d0 2024-02-15T18:23:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.950+0000 7f5c7b7fe700 1 --2- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f5c5c030070 0x7f5c5c032530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5c640096a0 tx=0x7f5c64006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:00.955+0000 7f5c78ff9700 1 -- 172.21.15.33:0/3522905576 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5c6c010360 con 0x7f5c7c0703d0 2024-02-15T18:23:01.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.114+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f5c7c0ffe90 con 0x7f5c7c0703d0 2024-02-15T18:23:01.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.115+0000 7f5c78ff9700 1 -- 172.21.15.33:0/3522905576 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v10) v1 ==== 112+0+5 (secure 0 0 0) 0x7f5c6c022ac0 con 0x7f5c7c0703d0 2024-02-15T18:23:01.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 8443 2024-02-15T18:23:01.117 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.116+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f5c5c030070 msgr2=0x7f5c5c032530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:01.117 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.116+0000 7f5c827ba700 1 --2- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f5c5c030070 0x7f5c5c032530 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5c640096a0 tx=0x7f5c64006b40).stop 2024-02-15T18:23:01.117 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.116+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 msgr2=0x7f5c7c10abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:01.117 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.116+0000 7f5c827ba700 1 --2- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c10abe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5c6c00c010 tx=0x7f5c6c006ee0).stop 2024-02-15T18:23:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.117+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 shutdown_connections 2024-02-15T18:23:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.117+0000 7f5c827ba700 1 --2- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f5c5c030070 0x7f5c5c032530 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.117+0000 7f5c827ba700 1 --2- 172.21.15.33:0/3522905576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c7c0703d0 0x7f5c7c10abe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.117+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 >> 172.21.15.33:0/3522905576 conn(0x7f5c7c0f6530 msgr2=0x7f5c7c0f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.117+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 shutdown_connections 2024-02-15T18:23:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2024-02-15T18:23:01.117+0000 7f5c827ba700 1 -- 172.21.15.33:0/3522905576 wait complete. 2024-02-15T18:23:01.765 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled firewalld.service 2024-02-15T18:23:01.767 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:00.582074+0000 mon.smithi033 (mon.0) 110 : cluster [DBG] mgrmap e17: smithi033.apxevf(active, since 6s) 2024-02-15T18:23:01.767 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:01.115754+0000 mon.smithi033 (mon.0) 111 : audit [DBG] from='client.? 172.21.15.33:0/3522905576' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-15T18:23:01.773 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: disabled 2024-02-15T18:23:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active firewalld.service 2024-02-15T18:23:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2024-02-15T18:23:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld.service is not enabled 2024-02-15T18:23:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-15T18:23:01.786 INFO:teuthology.orchestra.run.smithi033.stderr:Ceph Dashboard is now available at: 2024-02-15T18:23:01.786 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:23:01.786 INFO:teuthology.orchestra.run.smithi033.stderr: URL: https://smithi033.front.sepia.ceph.com:8443/ 2024-02-15T18:23:01.786 INFO:teuthology.orchestra.run.smithi033.stderr: User: admin 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: Password: 0gub7s768i 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr:You can access the Ceph CLI with: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr:Please consider enabling telemetry to help improve Ceph: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: ceph telemetry on 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr:For more information see: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: https://docs.ceph.com/docs/pacific/mgr/telemetry/ 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr:Bootstrap complete. 2024-02-15T18:23:01.787 INFO:teuthology.orchestra.run.smithi033.stderr:Releasing lock 140250813172200 on /run/cephadm/fd0b1c90-cc2e-11ee-95ba-87774f69a715.lock 2024-02-15T18:23:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:Lock 140250813172200 released on /run/cephadm/fd0b1c90-cc2e-11ee-95ba-87774f69a715.lock 2024-02-15T18:23:01.821 INFO:tasks.cephadm:Fetching config... 2024-02-15T18:23:01.821 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:23:01.821 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-15T18:23:01.882 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-15T18:23:01.882 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:23:01.882 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-15T18:23:01.941 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-15T18:23:01.941 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:23:01.941 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/keyring of=/dev/stdout 2024-02-15T18:23:02.009 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-15T18:23:02.010 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:23:02.010 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-15T18:23:02.067 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-15T18:23:02.068 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0fTsCbfwBO/PrDrTzOA4pTLMxfbIgD2eJQY0b+k4lO8L/cl7VYJSnbn6mq7Sc/wD364evjexvGO2ZHUuFRWZITkgPnb456qFHVAswz/lkljppfFJr/GHNKmIX1nDpMBEwkfoGOAOToSRzvprlPbv+hLidgGZcRyInG61X8ss9p3ezwAXIcq8bsDCnsB0BIc2bFrdmD6PF73PDhqSdOv6s7cdbiSV6bULpjhif+ViQ28NY8UoevvdjBV3wlGE5e8mrKRht4OVQ+GfWOkBQdxDvvfZz3DfJig3hADmAf+L82byIPv0ingbvYECZEExTyhmZqQx1y/S4qeidjpKc7f7DYLY6rxtjTwC+d9/Idw8kq3H2wCQnFn3IKvNnW3PvP8fd/9Atd62Y1qV8vthThiuJ7EvhQWVa6jqH1F8UazIS0rmYrefuNO828opbey4dwir8QzDO1Vx8lUS2y9RijxvMjMUuPtzKIi1LY+sAm77hn42KON3Gl5W1UyukNuP1lwc= ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-15T18:23:02.145 INFO:teuthology.orchestra.run.smithi033.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0fTsCbfwBO/PrDrTzOA4pTLMxfbIgD2eJQY0b+k4lO8L/cl7VYJSnbn6mq7Sc/wD364evjexvGO2ZHUuFRWZITkgPnb456qFHVAswz/lkljppfFJr/GHNKmIX1nDpMBEwkfoGOAOToSRzvprlPbv+hLidgGZcRyInG61X8ss9p3ezwAXIcq8bsDCnsB0BIc2bFrdmD6PF73PDhqSdOv6s7cdbiSV6bULpjhif+ViQ28NY8UoevvdjBV3wlGE5e8mrKRht4OVQ+GfWOkBQdxDvvfZz3DfJig3hADmAf+L82byIPv0ingbvYECZEExTyhmZqQx1y/S4qeidjpKc7f7DYLY6rxtjTwC+d9/Idw8kq3H2wCQnFn3IKvNnW3PvP8fd/9Atd62Y1qV8vthThiuJ7EvhQWVa6jqH1F8UazIS0rmYrefuNO828opbey4dwir8QzDO1Vx8lUS2y9RijxvMjMUuPtzKIi1LY+sAm77hn42KON3Gl5W1UyukNuP1lwc= ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:23:02.160 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0fTsCbfwBO/PrDrTzOA4pTLMxfbIgD2eJQY0b+k4lO8L/cl7VYJSnbn6mq7Sc/wD364evjexvGO2ZHUuFRWZITkgPnb456qFHVAswz/lkljppfFJr/GHNKmIX1nDpMBEwkfoGOAOToSRzvprlPbv+hLidgGZcRyInG61X8ss9p3ezwAXIcq8bsDCnsB0BIc2bFrdmD6PF73PDhqSdOv6s7cdbiSV6bULpjhif+ViQ28NY8UoevvdjBV3wlGE5e8mrKRht4OVQ+GfWOkBQdxDvvfZz3DfJig3hADmAf+L82byIPv0ingbvYECZEExTyhmZqQx1y/S4qeidjpKc7f7DYLY6rxtjTwC+d9/Idw8kq3H2wCQnFn3IKvNnW3PvP8fd/9Atd62Y1qV8vthThiuJ7EvhQWVa6jqH1F8UazIS0rmYrefuNO828opbey4dwir8QzDO1Vx8lUS2y9RijxvMjMUuPtzKIi1LY+sAm77hn42KON3Gl5W1UyukNuP1lwc= ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-15T18:23:02.203 INFO:teuthology.orchestra.run.smithi131.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0fTsCbfwBO/PrDrTzOA4pTLMxfbIgD2eJQY0b+k4lO8L/cl7VYJSnbn6mq7Sc/wD364evjexvGO2ZHUuFRWZITkgPnb456qFHVAswz/lkljppfFJr/GHNKmIX1nDpMBEwkfoGOAOToSRzvprlPbv+hLidgGZcRyInG61X8ss9p3ezwAXIcq8bsDCnsB0BIc2bFrdmD6PF73PDhqSdOv6s7cdbiSV6bULpjhif+ViQ28NY8UoevvdjBV3wlGE5e8mrKRht4OVQ+GfWOkBQdxDvvfZz3DfJig3hADmAf+L82byIPv0ingbvYECZEExTyhmZqQx1y/S4qeidjpKc7f7DYLY6rxtjTwC+d9/Idw8kq3H2wCQnFn3IKvNnW3PvP8fd/9Atd62Y1qV8vthThiuJ7EvhQWVa6jqH1F8UazIS0rmYrefuNO828opbey4dwir8QzDO1Vx8lUS2y9RijxvMjMUuPtzKIi1LY+sAm77hn42KON3Gl5W1UyukNuP1lwc= ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:23:02.215 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-15T18:23:04.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.751+0000 7fa4222d8700 1 -- 172.21.15.33:0/3367726345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 msgr2=0x7fa41c0f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:04.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.751+0000 7fa4222d8700 1 --2- 172.21.15.33:0/3367726345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 0x7fa41c0f9190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa40c009fb0 tx=0x7fa40c009b30).stop 2024-02-15T18:23:04.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.751+0000 7fa4222d8700 1 -- 172.21.15.33:0/3367726345 shutdown_connections 2024-02-15T18:23:04.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.751+0000 7fa4222d8700 1 --2- 172.21.15.33:0/3367726345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 0x7fa41c0f9190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:04.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.751+0000 7fa4222d8700 1 -- 172.21.15.33:0/3367726345 >> 172.21.15.33:0/3367726345 conn(0x7fa41c0f0b70 msgr2=0x7fa41c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:04.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.751+0000 7fa4222d8700 1 -- 172.21.15.33:0/3367726345 shutdown_connections 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.751+0000 7fa4222d8700 1 -- 172.21.15.33:0/3367726345 wait complete. 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.752+0000 7fa4222d8700 1 Processor -- start 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.752+0000 7fa4222d8700 1 -- start start 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.752+0000 7fa4222d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 0x7fa41c106790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.752+0000 7fa4222d8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c106c80 con 0x7fa41c0601e0 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.752+0000 7fa41bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 0x7fa41c106790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.752+0000 7fa41bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 0x7fa41c106790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32842/0 (socket says 172.21.15.33:32842) 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.752+0000 7fa41bfff700 1 -- 172.21.15.33:0/1480022909 learned_addr learned my addr 172.21.15.33:0/1480022909 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.753+0000 7fa41bfff700 1 -- 172.21.15.33:0/1480022909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c005040 con 0x7fa41c0601e0 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.753+0000 7fa41bfff700 1 --2- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 0x7fa41c106790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa40c007a10 tx=0x7fa40c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.753+0000 7fa4197fa700 1 -- 172.21.15.33:0/1480022909 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa40c018070 con 0x7fa41c0601e0 2024-02-15T18:23:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.753+0000 7fa4197fa700 1 -- 172.21.15.33:0/1480022909 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa40c013410 con 0x7fa41c0601e0 2024-02-15T18:23:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.753+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c106e80 con 0x7fa41c0601e0 2024-02-15T18:23:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.753+0000 7fa4197fa700 1 -- 172.21.15.33:0/1480022909 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa40c01c3c0 con 0x7fa41c0601e0 2024-02-15T18:23:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.753+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c107310 con 0x7fa41c0601e0 2024-02-15T18:23:04.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.754+0000 7fa4197fa700 1 -- 172.21.15.33:0/1480022909 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fa40c01c630 con 0x7fa41c0601e0 2024-02-15T18:23:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.754+0000 7fa4197fa700 1 --2- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa40802ffb0 0x7fa408032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.754+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c045ad0 con 0x7fa41c0601e0 2024-02-15T18:23:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.754+0000 7fa4197fa700 1 -- 172.21.15.33:0/1480022909 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fa40c042410 con 0x7fa41c0601e0 2024-02-15T18:23:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.754+0000 7fa413fff700 1 --2- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa40802ffb0 0x7fa408032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:04.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.755+0000 7fa413fff700 1 --2- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa40802ffb0 0x7fa408032470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa4040096a0 tx=0x7fa404006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:04.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.760+0000 7fa4197fa700 1 -- 172.21.15.33:0/1480022909 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa40c01ca30 con 0x7fa41c0601e0 2024-02-15T18:23:04.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.931+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fa41c0fc0a0 con 0x7fa41c0601e0 2024-02-15T18:23:04.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.934+0000 7fa4197fa700 1 -- 172.21.15.33:0/1480022909 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v11)=0 v11) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa40c01b9c0 con 0x7fa41c0601e0 2024-02-15T18:23:04.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa40802ffb0 msgr2=0x7fa408032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:04.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 --2- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa40802ffb0 0x7fa408032470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa4040096a0 tx=0x7fa404006b40).stop 2024-02-15T18:23:04.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 msgr2=0x7fa41c106790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:04.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 --2- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 0x7fa41c106790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa40c007a10 tx=0x7fa40c009b30).stop 2024-02-15T18:23:04.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 shutdown_connections 2024-02-15T18:23:04.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 --2- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa40802ffb0 0x7fa408032470 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:04.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 --2- 172.21.15.33:0/1480022909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa41c0601e0 0x7fa41c106790 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:04.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 >> 172.21.15.33:0/1480022909 conn(0x7fa41c0f0b70 msgr2=0x7fa41c0f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:04.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 shutdown_connections 2024-02-15T18:23:04.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:04.936+0000 7fa4222d8700 1 -- 172.21.15.33:0/1480022909 wait complete. 2024-02-15T18:23:05.283 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:04.016715+0000 mon.smithi033 (mon.0) 112 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:05.283 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:04.372021+0000 mon.smithi033 (mon.0) 113 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:05.283 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:04.935033+0000 mon.smithi033 (mon.0) 114 : audit [INF] from='client.? 172.21.15.33:0/1480022909' entity='client.admin' 2024-02-15T18:23:05.653 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi131 2024-02-15T18:23:05.654 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:23:05.654 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.conf 2024-02-15T18:23:05.675 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:23:05.676 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T18:23:05.737 INFO:tasks.cephadm:Adding host smithi131 to orchestrator... 2024-02-15T18:23:05.737 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph orch host add smithi131 2024-02-15T18:23:06.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:23:04.378117+0000 mgr.smithi033.apxevf (mgr.14162) 5 : cephadm [INF] Deploying daemon alertmanager.smithi033 on smithi033 2024-02-15T18:23:15.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:14.504852+0000 mgr.smithi033.apxevf (mgr.14162) 6 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:17.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:16.505103+0000 mgr.smithi033.apxevf (mgr.14162) 7 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:20.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:18.505408+0000 mgr.smithi033.apxevf (mgr.14162) 8 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:20.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:19.093454+0000 mon.smithi033 (mon.0) 115 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:20.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:19.094395+0000 mon.smithi033 (mon.0) 116 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:23:20.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:19.098626+0000 mon.smithi033 (mon.0) 117 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-15T18:23:20.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:19.099220+0000 mon.smithi033 (mon.0) 118 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:23:20.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:23:19.099754+0000 mgr.smithi033.apxevf (mgr.14162) 9 : cephadm [INF] Deploying daemon crash.smithi033 on smithi033 2024-02-15T18:23:22.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:20.505897+0000 mgr.smithi033.apxevf (mgr.14162) 10 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:22.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:21.544635+0000 mon.smithi033 (mon.0) 119 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:22.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:21.615179+0000 mon.smithi033 (mon.0) 120 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:22.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:21.616986+0000 mon.smithi033 (mon.0) 121 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:22.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:21.617392+0000 mon.smithi033 (mon.0) 122 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:23:22.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:21.620258+0000 mon.smithi033 (mon.0) 123 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:23.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:21.617860+0000 mgr.smithi033.apxevf (mgr.14162) 11 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:23:23.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:23:21.623548+0000 mgr.smithi033.apxevf (mgr.14162) 12 : cephadm [INF] Deploying daemon grafana.smithi033 on smithi033 2024-02-15T18:23:24.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:22.506215+0000 mgr.smithi033.apxevf (mgr.14162) 13 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:26.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:24.506473+0000 mgr.smithi033.apxevf (mgr.14162) 14 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:27.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.708+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2937104265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 msgr2=0x7ff3880f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.708+0000 7ff38e8ed700 1 --2- 172.21.15.131:0/2937104265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 0x7ff3880f7d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff37c009fb0 tx=0x7ff37c009b30).stop 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.709+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2937104265 shutdown_connections 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.709+0000 7ff38e8ed700 1 --2- 172.21.15.131:0/2937104265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 0x7ff3880f7d00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.709+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2937104265 >> 172.21.15.131:0/2937104265 conn(0x7ff3880f0120 msgr2=0x7ff3880f2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.709+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2937104265 shutdown_connections 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.709+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2937104265 wait complete. 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.709+0000 7ff38e8ed700 1 Processor -- start 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.709+0000 7ff38e8ed700 1 -- start start 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.709+0000 7ff38e8ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 0x7ff3881065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.709+0000 7ff38e8ed700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388106aa0 con 0x7ff3880f78e0 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff38d8eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 0x7ff3881065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:27.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff38d8eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 0x7ff3881065b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:56504/0 (socket says 172.21.15.131:56504) 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff38d8eb700 1 -- 172.21.15.131:0/2023142898 learned_addr learned my addr 172.21.15.131:0/2023142898 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff38d8eb700 1 -- 172.21.15.131:0/2023142898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c005040 con 0x7ff3880f78e0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff38d8eb700 1 --2- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 0x7ff3881065b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff37c0089f0 tx=0x7ff37c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff37a7fc700 1 -- 172.21.15.131:0/2023142898 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff37c009320 con 0x7ff3880f78e0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff37a7fc700 1 -- 172.21.15.131:0/2023142898 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff37c013380 con 0x7ff3880f78e0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff388106ca0 con 0x7ff3880f78e0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff37a7fc700 1 -- 172.21.15.131:0/2023142898 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff37c014e20 con 0x7ff3880f78e0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.710+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff388107130 con 0x7ff3880f78e0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.711+0000 7ff37a7fc700 1 -- 172.21.15.131:0/2023142898 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7ff37c0095f0 con 0x7ff3880f78e0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.711+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff388045ad0 con 0x7ff3880f78e0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.711+0000 7ff37a7fc700 1 --2- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff37402ff10 0x7ff3740323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.711+0000 7ff37a7fc700 1 -- 172.21.15.131:0/2023142898 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7ff37c040f50 con 0x7ff3880f78e0 2024-02-15T18:23:27.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.711+0000 7ff38d0ea700 1 --2- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff37402ff10 0x7ff3740323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:27.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.712+0000 7ff38d0ea700 1 --2- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff37402ff10 0x7ff3740323d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff3840096a0 tx=0x7ff384006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:27.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.716+0000 7ff37a7fc700 1 -- 172.21.15.131:0/2023142898 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff37c014420 con 0x7ff3880f78e0 2024-02-15T18:23:27.887 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:27.886+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3880f1280 con 0x7ff37402ff10 2024-02-15T18:23:28.485 INFO:teuthology.orchestra.run.smithi131.stdout:Added host 'smithi131' 2024-02-15T18:23:28.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.483+0000 7ff37a7fc700 1 -- 172.21.15.131:0/2023142898 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7ff3880f1280 con 0x7ff37402ff10 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff37402ff10 msgr2=0x7ff3740323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 --2- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff37402ff10 0x7ff3740323d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff3840096a0 tx=0x7ff384006b40).stop 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 msgr2=0x7ff3881065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 --2- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 0x7ff3881065b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff37c0089f0 tx=0x7ff37c00b040).stop 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 shutdown_connections 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 --2- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff37402ff10 0x7ff3740323d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 --2- 172.21.15.131:0/2023142898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3880f78e0 0x7ff3881065b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 >> 172.21.15.131:0/2023142898 conn(0x7ff3880f0120 msgr2=0x7ff3880f0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 shutdown_connections 2024-02-15T18:23:28.487 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:28.486+0000 7ff38e8ed700 1 -- 172.21.15.131:0/2023142898 wait complete. 2024-02-15T18:23:28.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:26.506791+0000 mgr.smithi033.apxevf (mgr.14162) 15 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:29.162 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph orch host ls --format=json 2024-02-15T18:23:29.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:27.888592+0000 mgr.smithi033.apxevf (mgr.14162) 16 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:29.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:28.484001+0000 mon.smithi033 (mon.0) 124 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:30.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:23:28.484404+0000 mgr.smithi033.apxevf (mgr.14162) 17 : cephadm [INF] Added host smithi131 2024-02-15T18:23:30.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:28.507218+0000 mgr.smithi033.apxevf (mgr.14162) 18 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:31.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.036+0000 7f4cd1660700 1 -- 172.21.15.131:0/1291982062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 msgr2=0x7f4ccc0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:31.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.036+0000 7f4cd1660700 1 --2- 172.21.15.131:0/1291982062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 0x7f4ccc0f6930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f4cc0009fb0 tx=0x7f4cc0009b30).stop 2024-02-15T18:23:31.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.036+0000 7f4cd1660700 1 -- 172.21.15.131:0/1291982062 shutdown_connections 2024-02-15T18:23:31.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.036+0000 7f4cd1660700 1 --2- 172.21.15.131:0/1291982062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 0x7f4ccc0f6930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:31.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.036+0000 7f4cd1660700 1 -- 172.21.15.131:0/1291982062 >> 172.21.15.131:0/1291982062 conn(0x7f4ccc0f1c70 msgr2=0x7f4ccc0f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:31.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.036+0000 7f4cd1660700 1 -- 172.21.15.131:0/1291982062 shutdown_connections 2024-02-15T18:23:31.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.036+0000 7f4cd1660700 1 -- 172.21.15.131:0/1291982062 wait complete. 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.037+0000 7f4cd1660700 1 Processor -- start 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.037+0000 7f4cd1660700 1 -- start start 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.037+0000 7f4cd1660700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 0x7f4ccc1067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.037+0000 7f4cd1660700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc106cd0 con 0x7f4ccc0f6510 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.037+0000 7f4ccaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 0x7f4ccc1067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.037+0000 7f4ccaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 0x7f4ccc1067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:37908/0 (socket says 172.21.15.131:37908) 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.037+0000 7f4ccaffd700 1 -- 172.21.15.131:0/965695016 learned_addr learned my addr 172.21.15.131:0/965695016 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.038+0000 7f4ccaffd700 1 -- 172.21.15.131:0/965695016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc0005040 con 0x7f4ccc0f6510 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.038+0000 7f4ccaffd700 1 --2- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 0x7f4ccc1067e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f4cc0005010 tx=0x7f4cc000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.038+0000 7f4cb37fe700 1 -- 172.21.15.131:0/965695016 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4cc0009320 con 0x7f4ccc0f6510 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.038+0000 7f4cb37fe700 1 -- 172.21.15.131:0/965695016 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4cc0013380 con 0x7f4ccc0f6510 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.038+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc106ed0 con 0x7f4ccc0f6510 2024-02-15T18:23:31.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.038+0000 7f4cb37fe700 1 -- 172.21.15.131:0/965695016 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4cc0014e50 con 0x7f4ccc0f6510 2024-02-15T18:23:31.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.038+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc107360 con 0x7f4ccc0f6510 2024-02-15T18:23:31.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.039+0000 7f4cb37fe700 1 -- 172.21.15.131:0/965695016 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f4cc0014420 con 0x7f4ccc0f6510 2024-02-15T18:23:31.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.039+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc045ad0 con 0x7f4ccc0f6510 2024-02-15T18:23:31.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.039+0000 7f4cb37fe700 1 --2- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f4cb402ff10 0x7f4cb40323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:31.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.039+0000 7f4cb37fe700 1 -- 172.21.15.131:0/965695016 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f4cc0040e30 con 0x7f4ccc0f6510 2024-02-15T18:23:31.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.039+0000 7f4cca7fc700 1 --2- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f4cb402ff10 0x7f4cb40323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:31.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.040+0000 7f4cca7fc700 1 --2- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f4cb402ff10 0x7f4cb40323d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4cbc0096a0 tx=0x7f4cbc006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:31.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.044+0000 7f4cb37fe700 1 -- 172.21.15.131:0/965695016 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4cc00095f0 con 0x7f4ccc0f6510 2024-02-15T18:23:31.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.214+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ccc0f2e70 con 0x7f4cb402ff10 2024-02-15T18:23:31.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.216+0000 7f4cb37fe700 1 -- 172.21.15.131:0/965695016 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+156 (secure 0 0 0) 0x7f4ccc0f2e70 con 0x7f4cb402ff10 2024-02-15T18:23:31.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:23:31.216 INFO:teuthology.orchestra.run.smithi131.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "smithi131", "hostname": "smithi131", "labels": [], "status": ""}] 2024-02-15T18:23:31.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.216+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f4cb402ff10 msgr2=0x7f4cb40323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:31.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.216+0000 7f4cd1660700 1 --2- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f4cb402ff10 0x7f4cb40323d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4cbc0096a0 tx=0x7f4cbc006b40).stop 2024-02-15T18:23:31.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.217+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 msgr2=0x7f4ccc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:31.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.217+0000 7f4cd1660700 1 --2- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 0x7f4ccc1067e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f4cc0005010 tx=0x7f4cc000b040).stop 2024-02-15T18:23:31.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.217+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 shutdown_connections 2024-02-15T18:23:31.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.217+0000 7f4cd1660700 1 --2- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f4cb402ff10 0x7f4cb40323d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:31.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.217+0000 7f4cd1660700 1 --2- 172.21.15.131:0/965695016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f6510 0x7f4ccc1067e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:31.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.217+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 >> 172.21.15.131:0/965695016 conn(0x7f4ccc0f1c70 msgr2=0x7f4ccc0f2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:31.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.217+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 shutdown_connections 2024-02-15T18:23:31.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:31.217+0000 7f4cd1660700 1 -- 172.21.15.131:0/965695016 wait complete. 2024-02-15T18:23:31.849 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-15T18:23:31.849 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd crush tunables default 2024-02-15T18:23:32.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:30.507522+0000 mgr.smithi033.apxevf (mgr.14162) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:32.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:31.216019+0000 mgr.smithi033.apxevf (mgr.14162) 20 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:23:34.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:32.507808+0000 mgr.smithi033.apxevf (mgr.14162) 21 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:36.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:34.508054+0000 mgr.smithi033.apxevf (mgr.14162) 22 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:38.469 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:36.508405+0000 mgr.smithi033.apxevf (mgr.14162) 23 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:38.469 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:38.043957+0000 mon.smithi033 (mon.0) 125 : audit [INF] from='client.? 172.21.15.33:0/2211404694' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-15T18:23:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.872+0000 7f6104e20700 1 -- 172.21.15.33:0/820642267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 msgr2=0x7f61000f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.872+0000 7f6104e20700 1 --2- 172.21.15.33:0/820642267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 0x7f61000f6930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f60e8009fb0 tx=0x7f60e8009b30).stop 2024-02-15T18:23:38.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.872+0000 7f6104e20700 1 -- 172.21.15.33:0/820642267 shutdown_connections 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.872+0000 7f6104e20700 1 --2- 172.21.15.33:0/820642267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 0x7f61000f6930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.872+0000 7f6104e20700 1 -- 172.21.15.33:0/820642267 >> 172.21.15.33:0/820642267 conn(0x7f61000f1c70 msgr2=0x7f61000f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.872+0000 7f6104e20700 1 -- 172.21.15.33:0/820642267 shutdown_connections 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.872+0000 7f6104e20700 1 -- 172.21.15.33:0/820642267 wait complete. 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.872+0000 7f6104e20700 1 Processor -- start 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f6104e20700 1 -- start start 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f6104e20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 0x7f61001067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f6104e20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6100106cd0 con 0x7f61000f6510 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f60fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 0x7f61001067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f60fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 0x7f61001067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49358/0 (socket says 172.21.15.33:49358) 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f60fe59c700 1 -- 172.21.15.33:0/2211404694 learned_addr learned my addr 172.21.15.33:0/2211404694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f60fe59c700 1 -- 172.21.15.33:0/2211404694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8005040 con 0x7f61000f6510 2024-02-15T18:23:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f60fe59c700 1 --2- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 0x7f61001067e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f60e8005010 tx=0x7f60e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f60f6ffd700 1 -- 172.21.15.33:0/2211404694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60e8009320 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6100106ed0 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f60f6ffd700 1 -- 172.21.15.33:0/2211404694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60e8013380 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f60f6ffd700 1 -- 172.21.15.33:0/2211404694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60e8014e50 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.873+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6100107360 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.874+0000 7f60f6ffd700 1 -- 172.21.15.33:0/2211404694 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f60e80263a0 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.874+0000 7f60f6ffd700 1 --2- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f60ec02ff10 0x7f60ec0323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.874+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6100045ad0 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.875+0000 7f60f6ffd700 1 -- 172.21.15.33:0/2211404694 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f60e8041170 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.875+0000 7f60fdd9b700 1 --2- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f60ec02ff10 0x7f60ec0323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.875+0000 7f60fdd9b700 1 --2- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f60ec02ff10 0x7f60ec0323d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f60f00096a0 tx=0x7f60f0006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:37.879+0000 7f60f6ffd700 1 -- 172.21.15.33:0/2211404694 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f60e801d380 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.042+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6100108210 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.253+0000 7f60f6ffd700 1 -- 172.21.15.33:0/2211404694 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v5) v1 ==== 124+0+0 (secure 0 0 0) 0x7f60e8012330 con 0x7f61000f6510 2024-02-15T18:23:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f60ec02ff10 msgr2=0x7f60ec0323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 --2- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f60ec02ff10 0x7f60ec0323d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f60f00096a0 tx=0x7f60f0006b40).stop 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 msgr2=0x7f61001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 --2- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 0x7f61001067e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f60e8005010 tx=0x7f60e800b040).stop 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 shutdown_connections 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 --2- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f60ec02ff10 0x7f60ec0323d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 --2- 172.21.15.33:0/2211404694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61000f6510 0x7f61001067e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 >> 172.21.15.33:0/2211404694 conn(0x7f61000f1c70 msgr2=0x7f61000f2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 shutdown_connections 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:23:38.255+0000 7f6104e20700 1 -- 172.21.15.33:0/2211404694 wait complete. 2024-02-15T18:23:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-02-15T18:23:39.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:38.255022+0000 mon.smithi033 (mon.0) 126 : audit [INF] from='client.? 172.21.15.33:0/2211404694' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-15T18:23:39.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:38.255066+0000 mon.smithi033 (mon.0) 127 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-15T18:23:40.340 INFO:tasks.cephadm:Adding mon.smithi033 on smithi033 2024-02-15T18:23:40.340 INFO:tasks.cephadm:Adding mon.smithi131 on smithi131 2024-02-15T18:23:40.341 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph orch apply mon '2;smithi033:172.21.15.33=smithi033;smithi131:172.21.15.131=smithi131' 2024-02-15T18:23:40.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:38.508772+0000 mgr.smithi033.apxevf (mgr.14162) 24 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:42.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.076+0000 7f916e836700 1 -- 172.21.15.131:0/3696253074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 msgr2=0x7f91680f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:42.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.076+0000 7f916e836700 1 --2- 172.21.15.131:0/3696253074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 0x7f91680f5830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f9158009fb0 tx=0x7f9158009b30).stop 2024-02-15T18:23:42.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.076+0000 7f916e836700 1 -- 172.21.15.131:0/3696253074 shutdown_connections 2024-02-15T18:23:42.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.076+0000 7f916e836700 1 --2- 172.21.15.131:0/3696253074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 0x7f91680f5830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:42.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.076+0000 7f916e836700 1 -- 172.21.15.131:0/3696253074 >> 172.21.15.131:0/3696253074 conn(0x7f91680f0b70 msgr2=0x7f91680f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:42.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.076+0000 7f916e836700 1 -- 172.21.15.131:0/3696253074 shutdown_connections 2024-02-15T18:23:42.077 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.076+0000 7f916e836700 1 -- 172.21.15.131:0/3696253074 wait complete. 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.076+0000 7f916e836700 1 Processor -- start 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.077+0000 7f916e836700 1 -- start start 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.077+0000 7f916e836700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 0x7f9168109510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.077+0000 7f916e836700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9168060240 con 0x7f91680f5410 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.077+0000 7f9167fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 0x7f9168109510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.077+0000 7f9167fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 0x7f9168109510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:51654/0 (socket says 172.21.15.131:51654) 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.077+0000 7f9167fff700 1 -- 172.21.15.131:0/886731596 learned_addr learned my addr 172.21.15.131:0/886731596 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.077+0000 7f9167fff700 1 -- 172.21.15.131:0/886731596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158005040 con 0x7f91680f5410 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.077+0000 7f9167fff700 1 --2- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 0x7f9168109510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f9158005010 tx=0x7f915800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.078+0000 7f9164ff9700 1 -- 172.21.15.131:0/886731596 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9158009320 con 0x7f91680f5410 2024-02-15T18:23:42.079 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.078+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9168060440 con 0x7f91680f5410 2024-02-15T18:23:42.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.078+0000 7f9164ff9700 1 -- 172.21.15.131:0/886731596 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9158013380 con 0x7f91680f5410 2024-02-15T18:23:42.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.078+0000 7f9164ff9700 1 -- 172.21.15.131:0/886731596 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9158014e50 con 0x7f91680f5410 2024-02-15T18:23:42.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.078+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9168109bc0 con 0x7f91680f5410 2024-02-15T18:23:42.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.078+0000 7f9164ff9700 1 -- 172.21.15.131:0/886731596 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f91580263a0 con 0x7f91680f5410 2024-02-15T18:23:42.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.078+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9168045ad0 con 0x7f91680f5410 2024-02-15T18:23:42.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.079+0000 7f9164ff9700 1 --2- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f915002ff10 0x7f91500323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:42.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.079+0000 7f9164ff9700 1 -- 172.21.15.131:0/886731596 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f9158041290 con 0x7f91680f5410 2024-02-15T18:23:42.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.079+0000 7f91677fe700 1 --2- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f915002ff10 0x7f91500323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:42.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.079+0000 7f91677fe700 1 --2- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f915002ff10 0x7f91500323d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f915c0096a0 tx=0x7f915c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:42.083 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.083+0000 7f9164ff9700 1 -- 172.21.15.131:0/886731596 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9158012330 con 0x7f91680f5410 2024-02-15T18:23:42.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.258+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi033:172.21.15.33=smithi033;smithi131:172.21.15.131=smithi131", "target": ["mon-mgr", ""]}) v1 -- 0x7f91680f1da0 con 0x7f915002ff10 2024-02-15T18:23:42.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.264+0000 7f9164ff9700 1 -- 172.21.15.131:0/886731596 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f91680f1da0 con 0x7f915002ff10 2024-02-15T18:23:42.264 INFO:teuthology.orchestra.run.smithi131.stdout:Scheduled mon update... 2024-02-15T18:23:42.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f915002ff10 msgr2=0x7f91500323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:42.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 --2- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f915002ff10 0x7f91500323d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f915c0096a0 tx=0x7f915c006b40).stop 2024-02-15T18:23:42.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 msgr2=0x7f9168109510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:42.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 --2- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 0x7f9168109510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f9158005010 tx=0x7f915800b040).stop 2024-02-15T18:23:42.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 shutdown_connections 2024-02-15T18:23:42.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 --2- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f915002ff10 0x7f91500323d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:42.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 --2- 172.21.15.131:0/886731596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91680f5410 0x7f9168109510 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:42.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 >> 172.21.15.131:0/886731596 conn(0x7f91680f0b70 msgr2=0x7f91680f15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:42.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 shutdown_connections 2024-02-15T18:23:42.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:42.265+0000 7f916e836700 1 -- 172.21.15.131:0/886731596 wait complete. 2024-02-15T18:23:42.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:40.509147+0000 mgr.smithi033.apxevf (mgr.14162) 25 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:42.306 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:40.993090+0000 mon.smithi033 (mon.0) 128 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:42.306 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:23:40.994601+0000 mgr.smithi033.apxevf (mgr.14162) 26 : cephadm [INF] Deploying daemon node-exporter.smithi033 on smithi033 2024-02-15T18:23:43.312 DEBUG:teuthology.orchestra.run.smithi131:mon.smithi131> sudo journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi131.service 2024-02-15T18:23:43.314 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:23:43.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:23:43.344 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:-- Logs begin at Thu 2024-02-15 18:10:20 UTC. -- 2024-02-15T18:23:43.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:42.260451+0000 mgr.smithi033.apxevf (mgr.14162) 27 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi033:172.21.15.33=smithi033;smithi131:172.21.15.131=smithi131", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:23:43.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:23:42.261786+0000 mgr.smithi033.apxevf (mgr.14162) 28 : cephadm [INF] Saving service mon spec with placement smithi033:172.21.15.33=smithi033;smithi131:172.21.15.131=smithi131;count:2 2024-02-15T18:23:43.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:42.264665+0000 mon.smithi033 (mon.0) 129 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:44.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:42.509535+0000 mgr.smithi033.apxevf (mgr.14162) 29 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:45.072 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.070+0000 7f294c728700 1 -- 172.21.15.131:0/3945941434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 msgr2=0x7f29440f7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.070+0000 7f294c728700 1 --2- 172.21.15.131:0/3945941434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 0x7f29440f7f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f2934009fb0 tx=0x7f2934009b30).stop 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294c728700 1 -- 172.21.15.131:0/3945941434 shutdown_connections 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294c728700 1 --2- 172.21.15.131:0/3945941434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 0x7f29440f7f80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294c728700 1 -- 172.21.15.131:0/3945941434 >> 172.21.15.131:0/3945941434 conn(0x7f29440f02e0 msgr2=0x7f29440f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294c728700 1 -- 172.21.15.131:0/3945941434 shutdown_connections 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294c728700 1 -- 172.21.15.131:0/3945941434 wait complete. 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294c728700 1 Processor -- start 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294c728700 1 -- start start 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294c728700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 0x7f2944106830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294c728700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2944106d20 con 0x7f29440f7b60 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.071+0000 7f294a4c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 0x7f2944106830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:45.073 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.072+0000 7f294a4c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 0x7f2944106830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:51676/0 (socket says 172.21.15.131:51676) 2024-02-15T18:23:45.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.072+0000 7f294a4c4700 1 -- 172.21.15.131:0/46872980 learned_addr learned my addr 172.21.15.131:0/46872980 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:23:45.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.072+0000 7f294a4c4700 1 -- 172.21.15.131:0/46872980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934005040 con 0x7f29440f7b60 2024-02-15T18:23:45.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.072+0000 7f294a4c4700 1 --2- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 0x7f2944106830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2934005010 tx=0x7f293400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:45.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.072+0000 7f293affd700 1 -- 172.21.15.131:0/46872980 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2934009320 con 0x7f29440f7b60 2024-02-15T18:23:45.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.072+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2944106f20 con 0x7f29440f7b60 2024-02-15T18:23:45.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.072+0000 7f293affd700 1 -- 172.21.15.131:0/46872980 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2934013380 con 0x7f29440f7b60 2024-02-15T18:23:45.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.072+0000 7f293affd700 1 -- 172.21.15.131:0/46872980 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2934014e50 con 0x7f29440f7b60 2024-02-15T18:23:45.074 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.072+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29441073b0 con 0x7f29440f7b60 2024-02-15T18:23:45.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.073+0000 7f293affd700 1 -- 172.21.15.131:0/46872980 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f29340095f0 con 0x7f29440f7b60 2024-02-15T18:23:45.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.073+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2944045ad0 con 0x7f29440f7b60 2024-02-15T18:23:45.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.073+0000 7f293affd700 1 --2- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f293002ff10 0x7f29300323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:45.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.073+0000 7f293affd700 1 -- 172.21.15.131:0/46872980 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f2934040e90 con 0x7f29440f7b60 2024-02-15T18:23:45.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.073+0000 7f2949cc3700 1 --2- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f293002ff10 0x7f29300323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:45.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.074+0000 7f2949cc3700 1 --2- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f293002ff10 0x7f29300323d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f29400096a0 tx=0x7f2940006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:45.078 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.079+0000 7f293affd700 1 -- 172.21.15.131:0/46872980 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2934014420 con 0x7f29440f7b60 2024-02-15T18:23:45.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.282+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2944108260 con 0x7f29440f7b60 2024-02-15T18:23:45.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.283+0000 7f293affd700 1 -- 172.21.15.131:0/46872980 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f2934010230 con 0x7f29440f7b60 2024-02-15T18:23:45.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:23:45.283 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:21:43.086424Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:23:45.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f293002ff10 msgr2=0x7f29300323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:45.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 --2- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f293002ff10 0x7f29300323d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f29400096a0 tx=0x7f2940006b40).stop 2024-02-15T18:23:45.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 msgr2=0x7f2944106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:45.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 --2- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 0x7f2944106830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2934005010 tx=0x7f293400b040).stop 2024-02-15T18:23:45.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 shutdown_connections 2024-02-15T18:23:45.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 --2- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f293002ff10 0x7f29300323d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:45.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 --2- 172.21.15.131:0/46872980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f7b60 0x7f2944106830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:45.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 >> 172.21.15.131:0/46872980 conn(0x7f29440f02e0 msgr2=0x7f29440f0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:45.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 shutdown_connections 2024-02-15T18:23:45.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:45.284+0000 7f294c728700 1 -- 172.21.15.131:0/46872980 wait complete. 2024-02-15T18:23:45.285 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-02-15T18:23:46.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:44.509775+0000 mgr.smithi033.apxevf (mgr.14162) 30 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:46.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:45.284105+0000 mon.smithi033 (mon.0) 130 : audit [DBG] from='client.? 172.21.15.131:0/46872980' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:23:46.857 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:23:46.857 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:23:48.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:46.510129+0000 mgr.smithi033.apxevf (mgr.14162) 31 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:50.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.473+0000 7fb315851700 1 -- 172.21.15.131:0/2175388073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 msgr2=0x7fb3100f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:50.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.473+0000 7fb315851700 1 --2- 172.21.15.131:0/2175388073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 0x7fb3100f5830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb2f8009fb0 tx=0x7fb2f8009b30).stop 2024-02-15T18:23:50.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.473+0000 7fb315851700 1 -- 172.21.15.131:0/2175388073 shutdown_connections 2024-02-15T18:23:50.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.473+0000 7fb315851700 1 --2- 172.21.15.131:0/2175388073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 0x7fb3100f5830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:50.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.473+0000 7fb315851700 1 -- 172.21.15.131:0/2175388073 >> 172.21.15.131:0/2175388073 conn(0x7fb3100f0b70 msgr2=0x7fb3100f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.473+0000 7fb315851700 1 -- 172.21.15.131:0/2175388073 shutdown_connections 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.473+0000 7fb315851700 1 -- 172.21.15.131:0/2175388073 wait complete. 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.474+0000 7fb315851700 1 Processor -- start 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.474+0000 7fb315851700 1 -- start start 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.474+0000 7fb315851700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 0x7fb310109520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.474+0000 7fb315851700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310060240 con 0x7fb3100f5410 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.474+0000 7fb30effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 0x7fb310109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.474+0000 7fb30effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 0x7fb310109520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:48618/0 (socket says 172.21.15.131:48618) 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.474+0000 7fb30effd700 1 -- 172.21.15.131:0/3144598169 learned_addr learned my addr 172.21.15.131:0/3144598169 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.475+0000 7fb30effd700 1 -- 172.21.15.131:0/3144598169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8005040 con 0x7fb3100f5410 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.475+0000 7fb30effd700 1 --2- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 0x7fb310109520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fb2f8005010 tx=0x7fb2f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:50.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.475+0000 7fb3077fe700 1 -- 172.21.15.131:0/3144598169 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2f8009320 con 0x7fb3100f5410 2024-02-15T18:23:50.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.475+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb310060440 con 0x7fb3100f5410 2024-02-15T18:23:50.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.475+0000 7fb3077fe700 1 -- 172.21.15.131:0/3144598169 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2f8013380 con 0x7fb3100f5410 2024-02-15T18:23:50.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.475+0000 7fb3077fe700 1 -- 172.21.15.131:0/3144598169 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2f8014e50 con 0x7fb3100f5410 2024-02-15T18:23:50.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.475+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb310109bd0 con 0x7fb3100f5410 2024-02-15T18:23:50.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.476+0000 7fb3077fe700 1 -- 172.21.15.131:0/3144598169 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fb2f80263a0 con 0x7fb3100f5410 2024-02-15T18:23:50.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.476+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb310045ad0 con 0x7fb3100f5410 2024-02-15T18:23:50.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.476+0000 7fb3077fe700 1 --2- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb2fc02ff10 0x7fb2fc0323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:50.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.476+0000 7fb3077fe700 1 -- 172.21.15.131:0/3144598169 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fb2f8040eb0 con 0x7fb3100f5410 2024-02-15T18:23:50.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.476+0000 7fb30e7fc700 1 --2- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb2fc02ff10 0x7fb2fc0323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:50.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.477+0000 7fb30e7fc700 1 --2- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb2fc02ff10 0x7fb2fc0323d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fb3000096a0 tx=0x7fb300006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:50.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.481+0000 7fb3077fe700 1 -- 172.21.15.131:0/3144598169 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb2f801d470 con 0x7fb3100f5410 2024-02-15T18:23:50.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:48.510391+0000 mgr.smithi033.apxevf (mgr.14162) 32 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:50.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.685+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb31010a3f0 con 0x7fb3100f5410 2024-02-15T18:23:50.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.685+0000 7fb3077fe700 1 -- 172.21.15.131:0/3144598169 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fb2f8012330 con 0x7fb3100f5410 2024-02-15T18:23:50.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:23:50.685 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:21:43.086424Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:23:50.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb2fc02ff10 msgr2=0x7fb2fc0323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:50.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 --2- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb2fc02ff10 0x7fb2fc0323d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fb3000096a0 tx=0x7fb300006b40).stop 2024-02-15T18:23:50.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 msgr2=0x7fb310109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:50.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 --2- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 0x7fb310109520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fb2f8005010 tx=0x7fb2f800b040).stop 2024-02-15T18:23:50.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 shutdown_connections 2024-02-15T18:23:50.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 --2- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb2fc02ff10 0x7fb2fc0323d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:50.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 --2- 172.21.15.131:0/3144598169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3100f5410 0x7fb310109520 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:50.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 >> 172.21.15.131:0/3144598169 conn(0x7fb3100f0b70 msgr2=0x7fb3100f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:50.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 shutdown_connections 2024-02-15T18:23:50.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:50.687+0000 7fb315851700 1 -- 172.21.15.131:0/3144598169 wait complete. 2024-02-15T18:23:50.687 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-02-15T18:23:51.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:50.685738+0000 mon.smithi033 (mon.0) 131 : audit [DBG] from='client.? 172.21.15.131:0/3144598169' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:23:51.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:51.141651+0000 mon.smithi033 (mon.0) 132 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:23:52.351 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:23:52.351 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:23:52.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:50.510770+0000 mgr.smithi033.apxevf (mgr.14162) 33 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:52.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:23:51.147465+0000 mgr.smithi033.apxevf (mgr.14162) 34 : cephadm [INF] Deploying daemon prometheus.smithi033 on smithi033 2024-02-15T18:23:54.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.191+0000 7fee5b909700 1 -- 172.21.15.131:0/3674643770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 msgr2=0x7fee540f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:54.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.191+0000 7fee5b909700 1 --2- 172.21.15.131:0/3674643770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 0x7fee540f5830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fee44009fb0 tx=0x7fee44009b30).stop 2024-02-15T18:23:54.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.191+0000 7fee5b909700 1 -- 172.21.15.131:0/3674643770 shutdown_connections 2024-02-15T18:23:54.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.191+0000 7fee5b909700 1 --2- 172.21.15.131:0/3674643770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 0x7fee540f5830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.191+0000 7fee5b909700 1 -- 172.21.15.131:0/3674643770 >> 172.21.15.131:0/3674643770 conn(0x7fee540f0b70 msgr2=0x7fee540f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.191+0000 7fee5b909700 1 -- 172.21.15.131:0/3674643770 shutdown_connections 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.191+0000 7fee5b909700 1 -- 172.21.15.131:0/3674643770 wait complete. 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.191+0000 7fee5b909700 1 Processor -- start 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.191+0000 7fee5b909700 1 -- start start 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee5b909700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 0x7fee541067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee5b909700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee54106cd0 con 0x7fee540f5410 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee596a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 0x7fee541067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee596a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 0x7fee541067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:48644/0 (socket says 172.21.15.131:48644) 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee596a5700 1 -- 172.21.15.131:0/1011814910 learned_addr learned my addr 172.21.15.131:0/1011814910 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee596a5700 1 -- 172.21.15.131:0/1011814910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee44005040 con 0x7fee540f5410 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee596a5700 1 --2- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 0x7fee541067e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fee44005010 tx=0x7fee4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee49ffb700 1 -- 172.21.15.131:0/1011814910 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee44009320 con 0x7fee540f5410 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee54106ed0 con 0x7fee540f5410 2024-02-15T18:23:54.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee49ffb700 1 -- 172.21.15.131:0/1011814910 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee44013380 con 0x7fee540f5410 2024-02-15T18:23:54.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.192+0000 7fee49ffb700 1 -- 172.21.15.131:0/1011814910 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee44014e50 con 0x7fee540f5410 2024-02-15T18:23:54.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.193+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee54107360 con 0x7fee540f5410 2024-02-15T18:23:54.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.193+0000 7fee49ffb700 1 -- 172.21.15.131:0/1011814910 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fee440095f0 con 0x7fee540f5410 2024-02-15T18:23:54.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.193+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee54045ad0 con 0x7fee540f5410 2024-02-15T18:23:54.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.194+0000 7fee49ffb700 1 --2- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fee4002ff10 0x7fee400323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:23:54.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.194+0000 7fee49ffb700 1 -- 172.21.15.131:0/1011814910 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fee44040e70 con 0x7fee540f5410 2024-02-15T18:23:54.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.194+0000 7fee58ea4700 1 --2- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fee4002ff10 0x7fee400323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:23:54.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.194+0000 7fee58ea4700 1 --2- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fee4002ff10 0x7fee400323d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fee500096a0 tx=0x7fee50006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:23:54.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.199+0000 7fee49ffb700 1 -- 172.21.15.131:0/1011814910 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fee44014420 con 0x7fee540f5410 2024-02-15T18:23:54.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.404+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fee54108210 con 0x7fee540f5410 2024-02-15T18:23:54.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.404+0000 7fee49ffb700 1 -- 172.21.15.131:0/1011814910 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fee44010230 con 0x7fee540f5410 2024-02-15T18:23:54.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:23:54.403 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:21:43.086424Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:23:54.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fee4002ff10 msgr2=0x7fee400323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:54.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 --2- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fee4002ff10 0x7fee400323d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fee500096a0 tx=0x7fee50006b40).stop 2024-02-15T18:23:54.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 msgr2=0x7fee541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:23:54.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 --2- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 0x7fee541067e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fee44005010 tx=0x7fee4400b040).stop 2024-02-15T18:23:54.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 shutdown_connections 2024-02-15T18:23:54.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 --2- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fee4002ff10 0x7fee400323d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:54.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 --2- 172.21.15.131:0/1011814910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee540f5410 0x7fee541067e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:23:54.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 >> 172.21.15.131:0/1011814910 conn(0x7fee540f0b70 msgr2=0x7fee540f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:23:54.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 shutdown_connections 2024-02-15T18:23:54.406 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:23:54.406+0000 7fee5b909700 1 -- 172.21.15.131:0/1011814910 wait complete. 2024-02-15T18:23:54.406 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-02-15T18:23:54.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:52.511118+0000 mgr.smithi033.apxevf (mgr.14162) 35 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:55.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:54.404675+0000 mon.smithi033 (mon.0) 133 : audit [DBG] from='client.? 172.21.15.131:0/1011814910' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:23:55.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:54.648828+0000 mon.smithi033 (mon.0) 134 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:23:55.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:23:54.651860+0000 mon.smithi033 (mon.0) 135 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:23:56.002 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:23:56.003 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:23:56.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:54.511464+0000 mgr.smithi033.apxevf (mgr.14162) 36 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:23:58.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:23:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:56.511836+0000 mgr.smithi033.apxevf (mgr.14162) 37 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:00.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:23:58.512109+0000 mgr.smithi033.apxevf (mgr.14162) 38 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:02.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:00.512314+0000 mgr.smithi033.apxevf (mgr.14162) 39 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:04.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:02.512661+0000 mgr.smithi033.apxevf (mgr.14162) 40 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:05.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.225+0000 7f7214298700 1 -- 172.21.15.131:0/2553172083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 msgr2=0x7f720c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:05.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.225+0000 7f7214298700 1 --2- 172.21.15.131:0/2553172083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 0x7f720c0f6930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f7208009fb0 tx=0x7f7208009b30).stop 2024-02-15T18:24:05.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.225+0000 7f7214298700 1 -- 172.21.15.131:0/2553172083 shutdown_connections 2024-02-15T18:24:05.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.225+0000 7f7214298700 1 --2- 172.21.15.131:0/2553172083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 0x7f720c0f6930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:05.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.225+0000 7f7214298700 1 -- 172.21.15.131:0/2553172083 >> 172.21.15.131:0/2553172083 conn(0x7f720c0f1c70 msgr2=0x7f720c0f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:05.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.225+0000 7f7214298700 1 -- 172.21.15.131:0/2553172083 shutdown_connections 2024-02-15T18:24:05.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.226+0000 7f7214298700 1 -- 172.21.15.131:0/2553172083 wait complete. 2024-02-15T18:24:05.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.226+0000 7f7214298700 1 Processor -- start 2024-02-15T18:24:05.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.226+0000 7f7214298700 1 -- start start 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.226+0000 7f7214298700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 0x7f720c1067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.226+0000 7f7214298700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c106cd0 con 0x7f720c0f6510 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.226+0000 7f7212034700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 0x7f720c1067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.226+0000 7f7212034700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 0x7f720c1067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:55104/0 (socket says 172.21.15.131:55104) 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.226+0000 7f7212034700 1 -- 172.21.15.131:0/1897019356 learned_addr learned my addr 172.21.15.131:0/1897019356 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.227+0000 7f7212034700 1 -- 172.21.15.131:0/1897019356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7208005040 con 0x7f720c0f6510 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.227+0000 7f7212034700 1 --2- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 0x7f720c1067e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7208005010 tx=0x7f720800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.227+0000 7f7202ffd700 1 -- 172.21.15.131:0/1897019356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7208009320 con 0x7f720c0f6510 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.227+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c106ed0 con 0x7f720c0f6510 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.227+0000 7f7202ffd700 1 -- 172.21.15.131:0/1897019356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7208013380 con 0x7f720c0f6510 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.227+0000 7f7202ffd700 1 -- 172.21.15.131:0/1897019356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7208014e50 con 0x7f720c0f6510 2024-02-15T18:24:05.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.227+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c107360 con 0x7f720c0f6510 2024-02-15T18:24:05.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.228+0000 7f7202ffd700 1 -- 172.21.15.131:0/1897019356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f72080263a0 con 0x7f720c0f6510 2024-02-15T18:24:05.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.228+0000 7f7202ffd700 1 --2- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f71f802ff10 0x7f71f80323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:05.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.228+0000 7f7202ffd700 1 -- 172.21.15.131:0/1897019356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f7208040eb0 con 0x7f720c0f6510 2024-02-15T18:24:05.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.228+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720c045ad0 con 0x7f720c0f6510 2024-02-15T18:24:05.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.228+0000 7f7211833700 1 --2- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f71f802ff10 0x7f71f80323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:05.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.229+0000 7f7211833700 1 --2- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f71f802ff10 0x7f71f80323d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f71fc0096a0 tx=0x7f71fc006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:05.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.233+0000 7f7202ffd700 1 -- 172.21.15.131:0/1897019356 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7208012920 con 0x7f720c0f6510 2024-02-15T18:24:05.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.436+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f720c0fc0a0 con 0x7f720c0f6510 2024-02-15T18:24:05.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.437+0000 7f7202ffd700 1 -- 172.21.15.131:0/1897019356 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f720802b020 con 0x7f720c0f6510 2024-02-15T18:24:05.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:24:05.437 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:21:43.086424Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:24:05.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f71f802ff10 msgr2=0x7f71f80323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:05.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 --2- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f71f802ff10 0x7f71f80323d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f71fc0096a0 tx=0x7f71fc006b40).stop 2024-02-15T18:24:05.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 msgr2=0x7f720c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:05.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 --2- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 0x7f720c1067e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7208005010 tx=0x7f720800b040).stop 2024-02-15T18:24:05.438 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 shutdown_connections 2024-02-15T18:24:05.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 --2- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f71f802ff10 0x7f71f80323d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:05.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 --2- 172.21.15.131:0/1897019356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f720c0f6510 0x7f720c1067e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:05.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 >> 172.21.15.131:0/1897019356 conn(0x7f720c0f1c70 msgr2=0x7f720c0f2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:05.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 shutdown_connections 2024-02-15T18:24:05.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:05.438+0000 7f7214298700 1 -- 172.21.15.131:0/1897019356 wait complete. 2024-02-15T18:24:05.439 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-02-15T18:24:06.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:04.512936+0000 mgr.smithi033.apxevf (mgr.14162) 41 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:06.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:05.438219+0000 mon.smithi033 (mon.0) 136 : audit [DBG] from='client.? 172.21.15.131:0/1897019356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:24:07.076 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:24:07.077 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:24:08.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:06.513225+0000 mgr.smithi033.apxevf (mgr.14162) 42 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.917+0000 7fd56d7f6700 1 -- 172.21.15.131:0/2444869979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 msgr2=0x7fd5680f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.917+0000 7fd56d7f6700 1 --2- 172.21.15.131:0/2444869979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 0x7fd5680f9190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd55c009fb0 tx=0x7fd55c009b30).stop 2024-02-15T18:24:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.917+0000 7fd56d7f6700 1 -- 172.21.15.131:0/2444869979 shutdown_connections 2024-02-15T18:24:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.917+0000 7fd56d7f6700 1 --2- 172.21.15.131:0/2444869979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 0x7fd5680f9190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.917+0000 7fd56d7f6700 1 -- 172.21.15.131:0/2444869979 >> 172.21.15.131:0/2444869979 conn(0x7fd5680f0b70 msgr2=0x7fd5680f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.917+0000 7fd56d7f6700 1 -- 172.21.15.131:0/2444869979 shutdown_connections 2024-02-15T18:24:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.917+0000 7fd56d7f6700 1 -- 172.21.15.131:0/2444869979 wait complete. 2024-02-15T18:24:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.918+0000 7fd56d7f6700 1 Processor -- start 2024-02-15T18:24:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.918+0000 7fd56d7f6700 1 -- start start 2024-02-15T18:24:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.918+0000 7fd56d7f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 0x7fd5681067d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.918+0000 7fd56d7f6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568106cc0 con 0x7fd5680601e0 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.918+0000 7fd566ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 0x7fd5681067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.918+0000 7fd566ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 0x7fd5681067d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:55112/0 (socket says 172.21.15.131:55112) 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.918+0000 7fd566ffd700 1 -- 172.21.15.131:0/4022621890 learned_addr learned my addr 172.21.15.131:0/4022621890 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.919+0000 7fd566ffd700 1 -- 172.21.15.131:0/4022621890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c005040 con 0x7fd5680601e0 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.919+0000 7fd566ffd700 1 --2- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 0x7fd5681067d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd55c007a10 tx=0x7fd55c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.919+0000 7fd54f7fe700 1 -- 172.21.15.131:0/4022621890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd55c018070 con 0x7fd5680601e0 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.919+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd568106ec0 con 0x7fd5680601e0 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.919+0000 7fd54f7fe700 1 -- 172.21.15.131:0/4022621890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd55c013410 con 0x7fd5680601e0 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.919+0000 7fd54f7fe700 1 -- 172.21.15.131:0/4022621890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd55c01c3c0 con 0x7fd5680601e0 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.919+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd568107350 con 0x7fd5680601e0 2024-02-15T18:24:08.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.920+0000 7fd54f7fe700 1 -- 172.21.15.131:0/4022621890 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fd55c01c680 con 0x7fd5680601e0 2024-02-15T18:24:08.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.920+0000 7fd54f7fe700 1 --2- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd55002ff60 0x7fd550032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:08.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.920+0000 7fd54f7fe700 1 -- 172.21.15.131:0/4022621890 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fd55c041560 con 0x7fd5680601e0 2024-02-15T18:24:08.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.920+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568045ad0 con 0x7fd5680601e0 2024-02-15T18:24:08.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.920+0000 7fd5667fc700 1 --2- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd55002ff60 0x7fd550032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:08.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.921+0000 7fd5667fc700 1 --2- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd55002ff60 0x7fd550032420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd5580096a0 tx=0x7fd558006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:08.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:08.925+0000 7fd54f7fe700 1 -- 172.21.15.131:0/4022621890 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd55c01ca80 con 0x7fd5680601e0 2024-02-15T18:24:09.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.131+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd5681083d0 con 0x7fd5680601e0 2024-02-15T18:24:09.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.131+0000 7fd54f7fe700 1 -- 172.21.15.131:0/4022621890 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fd55c01bb60 con 0x7fd5680601e0 2024-02-15T18:24:09.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:24:09.131 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:21:43.086424Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd55002ff60 msgr2=0x7fd550032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 --2- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd55002ff60 0x7fd550032420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd5580096a0 tx=0x7fd558006b40).stop 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 msgr2=0x7fd5681067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 --2- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 0x7fd5681067d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd55c007a10 tx=0x7fd55c009b30).stop 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 shutdown_connections 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 --2- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd55002ff60 0x7fd550032420 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 --2- 172.21.15.131:0/4022621890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680601e0 0x7fd5681067d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 >> 172.21.15.131:0/4022621890 conn(0x7fd5680f0b70 msgr2=0x7fd5680f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 shutdown_connections 2024-02-15T18:24:09.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:09.133+0000 7fd56d7f6700 1 -- 172.21.15.131:0/4022621890 wait complete. 2024-02-15T18:24:09.134 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-02-15T18:24:09.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:08.513526+0000 mgr.smithi033.apxevf (mgr.14162) 43 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:09.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:09.132767+0000 mon.smithi033 (mon.0) 137 : audit [DBG] from='client.? 172.21.15.131:0/4022621890' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:24:10.810 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:24:10.810 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:24:12.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:10.513770+0000 mgr.smithi033.apxevf (mgr.14162) 44 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:12.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:10.910930+0000 mon.smithi033 (mon.0) 138 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:12.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:10.911535+0000 mon.smithi033 (mon.0) 139 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:12.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:11.376861+0000 mon.smithi033 (mon.0) 140 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:12.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.799+0000 7fa36b59e700 1 -- 172.21.15.131:0/1394983645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 msgr2=0x7fa36c0f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:12.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.799+0000 7fa36b59e700 1 --2- 172.21.15.131:0/1394983645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 0x7fa36c0f66c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa35c009fb0 tx=0x7fa35c009b30).stop 2024-02-15T18:24:12.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36b59e700 1 -- 172.21.15.131:0/1394983645 shutdown_connections 2024-02-15T18:24:12.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36b59e700 1 --2- 172.21.15.131:0/1394983645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 0x7fa36c0f66c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:12.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36b59e700 1 -- 172.21.15.131:0/1394983645 >> 172.21.15.131:0/1394983645 conn(0x7fa36c0f1aa0 msgr2=0x7fa36c0f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:12.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36b59e700 1 -- 172.21.15.131:0/1394983645 shutdown_connections 2024-02-15T18:24:12.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36b59e700 1 -- 172.21.15.131:0/1394983645 wait complete. 2024-02-15T18:24:12.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36b59e700 1 Processor -- start 2024-02-15T18:24:12.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36b59e700 1 -- start start 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 0x7fa36c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c069e20 con 0x7fa36c0f62a0 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 0x7fa36c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 0x7fa36c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:46312/0 (socket says 172.21.15.131:46312) 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.800+0000 7fa36a59c700 1 -- 172.21.15.131:0/7290543 learned_addr learned my addr 172.21.15.131:0/7290543 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.801+0000 7fa36a59c700 1 -- 172.21.15.131:0/7290543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c005040 con 0x7fa36c0f62a0 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.801+0000 7fa36a59c700 1 --2- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 0x7fa36c06b9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa35c0089f0 tx=0x7fa35c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.801+0000 7fa35affd700 1 -- 172.21.15.131:0/7290543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa35c009320 con 0x7fa36c0f62a0 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.801+0000 7fa35affd700 1 -- 172.21.15.131:0/7290543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa35c013380 con 0x7fa36c0f62a0 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.801+0000 7fa35affd700 1 -- 172.21.15.131:0/7290543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa35c014e20 con 0x7fa36c0f62a0 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.801+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c069fc0 con 0x7fa36c0f62a0 2024-02-15T18:24:12.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.801+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c06a450 con 0x7fa36c0f62a0 2024-02-15T18:24:12.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.802+0000 7fa35affd700 1 -- 172.21.15.131:0/7290543 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fa35c0095f0 con 0x7fa36c0f62a0 2024-02-15T18:24:12.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.802+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c059100 con 0x7fa36c0f62a0 2024-02-15T18:24:12.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.802+0000 7fa35affd700 1 --2- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa35402ff60 0x7fa354032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:12.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.802+0000 7fa35affd700 1 -- 172.21.15.131:0/7290543 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fa35c040e40 con 0x7fa36c0f62a0 2024-02-15T18:24:12.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.802+0000 7fa369d9b700 1 --2- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa35402ff60 0x7fa354032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:12.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.803+0000 7fa369d9b700 1 --2- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa35402ff60 0x7fa354032420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa3600096a0 tx=0x7fa360006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:12.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:12.807+0000 7fa35affd700 1 -- 172.21.15.131:0/7290543 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa35c014420 con 0x7fa36c0f62a0 2024-02-15T18:24:13.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.024+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa36c0fbe30 con 0x7fa36c0f62a0 2024-02-15T18:24:13.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.025+0000 7fa35affd700 1 -- 172.21.15.131:0/7290543 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fa35c010230 con 0x7fa36c0f62a0 2024-02-15T18:24:13.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:24:13.024 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:21:43.086424Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:24:13.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa35402ff60 msgr2=0x7fa354032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:13.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 --2- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa35402ff60 0x7fa354032420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa3600096a0 tx=0x7fa360006b40).stop 2024-02-15T18:24:13.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 msgr2=0x7fa36c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:13.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 --2- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 0x7fa36c06b9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa35c0089f0 tx=0x7fa35c00b040).stop 2024-02-15T18:24:13.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 shutdown_connections 2024-02-15T18:24:13.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 --2- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa35402ff60 0x7fa354032420 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:13.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 --2- 172.21.15.131:0/7290543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa36c0f62a0 0x7fa36c06b9a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:13.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 >> 172.21.15.131:0/7290543 conn(0x7fa36c0f1aa0 msgr2=0x7fa36c0f2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:13.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 shutdown_connections 2024-02-15T18:24:13.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:13.027+0000 7fa36b59e700 1 -- 172.21.15.131:0/7290543 wait complete. 2024-02-15T18:24:13.027 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-02-15T18:24:13.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:12.149947+0000 mon.smithi033 (mon.0) 141 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:13.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:13.026096+0000 mon.smithi033 (mon.0) 142 : audit [DBG] from='client.? 172.21.15.131:0/7290543' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:24:14.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:12.514188+0000 mgr.smithi033.apxevf (mgr.14162) 45 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:14.795 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:24:14.795 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:24:16.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:14.514547+0000 mgr.smithi033.apxevf (mgr.14162) 46 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:16.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:15.170654+0000 mon.smithi033 (mon.0) 143 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.191+0000 7ff48d787700 1 -- 172.21.15.131:0/3723270627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 msgr2=0x7ff4880f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.191+0000 7ff48d787700 1 --2- 172.21.15.131:0/3723270627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 0x7ff4880f55c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ff478009fb0 tx=0x7ff478009b30).stop 2024-02-15T18:24:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.191+0000 7ff48d787700 1 -- 172.21.15.131:0/3723270627 shutdown_connections 2024-02-15T18:24:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.191+0000 7ff48d787700 1 --2- 172.21.15.131:0/3723270627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 0x7ff4880f55c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.191+0000 7ff48d787700 1 -- 172.21.15.131:0/3723270627 >> 172.21.15.131:0/3723270627 conn(0x7ff4880f09a0 msgr2=0x7ff4880f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.191+0000 7ff48d787700 1 -- 172.21.15.131:0/3723270627 shutdown_connections 2024-02-15T18:24:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.191+0000 7ff48d787700 1 -- 172.21.15.131:0/3723270627 wait complete. 2024-02-15T18:24:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.191+0000 7ff48d787700 1 Processor -- start 2024-02-15T18:24:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.192+0000 7ff48d787700 1 -- start start 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.192+0000 7ff48d787700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 0x7ff4880fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.192+0000 7ff48d787700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880fb6f0 con 0x7ff4880f51a0 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.192+0000 7ff487fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 0x7ff4880fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.192+0000 7ff487fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 0x7ff4880fd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:46336/0 (socket says 172.21.15.131:46336) 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.192+0000 7ff487fff700 1 -- 172.21.15.131:0/3578512029 learned_addr learned my addr 172.21.15.131:0/3578512029 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.192+0000 7ff487fff700 1 -- 172.21.15.131:0/3578512029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478005040 con 0x7ff4880f51a0 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.193+0000 7ff487fff700 1 --2- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 0x7ff4880fd270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff478009f80 tx=0x7ff47800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.193+0000 7ff484ff9700 1 -- 172.21.15.131:0/3578512029 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4780095f0 con 0x7ff4880f51a0 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.193+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880fb890 con 0x7ff4880f51a0 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.193+0000 7ff484ff9700 1 -- 172.21.15.131:0/3578512029 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff478007e90 con 0x7ff4880f51a0 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.193+0000 7ff484ff9700 1 -- 172.21.15.131:0/3578512029 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff478014d80 con 0x7ff4880f51a0 2024-02-15T18:24:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.193+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4880fbd20 con 0x7ff4880f51a0 2024-02-15T18:24:17.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.194+0000 7ff484ff9700 1 -- 172.21.15.131:0/3578512029 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7ff478025070 con 0x7ff4880f51a0 2024-02-15T18:24:17.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.194+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff488059100 con 0x7ff4880f51a0 2024-02-15T18:24:17.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.194+0000 7ff484ff9700 1 --2- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff47002ff60 0x7ff470032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:17.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.194+0000 7ff484ff9700 1 -- 172.21.15.131:0/3578512029 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7ff478040b70 con 0x7ff4880f51a0 2024-02-15T18:24:17.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.194+0000 7ff4877fe700 1 --2- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff47002ff60 0x7ff470032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:17.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.194+0000 7ff4877fe700 1 --2- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff47002ff60 0x7ff470032420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ff47c0096a0 tx=0x7ff47c006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.199+0000 7ff484ff9700 1 -- 172.21.15.131:0/3578512029 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff47800f300 con 0x7ff4880f51a0 2024-02-15T18:24:17.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.405+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff488045ad0 con 0x7ff4880f51a0 2024-02-15T18:24:17.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.406+0000 7ff484ff9700 1 -- 172.21.15.131:0/3578512029 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7ff478025ab0 con 0x7ff4880f51a0 2024-02-15T18:24:17.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:24:17.405 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:21:43.086424Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:24:17.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.407+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff47002ff60 msgr2=0x7ff470032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.407+0000 7ff48d787700 1 --2- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff47002ff60 0x7ff470032420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ff47c0096a0 tx=0x7ff47c006b40).stop 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.407+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 msgr2=0x7ff4880fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.407+0000 7ff48d787700 1 --2- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 0x7ff4880fd270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff478009f80 tx=0x7ff47800b040).stop 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.408+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 shutdown_connections 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.408+0000 7ff48d787700 1 --2- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff47002ff60 0x7ff470032420 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.408+0000 7ff48d787700 1 --2- 172.21.15.131:0/3578512029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4880f51a0 0x7ff4880fd270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.408+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 >> 172.21.15.131:0/3578512029 conn(0x7ff4880f09a0 msgr2=0x7ff48805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.408+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 shutdown_connections 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:17.408+0000 7ff48d787700 1 -- 172.21.15.131:0/3578512029 wait complete. 2024-02-15T18:24:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-02-15T18:24:18.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:16.514799+0000 mgr.smithi033.apxevf (mgr.14162) 47 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:18.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:16.999611+0000 mon.smithi033 (mon.0) 144 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:18.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:17.407183+0000 mon.smithi033 (mon.0) 145 : audit [DBG] from='client.? 172.21.15.131:0/3578512029' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:24:18.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:17.516948+0000 mon.smithi033 (mon.0) 146 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:18.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:17.520685+0000 mon.smithi033 (mon.0) 147 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:18.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:17.521956+0000 mon.smithi033 (mon.0) 148 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:24:18.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:17.526907+0000 mon.smithi033 (mon.0) 149 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-15T18:24:18.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:17.527687+0000 mon.smithi033 (mon.0) 150 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:19.113 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:24:19.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:24:19.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:17.528579+0000 mgr.smithi033.apxevf (mgr.14162) 48 : cephadm [INF] Deploying daemon crash.smithi131 on smithi131 2024-02-15T18:24:20.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:18.515056+0000 mgr.smithi033.apxevf (mgr.14162) 49 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:21.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 -- 172.21.15.131:0/2024936830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 msgr2=0x7fec400f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:21.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 --2- 172.21.15.131:0/2024936830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 0x7fec400f55c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fec3c009960 tx=0x7fec3c004d10).stop 2024-02-15T18:24:21.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 -- 172.21.15.131:0/2024936830 shutdown_connections 2024-02-15T18:24:21.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 --2- 172.21.15.131:0/2024936830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 0x7fec400f55c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:21.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 -- 172.21.15.131:0/2024936830 >> 172.21.15.131:0/2024936830 conn(0x7fec400f09a0 msgr2=0x7fec400f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:21.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 -- 172.21.15.131:0/2024936830 shutdown_connections 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 -- 172.21.15.131:0/2024936830 wait complete. 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 Processor -- start 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 -- start start 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 0x7fec40106650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.460+0000 7fec47400700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40106b40 con 0x7fec400f51a0 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec463fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 0x7fec40106650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec463fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 0x7fec40106650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:43688/0 (socket says 172.21.15.131:43688) 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec463fe700 1 -- 172.21.15.131:0/1266850552 learned_addr learned my addr 172.21.15.131:0/1266850552 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec463fe700 1 -- 172.21.15.131:0/1266850552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c009640 con 0x7fec400f51a0 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec463fe700 1 --2- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 0x7fec40106650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fec3c009610 tx=0x7fec3c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec36ffd700 1 -- 172.21.15.131:0/1266850552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec3c018070 con 0x7fec400f51a0 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec40106d40 con 0x7fec400f51a0 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec36ffd700 1 -- 172.21.15.131:0/1266850552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec3c00b970 con 0x7fec400f51a0 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec36ffd700 1 -- 172.21.15.131:0/1266850552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec3c013420 con 0x7fec400f51a0 2024-02-15T18:24:21.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.461+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec401071d0 con 0x7fec400f51a0 2024-02-15T18:24:21.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.462+0000 7fec36ffd700 1 -- 172.21.15.131:0/1266850552 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fec3c024060 con 0x7fec400f51a0 2024-02-15T18:24:21.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.462+0000 7fec36ffd700 1 --2- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fec2c02ffb0 0x7fec2c032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:21.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.462+0000 7fec36ffd700 1 -- 172.21.15.131:0/1266850552 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7fec3c041160 con 0x7fec400f51a0 2024-02-15T18:24:21.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.462+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec40045ad0 con 0x7fec400f51a0 2024-02-15T18:24:21.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.463+0000 7fec45bfd700 1 --2- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fec2c02ffb0 0x7fec2c032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:21.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.463+0000 7fec45bfd700 1 --2- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fec2c02ffb0 0x7fec2c032470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fec300096a0 tx=0x7fec30006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:21.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.468+0000 7fec36ffd700 1 -- 172.21.15.131:0/1266850552 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fec3c011910 con 0x7fec400f51a0 2024-02-15T18:24:21.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.684+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fec400fae80 con 0x7fec400f51a0 2024-02-15T18:24:21.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.685+0000 7fec36ffd700 1 -- 172.21.15.131:0/1266850552 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fec3c0102d0 con 0x7fec400f51a0 2024-02-15T18:24:21.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:24:21.684 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:21:43.086424Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:24:21.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.686+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fec2c02ffb0 msgr2=0x7fec2c032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:21.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.686+0000 7fec47400700 1 --2- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fec2c02ffb0 0x7fec2c032470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fec300096a0 tx=0x7fec30006b40).stop 2024-02-15T18:24:21.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.686+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 msgr2=0x7fec40106650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:21.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.686+0000 7fec47400700 1 --2- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 0x7fec40106650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fec3c009610 tx=0x7fec3c004d10).stop 2024-02-15T18:24:21.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.686+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 shutdown_connections 2024-02-15T18:24:21.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.686+0000 7fec47400700 1 --2- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fec2c02ffb0 0x7fec2c032470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:21.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.686+0000 7fec47400700 1 --2- 172.21.15.131:0/1266850552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f51a0 0x7fec40106650 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.686+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 >> 172.21.15.131:0/1266850552 conn(0x7fec400f09a0 msgr2=0x7fec4005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.686+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 shutdown_connections 2024-02-15T18:24:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:21.687+0000 7fec47400700 1 -- 172.21.15.131:0/1266850552 wait complete. 2024-02-15T18:24:21.687 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-02-15T18:24:22.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:20.515354+0000 mgr.smithi033.apxevf (mgr.14162) 50 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:22.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:21.685997+0000 mon.smithi033 (mon.0) 151 : audit [DBG] from='client.? 172.21.15.131:0/1266850552' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:24:22.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:22.139664+0000 mon.smithi033 (mon.0) 152 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:22.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:22.141074+0000 mon.smithi033 (mon.0) 153 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.buibla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:24:22.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:22.143144+0000 mon.smithi033 (mon.0) 154 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.buibla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-15T18:24:22.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:22.143944+0000 mon.smithi033 (mon.0) 155 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:24:22.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:22.144901+0000 mon.smithi033 (mon.0) 156 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:23.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:22.145705+0000 mgr.smithi033.apxevf (mgr.14162) 51 : cephadm [INF] Deploying daemon mgr.smithi131.buibla on smithi131 2024-02-15T18:24:23.604 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:24:23.604 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:24:24.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:22.515702+0000 mgr.smithi033.apxevf (mgr.14162) 52 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:26.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:24.516083+0000 mgr.smithi033.apxevf (mgr.14162) 53 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:26.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:24.799453+0000 mon.smithi033 (mon.0) 157 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:26.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:24.800731+0000 mon.smithi033 (mon.0) 158 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:24:26.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:24.801600+0000 mon.smithi033 (mon.0) 159 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:26.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:24.802331+0000 mgr.smithi033.apxevf (mgr.14162) 54 : cephadm [INF] Deploying daemon mon.smithi131 on smithi131 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.270+0000 7f794b1e5700 1 -- 172.21.15.131:0/8394646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 msgr2=0x7f79440f6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.270+0000 7f794b1e5700 1 --2- 172.21.15.131:0/8394646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 0x7f79440f6e20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f7938009fb0 tx=0x7f7938009b30).stop 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.270+0000 7f794b1e5700 1 -- 172.21.15.131:0/8394646 shutdown_connections 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.270+0000 7f794b1e5700 1 --2- 172.21.15.131:0/8394646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 0x7f79440f6e20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.270+0000 7f794b1e5700 1 -- 172.21.15.131:0/8394646 >> 172.21.15.131:0/8394646 conn(0x7f79440f0260 msgr2=0x7f79440f2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.270+0000 7f794b1e5700 1 -- 172.21.15.131:0/8394646 shutdown_connections 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.270+0000 7f794b1e5700 1 -- 172.21.15.131:0/8394646 wait complete. 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.271+0000 7f794b1e5700 1 Processor -- start 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.271+0000 7f794b1e5700 1 -- start start 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.271+0000 7f794b1e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 0x7f79440fd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:26.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.271+0000 7f794b1e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79440fb9e0 con 0x7f79440f6a00 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.271+0000 7f7948f81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 0x7f79440fd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.271+0000 7f7948f81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 0x7f79440fd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.131:43736/0 (socket says 172.21.15.131:43736) 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.271+0000 7f7948f81700 1 -- 172.21.15.131:0/1373294374 learned_addr learned my addr 172.21.15.131:0/1373294374 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.272+0000 7f7948f81700 1 -- 172.21.15.131:0/1373294374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7938005040 con 0x7f79440f6a00 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.272+0000 7f7948f81700 1 --2- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 0x7f79440fd560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f79380089f0 tx=0x7f793800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.272+0000 7f79417fa700 1 -- 172.21.15.131:0/1373294374 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7938009320 con 0x7f79440f6a00 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.272+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79440fbb80 con 0x7f79440f6a00 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.272+0000 7f79417fa700 1 -- 172.21.15.131:0/1373294374 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7938013380 con 0x7f79440f6a00 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.272+0000 7f79417fa700 1 -- 172.21.15.131:0/1373294374 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7938014e20 con 0x7f79440f6a00 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.272+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79440fc010 con 0x7f79440f6a00 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.273+0000 7f79417fa700 1 -- 172.21.15.131:0/1373294374 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f7938014420 con 0x7f79440f6a00 2024-02-15T18:24:26.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.273+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7944059100 con 0x7f79440f6a00 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:21:43.086424Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.273+0000 7f79417fa700 1 --2- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f793402ff10 0x7f79340323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.273+0000 7f79417fa700 1 -- 172.21.15.131:0/1373294374 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f7938040fb0 con 0x7f79440f6a00 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.273+0000 7f7943fff700 1 --2- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f793402ff10 0x7f79340323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.274+0000 7f7943fff700 1 --2- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f793402ff10 0x7f79340323d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f79300096a0 tx=0x7f7930006b40).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.278+0000 7f79417fa700 1 -- 172.21.15.131:0/1373294374 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f793806d2b0 con 0x7f79440f6a00 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.501+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7944045ad0 con 0x7f79440f6a00 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.501+0000 7f79417fa700 1 -- 172.21.15.131:0/1373294374 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f7938014790 con 0x7f79440f6a00 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.503+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f793402ff10 msgr2=0x7f79340323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.503+0000 7f794b1e5700 1 --2- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f793402ff10 0x7f79340323d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f79300096a0 tx=0x7f7930006b40).stop 2024-02-15T18:24:26.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.503+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 msgr2=0x7f79440fd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.503+0000 7f794b1e5700 1 --2- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 0x7f79440fd560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f79380089f0 tx=0x7f793800b040).stop 2024-02-15T18:24:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.503+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 shutdown_connections 2024-02-15T18:24:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.503+0000 7f794b1e5700 1 --2- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f793402ff10 0x7f79340323d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.503+0000 7f794b1e5700 1 --2- 172.21.15.131:0/1373294374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79440f6a00 0x7f79440fd560 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.503+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 >> 172.21.15.131:0/1373294374 conn(0x7f79440f0260 msgr2=0x7f79440f0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.504+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 shutdown_connections 2024-02-15T18:24:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:26.504+0000 7f794b1e5700 1 -- 172.21.15.131:0/1373294374 wait complete. 2024-02-15T18:24:26.893 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-02-15T18:24:27.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:26.502841+0000 mon.smithi033 (mon.0) 160 : audit [DBG] from='client.? 172.21.15.131:0/1373294374' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:24:28.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:26.516436+0000 mgr.smithi033.apxevf (mgr.14162) 55 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:29.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:28 smithi131 systemd[1]: Starting Ceph mon.smithi131 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:24:29.231 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-15T18:24:29.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-15T18:24:29.507 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.353+0000 7f40b6374700 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-15T18:24:29.507 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.353+0000 7f40b6374700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2024-02-15T18:24:29.507 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.353+0000 7f40b6374700 0 pidfile_write: ignore empty --pid-file 2024-02-15T18:24:29.507 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.358+0000 7f40b6374700 0 load: jerasure load: lrc load: isa 2024-02-15T18:24:29.507 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: RocksDB version: 6.8.1 2024-02-15T18:24:29.507 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Compile date May 13 2021 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: DB SUMMARY 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: CURRENT file: CURRENT 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: IDENTITY file: IDENTITY 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi131/store.db dir, Total Num: 0, files: 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi131/store.db: 000003.log size: 511 ; 2024-02-15T18:24:29.508 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.error_if_exists: 0 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.create_if_missing: 0 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.paranoid_checks: 1 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.env: 0x55a9e13371c0 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.fs: Posix File System 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.info_log: 0x55a9e1d7b960 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.statistics: (nil) 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.use_fsync: 0 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_log_file_size: 0 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-15T18:24:29.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.allow_fallocate: 1 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.use_direct_reads: 0 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.create_missing_column_families: 0 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.db_log_dir: 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi131/store.db 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_subcompactions: 1 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_background_flushes: -1 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T18:24:29.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.advise_random_on_open: 1 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.write_buffer_manager: 0x55a9e29f0030 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.rate_limiter: (nil) 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.unordered_write: 0 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T18:24:29.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.row_cache: None 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.wal_filter: None 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.preserve_deletes: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.two_write_queues: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.manual_wal_flush: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.atomic_flush: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.log_readahead_size: 0 2024-02-15T18:24:29.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_background_jobs: 2 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_background_compactions: -1 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_total_wal_size: 0 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_open_files: -1 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.bytes_per_sync: 0 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T18:24:29.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Compression algorithms supported: 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: kZSTD supported: 0 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: kXpressCompression supported: 0 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: kLZ4Compression supported: 1 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: kBZip2Compression supported: 0 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: kZlibCompression supported: 1 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: kSnappyCompression supported: 1 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi131/store.db/MANIFEST-000001 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.514 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.merge_operator: 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_filter: None 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_filter_factory: None 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a9e1c93cb0) 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cache_index_and_filter_blocks: 1 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: pin_top_level_index_and_filter: 1 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: index_type: 0 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: data_block_index_type: 0 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: index_shortening: 1 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: data_block_hash_table_util_ratio: 0.750000 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: hash_index_allow_collision: 1 2024-02-15T18:24:29.515 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: checksum: 1 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: no_block_cache: 0 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: block_cache: 0x55a9e1cc8f10 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: block_cache_name: BinnedLRUCache 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: block_cache_options: 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: capacity : 536870912 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: num_shard_bits : 4 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: strict_capacity_limit : 0 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: high_pri_pool_ratio: 0.000 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: block_cache_compressed: (nil) 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: persistent_cache: (nil) 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: block_size: 4096 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: block_size_deviation: 10 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: block_restart_interval: 16 2024-02-15T18:24:29.516 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: index_block_restart_interval: 1 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: metadata_block_size: 4096 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: partition_filters: 0 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: use_delta_encoding: 1 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: whole_key_filtering: 1 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: verify_compression: 0 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: read_amp_bytes_per_bit: 0 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: format_version: 2 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: enable_index_compression: 1 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: block_align: 0 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compression: NoCompression 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-15T18:24:29.517 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.num_levels: 7 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compression_opts.level: 32767 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T18:24:29.518 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compression_opts.enabled: false 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T18:24:29.519 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.arena_block_size: 4194304 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T18:24:29.520 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.table_properties_collectors: 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.inplace_update_support: 0 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.bloom_locality: 0 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.max_successive_merges: 0 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.force_consistency_checks: 0 2024-02-15T18:24:29.521 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.ttl: 2592000 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.359+0000 7f40b6374700 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.360+0000 7f40b6374700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi131/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.360+0000 7f40b6374700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.360+0000 7f40b6374700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021469361577, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.360+0000 7f40b6374700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.360+0000 7f40b6374700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.360+0000 7f40b6374700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021469362031, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708021469, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.360+0000 7f40b6374700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.361+0000 7f40b6374700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021469362431, "job": 1, "event": "recovery_finished"} 2024-02-15T18:24:29.522 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.361+0000 7f40b6374700 4 rocksdb: DB pointer 0x55a9e1d8d800 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.362+0000 7f409d18c700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.362+0000 7f409d18c700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ** DB Stats ** 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ** Compaction Stats [default] ** 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-02-15T18:24:29.523 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ** Compaction Stats [default] ** 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:24:29.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Cumulative compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Interval compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ** Compaction Stats [default] ** 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ** Compaction Stats [default] ** 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:24:29.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Cumulative compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.362+0000 7f40b6374700 0 mon.smithi131 does not exist in monmap, will attempt to join an existing cluster 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.362+0000 7f40b6374700 0 using public_addr v2:172.21.15.131:0/0 -> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.362+0000 7f40b6374700 0 starting mon.smithi131 rank -1 at public addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] at bind addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi131 fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:24:29.526 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.363+0000 7f40b6374700 1 mon.smithi131@-1(???) e0 preinit fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 0 mon.smithi131@-1(synchronizing).mds e1 new map 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 0 mon.smithi131@-1(synchronizing).mds e1 print_map 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: e1 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: legacy client fscid: -1 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: No filesystems configured 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 1 mon.smithi131@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 1 mon.smithi131@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 1 mon.smithi131@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 1 mon.smithi131@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 1 mon.smithi131@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 1 mon.smithi131@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-15T18:24:29.527 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 1 mon.smithi131@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 0 mon.smithi131@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 0 mon.smithi131@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 0 mon.smithi131@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 0 mon.smithi131@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:26.516436+0000 mgr.smithi033.apxevf (mgr.14162) 55 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.391+0000 7f409f991700 1 mon.smithi131@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta expand map: {default=false} 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta from 'false' to 'false' 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta expanded map: {default=false} 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta expand map: {default=info} 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta from 'info' to 'info' 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta expanded map: {default=info} 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta expand map: {default=daemon} 2024-02-15T18:24:29.528 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta from 'daemon' to 'daemon' 2024-02-15T18:24:29.529 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta expanded map: {default=daemon} 2024-02-15T18:24:29.529 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta expand map: {default=debug} 2024-02-15T18:24:29.529 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta from 'debug' to 'debug' 2024-02-15T18:24:29.529 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 20 expand_channel_meta expanded map: {default=debug} 2024-02-15T18:24:29.529 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:24:29.393+0000 7f409f991700 10 mon.smithi131@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2024-02-15T18:24:29.529 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 bash[40484]: 710ae4544ec330ecf864887138a11f08bffddb31047ab24d1233e237189c993d 2024-02-15T18:24:29.529 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:29 smithi131 systemd[1]: Started Ceph mon.smithi131 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.560+0000 7f017759e700 1 -- 172.21.15.131:0/1733315625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164003250 msgr2=0x7f01640056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.560+0000 7f017759e700 1 --2- 172.21.15.131:0/1733315625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164003250 0x7f01640056e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f01780f5ff0 tx=0x7f016000b040).stop 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.560+0000 7f017759e700 1 -- 172.21.15.131:0/1733315625 shutdown_connections 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.560+0000 7f017759e700 1 --2- 172.21.15.131:0/1733315625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164003250 0x7f01640056e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.560+0000 7f017759e700 1 -- 172.21.15.131:0/1733315625 >> 172.21.15.131:0/1733315625 conn(0x7f01780f09a0 msgr2=0x7f01780f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.560+0000 7f017759e700 1 -- 172.21.15.131:0/1733315625 shutdown_connections 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.560+0000 7f017759e700 1 -- 172.21.15.131:0/1733315625 wait complete. 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.561+0000 7f017759e700 1 Processor -- start 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.561+0000 7f017759e700 1 -- start start 2024-02-15T18:24:34.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.561+0000 7f017759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 0x7f01781054f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.561+0000 7f017759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01781059e0 0x7f01781068d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.561+0000 7f017759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0178105f40 con 0x7f01781059e0 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.561+0000 7f017759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0178106080 con 0x7f0164003250 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f017659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 0x7f01781054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f017659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 0x7f01781054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40066/0 (socket says 172.21.15.131:40066) 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f017659c700 1 -- 172.21.15.131:0/1536172114 learned_addr learned my addr 172.21.15.131:0/1536172114 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f0175d9b700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01781059e0 0x7f01781068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f017659c700 1 -- 172.21.15.131:0/1536172114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 msgr2=0x7f01781054f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f017659c700 1 -- 172.21.15.131:0/1536172114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 msgr2=0x7f01781054f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f017659c700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 0x7f01781054f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f017659c700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 0x7f01781054f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f0175d9b700 1 -- 172.21.15.131:0/1536172114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 msgr2=0x7f01781054f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f0175d9b700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 0x7f01781054f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f0175d9b700 1 -- 172.21.15.131:0/1536172114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0160005040 con 0x7f01781059e0 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f0175d9b700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01781059e0 0x7f01781068d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0168009390 tx=0x7f0168006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:34.562 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f016effd700 1 -- 172.21.15.131:0/1536172114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01680115e0 con 0x7f01781059e0 2024-02-15T18:24:34.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f016effd700 1 -- 172.21.15.131:0/1536172114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0168011c10 con 0x7f01781059e0 2024-02-15T18:24:34.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f016effd700 1 -- 172.21.15.131:0/1536172114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0168010cf0 con 0x7f01781059e0 2024-02-15T18:24:34.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0178106ee0 con 0x7f01781059e0 2024-02-15T18:24:34.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.562+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01781074a0 con 0x7f01781059e0 2024-02-15T18:24:34.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.563+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0178059100 con 0x7f01781059e0 2024-02-15T18:24:34.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.564+0000 7f016effd700 1 -- 172.21.15.131:0/1536172114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0168018030 con 0x7f01781059e0 2024-02-15T18:24:34.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.565+0000 7f016effd700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f015805c3a0 0x7f015805e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:34.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.565+0000 7f016effd700 1 -- 172.21.15.131:0/1536172114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f0168074b00 con 0x7f01781059e0 2024-02-15T18:24:34.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.565+0000 7f017659c700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f015805c3a0 0x7f015805e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:34.564 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.565+0000 7f017659c700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f015805c3a0 0x7f015805e860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0160009ee0 tx=0x7f016000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:34.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.570+0000 7f016effd700 1 -- 172.21.15.131:0/1536172114 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f01680452b0 con 0x7f01781059e0 2024-02-15T18:24:34.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:29.400176+0000 mon.smithi033 (mon.0) 162 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:24:34.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:29.400404+0000 mon.smithi033 (mon.0) 163 : cluster [INF] mon.smithi033 calling monitor election 2024-02-15T18:24:34.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:29.415670+0000 mon.smithi033 (mon.0) 164 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:29.761728+0000 mon.smithi033 (mon.0) 165 : audit [DBG] from='mgr.? 172.21.15.131:0/4121745460' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/crt"}]: dispatch 2024-02-15T18:24:34.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:30.396527+0000 mon.smithi033 (mon.0) 166 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:30.517186+0000 mgr.smithi033.apxevf (mgr.14162) 57 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:34.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:31.396600+0000 mon.smithi033 (mon.0) 167 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:31.397822+0000 mon.smithi131 (mon.1) 1 : cluster [INF] mon.smithi131 calling monitor election 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:32.397035+0000 mon.smithi033 (mon.0) 168 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:32.517556+0000 mgr.smithi033.apxevf (mgr.14162) 58 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:33.396873+0000 mon.smithi033 (mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:34.396983+0000 mon.smithi033 (mon.0) 170 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:34.429120+0000 mon.smithi033 (mon.0) 171 : cluster [INF] mon.smithi033 is new leader, mons smithi033,smithi131 in quorum (ranks 0,1) 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:34.432225+0000 mon.smithi033 (mon.0) 172 : cluster [DBG] monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi131=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:34.432271+0000 mon.smithi033 (mon.0) 173 : cluster [DBG] fsmap 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:34.432297+0000 mon.smithi033 (mon.0) 174 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:34.432513+0000 mon.smithi033 (mon.0) 175 : cluster [DBG] mgrmap e17: smithi033.apxevf(active, since 99s) 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:34.433203+0000 mon.smithi033 (mon.0) 176 : cluster [DBG] Standby manager daemon smithi131.buibla started 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:34.434447+0000 mon.smithi033 (mon.0) 177 : audit [DBG] from='mgr.? 172.21.15.131:0/4121745460' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:24:34.756 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:34.436057+0000 mon.smithi033 (mon.0) 178 : cluster [INF] overall HEALTH_OK 2024-02-15T18:24:34.757 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:34.436538+0000 mon.smithi033 (mon.0) 179 : audit [DBG] from='mgr.? 172.21.15.131:0/4121745460' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/key"}]: dispatch 2024-02-15T18:24:34.757 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:34.436991+0000 mon.smithi033 (mon.0) 180 : audit [DBG] from='mgr.? 172.21.15.131:0/4121745460' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:24:34.757 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:34.438420+0000 mon.smithi033 (mon.0) 181 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:34.807 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:29.400176+0000 mon.smithi033 (mon.0) 162 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:24:34.807 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:29.400404+0000 mon.smithi033 (mon.0) 163 : cluster [INF] mon.smithi033 calling monitor election 2024-02-15T18:24:34.807 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:29.415670+0000 mon.smithi033 (mon.0) 164 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:29.761728+0000 mon.smithi033 (mon.0) 165 : audit [DBG] from='mgr.? 172.21.15.131:0/4121745460' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/crt"}]: dispatch 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:30.396527+0000 mon.smithi033 (mon.0) 166 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:30.517186+0000 mgr.smithi033.apxevf (mgr.14162) 57 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:31.396600+0000 mon.smithi033 (mon.0) 167 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:31.397822+0000 mon.smithi131 (mon.1) 1 : cluster [INF] mon.smithi131 calling monitor election 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:32.397035+0000 mon.smithi033 (mon.0) 168 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:32.517556+0000 mgr.smithi033.apxevf (mgr.14162) 58 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:33.396873+0000 mon.smithi033 (mon.0) 169 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:34.396983+0000 mon.smithi033 (mon.0) 170 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:34.429120+0000 mon.smithi033 (mon.0) 171 : cluster [INF] mon.smithi033 is new leader, mons smithi033,smithi131 in quorum (ranks 0,1) 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:34.432225+0000 mon.smithi033 (mon.0) 172 : cluster [DBG] monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi131=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:34.432271+0000 mon.smithi033 (mon.0) 173 : cluster [DBG] fsmap 2024-02-15T18:24:34.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:34.432297+0000 mon.smithi033 (mon.0) 174 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-15T18:24:34.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:34.432513+0000 mon.smithi033 (mon.0) 175 : cluster [DBG] mgrmap e17: smithi033.apxevf(active, since 99s) 2024-02-15T18:24:34.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:34.433203+0000 mon.smithi033 (mon.0) 176 : cluster [DBG] Standby manager daemon smithi131.buibla started 2024-02-15T18:24:34.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:34.434447+0000 mon.smithi033 (mon.0) 177 : audit [DBG] from='mgr.? 172.21.15.131:0/4121745460' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:24:34.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:34.436057+0000 mon.smithi033 (mon.0) 178 : cluster [INF] overall HEALTH_OK 2024-02-15T18:24:34.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:34.436538+0000 mon.smithi033 (mon.0) 179 : audit [DBG] from='mgr.? 172.21.15.131:0/4121745460' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/key"}]: dispatch 2024-02-15T18:24:34.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:34.436991+0000 mon.smithi033 (mon.0) 180 : audit [DBG] from='mgr.? 172.21.15.131:0/4121745460' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:24:34.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:34.438420+0000 mon.smithi033 (mon.0) 181 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:34.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.810+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0178045ad0 con 0x7f01781059e0 2024-02-15T18:24:34.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.811+0000 7f016effd700 1 -- 172.21.15.131:0/1536172114 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+968 (secure 0 0 0) 0x7f0178045ad0 con 0x7f01781059e0 2024-02-15T18:24:34.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-02-15T18:24:34.810 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":2,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","modified":"2024-02-15T18:24:29.396749Z","created":"2024-02-15T18:21:43.086424Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi131","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-15T18:24:34.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f015805c3a0 msgr2=0x7f015805e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f015805c3a0 0x7f015805e860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0160009ee0 tx=0x7f016000b040).stop 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01781059e0 msgr2=0x7f01781068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01781059e0 0x7f01781068d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0168009390 tx=0x7f0168006e20).stop 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 shutdown_connections 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f015805c3a0 0x7f015805e860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0164003250 0x7f01781054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 --2- 172.21.15.131:0/1536172114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01781059e0 0x7f01781068d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 >> 172.21.15.131:0/1536172114 conn(0x7f01780f09a0 msgr2=0x7f01780f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 shutdown_connections 2024-02-15T18:24:34.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:24:34.813+0000 7f017759e700 1 -- 172.21.15.131:0/1536172114 wait complete. 2024-02-15T18:24:34.813 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 2 2024-02-15T18:24:35.513 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-15T18:24:35.513 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph config generate-minimal-conf 2024-02-15T18:24:35.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:24:34.439456+0000 mgr.smithi033.apxevf (mgr.14162) 59 : cephadm [INF] Deploying daemon node-exporter.smithi131 on smithi131 2024-02-15T18:24:35.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:34.493825+0000 mon.smithi033 (mon.0) 182 : cluster [DBG] mgrmap e18: smithi033.apxevf(active, since 100s), standbys: smithi131.buibla 2024-02-15T18:24:35.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:34.493985+0000 mon.smithi033 (mon.0) 183 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi131.buibla", "id": "smithi131.buibla"}]: dispatch 2024-02-15T18:24:35.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:34.517930+0000 mgr.smithi033.apxevf (mgr.14162) 60 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:35.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:34.811854+0000 mon.smithi033 (mon.0) 184 : audit [DBG] from='client.? 172.21.15.131:0/1536172114' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:24:35.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:35.397288+0000 mon.smithi033 (mon.0) 185 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:35.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:34.439456+0000 mgr.smithi033.apxevf (mgr.14162) 59 : cephadm [INF] Deploying daemon node-exporter.smithi131 on smithi131 2024-02-15T18:24:35.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:34.493825+0000 mon.smithi033 (mon.0) 182 : cluster [DBG] mgrmap e18: smithi033.apxevf(active, since 100s), standbys: smithi131.buibla 2024-02-15T18:24:35.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:34.493985+0000 mon.smithi033 (mon.0) 183 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi131.buibla", "id": "smithi131.buibla"}]: dispatch 2024-02-15T18:24:35.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:34.517930+0000 mgr.smithi033.apxevf (mgr.14162) 60 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:35.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:34.811854+0000 mon.smithi033 (mon.0) 184 : audit [DBG] from='client.? 172.21.15.131:0/1536172114' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-15T18:24:35.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:35.397288+0000 mon.smithi033 (mon.0) 185 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:24:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.364+0000 7f6589968700 1 -- 172.21.15.33:0/976707334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 msgr2=0x7f65840f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.364+0000 7f6589968700 1 --2- 172.21.15.33:0/976707334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 0x7f65840f55c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f6578009fb0 tx=0x7f6578009b30).stop 2024-02-15T18:24:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.364+0000 7f6589968700 1 -- 172.21.15.33:0/976707334 shutdown_connections 2024-02-15T18:24:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.364+0000 7f6589968700 1 --2- 172.21.15.33:0/976707334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 0x7f65840f55c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.364+0000 7f6589968700 1 -- 172.21.15.33:0/976707334 >> 172.21.15.33:0/976707334 conn(0x7f65840f09a0 msgr2=0x7f65840f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.364+0000 7f6589968700 1 -- 172.21.15.33:0/976707334 shutdown_connections 2024-02-15T18:24:37.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.364+0000 7f6589968700 1 -- 172.21.15.33:0/976707334 wait complete. 2024-02-15T18:24:37.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6589968700 1 Processor -- start 2024-02-15T18:24:37.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6589968700 1 -- start start 2024-02-15T18:24:37.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6589968700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 0x7f6584106680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:37.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6589968700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6584106b70 0x7f6584107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:37.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6589968700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65841070d0 con 0x7f65840f51a0 2024-02-15T18:24:37.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6589968700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6584107210 con 0x7f6584106b70 2024-02-15T18:24:37.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6588966700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 0x7f6584106680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:37.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6588966700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 0x7f6584106680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44164/0 (socket says 172.21.15.33:44164) 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6588966700 1 -- 172.21.15.33:0/614419319 learned_addr learned my addr 172.21.15.33:0/614419319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.365+0000 7f6583fff700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6584106b70 0x7f6584107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f6588966700 1 -- 172.21.15.33:0/614419319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6584106b70 msgr2=0x7f6584107a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f6588966700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6584106b70 0x7f6584107a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f6588966700 1 -- 172.21.15.33:0/614419319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6578005040 con 0x7f65840f51a0 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f6583fff700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6584106b70 0x7f6584107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f6588966700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 0x7f6584106680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6578000c00 tx=0x7f657800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f65817fa700 1 -- 172.21.15.33:0/614419319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6578019070 con 0x7f65840f51a0 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6584108010 con 0x7f65840f51a0 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f65817fa700 1 -- 172.21.15.33:0/614419319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6578007ba0 con 0x7f65840f51a0 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f65817fa700 1 -- 172.21.15.33:0/614419319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6578014420 con 0x7f65840f51a0 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.366+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6584108570 con 0x7f65840f51a0 2024-02-15T18:24:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.367+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6584045ad0 con 0x7f65840f51a0 2024-02-15T18:24:37.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.367+0000 7f65817fa700 1 -- 172.21.15.33:0/614419319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f657801e420 con 0x7f65840f51a0 2024-02-15T18:24:37.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.368+0000 7f65817fa700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f657405c3b0 0x7f657405e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:37.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.368+0000 7f65817fa700 1 -- 172.21.15.33:0/614419319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7f6578076700 con 0x7f65840f51a0 2024-02-15T18:24:37.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.368+0000 7f6583fff700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f657405c3b0 0x7f657405e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:37.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.368+0000 7f6583fff700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f657405c3b0 0x7f657405e870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f657000a820 tx=0x7f6570008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:37.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.372+0000 7f65817fa700 1 -- 172.21.15.33:0/614419319 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f657804a370 con 0x7f65840f51a0 2024-02-15T18:24:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.530+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f65840008d0 con 0x7f65840f51a0 2024-02-15T18:24:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.531+0000 7f65817fa700 1 -- 172.21.15.33:0/614419319 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v12) v1 ==== 76+0+225 (secure 0 0 0) 0x7f657804d990 con 0x7f65840f51a0 2024-02-15T18:24:37.530 INFO:teuthology.orchestra.run.smithi033.stdout:# minimal ceph.conf for fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:24:37.530 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-02-15T18:24:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:24:37.531 INFO:teuthology.orchestra.run.smithi033.stdout: mon_host = [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-02-15T18:24:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.532+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f657405c3b0 msgr2=0x7f657405e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f657405c3b0 0x7f657405e870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f657000a820 tx=0x7f6570008040).stop 2024-02-15T18:24:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 msgr2=0x7f6584106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 0x7f6584106680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6578000c00 tx=0x7f657800b040).stop 2024-02-15T18:24:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 shutdown_connections 2024-02-15T18:24:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f657405c3b0 0x7f657405e870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65840f51a0 0x7f6584106680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 --2- 172.21.15.33:0/614419319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6584106b70 0x7f6584107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 >> 172.21.15.33:0/614419319 conn(0x7f65840f09a0 msgr2=0x7f658405fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 shutdown_connections 2024-02-15T18:24:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:37.533+0000 7f6589968700 1 -- 172.21.15.33:0/614419319 wait complete. 2024-02-15T18:24:37.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:36.518199+0000 mgr.smithi033.apxevf (mgr.14162) 61 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:37.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:37.532767+0000 mon.smithi033 (mon.0) 186 : audit [DBG] from='client.? 172.21.15.33:0/614419319' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:38.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:36.518199+0000 mgr.smithi033.apxevf (mgr.14162) 61 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:38.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:37.532767+0000 mon.smithi033 (mon.0) 186 : audit [DBG] from='client.? 172.21.15.33:0/614419319' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:38.260 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-15T18:24:38.260 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:24:38.260 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.conf 2024-02-15T18:24:38.294 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:24:38.294 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T18:24:38.364 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:24:38.364 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.conf 2024-02-15T18:24:38.401 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:24:38.401 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-15T18:24:38.472 INFO:tasks.cephadm:Deploying OSDs... 2024-02-15T18:24:38.472 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:24:38.472 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T18:24:38.492 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T18:24:38.492 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-02-15T18:24:38.551 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T18:24:38.552 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:24:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 169021 Links: 1 2024-02-15T18:24:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:24:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-02-15 18:24:10.242257332 +0000 2024-02-15T18:24:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 18:16:41.414084808 +0000 2024-02-15T18:24:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 18:16:41.414084808 +0000 2024-02-15T18:24:38.552 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-02-15T18:24:38.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T18:24:38.620 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-02-15T18:24:38.620 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-02-15T18:24:38.620 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.00020743 s, 2.5 MB/s 2024-02-15T18:24:38.621 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T18:24:38.681 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-02-15T18:24:38.740 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T18:24:38.740 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:24:38.740 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 167261 Links: 1 2024-02-15T18:24:38.741 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:38.741 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:24:38.741 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-02-15 18:24:10.242257332 +0000 2024-02-15T18:24:38.741 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 18:16:41.764079030 +0000 2024-02-15T18:24:38.741 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 18:16:41.764079030 +0000 2024-02-15T18:24:38.741 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-02-15T18:24:38.741 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T18:24:38.808 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-02-15T18:24:38.808 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-02-15T18:24:38.808 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000203692 s, 2.5 MB/s 2024-02-15T18:24:38.809 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T18:24:38.868 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-02-15T18:24:38.928 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T18:24:38.928 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:24:38.928 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 168000 Links: 1 2024-02-15T18:24:38.928 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:38.928 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:24:38.928 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-02-15 18:24:10.242257332 +0000 2024-02-15T18:24:38.929 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 18:16:42.148072692 +0000 2024-02-15T18:24:38.929 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 18:16:42.148072692 +0000 2024-02-15T18:24:38.929 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-02-15T18:24:38.929 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T18:24:38.995 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-02-15T18:24:38.995 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-02-15T18:24:38.995 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000181533 s, 2.8 MB/s 2024-02-15T18:24:38.996 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T18:24:39.056 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-02-15T18:24:39.117 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T18:24:39.117 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:24:39.117 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 170094 Links: 1 2024-02-15T18:24:39.117 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:39.117 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:24:39.117 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-02-15 18:24:10.242257332 +0000 2024-02-15T18:24:39.117 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 18:16:42.504066815 +0000 2024-02-15T18:24:39.117 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 18:16:42.504066815 +0000 2024-02-15T18:24:39.118 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-02-15T18:24:39.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T18:24:39.184 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-02-15T18:24:39.184 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-02-15T18:24:39.184 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000222859 s, 2.3 MB/s 2024-02-15T18:24:39.185 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T18:24:39.244 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:24:39.244 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-02-15T18:24:39.266 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-15T18:24:39.266 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-02-15T18:24:39.328 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-15T18:24:39.329 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:24:39.329 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 163465 Links: 1 2024-02-15T18:24:39.329 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:39.329 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:24:39.329 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-02-15 18:24:34.872142162 +0000 2024-02-15T18:24:39.329 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-02-15 18:16:35.006869187 +0000 2024-02-15T18:24:39.329 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-02-15 18:16:35.006869187 +0000 2024-02-15T18:24:39.329 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-02-15T18:24:39.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-15T18:24:39.398 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-02-15T18:24:39.399 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-02-15T18:24:39.399 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000193641 s, 2.6 MB/s 2024-02-15T18:24:39.400 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-15T18:24:39.460 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-02-15T18:24:39.520 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-15T18:24:39.520 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:24:39.520 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 162625 Links: 1 2024-02-15T18:24:39.520 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:39.520 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:24:39.520 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-02-15 18:24:34.872142162 +0000 2024-02-15T18:24:39.520 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-02-15 18:16:35.346861619 +0000 2024-02-15T18:24:39.520 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-02-15 18:16:35.346861619 +0000 2024-02-15T18:24:39.520 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-02-15T18:24:39.521 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-15T18:24:39.586 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-02-15T18:24:39.587 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-02-15T18:24:39.587 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000225252 s, 2.3 MB/s 2024-02-15T18:24:39.588 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-15T18:24:39.648 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-02-15T18:24:39.706 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-15T18:24:39.706 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:24:39.706 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 163528 Links: 1 2024-02-15T18:24:39.706 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:39.706 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:24:39.706 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-02-15 18:24:34.872142162 +0000 2024-02-15T18:24:39.706 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-02-15 18:16:35.700853738 +0000 2024-02-15T18:24:39.706 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-02-15 18:16:35.700853738 +0000 2024-02-15T18:24:39.707 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-02-15T18:24:39.707 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-15T18:24:39.772 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-02-15T18:24:39.773 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-02-15T18:24:39.773 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000163611 s, 3.1 MB/s 2024-02-15T18:24:39.774 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-15T18:24:39.832 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-02-15T18:24:39.890 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-15T18:24:39.891 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-15T18:24:39.891 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 163646 Links: 1 2024-02-15T18:24:39.891 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:24:39.891 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-02-15T18:24:39.891 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-02-15 18:24:34.872142162 +0000 2024-02-15T18:24:39.891 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-02-15 18:16:36.050845947 +0000 2024-02-15T18:24:39.891 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-02-15 18:16:36.050845947 +0000 2024-02-15T18:24:39.891 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-02-15T18:24:39.891 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-15T18:24:39.956 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-02-15T18:24:39.956 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-02-15T18:24:39.956 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000232202 s, 2.2 MB/s 2024-02-15T18:24:39.957 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-15T18:24:40.016 INFO:tasks.cephadm:Deploying osd.0 on smithi033 with /dev/vg_nvme/lv_4... 2024-02-15T18:24:40.016 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-15T18:24:40.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:38.518547+0000 mgr.smithi033.apxevf (mgr.14162) 62 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:40.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:38.518547+0000 mgr.smithi033.apxevf (mgr.14162) 62 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:42.368 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:40.518789+0000 mgr.smithi033.apxevf (mgr.14162) 63 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:42.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:40.518789+0000 mgr.smithi033.apxevf (mgr.14162) 63 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:42.946 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-15T18:24:42.946 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-15T18:24:42.946 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-02-15T18:24:42.946 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-02-15T18:24:42.947 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109336 s, 959 MB/s 2024-02-15T18:24:42.947 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-02-15T18:24:43.672 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi033:vg_nvme/lv_4 2024-02-15T18:24:44.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:42.519158+0000 mgr.smithi033.apxevf (mgr.14162) 64 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:44.631 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:42.519158+0000 mgr.smithi033.apxevf (mgr.14162) 64 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:45.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.617+0000 7ff2aca88700 1 -- 172.21.15.33:0/2207694581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 msgr2=0x7ff2a80f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:45.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.617+0000 7ff2aca88700 1 --2- 172.21.15.33:0/2207694581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 0x7ff2a80f9180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff290004660 tx=0x7ff290009b30).stop 2024-02-15T18:24:45.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.617+0000 7ff2aca88700 1 -- 172.21.15.33:0/2207694581 shutdown_connections 2024-02-15T18:24:45.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.617+0000 7ff2aca88700 1 --2- 172.21.15.33:0/2207694581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2a80f9700 0x7ff2a80fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:24:45.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.617+0000 7ff2aca88700 1 --2- 172.21.15.33:0/2207694581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 0x7ff2a80f9180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:45.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.617+0000 7ff2aca88700 1 -- 172.21.15.33:0/2207694581 >> 172.21.15.33:0/2207694581 conn(0x7ff2a80f0ba0 msgr2=0x7ff2a80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:24:45.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.617+0000 7ff2aca88700 1 -- 172.21.15.33:0/2207694581 shutdown_connections 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.617+0000 7ff2aca88700 1 -- 172.21.15.33:0/2207694581 wait complete. 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2aca88700 1 Processor -- start 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2aca88700 1 -- start start 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2aca88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 0x7ff2a80f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2aca88700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2a80f9700 0x7ff2a80f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2aca88700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80f5670 con 0x7ff2a80602b0 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2aca88700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80f57b0 con 0x7ff2a80f9700 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2a77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 0x7ff2a80f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2a77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 0x7ff2a80f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47756/0 (socket says 172.21.15.33:47756) 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2a77fe700 1 -- 172.21.15.33:0/2099547291 learned_addr learned my addr 172.21.15.33:0/2099547291 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2a6ffd700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2a80f9700 0x7ff2a80f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2a77fe700 1 -- 172.21.15.33:0/2099547291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2a80f9700 msgr2=0x7ff2a80f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2a77fe700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2a80f9700 0x7ff2a80f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:24:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.618+0000 7ff2a77fe700 1 -- 172.21.15.33:0/2099547291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290005040 con 0x7ff2a80602b0 2024-02-15T18:24:45.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.619+0000 7ff2a77fe700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 0x7ff2a80f6c00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff290009830 tx=0x7ff290009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:45.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.619+0000 7ff29ffff700 1 -- 172.21.15.33:0/2099547291 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff290018070 con 0x7ff2a80602b0 2024-02-15T18:24:45.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.619+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a80f5a30 con 0x7ff2a80602b0 2024-02-15T18:24:45.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.619+0000 7ff29ffff700 1 -- 172.21.15.33:0/2099547291 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff290007c70 con 0x7ff2a80602b0 2024-02-15T18:24:45.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.619+0000 7ff29ffff700 1 -- 172.21.15.33:0/2099547291 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff29001c620 con 0x7ff2a80602b0 2024-02-15T18:24:45.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.619+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a810eec0 con 0x7ff2a80602b0 2024-02-15T18:24:45.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.620+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a8045ad0 con 0x7ff2a80602b0 2024-02-15T18:24:45.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.620+0000 7ff29ffff700 1 -- 172.21.15.33:0/2099547291 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff29001c8e0 con 0x7ff2a80602b0 2024-02-15T18:24:45.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.621+0000 7ff29ffff700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff29405c300 0x7ff29405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:24:45.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.621+0000 7ff29ffff700 1 -- 172.21.15.33:0/2099547291 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1270+0+0 (secure 0 0 0) 0x7ff290076cd0 con 0x7ff2a80602b0 2024-02-15T18:24:45.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.621+0000 7ff2a6ffd700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff29405c300 0x7ff29405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:24:45.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.621+0000 7ff2a6ffd700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff29405c300 0x7ff29405e7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff298006fd0 tx=0x7ff298008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:24:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.626+0000 7ff29ffff700 1 -- 172.21.15.33:0/2099547291 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff29004a9a0 con 0x7ff2a80602b0 2024-02-15T18:24:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:24:45.820+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2a80fef20 con 0x7ff29405c300 2024-02-15T18:24:46.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:44.519488+0000 mgr.smithi033.apxevf (mgr.14162) 65 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:46.255 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:44.940331+0000 mon.smithi033 (mon.0) 187 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:46.255 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:44.941230+0000 mon.smithi033 (mon.0) 188 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:46.255 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:45.823579+0000 mon.smithi033 (mon.0) 189 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:24:46.255 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:45.825065+0000 mon.smithi033 (mon.0) 190 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:24:46.255 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:45.825576+0000 mon.smithi033 (mon.0) 191 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:46.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:44.519488+0000 mgr.smithi033.apxevf (mgr.14162) 65 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:46.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:44.940331+0000 mon.smithi033 (mon.0) 187 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:46.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:44.941230+0000 mon.smithi033 (mon.0) 188 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:24:46.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:45.823579+0000 mon.smithi033 (mon.0) 189 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:24:46.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:45.825065+0000 mon.smithi033 (mon.0) 190 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:24:46.305 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:45.825576+0000 mon.smithi033 (mon.0) 191 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:47.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:45.822815+0000 mgr.smithi033.apxevf (mgr.14162) 66 : audit [DBG] from='client.14218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:47.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:45.824825+0000 mgr.smithi033.apxevf (mgr.14162) 67 : cephadm [INF] Applying service osd.None on host smithi033... 2024-02-15T18:24:47.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:46.887703+0000 mon.smithi033 (mon.0) 192 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:47.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:45.822815+0000 mgr.smithi033.apxevf (mgr.14162) 66 : audit [DBG] from='client.14218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:24:47.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:24:45.824825+0000 mgr.smithi033.apxevf (mgr.14162) 67 : cephadm [INF] Applying service osd.None on host smithi033... 2024-02-15T18:24:47.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:46.887703+0000 mon.smithi033 (mon.0) 192 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:48.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:46.519765+0000 mgr.smithi033.apxevf (mgr.14162) 68 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:48.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:46.519765+0000 mgr.smithi033.apxevf (mgr.14162) 68 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:49.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:48.563231+0000 mon.smithi033 (mon.0) 193 : audit [INF] from='client.? 172.21.15.33:0/2728805279' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff15bf7-6db5-4333-82b6-b609dccf7266"}]: dispatch 2024-02-15T18:24:49.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:48.566963+0000 mon.smithi033 (mon.0) 194 : audit [INF] from='client.? 172.21.15.33:0/2728805279' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ff15bf7-6db5-4333-82b6-b609dccf7266"}]': finished 2024-02-15T18:24:49.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:48.567008+0000 mon.smithi033 (mon.0) 195 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-15T18:24:49.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:48.567089+0000 mon.smithi033 (mon.0) 196 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:24:49.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:49.027731+0000 mon.smithi033 (mon.0) 197 : audit [DBG] from='client.? 172.21.15.33:0/3275711716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:24:49.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:48.563231+0000 mon.smithi033 (mon.0) 193 : audit [INF] from='client.? 172.21.15.33:0/2728805279' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff15bf7-6db5-4333-82b6-b609dccf7266"}]: dispatch 2024-02-15T18:24:49.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:48.566963+0000 mon.smithi033 (mon.0) 194 : audit [INF] from='client.? 172.21.15.33:0/2728805279' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ff15bf7-6db5-4333-82b6-b609dccf7266"}]': finished 2024-02-15T18:24:49.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:48.567008+0000 mon.smithi033 (mon.0) 195 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-15T18:24:49.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:48.567089+0000 mon.smithi033 (mon.0) 196 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:24:49.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:49.027731+0000 mon.smithi033 (mon.0) 197 : audit [DBG] from='client.? 172.21.15.33:0/3275711716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:24:50.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:48.519976+0000 mgr.smithi033.apxevf (mgr.14162) 69 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:50.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:48.519976+0000 mgr.smithi033.apxevf (mgr.14162) 69 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:52.504 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:50.520299+0000 mgr.smithi033.apxevf (mgr.14162) 70 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:52.504 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:51.252601+0000 mon.smithi033 (mon.0) 198 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:52.505 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:51.255405+0000 mon.smithi033 (mon.0) 199 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:52.505 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:24:51.257034+0000 mgr.smithi033.apxevf (mgr.14162) 71 : cephadm [INF] Reconfiguring mon.smithi033 (unknown last config time)... 2024-02-15T18:24:52.505 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:51.257271+0000 mon.smithi033 (mon.0) 200 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:24:52.505 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:51.257809+0000 mon.smithi033 (mon.0) 201 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:24:52.505 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:51.258311+0000 mon.smithi033 (mon.0) 202 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:52.505 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:24:51.258737+0000 mgr.smithi033.apxevf (mgr.14162) 72 : cephadm [INF] Reconfiguring daemon mon.smithi033 on smithi033 2024-02-15T18:24:52.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:50.520299+0000 mgr.smithi033.apxevf (mgr.14162) 70 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:52.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:51.252601+0000 mon.smithi033 (mon.0) 198 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:52.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:51.255405+0000 mon.smithi033 (mon.0) 199 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:52.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:51.257034+0000 mgr.smithi033.apxevf (mgr.14162) 71 : cephadm [INF] Reconfiguring mon.smithi033 (unknown last config time)... 2024-02-15T18:24:52.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:51.257271+0000 mon.smithi033 (mon.0) 200 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:24:52.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:51.257809+0000 mon.smithi033 (mon.0) 201 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:24:52.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:51.258311+0000 mon.smithi033 (mon.0) 202 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:52.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:51.258737+0000 mgr.smithi033.apxevf (mgr.14162) 72 : cephadm [INF] Reconfiguring daemon mon.smithi033 on smithi033 2024-02-15T18:24:54.475 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:52.520668+0000 mgr.smithi033.apxevf (mgr.14162) 73 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:54.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:52.520668+0000 mgr.smithi033.apxevf (mgr.14162) 73 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:55.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:54.649999+0000 mon.smithi033 (mon.0) 203 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:24:55.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:54.652727+0000 mon.smithi033 (mon.0) 204 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:24:55.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:54.649999+0000 mon.smithi033 (mon.0) 203 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:24:55.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:54.652727+0000 mon.smithi033 (mon.0) 204 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:24:56.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:54.520906+0000 mgr.smithi033.apxevf (mgr.14162) 74 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:56.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:55.321554+0000 mon.smithi033 (mon.0) 205 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:56.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:55.322350+0000 mon.smithi033 (mon.0) 206 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.apxevf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:24:56.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:55.323055+0000 mon.smithi033 (mon.0) 207 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:24:56.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:55.323640+0000 mon.smithi033 (mon.0) 208 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:56.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:54.520906+0000 mgr.smithi033.apxevf (mgr.14162) 74 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:56.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:55.321554+0000 mon.smithi033 (mon.0) 205 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:56.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:55.322350+0000 mon.smithi033 (mon.0) 206 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.apxevf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:24:56.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:55.323055+0000 mon.smithi033 (mon.0) 207 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:24:56.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:55.323640+0000 mon.smithi033 (mon.0) 208 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:57.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:55.322104+0000 mgr.smithi033.apxevf (mgr.14162) 75 : cephadm [INF] Reconfiguring mgr.smithi033.apxevf (unknown last config time)... 2024-02-15T18:24:57.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:55.324173+0000 mgr.smithi033.apxevf (mgr.14162) 76 : cephadm [INF] Reconfiguring daemon mgr.smithi033.apxevf on smithi033 2024-02-15T18:24:57.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:56.785281+0000 mon.smithi033 (mon.0) 209 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T18:24:57.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:56.786074+0000 mon.smithi033 (mon.0) 210 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:57.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:24:55.322104+0000 mgr.smithi033.apxevf (mgr.14162) 75 : cephadm [INF] Reconfiguring mgr.smithi033.apxevf (unknown last config time)... 2024-02-15T18:24:57.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:24:55.324173+0000 mgr.smithi033.apxevf (mgr.14162) 76 : cephadm [INF] Reconfiguring daemon mgr.smithi033.apxevf on smithi033 2024-02-15T18:24:57.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:56.785281+0000 mon.smithi033 (mon.0) 209 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T18:24:57.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:56.786074+0000 mon.smithi033 (mon.0) 210 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:24:58.421 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:56.521129+0000 mgr.smithi033.apxevf (mgr.14162) 77 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:58.422 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:56.786659+0000 mgr.smithi033.apxevf (mgr.14162) 78 : cephadm [INF] Deploying daemon osd.0 on smithi033 2024-02-15T18:24:58.422 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:24:58.135337+0000 mon.smithi033 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:58.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:56.521129+0000 mgr.smithi033.apxevf (mgr.14162) 77 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:24:58.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:24:56.786659+0000 mgr.smithi033.apxevf (mgr.14162) 78 : cephadm [INF] Deploying daemon osd.0 on smithi033 2024-02-15T18:24:58.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:24:58.135337+0000 mon.smithi033 (mon.0) 211 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:24:59.442 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:58.135914+0000 mgr.smithi033.apxevf (mgr.14162) 79 : cephadm [INF] Reconfiguring alertmanager.smithi033 (dependencies changed)... 2024-02-15T18:24:59.442 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:24:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:24:58.138222+0000 mgr.smithi033.apxevf (mgr.14162) 80 : cephadm [INF] Reconfiguring daemon alertmanager.smithi033 on smithi033 2024-02-15T18:24:59.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:24:58.135914+0000 mgr.smithi033.apxevf (mgr.14162) 79 : cephadm [INF] Reconfiguring alertmanager.smithi033 (dependencies changed)... 2024-02-15T18:24:59.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:24:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:24:58.138222+0000 mgr.smithi033.apxevf (mgr.14162) 80 : cephadm [INF] Reconfiguring daemon alertmanager.smithi033 on smithi033 2024-02-15T18:25:00.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:24:58.521358+0000 mgr.smithi033.apxevf (mgr.14162) 81 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:00.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:24:58.521358+0000 mgr.smithi033.apxevf (mgr.14162) 81 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:01.889 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 0 on host 'smithi033' 2024-02-15T18:25:01.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.889+0000 7ff29ffff700 1 -- 172.21.15.33:0/2099547291 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff2a80fef20 con 0x7ff29405c300 2024-02-15T18:25:01.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.892+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff29405c300 msgr2=0x7ff29405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.892+0000 7ff2aca88700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff29405c300 0x7ff29405e7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff298006fd0 tx=0x7ff298008040).stop 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.892+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 msgr2=0x7ff2a80f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.892+0000 7ff2aca88700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 0x7ff2a80f6c00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff290009830 tx=0x7ff290009b30).stop 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.892+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 shutdown_connections 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.892+0000 7ff2aca88700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff29405c300 0x7ff29405e7c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.892+0000 7ff2aca88700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a80602b0 0x7ff2a80f6c00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.892+0000 7ff2aca88700 1 --2- 172.21.15.33:0/2099547291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2a80f9700 0x7ff2a80f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.892+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 >> 172.21.15.33:0/2099547291 conn(0x7ff2a80f0ba0 msgr2=0x7ff2a80f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.893+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 shutdown_connections 2024-02-15T18:25:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:01.893+0000 7ff2aca88700 1 -- 172.21.15.33:0/2099547291 wait complete. 2024-02-15T18:25:02.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:00.521710+0000 mgr.smithi033.apxevf (mgr.14162) 82 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:02.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:01.885032+0000 mon.smithi033 (mon.0) 212 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:02.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:01.889290+0000 mon.smithi033 (mon.0) 213 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:02.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:00.521710+0000 mgr.smithi033.apxevf (mgr.14162) 82 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:02.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:01.885032+0000 mon.smithi033 (mon.0) 212 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:02.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:01.889290+0000 mon.smithi033 (mon.0) 213 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:04.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:02.521977+0000 mgr.smithi033.apxevf (mgr.14162) 83 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:04.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:02.521977+0000 mgr.smithi033.apxevf (mgr.14162) 83 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:04.887 DEBUG:teuthology.orchestra.run.smithi033:osd.0> sudo journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.0.service 2024-02-15T18:25:04.889 INFO:tasks.cephadm:Deploying osd.1 on smithi033 with /dev/vg_nvme/lv_3... 2024-02-15T18:25:04.890 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-15T18:25:04.925 INFO:journalctl@ceph.osd.0.smithi033.stdout:-- Logs begin at Thu 2024-02-15 18:09:56 UTC. -- 2024-02-15T18:25:06.054 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:25:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.0[48194]: debug 2024-02-15T18:25:05.764+0000 7fc0f6573080 -1 osd.0 0 log_to_monitors {default=true} 2024-02-15T18:25:06.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:04.522334+0000 mgr.smithi033.apxevf (mgr.14162) 84 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:06.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:05.768406+0000 mon.smithi033 (mon.0) 214 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T18:25:06.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:04.522334+0000 mgr.smithi033.apxevf (mgr.14162) 84 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:06.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:05.768406+0000 mon.smithi033 (mon.0) 214 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T18:25:07.393 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:25:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.0[48194]: debug 2024-02-15T18:25:07.299+0000 7fc0ecae4700 -1 osd.0 0 waiting for initial osdmap 2024-02-15T18:25:07.393 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:25:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.0[48194]: debug 2024-02-15T18:25:07.306+0000 7fc0e7a5d700 -1 osd.0 8 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-15T18:25:07.394 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:06.294781+0000 mon.smithi033 (mon.0) 215 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T18:25:07.394 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:06.294828+0000 mon.smithi033 (mon.0) 216 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-15T18:25:07.394 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:06.295112+0000 mon.smithi033 (mon.0) 217 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:07.394 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:06.295412+0000 mon.smithi033 (mon.0) 218 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:25:07.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:06.294781+0000 mon.smithi033 (mon.0) 215 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T18:25:07.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:06.294828+0000 mon.smithi033 (mon.0) 216 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-15T18:25:07.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:06.295112+0000 mon.smithi033 (mon.0) 217 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:07.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:06.295412+0000 mon.smithi033 (mon.0) 218 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:25:08.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:06.522669+0000 mgr.smithi033.apxevf (mgr.14162) 85 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:08.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:07.296696+0000 mon.smithi033 (mon.0) 219 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T18:25:08.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:07.296788+0000 mon.smithi033 (mon.0) 220 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-02-15T18:25:08.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:07.296920+0000 mon.smithi033 (mon.0) 221 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:08.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:07.300844+0000 mon.smithi033 (mon.0) 222 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:08.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:08.300450+0000 mon.smithi033 (mon.0) 223 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:08.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:06.522669+0000 mgr.smithi033.apxevf (mgr.14162) 85 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:08.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:07.296696+0000 mon.smithi033 (mon.0) 219 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T18:25:08.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:07.296788+0000 mon.smithi033 (mon.0) 220 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-02-15T18:25:08.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:07.296920+0000 mon.smithi033 (mon.0) 221 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:08.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:07.300844+0000 mon.smithi033 (mon.0) 222 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:08.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:08.300450+0000 mon.smithi033 (mon.0) 223 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:08.820 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-15T18:25:08.820 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-15T18:25:08.821 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-02-15T18:25:08.821 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-02-15T18:25:08.821 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113087 s, 927 MB/s 2024-02-15T18:25:08.821 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-02-15T18:25:09.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:06.811909+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:25:09.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:06.812054+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:25:09.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:08.305380+0000 mon.smithi033 (mon.0) 224 : cluster [INF] osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] boot 2024-02-15T18:25:09.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:08.305422+0000 mon.smithi033 (mon.0) 225 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-15T18:25:09.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:08.306053+0000 mon.smithi033 (mon.0) 226 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:09.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:08.330048+0000 mon.smithi033 (mon.0) 227 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:09.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:08.330516+0000 mgr.smithi033.apxevf (mgr.14162) 86 : cephadm [INF] Reconfiguring crash.smithi033 (monmap changed)... 2024-02-15T18:25:09.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:08.330751+0000 mon.smithi033 (mon.0) 228 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:25:09.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:08.331427+0000 mon.smithi033 (mon.0) 229 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:09.555 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:08.332175+0000 mgr.smithi033.apxevf (mgr.14162) 87 : cephadm [INF] Reconfiguring daemon crash.smithi033 on smithi033 2024-02-15T18:25:09.556 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:08.522972+0000 mgr.smithi033.apxevf (mgr.14162) 88 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:09.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:06.811909+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:25:09.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:06.812054+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:25:09.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:08.305380+0000 mon.smithi033 (mon.0) 224 : cluster [INF] osd.0 [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] boot 2024-02-15T18:25:09.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:08.305422+0000 mon.smithi033 (mon.0) 225 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-15T18:25:09.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:08.306053+0000 mon.smithi033 (mon.0) 226 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:25:09.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:08.330048+0000 mon.smithi033 (mon.0) 227 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:09.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:08.330516+0000 mgr.smithi033.apxevf (mgr.14162) 86 : cephadm [INF] Reconfiguring crash.smithi033 (monmap changed)... 2024-02-15T18:25:09.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:08.330751+0000 mon.smithi033 (mon.0) 228 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:25:09.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:08.331427+0000 mon.smithi033 (mon.0) 229 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:09.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:08.332175+0000 mgr.smithi033.apxevf (mgr.14162) 87 : cephadm [INF] Reconfiguring daemon crash.smithi033 on smithi033 2024-02-15T18:25:09.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:08.522972+0000 mgr.smithi033.apxevf (mgr.14162) 88 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-15T18:25:10.014 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi033:vg_nvme/lv_3 2024-02-15T18:25:10.707 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:09.333069+0000 mon.smithi033 (mon.0) 230 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-15T18:25:10.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:09.333069+0000 mon.smithi033 (mon.0) 230 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-15T18:25:11.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:10.494496+0000 mon.smithi033 (mon.0) 231 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:11.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:10.495157+0000 mgr.smithi033.apxevf (mgr.14162) 89 : cephadm [INF] Reconfiguring grafana.smithi033 (dependencies changed)... 2024-02-15T18:25:11.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:10.499566+0000 mgr.smithi033.apxevf (mgr.14162) 90 : cephadm [INF] Reconfiguring daemon grafana.smithi033 on smithi033 2024-02-15T18:25:11.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:10.523218+0000 mgr.smithi033.apxevf (mgr.14162) 91 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:11.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:10.494496+0000 mon.smithi033 (mon.0) 231 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:11.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:10.495157+0000 mgr.smithi033.apxevf (mgr.14162) 89 : cephadm [INF] Reconfiguring grafana.smithi033 (dependencies changed)... 2024-02-15T18:25:11.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:10.499566+0000 mgr.smithi033.apxevf (mgr.14162) 90 : cephadm [INF] Reconfiguring daemon grafana.smithi033 on smithi033 2024-02-15T18:25:11.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:10.523218+0000 mgr.smithi033.apxevf (mgr.14162) 91 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:14.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:12.523549+0000 mgr.smithi033.apxevf (mgr.14162) 92 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:14.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:12.523549+0000 mgr.smithi033.apxevf (mgr.14162) 92 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:15.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:14.316866+0000 mon.smithi033 (mon.0) 232 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:25:15.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:14.318116+0000 mon.smithi033 (mon.0) 233 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:25:15.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:14.318687+0000 mon.smithi033 (mon.0) 234 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.113+0000 7f3a3dba7700 1 -- 172.21.15.33:0/780327060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 msgr2=0x7f3a380f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.113+0000 7f3a3dba7700 1 --2- 172.21.15.33:0/780327060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 0x7f3a380f6cc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3a20004660 tx=0x7f3a20009b30).stop 2024-02-15T18:25:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.113+0000 7f3a3dba7700 1 -- 172.21.15.33:0/780327060 shutdown_connections 2024-02-15T18:25:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.113+0000 7f3a3dba7700 1 --2- 172.21.15.33:0/780327060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 0x7f3a380f6cc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.113+0000 7f3a3dba7700 1 --2- 172.21.15.33:0/780327060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380f55c0 0x7f3a380f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:25:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.113+0000 7f3a3dba7700 1 -- 172.21.15.33:0/780327060 >> 172.21.15.33:0/780327060 conn(0x7f3a380f0d40 msgr2=0x7f3a380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.113+0000 7f3a3dba7700 1 -- 172.21.15.33:0/780327060 shutdown_connections 2024-02-15T18:25:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.113+0000 7f3a3dba7700 1 -- 172.21.15.33:0/780327060 wait complete. 2024-02-15T18:25:15.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.113+0000 7f3a3dba7700 1 Processor -- start 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a3dba7700 1 -- start start 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a3dba7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380f55c0 0x7f3a38107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a3dba7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 0x7f3a38107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a3dba7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38107ba0 con 0x7f3a380f6860 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a3dba7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38108450 con 0x7f3a380f55c0 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a36ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 0x7f3a38107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a36ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 0x7f3a38107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46424/0 (socket says 172.21.15.33:46424) 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a36ffd700 1 -- 172.21.15.33:0/3888612749 learned_addr learned my addr 172.21.15.33:0/3888612749 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a36ffd700 1 -- 172.21.15.33:0/3888612749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380f55c0 msgr2=0x7f3a38107070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a377fe700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380f55c0 0x7f3a38107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a36ffd700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380f55c0 0x7f3a38107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a36ffd700 1 -- 172.21.15.33:0/3888612749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20005040 con 0x7f3a380f6860 2024-02-15T18:25:15.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a36ffd700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 0x7f3a38107560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3a20009830 tx=0x7f3a20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.114+0000 7f3a2ffff700 1 -- 172.21.15.33:0/3888612749 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a20018070 con 0x7f3a380f6860 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.115+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a381086d0 con 0x7f3a380f6860 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.115+0000 7f3a2ffff700 1 -- 172.21.15.33:0/3888612749 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a20007d70 con 0x7f3a380f6860 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.115+0000 7f3a2ffff700 1 -- 172.21.15.33:0/3888612749 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a2001c620 con 0x7f3a380f6860 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.115+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a38108c30 con 0x7f3a380f6860 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.116+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a380f49b0 con 0x7f3a380f6860 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.116+0000 7f3a2ffff700 1 -- 172.21.15.33:0/3888612749 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3a2001d980 con 0x7f3a380f6860 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.116+0000 7f3a2ffff700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3a2405c2b0 0x7f3a2405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.116+0000 7f3a2ffff700 1 -- 172.21.15.33:0/3888612749 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1882+0+0 (secure 0 0 0) 0x7f3a20077000 con 0x7f3a380f6860 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.116+0000 7f3a377fe700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3a2405c2b0 0x7f3a2405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.117+0000 7f3a377fe700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3a2405c2b0 0x7f3a2405e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3a380f66c0 tx=0x7f3a28008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.120+0000 7f3a2ffff700 1 -- 172.21.15.33:0/3888612749 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f3a2004aa10 con 0x7f3a380f6860 2024-02-15T18:25:15.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:14.314+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a3805fd30 con 0x7f3a2405c2b0 2024-02-15T18:25:15.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:14.316866+0000 mon.smithi033 (mon.0) 232 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:25:15.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:14.318116+0000 mon.smithi033 (mon.0) 233 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:25:15.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:14.318687+0000 mon.smithi033 (mon.0) 234 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:16.530 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:14.316153+0000 mgr.smithi033.apxevf (mgr.14162) 93 : audit [DBG] from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:16.530 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:14.317925+0000 mgr.smithi033.apxevf (mgr.14162) 94 : cephadm [INF] Applying service osd.None on host smithi033... 2024-02-15T18:25:16.530 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:14.523879+0000 mgr.smithi033.apxevf (mgr.14162) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:16.530 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:15.996882+0000 mon.smithi033 (mon.0) 235 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:16.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:14.316153+0000 mgr.smithi033.apxevf (mgr.14162) 93 : audit [DBG] from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:16.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:14.317925+0000 mgr.smithi033.apxevf (mgr.14162) 94 : cephadm [INF] Applying service osd.None on host smithi033... 2024-02-15T18:25:16.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:14.523879+0000 mgr.smithi033.apxevf (mgr.14162) 95 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:16.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:15.996882+0000 mon.smithi033 (mon.0) 235 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:17.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:15.997523+0000 mgr.smithi033.apxevf (mgr.14162) 96 : cephadm [INF] Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T18:25:17.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:15.999574+0000 mgr.smithi033.apxevf (mgr.14162) 97 : cephadm [INF] Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T18:25:17.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:15.997523+0000 mgr.smithi033.apxevf (mgr.14162) 96 : cephadm [INF] Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T18:25:17.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:15.999574+0000 mgr.smithi033.apxevf (mgr.14162) 97 : cephadm [INF] Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T18:25:18.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:16.524254+0000 mgr.smithi033.apxevf (mgr.14162) 98 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:18.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:17.924306+0000 mon.smithi033 (mon.0) 236 : audit [INF] from='client.? 172.21.15.33:0/743435838' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b795f15-d524-44fd-8dca-d5b4653dafbc"}]: dispatch 2024-02-15T18:25:18.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:17.928033+0000 mon.smithi033 (mon.0) 237 : audit [INF] from='client.? 172.21.15.33:0/743435838' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b795f15-d524-44fd-8dca-d5b4653dafbc"}]': finished 2024-02-15T18:25:18.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:17.928076+0000 mon.smithi033 (mon.0) 238 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-15T18:25:18.554 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:17.928160+0000 mon.smithi033 (mon.0) 239 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:18.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:16.524254+0000 mgr.smithi033.apxevf (mgr.14162) 98 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:18.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:17.924306+0000 mon.smithi033 (mon.0) 236 : audit [INF] from='client.? 172.21.15.33:0/743435838' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b795f15-d524-44fd-8dca-d5b4653dafbc"}]: dispatch 2024-02-15T18:25:18.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:17.928033+0000 mon.smithi033 (mon.0) 237 : audit [INF] from='client.? 172.21.15.33:0/743435838' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b795f15-d524-44fd-8dca-d5b4653dafbc"}]': finished 2024-02-15T18:25:18.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:17.928076+0000 mon.smithi033 (mon.0) 238 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-15T18:25:18.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:17.928160+0000 mon.smithi033 (mon.0) 239 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:19.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:18.366805+0000 mon.smithi033 (mon.0) 240 : audit [DBG] from='client.? 172.21.15.33:0/1026437000' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:25:19.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:18.366805+0000 mon.smithi033 (mon.0) 240 : audit [DBG] from='client.? 172.21.15.33:0/1026437000' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:25:20.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:18.524569+0000 mgr.smithi033.apxevf (mgr.14162) 99 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:20.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:18.524569+0000 mgr.smithi033.apxevf (mgr.14162) 99 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:22.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:20.524815+0000 mgr.smithi033.apxevf (mgr.14162) 100 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:22.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:20.524815+0000 mgr.smithi033.apxevf (mgr.14162) 100 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:24.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:22.525040+0000 mgr.smithi033.apxevf (mgr.14162) 101 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:24.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:22.525040+0000 mgr.smithi033.apxevf (mgr.14162) 101 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:26.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:24.525437+0000 mgr.smithi033.apxevf (mgr.14162) 102 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:26.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:24.525437+0000 mgr.smithi033.apxevf (mgr.14162) 102 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:27.728 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:26.525789+0000 mgr.smithi033.apxevf (mgr.14162) 103 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:27.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:26.525789+0000 mgr.smithi033.apxevf (mgr.14162) 103 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:29.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:28.402509+0000 mon.smithi033 (mon.0) 241 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:29.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:28.403097+0000 mgr.smithi033.apxevf (mgr.14162) 104 : cephadm [INF] Reconfiguring crash.smithi131 (monmap changed)... 2024-02-15T18:25:29.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:28.403370+0000 mon.smithi033 (mon.0) 242 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:25:29.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:28.404096+0000 mon.smithi033 (mon.0) 243 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:29.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:28.404596+0000 mgr.smithi033.apxevf (mgr.14162) 105 : cephadm [INF] Reconfiguring daemon crash.smithi131 on smithi131 2024-02-15T18:25:29.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:28.526046+0000 mgr.smithi033.apxevf (mgr.14162) 106 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:29.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:28.402509+0000 mon.smithi033 (mon.0) 241 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:29.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:28.403097+0000 mgr.smithi033.apxevf (mgr.14162) 104 : cephadm [INF] Reconfiguring crash.smithi131 (monmap changed)... 2024-02-15T18:25:29.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:28.403370+0000 mon.smithi033 (mon.0) 242 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:25:29.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:28.404096+0000 mon.smithi033 (mon.0) 243 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:29.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:28.404596+0000 mgr.smithi033.apxevf (mgr.14162) 105 : cephadm [INF] Reconfiguring daemon crash.smithi131 on smithi131 2024-02-15T18:25:29.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:28.526046+0000 mgr.smithi033.apxevf (mgr.14162) 106 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:31.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:29.806122+0000 mon.smithi033 (mon.0) 244 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:31.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:29.806687+0000 mgr.smithi033.apxevf (mgr.14162) 107 : cephadm [INF] Reconfiguring mgr.smithi131.buibla (monmap changed)... 2024-02-15T18:25:31.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:29.806993+0000 mon.smithi033 (mon.0) 245 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.buibla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:25:31.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:29.807800+0000 mon.smithi033 (mon.0) 246 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:25:31.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:29.808494+0000 mon.smithi033 (mon.0) 247 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:31.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:29.809088+0000 mgr.smithi033.apxevf (mgr.14162) 108 : cephadm [INF] Reconfiguring daemon mgr.smithi131.buibla on smithi131 2024-02-15T18:25:31.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:29.902051+0000 mon.smithi033 (mon.0) 248 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T18:25:31.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:29.902830+0000 mon.smithi033 (mon.0) 249 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:31.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:29.903425+0000 mgr.smithi033.apxevf (mgr.14162) 109 : cephadm [INF] Deploying daemon osd.1 on smithi033 2024-02-15T18:25:31.099 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:29.806122+0000 mon.smithi033 (mon.0) 244 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:31.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:29.806687+0000 mgr.smithi033.apxevf (mgr.14162) 107 : cephadm [INF] Reconfiguring mgr.smithi131.buibla (monmap changed)... 2024-02-15T18:25:31.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:29.806993+0000 mon.smithi033 (mon.0) 245 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.buibla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:25:31.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:29.807800+0000 mon.smithi033 (mon.0) 246 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:25:31.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:29.808494+0000 mon.smithi033 (mon.0) 247 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:31.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:29.809088+0000 mgr.smithi033.apxevf (mgr.14162) 108 : cephadm [INF] Reconfiguring daemon mgr.smithi131.buibla on smithi131 2024-02-15T18:25:31.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:29.902051+0000 mon.smithi033 (mon.0) 248 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T18:25:31.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:29.902830+0000 mon.smithi033 (mon.0) 249 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:31.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:29.903425+0000 mgr.smithi033.apxevf (mgr.14162) 109 : cephadm [INF] Deploying daemon osd.1 on smithi033 2024-02-15T18:25:32.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:30.526302+0000 mgr.smithi033.apxevf (mgr.14162) 110 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:32.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:31.142775+0000 mon.smithi033 (mon.0) 250 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:32.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:31.143267+0000 mgr.smithi033.apxevf (mgr.14162) 111 : cephadm [INF] Reconfiguring mon.smithi131 (monmap changed)... 2024-02-15T18:25:32.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:31.143519+0000 mon.smithi033 (mon.0) 251 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:25:32.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:31.144194+0000 mon.smithi033 (mon.0) 252 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:25:32.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:31.144836+0000 mon.smithi033 (mon.0) 253 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:32.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:31.145381+0000 mgr.smithi033.apxevf (mgr.14162) 112 : cephadm [INF] Reconfiguring daemon mon.smithi131 on smithi131 2024-02-15T18:25:32.465 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:30.526302+0000 mgr.smithi033.apxevf (mgr.14162) 110 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:32.465 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:31.142775+0000 mon.smithi033 (mon.0) 250 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:32.465 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:31.143267+0000 mgr.smithi033.apxevf (mgr.14162) 111 : cephadm [INF] Reconfiguring mon.smithi131 (monmap changed)... 2024-02-15T18:25:32.465 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:31.143519+0000 mon.smithi033 (mon.0) 251 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:25:32.465 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:31.144194+0000 mon.smithi033 (mon.0) 252 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:25:32.465 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:31.144836+0000 mon.smithi033 (mon.0) 253 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:32.465 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:31.145381+0000 mgr.smithi033.apxevf (mgr.14162) 112 : cephadm [INF] Reconfiguring daemon mon.smithi131 on smithi131 2024-02-15T18:25:33.726 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 1 on host 'smithi033' 2024-02-15T18:25:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.726+0000 7f3a2ffff700 1 -- 172.21.15.33:0/3888612749 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3a3805fd30 con 0x7f3a2405c2b0 2024-02-15T18:25:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3a2405c2b0 msgr2=0x7f3a2405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3a2405c2b0 0x7f3a2405e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3a380f66c0 tx=0x7f3a28008040).stop 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 msgr2=0x7f3a38107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 0x7f3a38107560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3a20009830 tx=0x7f3a20009b30).stop 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 shutdown_connections 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3a2405c2b0 0x7f3a2405e770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a380f55c0 0x7f3a38107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 --2- 172.21.15.33:0/3888612749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a380f6860 0x7f3a38107560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 >> 172.21.15.33:0/3888612749 conn(0x7f3a380f0d40 msgr2=0x7f3a3805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 shutdown_connections 2024-02-15T18:25:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:33.729+0000 7f3a3dba7700 1 -- 172.21.15.33:0/3888612749 wait complete. 2024-02-15T18:25:33.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:32.509045+0000 mon.smithi033 (mon.0) 254 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:33.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:32.511372+0000 mon.smithi033 (mon.0) 255 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:25:33.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:32.511740+0000 mgr.smithi033.apxevf (mgr.14162) 113 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:25:33.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:32.526519+0000 mgr.smithi033.apxevf (mgr.14162) 114 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:34.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:32.509045+0000 mon.smithi033 (mon.0) 254 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:34.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:32.511372+0000 mon.smithi033 (mon.0) 255 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:25:34.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:32.511740+0000 mgr.smithi033.apxevf (mgr.14162) 113 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:25:34.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:32.526519+0000 mgr.smithi033.apxevf (mgr.14162) 114 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:34.480 DEBUG:teuthology.orchestra.run.smithi033:osd.1> sudo journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.1.service 2024-02-15T18:25:34.483 INFO:tasks.cephadm:Deploying osd.2 on smithi033 with /dev/vg_nvme/lv_2... 2024-02-15T18:25:34.483 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-15T18:25:34.518 INFO:journalctl@ceph.osd.1.smithi033.stdout:-- Logs begin at Thu 2024-02-15 18:09:56 UTC. -- 2024-02-15T18:25:35.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.723872+0000 mon.smithi033 (mon.0) 256 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.727693+0000 mon.smithi033 (mon.0) 257 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.741945+0000 mon.smithi033 (mon.0) 258 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.742259+0000 mgr.smithi033.apxevf (mgr.14162) 115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.745967+0000 mon.smithi033 (mon.0) 259 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.748927+0000 mon.smithi033 (mon.0) 260 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.749230+0000 mgr.smithi033.apxevf (mgr.14162) 116 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.755598+0000 mon.smithi033 (mon.0) 261 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.33:3000"}]: dispatch 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.755914+0000 mgr.smithi033.apxevf (mgr.14162) 117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.33:3000"}]: dispatch 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.759892+0000 mon.smithi033 (mon.0) 262 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.763217+0000 mon.smithi033 (mon.0) 263 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.763547+0000 mgr.smithi033.apxevf (mgr.14162) 118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:25:35.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.767406+0000 mon.smithi033 (mon.0) 264 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.33:9095"}]: dispatch 2024-02-15T18:25:35.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.767693+0000 mgr.smithi033.apxevf (mgr.14162) 119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.33:9095"}]: dispatch 2024-02-15T18:25:35.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.771387+0000 mon.smithi033 (mon.0) 265 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:33.773459+0000 mon.smithi033 (mon.0) 266 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.723872+0000 mon.smithi033 (mon.0) 256 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.727693+0000 mon.smithi033 (mon.0) 257 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.741945+0000 mon.smithi033 (mon.0) 258 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.742259+0000 mgr.smithi033.apxevf (mgr.14162) 115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.745967+0000 mon.smithi033 (mon.0) 259 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.748927+0000 mon.smithi033 (mon.0) 260 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.749230+0000 mgr.smithi033.apxevf (mgr.14162) 116 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.755598+0000 mon.smithi033 (mon.0) 261 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.33:3000"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.755914+0000 mgr.smithi033.apxevf (mgr.14162) 117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.33:3000"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.759892+0000 mon.smithi033 (mon.0) 262 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.763217+0000 mon.smithi033 (mon.0) 263 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.763547+0000 mgr.smithi033.apxevf (mgr.14162) 118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.767406+0000 mon.smithi033 (mon.0) 264 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.33:9095"}]: dispatch 2024-02-15T18:25:35.054 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.767693+0000 mgr.smithi033.apxevf (mgr.14162) 119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.33:9095"}]: dispatch 2024-02-15T18:25:35.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.771387+0000 mon.smithi033 (mon.0) 265 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:35.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:33.773459+0000 mon.smithi033 (mon.0) 266 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:36.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:34.526814+0000 mgr.smithi033.apxevf (mgr.14162) 120 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:36.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:35.662462+0000 mon.smithi033 (mon.0) 267 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:36.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:34.526814+0000 mgr.smithi033.apxevf (mgr.14162) 120 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:36.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:35.662462+0000 mon.smithi033 (mon.0) 267 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:37.563 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-15T18:25:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-15T18:25:37.564 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-02-15T18:25:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-02-15T18:25:37.564 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126584 s, 828 MB/s 2024-02-15T18:25:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-02-15T18:25:38.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:36.527069+0000 mgr.smithi033.apxevf (mgr.14162) 121 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:38.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:37.587360+0000 mon.smithi033 (mon.0) 268 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T18:25:38.041 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:25:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.1[52262]: debug 2024-02-15T18:25:37.582+0000 7f1ec92ef080 -1 osd.1 0 log_to_monitors {default=true} 2024-02-15T18:25:38.234 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:36.527069+0000 mgr.smithi033.apxevf (mgr.14162) 121 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:38.234 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:37.587360+0000 mon.smithi033 (mon.0) 268 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T18:25:38.403 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi033:vg_nvme/lv_2 2024-02-15T18:25:38.993 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:25:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.1[52262]: debug 2024-02-15T18:25:38.785+0000 7f1ebf860700 -1 osd.1 0 waiting for initial osdmap 2024-02-15T18:25:38.993 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:25:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.1[52262]: debug 2024-02-15T18:25:38.793+0000 7f1eb8fd6700 -1 osd.1 13 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-15T18:25:38.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:37.781329+0000 mon.smithi033 (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T18:25:38.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:37.781400+0000 mon.smithi033 (mon.0) 270 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-15T18:25:38.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:37.781742+0000 mon.smithi033 (mon.0) 271 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:38.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:37.781970+0000 mon.smithi033 (mon.0) 272 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:25:39.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:37.781329+0000 mon.smithi033 (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T18:25:39.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:37.781400+0000 mon.smithi033 (mon.0) 270 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-15T18:25:39.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:37.781742+0000 mon.smithi033 (mon.0) 271 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:39.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:37.781970+0000 mon.smithi033 (mon.0) 272 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:25:40.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:38.527328+0000 mgr.smithi033.apxevf (mgr.14162) 122 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:40.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:38.784296+0000 mon.smithi033 (mon.0) 273 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T18:25:40.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:38.784379+0000 mon.smithi033 (mon.0) 274 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-02-15T18:25:40.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:38.784831+0000 mon.smithi033 (mon.0) 275 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:40.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:38.789928+0000 mon.smithi033 (mon.0) 276 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:40.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:38.527328+0000 mgr.smithi033.apxevf (mgr.14162) 122 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:40.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:38.784296+0000 mon.smithi033 (mon.0) 273 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T18:25:40.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:38.784379+0000 mon.smithi033 (mon.0) 274 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-02-15T18:25:40.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:38.784831+0000 mon.smithi033 (mon.0) 275 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:40.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:38.789928+0000 mon.smithi033 (mon.0) 276 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:40.949 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:38.581753+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:25:40.950 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:38.581853+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:25:40.950 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:39.787933+0000 mon.smithi033 (mon.0) 277 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:40.950 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:39.791267+0000 mon.smithi033 (mon.0) 278 : cluster [INF] osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] boot 2024-02-15T18:25:40.950 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:39.791298+0000 mon.smithi033 (mon.0) 279 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-15T18:25:40.950 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:39.791750+0000 mon.smithi033 (mon.0) 280 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:41.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:38.581753+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:25:41.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:38.581853+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:25:41.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:39.787933+0000 mon.smithi033 (mon.0) 277 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:41.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:39.791267+0000 mon.smithi033 (mon.0) 278 : cluster [INF] osd.1 [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] boot 2024-02-15T18:25:41.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:39.791298+0000 mon.smithi033 (mon.0) 279 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-15T18:25:41.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:39.791750+0000 mon.smithi033 (mon.0) 280 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.261+0000 7f86f0d7c700 1 -- 172.21.15.33:0/1427049756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 msgr2=0x7f86ec0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.261+0000 7f86f0d7c700 1 --2- 172.21.15.33:0/1427049756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 0x7f86ec0f6b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f86e0004660 tx=0x7f86e0009b30).stop 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.261+0000 7f86f0d7c700 1 -- 172.21.15.33:0/1427049756 shutdown_connections 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.261+0000 7f86f0d7c700 1 --2- 172.21.15.33:0/1427049756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 0x7f86ec0f6b30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.261+0000 7f86f0d7c700 1 --2- 172.21.15.33:0/1427049756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0f5430 0x7f86ec0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.261+0000 7f86f0d7c700 1 -- 172.21.15.33:0/1427049756 >> 172.21.15.33:0/1427049756 conn(0x7f86ec0f0b90 msgr2=0x7f86ec0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.261+0000 7f86f0d7c700 1 -- 172.21.15.33:0/1427049756 shutdown_connections 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.261+0000 7f86f0d7c700 1 -- 172.21.15.33:0/1427049756 wait complete. 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.261+0000 7f86f0d7c700 1 Processor -- start 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86f0d7c700 1 -- start start 2024-02-15T18:25:41.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86f0d7c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0f5430 0x7f86ec109b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86f0d7c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 0x7f86ec10c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86f0d7c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec060470 con 0x7f86ec0f66d0 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86f0d7c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0605b0 con 0x7f86ec0f5430 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 0x7f86ec10c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 0x7f86ec10c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56944/0 (socket says 172.21.15.33:56944) 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86eaffd700 1 -- 172.21.15.33:0/2966719243 learned_addr learned my addr 172.21.15.33:0/2966719243 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86eb7fe700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0f5430 0x7f86ec109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86eaffd700 1 -- 172.21.15.33:0/2966719243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0f5430 msgr2=0x7f86ec109b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86eaffd700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0f5430 0x7f86ec109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86eaffd700 1 -- 172.21.15.33:0/2966719243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0005040 con 0x7f86ec0f66d0 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86eaffd700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 0x7f86ec10c050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f86e0009830 tx=0x7f86e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86d3fff700 1 -- 172.21.15.33:0/2966719243 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86e0018070 con 0x7f86ec0f66d0 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec10c650 con 0x7f86ec0f66d0 2024-02-15T18:25:41.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86d3fff700 1 -- 172.21.15.33:0/2966719243 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86e0007d70 con 0x7f86ec0f66d0 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86d3fff700 1 -- 172.21.15.33:0/2966719243 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86e001c620 con 0x7f86ec0f66d0 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.262+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec10cb80 con 0x7f86ec0f66d0 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.263+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec059100 con 0x7f86ec0f66d0 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.264+0000 7f86d3fff700 1 -- 172.21.15.33:0/2966719243 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f86e001d980 con 0x7f86ec0f66d0 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.264+0000 7f86d3fff700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f86d405c300 0x7f86d405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.264+0000 7f86d3fff700 1 -- 172.21.15.33:0/2966719243 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2314+0+0 (secure 0 0 0) 0x7f86e00771b0 con 0x7f86ec0f66d0 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.264+0000 7f86eb7fe700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f86d405c300 0x7f86d405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.265+0000 7f86eb7fe700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f86d405c300 0x7f86d405e7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f86ec060060 tx=0x7f86dc008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.268+0000 7f86d3fff700 1 -- 172.21.15.33:0/2966719243 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f86e004aa10 con 0x7f86ec0f66d0 2024-02-15T18:25:41.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:41.471+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f86ec0008d0 con 0x7f86d405c300 2024-02-15T18:25:42.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:40.527702+0000 mgr.smithi033.apxevf (mgr.14162) 123 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:42.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:40.800268+0000 mon.smithi033 (mon.0) 281 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-02-15T18:25:42.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:41.474757+0000 mon.smithi033 (mon.0) 282 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:25:42.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:41.476105+0000 mon.smithi033 (mon.0) 283 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:25:42.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:41.476682+0000 mon.smithi033 (mon.0) 284 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:42.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:40.527702+0000 mgr.smithi033.apxevf (mgr.14162) 123 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2024-02-15T18:25:42.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:40.800268+0000 mon.smithi033 (mon.0) 281 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-02-15T18:25:42.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:41.474757+0000 mon.smithi033 (mon.0) 282 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:25:42.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:41.476105+0000 mon.smithi033 (mon.0) 283 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:25:42.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:41.476682+0000 mon.smithi033 (mon.0) 284 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:43.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:41.473964+0000 mgr.smithi033.apxevf (mgr.14162) 124 : audit [DBG] from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:43.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:41.475867+0000 mgr.smithi033.apxevf (mgr.14162) 125 : cephadm [INF] Applying service osd.None on host smithi033... 2024-02-15T18:25:43.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:41.473964+0000 mgr.smithi033.apxevf (mgr.14162) 124 : audit [DBG] from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:25:43.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:41.475867+0000 mgr.smithi033.apxevf (mgr.14162) 125 : cephadm [INF] Applying service osd.None on host smithi033... 2024-02-15T18:25:44.379 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:42.527991+0000 mgr.smithi033.apxevf (mgr.14162) 126 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:44.380 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:43.121000+0000 mon.smithi033 (mon.0) 285 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:44.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:42.527991+0000 mgr.smithi033.apxevf (mgr.14162) 126 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:44.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:43.121000+0000 mon.smithi033 (mon.0) 285 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:45.413 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:44.627361+0000 mon.smithi033 (mon.0) 286 : audit [INF] from='client.? 172.21.15.33:0/2161749432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47a30c41-97a6-451b-9941-8e225aff3535"}]: dispatch 2024-02-15T18:25:45.414 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:44.632144+0000 mon.smithi033 (mon.0) 287 : audit [INF] from='client.? 172.21.15.33:0/2161749432' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47a30c41-97a6-451b-9941-8e225aff3535"}]': finished 2024-02-15T18:25:45.414 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:44.632190+0000 mon.smithi033 (mon.0) 288 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-15T18:25:45.414 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:44.632275+0000 mon.smithi033 (mon.0) 289 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:25:45.414 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:45.064898+0000 mon.smithi033 (mon.0) 290 : audit [DBG] from='client.? 172.21.15.33:0/1370237251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:25:45.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:44.627361+0000 mon.smithi033 (mon.0) 286 : audit [INF] from='client.? 172.21.15.33:0/2161749432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47a30c41-97a6-451b-9941-8e225aff3535"}]: dispatch 2024-02-15T18:25:45.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:44.632144+0000 mon.smithi033 (mon.0) 287 : audit [INF] from='client.? 172.21.15.33:0/2161749432' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47a30c41-97a6-451b-9941-8e225aff3535"}]': finished 2024-02-15T18:25:45.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:44.632190+0000 mon.smithi033 (mon.0) 288 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-15T18:25:45.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:44.632275+0000 mon.smithi033 (mon.0) 289 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:25:45.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:45.064898+0000 mon.smithi033 (mon.0) 290 : audit [DBG] from='client.? 172.21.15.33:0/1370237251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:25:46.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:44.528220+0000 mgr.smithi033.apxevf (mgr.14162) 127 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:46.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:44.528220+0000 mgr.smithi033.apxevf (mgr.14162) 127 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:48.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:46.528621+0000 mgr.smithi033.apxevf (mgr.14162) 128 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:48.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:46.528621+0000 mgr.smithi033.apxevf (mgr.14162) 128 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:50.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:48.528909+0000 mgr.smithi033.apxevf (mgr.14162) 129 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:50.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:48.528909+0000 mgr.smithi033.apxevf (mgr.14162) 129 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:52.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:50.529200+0000 mgr.smithi033.apxevf (mgr.14162) 130 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:52.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:51.917229+0000 mon.smithi033 (mon.0) 291 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:52.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:52.262694+0000 mon.smithi033 (mon.0) 292 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:52.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:52.264924+0000 mon.smithi033 (mon.0) 293 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:52.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:50.529200+0000 mgr.smithi033.apxevf (mgr.14162) 130 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:52.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:51.917229+0000 mon.smithi033 (mon.0) 291 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:52.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:52.262694+0000 mon.smithi033 (mon.0) 292 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:52.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:52.264924+0000 mon.smithi033 (mon.0) 293 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:25:53.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:51.912816+0000 mgr.smithi033.apxevf (mgr.14162) 131 : cephadm [INF] Detected new or changed devices on smithi033 2024-02-15T18:25:53.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:53.222786+0000 mon.smithi033 (mon.0) 294 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T18:25:53.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:53.223532+0000 mon.smithi033 (mon.0) 295 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:53.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:51.912816+0000 mgr.smithi033.apxevf (mgr.14162) 131 : cephadm [INF] Detected new or changed devices on smithi033 2024-02-15T18:25:53.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:53.222786+0000 mon.smithi033 (mon.0) 294 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T18:25:53.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:53.223532+0000 mon.smithi033 (mon.0) 295 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:25:54.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:52.529464+0000 mgr.smithi033.apxevf (mgr.14162) 132 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:54.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:25:53.224121+0000 mgr.smithi033.apxevf (mgr.14162) 133 : cephadm [INF] Deploying daemon osd.2 on smithi033 2024-02-15T18:25:54.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:54.251995+0000 mon.smithi033 (mon.0) 296 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:54.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:52.529464+0000 mgr.smithi033.apxevf (mgr.14162) 132 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:54.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:25:53.224121+0000 mgr.smithi033.apxevf (mgr.14162) 133 : cephadm [INF] Deploying daemon osd.2 on smithi033 2024-02-15T18:25:54.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:54.251995+0000 mon.smithi033 (mon.0) 296 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:25:55.387 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:54.651081+0000 mon.smithi033 (mon.0) 297 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:25:55.387 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:54.653533+0000 mon.smithi033 (mon.0) 298 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:25:55.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:54.651081+0000 mon.smithi033 (mon.0) 297 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:25:55.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:54.653533+0000 mon.smithi033 (mon.0) 298 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:25:56.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:54.529806+0000 mgr.smithi033.apxevf (mgr.14162) 134 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:56.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:54.529806+0000 mgr.smithi033.apxevf (mgr.14162) 134 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:58.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:56.530045+0000 mgr.smithi033.apxevf (mgr.14162) 135 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:58.553 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:56.530045+0000 mgr.smithi033.apxevf (mgr.14162) 135 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:25:58.814 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 2 on host 'smithi033' 2024-02-15T18:25:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.816+0000 7f86d3fff700 1 -- 172.21.15.33:0/2966719243 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f86ec0008d0 con 0x7f86d405c300 2024-02-15T18:25:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.818+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f86d405c300 msgr2=0x7f86d405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.818+0000 7f86f0d7c700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f86d405c300 0x7f86d405e7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f86ec060060 tx=0x7f86dc008040).stop 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.818+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 msgr2=0x7f86ec10c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.818+0000 7f86f0d7c700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 0x7f86ec10c050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f86e0009830 tx=0x7f86e0009b30).stop 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.818+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 shutdown_connections 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.818+0000 7f86f0d7c700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f86d405c300 0x7f86d405e7c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.818+0000 7f86f0d7c700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86ec0f5430 0x7f86ec109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.818+0000 7f86f0d7c700 1 --2- 172.21.15.33:0/2966719243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86ec0f66d0 0x7f86ec10c050 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.818+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 >> 172.21.15.33:0/2966719243 conn(0x7f86ec0f0b90 msgr2=0x7f86ec0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.819+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 shutdown_connections 2024-02-15T18:25:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:25:58.819+0000 7f86f0d7c700 1 -- 172.21.15.33:0/2966719243 wait complete. 2024-02-15T18:25:59.794 DEBUG:teuthology.orchestra.run.smithi033:osd.2> sudo journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.2.service 2024-02-15T18:25:59.798 INFO:tasks.cephadm:Deploying osd.3 on smithi131 with /dev/vg_nvme/lv_4... 2024-02-15T18:25:59.798 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-15T18:25:59.833 INFO:journalctl@ceph.osd.2.smithi033.stdout:-- Logs begin at Thu 2024-02-15 18:09:56 UTC. -- 2024-02-15T18:26:00.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:25:58.530349+0000 mgr.smithi033.apxevf (mgr.14162) 136 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:26:00.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:58.811762+0000 mon.smithi033 (mon.0) 299 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:00.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:25:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:25:58.816224+0000 mon.smithi033 (mon.0) 300 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:00.197 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:25:58.530349+0000 mgr.smithi033.apxevf (mgr.14162) 136 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:26:00.197 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:58.811762+0000 mon.smithi033 (mon.0) 299 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:00.197 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:25:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:25:58.816224+0000 mon.smithi033 (mon.0) 300 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:01.908 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-15T18:26:01.908 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-15T18:26:01.908 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2024-02-15T18:26:01.909 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2024-02-15T18:26:01.909 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0148005 s, 708 MB/s 2024-02-15T18:26:01.909 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2024-02-15T18:26:02.200 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:00.530713+0000 mgr.smithi033.apxevf (mgr.14162) 137 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:26:02.201 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:00.999323+0000 mon.smithi033 (mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:02.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:00.530713+0000 mgr.smithi033.apxevf (mgr.14162) 137 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:26:02.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:00.999323+0000 mon.smithi033 (mon.0) 301 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:02.575 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi131:vg_nvme/lv_4 2024-02-15T18:26:02.756 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:26:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.2[56503]: debug 2024-02-15T18:26:02.698+0000 7fdc819d8080 -1 osd.2 0 log_to_monitors {default=true} 2024-02-15T18:26:03.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:02.702419+0000 mon.smithi033 (mon.0) 302 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T18:26:03.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:02.702419+0000 mon.smithi033 (mon.0) 302 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T18:26:04.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:02.530947+0000 mgr.smithi033.apxevf (mgr.14162) 138 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:26:04.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:03.010393+0000 mon.smithi033 (mon.0) 303 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T18:26:04.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:03.010471+0000 mon.smithi033 (mon.0) 304 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-15T18:26:04.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:03.010584+0000 mon.smithi033 (mon.0) 305 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:04.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:03.010915+0000 mon.smithi033 (mon.0) 306 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:26:04.303 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:26:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.2[56503]: debug 2024-02-15T18:26:04.012+0000 7fdc77f49700 -1 osd.2 0 waiting for initial osdmap 2024-02-15T18:26:04.303 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:26:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.2[56503]: debug 2024-02-15T18:26:04.019+0000 7fdc726c1700 -1 osd.2 18 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-15T18:26:04.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:02.530947+0000 mgr.smithi033.apxevf (mgr.14162) 138 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:26:04.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:03.010393+0000 mon.smithi033 (mon.0) 303 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T18:26:04.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:03.010471+0000 mon.smithi033 (mon.0) 304 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-15T18:26:04.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:03.010584+0000 mon.smithi033 (mon.0) 305 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:04.304 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:03.010915+0000 mon.smithi033 (mon.0) 306 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:26:04.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.368+0000 7fe98f4b3700 1 -- 172.21.15.131:0/2158990927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f7980 msgr2=0x7fe9880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:04.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.368+0000 7fe98f4b3700 1 --2- 172.21.15.131:0/2158990927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f7980 0x7fe9880f7de0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fe984004660 tx=0x7fe984009b30).stop 2024-02-15T18:26:04.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.368+0000 7fe98f4b3700 1 -- 172.21.15.131:0/2158990927 shutdown_connections 2024-02-15T18:26:04.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.368+0000 7fe98f4b3700 1 --2- 172.21.15.131:0/2158990927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f7980 0x7fe9880f7de0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.368+0000 7fe98f4b3700 1 --2- 172.21.15.131:0/2158990927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9880f66e0 0x7fe9880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.368+0000 7fe98f4b3700 1 -- 172.21.15.131:0/2158990927 >> 172.21.15.131:0/2158990927 conn(0x7fe9880f1e40 msgr2=0x7fe9880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:04.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.368+0000 7fe98f4b3700 1 -- 172.21.15.131:0/2158990927 shutdown_connections 2024-02-15T18:26:04.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.368+0000 7fe98f4b3700 1 -- 172.21.15.131:0/2158990927 wait complete. 2024-02-15T18:26:04.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98f4b3700 1 Processor -- start 2024-02-15T18:26:04.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98f4b3700 1 -- start start 2024-02-15T18:26:04.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98f4b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f66e0 0x7fe988106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:04.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98f4b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9880f7980 0x7fe9881074d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98f4b3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe988107a80 con 0x7fe9880f7980 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98f4b3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe988107bc0 con 0x7fe9880f66e0 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98d24f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f66e0 0x7fe988106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98d24f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f66e0 0x7fe988106fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39248/0 (socket says 172.21.15.131:39248) 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98d24f700 1 -- 172.21.15.131:0/3651430709 learned_addr learned my addr 172.21.15.131:0/3651430709 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98ca4e700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9880f7980 0x7fe9881074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98d24f700 1 -- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9880f7980 msgr2=0x7fe9881074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98d24f700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9880f7980 0x7fe9881074d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98d24f700 1 -- 172.21.15.131:0/3651430709 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984005040 con 0x7fe9880f66e0 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98d24f700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f66e0 0x7fe988106fe0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fe978002700 tx=0x7fe978009e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe97dffb700 1 -- 172.21.15.131:0/3651430709 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9780079c0 con 0x7fe9880f66e0 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe97dffb700 1 -- 172.21.15.131:0/3651430709 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe97800f040 con 0x7fe9880f66e0 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe97dffb700 1 -- 172.21.15.131:0/3651430709 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe978014910 con 0x7fe9880f66e0 2024-02-15T18:26:04.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.369+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe988108560 con 0x7fe9880f66e0 2024-02-15T18:26:04.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.370+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe988108ad0 con 0x7fe9880f66e0 2024-02-15T18:26:04.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.371+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe988045ad0 con 0x7fe9880f66e0 2024-02-15T18:26:04.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.371+0000 7fe97dffb700 1 -- 172.21.15.131:0/3651430709 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe97801b060 con 0x7fe9880f66e0 2024-02-15T18:26:04.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.371+0000 7fe97dffb700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fe97405c2b0 0x7fe97405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:04.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.371+0000 7fe97dffb700 1 -- 172.21.15.131:0/3651430709 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2466+0+0 (secure 0 0 0) 0x7fe978075230 con 0x7fe9880f66e0 2024-02-15T18:26:04.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.371+0000 7fe98ca4e700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fe97405c2b0 0x7fe97405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:04.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.372+0000 7fe98ca4e700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fe97405c2b0 0x7fe97405e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe984004630 tx=0x7fe984009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:04.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.375+0000 7fe97dffb700 1 -- 172.21.15.131:0/3651430709 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe978048a50 con 0x7fe9880f66e0 2024-02-15T18:26:04.546 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:04.550+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe988108da0 con 0x7fe97405c2b0 2024-02-15T18:26:05.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.009903+0000 mon.smithi033 (mon.0) 307 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T18:26:05.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:04.009976+0000 mon.smithi033 (mon.0) 308 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-02-15T18:26:05.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.010335+0000 mon.smithi033 (mon.0) 309 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:05.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.015676+0000 mon.smithi033 (mon.0) 310 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:05.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.551277+0000 mon.smithi033 (mon.0) 311 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:05.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.551825+0000 mon.smithi033 (mon.0) 312 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:26:05.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.554238+0000 mon.smithi033 (mon.0) 313 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:05.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.554356+0000 mon.smithi033 (mon.0) 314 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:26:05.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.555640+0000 mon.smithi033 (mon.0) 315 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:05.254 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.557489+0000 mon.smithi033 (mon.0) 316 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:05.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.009903+0000 mon.smithi033 (mon.0) 307 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-02-15T18:26:05.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:04.009976+0000 mon.smithi033 (mon.0) 308 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-02-15T18:26:05.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.010335+0000 mon.smithi033 (mon.0) 309 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:05.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.015676+0000 mon.smithi033 (mon.0) 310 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:05.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.551277+0000 mon.smithi033 (mon.0) 311 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:05.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.551825+0000 mon.smithi033 (mon.0) 312 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:26:05.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.554238+0000 mon.smithi033 (mon.0) 313 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:05.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.554356+0000 mon.smithi033 (mon.0) 314 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:26:05.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.555640+0000 mon.smithi033 (mon.0) 315 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:05.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.557489+0000 mon.smithi033 (mon.0) 316 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:06.167 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:03.660690+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:26:06.167 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:03.660795+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:26:06.167 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:04.531217+0000 mgr.smithi033.apxevf (mgr.14162) 139 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:26:06.167 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:04.551181+0000 mgr.smithi033.apxevf (mgr.14162) 140 : audit [DBG] from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:06.167 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:26:04.553064+0000 mgr.smithi033.apxevf (mgr.14162) 141 : cephadm [INF] Applying service osd.None on host smithi131... 2024-02-15T18:26:06.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:05.013493+0000 mon.smithi033 (mon.0) 317 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:06.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:05.016331+0000 mon.smithi033 (mon.0) 318 : cluster [INF] osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] boot 2024-02-15T18:26:06.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:05.016360+0000 mon.smithi033 (mon.0) 319 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-15T18:26:06.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:05.016694+0000 mon.smithi033 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:06.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:03.660690+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:26:06.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:03.660795+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:26:06.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:04.531217+0000 mgr.smithi033.apxevf (mgr.14162) 139 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2024-02-15T18:26:06.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:04.551181+0000 mgr.smithi033.apxevf (mgr.14162) 140 : audit [DBG] from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:06.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:26:04.553064+0000 mgr.smithi033.apxevf (mgr.14162) 141 : cephadm [INF] Applying service osd.None on host smithi131... 2024-02-15T18:26:06.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:05.013493+0000 mon.smithi033 (mon.0) 317 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:06.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:05.016331+0000 mon.smithi033 (mon.0) 318 : cluster [INF] osd.2 [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] boot 2024-02-15T18:26:06.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:05.016360+0000 mon.smithi033 (mon.0) 319 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-15T18:26:06.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:05.016694+0000 mon.smithi033 (mon.0) 320 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:26:07.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:06.028903+0000 mon.smithi033 (mon.0) 321 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-15T18:26:07.362 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:06.028903+0000 mon.smithi033 (mon.0) 321 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-15T18:26:08.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:06.531547+0000 mgr.smithi033.apxevf (mgr.14162) 142 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:08.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:07.507883+0000 mon.smithi131 (mon.1) 2 : audit [INF] from='client.? 172.21.15.131:0/2091324941' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d342c704-b853-421a-8f27-803f201e73c6"}]: dispatch 2024-02-15T18:26:08.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:07.508319+0000 mon.smithi033 (mon.0) 322 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d342c704-b853-421a-8f27-803f201e73c6"}]: dispatch 2024-02-15T18:26:08.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:07.512143+0000 mon.smithi033 (mon.0) 323 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d342c704-b853-421a-8f27-803f201e73c6"}]': finished 2024-02-15T18:26:08.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:07.512194+0000 mon.smithi033 (mon.0) 324 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2024-02-15T18:26:08.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:07.512305+0000 mon.smithi033 (mon.0) 325 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:08.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:07.851925+0000 mon.smithi033 (mon.0) 326 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:08.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:07.939215+0000 mon.smithi131 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.131:0/454316206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:26:08.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:06.531547+0000 mgr.smithi033.apxevf (mgr.14162) 142 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:08.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:07.507883+0000 mon.smithi131 (mon.1) 2 : audit [INF] from='client.? 172.21.15.131:0/2091324941' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d342c704-b853-421a-8f27-803f201e73c6"}]: dispatch 2024-02-15T18:26:08.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:07.508319+0000 mon.smithi033 (mon.0) 322 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d342c704-b853-421a-8f27-803f201e73c6"}]: dispatch 2024-02-15T18:26:08.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:07.512143+0000 mon.smithi033 (mon.0) 323 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d342c704-b853-421a-8f27-803f201e73c6"}]': finished 2024-02-15T18:26:08.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:07.512194+0000 mon.smithi033 (mon.0) 324 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2024-02-15T18:26:08.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:07.512305+0000 mon.smithi033 (mon.0) 325 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:08.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:07.851925+0000 mon.smithi033 (mon.0) 326 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:08.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:07.939215+0000 mon.smithi131 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.131:0/454316206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:26:10.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:08.531910+0000 mgr.smithi033.apxevf (mgr.14162) 143 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:10.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:08.997045+0000 mon.smithi033 (mon.0) 327 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:10.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:08.531910+0000 mgr.smithi033.apxevf (mgr.14162) 143 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:10.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:08.997045+0000 mon.smithi033 (mon.0) 327 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:12.201 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:10.532434+0000 mgr.smithi033.apxevf (mgr.14162) 144 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:12.282 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:10.532434+0000 mgr.smithi033.apxevf (mgr.14162) 144 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:13.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:12.521322+0000 mon.smithi033 (mon.0) 328 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:13.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:12.524038+0000 mon.smithi033 (mon.0) 329 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:13.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:12.532781+0000 mgr.smithi033.apxevf (mgr.14162) 145 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:13.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:12.521322+0000 mon.smithi033 (mon.0) 328 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:13.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:12.524038+0000 mon.smithi033 (mon.0) 329 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:13.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:12.532781+0000 mgr.smithi033.apxevf (mgr.14162) 145 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:14.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:14.409360+0000 mon.smithi033 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T18:26:14.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:14.410304+0000 mon.smithi033 (mon.0) 331 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:14.866 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:14.409360+0000 mon.smithi033 (mon.0) 330 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T18:26:14.867 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:14.410304+0000 mon.smithi033 (mon.0) 331 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:15.726 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:26:14.411050+0000 mgr.smithi033.apxevf (mgr.14162) 146 : cephadm [INF] Deploying daemon osd.3 on smithi131 2024-02-15T18:26:15.726 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:14.533122+0000 mgr.smithi033.apxevf (mgr.14162) 147 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:15.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:26:14.411050+0000 mgr.smithi033.apxevf (mgr.14162) 146 : cephadm [INF] Deploying daemon osd.3 on smithi131 2024-02-15T18:26:15.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:14.533122+0000 mgr.smithi033.apxevf (mgr.14162) 147 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:17.884 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 3 on host 'smithi131' 2024-02-15T18:26:17.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.885+0000 7fe97dffb700 1 -- 172.21.15.131:0/3651430709 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe988108da0 con 0x7fe97405c2b0 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fe97405c2b0 msgr2=0x7fe97405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fe97405c2b0 0x7fe97405e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe984004630 tx=0x7fe984009b30).stop 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f66e0 msgr2=0x7fe988106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f66e0 0x7fe988106fe0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fe978002700 tx=0x7fe978009e00).stop 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 shutdown_connections 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fe97405c2b0 0x7fe97405e770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9880f66e0 0x7fe988106fe0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 --2- 172.21.15.131:0/3651430709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9880f7980 0x7fe9881074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 >> 172.21.15.131:0/3651430709 conn(0x7fe9880f1e40 msgr2=0x7fe9880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:17.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.887+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 shutdown_connections 2024-02-15T18:26:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:17.888+0000 7fe98f4b3700 1 -- 172.21.15.131:0/3651430709 wait complete. 2024-02-15T18:26:17.905 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:16.533477+0000 mgr.smithi033.apxevf (mgr.14162) 148 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:18.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:16.533477+0000 mgr.smithi033.apxevf (mgr.14162) 148 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:18.560 DEBUG:teuthology.orchestra.run.smithi131:osd.3> sudo journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.3.service 2024-02-15T18:26:18.562 INFO:tasks.cephadm:Deploying osd.4 on smithi131 with /dev/vg_nvme/lv_3... 2024-02-15T18:26:18.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-15T18:26:18.592 INFO:journalctl@ceph.osd.3.smithi131.stdout:-- Logs begin at Thu 2024-02-15 18:10:20 UTC. -- 2024-02-15T18:26:19.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:17.876145+0000 mon.smithi033 (mon.0) 332 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:19.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:17.880548+0000 mon.smithi033 (mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:19.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:17.885563+0000 mon.smithi033 (mon.0) 334 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:19.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:17.888401+0000 mon.smithi033 (mon.0) 335 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2024-02-15T18:26:19.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:17.876145+0000 mon.smithi033 (mon.0) 332 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:19.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:17.880548+0000 mon.smithi033 (mon.0) 333 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:19.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:17.885563+0000 mon.smithi033 (mon.0) 334 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:19.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:17.888401+0000 mon.smithi033 (mon.0) 335 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2024-02-15T18:26:20.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:18.533717+0000 mgr.smithi033.apxevf (mgr.14162) 149 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:20.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:18.888286+0000 mon.smithi033 (mon.0) 336 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2024-02-15T18:26:20.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:18.888333+0000 mon.smithi033 (mon.0) 337 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-15T18:26:20.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:18.888447+0000 mon.smithi033 (mon.0) 338 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:20.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:18.889109+0000 mon.smithi033 (mon.0) 339 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:26:20.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:18.533717+0000 mgr.smithi033.apxevf (mgr.14162) 149 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:20.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:18.888286+0000 mon.smithi033 (mon.0) 336 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2024-02-15T18:26:20.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:18.888333+0000 mon.smithi033 (mon.0) 337 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-15T18:26:20.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:18.888447+0000 mon.smithi033 (mon.0) 338 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:20.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:18.889109+0000 mon.smithi033 (mon.0) 339 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:26:21.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:19.892139+0000 mon.smithi033 (mon.0) 340 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:26:21.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:19.892229+0000 mon.smithi033 (mon.0) 341 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-15T18:26:21.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:19.892369+0000 mon.smithi033 (mon.0) 342 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:21.228 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-15T18:26:21.228 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-15T18:26:21.228 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2024-02-15T18:26:21.228 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2024-02-15T18:26:21.228 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0121164 s, 865 MB/s 2024-02-15T18:26:21.228 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2024-02-15T18:26:21.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:19.892139+0000 mon.smithi033 (mon.0) 340 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:26:21.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:19.892229+0000 mon.smithi033 (mon.0) 341 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-15T18:26:21.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:19.892369+0000 mon.smithi033 (mon.0) 342 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:22.155 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:20.533956+0000 mgr.smithi033.apxevf (mgr.14162) 150 : cluster [DBG] pgmap v115: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:22.156 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:20.897813+0000 mon.smithi033 (mon.0) 343 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-15T18:26:22.156 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:20.897941+0000 mon.smithi033 (mon.0) 344 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:22.156 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:21.766504+0000 mon.smithi131 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:26:22.156 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:21.766866+0000 mon.smithi033 (mon.0) 345 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:26:22.179 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:26:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.3[44790]: debug 2024-02-15T18:26:21.762+0000 7fe71099e080 -1 osd.3 0 log_to_monitors {default=true} 2024-02-15T18:26:22.179 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:20.533956+0000 mgr.smithi033.apxevf (mgr.14162) 150 : cluster [DBG] pgmap v115: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:22.179 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:20.897813+0000 mon.smithi033 (mon.0) 343 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-15T18:26:22.179 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:20.897941+0000 mon.smithi033 (mon.0) 344 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:22.180 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:21.766504+0000 mon.smithi131 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:26:22.180 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:21.766866+0000 mon.smithi033 (mon.0) 345 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:26:22.198 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi131:vg_nvme/lv_3 2024-02-15T18:26:22.901 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:21.902042+0000 mon.smithi033 (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T18:26:22.902 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:21.902132+0000 mon.smithi033 (mon.0) 347 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-15T18:26:22.902 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:21.902236+0000 mon.smithi033 (mon.0) 348 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:23.252 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:21.902715+0000 mon.smithi131 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:26:23.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:21.902934+0000 mon.smithi033 (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:26:23.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:22.276023+0000 mon.smithi033 (mon.0) 350 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:23.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:22.783907+0000 mon.smithi033 (mon.0) 351 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:23.253 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:26:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.3[44790]: debug 2024-02-15T18:26:22.906+0000 7fe706f0f700 -1 osd.3 0 waiting for initial osdmap 2024-02-15T18:26:23.253 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:26:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.3[44790]: debug 2024-02-15T18:26:22.912+0000 7fe6ff683700 -1 osd.3 26 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-15T18:26:23.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:21.902042+0000 mon.smithi033 (mon.0) 346 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T18:26:23.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:21.902132+0000 mon.smithi033 (mon.0) 347 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-15T18:26:23.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:21.902236+0000 mon.smithi033 (mon.0) 348 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:23.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:21.902715+0000 mon.smithi131 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:26:23.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:21.902934+0000 mon.smithi033 (mon.0) 349 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:26:23.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:22.276023+0000 mon.smithi033 (mon.0) 350 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:23.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:22.783907+0000 mon.smithi033 (mon.0) 351 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:24.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:22.534316+0000 mgr.smithi033.apxevf (mgr.14162) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:24.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:22.902899+0000 mon.smithi033 (mon.0) 352 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-02-15T18:26:24.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:22.903001+0000 mon.smithi033 (mon.0) 353 : cluster [DBG] osdmap e26: 4 total, 3 up, 4 in 2024-02-15T18:26:24.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:22.903342+0000 mon.smithi033 (mon.0) 354 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:24.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:22.906897+0000 mon.smithi033 (mon.0) 355 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:24.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:23.354473+0000 mon.smithi033 (mon.0) 356 : cluster [INF] osd.3 [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] boot 2024-02-15T18:26:24.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:23.354546+0000 mon.smithi033 (mon.0) 357 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-15T18:26:24.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:23.355158+0000 mon.smithi033 (mon.0) 358 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:24.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:22.534316+0000 mgr.smithi033.apxevf (mgr.14162) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-02-15T18:26:24.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:22.902899+0000 mon.smithi033 (mon.0) 352 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-02-15T18:26:24.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:22.903001+0000 mon.smithi033 (mon.0) 353 : cluster [DBG] osdmap e26: 4 total, 3 up, 4 in 2024-02-15T18:26:24.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:22.903342+0000 mon.smithi033 (mon.0) 354 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:24.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:22.906897+0000 mon.smithi033 (mon.0) 355 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:24.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:23.354473+0000 mon.smithi033 (mon.0) 356 : cluster [INF] osd.3 [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] boot 2024-02-15T18:26:24.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:23.354546+0000 mon.smithi033 (mon.0) 357 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-15T18:26:24.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:23.355158+0000 mon.smithi033 (mon.0) 358 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:26:24.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.979+0000 7f19f8026700 1 -- 172.21.15.131:0/3945864725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 msgr2=0x7f19f00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:24.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.979+0000 7f19f8026700 1 --2- 172.21.15.131:0/3945864725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 0x7f19f00f6b00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f19ec004660 tx=0x7f19ec009b30).stop 2024-02-15T18:26:24.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.979+0000 7f19f8026700 1 -- 172.21.15.131:0/3945864725 shutdown_connections 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.979+0000 7f19f8026700 1 --2- 172.21.15.131:0/3945864725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19f00f7980 0x7f19f00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.979+0000 7f19f8026700 1 --2- 172.21.15.131:0/3945864725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 0x7f19f00f6b00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.979+0000 7f19f8026700 1 -- 172.21.15.131:0/3945864725 >> 172.21.15.131:0/3945864725 conn(0x7f19f00f1e40 msgr2=0x7f19f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f8026700 1 -- 172.21.15.131:0/3945864725 shutdown_connections 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f8026700 1 -- 172.21.15.131:0/3945864725 wait complete. 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f8026700 1 Processor -- start 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f8026700 1 -- start start 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f8026700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 0x7f19f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f8026700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19f00f7980 0x7f19f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f8026700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f006a410 con 0x7f19f00f7980 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f8026700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f006a550 con 0x7f19f00f66e0 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f5dc2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 0x7f19f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:24.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f5dc2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 0x7f19f006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:48166/0 (socket says 172.21.15.131:48166) 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.980+0000 7f19f5dc2700 1 -- 172.21.15.131:0/3971169483 learned_addr learned my addr 172.21.15.131:0/3971169483 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.981+0000 7f19f5dc2700 1 -- 172.21.15.131:0/3971169483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19f00f7980 msgr2=0x7f19f0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.981+0000 7f19f5dc2700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19f00f7980 0x7f19f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.981+0000 7f19f5dc2700 1 -- 172.21.15.131:0/3971169483 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec005040 con 0x7f19f00f66e0 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.981+0000 7f19f5dc2700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 0x7f19f006b9a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f19ec009f50 tx=0x7f19ec009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.981+0000 7f19e67fc700 1 -- 172.21.15.131:0/3971169483 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec018070 con 0x7f19f00f66e0 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.981+0000 7f19e67fc700 1 -- 172.21.15.131:0/3971169483 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19ec007d70 con 0x7f19f00f66e0 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.981+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f006a7d0 con 0x7f19f00f66e0 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.981+0000 7f19e67fc700 1 -- 172.21.15.131:0/3971169483 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ec01c620 con 0x7f19f00f66e0 2024-02-15T18:26:24.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.981+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f010f0d0 con 0x7f19f00f66e0 2024-02-15T18:26:24.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.982+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f0045ad0 con 0x7f19f00f66e0 2024-02-15T18:26:24.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.982+0000 7f19e67fc700 1 -- 172.21.15.131:0/3971169483 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f19ec01c8e0 con 0x7f19f00f66e0 2024-02-15T18:26:24.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.983+0000 7f19e67fc700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f19dc05c2b0 0x7f19dc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:24.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.983+0000 7f19e67fc700 1 -- 172.21.15.131:0/3971169483 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3688+0+0 (secure 0 0 0) 0x7f19ec0776b0 con 0x7f19f00f66e0 2024-02-15T18:26:24.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.983+0000 7f19f55c1700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f19dc05c2b0 0x7f19dc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:24.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.983+0000 7f19f55c1700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f19dc05c2b0 0x7f19dc05e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f19e0009610 tx=0x7f19e0006b50).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:24.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:24.987+0000 7f19e67fc700 1 -- 172.21.15.131:0/3971169483 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f19ec04aa10 con 0x7f19f00f66e0 2024-02-15T18:26:25.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:25.162+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f19f00ff140 con 0x7f19dc05c2b0 2024-02-15T18:26:25.545 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:22.776929+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:26:25.545 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:22.777134+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:26:25.545 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:24.356194+0000 mon.smithi033 (mon.0) 359 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-02-15T18:26:25.545 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:24.534803+0000 mgr.smithi033.apxevf (mgr.14162) 152 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:25.545 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:25.164331+0000 mgr.smithi033.apxevf (mgr.14162) 153 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:25.545 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:25.165335+0000 mon.smithi033 (mon.0) 360 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:26:25.546 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:26:25.166799+0000 mgr.smithi033.apxevf (mgr.14162) 154 : cephadm [INF] Applying service osd.None on host smithi131... 2024-02-15T18:26:25.546 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:25.167098+0000 mon.smithi033 (mon.0) 361 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:26:25.546 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:25.167869+0000 mon.smithi033 (mon.0) 362 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:25.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:22.776929+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:26:25.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:22.777134+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:26:25.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:24.356194+0000 mon.smithi033 (mon.0) 359 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-02-15T18:26:25.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:24.534803+0000 mgr.smithi033.apxevf (mgr.14162) 152 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:25.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:25.164331+0000 mgr.smithi033.apxevf (mgr.14162) 153 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:25.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:25.165335+0000 mon.smithi033 (mon.0) 360 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:26:25.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:26:25.166799+0000 mgr.smithi033.apxevf (mgr.14162) 154 : cephadm [INF] Applying service osd.None on host smithi131... 2024-02-15T18:26:25.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:25.167098+0000 mon.smithi033 (mon.0) 361 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:26:25.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:25.167869+0000 mon.smithi033 (mon.0) 362 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:26.732 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:25.361402+0000 mon.smithi033 (mon.0) 363 : cluster [DBG] osdmap e29: 4 total, 4 up, 4 in 2024-02-15T18:26:26.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:25.361402+0000 mon.smithi033 (mon.0) 363 : cluster [DBG] osdmap e29: 4 total, 4 up, 4 in 2024-02-15T18:26:27.502 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:26.535204+0000 mgr.smithi033.apxevf (mgr.14162) 155 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:27.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:26.535204+0000 mgr.smithi033.apxevf (mgr.14162) 155 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:29.252 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:26:27.872354+0000 mgr.smithi033.apxevf (mgr.14162) 156 : cephadm [INF] Detected new or changed devices on smithi131 2024-02-15T18:26:29.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:27.877332+0000 mon.smithi033 (mon.0) 364 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:29.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:27.882140+0000 mon.smithi033 (mon.0) 365 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:29.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:27.885122+0000 mon.smithi033 (mon.0) 366 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:29.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:28.566594+0000 mon.smithi131 (mon.1) 6 : audit [INF] from='client.? 172.21.15.131:0/2878421883' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a318488-8764-4284-b2c7-811c9bf5f312"}]: dispatch 2024-02-15T18:26:29.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:28.566923+0000 mon.smithi033 (mon.0) 367 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a318488-8764-4284-b2c7-811c9bf5f312"}]: dispatch 2024-02-15T18:26:29.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:28.570966+0000 mon.smithi033 (mon.0) 368 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a318488-8764-4284-b2c7-811c9bf5f312"}]': finished 2024-02-15T18:26:29.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:28.571042+0000 mon.smithi033 (mon.0) 369 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-15T18:26:29.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:28.571179+0000 mon.smithi033 (mon.0) 370 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:29.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:26:27.872354+0000 mgr.smithi033.apxevf (mgr.14162) 156 : cephadm [INF] Detected new or changed devices on smithi131 2024-02-15T18:26:29.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:27.877332+0000 mon.smithi033 (mon.0) 364 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:29.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:27.882140+0000 mon.smithi033 (mon.0) 365 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:29.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:27.885122+0000 mon.smithi033 (mon.0) 366 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:29.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:28.566594+0000 mon.smithi131 (mon.1) 6 : audit [INF] from='client.? 172.21.15.131:0/2878421883' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a318488-8764-4284-b2c7-811c9bf5f312"}]: dispatch 2024-02-15T18:26:29.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:28.566923+0000 mon.smithi033 (mon.0) 367 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a318488-8764-4284-b2c7-811c9bf5f312"}]: dispatch 2024-02-15T18:26:29.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:28.570966+0000 mon.smithi033 (mon.0) 368 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a318488-8764-4284-b2c7-811c9bf5f312"}]': finished 2024-02-15T18:26:29.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:28.571042+0000 mon.smithi033 (mon.0) 369 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-15T18:26:29.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:28.571179+0000 mon.smithi033 (mon.0) 370 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:30.252 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:28.535516+0000 mgr.smithi033.apxevf (mgr.14162) 157 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:30.252 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:28.985128+0000 mon.smithi131 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.131:0/693013867' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:26:30.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:28.535516+0000 mgr.smithi033.apxevf (mgr.14162) 157 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:30.302 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:28.985128+0000 mon.smithi131 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.131:0/693013867' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:26:32.162 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:30.535888+0000 mgr.smithi033.apxevf (mgr.14162) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:32.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:30.535888+0000 mgr.smithi033.apxevf (mgr.14162) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:34.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:32.536285+0000 mgr.smithi033.apxevf (mgr.14162) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:34.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:32.791015+0000 mon.smithi033 (mon.0) 371 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:34.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:32.793965+0000 mon.smithi033 (mon.0) 372 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:34.252 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:32.536285+0000 mgr.smithi033.apxevf (mgr.14162) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:34.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:32.791015+0000 mon.smithi033 (mon.0) 371 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:34.253 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:32.793965+0000 mon.smithi033 (mon.0) 372 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:36.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:34.536761+0000 mgr.smithi033.apxevf (mgr.14162) 160 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:36.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:35.720549+0000 mon.smithi033 (mon.0) 373 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T18:26:36.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:35.721402+0000 mon.smithi033 (mon.0) 374 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:36.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:34.536761+0000 mgr.smithi033.apxevf (mgr.14162) 160 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:36.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:35.720549+0000 mon.smithi033 (mon.0) 373 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T18:26:36.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:35.721402+0000 mon.smithi033 (mon.0) 374 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:37.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:26:35.722100+0000 mgr.smithi033.apxevf (mgr.14162) 161 : cephadm [INF] Deploying daemon osd.4 on smithi131 2024-02-15T18:26:37.161 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:26:35.722100+0000 mgr.smithi033.apxevf (mgr.14162) 161 : cephadm [INF] Deploying daemon osd.4 on smithi131 2024-02-15T18:26:38.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:36.537119+0000 mgr.smithi033.apxevf (mgr.14162) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:38.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:36.537119+0000 mgr.smithi033.apxevf (mgr.14162) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:39.353 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 4 on host 'smithi131' 2024-02-15T18:26:39.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.355+0000 7f19e67fc700 1 -- 172.21.15.131:0/3971169483 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f19f00ff140 con 0x7f19dc05c2b0 2024-02-15T18:26:39.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f19dc05c2b0 msgr2=0x7f19dc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f19dc05c2b0 0x7f19dc05e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f19e0009610 tx=0x7f19e0006b50).stop 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 msgr2=0x7f19f006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 0x7f19f006b9a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f19ec009f50 tx=0x7f19ec009b30).stop 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 shutdown_connections 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f19dc05c2b0 0x7f19dc05e770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19f00f66e0 0x7f19f006b9a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 --2- 172.21.15.131:0/3971169483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19f00f7980 0x7f19f0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 >> 172.21.15.131:0/3971169483 conn(0x7f19f00f1e40 msgr2=0x7f19f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 shutdown_connections 2024-02-15T18:26:39.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:39.358+0000 7f19f8026700 1 -- 172.21.15.131:0/3971169483 wait complete. 2024-02-15T18:26:39.705 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:38.537454+0000 mgr.smithi033.apxevf (mgr.14162) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:39.705 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:39.345681+0000 mon.smithi033 (mon.0) 375 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:39.705 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:39.350151+0000 mon.smithi033 (mon.0) 376 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:39.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:38.537454+0000 mgr.smithi033.apxevf (mgr.14162) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:39.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:39.345681+0000 mon.smithi033 (mon.0) 375 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:39.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:39.350151+0000 mon.smithi033 (mon.0) 376 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:40.076 DEBUG:teuthology.orchestra.run.smithi131:osd.4> sudo journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.4.service 2024-02-15T18:26:40.078 INFO:tasks.cephadm:Deploying osd.5 on smithi131 with /dev/vg_nvme/lv_2... 2024-02-15T18:26:40.078 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-15T18:26:40.109 INFO:journalctl@ceph.osd.4.smithi131.stdout:-- Logs begin at Thu 2024-02-15 18:10:20 UTC. -- 2024-02-15T18:26:40.626 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:39.355563+0000 mon.smithi033 (mon.0) 377 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:40.755 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:39.355563+0000 mon.smithi033 (mon.0) 377 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:41.621 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:40.537849+0000 mgr.smithi033.apxevf (mgr.14162) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:41.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:40.537849+0000 mgr.smithi033.apxevf (mgr.14162) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:42.672 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-15T18:26:42.672 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-15T18:26:42.672 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2024-02-15T18:26:42.672 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2024-02-15T18:26:42.672 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134268 s, 781 MB/s 2024-02-15T18:26:42.672 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2024-02-15T18:26:43.502 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:26:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.4[48390]: debug 2024-02-15T18:26:43.220+0000 7f3e230de080 -1 osd.4 0 log_to_monitors {default=true} 2024-02-15T18:26:43.662 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi131:vg_nvme/lv_2 2024-02-15T18:26:44.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:42.538113+0000 mgr.smithi033.apxevf (mgr.14162) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:44.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:43.224421+0000 mon.smithi131 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:26:44.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:43.224742+0000 mon.smithi033 (mon.0) 378 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:26:44.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:42.538113+0000 mgr.smithi033.apxevf (mgr.14162) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:44.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:43.224421+0000 mon.smithi131 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:26:44.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:43.224742+0000 mon.smithi033 (mon.0) 378 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:26:44.656 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:26:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.4[48390]: debug 2024-02-15T18:26:44.608+0000 7f3e1964f700 -1 osd.4 0 waiting for initial osdmap 2024-02-15T18:26:44.656 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:26:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.4[48390]: debug 2024-02-15T18:26:44.615+0000 7f3e13dc7700 -1 osd.4 32 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-15T18:26:44.656 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:43.597365+0000 mon.smithi033 (mon.0) 379 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T18:26:44.656 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:43.597460+0000 mon.smithi033 (mon.0) 380 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-02-15T18:26:44.657 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:43.597574+0000 mon.smithi033 (mon.0) 381 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:44.657 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:43.597996+0000 mon.smithi131 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:26:44.657 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:43.598243+0000 mon.smithi033 (mon.0) 382 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:26:44.657 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:43.760727+0000 mon.smithi033 (mon.0) 383 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:44.657 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:43.944415+0000 mon.smithi033 (mon.0) 384 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:45.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:43.597365+0000 mon.smithi033 (mon.0) 379 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T18:26:45.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:43.597460+0000 mon.smithi033 (mon.0) 380 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-02-15T18:26:45.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:43.597574+0000 mon.smithi033 (mon.0) 381 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:45.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:43.597996+0000 mon.smithi131 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:26:45.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:43.598243+0000 mon.smithi033 (mon.0) 382 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:26:45.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:43.760727+0000 mon.smithi033 (mon.0) 383 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:45.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:43.944415+0000 mon.smithi033 (mon.0) 384 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:45.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:44.538545+0000 mgr.smithi033.apxevf (mgr.14162) 166 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:45.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:44.603209+0000 mon.smithi033 (mon.0) 385 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-02-15T18:26:45.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:44.603403+0000 mon.smithi033 (mon.0) 386 : cluster [DBG] osdmap e32: 5 total, 4 up, 5 in 2024-02-15T18:26:45.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:44.603864+0000 mon.smithi033 (mon.0) 387 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:45.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:44.609943+0000 mon.smithi033 (mon.0) 388 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:45.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:45.601283+0000 mon.smithi033 (mon.0) 389 : cluster [INF] osd.4 [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] boot 2024-02-15T18:26:45.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:45.601321+0000 mon.smithi033 (mon.0) 390 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-15T18:26:45.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:45.601541+0000 mon.smithi033 (mon.0) 391 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:45.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:44.538545+0000 mgr.smithi033.apxevf (mgr.14162) 166 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2024-02-15T18:26:45.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:44.603209+0000 mon.smithi033 (mon.0) 385 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-02-15T18:26:45.919 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:44.603403+0000 mon.smithi033 (mon.0) 386 : cluster [DBG] osdmap e32: 5 total, 4 up, 5 in 2024-02-15T18:26:45.919 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:44.603864+0000 mon.smithi033 (mon.0) 387 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:45.919 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:44.609943+0000 mon.smithi033 (mon.0) 388 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:45.919 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:45.601283+0000 mon.smithi033 (mon.0) 389 : cluster [INF] osd.4 [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] boot 2024-02-15T18:26:45.919 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:45.601321+0000 mon.smithi033 (mon.0) 390 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-15T18:26:45.919 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:45.601541+0000 mon.smithi033 (mon.0) 391 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:26:47.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:44.193251+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:26:47.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:44.193381+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:26:47.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:46.999+0000 7f7734092700 1 -- 172.21.15.131:0/322557997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 msgr2=0x7f772c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:47.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:46.999+0000 7f7734092700 1 --2- 172.21.15.131:0/322557997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 0x7f772c0f7de0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7728004660 tx=0x7f7728009b30).stop 2024-02-15T18:26:47.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:46.999+0000 7f7734092700 1 -- 172.21.15.131:0/322557997 shutdown_connections 2024-02-15T18:26:47.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:46.999+0000 7f7734092700 1 --2- 172.21.15.131:0/322557997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 0x7f772c0f7de0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:26:47.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:46.999+0000 7f7734092700 1 --2- 172.21.15.131:0/322557997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c0f66e0 0x7f772c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:47.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:46.999+0000 7f7734092700 1 -- 172.21.15.131:0/322557997 >> 172.21.15.131:0/322557997 conn(0x7f772c0f1e40 msgr2=0x7f772c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:26:47.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:46.999+0000 7f7734092700 1 -- 172.21.15.131:0/322557997 shutdown_connections 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:46.999+0000 7f7734092700 1 -- 172.21.15.131:0/322557997 wait complete. 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f7734092700 1 Processor -- start 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f7734092700 1 -- start start 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f7734092700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c0f66e0 0x7f772c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f7734092700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 0x7f772c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f7734092700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c06a410 con 0x7f772c0f66e0 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f7734092700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c06a550 con 0x7f772c0f7980 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f773162d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 0x7f772c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f773162d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 0x7f772c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:37374/0 (socket says 172.21.15.131:37374) 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f773162d700 1 -- 172.21.15.131:0/650809063 learned_addr learned my addr 172.21.15.131:0/650809063 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f773162d700 1 -- 172.21.15.131:0/650809063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c0f66e0 msgr2=0x7f772c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f773162d700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c0f66e0 0x7f772c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f773162d700 1 -- 172.21.15.131:0/650809063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7728005040 con 0x7f772c0f7980 2024-02-15T18:26:47.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f773162d700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 0x7f772c069e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7728009830 tx=0x7f7728009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f77227fc700 1 -- 172.21.15.131:0/650809063 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7728018070 con 0x7f772c0f7980 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c06a7d0 con 0x7f772c0f7980 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f77227fc700 1 -- 172.21.15.131:0/650809063 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7728007d70 con 0x7f772c0f7980 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f77227fc700 1 -- 172.21.15.131:0/650809063 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f772801c620 con 0x7f772c0f7980 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.000+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c10f0d0 con 0x7f772c0f7980 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.001+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c045ad0 con 0x7f772c0f7980 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.002+0000 7f77227fc700 1 -- 172.21.15.131:0/650809063 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f772801d980 con 0x7f772c0f7980 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.002+0000 7f77227fc700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f771805c2b0 0x7f771805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.002+0000 7f77227fc700 1 -- 172.21.15.131:0/650809063 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4120+0+0 (secure 0 0 0) 0x7f77280778c0 con 0x7f772c0f7980 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.002+0000 7f7731e2e700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f771805c2b0 0x7f771805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.003+0000 7f7731e2e700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f771805c2b0 0x7f771805e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f772c06b730 tx=0x7f771c006ab0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:26:47.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.006+0000 7f77227fc700 1 -- 172.21.15.131:0/650809063 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f772804aa10 con 0x7f772c0f7980 2024-02-15T18:26:47.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:44.193251+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:26:47.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:44.193381+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:26:47.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:26:47.193+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f772c0ff190 con 0x7f771805c2b0 2024-02-15T18:26:47.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:46.539044+0000 mgr.smithi033.apxevf (mgr.14162) 167 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:47.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:46.618007+0000 mon.smithi033 (mon.0) 392 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-02-15T18:26:47.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:47.195915+0000 mgr.smithi033.apxevf (mgr.14162) 168 : audit [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:47.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:47.196851+0000 mon.smithi033 (mon.0) 393 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:26:47.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:26:47.198251+0000 mgr.smithi033.apxevf (mgr.14162) 169 : cephadm [INF] Applying service osd.None on host smithi131... 2024-02-15T18:26:47.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:47.198522+0000 mon.smithi033 (mon.0) 394 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:26:47.754 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:47.199253+0000 mon.smithi033 (mon.0) 395 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:48.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:46.539044+0000 mgr.smithi033.apxevf (mgr.14162) 167 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:48.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:46.618007+0000 mon.smithi033 (mon.0) 392 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-02-15T18:26:48.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:47.195915+0000 mgr.smithi033.apxevf (mgr.14162) 168 : audit [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:26:48.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:47.196851+0000 mon.smithi033 (mon.0) 393 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-15T18:26:48.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:26:47.198251+0000 mgr.smithi033.apxevf (mgr.14162) 169 : cephadm [INF] Applying service osd.None on host smithi131... 2024-02-15T18:26:48.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:47.198522+0000 mon.smithi033 (mon.0) 394 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-15T18:26:48.053 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:47.199253+0000 mon.smithi033 (mon.0) 395 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:49.430 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:48.539423+0000 mgr.smithi033.apxevf (mgr.14162) 170 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:49.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:48.539423+0000 mgr.smithi033.apxevf (mgr.14162) 170 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:50.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:26:49.481542+0000 mgr.smithi033.apxevf (mgr.14162) 171 : cephadm [INF] Detected new or changed devices on smithi131 2024-02-15T18:26:50.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:49.485787+0000 mon.smithi033 (mon.0) 396 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:50.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:49.736603+0000 mon.smithi033 (mon.0) 397 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:50.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:49.739544+0000 mon.smithi033 (mon.0) 398 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:50.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:50.169895+0000 mon.smithi131 (mon.1) 10 : audit [INF] from='client.? 172.21.15.131:0/338126390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26789e21-a7cc-431d-b59e-5c06f9e676b4"}]: dispatch 2024-02-15T18:26:50.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:50.170255+0000 mon.smithi033 (mon.0) 399 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26789e21-a7cc-431d-b59e-5c06f9e676b4"}]: dispatch 2024-02-15T18:26:50.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:50.174694+0000 mon.smithi033 (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26789e21-a7cc-431d-b59e-5c06f9e676b4"}]': finished 2024-02-15T18:26:50.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:50.174746+0000 mon.smithi033 (mon.0) 401 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-15T18:26:50.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:50.174845+0000 mon.smithi033 (mon.0) 402 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:26:50.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:26:49.481542+0000 mgr.smithi033.apxevf (mgr.14162) 171 : cephadm [INF] Detected new or changed devices on smithi131 2024-02-15T18:26:50.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:49.485787+0000 mon.smithi033 (mon.0) 396 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:50.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:49.736603+0000 mon.smithi033 (mon.0) 397 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:50.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:49.739544+0000 mon.smithi033 (mon.0) 398 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:26:50.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:50.169895+0000 mon.smithi131 (mon.1) 10 : audit [INF] from='client.? 172.21.15.131:0/338126390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26789e21-a7cc-431d-b59e-5c06f9e676b4"}]: dispatch 2024-02-15T18:26:50.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:50.170255+0000 mon.smithi033 (mon.0) 399 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26789e21-a7cc-431d-b59e-5c06f9e676b4"}]: dispatch 2024-02-15T18:26:50.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:50.174694+0000 mon.smithi033 (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26789e21-a7cc-431d-b59e-5c06f9e676b4"}]': finished 2024-02-15T18:26:50.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:50.174746+0000 mon.smithi033 (mon.0) 401 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-15T18:26:50.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:50.174845+0000 mon.smithi033 (mon.0) 402 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:26:51.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:50.539829+0000 mgr.smithi033.apxevf (mgr.14162) 172 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:51.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:50.590199+0000 mon.smithi131 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.131:0/3719799088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:26:51.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:50.539829+0000 mgr.smithi033.apxevf (mgr.14162) 172 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:51.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:50.590199+0000 mon.smithi131 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.131:0/3719799088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-15T18:26:53.855 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:52.540232+0000 mgr.smithi033.apxevf (mgr.14162) 173 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:54.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:52.540232+0000 mgr.smithi033.apxevf (mgr.14162) 173 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:55.502 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:54.326601+0000 mon.smithi033 (mon.0) 403 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:55.502 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:54.540500+0000 mgr.smithi033.apxevf (mgr.14162) 174 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:55.502 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:54.586522+0000 mon.smithi033 (mon.0) 404 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:55.502 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:54.653517+0000 mon.smithi033 (mon.0) 405 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:26:55.503 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:54.654328+0000 mon.smithi033 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:26:55.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:54.326601+0000 mon.smithi033 (mon.0) 403 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:55.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:54.540500+0000 mgr.smithi033.apxevf (mgr.14162) 174 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:55.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:54.586522+0000 mon.smithi033 (mon.0) 404 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:26:55.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:54.653517+0000 mon.smithi033 (mon.0) 405 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:26:55.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:54.654328+0000 mon.smithi033 (mon.0) 406 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:26:58.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:56.540908+0000 mgr.smithi033.apxevf (mgr.14162) 175 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:58.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:57.578803+0000 mon.smithi033 (mon.0) 407 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T18:26:58.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:26:57.579601+0000 mon.smithi033 (mon.0) 408 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:58.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:56.540908+0000 mgr.smithi033.apxevf (mgr.14162) 175 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:26:58.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:57.578803+0000 mon.smithi033 (mon.0) 407 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T18:26:58.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:26:57.579601+0000 mon.smithi033 (mon.0) 408 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:26:58.986 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:26:57.580290+0000 mgr.smithi033.apxevf (mgr.14162) 176 : cephadm [INF] Deploying daemon osd.5 on smithi131 2024-02-15T18:26:59.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:26:57.580290+0000 mgr.smithi033.apxevf (mgr.14162) 176 : cephadm [INF] Deploying daemon osd.5 on smithi131 2024-02-15T18:26:59.987 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:26:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:26:58.541378+0000 mgr.smithi033.apxevf (mgr.14162) 177 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:00.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:26:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:26:58.541378+0000 mgr.smithi033.apxevf (mgr.14162) 177 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:01.171 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 5 on host 'smithi131' 2024-02-15T18:27:01.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.173+0000 7f77227fc700 1 -- 172.21.15.131:0/650809063 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f772c0ff190 con 0x7f771805c2b0 2024-02-15T18:27:01.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f771805c2b0 msgr2=0x7f771805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:01.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f771805c2b0 0x7f771805e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f772c06b730 tx=0x7f771c006ab0).stop 2024-02-15T18:27:01.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 msgr2=0x7f772c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:01.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 0x7f772c069e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7728009830 tx=0x7f7728009b30).stop 2024-02-15T18:27:01.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 shutdown_connections 2024-02-15T18:27:01.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f771805c2b0 0x7f771805e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:01.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f772c0f66e0 0x7f772c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:01.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 --2- 172.21.15.131:0/650809063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c0f7980 0x7f772c069e20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:01.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 >> 172.21.15.131:0/650809063 conn(0x7f772c0f1e40 msgr2=0x7f772c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:01.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 shutdown_connections 2024-02-15T18:27:01.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:01.176+0000 7f7734092700 1 -- 172.21.15.131:0/650809063 wait complete. 2024-02-15T18:27:01.841 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:00.541899+0000 mgr.smithi033.apxevf (mgr.14162) 178 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:01.841 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:01.162567+0000 mon.smithi033 (mon.0) 409 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:01.841 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:01.167358+0000 mon.smithi033 (mon.0) 410 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:01.841 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:01.173710+0000 mon.smithi033 (mon.0) 411 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:01.863 DEBUG:teuthology.orchestra.run.smithi131:osd.5> sudo journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.5.service 2024-02-15T18:27:01.865 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-15T18:27:01.865 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd stat -f json 2024-02-15T18:27:01.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:00.541899+0000 mgr.smithi033.apxevf (mgr.14162) 178 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:01.894 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:01.162567+0000 mon.smithi033 (mon.0) 409 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:01.894 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:01.167358+0000 mon.smithi033 (mon.0) 410 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:01.894 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:01.173710+0000 mon.smithi033 (mon.0) 411 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:01.894 INFO:journalctl@ceph.osd.5.smithi131.stdout:-- Logs begin at Thu 2024-02-15 18:10:20 UTC. -- 2024-02-15T18:27:04.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:02.542333+0000 mgr.smithi033.apxevf (mgr.14162) 179 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:04.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:02.542333+0000 mgr.smithi033.apxevf (mgr.14162) 179 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.513+0000 7f6de3240700 1 -- 172.21.15.33:0/2672147081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 msgr2=0x7f6ddc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.513+0000 7f6de3240700 1 --2- 172.21.15.33:0/2672147081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 0x7f6ddc0f7de0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f6dc8004660 tx=0x7f6dc8009b30).stop 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.513+0000 7f6de3240700 1 -- 172.21.15.33:0/2672147081 shutdown_connections 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.513+0000 7f6de3240700 1 --2- 172.21.15.33:0/2672147081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 0x7f6ddc0f7de0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.513+0000 7f6de3240700 1 --2- 172.21.15.33:0/2672147081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ddc0f66e0 0x7f6ddc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.513+0000 7f6de3240700 1 -- 172.21.15.33:0/2672147081 >> 172.21.15.33:0/2672147081 conn(0x7f6ddc0f1e40 msgr2=0x7f6ddc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.513+0000 7f6de3240700 1 -- 172.21.15.33:0/2672147081 shutdown_connections 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.513+0000 7f6de3240700 1 -- 172.21.15.33:0/2672147081 wait complete. 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.514+0000 7f6de3240700 1 Processor -- start 2024-02-15T18:27:04.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.514+0000 7f6de3240700 1 -- start start 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.514+0000 7f6de3240700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ddc0f66e0 0x7f6ddc107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.514+0000 7f6de3240700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 0x7f6ddc1074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.514+0000 7f6de3240700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc107aa0 con 0x7f6ddc0f7980 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.514+0000 7f6de3240700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc107be0 con 0x7f6ddc0f66e0 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.514+0000 7f6ddbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 0x7f6ddc1074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.514+0000 7f6ddbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 0x7f6ddc1074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46174/0 (socket says 172.21.15.33:46174) 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.514+0000 7f6ddbfff700 1 -- 172.21.15.33:0/2817183772 learned_addr learned my addr 172.21.15.33:0/2817183772 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6de0fdc700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ddc0f66e0 0x7f6ddc107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6ddbfff700 1 -- 172.21.15.33:0/2817183772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ddc0f66e0 msgr2=0x7f6ddc107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6ddbfff700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ddc0f66e0 0x7f6ddc107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6ddbfff700 1 -- 172.21.15.33:0/2817183772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc8005040 con 0x7f6ddc0f7980 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6ddbfff700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 0x7f6ddc1074f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6dc8000c00 tx=0x7f6dc800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6dd97fa700 1 -- 172.21.15.33:0/2817183772 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dc8019070 con 0x7f6ddc0f7980 2024-02-15T18:27:04.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6dd97fa700 1 -- 172.21.15.33:0/2817183772 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6dc8007e90 con 0x7f6ddc0f7980 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc108520 con 0x7f6ddc0f7980 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6dd97fa700 1 -- 172.21.15.33:0/2817183772 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dc8014d50 con 0x7f6ddc0f7980 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.515+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc108a80 con 0x7f6ddc0f7980 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.516+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc045ad0 con 0x7f6ddc0f7980 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.516+0000 7f6dd97fa700 1 -- 172.21.15.33:0/2817183772 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6dc8025070 con 0x7f6ddc0f7980 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.517+0000 7f6dd97fa700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f6dc005c250 0x7f6dc005e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.517+0000 7f6dd97fa700 1 -- 172.21.15.33:0/2817183772 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4235+0+0 (secure 0 0 0) 0x7f6dc8076920 con 0x7f6ddc0f7980 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.517+0000 7f6de0fdc700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f6dc005c250 0x7f6dc005e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.517+0000 7f6de0fdc700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f6dc005c250 0x7f6dc005e710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f6dd0009fd0 tx=0x7f6dd000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:04.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.521+0000 7f6dd97fa700 1 -- 172.21.15.33:0/2817183772 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6dc8049a60 con 0x7f6ddc0f7980 2024-02-15T18:27:04.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.684+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f6ddc027a00 con 0x7f6ddc0f7980 2024-02-15T18:27:04.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.684+0000 7f6dd97fa700 1 -- 172.21.15.33:0/2817183772 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) v1 ==== 74+0+130 (secure 0 0 0) 0x7f6dc804d080 con 0x7f6ddc0f7980 2024-02-15T18:27:04.681 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:27:04.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f6dc005c250 msgr2=0x7f6dc005e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:04.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f6dc005c250 0x7f6dc005e710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f6dd0009fd0 tx=0x7f6dd000b040).stop 2024-02-15T18:27:04.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 msgr2=0x7f6ddc1074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:04.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 0x7f6ddc1074f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6dc8000c00 tx=0x7f6dc800b040).stop 2024-02-15T18:27:04.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 shutdown_connections 2024-02-15T18:27:04.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f6dc005c250 0x7f6dc005e710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:04.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ddc0f66e0 0x7f6ddc107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:04.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 --2- 172.21.15.33:0/2817183772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc0f7980 0x7f6ddc1074f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:04.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 >> 172.21.15.33:0/2817183772 conn(0x7f6ddc0f1e40 msgr2=0x7f6ddc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:04.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 shutdown_connections 2024-02-15T18:27:04.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:04.686+0000 7f6de3240700 1 -- 172.21.15.33:0/2817183772 wait complete. 2024-02-15T18:27:04.942 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:03.683652+0000 mon.smithi033 (mon.0) 412 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:05.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:03.683652+0000 mon.smithi033 (mon.0) 412 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:05.424 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:27:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.5[52036]: debug 2024-02-15T18:27:05.059+0000 7f84f2b8d080 -1 osd.5 0 log_to_monitors {default=true} 2024-02-15T18:27:05.588 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1708021605,"num_in_osds":6,"osd_in_since":1708021610,"num_remapped_pgs":0} 2024-02-15T18:27:05.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:04.542653+0000 mgr.smithi033.apxevf (mgr.14162) 180 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:05.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:04.685410+0000 mon.smithi033 (mon.0) 413 : audit [DBG] from='client.? 172.21.15.33:0/2817183772' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T18:27:05.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:05.063230+0000 mon.smithi131 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:27:05.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:05.063555+0000 mon.smithi033 (mon.0) 414 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:27:06.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:04.542653+0000 mgr.smithi033.apxevf (mgr.14162) 180 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:06.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:04.685410+0000 mon.smithi033 (mon.0) 413 : audit [DBG] from='client.? 172.21.15.33:0/2817183772' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T18:27:06.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:05.063230+0000 mon.smithi131 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:27:06.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:05.063555+0000 mon.smithi033 (mon.0) 414 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:27:06.590 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd stat -f json 2024-02-15T18:27:06.892 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:27:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.5[52036]: debug 2024-02-15T18:27:06.700+0000 7f84e90fe700 -1 osd.5 0 waiting for initial osdmap 2024-02-15T18:27:06.892 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:27:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.5[52036]: debug 2024-02-15T18:27:06.708+0000 7f84e3876700 -1 osd.5 37 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-15T18:27:06.892 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:05.695630+0000 mon.smithi033 (mon.0) 415 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T18:27:06.892 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:05.695707+0000 mon.smithi033 (mon.0) 416 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-15T18:27:06.892 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:05.695821+0000 mon.smithi033 (mon.0) 417 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:06.892 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:05.696634+0000 mon.smithi131 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:27:06.892 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:05.696943+0000 mon.smithi033 (mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:27:07.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:05.695630+0000 mon.smithi033 (mon.0) 415 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T18:27:07.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:05.695707+0000 mon.smithi033 (mon.0) 416 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-15T18:27:07.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:05.695821+0000 mon.smithi033 (mon.0) 417 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:07.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:05.696634+0000 mon.smithi131 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:27:07.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:05.696943+0000 mon.smithi033 (mon.0) 418 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:27:08.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:06.542979+0000 mgr.smithi033.apxevf (mgr.14162) 181 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:08.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:06.697335+0000 mon.smithi033 (mon.0) 419 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-02-15T18:27:08.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:06.697427+0000 mon.smithi033 (mon.0) 420 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-02-15T18:27:08.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:06.697784+0000 mon.smithi033 (mon.0) 421 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:08.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:06.702056+0000 mon.smithi033 (mon.0) 422 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:08.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:27:07.113830+0000 mgr.smithi033.apxevf (mgr.14162) 182 : cephadm [INF] Detected new or changed devices on smithi131 2024-02-15T18:27:08.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:07.120464+0000 mon.smithi033 (mon.0) 423 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:08.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:06.542979+0000 mgr.smithi033.apxevf (mgr.14162) 181 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:08.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:06.697335+0000 mon.smithi033 (mon.0) 419 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-02-15T18:27:08.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:06.697427+0000 mon.smithi033 (mon.0) 420 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-02-15T18:27:08.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:06.697784+0000 mon.smithi033 (mon.0) 421 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:08.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:06.702056+0000 mon.smithi033 (mon.0) 422 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:08.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:27:07.113830+0000 mgr.smithi033.apxevf (mgr.14162) 182 : cephadm [INF] Detected new or changed devices on smithi131 2024-02-15T18:27:08.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:07.120464+0000 mon.smithi033 (mon.0) 423 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:09.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:06.090131+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:27:09.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:06.090255+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:27:09.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:07.700774+0000 mon.smithi033 (mon.0) 424 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:09.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:07.705362+0000 mon.smithi033 (mon.0) 425 : cluster [INF] osd.5 [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] boot 2024-02-15T18:27:09.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:07.705403+0000 mon.smithi033 (mon.0) 426 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-15T18:27:09.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:07.706439+0000 mon.smithi033 (mon.0) 427 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:09.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:06.090131+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-15T18:27:09.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:06.090255+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-15T18:27:09.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:07.700774+0000 mon.smithi033 (mon.0) 424 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:09.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:07.705362+0000 mon.smithi033 (mon.0) 425 : cluster [INF] osd.5 [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] boot 2024-02-15T18:27:09.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:07.705403+0000 mon.smithi033 (mon.0) 426 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-15T18:27:09.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:07.706439+0000 mon.smithi033 (mon.0) 427 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:27:09.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 -- 172.21.15.33:0/957589402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f51a0 msgr2=0x7f74d40f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 --2- 172.21.15.33:0/957589402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f51a0 0x7f74d40f7920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f74c8004660 tx=0x7f74c8009b30).stop 2024-02-15T18:27:09.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 -- 172.21.15.33:0/957589402 shutdown_connections 2024-02-15T18:27:09.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 --2- 172.21.15.33:0/957589402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f51a0 0x7f74d40f7920 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 --2- 172.21.15.33:0/957589402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40f4800 0x7f74d40f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:09.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 -- 172.21.15.33:0/957589402 >> 172.21.15.33:0/957589402 conn(0x7f74d40f0320 msgr2=0x7f74d40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 -- 172.21.15.33:0/957589402 shutdown_connections 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 -- 172.21.15.33:0/957589402 wait complete. 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 Processor -- start 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.180+0000 7f74d359e700 1 -- start start 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f4800 0x7f74d4106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40f51a0 0x7f74d41073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d41079e0 con 0x7f74d40f4800 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4108290 con 0x7f74d40f51a0 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f4800 0x7f74d4106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f4800 0x7f74d4106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43904/0 (socket says 172.21.15.33:43904) 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d259c700 1 -- 172.21.15.33:0/107985547 learned_addr learned my addr 172.21.15.33:0/107985547 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d1d9b700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40f51a0 0x7f74d41073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d259c700 1 -- 172.21.15.33:0/107985547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40f51a0 msgr2=0x7f74d41073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d259c700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40f51a0 0x7f74d41073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d259c700 1 -- 172.21.15.33:0/107985547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8005040 con 0x7f74d40f4800 2024-02-15T18:27:09.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d1d9b700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40f51a0 0x7f74d41073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:27:09.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74d259c700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f4800 0x7f74d4106eb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f74c40093f0 tx=0x7f74c4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:09.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74c2ffd700 1 -- 172.21.15.33:0/107985547 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c4009ea0 con 0x7f74d40f4800 2024-02-15T18:27:09.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.181+0000 7f74c2ffd700 1 -- 172.21.15.33:0/107985547 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74c4013b10 con 0x7f74d40f4800 2024-02-15T18:27:09.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.182+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d4108570 con 0x7f74d40f4800 2024-02-15T18:27:09.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.182+0000 7f74c2ffd700 1 -- 172.21.15.33:0/107985547 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c400dbc0 con 0x7f74d40f4800 2024-02-15T18:27:09.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.182+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d4108b30 con 0x7f74d40f4800 2024-02-15T18:27:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.183+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d4059100 con 0x7f74d40f4800 2024-02-15T18:27:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.183+0000 7f74c2ffd700 1 -- 172.21.15.33:0/107985547 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f74c401a060 con 0x7f74d40f4800 2024-02-15T18:27:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.183+0000 7f74c2ffd700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f74bc05c300 0x7f74bc05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.183+0000 7f74c2ffd700 1 -- 172.21.15.33:0/107985547 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f74c4075c10 con 0x7f74d40f4800 2024-02-15T18:27:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.183+0000 7f74d1d9b700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f74bc05c300 0x7f74bc05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.184+0000 7f74d1d9b700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f74bc05c300 0x7f74bc05e7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f74c8005010 tx=0x7f74c8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:09.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.187+0000 7f74c2ffd700 1 -- 172.21.15.33:0/107985547 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f74c404c5e0 con 0x7f74d40f4800 2024-02-15T18:27:09.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.352+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f74d40fefc0 con 0x7f74d40f4800 2024-02-15T18:27:09.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.352+0000 7f74c2ffd700 1 -- 172.21.15.33:0/107985547 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7f74c404c1d0 con 0x7f74d40f4800 2024-02-15T18:27:09.348 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f74bc05c300 msgr2=0x7f74bc05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f74bc05c300 0x7f74bc05e7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f74c8005010 tx=0x7f74c8009b30).stop 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f4800 msgr2=0x7f74d4106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f4800 0x7f74d4106eb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f74c40093f0 tx=0x7f74c4006ec0).stop 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 shutdown_connections 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f74bc05c300 0x7f74bc05e7c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f4800 0x7f74d4106eb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 --2- 172.21.15.33:0/107985547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40f51a0 0x7f74d41073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 >> 172.21.15.33:0/107985547 conn(0x7f74d40f0320 msgr2=0x7f74d40fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 shutdown_connections 2024-02-15T18:27:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:09.354+0000 7f74d359e700 1 -- 172.21.15.33:0/107985547 wait complete. 2024-02-15T18:27:10.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:08.543444+0000 mgr.smithi033.apxevf (mgr.14162) 183 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:10.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:08.715483+0000 mon.smithi033 (mon.0) 428 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-15T18:27:10.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:09.234040+0000 mon.smithi033 (mon.0) 429 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:10.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:09.237021+0000 mon.smithi033 (mon.0) 430 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:10.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:09.239429+0000 mon.smithi033 (mon.0) 431 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:10.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:09.352952+0000 mon.smithi033 (mon.0) 432 : audit [DBG] from='client.? 172.21.15.33:0/107985547' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T18:27:10.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:08.543444+0000 mgr.smithi033.apxevf (mgr.14162) 183 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2024-02-15T18:27:10.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:08.715483+0000 mon.smithi033 (mon.0) 428 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-15T18:27:10.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:09.234040+0000 mon.smithi033 (mon.0) 429 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:10.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:09.237021+0000 mon.smithi033 (mon.0) 430 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:10.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:09.239429+0000 mon.smithi033 (mon.0) 431 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:27:10.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:09.352952+0000 mon.smithi033 (mon.0) 432 : audit [DBG] from='client.? 172.21.15.33:0/107985547' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-15T18:27:10.155 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1708021627,"num_in_osds":6,"osd_in_since":1708021610,"num_remapped_pgs":0} 2024-02-15T18:27:10.156 INFO:tasks.cephadm:Setting up client nodes... 2024-02-15T18:27:10.156 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-15T18:27:11.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:10.543957+0000 mgr.smithi033.apxevf (mgr.14162) 184 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:12.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:10.543957+0000 mgr.smithi033.apxevf (mgr.14162) 184 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:13.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 -- 172.21.15.33:0/3371692932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 msgr2=0x7f0f300f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:13.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 --2- 172.21.15.33:0/3371692932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 0x7f0f300f5a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0f24004660 tx=0x7f0f24009b30).stop 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 -- 172.21.15.33:0/3371692932 shutdown_connections 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 --2- 172.21.15.33:0/3371692932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f300f6880 0x7f0f300f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 --2- 172.21.15.33:0/3371692932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 0x7f0f300f5a00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 -- 172.21.15.33:0/3371692932 >> 172.21.15.33:0/3371692932 conn(0x7f0f300f0d40 msgr2=0x7f0f300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 -- 172.21.15.33:0/3371692932 shutdown_connections 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 -- 172.21.15.33:0/3371692932 wait complete. 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 Processor -- start 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.464+0000 7f0f3572c700 1 -- start start 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f3572c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 0x7f0f30109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f3572c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f300f6880 0x7f0f3010c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f3572c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30060630 con 0x7f0f300f55e0 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f3572c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30060770 con 0x7f0f300f6880 2024-02-15T18:27:13.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 0x7f0f30109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 0x7f0f30109d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43920/0 (socket says 172.21.15.33:43920) 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f2effd700 1 -- 172.21.15.33:0/2704758101 learned_addr learned my addr 172.21.15.33:0/2704758101 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f2e7fc700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f300f6880 0x7f0f3010c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f2effd700 1 -- 172.21.15.33:0/2704758101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f300f6880 msgr2=0x7f0f3010c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f2effd700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f300f6880 0x7f0f3010c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f2effd700 1 -- 172.21.15.33:0/2704758101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24005040 con 0x7f0f300f55e0 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f2e7fc700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f300f6880 0x7f0f3010c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f2effd700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 0x7f0f30109d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0f24009f50 tx=0x7f0f24009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f177fe700 1 -- 172.21.15.33:0/2704758101 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f24018070 con 0x7f0f300f55e0 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f177fe700 1 -- 172.21.15.33:0/2704758101 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f24007d70 con 0x7f0f300f55e0 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3010c830 con 0x7f0f300f55e0 2024-02-15T18:27:13.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f177fe700 1 -- 172.21.15.33:0/2704758101 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f2401c620 con 0x7f0f300f55e0 2024-02-15T18:27:13.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.465+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3010cd90 con 0x7f0f300f55e0 2024-02-15T18:27:13.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.466+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f30045ad0 con 0x7f0f300f55e0 2024-02-15T18:27:13.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.467+0000 7f0f177fe700 1 -- 172.21.15.33:0/2704758101 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0f2401c890 con 0x7f0f300f55e0 2024-02-15T18:27:13.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.467+0000 7f0f177fe700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0f1805c2b0 0x7f0f1805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:13.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.467+0000 7f0f177fe700 1 -- 172.21.15.33:0/2704758101 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f0f24077920 con 0x7f0f300f55e0 2024-02-15T18:27:13.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.467+0000 7f0f2e7fc700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0f1805c2b0 0x7f0f1805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:13.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.468+0000 7f0f2e7fc700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0f1805c2b0 0x7f0f1805e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0f2000b830 tx=0x7f0f20008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:13.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.471+0000 7f0f177fe700 1 -- 172.21.15.33:0/2704758101 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0f2404a9a0 con 0x7f0f300f55e0 2024-02-15T18:27:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.693+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f0f300fe070 con 0x7f0f300f55e0 2024-02-15T18:27:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.697+0000 7f0f177fe700 1 -- 172.21.15.33:0/2704758101 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f0f2404dfc0 con 0x7f0f300f55e0 2024-02-15T18:27:13.693 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-02-15T18:27:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCBV85l9K5tKRAAvVvKfo4yUl+gY1yKFVI6Tw== 2024-02-15T18:27:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0f1805c2b0 msgr2=0x7f0f1805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0f1805c2b0 0x7f0f1805e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0f2000b830 tx=0x7f0f20008040).stop 2024-02-15T18:27:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 msgr2=0x7f0f30109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:13.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 0x7f0f30109d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0f24009f50 tx=0x7f0f24009b30).stop 2024-02-15T18:27:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 shutdown_connections 2024-02-15T18:27:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0f1805c2b0 0x7f0f1805e770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f300f55e0 0x7f0f30109d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 --2- 172.21.15.33:0/2704758101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f300f6880 0x7f0f3010c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 >> 172.21.15.33:0/2704758101 conn(0x7f0f300f0d40 msgr2=0x7f0f300fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 shutdown_connections 2024-02-15T18:27:13.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:13.699+0000 7f0f3572c700 1 -- 172.21.15.33:0/2704758101 wait complete. 2024-02-15T18:27:14.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:12.544283+0000 mgr.smithi033.apxevf (mgr.14162) 185 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:14.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:13.694889+0000 mon.smithi033 (mon.0) 433 : audit [INF] from='client.? 172.21.15.33:0/2704758101' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:27:14.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:13.698406+0000 mon.smithi033 (mon.0) 434 : audit [INF] from='client.? 172.21.15.33:0/2704758101' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T18:27:14.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:12.544283+0000 mgr.smithi033.apxevf (mgr.14162) 185 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:14.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:13.694889+0000 mon.smithi033 (mon.0) 433 : audit [INF] from='client.? 172.21.15.33:0/2704758101' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:27:14.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:13.698406+0000 mon.smithi033 (mon.0) 434 : audit [INF] from='client.? 172.21.15.33:0/2704758101' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T18:27:14.438 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:27:14.438 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-15T18:27:14.438 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-15T18:27:14.484 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-15T18:27:15.839 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:14.544729+0000 mgr.smithi033.apxevf (mgr.14162) 186 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:16.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:14.544729+0000 mgr.smithi033.apxevf (mgr.14162) 186 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:16.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 -- 172.21.15.131:0/3887279954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 msgr2=0x7f2a800f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:16.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 --2- 172.21.15.131:0/3887279954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 0x7f2a800f9110 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2a74004660 tx=0x7f2a74009b30).stop 2024-02-15T18:27:16.339 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 -- 172.21.15.131:0/3887279954 shutdown_connections 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 --2- 172.21.15.131:0/3887279954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a800f9690 0x7f2a800fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 --2- 172.21.15.131:0/3887279954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 0x7f2a800f9110 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 -- 172.21.15.131:0/3887279954 >> 172.21.15.131:0/3887279954 conn(0x7f2a800f0b90 msgr2=0x7f2a800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 -- 172.21.15.131:0/3887279954 shutdown_connections 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 -- 172.21.15.131:0/3887279954 wait complete. 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 Processor -- start 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.341+0000 7f2a7f59e700 1 -- start start 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 0x7f2a80106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a800f9690 0x7f2a801073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80107970 con 0x7f2a800f9690 2024-02-15T18:27:16.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7f59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80108170 con 0x7f2a80060310 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 0x7f2a80106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 0x7f2a80106ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53600/0 (socket says 172.21.15.131:53600) 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7e59c700 1 -- 172.21.15.131:0/1604336510 learned_addr learned my addr 172.21.15.131:0/1604336510 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7dd9b700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a800f9690 0x7f2a801073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7e59c700 1 -- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a800f9690 msgr2=0x7f2a801073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7e59c700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a800f9690 0x7f2a801073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7e59c700 1 -- 172.21.15.131:0/1604336510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74005040 con 0x7f2a80060310 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7e59c700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 0x7f2a80106ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2a74009830 tx=0x7f2a74009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a6effd700 1 -- 172.21.15.131:0/1604336510 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a74018070 con 0x7f2a80060310 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a6effd700 1 -- 172.21.15.131:0/1604336510 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a74007ba0 con 0x7f2a80060310 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a801083f0 con 0x7f2a80060310 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a6effd700 1 -- 172.21.15.131:0/1604336510 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7401c3c0 con 0x7f2a80060310 2024-02-15T18:27:16.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.342+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a80108950 con 0x7f2a80060310 2024-02-15T18:27:16.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.343+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a80059100 con 0x7f2a80060310 2024-02-15T18:27:16.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.343+0000 7f2a6effd700 1 -- 172.21.15.131:0/1604336510 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2a74007d10 con 0x7f2a80060310 2024-02-15T18:27:16.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.344+0000 7f2a6effd700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2a6805c300 0x7f2a6805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.344+0000 7f2a6effd700 1 -- 172.21.15.131:0/1604336510 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f2a74077800 con 0x7f2a80060310 2024-02-15T18:27:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.344+0000 7f2a7dd9b700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2a6805c300 0x7f2a6805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:16.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.344+0000 7f2a7dd9b700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2a6805c300 0x7f2a6805e7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2a800600e0 tx=0x7f2a7000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.348+0000 7f2a6effd700 1 -- 172.21.15.131:0/1604336510 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2a7404a7a0 con 0x7f2a80060310 2024-02-15T18:27:16.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.554+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f2a800fee20 con 0x7f2a80060310 2024-02-15T18:27:16.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.560+0000 7f2a6effd700 1 -- 172.21.15.131:0/1604336510 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f2a7404ddc0 con 0x7f2a80060310 2024-02-15T18:27:16.557 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2024-02-15T18:27:16.557 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCEV85l5ussIRAA2a4LG8v3/2rftZefa0M7Lw== 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2a6805c300 msgr2=0x7f2a6805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2a6805c300 0x7f2a6805e7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f2a800600e0 tx=0x7f2a7000b040).stop 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 msgr2=0x7f2a80106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 0x7f2a80106ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2a74009830 tx=0x7f2a74009b30).stop 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 shutdown_connections 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2a6805c300 0x7f2a6805e7c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a80060310 0x7f2a80106ed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 --2- 172.21.15.131:0/1604336510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a800f9690 0x7f2a801073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 >> 172.21.15.131:0/1604336510 conn(0x7f2a800f0b90 msgr2=0x7f2a800f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 shutdown_connections 2024-02-15T18:27:16.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:27:16.562+0000 7f2a7f59e700 1 -- 172.21.15.131:0/1604336510 wait complete. 2024-02-15T18:27:17.208 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:27:17.209 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-15T18:27:17.209 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-15T18:27:17.250 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T18:27:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:17.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:16.502766+0000 mon.smithi033 (mon.0) 435 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:17.552 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:16.507785+0000 mon.smithi033 (mon.0) 436 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:17.552 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:16.545185+0000 mgr.smithi033.apxevf (mgr.14162) 187 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:17.552 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:16.556121+0000 mon.smithi131 (mon.1) 14 : audit [INF] from='client.? 172.21.15.131:0/1604336510' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:27:17.552 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:16.556458+0000 mon.smithi033 (mon.0) 437 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:27:17.552 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:16.561357+0000 mon.smithi033 (mon.0) 438 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T18:27:17.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:16.502766+0000 mon.smithi033 (mon.0) 435 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:17.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:16.507785+0000 mon.smithi033 (mon.0) 436 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:27:17.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:16.545185+0000 mgr.smithi033.apxevf (mgr.14162) 187 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:17.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:16.556121+0000 mon.smithi131 (mon.1) 14 : audit [INF] from='client.? 172.21.15.131:0/1604336510' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:27:17.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:16.556458+0000 mon.smithi033 (mon.0) 437 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-15T18:27:17.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:16.561357+0000 mon.smithi033 (mon.0) 438 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-15T18:27:19.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.418+0000 7f125652f700 1 -- 172.21.15.33:0/3462438930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 msgr2=0x7f12500f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:19.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.418+0000 7f125652f700 1 --2- 172.21.15.33:0/3462438930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 0x7f12500f6be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f1240004660 tx=0x7f1240009b30).stop 2024-02-15T18:27:19.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.418+0000 7f125652f700 1 -- 172.21.15.33:0/3462438930 shutdown_connections 2024-02-15T18:27:19.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.418+0000 7f125652f700 1 --2- 172.21.15.33:0/3462438930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12500f7a60 0x7f12500f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:19.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.418+0000 7f125652f700 1 --2- 172.21.15.33:0/3462438930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 0x7f12500f6be0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:19.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.418+0000 7f125652f700 1 -- 172.21.15.33:0/3462438930 >> 172.21.15.33:0/3462438930 conn(0x7f12500f1f20 msgr2=0x7f12500f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:19.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.418+0000 7f125652f700 1 -- 172.21.15.33:0/3462438930 shutdown_connections 2024-02-15T18:27:19.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.418+0000 7f125652f700 1 -- 172.21.15.33:0/3462438930 wait complete. 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.419+0000 7f125652f700 1 Processor -- start 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.419+0000 7f125652f700 1 -- start start 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f125652f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 0x7f12501071b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f125652f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12500f7a60 0x7f12501076a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f125652f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250107ce0 con 0x7f12500f67c0 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f125652f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250108590 con 0x7f12500f7a60 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 0x7f12501071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 0x7f12501071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43338/0 (socket says 172.21.15.33:43338) 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124ffff700 1 -- 172.21.15.33:0/4123536616 learned_addr learned my addr 172.21.15.33:0/4123536616 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124ffff700 1 -- 172.21.15.33:0/4123536616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12500f7a60 msgr2=0x7f12501076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124ffff700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12500f7a60 0x7f12501076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124ffff700 1 -- 172.21.15.33:0/4123536616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240005040 con 0x7f12500f67c0 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124ffff700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 0x7f12501071b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f1240009f50 tx=0x7f1240009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:19.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124cff9700 1 -- 172.21.15.33:0/4123536616 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1240018070 con 0x7f12500f67c0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124cff9700 1 -- 172.21.15.33:0/4123536616 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1240007d70 con 0x7f12500f67c0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1250108810 con 0x7f12500f67c0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f124cff9700 1 -- 172.21.15.33:0/4123536616 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124001c620 con 0x7f12500f67c0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.420+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1250108d70 con 0x7f12500f67c0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.421+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1250059100 con 0x7f12500f67c0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.422+0000 7f124cff9700 1 -- 172.21.15.33:0/4123536616 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f124001d420 con 0x7f12500f67c0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.422+0000 7f124cff9700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f123805c2a0 0x7f123805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.422+0000 7f124cff9700 1 -- 172.21.15.33:0/4123536616 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f1240077970 con 0x7f12500f67c0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.422+0000 7f124f7fe700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f123805c2a0 0x7f123805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.423+0000 7f124f7fe700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f123805c2a0 0x7f123805e760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1244009610 tx=0x7f1244006ab0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.426+0000 7f124cff9700 1 -- 172.21.15.33:0/4123536616 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f124004a9f0 con 0x7f12500f67c0 2024-02-15T18:27:19.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:18.545663+0000 mgr.smithi033.apxevf (mgr.14162) 188 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:19.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.584+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1250045ad0 con 0x7f12500f67c0 2024-02-15T18:27:19.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.585+0000 7f124cff9700 1 -- 172.21.15.33:0/4123536616 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+10896 (secure 0 0 0) 0x7f124004e010 con 0x7f12500f67c0 2024-02-15T18:27:19.581 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:27:19.581 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:21:46.103137+0000","modified":"2024-02-15T18:27:08.709592+0000","last_up_change":"2024-02-15T18:27:07.699530+0000","last_in_change":"2024-02-15T18:26:50.170774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:26:18.348861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"0ff15bf7-6db5-4333-82b6-b609dccf7266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6803","nonce":1923638632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6805","nonce":1923638632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6809","nonce":1923638632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6807","nonce":1923638632}]},"public_addr":"172.21.15.33:6803/1923638632","cluster_addr":"172.21.15.33:6805/1923638632","heartbeat_back_addr":"172.21.15.33:6809/1923638632","heartbeat_front_addr":"172.21.15.33:6807/1923638632","state":["exists","up"]},{"osd":1,"uuid":"7b795f15-d524-44fd-8dca-d5b4653dafbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6811","nonce":318646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6813","nonce":318646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6817","nonce":318646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6815","nonce":318646837}]},"public_addr":"172.21.15.33:6811/318646837","cluster_addr":"172.21.15.33:6813/318646837","heartbeat_back_addr":"172.21.15.33:6817/318646837","heartbeat_front_addr":"172.21.15.33:6815/318646837","state":["exists","up"]},{"osd":2,"uuid":"47a30c41-97a6-451b-9941-8e225aff3535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6819","nonce":3415315149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6821","nonce":3415315149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6825","nonce":3415315149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6823","nonce":3415315149}]},"public_addr":"172.21.15.33:6819/3415315149","cluster_addr":"172.21.15.33:6821/3415315149","heartbeat_back_addr":"172.21.15.33:6825/3415315149","heartbeat_front_addr":"172.21.15.33:6823/3415315149","state":["exists","up"]},{"osd":3,"uuid":"d342c704-b853-421a-8f27-803f201e73c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6801","nonce":4035744604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6803","nonce":4035744604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6807","nonce":4035744604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6805","nonce":4035744604}]},"public_addr":"172.21.15.131:6801/4035744604","cluster_addr":"172.21.15.131:6803/4035744604","heartbeat_back_addr":"172.21.15.131:6807/4035744604","heartbeat_front_addr":"172.21.15.131:6805/4035744604","state":["exists","up"]},{"osd":4,"uuid":"6a318488-8764-4284-b2c7-811c9bf5f312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6809","nonce":17489211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6811","nonce":17489211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6815","nonce":17489211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6813","nonce":17489211}]},"public_addr":"172.21.15.131:6809/17489211","cluster_addr":"172.21.15.131:6811/17489211","heartbeat_back_addr":"172.21.15.131:6815/17489211","heartbeat_front_addr":"172.21.15.131:6813/17489211","state":["exists","up"]},{"osd":5,"uuid":"26789e21-a7cc-431d-b59e-5c06f9e676b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6817","nonce":3544205792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6819","nonce":3544205792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6823","nonce":3544205792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6821","nonce":3544205792}]},"public_addr":"172.21.15.131:6817/3544205792","cluster_addr":"172.21.15.131:6819/3544205792","heartbeat_back_addr":"172.21.15.131:6823/3544205792","heartbeat_front_addr":"172.21.15.131:6821/3544205792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:06.812056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:38.581855+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:03.660797+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:22.777140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:44.193385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:27:06.090258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2117788911":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6800/1651162060":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6801/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/9598196":"2024-02-16T18:22:37.704559+0000","172.21.15.33:6800/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/1847321696":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/1388323627":"2024-02-16T18:22:16.059979+0000","172.21.15.33:0/2037477695":"2024-02-16T18:22:54.446695+0000","172.21.15.33:0/805181307":"2024-02-16T18:22:16.059979+0000","172.21.15.33:6801/1651162060":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6800/2905208543":"2024-02-16T18:22:16.059979+0000","172.21.15.33:6801/2905208543":"2024-02-16T18:22:16.059979+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:27:19.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.586+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f123805c2a0 msgr2=0x7f123805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:19.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.586+0000 7f125652f700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f123805c2a0 0x7f123805e760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1244009610 tx=0x7f1244006ab0).stop 2024-02-15T18:27:19.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.586+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 msgr2=0x7f12501071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:19.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.586+0000 7f125652f700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 0x7f12501071b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f1240009f50 tx=0x7f1240009b30).stop 2024-02-15T18:27:19.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.587+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 shutdown_connections 2024-02-15T18:27:19.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.587+0000 7f125652f700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f123805c2a0 0x7f123805e760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:19.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.587+0000 7f125652f700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12500f67c0 0x7f12501071b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:19.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.587+0000 7f125652f700 1 --2- 172.21.15.33:0/4123536616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12500f7a60 0x7f12501076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:19.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.587+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 >> 172.21.15.33:0/4123536616 conn(0x7f12500f1f20 msgr2=0x7f12500fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:19.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.587+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 shutdown_connections 2024-02-15T18:27:19.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:19.587+0000 7f125652f700 1 -- 172.21.15.33:0/4123536616 wait complete. 2024-02-15T18:27:19.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:18.545663+0000 mgr.smithi033.apxevf (mgr.14162) 188 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:20.427 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-15T18:26:18.348861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-02-15T18:27:20.427 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-15T18:27:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:20.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:19.585385+0000 mon.smithi033 (mon.0) 439 : audit [DBG] from='client.? 172.21.15.33:0/4123536616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:27:20.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:19.585385+0000 mon.smithi033 (mon.0) 439 : audit [DBG] from='client.? 172.21.15.33:0/4123536616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:27:21.752 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:20.545986+0000 mgr.smithi033.apxevf (mgr.14162) 189 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:21.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:20.545986+0000 mgr.smithi033.apxevf (mgr.14162) 189 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:22.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.494+0000 7f24a3681700 1 -- 172.21.15.33:0/1257235297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 msgr2=0x7f249c0f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:22.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.494+0000 7f24a3681700 1 --2- 172.21.15.33:0/1257235297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 0x7f249c0f6be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f248c004660 tx=0x7f248c009b30).stop 2024-02-15T18:27:22.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.494+0000 7f24a3681700 1 -- 172.21.15.33:0/1257235297 shutdown_connections 2024-02-15T18:27:22.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.494+0000 7f24a3681700 1 --2- 172.21.15.33:0/1257235297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f249c0f7a60 0x7f249c0f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:22.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.494+0000 7f24a3681700 1 --2- 172.21.15.33:0/1257235297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 0x7f249c0f6be0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:22.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.494+0000 7f24a3681700 1 -- 172.21.15.33:0/1257235297 >> 172.21.15.33:0/1257235297 conn(0x7f249c0f1f20 msgr2=0x7f249c0f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:22.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.494+0000 7f24a3681700 1 -- 172.21.15.33:0/1257235297 shutdown_connections 2024-02-15T18:27:22.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.494+0000 7f24a3681700 1 -- 172.21.15.33:0/1257235297 wait complete. 2024-02-15T18:27:22.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.495+0000 7f24a3681700 1 Processor -- start 2024-02-15T18:27:22.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.495+0000 7f24a3681700 1 -- start start 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.495+0000 7f24a3681700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 0x7f249c1071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.495+0000 7f24a3681700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f249c0f7a60 0x7f249c1076b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.495+0000 7f24a3681700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c107c60 con 0x7f249c0f67c0 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.495+0000 7f24a3681700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c107da0 con 0x7f249c0f7a60 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.495+0000 7f24a141d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 0x7f249c1071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.495+0000 7f24a141d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 0x7f249c1071c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43360/0 (socket says 172.21.15.33:43360) 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.495+0000 7f24a141d700 1 -- 172.21.15.33:0/3786345805 learned_addr learned my addr 172.21.15.33:0/3786345805 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f24a0c1c700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f249c0f7a60 0x7f249c1076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f24a141d700 1 -- 172.21.15.33:0/3786345805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f249c0f7a60 msgr2=0x7f249c1076b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f24a141d700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f249c0f7a60 0x7f249c1076b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f24a141d700 1 -- 172.21.15.33:0/3786345805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c005040 con 0x7f249c0f67c0 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f24a141d700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 0x7f249c1071c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f248c004e30 tx=0x7f248c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f2491ffb700 1 -- 172.21.15.33:0/3786345805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248c018070 con 0x7f249c0f67c0 2024-02-15T18:27:22.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f2491ffb700 1 -- 172.21.15.33:0/3786345805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f248c007ba0 con 0x7f249c0f67c0 2024-02-15T18:27:22.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c1086e0 con 0x7f249c0f67c0 2024-02-15T18:27:22.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f2491ffb700 1 -- 172.21.15.33:0/3786345805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248c01c620 con 0x7f249c0f67c0 2024-02-15T18:27:22.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.496+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c108c40 con 0x7f249c0f67c0 2024-02-15T18:27:22.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.497+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c045ad0 con 0x7f249c0f67c0 2024-02-15T18:27:22.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.498+0000 7f2491ffb700 1 -- 172.21.15.33:0/3786345805 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f248c007d10 con 0x7f249c0f67c0 2024-02-15T18:27:22.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.498+0000 7f2491ffb700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f248805c2a0 0x7f248805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:22.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.498+0000 7f2491ffb700 1 -- 172.21.15.33:0/3786345805 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f248c0778d0 con 0x7f249c0f67c0 2024-02-15T18:27:22.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.498+0000 7f24a0c1c700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f248805c2a0 0x7f248805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:22.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.499+0000 7f24a0c1c700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f248805c2a0 0x7f248805e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f24980096c0 tx=0x7f2498009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:22.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.502+0000 7f2491ffb700 1 -- 172.21.15.33:0/3786345805 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f248c04a8d0 con 0x7f249c0f67c0 2024-02-15T18:27:22.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.661+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f249c027a00 con 0x7f249c0f67c0 2024-02-15T18:27:22.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.662+0000 7f2491ffb700 1 -- 172.21.15.33:0/3786345805 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v39) v1 ==== 110+0+10 (secure 0 0 0) 0x7f248c04def0 con 0x7f249c0f67c0 2024-02-15T18:27:22.658 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-02-15T18:27:22.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.663+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f248805c2a0 msgr2=0x7f248805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:22.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.663+0000 7f24a3681700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f248805c2a0 0x7f248805e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f24980096c0 tx=0x7f2498009be0).stop 2024-02-15T18:27:22.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.663+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 msgr2=0x7f249c1071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:22.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.663+0000 7f24a3681700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 0x7f249c1071c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f248c004e30 tx=0x7f248c009b30).stop 2024-02-15T18:27:22.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.663+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 shutdown_connections 2024-02-15T18:27:22.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.663+0000 7f24a3681700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f248805c2a0 0x7f248805e760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:22.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.663+0000 7f24a3681700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0f67c0 0x7f249c1071c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:22.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.663+0000 7f24a3681700 1 --2- 172.21.15.33:0/3786345805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f249c0f7a60 0x7f249c1076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:22.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.663+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 >> 172.21.15.33:0/3786345805 conn(0x7f249c0f1f20 msgr2=0x7f249c0fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:22.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.664+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 shutdown_connections 2024-02-15T18:27:22.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:22.664+0000 7f24a3681700 1 -- 172.21.15.33:0/3786345805 wait complete. 2024-02-15T18:27:23.525 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-15T18:27:23.525 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-15T18:27:23.525 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph mgr dump --format=json 2024-02-15T18:27:23.766 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:23.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:22.546283+0000 mgr.smithi033.apxevf (mgr.14162) 190 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:23.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:22.662680+0000 mon.smithi033 (mon.0) 440 : audit [DBG] from='client.? 172.21.15.33:0/3786345805' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:27:24.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:22.546283+0000 mgr.smithi033.apxevf (mgr.14162) 190 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:24.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:22.662680+0000 mon.smithi033 (mon.0) 440 : audit [DBG] from='client.? 172.21.15.33:0/3786345805' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:27:25.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.676+0000 7f741c8c7700 1 -- 172.21.15.33:0/2482399345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f56c0 msgr2=0x7f74180f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:25.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.676+0000 7f741c8c7700 1 --2- 172.21.15.33:0/2482399345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f56c0 0x7f74180f5ae0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f740c004660 tx=0x7f740c009b30).stop 2024-02-15T18:27:25.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.676+0000 7f741c8c7700 1 -- 172.21.15.33:0/2482399345 shutdown_connections 2024-02-15T18:27:25.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.676+0000 7f741c8c7700 1 --2- 172.21.15.33:0/2482399345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74180f6960 0x7f74180f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:25.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.676+0000 7f741c8c7700 1 --2- 172.21.15.33:0/2482399345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f56c0 0x7f74180f5ae0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:25.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.676+0000 7f741c8c7700 1 -- 172.21.15.33:0/2482399345 >> 172.21.15.33:0/2482399345 conn(0x7f74180f0e20 msgr2=0x7f74180f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.676+0000 7f741c8c7700 1 -- 172.21.15.33:0/2482399345 shutdown_connections 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.676+0000 7f741c8c7700 1 -- 172.21.15.33:0/2482399345 wait complete. 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.676+0000 7f741c8c7700 1 Processor -- start 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f741c8c7700 1 -- start start 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f741c8c7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74180f56c0 0x7f74180f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f741c8c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f6960 0x7f74180f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f741c8c7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180f8200 con 0x7f74180f6960 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f741c8c7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180f8340 con 0x7f74180f56c0 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f7415d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f6960 0x7f74180f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f7415d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f6960 0x7f74180f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33268/0 (socket says 172.21.15.33:33268) 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f7415d9b700 1 -- 172.21.15.33:0/1874845908 learned_addr learned my addr 172.21.15.33:0/1874845908 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f741659c700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74180f56c0 0x7f74180f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f7415d9b700 1 -- 172.21.15.33:0/1874845908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74180f56c0 msgr2=0x7f74180f9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:25.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f7415d9b700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74180f56c0 0x7f74180f9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:25.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f7415d9b700 1 -- 172.21.15.33:0/1874845908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c005040 con 0x7f74180f6960 2024-02-15T18:27:25.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f7415d9b700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f6960 0x7f74180f7ca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f740800c530 tx=0x7f7408007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:25.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.677+0000 7f7406ffd700 1 -- 172.21.15.33:0/1874845908 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f740800f650 con 0x7f74180f6960 2024-02-15T18:27:25.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.678+0000 7f7406ffd700 1 -- 172.21.15.33:0/1874845908 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f740800fc80 con 0x7f74180f6960 2024-02-15T18:27:25.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.678+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74180f8620 con 0x7f74180f6960 2024-02-15T18:27:25.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.678+0000 7f7406ffd700 1 -- 172.21.15.33:0/1874845908 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7408012d80 con 0x7f74180f6960 2024-02-15T18:27:25.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.678+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741810f330 con 0x7f74180f6960 2024-02-15T18:27:25.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.678+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7418045ad0 con 0x7f74180f6960 2024-02-15T18:27:25.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.679+0000 7f7406ffd700 1 -- 172.21.15.33:0/1874845908 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7408010070 con 0x7f74180f6960 2024-02-15T18:27:25.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.679+0000 7f7406ffd700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f740005c2a0 0x7f740005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:25.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.679+0000 7f7406ffd700 1 -- 172.21.15.33:0/1874845908 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f74080758b0 con 0x7f74180f6960 2024-02-15T18:27:25.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.679+0000 7f741659c700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f740005c2a0 0x7f740005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:25.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.680+0000 7f741659c700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f740005c2a0 0x7f740005e760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f74180f95b0 tx=0x7f740c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:25.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.683+0000 7f7406ffd700 1 -- 172.21.15.33:0/1874845908 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f74080452b0 con 0x7f74180f6960 2024-02-15T18:27:25.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:24.546563+0000 mgr.smithi033.apxevf (mgr.14162) 191 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:25.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.884+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f74180fdf90 con 0x7f74180f6960 2024-02-15T18:27:25.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.887+0000 7f7406ffd700 1 -- 172.21.15.33:0/1874845908 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+143499 (secure 0 0 0) 0x7f74080430a0 con 0x7f74180f6960 2024-02-15T18:27:25.885 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f740005c2a0 msgr2=0x7f740005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f740005c2a0 0x7f740005e760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f74180f95b0 tx=0x7f740c009b30).stop 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f6960 msgr2=0x7f74180f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f6960 0x7f74180f7ca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f740800c530 tx=0x7f7408007e20).stop 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 shutdown_connections 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f740005c2a0 0x7f740005e760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74180f56c0 0x7f74180f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 --2- 172.21.15.33:0/1874845908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74180f6960 0x7f74180f7ca0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 >> 172.21.15.33:0/1874845908 conn(0x7f74180f0e20 msgr2=0x7f74180f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:25.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 shutdown_connections 2024-02-15T18:27:25.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:25.889+0000 7f741c8c7700 1 -- 172.21.15.33:0/1874845908 wait complete. 2024-02-15T18:27:26.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:24.546563+0000 mgr.smithi033.apxevf (mgr.14162) 191 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:26.634 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":18,"active_gid":14162,"active_name":"smithi033.apxevf","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":1351334089},{"type":"v1","addr":"172.21.15.33:6801","nonce":1351334089}]},"active_addr":"172.21.15.33:6801/1351334089","active_change":"2024-02-15T18:22:54.447061+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":14204,"name":"smithi131.buibla","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi033.front.sepia.ceph.com:8443/","prometheus":"http://smithi033.front.sepia.ceph.com:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":4,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1585662851}]},{"addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":446078726}]}]}} 2024-02-15T18:27:26.639 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-15T18:27:26.639 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-15T18:27:26.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T18:27:26.880 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:27.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:25.885630+0000 mon.smithi033 (mon.0) 441 : audit [DBG] from='client.? 172.21.15.33:0/1874845908' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-15T18:27:27.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:25.885630+0000 mon.smithi033 (mon.0) 441 : audit [DBG] from='client.? 172.21.15.33:0/1874845908' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-15T18:27:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:26.546953+0000 mgr.smithi033.apxevf (mgr.14162) 192 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:28.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:26.546953+0000 mgr.smithi033.apxevf (mgr.14162) 192 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:28.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.757+0000 7f0bb2a52700 1 -- 172.21.15.33:0/2684932321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 msgr2=0x7f0bac0f4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:28.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.757+0000 7f0bb2a52700 1 --2- 172.21.15.33:0/2684932321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 0x7f0bac0f4e90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f0b9c004660 tx=0x7f0b9c009b30).stop 2024-02-15T18:27:28.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.757+0000 7f0bb2a52700 1 -- 172.21.15.33:0/2684932321 shutdown_connections 2024-02-15T18:27:28.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.757+0000 7f0bb2a52700 1 --2- 172.21.15.33:0/2684932321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bac0f5410 0x7f0bac0f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:28.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.757+0000 7f0bb2a52700 1 --2- 172.21.15.33:0/2684932321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 0x7f0bac0f4e90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:28.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.757+0000 7f0bb2a52700 1 -- 172.21.15.33:0/2684932321 >> 172.21.15.33:0/2684932321 conn(0x7f0bac0f0590 msgr2=0x7f0bac0f29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:28.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.757+0000 7f0bb2a52700 1 -- 172.21.15.33:0/2684932321 shutdown_connections 2024-02-15T18:27:28.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.757+0000 7f0bb2a52700 1 -- 172.21.15.33:0/2684932321 wait complete. 2024-02-15T18:27:28.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.758+0000 7f0bb2a52700 1 Processor -- start 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.758+0000 7f0bb2a52700 1 -- start start 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.758+0000 7f0bb2a52700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 0x7f0bac107200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0bb2a52700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bac0f5410 0x7f0bac1076f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0bb2a52700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac107d30 con 0x7f0bac0f4a70 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0bb2a52700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac1085e0 con 0x7f0bac0f5410 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0babfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 0x7f0bac107200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0babfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 0x7f0bac107200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33296/0 (socket says 172.21.15.33:33296) 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0babfff700 1 -- 172.21.15.33:0/460092816 learned_addr learned my addr 172.21.15.33:0/460092816 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0babfff700 1 -- 172.21.15.33:0/460092816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bac0f5410 msgr2=0x7f0bac1076f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0bab7fe700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bac0f5410 0x7f0bac1076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:28.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0babfff700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bac0f5410 0x7f0bac1076f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0babfff700 1 -- 172.21.15.33:0/460092816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c005040 con 0x7f0bac0f4a70 2024-02-15T18:27:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0bab7fe700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bac0f5410 0x7f0bac1076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:27:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0babfff700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 0x7f0bac107200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0b9c009f50 tx=0x7f0b9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0ba8ff9700 1 -- 172.21.15.33:0/460092816 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9c018070 con 0x7f0bac0f4a70 2024-02-15T18:27:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac108860 con 0x7f0bac0f4a70 2024-02-15T18:27:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0ba8ff9700 1 -- 172.21.15.33:0/460092816 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b9c007d70 con 0x7f0bac0f4a70 2024-02-15T18:27:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0ba8ff9700 1 -- 172.21.15.33:0/460092816 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9c01c620 con 0x7f0bac0f4a70 2024-02-15T18:27:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.759+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac108dc0 con 0x7f0bac0f4a70 2024-02-15T18:27:28.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.760+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac059100 con 0x7f0bac0f4a70 2024-02-15T18:27:28.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.761+0000 7f0ba8ff9700 1 -- 172.21.15.33:0/460092816 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0b9c01c8e0 con 0x7f0bac0f4a70 2024-02-15T18:27:28.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.761+0000 7f0ba8ff9700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0b9405c2a0 0x7f0b9405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:28.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.761+0000 7f0ba8ff9700 1 -- 172.21.15.33:0/460092816 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f0b9c077a20 con 0x7f0bac0f4a70 2024-02-15T18:27:28.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.761+0000 7f0bab7fe700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0b9405c2a0 0x7f0b9405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:28.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.762+0000 7f0bab7fe700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0b9405c2a0 0x7f0b9405e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0bac0f5850 tx=0x7f0ba0008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:28.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.766+0000 7f0ba8ff9700 1 -- 172.21.15.33:0/460092816 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0b9c04aa20 con 0x7f0bac0f4a70 2024-02-15T18:27:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.924+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bac0008d0 con 0x7f0bac0f4a70 2024-02-15T18:27:28.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.924+0000 7f0ba8ff9700 1 -- 172.21.15.33:0/460092816 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+10896 (secure 0 0 0) 0x7f0b9c04e040 con 0x7f0bac0f4a70 2024-02-15T18:27:28.920 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:27:28.920 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:21:46.103137+0000","modified":"2024-02-15T18:27:08.709592+0000","last_up_change":"2024-02-15T18:27:07.699530+0000","last_in_change":"2024-02-15T18:26:50.170774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:26:18.348861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"0ff15bf7-6db5-4333-82b6-b609dccf7266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6803","nonce":1923638632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6805","nonce":1923638632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6809","nonce":1923638632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6807","nonce":1923638632}]},"public_addr":"172.21.15.33:6803/1923638632","cluster_addr":"172.21.15.33:6805/1923638632","heartbeat_back_addr":"172.21.15.33:6809/1923638632","heartbeat_front_addr":"172.21.15.33:6807/1923638632","state":["exists","up"]},{"osd":1,"uuid":"7b795f15-d524-44fd-8dca-d5b4653dafbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6811","nonce":318646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6813","nonce":318646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6817","nonce":318646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6815","nonce":318646837}]},"public_addr":"172.21.15.33:6811/318646837","cluster_addr":"172.21.15.33:6813/318646837","heartbeat_back_addr":"172.21.15.33:6817/318646837","heartbeat_front_addr":"172.21.15.33:6815/318646837","state":["exists","up"]},{"osd":2,"uuid":"47a30c41-97a6-451b-9941-8e225aff3535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6819","nonce":3415315149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6821","nonce":3415315149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6825","nonce":3415315149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6823","nonce":3415315149}]},"public_addr":"172.21.15.33:6819/3415315149","cluster_addr":"172.21.15.33:6821/3415315149","heartbeat_back_addr":"172.21.15.33:6825/3415315149","heartbeat_front_addr":"172.21.15.33:6823/3415315149","state":["exists","up"]},{"osd":3,"uuid":"d342c704-b853-421a-8f27-803f201e73c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6801","nonce":4035744604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6803","nonce":4035744604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6807","nonce":4035744604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6805","nonce":4035744604}]},"public_addr":"172.21.15.131:6801/4035744604","cluster_addr":"172.21.15.131:6803/4035744604","heartbeat_back_addr":"172.21.15.131:6807/4035744604","heartbeat_front_addr":"172.21.15.131:6805/4035744604","state":["exists","up"]},{"osd":4,"uuid":"6a318488-8764-4284-b2c7-811c9bf5f312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6809","nonce":17489211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6811","nonce":17489211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6815","nonce":17489211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6813","nonce":17489211}]},"public_addr":"172.21.15.131:6809/17489211","cluster_addr":"172.21.15.131:6811/17489211","heartbeat_back_addr":"172.21.15.131:6815/17489211","heartbeat_front_addr":"172.21.15.131:6813/17489211","state":["exists","up"]},{"osd":5,"uuid":"26789e21-a7cc-431d-b59e-5c06f9e676b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6817","nonce":3544205792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6819","nonce":3544205792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6823","nonce":3544205792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6821","nonce":3544205792}]},"public_addr":"172.21.15.131:6817/3544205792","cluster_addr":"172.21.15.131:6819/3544205792","heartbeat_back_addr":"172.21.15.131:6823/3544205792","heartbeat_front_addr":"172.21.15.131:6821/3544205792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:06.812056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:38.581855+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:03.660797+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:22.777140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:44.193385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:27:06.090258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2117788911":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6800/1651162060":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6801/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/9598196":"2024-02-16T18:22:37.704559+0000","172.21.15.33:6800/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/1847321696":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/1388323627":"2024-02-16T18:22:16.059979+0000","172.21.15.33:0/2037477695":"2024-02-16T18:22:54.446695+0000","172.21.15.33:0/805181307":"2024-02-16T18:22:16.059979+0000","172.21.15.33:6801/1651162060":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6800/2905208543":"2024-02-16T18:22:16.059979+0000","172.21.15.33:6801/2905208543":"2024-02-16T18:22:16.059979+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:27:28.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0b9405c2a0 msgr2=0x7f0b9405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:28.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0b9405c2a0 0x7f0b9405e760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0bac0f5850 tx=0x7f0ba0008040).stop 2024-02-15T18:27:28.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 msgr2=0x7f0bac107200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:28.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 0x7f0bac107200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0b9c009f50 tx=0x7f0b9c009b30).stop 2024-02-15T18:27:28.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 shutdown_connections 2024-02-15T18:27:28.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f0b9405c2a0 0x7f0b9405e760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:28.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bac0f4a70 0x7f0bac107200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:28.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 --2- 172.21.15.33:0/460092816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bac0f5410 0x7f0bac1076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:28.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 >> 172.21.15.33:0/460092816 conn(0x7f0bac0f0590 msgr2=0x7f0bac0fb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:28.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 shutdown_connections 2024-02-15T18:27:28.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:28.926+0000 7f0bb2a52700 1 -- 172.21.15.33:0/460092816 wait complete. 2024-02-15T18:27:29.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:28.547264+0000 mgr.smithi033.apxevf (mgr.14162) 193 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:29.552 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:28.924937+0000 mon.smithi033 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.33:0/460092816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:27:29.703 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-15T18:27:29.703 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-15T18:27:29.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:28.547264+0000 mgr.smithi033.apxevf (mgr.14162) 193 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:29.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:28.924937+0000 mon.smithi033 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.33:0/460092816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:27:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.872+0000 7f2970b4f700 1 -- 172.21.15.33:0/2870387689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 msgr2=0x7f296c0f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.872+0000 7f2970b4f700 1 --2- 172.21.15.33:0/2870387689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 0x7f296c0f5ae0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f295c004660 tx=0x7f295c009b30).stop 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.872+0000 7f2970b4f700 1 -- 172.21.15.33:0/2870387689 shutdown_connections 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.872+0000 7f2970b4f700 1 --2- 172.21.15.33:0/2870387689 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f6960 0x7f296c0f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.872+0000 7f2970b4f700 1 --2- 172.21.15.33:0/2870387689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 0x7f296c0f5ae0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.872+0000 7f2970b4f700 1 -- 172.21.15.33:0/2870387689 >> 172.21.15.33:0/2870387689 conn(0x7f296c0f0e20 msgr2=0x7f296c0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.872+0000 7f2970b4f700 1 -- 172.21.15.33:0/2870387689 shutdown_connections 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.872+0000 7f2970b4f700 1 -- 172.21.15.33:0/2870387689 wait complete. 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.873+0000 7f2970b4f700 1 Processor -- start 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.873+0000 7f2970b4f700 1 -- start start 2024-02-15T18:27:31.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.873+0000 7f2970b4f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 0x7f296c1060d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.873+0000 7f2970b4f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f6960 0x7f296c1065c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.873+0000 7f2970b4f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c106c00 con 0x7f296c0f56c0 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.873+0000 7f2970b4f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c1074b0 con 0x7f296c0f6960 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.873+0000 7f296a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 0x7f296c1060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.873+0000 7f296a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 0x7f296c1060d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33322/0 (socket says 172.21.15.33:33322) 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.873+0000 7f296a59c700 1 -- 172.21.15.33:0/509859867 learned_addr learned my addr 172.21.15.33:0/509859867 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f2969d9b700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f6960 0x7f296c1065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f296a59c700 1 -- 172.21.15.33:0/509859867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f6960 msgr2=0x7f296c1065c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f296a59c700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f6960 0x7f296c1065c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f296a59c700 1 -- 172.21.15.33:0/509859867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c005040 con 0x7f296c0f56c0 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f296a59c700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 0x7f296c1060d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f295c009f50 tx=0x7f295c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f2962ffd700 1 -- 172.21.15.33:0/509859867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295c018070 con 0x7f296c0f56c0 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f2962ffd700 1 -- 172.21.15.33:0/509859867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f295c007d70 con 0x7f296c0f56c0 2024-02-15T18:27:31.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c107730 con 0x7f296c0f56c0 2024-02-15T18:27:31.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f2962ffd700 1 -- 172.21.15.33:0/509859867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295c01c620 con 0x7f296c0f56c0 2024-02-15T18:27:31.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.874+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c107c90 con 0x7f296c0f56c0 2024-02-15T18:27:31.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.875+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c059100 con 0x7f296c0f56c0 2024-02-15T18:27:31.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.875+0000 7f2962ffd700 1 -- 172.21.15.33:0/509859867 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f295c01c8e0 con 0x7f296c0f56c0 2024-02-15T18:27:31.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.876+0000 7f2962ffd700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f295805c2a0 0x7f295805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:31.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.876+0000 7f2962ffd700 1 -- 172.21.15.33:0/509859867 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f295c077a10 con 0x7f296c0f56c0 2024-02-15T18:27:31.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.876+0000 7f2969d9b700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f295805c2a0 0x7f295805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:31.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.876+0000 7f2969d9b700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f295805c2a0 0x7f295805e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f295400b790 tx=0x7f2954008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:31.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:31.880+0000 7f2962ffd700 1 -- 172.21.15.33:0/509859867 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f295c04aa10 con 0x7f296c0f56c0 2024-02-15T18:27:32.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:30.547596+0000 mgr.smithi033.apxevf (mgr.14162) 194 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:32.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.039+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f296c027a00 con 0x7f296c0f56c0 2024-02-15T18:27:32.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.039+0000 7f2962ffd700 1 -- 172.21.15.33:0/509859867 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+10896 (secure 0 0 0) 0x7f295c04e030 con 0x7f296c0f56c0 2024-02-15T18:27:32.035 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:27:32.035 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:21:46.103137+0000","modified":"2024-02-15T18:27:08.709592+0000","last_up_change":"2024-02-15T18:27:07.699530+0000","last_in_change":"2024-02-15T18:26:50.170774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:26:18.348861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"0ff15bf7-6db5-4333-82b6-b609dccf7266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6803","nonce":1923638632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6805","nonce":1923638632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6809","nonce":1923638632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6807","nonce":1923638632}]},"public_addr":"172.21.15.33:6803/1923638632","cluster_addr":"172.21.15.33:6805/1923638632","heartbeat_back_addr":"172.21.15.33:6809/1923638632","heartbeat_front_addr":"172.21.15.33:6807/1923638632","state":["exists","up"]},{"osd":1,"uuid":"7b795f15-d524-44fd-8dca-d5b4653dafbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6811","nonce":318646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6813","nonce":318646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6817","nonce":318646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6815","nonce":318646837}]},"public_addr":"172.21.15.33:6811/318646837","cluster_addr":"172.21.15.33:6813/318646837","heartbeat_back_addr":"172.21.15.33:6817/318646837","heartbeat_front_addr":"172.21.15.33:6815/318646837","state":["exists","up"]},{"osd":2,"uuid":"47a30c41-97a6-451b-9941-8e225aff3535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6819","nonce":3415315149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6821","nonce":3415315149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6825","nonce":3415315149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6823","nonce":3415315149}]},"public_addr":"172.21.15.33:6819/3415315149","cluster_addr":"172.21.15.33:6821/3415315149","heartbeat_back_addr":"172.21.15.33:6825/3415315149","heartbeat_front_addr":"172.21.15.33:6823/3415315149","state":["exists","up"]},{"osd":3,"uuid":"d342c704-b853-421a-8f27-803f201e73c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6801","nonce":4035744604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6803","nonce":4035744604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6807","nonce":4035744604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6805","nonce":4035744604}]},"public_addr":"172.21.15.131:6801/4035744604","cluster_addr":"172.21.15.131:6803/4035744604","heartbeat_back_addr":"172.21.15.131:6807/4035744604","heartbeat_front_addr":"172.21.15.131:6805/4035744604","state":["exists","up"]},{"osd":4,"uuid":"6a318488-8764-4284-b2c7-811c9bf5f312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6809","nonce":17489211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6811","nonce":17489211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6815","nonce":17489211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6813","nonce":17489211}]},"public_addr":"172.21.15.131:6809/17489211","cluster_addr":"172.21.15.131:6811/17489211","heartbeat_back_addr":"172.21.15.131:6815/17489211","heartbeat_front_addr":"172.21.15.131:6813/17489211","state":["exists","up"]},{"osd":5,"uuid":"26789e21-a7cc-431d-b59e-5c06f9e676b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6817","nonce":3544205792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6819","nonce":3544205792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6823","nonce":3544205792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6821","nonce":3544205792}]},"public_addr":"172.21.15.131:6817/3544205792","cluster_addr":"172.21.15.131:6819/3544205792","heartbeat_back_addr":"172.21.15.131:6823/3544205792","heartbeat_front_addr":"172.21.15.131:6821/3544205792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:06.812056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:38.581855+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:03.660797+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:22.777140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:44.193385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:27:06.090258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2117788911":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6800/1651162060":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6801/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/9598196":"2024-02-16T18:22:37.704559+0000","172.21.15.33:6800/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/1847321696":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/1388323627":"2024-02-16T18:22:16.059979+0000","172.21.15.33:0/2037477695":"2024-02-16T18:22:54.446695+0000","172.21.15.33:0/805181307":"2024-02-16T18:22:16.059979+0000","172.21.15.33:6801/1651162060":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6800/2905208543":"2024-02-16T18:22:16.059979+0000","172.21.15.33:6801/2905208543":"2024-02-16T18:22:16.059979+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f295805c2a0 msgr2=0x7f295805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f295805c2a0 0x7f295805e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f295400b790 tx=0x7f2954008040).stop 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 msgr2=0x7f296c1060d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 0x7f296c1060d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f295c009f50 tx=0x7f295c009b30).stop 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 shutdown_connections 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f295805c2a0 0x7f295805e760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f56c0 0x7f296c1060d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 --2- 172.21.15.33:0/509859867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f6960 0x7f296c1065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 >> 172.21.15.33:0/509859867 conn(0x7f296c0f0e20 msgr2=0x7f296c0fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:32.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 shutdown_connections 2024-02-15T18:27:32.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:32.041+0000 7f2970b4f700 1 -- 172.21.15.33:0/509859867 wait complete. 2024-02-15T18:27:32.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:30.547596+0000 mgr.smithi033.apxevf (mgr.14162) 194 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:32.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:32.040016+0000 mon.smithi033 (mon.0) 443 : audit [DBG] from='client.? 172.21.15.33:0/509859867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:27:32.803 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-15T18:27:33.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:32.040016+0000 mon.smithi033 (mon.0) 443 : audit [DBG] from='client.? 172.21.15.33:0/509859867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:27:33.043 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:33.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:32.548048+0000 mgr.smithi033.apxevf (mgr.14162) 195 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:34.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:32.548048+0000 mgr.smithi033.apxevf (mgr.14162) 195 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:35.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.089+0000 7f9fadf9e700 1 -- 172.21.15.33:0/3243006234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa8060810 msgr2=0x7f9fa80fb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:35.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.089+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/3243006234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa8060810 0x7f9fa80fb800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9f98004660 tx=0x7f9f98009b30).stop 2024-02-15T18:27:35.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.089+0000 7f9fadf9e700 1 -- 172.21.15.33:0/3243006234 shutdown_connections 2024-02-15T18:27:35.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.089+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/3243006234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fa80fbcf0 0x7f9fa80fe0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:35.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.089+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/3243006234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa8060810 0x7f9fa80fb800 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:35.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.089+0000 7f9fadf9e700 1 -- 172.21.15.33:0/3243006234 >> 172.21.15.33:0/3243006234 conn(0x7f9fa80f0e20 msgr2=0x7f9fa80f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:35.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.089+0000 7f9fadf9e700 1 -- 172.21.15.33:0/3243006234 shutdown_connections 2024-02-15T18:27:35.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.089+0000 7f9fadf9e700 1 -- 172.21.15.33:0/3243006234 wait complete. 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fadf9e700 1 Processor -- start 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fadf9e700 1 -- start start 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fadf9e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fa8060810 0x7f9fa8109390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fadf9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa80fbcf0 0x7f9fa8109880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fadf9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8109e30 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fadf9e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8109f70 con 0x7f9fa8060810 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fa6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa80fbcf0 0x7f9fa8109880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fa6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa80fbcf0 0x7f9fa8109880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33344/0 (socket says 172.21.15.33:33344) 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fa6ffd700 1 -- 172.21.15.33:0/2266143617 learned_addr learned my addr 172.21.15.33:0/2266143617 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:35.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.090+0000 7f9fa77fe700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fa8060810 0x7f9fa8109390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.091+0000 7f9fa6ffd700 1 -- 172.21.15.33:0/2266143617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fa8060810 msgr2=0x7f9fa8109390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.091+0000 7f9fa6ffd700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fa8060810 0x7f9fa8109390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.091+0000 7f9fa6ffd700 1 -- 172.21.15.33:0/2266143617 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98005040 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.091+0000 7f9fa6ffd700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa80fbcf0 0x7f9fa8109880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9f9c002700 tx=0x7f9f9c009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.091+0000 7f9f8ffff700 1 -- 172.21.15.33:0/2266143617 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c0079c0 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.091+0000 7f9f8ffff700 1 -- 172.21.15.33:0/2266143617 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f9c00f040 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.091+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa810a910 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.091+0000 7f9f8ffff700 1 -- 172.21.15.33:0/2266143617 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f9c014840 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.091+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa810aed0 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.092+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9fa805dd30 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.092+0000 7f9f8ffff700 1 -- 172.21.15.33:0/2266143617 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9f9c01b060 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.093+0000 7f9f8ffff700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9f9005c2a0 0x7f9f9005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.093+0000 7f9f8ffff700 1 -- 172.21.15.33:0/2266143617 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f9f9c0759e0 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.093+0000 7f9fa77fe700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9f9005c2a0 0x7f9f9005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.093+0000 7f9f8ffff700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] conn(0x7f9f90062030 0x7f9f90064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.093+0000 7f9f8ffff700 1 -- 172.21.15.33:0/2266143617 --> [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f90064b10 con 0x7f9f90062030 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.093+0000 7f9f8ffff700 1 -- 172.21.15.33:0/2266143617 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f9c07a220 con 0x7f9fa80fbcf0 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.093+0000 7f9fa7fff700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] conn(0x7f9f90062030 0x7f9f90064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.093+0000 7f9fa77fe700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9f9005c2a0 0x7f9f9005e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9f98004630 tx=0x7f9f98009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.093+0000 7f9fa7fff700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] conn(0x7f9f90062030 0x7f9f90064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.094+0000 7f9f8ffff700 1 -- 172.21.15.33:0/2266143617 <== osd.0 v2:172.21.15.33:6802/1923638632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f9f90064b10 con 0x7f9f90062030 2024-02-15T18:27:35.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.109+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 --> [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9fa810b390 con 0x7f9f90062030 2024-02-15T18:27:35.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.109+0000 7f9f8ffff700 1 -- 172.21.15.33:0/2266143617 <== osd.0 v2:172.21.15.33:6802/1923638632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9fa810b390 con 0x7f9f90062030 2024-02-15T18:27:35.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.109+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] conn(0x7f9f90062030 msgr2=0x7f9f90064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:35.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.109+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] conn(0x7f9f90062030 0x7f9f90064490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9f9005c2a0 msgr2=0x7f9f9005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9f9005c2a0 0x7f9f9005e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9f98004630 tx=0x7f9f98009b30).stop 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa80fbcf0 msgr2=0x7f9fa8109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa80fbcf0 0x7f9fa8109880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f9f9c002700 tx=0x7f9f9c009d60).stop 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 shutdown_connections 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6802/1923638632,v1:172.21.15.33:6803/1923638632] conn(0x7f9f90062030 0x7f9f90064490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9f9005c2a0 0x7f9f9005e760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fa8060810 0x7f9fa8109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 --2- 172.21.15.33:0/2266143617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fa80fbcf0 0x7f9fa8109880 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 >> 172.21.15.33:0/2266143617 conn(0x7f9fa80f0e20 msgr2=0x7f9fa80f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 shutdown_connections 2024-02-15T18:27:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:35.110+0000 7f9fadf9e700 1 -- 172.21.15.33:0/2266143617 wait complete. 2024-02-15T18:27:35.768 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:34.548423+0000 mgr.smithi033.apxevf (mgr.14162) 196 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:35.791 INFO:teuthology.orchestra.run.smithi033.stdout:38654705697 2024-02-15T18:27:35.791 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-15T18:27:36.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:34.548423+0000 mgr.smithi033.apxevf (mgr.14162) 196 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:36.032 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:37.677 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:36.548814+0000 mgr.smithi033.apxevf (mgr.14162) 197 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:37.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 -- 172.21.15.33:0/1879324385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 msgr2=0x7fad6c0f9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:37.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 --2- 172.21.15.33:0/1879324385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 0x7fad6c0f9440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fad60004660 tx=0x7fad60009b30).stop 2024-02-15T18:27:37.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 -- 172.21.15.33:0/1879324385 shutdown_connections 2024-02-15T18:27:37.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 --2- 172.21.15.33:0/1879324385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad6c0f9930 0x7fad6c0fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:37.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 --2- 172.21.15.33:0/1879324385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 0x7fad6c0f9440 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:37.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 -- 172.21.15.33:0/1879324385 >> 172.21.15.33:0/1879324385 conn(0x7fad6c0f0e20 msgr2=0x7fad6c0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 -- 172.21.15.33:0/1879324385 shutdown_connections 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 -- 172.21.15.33:0/1879324385 wait complete. 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 Processor -- start 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.946+0000 7fad72ad5700 1 -- start start 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad72ad5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 0x7fad6c1070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad72ad5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad6c0f9930 0x7fad6c1075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad72ad5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c107b70 con 0x7fad6c0607d0 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad72ad5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c107cb0 con 0x7fad6c0f9930 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad70871700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 0x7fad6c1070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad70871700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 0x7fad6c1070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54438/0 (socket says 172.21.15.33:54438) 2024-02-15T18:27:37.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad70871700 1 -- 172.21.15.33:0/268970463 learned_addr learned my addr 172.21.15.33:0/268970463 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:37.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad70871700 1 -- 172.21.15.33:0/268970463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad6c0f9930 msgr2=0x7fad6c1075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:37.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad70871700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad6c0f9930 0x7fad6c1075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:37.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad70871700 1 -- 172.21.15.33:0/268970463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60005040 con 0x7fad6c0607d0 2024-02-15T18:27:37.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad70871700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 0x7fad6c1070d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fad60000c00 tx=0x7fad6000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:37.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad697fa700 1 -- 172.21.15.33:0/268970463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad60019070 con 0x7fad6c0607d0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad697fa700 1 -- 172.21.15.33:0/268970463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad60007e90 con 0x7fad6c0607d0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c1085f0 con 0x7fad6c0607d0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad697fa700 1 -- 172.21.15.33:0/268970463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad60014e20 con 0x7fad6c0607d0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.947+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c108b50 con 0x7fad6c0607d0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.948+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad6c05dd30 con 0x7fad6c0607d0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.949+0000 7fad697fa700 1 -- 172.21.15.33:0/268970463 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fad60025070 con 0x7fad6c0607d0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.949+0000 7fad697fa700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fad5c05c240 0x7fad5c05e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.949+0000 7fad697fa700 1 -- 172.21.15.33:0/268970463 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fad60076f60 con 0x7fad6c0607d0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.949+0000 7fad6bfff700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fad5c05c240 0x7fad5c05e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.949+0000 7fad697fa700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] conn(0x7fad5c061fd0 0x7fad5c064430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.949+0000 7fad697fa700 1 -- 172.21.15.33:0/268970463 --> [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad5c064ab0 con 0x7fad5c061fd0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.949+0000 7fad697fa700 1 -- 172.21.15.33:0/268970463 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad60077360 con 0x7fad6c0607d0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.949+0000 7fad71072700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] conn(0x7fad5c061fd0 0x7fad5c064430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.950+0000 7fad6bfff700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fad5c05c240 0x7fad5c05e700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fad6c0605a0 tx=0x7fad5800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:37.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.950+0000 7fad71072700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] conn(0x7fad5c061fd0 0x7fad5c064430 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:37.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.950+0000 7fad697fa700 1 -- 172.21.15.33:0/268970463 <== osd.1 v2:172.21.15.33:6810/318646837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fad5c064ab0 con 0x7fad5c061fd0 2024-02-15T18:27:37.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.965+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 --> [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad6c109000 con 0x7fad5c061fd0 2024-02-15T18:27:37.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.965+0000 7fad697fa700 1 -- 172.21.15.33:0/268970463 <== osd.1 v2:172.21.15.33:6810/318646837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fad6c109000 con 0x7fad5c061fd0 2024-02-15T18:27:37.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.965+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] conn(0x7fad5c061fd0 msgr2=0x7fad5c064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:37.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.965+0000 7fad72ad5700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] conn(0x7fad5c061fd0 0x7fad5c064430 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:37.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.965+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fad5c05c240 msgr2=0x7fad5c05e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:37.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.965+0000 7fad72ad5700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fad5c05c240 0x7fad5c05e700 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fad6c0605a0 tx=0x7fad5800b040).stop 2024-02-15T18:27:37.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.965+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 msgr2=0x7fad6c1070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.965+0000 7fad72ad5700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 0x7fad6c1070d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fad60000c00 tx=0x7fad6000b040).stop 2024-02-15T18:27:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.966+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 shutdown_connections 2024-02-15T18:27:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.966+0000 7fad72ad5700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fad5c05c240 0x7fad5c05e700 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.966+0000 7fad72ad5700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:6810/318646837,v1:172.21.15.33:6811/318646837] conn(0x7fad5c061fd0 0x7fad5c064430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.966+0000 7fad72ad5700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c0607d0 0x7fad6c1070d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.966+0000 7fad72ad5700 1 --2- 172.21.15.33:0/268970463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad6c0f9930 0x7fad6c1075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.966+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 >> 172.21.15.33:0/268970463 conn(0x7fad6c0f0e20 msgr2=0x7fad6c0f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.966+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 shutdown_connections 2024-02-15T18:27:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:37.966+0000 7fad72ad5700 1 -- 172.21.15.33:0/268970463 wait complete. 2024-02-15T18:27:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:36.548814+0000 mgr.smithi033.apxevf (mgr.14162) 197 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:38.791 INFO:teuthology.orchestra.run.smithi033.stdout:60129542171 2024-02-15T18:27:38.792 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-15T18:27:39.030 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:39.503 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:38.549247+0000 mgr.smithi033.apxevf (mgr.14162) 198 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:39.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:38.549247+0000 mgr.smithi033.apxevf (mgr.14162) 198 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.010+0000 7fa6f19e9700 1 -- 172.21.15.33:0/4294579107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 msgr2=0x7fa6ec0f6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.010+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/4294579107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 0x7fa6ec0f6c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fa6dc004660 tx=0x7fa6dc009b30).stop 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.010+0000 7fa6f19e9700 1 -- 172.21.15.33:0/4294579107 shutdown_connections 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/4294579107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 0x7fa6ec0f6c50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/4294579107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6ec0f5550 0x7fa6ec0f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 -- 172.21.15.33:0/4294579107 >> 172.21.15.33:0/4294579107 conn(0x7fa6ec0f0cb0 msgr2=0x7fa6ec0f30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 -- 172.21.15.33:0/4294579107 shutdown_connections 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 -- 172.21.15.33:0/4294579107 wait complete. 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 Processor -- start 2024-02-15T18:27:41.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 -- start start 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6ec0f5550 0x7fa6ec0f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 0x7fa6ec0f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0f8120 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.011+0000 7fa6f19e9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0f8260 con 0x7fa6ec0f5550 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6ea7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 0x7fa6ec0f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6ea7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 0x7fa6ec0f7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54458/0 (socket says 172.21.15.33:54458) 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6ea7fc700 1 -- 172.21.15.33:0/3371500181 learned_addr learned my addr 172.21.15.33:0/3371500181 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6ea7fc700 1 -- 172.21.15.33:0/3371500181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6ec0f5550 msgr2=0x7fa6ec0f96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6ea7fc700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6ec0f5550 0x7fa6ec0f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6ea7fc700 1 -- 172.21.15.33:0/3371500181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc005040 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6ea7fc700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 0x7fa6ec0f7b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fa6dc009830 tx=0x7fa6dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6d37fe700 1 -- 172.21.15.33:0/3371500181 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6dc018070 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6d37fe700 1 -- 172.21.15.33:0/3371500181 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6dc007d70 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec0f84e0 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6d37fe700 1 -- 172.21.15.33:0/3371500181 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6dc01c620 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.012+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec10f010 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.013+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6ec05db80 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6d37fe700 1 -- 172.21.15.33:0/3371500181 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa6dc01d980 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6d37fe700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa6d405c2b0 0x7fa6d405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6d37fe700 1 -- 172.21.15.33:0/3371500181 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fa6dc0779a0 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6eaffd700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa6d405c2b0 0x7fa6d405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6d37fe700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] conn(0x7fa6d4062040 0x7fa6d40644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6d37fe700 1 -- 172.21.15.33:0/3371500181 --> [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6d4064b20 con 0x7fa6d4062040 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6d37fe700 1 -- 172.21.15.33:0/3371500181 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6dc07c220 con 0x7fa6ec0f67f0 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6eb7fe700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] conn(0x7fa6d4062040 0x7fa6d40644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6eaffd700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa6d405c2b0 0x7fa6d405e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa6ec0f9440 tx=0x7fa6e0006ab0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.014+0000 7fa6eb7fe700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] conn(0x7fa6d4062040 0x7fa6d40644a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:41.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.015+0000 7fa6d37fe700 1 -- 172.21.15.33:0/3371500181 <== osd.2 v2:172.21.15.33:6818/3415315149 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa6d4064b20 con 0x7fa6d4062040 2024-02-15T18:27:41.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 --> [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6ec0fae70 con 0x7fa6d4062040 2024-02-15T18:27:41.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6d37fe700 1 -- 172.21.15.33:0/3371500181 <== osd.2 v2:172.21.15.33:6818/3415315149 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6ec0fae70 con 0x7fa6d4062040 2024-02-15T18:27:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] conn(0x7fa6d4062040 msgr2=0x7fa6d40644a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] conn(0x7fa6d4062040 0x7fa6d40644a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa6d405c2b0 msgr2=0x7fa6d405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa6d405c2b0 0x7fa6d405e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa6ec0f9440 tx=0x7fa6e0006ab0).stop 2024-02-15T18:27:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 msgr2=0x7fa6ec0f7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 0x7fa6ec0f7b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fa6dc009830 tx=0x7fa6dc009b30).stop 2024-02-15T18:27:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 shutdown_connections 2024-02-15T18:27:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6818/3415315149,v1:172.21.15.33:6819/3415315149] conn(0x7fa6d4062040 0x7fa6d40644a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa6d405c2b0 0x7fa6d405e770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6ec0f5550 0x7fa6ec0f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:41.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 --2- 172.21.15.33:0/3371500181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6ec0f67f0 0x7fa6ec0f7b30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:41.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 >> 172.21.15.33:0/3371500181 conn(0x7fa6ec0f0cb0 msgr2=0x7fa6ec0603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:41.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 shutdown_connections 2024-02-15T18:27:41.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:41.030+0000 7fa6f19e9700 1 -- 172.21.15.33:0/3371500181 wait complete. 2024-02-15T18:27:41.699 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:40.549582+0000 mgr.smithi033.apxevf (mgr.14162) 199 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:41.722 INFO:teuthology.orchestra.run.smithi033.stdout:81604378647 2024-02-15T18:27:41.723 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-15T18:27:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:42.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:40.549582+0000 mgr.smithi033.apxevf (mgr.14162) 199 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.903+0000 7f3bf950f700 1 -- 172.21.15.33:0/1072291287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 msgr2=0x7f3bf40f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.903+0000 7f3bf950f700 1 --2- 172.21.15.33:0/1072291287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 0x7f3bf40f6de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3bdc004660 tx=0x7f3bdc009b30).stop 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.903+0000 7f3bf950f700 1 -- 172.21.15.33:0/1072291287 shutdown_connections 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.903+0000 7f3bf950f700 1 --2- 172.21.15.33:0/1072291287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 0x7f3bf40f6de0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.903+0000 7f3bf950f700 1 --2- 172.21.15.33:0/1072291287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf40f56e0 0x7f3bf40f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.903+0000 7f3bf950f700 1 -- 172.21.15.33:0/1072291287 >> 172.21.15.33:0/1072291287 conn(0x7f3bf40f0e20 msgr2=0x7f3bf40f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.903+0000 7f3bf950f700 1 -- 172.21.15.33:0/1072291287 shutdown_connections 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.903+0000 7f3bf950f700 1 -- 172.21.15.33:0/1072291287 wait complete. 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.904+0000 7f3bf950f700 1 Processor -- start 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.904+0000 7f3bf950f700 1 -- start start 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.904+0000 7f3bf950f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf40f56e0 0x7f3bf40f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.904+0000 7f3bf950f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 0x7f3bf40f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.904+0000 7f3bf950f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40f8220 con 0x7f3bf40f6980 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.904+0000 7f3bf950f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40f8360 con 0x7f3bf40f56e0 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.904+0000 7f3bf27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 0x7f3bf40f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.904+0000 7f3bf27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 0x7f3bf40f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54466/0 (socket says 172.21.15.33:54466) 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.904+0000 7f3bf27fc700 1 -- 172.21.15.33:0/3912902768 learned_addr learned my addr 172.21.15.33:0/3912902768 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3bf2ffd700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf40f56e0 0x7f3bf40f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3bf27fc700 1 -- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf40f56e0 msgr2=0x7f3bf40f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3bf27fc700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf40f56e0 0x7f3bf40f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3bf27fc700 1 -- 172.21.15.33:0/3912902768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc005040 con 0x7f3bf40f6980 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3bf27fc700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 0x7f3bf40f7cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3bdc009830 tx=0x7f3bdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3beb7fe700 1 -- 172.21.15.33:0/3912902768 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bdc018070 con 0x7f3bf40f6980 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3beb7fe700 1 -- 172.21.15.33:0/3912902768 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bdc007ba0 con 0x7f3bf40f6980 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf40f85e0 con 0x7f3bf40f6980 2024-02-15T18:27:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3beb7fe700 1 -- 172.21.15.33:0/3912902768 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bdc01c440 con 0x7f3bf40f6980 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.905+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf40f8b40 con 0x7f3bf40f6980 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.906+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3bf405dcf0 con 0x7f3bf40f6980 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.906+0000 7f3beb7fe700 1 -- 172.21.15.33:0/3912902768 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f3bdc01d420 con 0x7f3bf40f6980 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.907+0000 7f3beb7fe700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3be005c2a0 0x7f3be005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.907+0000 7f3beb7fe700 1 -- 172.21.15.33:0/3912902768 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f3bdc0779f0 con 0x7f3bf40f6980 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.907+0000 7f3bf2ffd700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3be005c2a0 0x7f3be005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.907+0000 7f3beb7fe700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] conn(0x7f3be0062080 0x7f3be00644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.907+0000 7f3beb7fe700 1 -- 172.21.15.33:0/3912902768 --> [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3be0064b60 con 0x7f3be0062080 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.907+0000 7f3beb7fe700 1 -- 172.21.15.33:0/3912902768 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bdc07c220 con 0x7f3bf40f6980 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.907+0000 7f3bf2ffd700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3be005c2a0 0x7f3be005e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3bf40f95d0 tx=0x7f3be4009c00).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.907+0000 7f3bf37fe700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] conn(0x7f3be0062080 0x7f3be00644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.908+0000 7f3bf37fe700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] conn(0x7f3be0062080 0x7f3be00644e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.909+0000 7f3beb7fe700 1 -- 172.21.15.33:0/3912902768 <== osd.3 v2:172.21.15.131:6800/4035744604 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f3be0064b60 con 0x7f3be0062080 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.923+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 --> [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3bf40fb000 con 0x7f3be0062080 2024-02-15T18:27:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3beb7fe700 1 -- 172.21.15.33:0/3912902768 <== osd.3 v2:172.21.15.131:6800/4035744604 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3bf40fb000 con 0x7f3be0062080 2024-02-15T18:27:43.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] conn(0x7f3be0062080 msgr2=0x7f3be00644e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] conn(0x7f3be0062080 0x7f3be00644e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3be005c2a0 msgr2=0x7f3be005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3be005c2a0 0x7f3be005e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3bf40f95d0 tx=0x7f3be4009c00).stop 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 msgr2=0x7f3bf40f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 0x7f3bf40f7cc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3bdc009830 tx=0x7f3bdc009b30).stop 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 shutdown_connections 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:6800/4035744604,v1:172.21.15.131:6801/4035744604] conn(0x7f3be0062080 0x7f3be00644e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f3be005c2a0 0x7f3be005e760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3bf40f56e0 0x7f3bf40f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 --2- 172.21.15.33:0/3912902768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf40f6980 0x7f3bf40f7cc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 >> 172.21.15.33:0/3912902768 conn(0x7f3bf40f0e20 msgr2=0x7f3bf40603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:43.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 shutdown_connections 2024-02-15T18:27:43.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:43.924+0000 7f3bf950f700 1 -- 172.21.15.33:0/3912902768 wait complete. 2024-02-15T18:27:43.948 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:42.549853+0000 mgr.smithi033.apxevf (mgr.14162) 200 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:44.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:42.549853+0000 mgr.smithi033.apxevf (mgr.14162) 200 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:44.600 INFO:teuthology.orchestra.run.smithi033.stdout:115964117011 2024-02-15T18:27:44.601 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-15T18:27:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:45.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:44.550137+0000 mgr.smithi033.apxevf (mgr.14162) 201 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:46.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:44.550137+0000 mgr.smithi033.apxevf (mgr.14162) 201 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.671+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3054965391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 msgr2=0x7f8a9c0f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.671+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3054965391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 0x7f8a9c0f5ae0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f8a90004660 tx=0x7f8a90009b30).stop 2024-02-15T18:27:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.671+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3054965391 shutdown_connections 2024-02-15T18:27:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.671+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3054965391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a9c0f6960 0x7f8a9c0f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.671+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3054965391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 0x7f8a9c0f5ae0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.671+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3054965391 >> 172.21.15.33:0/3054965391 conn(0x7f8a9c0f0e20 msgr2=0x7f8a9c0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.671+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3054965391 shutdown_connections 2024-02-15T18:27:46.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.671+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3054965391 wait complete. 2024-02-15T18:27:46.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8aa16f4700 1 Processor -- start 2024-02-15T18:27:46.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8aa16f4700 1 -- start start 2024-02-15T18:27:46.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8aa16f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 0x7f8a9c1060f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:46.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8aa16f4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a9c0f6960 0x7f8a9c1065e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:46.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8aa16f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c106b90 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8aa16f4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c106cd0 con 0x7f8a9c0f6960 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8a9affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 0x7f8a9c1060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8a9affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 0x7f8a9c1060f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52582/0 (socket says 172.21.15.33:52582) 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8a9affd700 1 -- 172.21.15.33:0/3160119913 learned_addr learned my addr 172.21.15.33:0/3160119913 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8a9a7fc700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a9c0f6960 0x7f8a9c1065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8a9affd700 1 -- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a9c0f6960 msgr2=0x7f8a9c1065e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8a9affd700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a9c0f6960 0x7f8a9c1065e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8a9affd700 1 -- 172.21.15.33:0/3160119913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a90005040 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.672+0000 7f8a9a7fc700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a9c0f6960 0x7f8a9c1065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.673+0000 7f8a9affd700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 0x7f8a9c1060f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8a90004e30 tx=0x7f8a90009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.673+0000 7f8a837fe700 1 -- 172.21.15.33:0/3160119913 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a90018070 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.673+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c107610 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.673+0000 7f8a837fe700 1 -- 172.21.15.33:0/3160119913 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a90007ba0 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.673+0000 7f8a837fe700 1 -- 172.21.15.33:0/3160119913 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a9001c620 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.673+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c107b70 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.673+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a9c05dd30 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.674+0000 7f8a837fe700 1 -- 172.21.15.33:0/3160119913 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8a90007d10 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.674+0000 7f8a837fe700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8a8405c2a0 0x7f8a8405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.674+0000 7f8a837fe700 1 -- 172.21.15.33:0/3160119913 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f8a90077920 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.674+0000 7f8a9a7fc700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8a8405c2a0 0x7f8a8405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.675+0000 7f8a837fe700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] conn(0x7f8a84062030 0x7f8a84064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.675+0000 7f8a837fe700 1 -- 172.21.15.33:0/3160119913 --> [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a84064b10 con 0x7f8a84062030 2024-02-15T18:27:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.675+0000 7f8a837fe700 1 -- 172.21.15.33:0/3160119913 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a9007c220 con 0x7f8a9c0f56c0 2024-02-15T18:27:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.675+0000 7f8a9a7fc700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8a8405c2a0 0x7f8a8405e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8a8c009740 tx=0x7f8a8c009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.675+0000 7f8a9b7fe700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] conn(0x7f8a84062030 0x7f8a84064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.675+0000 7f8a9b7fe700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] conn(0x7f8a84062030 0x7f8a84064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.676+0000 7f8a837fe700 1 -- 172.21.15.33:0/3160119913 <== osd.4 v2:172.21.15.131:6808/17489211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f8a84064b10 con 0x7f8a84062030 2024-02-15T18:27:46.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 --> [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a9c107fd0 con 0x7f8a84062030 2024-02-15T18:27:46.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8a837fe700 1 -- 172.21.15.33:0/3160119913 <== osd.4 v2:172.21.15.131:6808/17489211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8a9c107fd0 con 0x7f8a84062030 2024-02-15T18:27:46.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] conn(0x7f8a84062030 msgr2=0x7f8a84064490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:46.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] conn(0x7f8a84062030 0x7f8a84064490 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:46.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8a8405c2a0 msgr2=0x7f8a8405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:46.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8a8405c2a0 0x7f8a8405e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f8a8c009740 tx=0x7f8a8c009be0).stop 2024-02-15T18:27:46.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 msgr2=0x7f8a9c1060f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 0x7f8a9c1060f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8a90004e30 tx=0x7f8a90009b30).stop 2024-02-15T18:27:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 shutdown_connections 2024-02-15T18:27:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:6808/17489211,v1:172.21.15.131:6809/17489211] conn(0x7f8a84062030 0x7f8a84064490 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.691+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8a8405c2a0 0x7f8a8405e760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.692+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a9c0f56c0 0x7f8a9c1060f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.692+0000 7f8aa16f4700 1 --2- 172.21.15.33:0/3160119913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a9c0f6960 0x7f8a9c1065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.692+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 >> 172.21.15.33:0/3160119913 conn(0x7f8a9c0f0e20 msgr2=0x7f8a9c0fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.692+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 shutdown_connections 2024-02-15T18:27:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:46.692+0000 7f8aa16f4700 1 -- 172.21.15.33:0/3160119913 wait complete. 2024-02-15T18:27:47.494 INFO:teuthology.orchestra.run.smithi033.stdout:141733920783 2024-02-15T18:27:47.495 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-15T18:27:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:47.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:46.550502+0000 mgr.smithi033.apxevf (mgr.14162) 202 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:48.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:46.550502+0000 mgr.smithi033.apxevf (mgr.14162) 202 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.600+0000 7f9fc53fa700 1 -- 172.21.15.33:0/4060661808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f6610 msgr2=0x7f9fc00f6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.600+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/4060661808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f6610 0x7f9fc00f6a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f9fb0004660 tx=0x7f9fb0009b30).stop 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 -- 172.21.15.33:0/4060661808 shutdown_connections 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/4060661808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fc00f78b0 0x7f9fc00f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/4060661808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f6610 0x7f9fc00f6a30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 -- 172.21.15.33:0/4060661808 >> 172.21.15.33:0/4060661808 conn(0x7f9fc00f1d70 msgr2=0x7f9fc00f4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 -- 172.21.15.33:0/4060661808 shutdown_connections 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 -- 172.21.15.33:0/4060661808 wait complete. 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 Processor -- start 2024-02-15T18:27:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 -- start start 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fc00f6610 0x7f9fc0106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.601+0000 7f9fc53fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f78b0 0x7f9fc01074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fc53fa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0107b20 con 0x7f9fc00f78b0 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fc53fa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01083d0 con 0x7f9fc00f6610 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f78b0 0x7f9fc01074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f78b0 0x7f9fc01074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52594/0 (socket says 172.21.15.33:52594) 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbf7fe700 1 -- 172.21.15.33:0/1485290514 learned_addr learned my addr 172.21.15.33:0/1485290514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbffff700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fc00f6610 0x7f9fc0106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbf7fe700 1 -- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fc00f6610 msgr2=0x7f9fc0106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbf7fe700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fc00f6610 0x7f9fc0106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbf7fe700 1 -- 172.21.15.33:0/1485290514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0005040 con 0x7f9fc00f78b0 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbffff700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fc00f6610 0x7f9fc0106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:27:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbf7fe700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f78b0 0x7f9fc01074e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f9fb400b410 tx=0x7f9fb4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbcff9700 1 -- 172.21.15.33:0/1485290514 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb40125f0 con 0x7f9fc00f78b0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbcff9700 1 -- 172.21.15.33:0/1485290514 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fb4012c20 con 0x7f9fc00f78b0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc01086b0 con 0x7f9fc00f78b0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fbcff9700 1 -- 172.21.15.33:0/1485290514 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb4002b30 con 0x7f9fc00f78b0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.602+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc0108c70 con 0x7f9fc00f78b0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.603+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9fc005db80 con 0x7f9fc00f78b0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.604+0000 7f9fbcff9700 1 -- 172.21.15.33:0/1485290514 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9fb400f030 con 0x7f9fc00f78b0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.604+0000 7f9fbcff9700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9fa805c2b0 0x7f9fa805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.604+0000 7f9fbcff9700 1 -- 172.21.15.33:0/1485290514 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f9fb4075f60 con 0x7f9fc00f78b0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.604+0000 7f9fbffff700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9fa805c2b0 0x7f9fa805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.604+0000 7f9fbcff9700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] conn(0x7f9fa8062040 0x7f9fa80644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.604+0000 7f9fbcff9700 1 -- 172.21.15.33:0/1485290514 --> [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fa8064b20 con 0x7f9fa8062040 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.604+0000 7f9fbcff9700 1 -- 172.21.15.33:0/1485290514 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fb4078570 con 0x7f9fc00f78b0 2024-02-15T18:27:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.604+0000 7f9fbffff700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9fa805c2b0 0x7f9fa805e770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9fb0004e30 tx=0x7f9fb0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:49.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.604+0000 7f9fc4bf9700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] conn(0x7f9fa8062040 0x7f9fa80644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:49.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.605+0000 7f9fc4bf9700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] conn(0x7f9fa8062040 0x7f9fa80644a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:49.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.606+0000 7f9fbcff9700 1 -- 172.21.15.33:0/1485290514 <== osd.5 v2:172.21.15.131:6816/3544205792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f9fa8064b20 con 0x7f9fa8062040 2024-02-15T18:27:49.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.620+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 --> [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9fc0109120 con 0x7f9fa8062040 2024-02-15T18:27:49.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fbcff9700 1 -- 172.21.15.33:0/1485290514 <== osd.5 v2:172.21.15.131:6816/3544205792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9fc0109120 con 0x7f9fa8062040 2024-02-15T18:27:49.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] conn(0x7f9fa8062040 msgr2=0x7f9fa80644a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:49.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] conn(0x7f9fa8062040 0x7f9fa80644a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:49.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9fa805c2b0 msgr2=0x7f9fa805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9fa805c2b0 0x7f9fa805e770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9fb0004e30 tx=0x7f9fb0009b30).stop 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f78b0 msgr2=0x7f9fc01074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f78b0 0x7f9fc01074e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f9fb400b410 tx=0x7f9fb4006ef0).stop 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 shutdown_connections 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:6816/3544205792,v1:172.21.15.131:6817/3544205792] conn(0x7f9fa8062040 0x7f9fa80644a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9fa805c2b0 0x7f9fa805e770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fc00f6610 0x7f9fc0106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 --2- 172.21.15.33:0/1485290514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fc00f78b0 0x7f9fc01074e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 >> 172.21.15.33:0/1485290514 conn(0x7f9fc00f1d70 msgr2=0x7f9fc00fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 shutdown_connections 2024-02-15T18:27:49.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:49.621+0000 7f9fc53fa700 1 -- 172.21.15.33:0/1485290514 wait complete. 2024-02-15T18:27:49.638 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:48.550954+0000 mgr.smithi033.apxevf (mgr.14162) 203 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:49.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:48.550954+0000 mgr.smithi033.apxevf (mgr.14162) 203 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:50.431 INFO:teuthology.orchestra.run.smithi033.stdout:163208757260 2024-02-15T18:27:50.432 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-15T18:27:50.672 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:51.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:50.551290+0000 mgr.smithi033.apxevf (mgr.14162) 204 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:52.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:50.551290+0000 mgr.smithi033.apxevf (mgr.14162) 204 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:52.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 -- 172.21.15.33:0/1149699519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 msgr2=0x7f7bf40f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:52.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 --2- 172.21.15.33:0/1149699519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 0x7f7bf40f6be0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f7be8004660 tx=0x7f7be8009b30).stop 2024-02-15T18:27:52.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 -- 172.21.15.33:0/1149699519 shutdown_connections 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 --2- 172.21.15.33:0/1149699519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf40f7a60 0x7f7bf40f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 --2- 172.21.15.33:0/1149699519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 0x7f7bf40f6be0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 -- 172.21.15.33:0/1149699519 >> 172.21.15.33:0/1149699519 conn(0x7f7bf40f1f20 msgr2=0x7f7bf40f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 -- 172.21.15.33:0/1149699519 shutdown_connections 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 -- 172.21.15.33:0/1149699519 wait complete. 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 Processor -- start 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.521+0000 7f7bfb00d700 1 -- start start 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bfb00d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 0x7f7bf41071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bfb00d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf40f7a60 0x7f7bf4107690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bfb00d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4107c40 con 0x7f7bf40f67c0 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bfb00d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4107d80 con 0x7f7bf40f7a60 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bf8da9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 0x7f7bf41071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:52.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bf8da9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 0x7f7bf41071a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52616/0 (socket says 172.21.15.33:52616) 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bf8da9700 1 -- 172.21.15.33:0/3706265589 learned_addr learned my addr 172.21.15.33:0/3706265589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bf3fff700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf40f7a60 0x7f7bf4107690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bf8da9700 1 -- 172.21.15.33:0/3706265589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf40f7a60 msgr2=0x7f7bf4107690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bf8da9700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf40f7a60 0x7f7bf4107690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bf8da9700 1 -- 172.21.15.33:0/3706265589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be8005040 con 0x7f7bf40f67c0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.522+0000 7f7bf8da9700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 0x7f7bf41071a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f7be8004e30 tx=0x7f7be8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.523+0000 7f7bf17fa700 1 -- 172.21.15.33:0/3706265589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be8018070 con 0x7f7bf40f67c0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.523+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf41086c0 con 0x7f7bf40f67c0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.523+0000 7f7bf17fa700 1 -- 172.21.15.33:0/3706265589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7be8007ba0 con 0x7f7bf40f67c0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.523+0000 7f7bf17fa700 1 -- 172.21.15.33:0/3706265589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be801c3c0 con 0x7f7bf40f67c0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.523+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf4108c20 con 0x7f7bf40f67c0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.524+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf4045ad0 con 0x7f7bf40f67c0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.524+0000 7f7bf17fa700 1 -- 172.21.15.33:0/3706265589 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7be8007d10 con 0x7f7bf40f67c0 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.524+0000 7f7bf17fa700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f7be405c2a0 0x7f7be405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.524+0000 7f7bf17fa700 1 -- 172.21.15.33:0/3706265589 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f7be8077790 con 0x7f7bf40f67c0 2024-02-15T18:27:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.524+0000 7f7bf3fff700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f7be405c2a0 0x7f7be405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.525+0000 7f7bf3fff700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f7be405c2a0 0x7f7be405e760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7be0004c40 tx=0x7f7be000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:52.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.528+0000 7f7bf17fa700 1 -- 172.21.15.33:0/3706265589 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7be804a790 con 0x7f7bf40f67c0 2024-02-15T18:27:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.688+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7bf4027a00 con 0x7f7bf40f67c0 2024-02-15T18:27:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.688+0000 7f7bf17fa700 1 -- 172.21.15.33:0/3706265589 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7be804ddb0 con 0x7f7bf40f67c0 2024-02-15T18:27:52.685 INFO:teuthology.orchestra.run.smithi033.stdout:38654705700 2024-02-15T18:27:52.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f7be405c2a0 msgr2=0x7f7be405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:52.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f7be405c2a0 0x7f7be405e760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7be0004c40 tx=0x7f7be000b040).stop 2024-02-15T18:27:52.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 msgr2=0x7f7bf41071a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:52.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 0x7f7bf41071a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f7be8004e30 tx=0x7f7be8009b30).stop 2024-02-15T18:27:52.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 shutdown_connections 2024-02-15T18:27:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f7be405c2a0 0x7f7be405e760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bf40f67c0 0x7f7bf41071a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 --2- 172.21.15.33:0/3706265589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf40f7a60 0x7f7bf4107690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 >> 172.21.15.33:0/3706265589 conn(0x7f7bf40f1f20 msgr2=0x7f7bf40fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 shutdown_connections 2024-02-15T18:27:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:52.690+0000 7f7bfb00d700 1 -- 172.21.15.33:0/3706265589 wait complete. 2024-02-15T18:27:53.380 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705697 got 38654705700 for osd.0 2024-02-15T18:27:53.380 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-15T18:27:53.621 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:53.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:52.551560+0000 mgr.smithi033.apxevf (mgr.14162) 205 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:53.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:52.690261+0000 mon.smithi033 (mon.0) 444 : audit [DBG] from='client.? 172.21.15.33:0/3706265589' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-15T18:27:54.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:52.551560+0000 mgr.smithi033.apxevf (mgr.14162) 205 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:54.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:52.690261+0000 mon.smithi033 (mon.0) 444 : audit [DBG] from='client.? 172.21.15.33:0/3706265589' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-15T18:27:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 -- 172.21.15.33:0/2611382797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 msgr2=0x7f74400f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 --2- 172.21.15.33:0/2611382797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 0x7f74400f6dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f7434004660 tx=0x7f7434009b30).stop 2024-02-15T18:27:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 -- 172.21.15.33:0/2611382797 shutdown_connections 2024-02-15T18:27:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 --2- 172.21.15.33:0/2611382797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 0x7f74400f6dc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:55.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 --2- 172.21.15.33:0/2611382797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74400f56c0 0x7f74400f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:55.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 -- 172.21.15.33:0/2611382797 >> 172.21.15.33:0/2611382797 conn(0x7f74400f0e20 msgr2=0x7f74400f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:55.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 -- 172.21.15.33:0/2611382797 shutdown_connections 2024-02-15T18:27:55.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 -- 172.21.15.33:0/2611382797 wait complete. 2024-02-15T18:27:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 Processor -- start 2024-02-15T18:27:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.320+0000 7f7444e11700 1 -- start start 2024-02-15T18:27:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f7444e11700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74400f56c0 0x7f74400f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:55.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f7444e11700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 0x7f74400f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f7444e11700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400f8200 con 0x7f74400f6960 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f7444e11700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400f8340 con 0x7f74400f56c0 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f743dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 0x7f74400f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f743dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 0x7f74400f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52628/0 (socket says 172.21.15.33:52628) 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f743dd9b700 1 -- 172.21.15.33:0/2937053724 learned_addr learned my addr 172.21.15.33:0/2937053724 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f743e59c700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74400f56c0 0x7f74400f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f743dd9b700 1 -- 172.21.15.33:0/2937053724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74400f56c0 msgr2=0x7f74400f9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f743dd9b700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74400f56c0 0x7f74400f9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f743dd9b700 1 -- 172.21.15.33:0/2937053724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434005040 con 0x7f74400f6960 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f743dd9b700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 0x7f74400f7ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7434009830 tx=0x7f7434009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f742effd700 1 -- 172.21.15.33:0/2937053724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7434018070 con 0x7f74400f6960 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f742effd700 1 -- 172.21.15.33:0/2937053724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7434007ba0 con 0x7f74400f6960 2024-02-15T18:27:55.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74400f85c0 con 0x7f74400f6960 2024-02-15T18:27:55.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f742effd700 1 -- 172.21.15.33:0/2937053724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f743401c3c0 con 0x7f74400f6960 2024-02-15T18:27:55.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.321+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74400f8b20 con 0x7f74400f6960 2024-02-15T18:27:55.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.322+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7440045ad0 con 0x7f74400f6960 2024-02-15T18:27:55.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.323+0000 7f742effd700 1 -- 172.21.15.33:0/2937053724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7434007d10 con 0x7f74400f6960 2024-02-15T18:27:55.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.323+0000 7f742effd700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f742805c2a0 0x7f742805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:55.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.323+0000 7f742effd700 1 -- 172.21.15.33:0/2937053724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f7434077800 con 0x7f74400f6960 2024-02-15T18:27:55.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.323+0000 7f743e59c700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f742805c2a0 0x7f742805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:55.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.323+0000 7f743e59c700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f742805c2a0 0x7f742805e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f74400f95b0 tx=0x7f743000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:55.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.328+0000 7f742effd700 1 -- 172.21.15.33:0/2937053724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f743404a7a0 con 0x7f74400f6960 2024-02-15T18:27:55.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.488+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f744010f820 con 0x7f74400f6960 2024-02-15T18:27:55.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.489+0000 7f742effd700 1 -- 172.21.15.33:0/2937053724 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f743404ddc0 con 0x7f74400f6960 2024-02-15T18:27:55.486 INFO:teuthology.orchestra.run.smithi033.stdout:60129542174 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.491+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f742805c2a0 msgr2=0x7f742805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.491+0000 7f7444e11700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f742805c2a0 0x7f742805e760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f74400f95b0 tx=0x7f743000b040).stop 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.491+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 msgr2=0x7f74400f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.491+0000 7f7444e11700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 0x7f74400f7ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7434009830 tx=0x7f7434009b30).stop 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.491+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 shutdown_connections 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.491+0000 7f7444e11700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f742805c2a0 0x7f742805e760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.491+0000 7f7444e11700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74400f56c0 0x7f74400f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.491+0000 7f7444e11700 1 --2- 172.21.15.33:0/2937053724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74400f6960 0x7f74400f7ca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.492+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 >> 172.21.15.33:0/2937053724 conn(0x7f74400f0e20 msgr2=0x7f74400603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:55.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.492+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 shutdown_connections 2024-02-15T18:27:55.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:55.492+0000 7f7444e11700 1 -- 172.21.15.33:0/2937053724 wait complete. 2024-02-15T18:27:55.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:54.551838+0000 mgr.smithi033.apxevf (mgr.14162) 206 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:55.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:54.657556+0000 mon.smithi033 (mon.0) 445 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:27:55.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:54.657796+0000 mon.smithi033 (mon.0) 446 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:27:55.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:55.490832+0000 mon.smithi033 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.33:0/2937053724' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-15T18:27:56.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:54.551838+0000 mgr.smithi033.apxevf (mgr.14162) 206 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:56.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:54.657556+0000 mon.smithi033 (mon.0) 445 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:27:56.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:54.657796+0000 mon.smithi033 (mon.0) 446 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:27:56.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:55.490832+0000 mon.smithi033 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.33:0/2937053724' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-15T18:27:56.385 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542171 got 60129542174 for osd.1 2024-02-15T18:27:56.385 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-15T18:27:56.626 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:58.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:56.552103+0000 mgr.smithi033.apxevf (mgr.14162) 207 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:58.010 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:56.552103+0000 mgr.smithi033.apxevf (mgr.14162) 207 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.511+0000 7f53b2fed700 1 -- 172.21.15.33:0/1241859533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f56c0 msgr2=0x7f53ac0f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.511+0000 7f53b2fed700 1 --2- 172.21.15.33:0/1241859533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f56c0 0x7f53ac0f5ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f53a0004660 tx=0x7f53a0009b30).stop 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.511+0000 7f53b2fed700 1 -- 172.21.15.33:0/1241859533 shutdown_connections 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.511+0000 7f53b2fed700 1 --2- 172.21.15.33:0/1241859533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0f6960 0x7f53ac0f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.511+0000 7f53b2fed700 1 --2- 172.21.15.33:0/1241859533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f56c0 0x7f53ac0f5ae0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.511+0000 7f53b2fed700 1 -- 172.21.15.33:0/1241859533 >> 172.21.15.33:0/1241859533 conn(0x7f53ac0f0e20 msgr2=0x7f53ac0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.511+0000 7f53b2fed700 1 -- 172.21.15.33:0/1241859533 shutdown_connections 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.511+0000 7f53b2fed700 1 -- 172.21.15.33:0/1241859533 wait complete. 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.512+0000 7f53b2fed700 1 Processor -- start 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.512+0000 7f53b2fed700 1 -- start start 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.512+0000 7f53b2fed700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0f56c0 0x7f53ac1060f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.512+0000 7f53b2fed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f6960 0x7f53ac1065e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.512+0000 7f53b2fed700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac106b90 con 0x7f53ac0f6960 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.512+0000 7f53b2fed700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac106cd0 con 0x7f53ac0f56c0 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.512+0000 7f53abfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f6960 0x7f53ac1065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.512+0000 7f53abfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f6960 0x7f53ac1065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34838/0 (socket says 172.21.15.33:34838) 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.512+0000 7f53abfff700 1 -- 172.21.15.33:0/2190017930 learned_addr learned my addr 172.21.15.33:0/2190017930 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53b0d89700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0f56c0 0x7f53ac1060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53abfff700 1 -- 172.21.15.33:0/2190017930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0f56c0 msgr2=0x7f53ac1060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53abfff700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0f56c0 0x7f53ac1060f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53abfff700 1 -- 172.21.15.33:0/2190017930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a0005040 con 0x7f53ac0f6960 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53abfff700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f6960 0x7f53ac1065e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f53980026d0 tx=0x7f5398009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53a97fa700 1 -- 172.21.15.33:0/2190017930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5398009320 con 0x7f53ac0f6960 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53a97fa700 1 -- 172.21.15.33:0/2190017930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f539800f040 con 0x7f53ac0f6960 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac107670 con 0x7f53ac0f6960 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53a97fa700 1 -- 172.21.15.33:0/2190017930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5398014910 con 0x7f53ac0f6960 2024-02-15T18:27:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.513+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac107c30 con 0x7f53ac0f6960 2024-02-15T18:27:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.514+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac045ad0 con 0x7f53ac0f6960 2024-02-15T18:27:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.514+0000 7f53a97fa700 1 -- 172.21.15.33:0/2190017930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f53980077b0 con 0x7f53ac0f6960 2024-02-15T18:27:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.515+0000 7f53a97fa700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f539c05c2a0 0x7f539c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:27:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.515+0000 7f53a97fa700 1 -- 172.21.15.33:0/2190017930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f5398076080 con 0x7f53ac0f6960 2024-02-15T18:27:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.515+0000 7f53b0d89700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f539c05c2a0 0x7f539c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:27:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.515+0000 7f53b0d89700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f539c05c2a0 0x7f539c05e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f53a0004e30 tx=0x7f53a0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:27:58.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.519+0000 7f53a97fa700 1 -- 172.21.15.33:0/2190017930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5398049100 con 0x7f53ac0f6960 2024-02-15T18:27:58.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.677+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f53ac027a00 con 0x7f53ac0f6960 2024-02-15T18:27:58.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.677+0000 7f53a97fa700 1 -- 172.21.15.33:0/2190017930 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f539804c720 con 0x7f53ac0f6960 2024-02-15T18:27:58.672 INFO:teuthology.orchestra.run.smithi033.stdout:81604378650 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.678+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f539c05c2a0 msgr2=0x7f539c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.678+0000 7f53b2fed700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f539c05c2a0 0x7f539c05e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f53a0004e30 tx=0x7f53a0009b30).stop 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.678+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f6960 msgr2=0x7f53ac1065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.678+0000 7f53b2fed700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f6960 0x7f53ac1065e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f53980026d0 tx=0x7f5398009de0).stop 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.678+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 shutdown_connections 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.679+0000 7f53b2fed700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f539c05c2a0 0x7f539c05e760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.679+0000 7f53b2fed700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53ac0f56c0 0x7f53ac1060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.679+0000 7f53b2fed700 1 --2- 172.21.15.33:0/2190017930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f6960 0x7f53ac1065e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.679+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 >> 172.21.15.33:0/2190017930 conn(0x7f53ac0f0e20 msgr2=0x7f53ac0fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.679+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 shutdown_connections 2024-02-15T18:27:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:27:58.679+0000 7f53b2fed700 1 -- 172.21.15.33:0/2190017930 wait complete. 2024-02-15T18:27:59.476 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378650 for osd.2 2024-02-15T18:27:59.476 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-15T18:27:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:27:59.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:27:58.552371+0000 mgr.smithi033.apxevf (mgr.14162) 208 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:59.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:27:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:27:58.677942+0000 mon.smithi033 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.33:0/2190017930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-15T18:27:59.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:27:58.552371+0000 mgr.smithi033.apxevf (mgr.14162) 208 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:27:59.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:27:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:27:58.677942+0000 mon.smithi033 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.33:0/2190017930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-15T18:28:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.671+0000 7f9a93fff700 1 -- 172.21.15.33:0/2564221360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f48e0 msgr2=0x7f9a940f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.671+0000 7f9a93fff700 1 --2- 172.21.15.33:0/2564221360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f48e0 0x7f9a940f4d00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9a84004660 tx=0x7f9a84009b30).stop 2024-02-15T18:28:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.671+0000 7f9a93fff700 1 -- 172.21.15.33:0/2564221360 shutdown_connections 2024-02-15T18:28:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.671+0000 7f9a93fff700 1 --2- 172.21.15.33:0/2564221360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a940f5280 0x7f9a940f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.671+0000 7f9a93fff700 1 --2- 172.21.15.33:0/2564221360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f48e0 0x7f9a940f4d00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.671+0000 7f9a93fff700 1 -- 172.21.15.33:0/2564221360 >> 172.21.15.33:0/2564221360 conn(0x7f9a940f0400 msgr2=0x7f9a940f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.671+0000 7f9a93fff700 1 -- 172.21.15.33:0/2564221360 shutdown_connections 2024-02-15T18:28:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.671+0000 7f9a93fff700 1 -- 172.21.15.33:0/2564221360 wait complete. 2024-02-15T18:28:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.672+0000 7f9a93fff700 1 Processor -- start 2024-02-15T18:28:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.672+0000 7f9a93fff700 1 -- start start 2024-02-15T18:28:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.672+0000 7f9a93fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a940f48e0 0x7f9a94107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a93fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f5280 0x7f9a94107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a93fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a94107bc0 con 0x7f9a940f5280 2024-02-15T18:28:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a93fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a94108420 con 0x7f9a940f48e0 2024-02-15T18:28:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a927fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f5280 0x7f9a94107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a927fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f5280 0x7f9a94107580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34862/0 (socket says 172.21.15.33:34862) 2024-02-15T18:28:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a927fc700 1 -- 172.21.15.33:0/743315102 learned_addr learned my addr 172.21.15.33:0/743315102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a927fc700 1 -- 172.21.15.33:0/743315102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a940f48e0 msgr2=0x7f9a94107090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a927fc700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a940f48e0 0x7f9a94107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a927fc700 1 -- 172.21.15.33:0/743315102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a84005040 con 0x7f9a940f5280 2024-02-15T18:28:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a927fc700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f5280 0x7f9a94107580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f9a7c0093f0 tx=0x7f9a7c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a8b7fe700 1 -- 172.21.15.33:0/743315102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7c009ea0 con 0x7f9a940f5280 2024-02-15T18:28:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a94108700 con 0x7f9a940f5280 2024-02-15T18:28:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a8b7fe700 1 -- 172.21.15.33:0/743315102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a7c013b10 con 0x7f9a940f5280 2024-02-15T18:28:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a8b7fe700 1 -- 172.21.15.33:0/743315102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7c00dbc0 con 0x7f9a940f5280 2024-02-15T18:28:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.673+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a94108cc0 con 0x7f9a940f5280 2024-02-15T18:28:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.674+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a94059100 con 0x7f9a940f5280 2024-02-15T18:28:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.675+0000 7f9a8b7fe700 1 -- 172.21.15.33:0/743315102 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9a7c01a060 con 0x7f9a940f5280 2024-02-15T18:28:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.675+0000 7f9a8b7fe700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9a8005c2b0 0x7f9a8005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.675+0000 7f9a8b7fe700 1 -- 172.21.15.33:0/743315102 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f9a7c075be0 con 0x7f9a940f5280 2024-02-15T18:28:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.675+0000 7f9a92ffd700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9a8005c2b0 0x7f9a8005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.675+0000 7f9a92ffd700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9a8005c2b0 0x7f9a8005e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9a84009f50 tx=0x7f9a84009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.679+0000 7f9a8b7fe700 1 -- 172.21.15.33:0/743315102 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9a7c04c610 con 0x7f9a940f5280 2024-02-15T18:28:01.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:00.552957+0000 mgr.smithi033.apxevf (mgr.14162) 209 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:01.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.839+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a940008d0 con 0x7f9a940f5280 2024-02-15T18:28:01.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.839+0000 7f9a8b7fe700 1 -- 172.21.15.33:0/743315102 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a7c04c200 con 0x7f9a940f5280 2024-02-15T18:28:01.835 INFO:teuthology.orchestra.run.smithi033.stdout:115964117014 2024-02-15T18:28:01.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9a8005c2b0 msgr2=0x7f9a8005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9a8005c2b0 0x7f9a8005e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9a84009f50 tx=0x7f9a84009b30).stop 2024-02-15T18:28:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f5280 msgr2=0x7f9a94107580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f5280 0x7f9a94107580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f9a7c0093f0 tx=0x7f9a7c006ec0).stop 2024-02-15T18:28:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 shutdown_connections 2024-02-15T18:28:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f9a8005c2b0 0x7f9a8005e770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a940f48e0 0x7f9a94107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 --2- 172.21.15.33:0/743315102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a940f5280 0x7f9a94107580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 >> 172.21.15.33:0/743315102 conn(0x7f9a940f0400 msgr2=0x7f9a940fb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 shutdown_connections 2024-02-15T18:28:01.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:01.841+0000 7f9a93fff700 1 -- 172.21.15.33:0/743315102 wait complete. 2024-02-15T18:28:02.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:00.552957+0000 mgr.smithi033.apxevf (mgr.14162) 209 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:02.511 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117014 for osd.3 2024-02-15T18:28:02.511 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-15T18:28:02.747 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:28:02.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:01.840366+0000 mon.smithi033 (mon.0) 449 : audit [DBG] from='client.? 172.21.15.33:0/743315102' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-15T18:28:03.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:01.840366+0000 mon.smithi033 (mon.0) 449 : audit [DBG] from='client.? 172.21.15.33:0/743315102' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-15T18:28:04.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:02.553251+0000 mgr.smithi033.apxevf (mgr.14162) 210 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:04.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:02.553251+0000 mgr.smithi033.apxevf (mgr.14162) 210 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:04.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.720+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/2175700587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 msgr2=0x7fcdb00f7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.720+0000 7fcdb7c5f700 1 --2- 172.21.15.33:0/2175700587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 0x7fcdb00f7ee0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fcda4004660 tx=0x7fcda4009b30).stop 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.720+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/2175700587 shutdown_connections 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.720+0000 7fcdb7c5f700 1 --2- 172.21.15.33:0/2175700587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 0x7fcdb00f7ee0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.720+0000 7fcdb7c5f700 1 --2- 172.21.15.33:0/2175700587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdb00f67e0 0x7fcdb00f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.720+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/2175700587 >> 172.21.15.33:0/2175700587 conn(0x7fcdb00f1f40 msgr2=0x7fcdb00f4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.720+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/2175700587 shutdown_connections 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.720+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/2175700587 wait complete. 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb7c5f700 1 Processor -- start 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb7c5f700 1 -- start start 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb7c5f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdb00f67e0 0x7fcdb0107190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb7c5f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 0x7fcdb0107680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:04.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb7c5f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0107c30 con 0x7fcdb00f7a80 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb7c5f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0107d70 con 0x7fcdb00f67e0 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb51fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 0x7fcdb0107680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb51fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 0x7fcdb0107680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34882/0 (socket says 172.21.15.33:34882) 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb51fa700 1 -- 172.21.15.33:0/1087541534 learned_addr learned my addr 172.21.15.33:0/1087541534 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.721+0000 7fcdb59fb700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdb00f67e0 0x7fcdb0107190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcdb51fa700 1 -- 172.21.15.33:0/1087541534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdb00f67e0 msgr2=0x7fcdb0107190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcdb51fa700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdb00f67e0 0x7fcdb0107190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcdb51fa700 1 -- 172.21.15.33:0/1087541534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda4005040 con 0x7fcdb00f7a80 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcdb59fb700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdb00f67e0 0x7fcdb0107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcdb51fa700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 0x7fcdb0107680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fcda4009830 tx=0x7fcda4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcda27fc700 1 -- 172.21.15.33:0/1087541534 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcda4018070 con 0x7fcdb00f7a80 2024-02-15T18:28:04.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcda27fc700 1 -- 172.21.15.33:0/1087541534 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcda4007d70 con 0x7fcdb00f7a80 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb01086b0 con 0x7fcdb00f7a80 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcda27fc700 1 -- 172.21.15.33:0/1087541534 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcda401c620 con 0x7fcdb00f7a80 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.722+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb0108c10 con 0x7fcdb00f7a80 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.723+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb0045ad0 con 0x7fcdb00f7a80 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.723+0000 7fcda27fc700 1 -- 172.21.15.33:0/1087541534 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fcda401d980 con 0x7fcdb00f7a80 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.724+0000 7fcda27fc700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd9c05c2a0 0x7fcd9c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.724+0000 7fcda27fc700 1 -- 172.21.15.33:0/1087541534 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fcda4077a70 con 0x7fcdb00f7a80 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.724+0000 7fcdb59fb700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd9c05c2a0 0x7fcd9c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.724+0000 7fcdb59fb700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd9c05c2a0 0x7fcd9c05e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcdb00f78e0 tx=0x7fcdac009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:04.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.728+0000 7fcda27fc700 1 -- 172.21.15.33:0/1087541534 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcda404aa10 con 0x7fcdb00f7a80 2024-02-15T18:28:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.886+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcdb0027a00 con 0x7fcdb00f7a80 2024-02-15T18:28:04.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.886+0000 7fcda27fc700 1 -- 172.21.15.33:0/1087541534 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcda4077e60 con 0x7fcdb00f7a80 2024-02-15T18:28:04.881 INFO:teuthology.orchestra.run.smithi033.stdout:141733920786 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.887+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd9c05c2a0 msgr2=0x7fcd9c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.887+0000 7fcdb7c5f700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd9c05c2a0 0x7fcd9c05e760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcdb00f78e0 tx=0x7fcdac009040).stop 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.887+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 msgr2=0x7fcdb0107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.887+0000 7fcdb7c5f700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 0x7fcdb0107680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fcda4009830 tx=0x7fcda4009b30).stop 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.887+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 shutdown_connections 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.887+0000 7fcdb7c5f700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd9c05c2a0 0x7fcd9c05e760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.887+0000 7fcdb7c5f700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdb00f67e0 0x7fcdb0107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.887+0000 7fcdb7c5f700 1 --2- 172.21.15.33:0/1087541534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdb00f7a80 0x7fcdb0107680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.887+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 >> 172.21.15.33:0/1087541534 conn(0x7fcdb00f1f40 msgr2=0x7fcdb00fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.888+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 shutdown_connections 2024-02-15T18:28:04.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:04.888+0000 7fcdb7c5f700 1 -- 172.21.15.33:0/1087541534 wait complete. 2024-02-15T18:28:05.730 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920783 got 141733920786 for osd.4 2024-02-15T18:28:05.730 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-15T18:28:05.917 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:04.553788+0000 mgr.smithi033.apxevf (mgr.14162) 211 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:05.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:04.886893+0000 mon.smithi033 (mon.0) 450 : audit [DBG] from='client.? 172.21.15.33:0/1087541534' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-15T18:28:05.971 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:28:06.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:04.553788+0000 mgr.smithi033.apxevf (mgr.14162) 211 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:06.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:04.886893+0000 mon.smithi033 (mon.0) 450 : audit [DBG] from='client.? 172.21.15.33:0/1087541534' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-15T18:28:07.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:06.554167+0000 mgr.smithi033.apxevf (mgr.14162) 212 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:07.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.994+0000 7f520309f700 1 -- 172.21.15.33:0/2161678982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f7a70 msgr2=0x7f51fc0f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:07.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.994+0000 7f520309f700 1 --2- 172.21.15.33:0/2161678982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f7a70 0x7f51fc0f7ed0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f51e8004660 tx=0x7f51e8009b30).stop 2024-02-15T18:28:07.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.994+0000 7f520309f700 1 -- 172.21.15.33:0/2161678982 shutdown_connections 2024-02-15T18:28:07.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.994+0000 7f520309f700 1 --2- 172.21.15.33:0/2161678982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f7a70 0x7f51fc0f7ed0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:07.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.994+0000 7f520309f700 1 --2- 172.21.15.33:0/2161678982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51fc0f67d0 0x7f51fc0f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:07.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.994+0000 7f520309f700 1 -- 172.21.15.33:0/2161678982 >> 172.21.15.33:0/2161678982 conn(0x7f51fc0f1f50 msgr2=0x7f51fc0f4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:07.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.994+0000 7f520309f700 1 -- 172.21.15.33:0/2161678982 shutdown_connections 2024-02-15T18:28:07.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.994+0000 7f520309f700 1 -- 172.21.15.33:0/2161678982 wait complete. 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.995+0000 7f520309f700 1 Processor -- start 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.995+0000 7f520309f700 1 -- start start 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.995+0000 7f520309f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f67d0 0x7f51fc107190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.995+0000 7f520309f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51fc0f7a70 0x7f51fc107680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.995+0000 7f520309f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc107cc0 con 0x7f51fc0f67d0 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.995+0000 7f520309f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc108570 con 0x7f51fc0f7a70 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f5200e3b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f67d0 0x7f51fc107190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f5200e3b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f67d0 0x7f51fc107190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46172/0 (socket says 172.21.15.33:46172) 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f5200e3b700 1 -- 172.21.15.33:0/1184660786 learned_addr learned my addr 172.21.15.33:0/1184660786 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f51fbfff700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51fc0f7a70 0x7f51fc107680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f5200e3b700 1 -- 172.21.15.33:0/1184660786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51fc0f7a70 msgr2=0x7f51fc107680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:07.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f5200e3b700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51fc0f7a70 0x7f51fc107680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:07.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f5200e3b700 1 -- 172.21.15.33:0/1184660786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8005040 con 0x7f51fc0f67d0 2024-02-15T18:28:07.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f51fbfff700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51fc0f7a70 0x7f51fc107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:28:07.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f5200e3b700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f67d0 0x7f51fc107190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f51f00093f0 tx=0x7f51f0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:07.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f51f97fa700 1 -- 172.21.15.33:0/1184660786 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51f0009ea0 con 0x7f51fc0f67d0 2024-02-15T18:28:07.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f51f97fa700 1 -- 172.21.15.33:0/1184660786 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51f0013b10 con 0x7f51fc0f67d0 2024-02-15T18:28:07.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f51f97fa700 1 -- 172.21.15.33:0/1184660786 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51f000dbc0 con 0x7f51fc0f67d0 2024-02-15T18:28:07.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51fc108850 con 0x7f51fc0f67d0 2024-02-15T18:28:07.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.996+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc108e10 con 0x7f51fc0f67d0 2024-02-15T18:28:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.997+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc059100 con 0x7f51fc0f67d0 2024-02-15T18:28:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.998+0000 7f51f97fa700 1 -- 172.21.15.33:0/1184660786 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f51f001a060 con 0x7f51fc0f67d0 2024-02-15T18:28:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.998+0000 7f51f97fa700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f51ec05c2a0 0x7f51ec05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.998+0000 7f51f97fa700 1 -- 172.21.15.33:0/1184660786 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f51f0075c10 con 0x7f51fc0f67d0 2024-02-15T18:28:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.998+0000 7f51fbfff700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f51ec05c2a0 0x7f51ec05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:07.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:07.998+0000 7f51fbfff700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f51ec05c2a0 0x7f51ec05e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f51e8005010 tx=0x7f51e8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.002+0000 7f51f97fa700 1 -- 172.21.15.33:0/1184660786 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f51f004c5e0 con 0x7f51fc0f67d0 2024-02-15T18:28:08.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:06.554167+0000 mgr.smithi033.apxevf (mgr.14162) 212 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:08.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.160+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f51fc0ff230 con 0x7f51fc0f67d0 2024-02-15T18:28:08.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.160+0000 7f51f97fa700 1 -- 172.21.15.33:0/1184660786 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51f004c1d0 con 0x7f51fc0f67d0 2024-02-15T18:28:08.156 INFO:teuthology.orchestra.run.smithi033.stdout:163208757263 2024-02-15T18:28:08.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f51ec05c2a0 msgr2=0x7f51ec05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:08.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f51ec05c2a0 0x7f51ec05e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f51e8005010 tx=0x7f51e8009b30).stop 2024-02-15T18:28:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f67d0 msgr2=0x7f51fc107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f67d0 0x7f51fc107190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f51f00093f0 tx=0x7f51f0006ec0).stop 2024-02-15T18:28:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 shutdown_connections 2024-02-15T18:28:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f51ec05c2a0 0x7f51ec05e760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51fc0f67d0 0x7f51fc107190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 --2- 172.21.15.33:0/1184660786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51fc0f7a70 0x7f51fc107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 >> 172.21.15.33:0/1184660786 conn(0x7f51fc0f1f50 msgr2=0x7f51fc0fb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 shutdown_connections 2024-02-15T18:28:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:08.162+0000 7f520309f700 1 -- 172.21.15.33:0/1184660786 wait complete. 2024-02-15T18:28:08.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:08.161495+0000 mon.smithi033 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.33:0/1184660786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-15T18:28:08.834 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757260 got 163208757263 for osd.5 2024-02-15T18:28:08.834 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-15T18:28:08.834 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-15T18:28:09.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:08.161495+0000 mon.smithi033 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.33:0/1184660786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-15T18:28:09.073 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:28:10.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:08.554594+0000 mgr.smithi033.apxevf (mgr.14162) 213 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:10.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:08.554594+0000 mgr.smithi033.apxevf (mgr.14162) 213 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 -- 172.21.15.33:0/946194777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f78c0 msgr2=0x7fb1480f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 --2- 172.21.15.33:0/946194777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f78c0 0x7fb1480f7d20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fb130004660 tx=0x7fb130009b30).stop 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 -- 172.21.15.33:0/946194777 shutdown_connections 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 --2- 172.21.15.33:0/946194777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f78c0 0x7fb1480f7d20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 --2- 172.21.15.33:0/946194777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1480f6620 0x7fb1480f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 -- 172.21.15.33:0/946194777 >> 172.21.15.33:0/946194777 conn(0x7fb1480f1da0 msgr2=0x7fb1480f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 -- 172.21.15.33:0/946194777 shutdown_connections 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 -- 172.21.15.33:0/946194777 wait complete. 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 Processor -- start 2024-02-15T18:28:11.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.022+0000 7fb14d08e700 1 -- start start 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb14d08e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f6620 0x7fb148107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb14d08e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1480f78c0 0x7fb1481074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb14d08e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148107b30 con 0x7fb1480f6620 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb14d08e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1481083e0 con 0x7fb1480f78c0 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb147fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f6620 0x7fb148107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb147fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f6620 0x7fb148107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46188/0 (socket says 172.21.15.33:46188) 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb147fff700 1 -- 172.21.15.33:0/1719513110 learned_addr learned my addr 172.21.15.33:0/1719513110 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb1477fe700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1480f78c0 0x7fb1481074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb147fff700 1 -- 172.21.15.33:0/1719513110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1480f78c0 msgr2=0x7fb1481074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb147fff700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1480f78c0 0x7fb1481074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb147fff700 1 -- 172.21.15.33:0/1719513110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb130005040 con 0x7fb1480f6620 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb1477fe700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1480f78c0 0x7fb1481074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb147fff700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f6620 0x7fb148107000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fb1380093f0 tx=0x7fb138006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:11.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb144ff9700 1 -- 172.21.15.33:0/1719513110 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb138009ea0 con 0x7fb1480f6620 2024-02-15T18:28:11.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1481086c0 con 0x7fb1480f6620 2024-02-15T18:28:11.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb144ff9700 1 -- 172.21.15.33:0/1719513110 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb138013b10 con 0x7fb1480f6620 2024-02-15T18:28:11.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.023+0000 7fb144ff9700 1 -- 172.21.15.33:0/1719513110 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb13800dbc0 con 0x7fb1480f6620 2024-02-15T18:28:11.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.024+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb148108c80 con 0x7fb1480f6620 2024-02-15T18:28:11.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.025+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb148059100 con 0x7fb1480f6620 2024-02-15T18:28:11.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.025+0000 7fb144ff9700 1 -- 172.21.15.33:0/1719513110 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb13801a060 con 0x7fb1480f6620 2024-02-15T18:28:11.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.025+0000 7fb144ff9700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb13405c2b0 0x7fb13405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:11.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.025+0000 7fb144ff9700 1 -- 172.21.15.33:0/1719513110 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fb138075bd0 con 0x7fb1480f6620 2024-02-15T18:28:11.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.025+0000 7fb1477fe700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb13405c2b0 0x7fb13405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:11.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.026+0000 7fb1477fe700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb13405c2b0 0x7fb13405e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb130004630 tx=0x7fb130009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:11.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.029+0000 7fb144ff9700 1 -- 172.21.15.33:0/1719513110 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb13804c600 con 0x7fb1480f6620 2024-02-15T18:28:11.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.184+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1480ff080 con 0x7fb13405c2b0 2024-02-15T18:28:11.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.185+0000 7fb144ff9700 1 -- 172.21.15.33:0/1719513110 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27777 (secure 0 0 0) 0x7fb1480ff080 con 0x7fb13405c2b0 2024-02-15T18:28:11.181 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:11.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb13405c2b0 msgr2=0x7fb13405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:11.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb13405c2b0 0x7fb13405e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb130004630 tx=0x7fb130009b30).stop 2024-02-15T18:28:11.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f6620 msgr2=0x7fb148107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:11.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f6620 0x7fb148107000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fb1380093f0 tx=0x7fb138006ec0).stop 2024-02-15T18:28:11.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 shutdown_connections 2024-02-15T18:28:11.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb13405c2b0 0x7fb13405e770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:11.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1480f6620 0x7fb148107000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:11.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 --2- 172.21.15.33:0/1719513110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1480f78c0 0x7fb1481074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:11.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 >> 172.21.15.33:0/1719513110 conn(0x7fb1480f1da0 msgr2=0x7fb1480fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:11.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 shutdown_connections 2024-02-15T18:28:11.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:11.187+0000 7fb14d08e700 1 -- 172.21.15.33:0/1719513110 wait complete. 2024-02-15T18:28:11.183 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-02-15T18:28:11.899 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:10.554987+0000 mgr.smithi033.apxevf (mgr.14162) 214 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:11.899 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:11.185123+0000 mgr.smithi033.apxevf (mgr.14162) 215 : audit [DBG] from='client.14390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:28:11.922 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-02-15T18:28:10.554833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31272,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":29184,"kb_avail":562439640,"statfs":{"total":575970213888,"available":575938191360,"internally_reserved":0,"allocated":2088960,"data_stored":786132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29884416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"38","state":"active+clean","last_fresh":"2024-02-15T18:27:08.896554+0000","last_change":"2024-02-15T18:26:45.907762+0000","last_active":"2024-02-15T18:27:08.896554+0000","last_peered":"2024-02-15T18:27:08.896554+0000","last_clean":"2024-02-15T18:27:08.896554+0000","last_became_active":"2024-02-15T18:26:45.907361+0000","last_became_peered":"2024-02-15T18:26:45.907361+0000","last_unstale":"2024-02-15T18:27:08.896554+0000","last_undegraded":"2024-02-15T18:27:08.896554+0000","last_fullsized":"2024-02-15T18:27:08.896554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T18:26:18.883707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T18:26:18.883707+0000","last_clean_scrub_stamp":"2024-02-15T18:26:18.883707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5084,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740068,"statfs":{"total":95995035648,"available":95989829632,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5148,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740004,"statfs":{"total":95995035648,"available":95989764096,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.439}]},{"osd":1,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.30199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5212,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739940,"statfs":{"total":95995035648,"available":95989698560,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Feb 15 18:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.504}]},{"osd":2,"last update":"Thu Feb 15 18:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Feb 15 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.435},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5212,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739940,"statfs":{"total":95995035648,"available":95989698560,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:27:06 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.255}]},{"osd":1,"last update":"Thu Feb 15 18:27:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Feb 15 18:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.432}]},{"osd":4,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5340,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739812,"statfs":{"total":95995035648,"available":95989567488,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 18:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.32500000000000001,"15min":0.318},"min":{"1min":0.26800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Feb 15 18:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.318}]},{"osd":3,"last update":"Thu Feb 15 18:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.432},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Feb 15 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5276,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739876,"statfs":{"total":95995035648,"available":95989633024,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.26200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.499,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.27400000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Feb 15 18:27:08 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Feb 15 18:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T18:28:11.923 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-15T18:28:12.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:10.554987+0000 mgr.smithi033.apxevf (mgr.14162) 214 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:12.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:11.185123+0000 mgr.smithi033.apxevf (mgr.14162) 215 : audit [DBG] from='client.14390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:28:12.165 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:28:13.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:12.555283+0000 mgr.smithi033.apxevf (mgr.14162) 216 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:14.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:12.555283+0000 mgr.smithi033.apxevf (mgr.14162) 216 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:14.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.006+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/3647842596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f7a70 msgr2=0x7fa3e00f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.006+0000 7fa3e6c2a700 1 --2- 172.21.15.33:0/3647842596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f7a70 0x7fa3e00f7ed0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fa3cc004660 tx=0x7fa3cc009b30).stop 2024-02-15T18:28:14.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.006+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/3647842596 shutdown_connections 2024-02-15T18:28:14.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.006+0000 7fa3e6c2a700 1 --2- 172.21.15.33:0/3647842596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f7a70 0x7fa3e00f7ed0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.006+0000 7fa3e6c2a700 1 --2- 172.21.15.33:0/3647842596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00f67d0 0x7fa3e00f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:14.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.006+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/3647842596 >> 172.21.15.33:0/3647842596 conn(0x7fa3e00f1f50 msgr2=0x7fa3e00f4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:14.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.006+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/3647842596 shutdown_connections 2024-02-15T18:28:14.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.006+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/3647842596 wait complete. 2024-02-15T18:28:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.007+0000 7fa3e6c2a700 1 Processor -- start 2024-02-15T18:28:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.007+0000 7fa3e6c2a700 1 -- start start 2024-02-15T18:28:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.007+0000 7fa3e6c2a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f67d0 0x7fa3e0107190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.007+0000 7fa3e6c2a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00f7a70 0x7fa3e0107680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.007+0000 7fa3e6c2a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0107cc0 con 0x7fa3e00f67d0 2024-02-15T18:28:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.007+0000 7fa3e6c2a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0108570 con 0x7fa3e00f7a70 2024-02-15T18:28:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.007+0000 7fa3e49c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f67d0 0x7fa3e0107190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3e49c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f67d0 0x7fa3e0107190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46204/0 (socket says 172.21.15.33:46204) 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3e49c6700 1 -- 172.21.15.33:0/2099511602 learned_addr learned my addr 172.21.15.33:0/2099511602 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3dffff700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00f7a70 0x7fa3e0107680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3e49c6700 1 -- 172.21.15.33:0/2099511602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00f7a70 msgr2=0x7fa3e0107680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3e49c6700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00f7a70 0x7fa3e0107680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3e49c6700 1 -- 172.21.15.33:0/2099511602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc005040 con 0x7fa3e00f67d0 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3e49c6700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f67d0 0x7fa3e0107190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa3d40093f0 tx=0x7fa3d4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3dd7fa700 1 -- 172.21.15.33:0/2099511602 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d4009ea0 con 0x7fa3e00f67d0 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e0108850 con 0x7fa3e00f67d0 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3dd7fa700 1 -- 172.21.15.33:0/2099511602 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3d4013b10 con 0x7fa3e00f67d0 2024-02-15T18:28:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3dd7fa700 1 -- 172.21.15.33:0/2099511602 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d400dbc0 con 0x7fa3e00f67d0 2024-02-15T18:28:14.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.008+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e0108e10 con 0x7fa3e00f67d0 2024-02-15T18:28:14.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.009+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e0059100 con 0x7fa3e00f67d0 2024-02-15T18:28:14.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.009+0000 7fa3dd7fa700 1 -- 172.21.15.33:0/2099511602 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa3d401a060 con 0x7fa3e00f67d0 2024-02-15T18:28:14.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.010+0000 7fa3dd7fa700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa3d005c2a0 0x7fa3d005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:14.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.010+0000 7fa3dd7fa700 1 -- 172.21.15.33:0/2099511602 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fa3d4075c10 con 0x7fa3e00f67d0 2024-02-15T18:28:14.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.010+0000 7fa3dffff700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa3d005c2a0 0x7fa3d005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:14.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.010+0000 7fa3dffff700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa3d005c2a0 0x7fa3d005e760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa3cc004e30 tx=0x7fa3cc009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:14.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.014+0000 7fa3dd7fa700 1 -- 172.21.15.33:0/2099511602 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa3d404c5e0 con 0x7fa3e00f67d0 2024-02-15T18:28:14.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.168+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3e00ff230 con 0x7fa3d005c2a0 2024-02-15T18:28:14.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.169+0000 7fa3dd7fa700 1 -- 172.21.15.33:0/2099511602 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+29120 (secure 0 0 0) 0x7fa3e00ff230 con 0x7fa3d005c2a0 2024-02-15T18:28:14.165 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:14.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa3d005c2a0 msgr2=0x7fa3d005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa3d005c2a0 0x7fa3d005e760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa3cc004e30 tx=0x7fa3cc009b30).stop 2024-02-15T18:28:14.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f67d0 msgr2=0x7fa3e0107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:14.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f67d0 0x7fa3e0107190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa3d40093f0 tx=0x7fa3d4006ec0).stop 2024-02-15T18:28:14.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 shutdown_connections 2024-02-15T18:28:14.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa3d005c2a0 0x7fa3d005e760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3e00f67d0 0x7fa3e0107190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 --2- 172.21.15.33:0/2099511602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3e00f7a70 0x7fa3e0107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:14.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 >> 172.21.15.33:0/2099511602 conn(0x7fa3e00f1f50 msgr2=0x7fa3e00fb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:14.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 shutdown_connections 2024-02-15T18:28:14.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:14.171+0000 7fa3e6c2a700 1 -- 172.21.15.33:0/2099511602 wait complete. 2024-02-15T18:28:14.167 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-02-15T18:28:14.879 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:14.169124+0000 mgr.smithi033.apxevf (mgr.14162) 217 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:28:14.901 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-02-15T18:28:12.555167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":31272,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":29184,"kb_avail":562439640,"statfs":{"total":575970213888,"available":575938191360,"internally_reserved":0,"allocated":2088960,"data_stored":786132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29884416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"35","reported_epoch":"38","state":"active+clean","last_fresh":"2024-02-15T18:27:08.896554+0000","last_change":"2024-02-15T18:26:45.907762+0000","last_active":"2024-02-15T18:27:08.896554+0000","last_peered":"2024-02-15T18:27:08.896554+0000","last_clean":"2024-02-15T18:27:08.896554+0000","last_became_active":"2024-02-15T18:26:45.907361+0000","last_became_peered":"2024-02-15T18:26:45.907361+0000","last_unstale":"2024-02-15T18:27:08.896554+0000","last_undegraded":"2024-02-15T18:27:08.896554+0000","last_fullsized":"2024-02-15T18:27:08.896554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-15T18:26:18.883707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-15T18:26:18.883707+0000","last_clean_scrub_stamp":"2024-02-15T18:26:18.883707+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5084,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740068,"statfs":{"total":95995035648,"available":95989829632,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5148,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740004,"statfs":{"total":95995035648,"available":95989764096,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.498}]},{"osd":2,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35999999999999999}]},{"osd":5,"last update":"Thu Feb 15 18:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.39100000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5212,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739940,"statfs":{"total":95995035648,"available":95989698560,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Feb 15 18:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.504}]},{"osd":2,"last update":"Thu Feb 15 18:27:24 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Feb 15 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.435},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5212,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739940,"statfs":{"total":95995035648,"available":95989698560,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:28:07 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.376}]},{"osd":1,"last update":"Thu Feb 15 18:28:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35499999999999998},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.373,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Feb 15 18:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.625},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Feb 15 18:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5340,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739812,"statfs":{"total":95995035648,"available":95989567488,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 15 18:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.32500000000000001,"15min":0.318},"min":{"1min":0.26800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46400000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Feb 15 18:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.318}]},{"osd":3,"last update":"Thu Feb 15 18:27:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.432},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Feb 15 18:27:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5276,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739876,"statfs":{"total":95995035648,"available":95989633024,"internally_reserved":0,"allocated":348160,"data_stored":131022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 15 18:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.26200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.499,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33700000000000002,"15min":0.33300000000000002},"min":{"1min":0.27400000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Feb 15 18:27:08 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.307},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Feb 15 18:27:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.624},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Feb 15 18:27:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Feb 15 18:28:08 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.78400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-15T18:28:14.902 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-15T18:28:14.902 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-15T18:28:14.902 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-15T18:28:14.902 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- ceph health --format=json 2024-02-15T18:28:15.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:14.169124+0000 mgr.smithi033.apxevf (mgr.14162) 217 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-15T18:28:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/mon.smithi033/config 2024-02-15T18:28:15.917 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:14.555557+0000 mgr.smithi033.apxevf (mgr.14162) 218 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:16.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:14.555557+0000 mgr.smithi033.apxevf (mgr.14162) 218 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:16.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:16.510499+0000 mon.smithi033 (mon.0) 452 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:16.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.924+0000 7f881cf46700 1 -- 172.21.15.33:0/3567058360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f56c0 msgr2=0x7f88180f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:16.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.924+0000 7f881cf46700 1 --2- 172.21.15.33:0/3567058360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f56c0 0x7f88180f5ae0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f880c004660 tx=0x7f880c009b30).stop 2024-02-15T18:28:16.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.925+0000 7f881cf46700 1 -- 172.21.15.33:0/3567058360 shutdown_connections 2024-02-15T18:28:16.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.925+0000 7f881cf46700 1 --2- 172.21.15.33:0/3567058360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88180f6960 0x7f88180f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:28:16.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.925+0000 7f881cf46700 1 --2- 172.21.15.33:0/3567058360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f56c0 0x7f88180f5ae0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.925+0000 7f881cf46700 1 -- 172.21.15.33:0/3567058360 >> 172.21.15.33:0/3567058360 conn(0x7f88180f0e20 msgr2=0x7f88180f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.925+0000 7f881cf46700 1 -- 172.21.15.33:0/3567058360 shutdown_connections 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.925+0000 7f881cf46700 1 -- 172.21.15.33:0/3567058360 wait complete. 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.925+0000 7f881cf46700 1 Processor -- start 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.925+0000 7f881cf46700 1 -- start start 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f881cf46700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88180f56c0 0x7f8818109ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f881cf46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f6960 0x7f881810c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f881cf46700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88180609d0 con 0x7f88180f6960 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f881cf46700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8818060b10 con 0x7f88180f56c0 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8815d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f6960 0x7f881810c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8815d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f6960 0x7f881810c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39294/0 (socket says 172.21.15.33:39294) 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8815d9b700 1 -- 172.21.15.33:0/181737852 learned_addr learned my addr 172.21.15.33:0/181737852 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f881659c700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88180f56c0 0x7f8818109ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8815d9b700 1 -- 172.21.15.33:0/181737852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88180f56c0 msgr2=0x7f8818109ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:16.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8815d9b700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88180f56c0 0x7f8818109ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:16.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8815d9b700 1 -- 172.21.15.33:0/181737852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c005040 con 0x7f88180f6960 2024-02-15T18:28:16.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f881659c700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88180f56c0 0x7f8818109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:28:16.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8815d9b700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f6960 0x7f881810c3d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f880800b410 tx=0x7f8808006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:16.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8806ffd700 1 -- 172.21.15.33:0/181737852 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88080125f0 con 0x7f88180f6960 2024-02-15T18:28:16.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8806ffd700 1 -- 172.21.15.33:0/181737852 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8808012c20 con 0x7f88180f6960 2024-02-15T18:28:16.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881810ca30 con 0x7f88180f6960 2024-02-15T18:28:16.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f8806ffd700 1 -- 172.21.15.33:0/181737852 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8808002b30 con 0x7f88180f6960 2024-02-15T18:28:16.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.926+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881810cfc0 con 0x7f88180f6960 2024-02-15T18:28:16.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.927+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8818059100 con 0x7f88180f6960 2024-02-15T18:28:16.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.928+0000 7f8806ffd700 1 -- 172.21.15.33:0/181737852 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f880800f030 con 0x7f88180f6960 2024-02-15T18:28:16.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.928+0000 7f8806ffd700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f880005c2a0 0x7f880005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:16.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.928+0000 7f8806ffd700 1 -- 172.21.15.33:0/181737852 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f8808075f30 con 0x7f88180f6960 2024-02-15T18:28:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.928+0000 7f881659c700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f880005c2a0 0x7f880005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.928+0000 7f881659c700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f880005c2a0 0x7f880005e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f88180605c0 tx=0x7f880c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:16.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:16.932+0000 7f8806ffd700 1 -- 172.21.15.33:0/181737852 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8808048fb0 con 0x7f88180f6960 2024-02-15T18:28:17.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:16.510499+0000 mon.smithi033 (mon.0) 452 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.149+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f88180fe010 con 0x7f88180f6960 2024-02-15T18:28:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.149+0000 7f8806ffd700 1 -- 172.21.15.33:0/181737852 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f880804c5d0 con 0x7f88180f6960 2024-02-15T18:28:17.144 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.150+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f880005c2a0 msgr2=0x7f880005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.150+0000 7f881cf46700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f880005c2a0 0x7f880005e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f88180605c0 tx=0x7f880c009b30).stop 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.150+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f6960 msgr2=0x7f881810c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.150+0000 7f881cf46700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f6960 0x7f881810c3d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f880800b410 tx=0x7f8808006ef0).stop 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.151+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 shutdown_connections 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.151+0000 7f881cf46700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f880005c2a0 0x7f880005e760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.151+0000 7f881cf46700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88180f56c0 0x7f8818109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.151+0000 7f881cf46700 1 --2- 172.21.15.33:0/181737852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88180f6960 0x7f881810c3d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.151+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 >> 172.21.15.33:0/181737852 conn(0x7f88180f0e20 msgr2=0x7f88180fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.151+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 shutdown_connections 2024-02-15T18:28:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:17.151+0000 7f881cf46700 1 -- 172.21.15.33:0/181737852 wait complete. 2024-02-15T18:28:17.955 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:16.555862+0000 mgr.smithi033.apxevf (mgr.14162) 219 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:17.955 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:16.774497+0000 mon.smithi033 (mon.0) 453 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:17.955 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:17.149937+0000 mon.smithi033 (mon.0) 454 : audit [DBG] from='client.? 172.21.15.33:0/181737852' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-15T18:28:17.978 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-15T18:28:17.978 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-15T18:28:17.978 INFO:tasks.cephadm:Setup complete, yielding 2024-02-15T18:28:17.978 INFO:teuthology.run_tasks:Running task print... 2024-02-15T18:28:17.988 INFO:teuthology.task.print:**** done starting v16.2.4 2024-02-15T18:28:17.988 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:28:18.017 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:28:18.018 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch status' 2024-02-15T18:28:18.230 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:16.555862+0000 mgr.smithi033.apxevf (mgr.14162) 219 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:18.230 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:16.774497+0000 mon.smithi033 (mon.0) 453 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:18.230 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:17.149937+0000 mon.smithi033 (mon.0) 454 : audit [DBG] from='client.? 172.21.15.33:0/181737852' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-15T18:28:19.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:18.556162+0000 mgr.smithi033.apxevf (mgr.14162) 220 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:19.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:18.556162+0000 mgr.smithi033.apxevf (mgr.14162) 220 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.146+0000 7fa76da04700 1 -- 172.21.15.33:0/3622689020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 msgr2=0x7fa7680f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.146+0000 7fa76da04700 1 --2- 172.21.15.33:0/3622689020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 0x7fa7680f6b40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fa754004660 tx=0x7fa754009b30).stop 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.146+0000 7fa76da04700 1 -- 172.21.15.33:0/3622689020 shutdown_connections 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.146+0000 7fa76da04700 1 --2- 172.21.15.33:0/3622689020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 0x7fa7680f6b40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.146+0000 7fa76da04700 1 --2- 172.21.15.33:0/3622689020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7680f5440 0x7fa7680f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.146+0000 7fa76da04700 1 -- 172.21.15.33:0/3622689020 >> 172.21.15.33:0/3622689020 conn(0x7fa7680f0ba0 msgr2=0x7fa7680f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.146+0000 7fa76da04700 1 -- 172.21.15.33:0/3622689020 shutdown_connections 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.146+0000 7fa76da04700 1 -- 172.21.15.33:0/3622689020 wait complete. 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa76da04700 1 Processor -- start 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa76da04700 1 -- start start 2024-02-15T18:28:20.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa76da04700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7680f5440 0x7fa768109b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa76da04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 0x7fa76810c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa76da04700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680603c0 con 0x7fa7680f66e0 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa76da04700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768060500 con 0x7fa7680f5440 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa767fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 0x7fa76810c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa767fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 0x7fa76810c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39316/0 (socket says 172.21.15.33:39316) 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa767fff700 1 -- 172.21.15.33:0/2463352476 learned_addr learned my addr 172.21.15.33:0/2463352476 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa76ca02700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7680f5440 0x7fa768109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa767fff700 1 -- 172.21.15.33:0/2463352476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7680f5440 msgr2=0x7fa768109b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa767fff700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7680f5440 0x7fa768109b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa767fff700 1 -- 172.21.15.33:0/2463352476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754005040 con 0x7fa7680f66e0 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.147+0000 7fa767fff700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 0x7fa76810c060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa754009830 tx=0x7fa754009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:20.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.148+0000 7fa7657fa700 1 -- 172.21.15.33:0/2463352476 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa754018070 con 0x7fa7680f66e0 2024-02-15T18:28:20.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.148+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76810c5b0 con 0x7fa7680f66e0 2024-02-15T18:28:20.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.148+0000 7fa7657fa700 1 -- 172.21.15.33:0/2463352476 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa754007c70 con 0x7fa7680f66e0 2024-02-15T18:28:20.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.148+0000 7fa7657fa700 1 -- 172.21.15.33:0/2463352476 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75401c620 con 0x7fa7680f66e0 2024-02-15T18:28:20.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.148+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76810cae0 con 0x7fa7680f66e0 2024-02-15T18:28:20.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.149+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa768059100 con 0x7fa7680f66e0 2024-02-15T18:28:20.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.149+0000 7fa7657fa700 1 -- 172.21.15.33:0/2463352476 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa75401c8e0 con 0x7fa7680f66e0 2024-02-15T18:28:20.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.149+0000 7fa7657fa700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa75805c300 0x7fa75805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:20.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.150+0000 7fa7657fa700 1 -- 172.21.15.33:0/2463352476 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fa7540779e0 con 0x7fa7680f66e0 2024-02-15T18:28:20.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.150+0000 7fa76ca02700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa75805c300 0x7fa75805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:20.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.150+0000 7fa76ca02700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa75805c300 0x7fa75805e7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa768060040 tx=0x7fa75c009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:20.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.154+0000 7fa7657fa700 1 -- 172.21.15.33:0/2463352476 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa75404a9e0 con 0x7fa7680f66e0 2024-02-15T18:28:20.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.347+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7680fde90 con 0x7fa75805c300 2024-02-15T18:28:20.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.348+0000 7fa7657fa700 1 -- 172.21.15.33:0/2463352476 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa7680fde90 con 0x7fa75805c300 2024-02-15T18:28:20.343 INFO:teuthology.orchestra.run.smithi033.stdout:Backend: cephadm 2024-02-15T18:28:20.343 INFO:teuthology.orchestra.run.smithi033.stdout:Available: Yes 2024-02-15T18:28:20.343 INFO:teuthology.orchestra.run.smithi033.stdout:Paused: No 2024-02-15T18:28:20.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa75805c300 msgr2=0x7fa75805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:20.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa75805c300 0x7fa75805e7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa768060040 tx=0x7fa75c009040).stop 2024-02-15T18:28:20.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 msgr2=0x7fa76810c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:20.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 0x7fa76810c060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa754009830 tx=0x7fa754009b30).stop 2024-02-15T18:28:20.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 shutdown_connections 2024-02-15T18:28:20.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa75805c300 0x7fa75805e7c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:20.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7680f5440 0x7fa768109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:20.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 --2- 172.21.15.33:0/2463352476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680f66e0 0x7fa76810c060 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:20.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 >> 172.21.15.33:0/2463352476 conn(0x7fa7680f0ba0 msgr2=0x7fa7680fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:20.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 shutdown_connections 2024-02-15T18:28:20.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:20.349+0000 7fa76da04700 1 -- 172.21.15.33:0/2463352476 wait complete. 2024-02-15T18:28:21.102 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-15T18:28:21.859 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:20.348440+0000 mgr.smithi033.apxevf (mgr.14162) 221 : audit [DBG] from='client.14402 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:21.860 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:20.556447+0000 mgr.smithi033.apxevf (mgr.14162) 222 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:22.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:20.348440+0000 mgr.smithi033.apxevf (mgr.14162) 221 : audit [DBG] from='client.14402 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:22.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:20.556447+0000 mgr.smithi033.apxevf (mgr.14162) 222 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:23.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 -- 172.21.15.33:0/2483336672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 msgr2=0x7f84400f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:23.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 --2- 172.21.15.33:0/2483336672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 0x7f84400f59e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8430004660 tx=0x7f8430009b30).stop 2024-02-15T18:28:23.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 -- 172.21.15.33:0/2483336672 shutdown_connections 2024-02-15T18:28:23.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 --2- 172.21.15.33:0/2483336672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84400f6860 0x7f84400f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:23.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 --2- 172.21.15.33:0/2483336672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 0x7f84400f59e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:23.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 -- 172.21.15.33:0/2483336672 >> 172.21.15.33:0/2483336672 conn(0x7f84400f0d40 msgr2=0x7f84400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:23.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 -- 172.21.15.33:0/2483336672 shutdown_connections 2024-02-15T18:28:23.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 -- 172.21.15.33:0/2483336672 wait complete. 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 Processor -- start 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.100+0000 7f844576a700 1 -- start start 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f844576a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 0x7f84400f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f844576a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84400f6860 0x7f84400f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f844576a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400f8100 con 0x7f84400f55c0 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f844576a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400f8240 con 0x7f84400f6860 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f843effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 0x7f84400f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f843effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 0x7f84400f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39326/0 (socket says 172.21.15.33:39326) 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f843effd700 1 -- 172.21.15.33:0/1308350823 learned_addr learned my addr 172.21.15.33:0/1308350823 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f843e7fc700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84400f6860 0x7f84400f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f843effd700 1 -- 172.21.15.33:0/1308350823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84400f6860 msgr2=0x7f84400f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f843effd700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84400f6860 0x7f84400f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f843effd700 1 -- 172.21.15.33:0/1308350823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430005040 con 0x7f84400f55c0 2024-02-15T18:28:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f843effd700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 0x7f84400f9720 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8430004e30 tx=0x7f8430009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:23.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f84277fe700 1 -- 172.21.15.33:0/1308350823 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8430018070 con 0x7f84400f55c0 2024-02-15T18:28:23.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f84277fe700 1 -- 172.21.15.33:0/1308350823 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8430007ba0 con 0x7f84400f55c0 2024-02-15T18:28:23.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84400f84c0 con 0x7f84400f55c0 2024-02-15T18:28:23.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f84277fe700 1 -- 172.21.15.33:0/1308350823 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f843001c620 con 0x7f84400f55c0 2024-02-15T18:28:23.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.101+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84400f8a20 con 0x7f84400f55c0 2024-02-15T18:28:23.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.102+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8440045ad0 con 0x7f84400f55c0 2024-02-15T18:28:23.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.103+0000 7f84277fe700 1 -- 172.21.15.33:0/1308350823 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8430007d10 con 0x7f84400f55c0 2024-02-15T18:28:23.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.103+0000 7f84277fe700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f842805c2b0 0x7f842805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:23.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.103+0000 7f84277fe700 1 -- 172.21.15.33:0/1308350823 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f84300778a0 con 0x7f84400f55c0 2024-02-15T18:28:23.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.103+0000 7f843e7fc700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f842805c2b0 0x7f842805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:23.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.104+0000 7f843e7fc700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f842805c2b0 0x7f842805e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f8434009760 tx=0x7f8434009c60).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:23.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.107+0000 7f84277fe700 1 -- 172.21.15.33:0/1308350823 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f843004a8a0 con 0x7f84400f55c0 2024-02-15T18:28:23.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.294+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f84400faca0 con 0x7f842805c2b0 2024-02-15T18:28:23.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.301+0000 7f84277fe700 1 -- 172.21.15.33:0/1308350823 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2160 (secure 0 0 0) 0x7f84400faca0 con 0x7f842805c2b0 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (3m) 66s ago 5m 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (5m) 66s ago 5m 16.2.4 8d91d370c2b8 6deae8bbd6c5 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (4m) 79s ago 4m 16.2.4 8d91d370c2b8 e45b11308af7 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (3m) 66s ago 4m 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:9283 running (6m) 66s ago 6m 16.2.4 8d91d370c2b8 c319170b238f 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (3m) 79s ago 3m 16.2.4 8d91d370c2b8 636ca5f9c9dd 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (6m) 66s ago 6m 16.2.4 8d91d370c2b8 04c43c0cba21 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (3m) 79s ago 3m 16.2.4 8d91d370c2b8 710ae4544ec3 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (4m) 66s ago 4m 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (3m) 79s ago 3m 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (3m) 66s ago 3m 16.2.4 8d91d370c2b8 8fd8ca242c54 2024-02-15T18:28:23.296 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (2m) 66s ago 2m 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:28:23.297 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (2m) 66s ago 2m 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:28:23.297 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (2m) 79s ago 2m 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:28:23.297 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (104s) 79s ago 103s 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:28:23.297 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (82s) 79s ago 82s 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:28:23.297 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (2m) 66s ago 4m 2.18.1 de242295e225 0b5ba62c4d4c 2024-02-15T18:28:23.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f842805c2b0 msgr2=0x7f842805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:23.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f842805c2b0 0x7f842805e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f8434009760 tx=0x7f8434009c60).stop 2024-02-15T18:28:23.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 msgr2=0x7f84400f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:23.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 0x7f84400f9720 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8430004e30 tx=0x7f8430009b30).stop 2024-02-15T18:28:23.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 shutdown_connections 2024-02-15T18:28:23.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f842805c2b0 0x7f842805e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:23.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84400f55c0 0x7f84400f9720 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:23.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 --2- 172.21.15.33:0/1308350823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84400f6860 0x7f84400f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:23.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 >> 172.21.15.33:0/1308350823 conn(0x7f84400f0d40 msgr2=0x7f844005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:23.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 shutdown_connections 2024-02-15T18:28:23.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:23.302+0000 7f844576a700 1 -- 172.21.15.33:0/1308350823 wait complete. 2024-02-15T18:28:24.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:22.556779+0000 mgr.smithi033.apxevf (mgr.14162) 223 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:24.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:23.295555+0000 mgr.smithi033.apxevf (mgr.14162) 224 : audit [DBG] from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:24.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:22.556779+0000 mgr.smithi033.apxevf (mgr.14162) 223 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:24.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:23.295555+0000 mgr.smithi033.apxevf (mgr.14162) 224 : audit [DBG] from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:24.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-15T18:28:25.674 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:24.557084+0000 mgr.smithi033.apxevf (mgr.14162) 225 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:26.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:24.557084+0000 mgr.smithi033.apxevf (mgr.14162) 225 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:26.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.228+0000 7f82751ae700 1 -- 172.21.15.33:0/1818993625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f5440 msgr2=0x7f82700f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:26.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.228+0000 7f82751ae700 1 --2- 172.21.15.33:0/1818993625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f5440 0x7f82700f5860 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f8260004660 tx=0x7f8260009b30).stop 2024-02-15T18:28:26.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.228+0000 7f82751ae700 1 -- 172.21.15.33:0/1818993625 shutdown_connections 2024-02-15T18:28:26.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.228+0000 7f82751ae700 1 --2- 172.21.15.33:0/1818993625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82700f66e0 0x7f82700f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:26.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.228+0000 7f82751ae700 1 --2- 172.21.15.33:0/1818993625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f5440 0x7f82700f5860 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:26.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.228+0000 7f82751ae700 1 -- 172.21.15.33:0/1818993625 >> 172.21.15.33:0/1818993625 conn(0x7f82700f0ba0 msgr2=0x7f82700f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:26.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.228+0000 7f82751ae700 1 -- 172.21.15.33:0/1818993625 shutdown_connections 2024-02-15T18:28:26.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.228+0000 7f82751ae700 1 -- 172.21.15.33:0/1818993625 wait complete. 2024-02-15T18:28:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.228+0000 7f82751ae700 1 Processor -- start 2024-02-15T18:28:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.229+0000 7f82751ae700 1 -- start start 2024-02-15T18:28:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.229+0000 7f82751ae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82700f5440 0x7f8270109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.229+0000 7f82751ae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f66e0 0x7f827010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.229+0000 7f82751ae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700603e0 con 0x7f82700f66e0 2024-02-15T18:28:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.229+0000 7f82751ae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8270060520 con 0x7f82700f5440 2024-02-15T18:28:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.229+0000 7f826f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f66e0 0x7f827010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.229+0000 7f826f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f66e0 0x7f827010c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46086/0 (socket says 172.21.15.33:46086) 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.229+0000 7f826f7fe700 1 -- 172.21.15.33:0/1572444763 learned_addr learned my addr 172.21.15.33:0/1572444763 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.229+0000 7f826ffff700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82700f5440 0x7f8270109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.230+0000 7f826f7fe700 1 -- 172.21.15.33:0/1572444763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82700f5440 msgr2=0x7f8270109b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.230+0000 7f826f7fe700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82700f5440 0x7f8270109b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.230+0000 7f826f7fe700 1 -- 172.21.15.33:0/1572444763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8260005040 con 0x7f82700f66e0 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.230+0000 7f826f7fe700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f66e0 0x7f827010c080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f82580026d0 tx=0x7f8258009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.230+0000 7f826cff9700 1 -- 172.21.15.33:0/1572444763 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82580079c0 con 0x7f82700f66e0 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.230+0000 7f826cff9700 1 -- 172.21.15.33:0/1572444763 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f825800f040 con 0x7f82700f66e0 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.230+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827010c630 con 0x7f82700f66e0 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.230+0000 7f826cff9700 1 -- 172.21.15.33:0/1572444763 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8258014980 con 0x7f82700f66e0 2024-02-15T18:28:26.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.230+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827010cbf0 con 0x7f82700f66e0 2024-02-15T18:28:26.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.231+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8270045ad0 con 0x7f82700f66e0 2024-02-15T18:28:26.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.231+0000 7f826cff9700 1 -- 172.21.15.33:0/1572444763 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f82580090d0 con 0x7f82700f66e0 2024-02-15T18:28:26.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.232+0000 7f826cff9700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f825c05c300 0x7f825c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:26.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.232+0000 7f826cff9700 1 -- 172.21.15.33:0/1572444763 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f8258075ac0 con 0x7f82700f66e0 2024-02-15T18:28:26.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.232+0000 7f826ffff700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f825c05c300 0x7f825c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:26.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.232+0000 7f826ffff700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f825c05c300 0x7f825c05e7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8270060060 tx=0x7f8260009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:26.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.236+0000 7f826cff9700 1 -- 172.21.15.33:0/1572444763 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8258048b40 con 0x7f82700f66e0 2024-02-15T18:28:26.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.421+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8270057f10 con 0x7f825c05c300 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.425+0000 7f826cff9700 1 -- 172.21.15.33:0/1572444763 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1116 (secure 0 0 0) 0x7f8270057f10 con 0x7f825c05c300 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager 1/1 69s ago 5m count:1 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:crash 2/2 82s ago 5m * 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:grafana 1/1 69s ago 5m count:1 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:mgr 2/2 82s ago 5m count:2 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:mon 2/2 82s ago 4m smithi033:172.21.15.33=smithi033;smithi131:172.21.15.131=smithi131;count:2 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter 2/2 82s ago 5m * 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:osd.unmanaged 6/6 82s ago - 2024-02-15T18:28:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus 1/1 69s ago 5m count:1 2024-02-15T18:28:26.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.426+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f825c05c300 msgr2=0x7f825c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:26.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.426+0000 7f82751ae700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f825c05c300 0x7f825c05e7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8270060060 tx=0x7f8260009b30).stop 2024-02-15T18:28:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.426+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f66e0 msgr2=0x7f827010c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.426+0000 7f82751ae700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f66e0 0x7f827010c080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f82580026d0 tx=0x7f8258009de0).stop 2024-02-15T18:28:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.426+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 shutdown_connections 2024-02-15T18:28:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.426+0000 7f82751ae700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f825c05c300 0x7f825c05e7c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.426+0000 7f82751ae700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82700f5440 0x7f8270109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.426+0000 7f82751ae700 1 --2- 172.21.15.33:0/1572444763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82700f66e0 0x7f827010c080 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.426+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 >> 172.21.15.33:0/1572444763 conn(0x7f82700f0ba0 msgr2=0x7f82700fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.427+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 shutdown_connections 2024-02-15T18:28:26.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:26.427+0000 7f82751ae700 1 -- 172.21.15.33:0/1572444763 wait complete. 2024-02-15T18:28:27.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-15T18:28:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:26.422257+0000 mgr.smithi033.apxevf (mgr.14162) 226 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:26.557371+0000 mgr.smithi033.apxevf (mgr.14162) 227 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:28.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:26.422257+0000 mgr.smithi033.apxevf (mgr.14162) 226 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:28.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:26.557371+0000 mgr.smithi033.apxevf (mgr.14162) 227 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:28.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.976+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/886690892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f7980 msgr2=0x7fd0e40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:28.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.976+0000 7fd0ebcdc700 1 --2- 172.21.15.33:0/886690892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f7980 0x7fd0e40f7de0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fd0d8004660 tx=0x7fd0d8009b30).stop 2024-02-15T18:28:28.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.976+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/886690892 shutdown_connections 2024-02-15T18:28:28.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.976+0000 7fd0ebcdc700 1 --2- 172.21.15.33:0/886690892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f7980 0x7fd0e40f7de0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:28.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.976+0000 7fd0ebcdc700 1 --2- 172.21.15.33:0/886690892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0e40f66e0 0x7fd0e40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:28.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.976+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/886690892 >> 172.21.15.33:0/886690892 conn(0x7fd0e40f1e40 msgr2=0x7fd0e40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:28.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.976+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/886690892 shutdown_connections 2024-02-15T18:28:28.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.976+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/886690892 wait complete. 2024-02-15T18:28:28.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0ebcdc700 1 Processor -- start 2024-02-15T18:28:28.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0ebcdc700 1 -- start start 2024-02-15T18:28:28.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0ebcdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f66e0 0x7fd0e4107090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:28.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0ebcdc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0e40f7980 0x7fd0e4107580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:28.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0ebcdc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4107b30 con 0x7fd0e40f66e0 2024-02-15T18:28:28.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0ebcdc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4107c70 con 0x7fd0e40f7980 2024-02-15T18:28:28.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0e9a78700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f66e0 0x7fd0e4107090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:28.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0e9a78700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f66e0 0x7fd0e4107090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46100/0 (socket says 172.21.15.33:46100) 2024-02-15T18:28:28.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0e9a78700 1 -- 172.21.15.33:0/121108942 learned_addr learned my addr 172.21.15.33:0/121108942 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:28.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.977+0000 7fd0e9277700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0e40f7980 0x7fd0e4107580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:28.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.978+0000 7fd0e9a78700 1 -- 172.21.15.33:0/121108942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0e40f7980 msgr2=0x7fd0e4107580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.978+0000 7fd0e9a78700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0e40f7980 0x7fd0e4107580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.978+0000 7fd0e9a78700 1 -- 172.21.15.33:0/121108942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8005040 con 0x7fd0e40f66e0 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.978+0000 7fd0e9a78700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f66e0 0x7fd0e4107090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fd0e0002700 tx=0x7fd0e0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.978+0000 7fd0d67fc700 1 -- 172.21.15.33:0/121108942 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0e0009320 con 0x7fd0e40f66e0 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.978+0000 7fd0d67fc700 1 -- 172.21.15.33:0/121108942 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0e000f040 con 0x7fd0e40f66e0 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.978+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e4108610 con 0x7fd0e40f66e0 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.978+0000 7fd0d67fc700 1 -- 172.21.15.33:0/121108942 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0e0014940 con 0x7fd0e40f66e0 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.978+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e4108bd0 con 0x7fd0e40f66e0 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.979+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e4045ad0 con 0x7fd0e40f66e0 2024-02-15T18:28:28.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.979+0000 7fd0d67fc700 1 -- 172.21.15.33:0/121108942 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd0e00077b0 con 0x7fd0e40f66e0 2024-02-15T18:28:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.980+0000 7fd0d67fc700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd0d005c2b0 0x7fd0d005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.980+0000 7fd0d67fc700 1 -- 172.21.15.33:0/121108942 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7fd0e0075de0 con 0x7fd0e40f66e0 2024-02-15T18:28:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.980+0000 7fd0e9277700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd0d005c2b0 0x7fd0d005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.980+0000 7fd0e9277700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd0d005c2b0 0x7fd0d005e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fd0d8004e30 tx=0x7fd0d8009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:28.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:28.984+0000 7fd0d67fc700 1 -- 172.21.15.33:0/121108942 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd0e0048de0 con 0x7fd0e40f66e0 2024-02-15T18:28:29.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.167+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0e40ff130 con 0x7fd0d005c2b0 2024-02-15T18:28:29.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.168+0000 7fd0d67fc700 1 -- 172.21.15.33:0/121108942 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+126 (secure 0 0 0) 0x7fd0e40ff130 con 0x7fd0d005c2b0 2024-02-15T18:28:29.163 INFO:teuthology.orchestra.run.smithi033.stdout:HOST ADDR LABELS STATUS 2024-02-15T18:28:29.163 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 172.21.15.33 2024-02-15T18:28:29.163 INFO:teuthology.orchestra.run.smithi033.stdout:smithi131 smithi131 2024-02-15T18:28:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd0d005c2b0 msgr2=0x7fd0d005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd0d005c2b0 0x7fd0d005e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fd0d8004e30 tx=0x7fd0d8009b30).stop 2024-02-15T18:28:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f66e0 msgr2=0x7fd0e4107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f66e0 0x7fd0e4107090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fd0e0002700 tx=0x7fd0e0009d80).stop 2024-02-15T18:28:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 shutdown_connections 2024-02-15T18:28:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fd0d005c2b0 0x7fd0d005e770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0e40f66e0 0x7fd0e4107090 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 --2- 172.21.15.33:0/121108942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0e40f7980 0x7fd0e4107580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 >> 172.21.15.33:0/121108942 conn(0x7fd0e40f1e40 msgr2=0x7fd0e40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:29.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 shutdown_connections 2024-02-15T18:28:29.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:29.170+0000 7fd0ebcdc700 1 -- 172.21.15.33:0/121108942 wait complete. 2024-02-15T18:28:29.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:28.557852+0000 mgr.smithi033.apxevf (mgr.14162) 228 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:29.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:29.168847+0000 mgr.smithi033.apxevf (mgr.14162) 229 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:29.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:28.557852+0000 mgr.smithi033.apxevf (mgr.14162) 228 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:29.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:29.168847+0000 mgr.smithi033.apxevf (mgr.14162) 229 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:29.925 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-15T18:28:31.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.894+0000 7feb79e9f700 1 -- 172.21.15.33:0/1978393776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f55c0 msgr2=0x7feb740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:31.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.894+0000 7feb79e9f700 1 --2- 172.21.15.33:0/1978393776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f55c0 0x7feb740f59e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7feb64004660 tx=0x7feb64009b30).stop 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.894+0000 7feb79e9f700 1 -- 172.21.15.33:0/1978393776 shutdown_connections 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.894+0000 7feb79e9f700 1 --2- 172.21.15.33:0/1978393776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb740f6860 0x7feb740f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.894+0000 7feb79e9f700 1 --2- 172.21.15.33:0/1978393776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f55c0 0x7feb740f59e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.894+0000 7feb79e9f700 1 -- 172.21.15.33:0/1978393776 >> 172.21.15.33:0/1978393776 conn(0x7feb740f0d40 msgr2=0x7feb740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.894+0000 7feb79e9f700 1 -- 172.21.15.33:0/1978393776 shutdown_connections 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.894+0000 7feb79e9f700 1 -- 172.21.15.33:0/1978393776 wait complete. 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.894+0000 7feb79e9f700 1 Processor -- start 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb79e9f700 1 -- start start 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb79e9f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb740f55c0 0x7feb74109270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb79e9f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f6860 0x7feb74109760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb79e9f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74109d10 con 0x7feb740f6860 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb79e9f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74109e50 con 0x7feb740f55c0 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb72ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f6860 0x7feb74109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb72ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f6860 0x7feb74109760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46112/0 (socket says 172.21.15.33:46112) 2024-02-15T18:28:31.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb72ffd700 1 -- 172.21.15.33:0/4267211447 learned_addr learned my addr 172.21.15.33:0/4267211447 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb737fe700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb740f55c0 0x7feb74109270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb72ffd700 1 -- 172.21.15.33:0/4267211447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb740f55c0 msgr2=0x7feb74109270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb72ffd700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb740f55c0 0x7feb74109270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb72ffd700 1 -- 172.21.15.33:0/4267211447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb64005040 con 0x7feb740f6860 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb737fe700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb740f55c0 0x7feb74109270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.895+0000 7feb72ffd700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f6860 0x7feb74109760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7feb5c00c790 tx=0x7feb5c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.896+0000 7feb6bfff700 1 -- 172.21.15.33:0/4267211447 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb5c00e680 con 0x7feb740f6860 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.896+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7410a7f0 con 0x7feb740f6860 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.896+0000 7feb6bfff700 1 -- 172.21.15.33:0/4267211447 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb5c00ecb0 con 0x7feb740f6860 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.896+0000 7feb6bfff700 1 -- 172.21.15.33:0/4267211447 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb5c013e10 con 0x7feb740f6860 2024-02-15T18:28:31.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.896+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7410adb0 con 0x7feb740f6860 2024-02-15T18:28:31.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.897+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb74045ad0 con 0x7feb740f6860 2024-02-15T18:28:31.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.897+0000 7feb6bfff700 1 -- 172.21.15.33:0/4267211447 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7feb5c01a060 con 0x7feb740f6860 2024-02-15T18:28:31.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.897+0000 7feb6bfff700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feb6005c2b0 0x7feb6005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:31.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.897+0000 7feb6bfff700 1 -- 172.21.15.33:0/4267211447 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7feb5c075e10 con 0x7feb740f6860 2024-02-15T18:28:31.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.897+0000 7feb737fe700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feb6005c2b0 0x7feb6005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:31.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.898+0000 7feb737fe700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feb6005c2b0 0x7feb6005e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7feb64004e30 tx=0x7feb64009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:31.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:31.901+0000 7feb6bfff700 1 -- 172.21.15.33:0/4267211447 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7feb5c048e10 con 0x7feb740f6860 2024-02-15T18:28:32.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:30.558174+0000 mgr.smithi033.apxevf (mgr.14162) 230 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:32.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:30.558174+0000 mgr.smithi033.apxevf (mgr.14162) 230 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:32.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.086+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7feb740faaa0 con 0x7feb6005c2b0 2024-02-15T18:28:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.088+0000 7feb6bfff700 1 -- 172.21.15.33:0/4267211447 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+279 (secure 0 0 0) 0x7feb740faaa0 con 0x7feb6005c2b0 2024-02-15T18:28:32.083 INFO:teuthology.orchestra.run.smithi033.stdout:Hostname Path Type Serial Size Health Ident Fault Available 2024-02-15T18:28:32.083 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 /dev/nvme0n1 ssd CVFT5330008Q400BGN 400G Unknown N/A N/A No 2024-02-15T18:28:32.083 INFO:teuthology.orchestra.run.smithi033.stdout:smithi131 /dev/nvme0n1 ssd CVFT623300N4400BGN 400G Unknown N/A N/A No 2024-02-15T18:28:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feb6005c2b0 msgr2=0x7feb6005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feb6005c2b0 0x7feb6005e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7feb64004e30 tx=0x7feb64009b30).stop 2024-02-15T18:28:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f6860 msgr2=0x7feb74109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f6860 0x7feb74109760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7feb5c00c790 tx=0x7feb5c007d70).stop 2024-02-15T18:28:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 shutdown_connections 2024-02-15T18:28:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feb6005c2b0 0x7feb6005e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb740f55c0 0x7feb74109270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 --2- 172.21.15.33:0/4267211447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb740f6860 0x7feb74109760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 >> 172.21.15.33:0/4267211447 conn(0x7feb740f0d40 msgr2=0x7feb7405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 shutdown_connections 2024-02-15T18:28:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:32.089+0000 7feb79e9f700 1 -- 172.21.15.33:0/4267211447 wait complete. 2024-02-15T18:28:32.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:32.087883+0000 mgr.smithi033.apxevf (mgr.14162) 231 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:32.935 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:28:32.945 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:28:32.945 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-15T18:28:33.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:32.087883+0000 mgr.smithi033.apxevf (mgr.14162) 231 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:33.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:32.558496+0000 mgr.smithi033.apxevf (mgr.14162) 232 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:34.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:32.558496+0000 mgr.smithi033.apxevf (mgr.14162) 232 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.962+0000 7f2adb4b9700 1 -- 172.21.15.33:0/216907370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f5430 msgr2=0x7f2ad40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.962+0000 7f2adb4b9700 1 --2- 172.21.15.33:0/216907370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f5430 0x7f2ad40f5850 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f2ad0004660 tx=0x7f2ad0009b30).stop 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.962+0000 7f2adb4b9700 1 -- 172.21.15.33:0/216907370 shutdown_connections 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.962+0000 7f2adb4b9700 1 --2- 172.21.15.33:0/216907370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad40f66d0 0x7f2ad40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.962+0000 7f2adb4b9700 1 --2- 172.21.15.33:0/216907370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f5430 0x7f2ad40f5850 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.962+0000 7f2adb4b9700 1 -- 172.21.15.33:0/216907370 >> 172.21.15.33:0/216907370 conn(0x7f2ad40f0b90 msgr2=0x7f2ad40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.962+0000 7f2adb4b9700 1 -- 172.21.15.33:0/216907370 shutdown_connections 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.962+0000 7f2adb4b9700 1 -- 172.21.15.33:0/216907370 wait complete. 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.962+0000 7f2adb4b9700 1 Processor -- start 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2adb4b9700 1 -- start start 2024-02-15T18:28:34.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2adb4b9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad40f5430 0x7f2ad4105e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2adb4b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f66d0 0x7f2ad4106300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2adb4b9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4106900 con 0x7f2ad40f66d0 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2adb4b9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4107110 con 0x7f2ad40f5430 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2ad9cb6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f66d0 0x7f2ad4106300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2ad9cb6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f66d0 0x7f2ad4106300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46126/0 (socket says 172.21.15.33:46126) 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2ad9cb6700 1 -- 172.21.15.33:0/3091779374 learned_addr learned my addr 172.21.15.33:0/3091779374 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2ada4b7700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad40f5430 0x7f2ad4105e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2ad9cb6700 1 -- 172.21.15.33:0/3091779374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad40f5430 msgr2=0x7f2ad4105e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2ad9cb6700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad40f5430 0x7f2ad4105e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2ad9cb6700 1 -- 172.21.15.33:0/3091779374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0005040 con 0x7f2ad40f66d0 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.963+0000 7f2ad9cb6700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f66d0 0x7f2ad4106300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f2ac40026d0 tx=0x7f2ac4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.964+0000 7f2acaffd700 1 -- 172.21.15.33:0/3091779374 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac4009320 con 0x7f2ad40f66d0 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.964+0000 7f2acaffd700 1 -- 172.21.15.33:0/3091779374 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ac400f040 con 0x7f2ad40f66d0 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.964+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad4107390 con 0x7f2ad40f66d0 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.964+0000 7f2acaffd700 1 -- 172.21.15.33:0/3091779374 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ac4014910 con 0x7f2ad40f66d0 2024-02-15T18:28:34.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.964+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad4107950 con 0x7f2ad40f66d0 2024-02-15T18:28:34.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.964+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad4059100 con 0x7f2ad40f66d0 2024-02-15T18:28:34.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.965+0000 7f2acaffd700 1 -- 172.21.15.33:0/3091779374 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2ac40077b0 con 0x7f2ad40f66d0 2024-02-15T18:28:34.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.965+0000 7f2acaffd700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2ac005c300 0x7f2ac005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:34.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.965+0000 7f2acaffd700 1 -- 172.21.15.33:0/3091779374 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f2ac4076120 con 0x7f2ad40f66d0 2024-02-15T18:28:34.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.965+0000 7f2ada4b7700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2ac005c300 0x7f2ac005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:34.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.966+0000 7f2ada4b7700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2ac005c300 0x7f2ac005e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2ad4105b80 tx=0x7f2ad0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:34.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:34.969+0000 7f2acaffd700 1 -- 172.21.15.33:0/3091779374 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2ac4049120 con 0x7f2ad40f66d0 2024-02-15T18:28:35.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:35.154+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ad40fde70 con 0x7f2ac005c300 2024-02-15T18:28:35.917 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:34.558997+0000 mgr.smithi033.apxevf (mgr.14162) 233 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:35.917 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:35.156347+0000 mgr.smithi033.apxevf (mgr.14162) 234 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:35.917 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:35.156865+0000 mon.smithi033 (mon.0) 455 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-15T18:28:36.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:34.558997+0000 mgr.smithi033.apxevf (mgr.14162) 233 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:36.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:35.156347+0000 mgr.smithi033.apxevf (mgr.14162) 234 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:28:36.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:35.156865+0000 mon.smithi033 (mon.0) 455 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-15T18:28:36.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.662+0000 7f2acaffd700 1 -- 172.21.15.33:0/3091779374 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2ad40fde70 con 0x7f2ac005c300 2024-02-15T18:28:36.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.664+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2ac005c300 msgr2=0x7f2ac005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:36.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.664+0000 7f2adb4b9700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2ac005c300 0x7f2ac005e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f2ad4105b80 tx=0x7f2ad0009b30).stop 2024-02-15T18:28:36.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.664+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f66d0 msgr2=0x7f2ad4106300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:36.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.664+0000 7f2adb4b9700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f66d0 0x7f2ad4106300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f2ac40026d0 tx=0x7f2ac4009de0).stop 2024-02-15T18:28:36.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.665+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 shutdown_connections 2024-02-15T18:28:36.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.665+0000 7f2adb4b9700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f2ac005c300 0x7f2ac005e7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:36.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.665+0000 7f2adb4b9700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ad40f5430 0x7f2ad4105e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:36.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.665+0000 7f2adb4b9700 1 --2- 172.21.15.33:0/3091779374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ad40f66d0 0x7f2ad4106300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:36.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.665+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 >> 172.21.15.33:0/3091779374 conn(0x7f2ad40f0b90 msgr2=0x7f2ad40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:36.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.665+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 shutdown_connections 2024-02-15T18:28:36.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:36.665+0000 7f2adb4b9700 1 -- 172.21.15.33:0/3091779374 wait complete. 2024-02-15T18:28:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:35.630466+0000 mon.smithi033 (mon.0) 456 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-15T18:28:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:35.630537+0000 mon.smithi033 (mon.0) 457 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-02-15T18:28:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:35.633109+0000 mon.smithi033 (mon.0) 458 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-15T18:28:37.018 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:28:36.636+0000 7fd5a099c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T18:28:37.018 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:35.630466+0000 mon.smithi033 (mon.0) 456 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-15T18:28:37.018 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:35.630537+0000 mon.smithi033 (mon.0) 457 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-02-15T18:28:37.018 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:35.633109+0000 mon.smithi033 (mon.0) 458 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-15T18:28:37.484 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T18:28:37.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:36.559517+0000 mgr.smithi033.apxevf (mgr.14162) 235 : cluster [DBG] pgmap v200: 33 pgs: 12 creating+peering, 1 active+clean, 20 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.632460+0000 mon.smithi033 (mon.0) 459 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:36.632625+0000 mon.smithi033 (mon.0) 460 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.637435+0000 mon.smithi033 (mon.0) 461 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:36.638335+0000 mon.smithi033 (mon.0) 462 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:36.638365+0000 mon.smithi033 (mon.0) 463 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:36.654157+0000 mon.smithi033 (mon.0) 464 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.654820+0000 mon.smithi033 (mon.0) 465 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:36.654928+0000 mon.smithi033 (mon.0) 466 : cluster [DBG] fsmap cephfs:0 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:28:36.659211+0000 mgr.smithi033.apxevf (mgr.14162) 236 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.663627+0000 mon.smithi033 (mon.0) 467 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.664507+0000 mon.smithi033 (mon.0) 468 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.672472+0000 mon.smithi033 (mon.0) 469 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:37.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.679132+0000 mon.smithi033 (mon.0) 470 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:37.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.680100+0000 mon.smithi033 (mon.0) 471 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.ywlevz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:28:37.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.683250+0000 mon.smithi033 (mon.0) 472 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.ywlevz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:28:37.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:36.683980+0000 mon.smithi033 (mon.0) 473 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:37.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:28:36.684735+0000 mgr.smithi033.apxevf (mgr.14162) 237 : cephadm [INF] Deploying daemon mds.cephfs.smithi131.ywlevz on smithi131 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:36.559517+0000 mgr.smithi033.apxevf (mgr.14162) 235 : cluster [DBG] pgmap v200: 33 pgs: 12 creating+peering, 1 active+clean, 20 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.632460+0000 mon.smithi033 (mon.0) 459 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:36.632625+0000 mon.smithi033 (mon.0) 460 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.637435+0000 mon.smithi033 (mon.0) 461 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:36.638335+0000 mon.smithi033 (mon.0) 462 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:36.638365+0000 mon.smithi033 (mon.0) 463 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:36.654157+0000 mon.smithi033 (mon.0) 464 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.654820+0000 mon.smithi033 (mon.0) 465 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:36.654928+0000 mon.smithi033 (mon.0) 466 : cluster [DBG] fsmap cephfs:0 2024-02-15T18:28:38.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:28:36.659211+0000 mgr.smithi033.apxevf (mgr.14162) 236 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-02-15T18:28:38.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.663627+0000 mon.smithi033 (mon.0) 467 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:38.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.664507+0000 mon.smithi033 (mon.0) 468 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:38.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.672472+0000 mon.smithi033 (mon.0) 469 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:38.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.679132+0000 mon.smithi033 (mon.0) 470 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:38.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.680100+0000 mon.smithi033 (mon.0) 471 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.ywlevz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:28:38.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.683250+0000 mon.smithi033 (mon.0) 472 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.ywlevz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:28:38.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:36.683980+0000 mon.smithi033 (mon.0) 473 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:38.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:28:36.684735+0000 mgr.smithi033.apxevf (mgr.14162) 237 : cephadm [INF] Deploying daemon mds.cephfs.smithi131.ywlevz on smithi131 2024-02-15T18:28:38.990 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:37.657501+0000 mon.smithi033 (mon.0) 474 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-02-15T18:28:39.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:37.657501+0000 mon.smithi033 (mon.0) 474 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.688+0000 7f87e7f68700 1 -- 172.21.15.33:0/1001444797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 msgr2=0x7f87e00fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.688+0000 7f87e7f68700 1 --2- 172.21.15.33:0/1001444797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 0x7f87e00fe040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f87d0004660 tx=0x7f87d0009b30).stop 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.688+0000 7f87e7f68700 1 -- 172.21.15.33:0/1001444797 shutdown_connections 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.688+0000 7f87e7f68700 1 --2- 172.21.15.33:0/1001444797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 0x7f87e00fe040 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.688+0000 7f87e7f68700 1 --2- 172.21.15.33:0/1001444797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87e00f6d10 0x7f87e00f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.688+0000 7f87e7f68700 1 -- 172.21.15.33:0/1001444797 >> 172.21.15.33:0/1001444797 conn(0x7f87e00f0540 msgr2=0x7f87e00f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.689+0000 7f87e7f68700 1 -- 172.21.15.33:0/1001444797 shutdown_connections 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.689+0000 7f87e7f68700 1 -- 172.21.15.33:0/1001444797 wait complete. 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.689+0000 7f87e7f68700 1 Processor -- start 2024-02-15T18:28:39.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.689+0000 7f87e7f68700 1 -- start start 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e7f68700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87e00f6d10 0x7f87e0109210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e7f68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 0x7f87e0109700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e7f68700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0109cb0 con 0x7f87e00f7620 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e7f68700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0109df0 con 0x7f87e00f6d10 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e5503700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 0x7f87e0109700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e5503700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 0x7f87e0109700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57956/0 (socket says 172.21.15.33:57956) 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e5503700 1 -- 172.21.15.33:0/3693023409 learned_addr learned my addr 172.21.15.33:0/3693023409 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e5d04700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87e00f6d10 0x7f87e0109210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e5503700 1 -- 172.21.15.33:0/3693023409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87e00f6d10 msgr2=0x7f87e0109210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e5503700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87e00f6d10 0x7f87e0109210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e5503700 1 -- 172.21.15.33:0/3693023409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0005040 con 0x7f87e00f7620 2024-02-15T18:28:39.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87e5503700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 0x7f87e0109700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f87d0009830 tx=0x7f87d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:39.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87d67fc700 1 -- 172.21.15.33:0/3693023409 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87d0018070 con 0x7f87e00f7620 2024-02-15T18:28:39.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.690+0000 7f87d67fc700 1 -- 172.21.15.33:0/3693023409 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87d0007ba0 con 0x7f87e00f7620 2024-02-15T18:28:39.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.691+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e010a730 con 0x7f87e00f7620 2024-02-15T18:28:39.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.691+0000 7f87d67fc700 1 -- 172.21.15.33:0/3693023409 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87d001c3c0 con 0x7f87e00f7620 2024-02-15T18:28:39.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.691+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e010ac90 con 0x7f87e00f7620 2024-02-15T18:28:39.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.692+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e0045ad0 con 0x7f87e00f7620 2024-02-15T18:28:39.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.692+0000 7f87d67fc700 1 -- 172.21.15.33:0/3693023409 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f87d001c630 con 0x7f87e00f7620 2024-02-15T18:28:39.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.692+0000 7f87d67fc700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f87cc05c2b0 0x7f87cc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:39.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.692+0000 7f87d67fc700 1 -- 172.21.15.33:0/3693023409 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f87d0077aa0 con 0x7f87e00f7620 2024-02-15T18:28:39.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.692+0000 7f87e5d04700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f87cc05c2b0 0x7f87cc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:39.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.693+0000 7f87e5d04700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f87cc05c2b0 0x7f87cc05e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f87dc004c40 tx=0x7f87dc00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:39.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.697+0000 7f87d67fc700 1 -- 172.21.15.33:0/3693023409 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f87d004a7e0 con 0x7f87e00f7620 2024-02-15T18:28:39.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.900+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f87e0027a00 con 0x7f87e00f7620 2024-02-15T18:28:39.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.901+0000 7f87d67fc700 1 -- 172.21.15.33:0/3693023409 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1147 (secure 0 0 0) 0x7f87d004de00 con 0x7f87e00f7620 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:e4 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 4 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:28:39.660619+0000 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:28:39.897 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255} 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-02-15T18:28:39.898 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:28:39.899 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 0 2024-02-15T18:28:39.899 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:creating seq 1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707]] 2024-02-15T18:28:39.899 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:39.899 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:39.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.902+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f87cc05c2b0 msgr2=0x7f87cc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.902+0000 7f87e7f68700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f87cc05c2b0 0x7f87cc05e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f87dc004c40 tx=0x7f87dc00b040).stop 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.902+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 msgr2=0x7f87e0109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.902+0000 7f87e7f68700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 0x7f87e0109700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f87d0009830 tx=0x7f87d0009b30).stop 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.902+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 shutdown_connections 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.902+0000 7f87e7f68700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f87cc05c2b0 0x7f87cc05e770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.902+0000 7f87e7f68700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87e00f6d10 0x7f87e0109210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.902+0000 7f87e7f68700 1 --2- 172.21.15.33:0/3693023409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87e00f7620 0x7f87e0109700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.902+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 >> 172.21.15.33:0/3693023409 conn(0x7f87e00f0540 msgr2=0x7f87e00f2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.903+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 shutdown_connections 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:39.903+0000 7f87e7f68700 1 -- 172.21.15.33:0/3693023409 wait complete. 2024-02-15T18:28:39.900 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 4 2024-02-15T18:28:39.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:38.559999+0000 mgr.smithi033.apxevf (mgr.14162) 238 : cluster [DBG] pgmap v204: 65 pgs: 12 creating+peering, 1 active+clean, 52 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:39.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:38.659449+0000 mon.smithi033 (mon.0) 475 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-02-15T18:28:39.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:39.112765+0000 mon.smithi033 (mon.0) 476 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:39.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:39.113738+0000 mon.smithi033 (mon.0) 477 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.qszefh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:28:39.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:39.116961+0000 mon.smithi033 (mon.0) 478 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.qszefh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:28:39.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:39.117769+0000 mon.smithi033 (mon.0) 479 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:39.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:28:39.118530+0000 mgr.smithi033.apxevf (mgr.14162) 239 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.qszefh on smithi033 2024-02-15T18:28:40.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:38.559999+0000 mgr.smithi033.apxevf (mgr.14162) 238 : cluster [DBG] pgmap v204: 65 pgs: 12 creating+peering, 1 active+clean, 52 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:40.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:38.659449+0000 mon.smithi033 (mon.0) 475 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-02-15T18:28:40.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:39.112765+0000 mon.smithi033 (mon.0) 476 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:40.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:39.113738+0000 mon.smithi033 (mon.0) 477 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.qszefh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:28:40.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:39.116961+0000 mon.smithi033 (mon.0) 478 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.qszefh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:28:40.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:39.117769+0000 mon.smithi033 (mon.0) 479 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:40.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:28:39.118530+0000 mgr.smithi033.apxevf (mgr.14162) 239 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.qszefh on smithi033 2024-02-15T18:28:40.699 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:28:40.708 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:28:40.708 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-15T18:28:41.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:39.660540+0000 mon.smithi033 (mon.0) 480 : cluster [DBG] mds.? [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] up:boot 2024-02-15T18:28:41.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:39.660596+0000 mon.smithi033 (mon.0) 481 : cluster [INF] daemon mds.cephfs.smithi131.ywlevz assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-15T18:28:41.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:39.660640+0000 mon.smithi033 (mon.0) 482 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T18:28:41.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:39.660659+0000 mon.smithi033 (mon.0) 483 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:28:41.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:39.660668+0000 mon.smithi033 (mon.0) 484 : cluster [INF] Cluster is now healthy 2024-02-15T18:28:41.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:39.660927+0000 mon.smithi033 (mon.0) 485 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-02-15T18:28:41.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:39.661024+0000 mon.smithi033 (mon.0) 486 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:28:41.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:39.665617+0000 mon.smithi033 (mon.0) 487 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:creating} 2024-02-15T18:28:41.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:39.676074+0000 mon.smithi033 (mon.0) 488 : cluster [INF] daemon mds.cephfs.smithi131.ywlevz is now active in filesystem cephfs as rank 0 2024-02-15T18:28:41.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:39.902706+0000 mon.smithi033 (mon.0) 489 : audit [DBG] from='client.? 172.21.15.33:0/3693023409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:28:41.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:39.660540+0000 mon.smithi033 (mon.0) 480 : cluster [DBG] mds.? [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] up:boot 2024-02-15T18:28:41.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:39.660596+0000 mon.smithi033 (mon.0) 481 : cluster [INF] daemon mds.cephfs.smithi131.ywlevz assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-15T18:28:41.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:39.660640+0000 mon.smithi033 (mon.0) 482 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T18:28:41.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:39.660659+0000 mon.smithi033 (mon.0) 483 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:28:41.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:39.660668+0000 mon.smithi033 (mon.0) 484 : cluster [INF] Cluster is now healthy 2024-02-15T18:28:41.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:39.660927+0000 mon.smithi033 (mon.0) 485 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-02-15T18:28:41.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:39.661024+0000 mon.smithi033 (mon.0) 486 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:28:41.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:39.665617+0000 mon.smithi033 (mon.0) 487 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:creating} 2024-02-15T18:28:41.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:39.676074+0000 mon.smithi033 (mon.0) 488 : cluster [INF] daemon mds.cephfs.smithi131.ywlevz is now active in filesystem cephfs as rank 0 2024-02-15T18:28:41.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:39.902706+0000 mon.smithi033 (mon.0) 489 : audit [DBG] from='client.? 172.21.15.33:0/3693023409' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:28:41.896 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:40.560544+0000 mgr.smithi033.apxevf (mgr.14162) 240 : cluster [DBG] pgmap v206: 65 pgs: 38 active+clean, 12 creating+peering, 15 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:41.896 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:40.669010+0000 mon.smithi033 (mon.0) 490 : cluster [DBG] mds.? [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] up:active 2024-02-15T18:28:41.896 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:40.669110+0000 mon.smithi033 (mon.0) 491 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2024-02-15T18:28:42.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:40.560544+0000 mgr.smithi033.apxevf (mgr.14162) 240 : cluster [DBG] pgmap v206: 65 pgs: 38 active+clean, 12 creating+peering, 15 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:42.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:40.669010+0000 mon.smithi033 (mon.0) 490 : cluster [DBG] mds.? [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] up:active 2024-02-15T18:28:42.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:40.669110+0000 mon.smithi033 (mon.0) 491 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2024-02-15T18:28:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.785+0000 7f64b359e700 1 -- 172.21.15.33:0/2360165655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 msgr2=0x7f64b40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.785+0000 7f64b359e700 1 --2- 172.21.15.33:0/2360165655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 0x7f64b40f6950 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f64a4004660 tx=0x7f64a4009b30).stop 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.785+0000 7f64b359e700 1 -- 172.21.15.33:0/2360165655 shutdown_connections 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.785+0000 7f64b359e700 1 --2- 172.21.15.33:0/2360165655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64b40f77d0 0x7f64b40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.785+0000 7f64b359e700 1 --2- 172.21.15.33:0/2360165655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 0x7f64b40f6950 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.785+0000 7f64b359e700 1 -- 172.21.15.33:0/2360165655 >> 172.21.15.33:0/2360165655 conn(0x7f64b40f1c90 msgr2=0x7f64b40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.785+0000 7f64b359e700 1 -- 172.21.15.33:0/2360165655 shutdown_connections 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.785+0000 7f64b359e700 1 -- 172.21.15.33:0/2360165655 wait complete. 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b359e700 1 Processor -- start 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b359e700 1 -- start start 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 0x7f64b4106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64b40f77d0 0x7f64b41073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4107960 con 0x7f64b40f6530 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4108160 con 0x7f64b40f77d0 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 0x7f64b4106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 0x7f64b4106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58008/0 (socket says 172.21.15.33:58008) 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b1d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64b40f77d0 0x7f64b41073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.786+0000 7f64b259c700 1 -- 172.21.15.33:0/3487241601 learned_addr learned my addr 172.21.15.33:0/3487241601 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.787+0000 7f64b259c700 1 -- 172.21.15.33:0/3487241601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64b40f77d0 msgr2=0x7f64b41073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.787+0000 7f64b259c700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64b40f77d0 0x7f64b41073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.787+0000 7f64b259c700 1 -- 172.21.15.33:0/3487241601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4005040 con 0x7f64b40f6530 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.787+0000 7f64b259c700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 0x7f64b4106ec0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f64a4004e30 tx=0x7f64a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.787+0000 7f64aaffd700 1 -- 172.21.15.33:0/3487241601 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a4018070 con 0x7f64b40f6530 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.787+0000 7f64aaffd700 1 -- 172.21.15.33:0/3487241601 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64a4007ba0 con 0x7f64b40f6530 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.787+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b41083e0 con 0x7f64b40f6530 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.787+0000 7f64aaffd700 1 -- 172.21.15.33:0/3487241601 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a401c3c0 con 0x7f64b40f6530 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.787+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b4108940 con 0x7f64b40f6530 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.788+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b4059100 con 0x7f64b40f6530 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.788+0000 7f64aaffd700 1 -- 172.21.15.33:0/3487241601 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f64a4007d10 con 0x7f64b40f6530 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.789+0000 7f64aaffd700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f64a005c300 0x7f64a005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.789+0000 7f64aaffd700 1 -- 172.21.15.33:0/3487241601 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f64a40779f0 con 0x7f64b40f6530 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.789+0000 7f64b1d9b700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f64a005c300 0x7f64a005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.789+0000 7f64b1d9b700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f64a005c300 0x7f64a005e7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f649c004ce0 tx=0x7f649c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.793+0000 7f64aaffd700 1 -- 172.21.15.33:0/3487241601 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f64a4079e60 con 0x7f64b40f6530 2024-02-15T18:28:43.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:43.993+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f64b40fee00 con 0x7f64b40f6530 2024-02-15T18:28:44.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:42.560994+0000 mgr.smithi033.apxevf (mgr.14162) 241 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 182 B data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:44.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:43.630194+0000 mon.smithi033 (mon.0) 492 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:44.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:43.631056+0000 mon.smithi033 (mon.0) 493 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.bgnwzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:28:44.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:43.633733+0000 mon.smithi033 (mon.0) 494 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.bgnwzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:28:44.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:43.634431+0000 mon.smithi033 (mon.0) 495 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:44.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:42.560994+0000 mgr.smithi033.apxevf (mgr.14162) 241 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 182 B data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:28:44.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:43.630194+0000 mon.smithi033 (mon.0) 492 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:44.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:43.631056+0000 mon.smithi033 (mon.0) 493 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.bgnwzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:28:44.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:43.633733+0000 mon.smithi033 (mon.0) 494 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.bgnwzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:28:44.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:43.634431+0000 mon.smithi033 (mon.0) 495 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:44.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.677+0000 7f64aaffd700 1 -- 172.21.15.33:0/3487241601 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f64a404a730 con 0x7f64b40f6530 2024-02-15T18:28:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f64a005c300 msgr2=0x7f64a005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f64a005c300 0x7f64a005e7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f649c004ce0 tx=0x7f649c00b040).stop 2024-02-15T18:28:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 msgr2=0x7f64b4106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 0x7f64b4106ec0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f64a4004e30 tx=0x7f64a4009b30).stop 2024-02-15T18:28:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 shutdown_connections 2024-02-15T18:28:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f64a005c300 0x7f64a005e7c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:44.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64b40f6530 0x7f64b4106ec0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:44.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 --2- 172.21.15.33:0/3487241601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64b40f77d0 0x7f64b41073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:44.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 >> 172.21.15.33:0/3487241601 conn(0x7f64b40f1c90 msgr2=0x7f64b40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:44.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 shutdown_connections 2024-02-15T18:28:44.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:44.679+0000 7f64b359e700 1 -- 172.21.15.33:0/3487241601 wait complete. 2024-02-15T18:28:45.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:28:43.634978+0000 mgr.smithi033.apxevf (mgr.14162) 242 : cephadm [INF] Deploying daemon mds.cephfs.smithi131.bgnwzs on smithi131 2024-02-15T18:28:45.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:43.995009+0000 mon.smithi033 (mon.0) 496 : audit [INF] from='client.? 172.21.15.33:0/3487241601' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T18:28:45.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:28:43.634978+0000 mgr.smithi033.apxevf (mgr.14162) 242 : cephadm [INF] Deploying daemon mds.cephfs.smithi131.bgnwzs on smithi131 2024-02-15T18:28:45.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:43.995009+0000 mon.smithi033 (mon.0) 496 : audit [INF] from='client.? 172.21.15.33:0/3487241601' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T18:28:45.425 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:28:45.435 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:28:45.435 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-02-15T18:28:45.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:44.561473+0000 mgr.smithi033.apxevf (mgr.14162) 243 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 8 op/s 2024-02-15T18:28:45.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:44.671753+0000 mon.smithi033 (mon.0) 497 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:28:45.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:44.678462+0000 mon.smithi033 (mon.0) 498 : audit [INF] from='client.? 172.21.15.33:0/3487241601' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T18:28:45.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:44.678577+0000 mon.smithi033 (mon.0) 499 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2024-02-15T18:28:45.959 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:44.561473+0000 mgr.smithi033.apxevf (mgr.14162) 243 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 8 op/s 2024-02-15T18:28:45.959 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:44.671753+0000 mon.smithi033 (mon.0) 497 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:28:45.959 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:44.678462+0000 mon.smithi033 (mon.0) 498 : audit [INF] from='client.? 172.21.15.33:0/3487241601' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T18:28:45.959 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:44.678577+0000 mon.smithi033 (mon.0) 499 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2024-02-15T18:28:47.300 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:46.089128+0000 mon.smithi033 (mon.0) 500 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:46.089872+0000 mon.smithi033 (mon.0) 501 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.mcppgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:46.094950+0000 mon.smithi033 (mon.0) 502 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.mcppgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:46.095556+0000 mon.smithi033 (mon.0) 503 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:28:46.096140+0000 mgr.smithi033.apxevf (mgr.14162) 244 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.mcppgd on smithi033 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:46.677376+0000 mon.smithi033 (mon.0) 504 : cluster [DBG] mds.? [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] up:boot 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:46.677417+0000 mon.smithi033 (mon.0) 505 : cluster [INF] daemon mds.cephfs.smithi131.bgnwzs assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:46.677499+0000 mon.smithi033 (mon.0) 506 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:46.677514+0000 mon.smithi033 (mon.0) 507 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:46.677990+0000 mon.smithi033 (mon.0) 508 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 1 up:standby 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:46.678084+0000 mon.smithi033 (mon.0) 509 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:46.682260+0000 mon.smithi033 (mon.0) 510 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:creating} 2024-02-15T18:28:47.301 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:46.693671+0000 mon.smithi033 (mon.0) 511 : cluster [INF] daemon mds.cephfs.smithi131.bgnwzs is now active in filesystem cephfs as rank 1 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:46.089128+0000 mon.smithi033 (mon.0) 500 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:46.089872+0000 mon.smithi033 (mon.0) 501 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.mcppgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:46.094950+0000 mon.smithi033 (mon.0) 502 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.mcppgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:46.095556+0000 mon.smithi033 (mon.0) 503 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:28:46.096140+0000 mgr.smithi033.apxevf (mgr.14162) 244 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.mcppgd on smithi033 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:46.677376+0000 mon.smithi033 (mon.0) 504 : cluster [DBG] mds.? [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] up:boot 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:46.677417+0000 mon.smithi033 (mon.0) 505 : cluster [INF] daemon mds.cephfs.smithi131.bgnwzs assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:46.677499+0000 mon.smithi033 (mon.0) 506 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:46.677514+0000 mon.smithi033 (mon.0) 507 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:46.677990+0000 mon.smithi033 (mon.0) 508 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 1 up:standby 2024-02-15T18:28:47.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:46.678084+0000 mon.smithi033 (mon.0) 509 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:28:47.502 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:46.682260+0000 mon.smithi033 (mon.0) 510 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:creating} 2024-02-15T18:28:47.502 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:46.693671+0000 mon.smithi033 (mon.0) 511 : cluster [INF] daemon mds.cephfs.smithi131.bgnwzs is now active in filesystem cephfs as rank 1 2024-02-15T18:28:48.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.821+0000 7feaba1e9700 1 -- 172.21.15.33:0/3042249650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 msgr2=0x7feab40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:48.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.821+0000 7feaba1e9700 1 --2- 172.21.15.33:0/3042249650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 0x7feab40f6b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7feaa4004660 tx=0x7feaa4009b30).stop 2024-02-15T18:28:48.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.821+0000 7feaba1e9700 1 -- 172.21.15.33:0/3042249650 shutdown_connections 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.821+0000 7feaba1e9700 1 --2- 172.21.15.33:0/3042249650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab40f7980 0x7feab40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.821+0000 7feaba1e9700 1 --2- 172.21.15.33:0/3042249650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 0x7feab40f6b00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.821+0000 7feaba1e9700 1 -- 172.21.15.33:0/3042249650 >> 172.21.15.33:0/3042249650 conn(0x7feab40f1e40 msgr2=0x7feab40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.821+0000 7feaba1e9700 1 -- 172.21.15.33:0/3042249650 shutdown_connections 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.822+0000 7feaba1e9700 1 -- 172.21.15.33:0/3042249650 wait complete. 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.822+0000 7feaba1e9700 1 Processor -- start 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feaba1e9700 1 -- start start 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feaba1e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 0x7feab406b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feaba1e9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab40f7980 0x7feab406a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feaba1e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab406bb40 con 0x7feab40f66e0 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feaba1e9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab406bc80 con 0x7feab40f7980 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feab37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 0x7feab406b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feab37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 0x7feab406b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46402/0 (socket says 172.21.15.33:46402) 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feab37fe700 1 -- 172.21.15.33:0/1544386705 learned_addr learned my addr 172.21.15.33:0/1544386705 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feab2ffd700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab40f7980 0x7feab406a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feab37fe700 1 -- 172.21.15.33:0/1544386705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab40f7980 msgr2=0x7feab406a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feab37fe700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab40f7980 0x7feab406a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.823+0000 7feab37fe700 1 -- 172.21.15.33:0/1544386705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4005040 con 0x7feab40f66e0 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.824+0000 7feab37fe700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 0x7feab406b540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7feaa4009f50 tx=0x7feaa4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.824+0000 7feaabfff700 1 -- 172.21.15.33:0/1544386705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa4018070 con 0x7feab40f66e0 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.824+0000 7feaabfff700 1 -- 172.21.15.33:0/1544386705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feaa4007c70 con 0x7feab40f66e0 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.824+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab406a560 con 0x7feab40f66e0 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.824+0000 7feaabfff700 1 -- 172.21.15.33:0/1544386705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa401c620 con 0x7feab40f66e0 2024-02-15T18:28:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.824+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab406aac0 con 0x7feab40f66e0 2024-02-15T18:28:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.825+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab40f5ad0 con 0x7feab40f66e0 2024-02-15T18:28:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.825+0000 7feaabfff700 1 -- 172.21.15.33:0/1544386705 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7feaa401d420 con 0x7feab40f66e0 2024-02-15T18:28:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.826+0000 7feaabfff700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feaa005c2b0 0x7feaa005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.826+0000 7feaabfff700 1 -- 172.21.15.33:0/1544386705 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7feaa4077cb0 con 0x7feab40f66e0 2024-02-15T18:28:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.826+0000 7feab2ffd700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feaa005c2b0 0x7feaa005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.826+0000 7feab2ffd700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feaa005c2b0 0x7feaa005e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fea9c0041d0 tx=0x7fea9c009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:47.830+0000 7feaabfff700 1 -- 172.21.15.33:0/1544386705 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7feaa404a970 con 0x7feab40f66e0 2024-02-15T18:28:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.039+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feab40ff120 con 0x7feab40f66e0 2024-02-15T18:28:48.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:46.561861+0000 mgr.smithi033.apxevf (mgr.14162) 245 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s wr, 4 op/s 2024-02-15T18:28:48.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:47.680873+0000 mon.smithi033 (mon.0) 512 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T18:28:48.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:47.680901+0000 mon.smithi033 (mon.0) 513 : cluster [INF] Cluster is now healthy 2024-02-15T18:28:48.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:47.684624+0000 mon.smithi033 (mon.0) 514 : cluster [DBG] mds.? [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] up:active 2024-02-15T18:28:48.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:47.684721+0000 mon.smithi033 (mon.0) 515 : cluster [DBG] mds.? [v2:172.21.15.33:6826/3858685802,v1:172.21.15.33:6827/3858685802] up:boot 2024-02-15T18:28:48.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:47.684786+0000 mon.smithi033 (mon.0) 516 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:28:48.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:47.684914+0000 mon.smithi033 (mon.0) 517 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:28:48.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:48.041716+0000 mon.smithi033 (mon.0) 518 : audit [INF] from='client.? 172.21.15.33:0/1544386705' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-15T18:28:48.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:46.561861+0000 mgr.smithi033.apxevf (mgr.14162) 245 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s wr, 4 op/s 2024-02-15T18:28:48.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:47.680873+0000 mon.smithi033 (mon.0) 512 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-15T18:28:48.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:47.680901+0000 mon.smithi033 (mon.0) 513 : cluster [INF] Cluster is now healthy 2024-02-15T18:28:48.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:47.684624+0000 mon.smithi033 (mon.0) 514 : cluster [DBG] mds.? [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] up:active 2024-02-15T18:28:48.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:47.684721+0000 mon.smithi033 (mon.0) 515 : cluster [DBG] mds.? [v2:172.21.15.33:6826/3858685802,v1:172.21.15.33:6827/3858685802] up:boot 2024-02-15T18:28:48.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:47.684786+0000 mon.smithi033 (mon.0) 516 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:28:48.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:47.684914+0000 mon.smithi033 (mon.0) 517 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:28:48.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:48.041716+0000 mon.smithi033 (mon.0) 518 : audit [INF] from='client.? 172.21.15.33:0/1544386705' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-15T18:28:48.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.683+0000 7feaabfff700 1 -- 172.21.15.33:0/1544386705 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7feaa404df90 con 0x7feab40f66e0 2024-02-15T18:28:48.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feaa005c2b0 msgr2=0x7feaa005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feaa005c2b0 0x7feaa005e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fea9c0041d0 tx=0x7fea9c009040).stop 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 msgr2=0x7feab406b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 0x7feab406b540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7feaa4009f50 tx=0x7feaa4009b30).stop 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 shutdown_connections 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7feaa005c2b0 0x7feaa005e770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feab40f66e0 0x7feab406b540 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 --2- 172.21.15.33:0/1544386705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feab40f7980 0x7feab406a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 >> 172.21.15.33:0/1544386705 conn(0x7feab40f1e40 msgr2=0x7feab40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 shutdown_connections 2024-02-15T18:28:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:48.686+0000 7feaba1e9700 1 -- 172.21.15.33:0/1544386705 wait complete. 2024-02-15T18:28:49.445 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:28:49.456 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:28:49.456 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-02-15T18:28:50.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:48.562280+0000 mgr.smithi033.apxevf (mgr.14162) 246 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 3 op/s 2024-02-15T18:28:50.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:48.685451+0000 mon.smithi033 (mon.0) 519 : audit [INF] from='client.? 172.21.15.33:0/1544386705' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-15T18:28:50.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:48.685564+0000 mon.smithi033 (mon.0) 520 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:28:50.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:48.562280+0000 mgr.smithi033.apxevf (mgr.14162) 246 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 3 op/s 2024-02-15T18:28:50.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:48.685451+0000 mon.smithi033 (mon.0) 519 : audit [INF] from='client.? 172.21.15.33:0/1544386705' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-15T18:28:50.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:48.685564+0000 mon.smithi033 (mon.0) 520 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.700+0000 7f8ea8c63700 1 -- 172.21.15.33:0/1371527013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 msgr2=0x7f8ea40f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.700+0000 7f8ea8c63700 1 --2- 172.21.15.33:0/1371527013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 0x7f8ea40f5850 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f8e9c004660 tx=0x7f8e9c009b30).stop 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.700+0000 7f8ea8c63700 1 -- 172.21.15.33:0/1371527013 shutdown_connections 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.700+0000 7f8ea8c63700 1 --2- 172.21.15.33:0/1371527013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ea40f66d0 0x7f8ea40f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.700+0000 7f8ea8c63700 1 --2- 172.21.15.33:0/1371527013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 0x7f8ea40f5850 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.700+0000 7f8ea8c63700 1 -- 172.21.15.33:0/1371527013 >> 172.21.15.33:0/1371527013 conn(0x7f8ea40f0b90 msgr2=0x7f8ea40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.700+0000 7f8ea8c63700 1 -- 172.21.15.33:0/1371527013 shutdown_connections 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.700+0000 7f8ea8c63700 1 -- 172.21.15.33:0/1371527013 wait complete. 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.701+0000 7f8ea8c63700 1 Processor -- start 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.701+0000 7f8ea8c63700 1 -- start start 2024-02-15T18:28:51.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.701+0000 7f8ea8c63700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 0x7f8ea4106e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.701+0000 7f8ea8c63700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ea40f66d0 0x7f8ea4107360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.701+0000 7f8ea8c63700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4107910 con 0x7f8ea40f5430 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.701+0000 7f8ea8c63700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4107a50 con 0x7f8ea40f66d0 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 0x7f8ea4106e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 0x7f8ea4106e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46436/0 (socket says 172.21.15.33:46436) 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea37fe700 1 -- 172.21.15.33:0/2618656735 learned_addr learned my addr 172.21.15.33:0/2618656735 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea2ffd700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ea40f66d0 0x7f8ea4107360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea37fe700 1 -- 172.21.15.33:0/2618656735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ea40f66d0 msgr2=0x7f8ea4107360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea37fe700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ea40f66d0 0x7f8ea4107360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea37fe700 1 -- 172.21.15.33:0/2618656735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c005040 con 0x7f8ea40f5430 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea37fe700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 0x7f8ea4106e70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8e9c004e30 tx=0x7f8e9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8e9bfff700 1 -- 172.21.15.33:0/2618656735 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e9c018070 con 0x7f8ea40f5430 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea4108390 con 0x7f8ea40f5430 2024-02-15T18:28:51.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8e9bfff700 1 -- 172.21.15.33:0/2618656735 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e9c007ba0 con 0x7f8ea40f5430 2024-02-15T18:28:51.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8e9bfff700 1 -- 172.21.15.33:0/2618656735 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e9c01c3c0 con 0x7f8ea40f5430 2024-02-15T18:28:51.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.702+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea41088f0 con 0x7f8ea40f5430 2024-02-15T18:28:51.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.703+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea4045ad0 con 0x7f8ea40f5430 2024-02-15T18:28:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.704+0000 7f8e9bfff700 1 -- 172.21.15.33:0/2618656735 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8e9c007d10 con 0x7f8ea40f5430 2024-02-15T18:28:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.704+0000 7f8e9bfff700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8e9005c300 0x7f8e9005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.705+0000 7f8e9bfff700 1 -- 172.21.15.33:0/2618656735 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8e9c077aa0 con 0x7f8ea40f5430 2024-02-15T18:28:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.705+0000 7f8ea2ffd700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8e9005c300 0x7f8e9005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.705+0000 7f8ea2ffd700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8e9005c300 0x7f8e9005e7c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8e8c004c40 tx=0x7f8e8c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.709+0000 7f8e9bfff700 1 -- 172.21.15.33:0/2618656735 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8e9c04a760 con 0x7f8ea40f5430 2024-02-15T18:28:51.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:51.919+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ea40fde80 con 0x7f8ea40f5430 2024-02-15T18:28:52.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:50.562710+0000 mgr.smithi033.apxevf (mgr.14162) 247 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 2.4 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 5 op/s 2024-02-15T18:28:52.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:50.766312+0000 mon.smithi033 (mon.0) 521 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:52.051 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:50.767077+0000 mon.smithi033 (mon.0) 522 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:52.219 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:50.562710+0000 mgr.smithi033.apxevf (mgr.14162) 247 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 2.4 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 5 op/s 2024-02-15T18:28:52.219 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:50.766312+0000 mon.smithi033 (mon.0) 521 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:52.219 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:50.767077+0000 mon.smithi033 (mon.0) 522 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:28:52.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.773+0000 7f8e9bfff700 1 -- 172.21.15.33:0/2618656735 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v12) v1 ==== 168+0+0 (secure 0 0 0) 0x7f8e9c04dd80 con 0x7f8ea40f5430 2024-02-15T18:28:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8e9005c300 msgr2=0x7f8e9005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8e9005c300 0x7f8e9005e7c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f8e8c004c40 tx=0x7f8e8c00b040).stop 2024-02-15T18:28:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 msgr2=0x7f8ea4106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 0x7f8ea4106e70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8e9c004e30 tx=0x7f8e9c009b30).stop 2024-02-15T18:28:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 shutdown_connections 2024-02-15T18:28:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8e9005c300 0x7f8e9005e7c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea40f5430 0x7f8ea4106e70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 --2- 172.21.15.33:0/2618656735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ea40f66d0 0x7f8ea4107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 >> 172.21.15.33:0/2618656735 conn(0x7f8ea40f0b90 msgr2=0x7f8ea405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 shutdown_connections 2024-02-15T18:28:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:52.775+0000 7f8ea8c63700 1 -- 172.21.15.33:0/2618656735 wait complete. 2024-02-15T18:28:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:inline data enabled 2024-02-15T18:28:53.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:51.768214+0000 mon.smithi033 (mon.0) 523 : cluster [DBG] mds.? [v2:172.21.15.33:6826/3858685802,v1:172.21.15.33:6827/3858685802] up:standby 2024-02-15T18:28:53.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:51.768277+0000 mon.smithi033 (mon.0) 524 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:28:53.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:51.920979+0000 mon.smithi033 (mon.0) 525 : audit [INF] from='client.? 172.21.15.33:0/2618656735' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-15T18:28:53.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:51.768214+0000 mon.smithi033 (mon.0) 523 : cluster [DBG] mds.? [v2:172.21.15.33:6826/3858685802,v1:172.21.15.33:6827/3858685802] up:standby 2024-02-15T18:28:53.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:51.768277+0000 mon.smithi033 (mon.0) 524 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:28:53.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:51.920979+0000 mon.smithi033 (mon.0) 525 : audit [INF] from='client.? 172.21.15.33:0/2618656735' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-15T18:28:54.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:52.563115+0000 mgr.smithi033.apxevf (mgr.14162) 248 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 5 op/s 2024-02-15T18:28:54.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:52.769942+0000 mon.smithi033 (mon.0) 526 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-02-15T18:28:54.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:52.775162+0000 mon.smithi033 (mon.0) 527 : audit [INF] from='client.? 172.21.15.33:0/2618656735' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-02-15T18:28:54.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:52.775251+0000 mon.smithi033 (mon.0) 528 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:28:54.025 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:52.879385+0000 mon.smithi033 (mon.0) 529 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:54.026 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:28:54.038 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:28:54.038 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T18:28:54.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:52.563115+0000 mgr.smithi033.apxevf (mgr.14162) 248 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 5 op/s 2024-02-15T18:28:54.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:52.769942+0000 mon.smithi033 (mon.0) 526 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-02-15T18:28:54.251 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:52.775162+0000 mon.smithi033 (mon.0) 527 : audit [INF] from='client.? 172.21.15.33:0/2618656735' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-02-15T18:28:54.251 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:52.775251+0000 mon.smithi033 (mon.0) 528 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:28:54.251 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:52.879385+0000 mon.smithi033 (mon.0) 529 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:28:55.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:54.664051+0000 mon.smithi033 (mon.0) 530 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:28:55.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:54.664235+0000 mon.smithi033 (mon.0) 531 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:28:55.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:54.778689+0000 mon.smithi033 (mon.0) 532 : cluster [DBG] mds.? [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] up:boot 2024-02-15T18:28:55.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:54.778730+0000 mon.smithi033 (mon.0) 533 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:28:55.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:54.778817+0000 mon.smithi033 (mon.0) 534 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:28:55.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:54.664051+0000 mon.smithi033 (mon.0) 530 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:28:55.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:54.664235+0000 mon.smithi033 (mon.0) 531 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:28:55.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:54.778689+0000 mon.smithi033 (mon.0) 532 : cluster [DBG] mds.? [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] up:boot 2024-02-15T18:28:55.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:54.778730+0000 mon.smithi033 (mon.0) 533 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:28:55.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:54.778817+0000 mon.smithi033 (mon.0) 534 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:28:56.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:54.563609+0000 mgr.smithi033.apxevf (mgr.14162) 249 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 4 op/s 2024-02-15T18:28:56.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:54.563609+0000 mgr.smithi033.apxevf (mgr.14162) 249 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 4 op/s 2024-02-15T18:28:56.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.562+0000 7f32cc501700 1 -- 172.21.15.33:0/2032109644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 msgr2=0x7f32c40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.562+0000 7f32cc501700 1 --2- 172.21.15.33:0/2032109644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 0x7f32c40f59e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f32b8004660 tx=0x7f32b8009b30).stop 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.562+0000 7f32cc501700 1 -- 172.21.15.33:0/2032109644 shutdown_connections 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.562+0000 7f32cc501700 1 --2- 172.21.15.33:0/2032109644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c40f6860 0x7f32c40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.562+0000 7f32cc501700 1 --2- 172.21.15.33:0/2032109644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 0x7f32c40f59e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.562+0000 7f32cc501700 1 -- 172.21.15.33:0/2032109644 >> 172.21.15.33:0/2032109644 conn(0x7f32c40f0d40 msgr2=0x7f32c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.562+0000 7f32cc501700 1 -- 172.21.15.33:0/2032109644 shutdown_connections 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.562+0000 7f32cc501700 1 -- 172.21.15.33:0/2032109644 wait complete. 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.563+0000 7f32cc501700 1 Processor -- start 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.563+0000 7f32cc501700 1 -- start start 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.563+0000 7f32cc501700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 0x7f32c4107080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.563+0000 7f32cc501700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c40f6860 0x7f32c4107570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.563+0000 7f32cc501700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4107b20 con 0x7f32c40f55c0 2024-02-15T18:28:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.563+0000 7f32cc501700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4107c60 con 0x7f32c40f6860 2024-02-15T18:28:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.563+0000 7f32ca29d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 0x7f32c4107080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.563+0000 7f32ca29d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 0x7f32c4107080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42730/0 (socket says 172.21.15.33:42730) 2024-02-15T18:28:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.563+0000 7f32ca29d700 1 -- 172.21.15.33:0/2774692902 learned_addr learned my addr 172.21.15.33:0/2774692902 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:28:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32c9a9c700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c40f6860 0x7f32c4107570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32ca29d700 1 -- 172.21.15.33:0/2774692902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c40f6860 msgr2=0x7f32c4107570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32ca29d700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c40f6860 0x7f32c4107570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32ca29d700 1 -- 172.21.15.33:0/2774692902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8005040 con 0x7f32c40f55c0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32ca29d700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 0x7f32c4107080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f32b8004e30 tx=0x7f32b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32b6ffd700 1 -- 172.21.15.33:0/2774692902 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b8018070 con 0x7f32c40f55c0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32b6ffd700 1 -- 172.21.15.33:0/2774692902 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32b8007ba0 con 0x7f32c40f55c0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c41085a0 con 0x7f32c40f55c0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32b6ffd700 1 -- 172.21.15.33:0/2774692902 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b801c620 con 0x7f32c40f55c0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.564+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c4108b00 con 0x7f32c40f55c0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.565+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c4045ad0 con 0x7f32c40f55c0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.566+0000 7f32b6ffd700 1 -- 172.21.15.33:0/2774692902 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f32b8007d10 con 0x7f32c40f55c0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.566+0000 7f32b6ffd700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f32b005c2b0 0x7f32b005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.566+0000 7f32b6ffd700 1 -- 172.21.15.33:0/2774692902 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f32b80780e0 con 0x7f32c40f55c0 2024-02-15T18:28:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.566+0000 7f32c9a9c700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f32b005c2b0 0x7f32b005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:28:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.566+0000 7f32c9a9c700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f32b005c2b0 0x7f32b005e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f32c00096c0 tx=0x7f32c0009be0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:28:56.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.570+0000 7f32b6ffd700 1 -- 172.21.15.33:0/2774692902 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f32b804ae90 con 0x7f32c40f55c0 2024-02-15T18:28:56.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.770+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f32c410d6a0 con 0x7f32c40f55c0 2024-02-15T18:28:56.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.771+0000 7f32b6ffd700 1 -- 172.21.15.33:0/2774692902 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1662 (secure 0 0 0) 0x7f32b804e4b0 con 0x7f32c40f55c0 2024-02-15T18:28:56.766 INFO:teuthology.orchestra.run.smithi033.stdout:e13 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 12 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:28:52.769887+0000 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:28:56.767 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:28:56.768 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707]] 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411]] 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14432} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6826/3858685802,v1:172.21.15.33:6827/3858685802]] 2024-02-15T18:28:56.769 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 2 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613]] 2024-02-15T18:28:56.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.772+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f32b005c2b0 msgr2=0x7f32b005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:56.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.772+0000 7f32cc501700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f32b005c2b0 0x7f32b005e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f32c00096c0 tx=0x7f32c0009be0).stop 2024-02-15T18:28:56.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.772+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 msgr2=0x7f32c4107080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:28:56.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.772+0000 7f32cc501700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 0x7f32c4107080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f32b8004e30 tx=0x7f32b8009b30).stop 2024-02-15T18:28:56.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.773+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 shutdown_connections 2024-02-15T18:28:56.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.773+0000 7f32cc501700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f32b005c2b0 0x7f32b005e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:56.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.773+0000 7f32cc501700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32c40f55c0 0x7f32c4107080 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:56.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.773+0000 7f32cc501700 1 --2- 172.21.15.33:0/2774692902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c40f6860 0x7f32c4107570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:28:56.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.773+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 >> 172.21.15.33:0/2774692902 conn(0x7f32c40f0d40 msgr2=0x7f32c405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:28:56.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.773+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 shutdown_connections 2024-02-15T18:28:56.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:28:56.773+0000 7f32cc501700 1 -- 172.21.15.33:0/2774692902 wait complete. 2024-02-15T18:28:56.771 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2024-02-15T18:28:57.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:56.772803+0000 mon.smithi033 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.33:0/2774692902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:28:57.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:56.772803+0000 mon.smithi033 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.33:0/2774692902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:28:57.894 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-15T18:28:58.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:56.564084+0000 mgr.smithi033.apxevf (mgr.14162) 250 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-02-15T18:28:58.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:56.564084+0000 mgr.smithi033.apxevf (mgr.14162) 250 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-02-15T18:28:59.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:58.231264+0000 mon.smithi033 (mon.0) 536 : cluster [DBG] mds.? [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] up:standby 2024-02-15T18:28:59.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:28:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:58.231328+0000 mon.smithi033 (mon.0) 537 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:28:59.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:58.231264+0000 mon.smithi033 (mon.0) 536 : cluster [DBG] mds.? [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] up:standby 2024-02-15T18:28:59.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:28:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:58.231328+0000 mon.smithi033 (mon.0) 537 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:29:00.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:28:58.564404+0000 mgr.smithi033.apxevf (mgr.14162) 251 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-02-15T18:29:00.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:59.608705+0000 mon.smithi033 (mon.0) 538 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:00.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:59.613576+0000 mon.smithi033 (mon.0) 539 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:00.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:28:59.617328+0000 mon.smithi033 (mon.0) 540 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:00.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:28:58.564404+0000 mgr.smithi033.apxevf (mgr.14162) 251 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-02-15T18:29:00.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:59.608705+0000 mon.smithi033 (mon.0) 538 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:00.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:59.613576+0000 mon.smithi033 (mon.0) 539 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:00.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:28:59.617328+0000 mon.smithi033 (mon.0) 540 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:00.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.545+0000 7feff240b700 1 -- 172.21.15.33:0/578828439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 msgr2=0x7fefec0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.545+0000 7feff240b700 1 --2- 172.21.15.33:0/578828439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 0x7fefec0f6b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fefe0004660 tx=0x7fefe0009b30).stop 2024-02-15T18:29:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.546+0000 7feff240b700 1 -- 172.21.15.33:0/578828439 shutdown_connections 2024-02-15T18:29:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.546+0000 7feff240b700 1 --2- 172.21.15.33:0/578828439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 0x7fefec0f6b30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.546+0000 7feff240b700 1 --2- 172.21.15.33:0/578828439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefec0f5430 0x7fefec0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.546+0000 7feff240b700 1 -- 172.21.15.33:0/578828439 >> 172.21.15.33:0/578828439 conn(0x7fefec0f0b90 msgr2=0x7fefec0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.546+0000 7feff240b700 1 -- 172.21.15.33:0/578828439 shutdown_connections 2024-02-15T18:29:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.546+0000 7feff240b700 1 -- 172.21.15.33:0/578828439 wait complete. 2024-02-15T18:29:00.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.546+0000 7feff240b700 1 Processor -- start 2024-02-15T18:29:00.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.546+0000 7feff240b700 1 -- start start 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff240b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefec0f5430 0x7fefec107860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff240b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 0x7fefec109d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff240b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec060420 con 0x7fefec0f66d0 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff240b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec060560 con 0x7fefec0f5430 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff0c08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 0x7fefec109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff0c08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 0x7fefec109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42756/0 (socket says 172.21.15.33:42756) 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff1409700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefec0f5430 0x7fefec107860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff0c08700 1 -- 172.21.15.33:0/3463056195 learned_addr learned my addr 172.21.15.33:0/3463056195 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff0c08700 1 -- 172.21.15.33:0/3463056195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefec0f5430 msgr2=0x7fefec107860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff0c08700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefec0f5430 0x7fefec107860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:00.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff0c08700 1 -- 172.21.15.33:0/3463056195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0005040 con 0x7fefec0f66d0 2024-02-15T18:29:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff0c08700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 0x7fefec109d60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fefe0000c00 tx=0x7fefe000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7fefddffb700 1 -- 172.21.15.33:0/3463056195 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe0019070 con 0x7fefec0f66d0 2024-02-15T18:29:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefec10a310 con 0x7fefec0f66d0 2024-02-15T18:29:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7fefddffb700 1 -- 172.21.15.33:0/3463056195 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefe0007e90 con 0x7fefec0f66d0 2024-02-15T18:29:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.547+0000 7fefddffb700 1 -- 172.21.15.33:0/3463056195 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe0014d50 con 0x7fefec0f66d0 2024-02-15T18:29:00.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.548+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefec10a870 con 0x7fefec0f66d0 2024-02-15T18:29:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.549+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefec059100 con 0x7fefec0f66d0 2024-02-15T18:29:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.549+0000 7fefddffb700 1 -- 172.21.15.33:0/3463056195 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fefe0025070 con 0x7fefec0f66d0 2024-02-15T18:29:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.549+0000 7fefddffb700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fefd805c300 0x7fefd805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.549+0000 7fefddffb700 1 -- 172.21.15.33:0/3463056195 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fefe0076e50 con 0x7fefec0f66d0 2024-02-15T18:29:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.549+0000 7feff1409700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fefd805c300 0x7fefd805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:00.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.550+0000 7feff1409700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fefd805c300 0x7fefd805e7c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fefec0600a0 tx=0x7fefe800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:00.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.554+0000 7fefddffb700 1 -- 172.21.15.33:0/3463056195 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fefe004d540 con 0x7fefec0f66d0 2024-02-15T18:29:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.764+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefec0ffb80 con 0x7fefec0f66d0 2024-02-15T18:29:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.764+0000 7fefddffb700 1 -- 172.21.15.33:0/3463056195 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3018 (secure 0 0 0) 0x7fefe004d130 con 0x7fefec0f66d0 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fefd805c300 msgr2=0x7fefd805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fefd805c300 0x7fefd805e7c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fefec0600a0 tx=0x7fefe800b040).stop 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 msgr2=0x7fefec109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 0x7fefec109d60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fefe0000c00 tx=0x7fefe000b040).stop 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 shutdown_connections 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fefd805c300 0x7fefd805e7c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefec0f5430 0x7fefec107860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 --2- 172.21.15.33:0/3463056195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefec0f66d0 0x7fefec109d60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 >> 172.21.15.33:0/3463056195 conn(0x7fefec0f0b90 msgr2=0x7fefec0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 shutdown_connections 2024-02-15T18:29:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:00.766+0000 7feff240b700 1 -- 172.21.15.33:0/3463056195 wait complete. 2024-02-15T18:29:00.762 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-02-15T18:29:00.770 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:29:01.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:00.765098+0000 mon.smithi033 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.33:0/3463056195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:29:01.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:00.765098+0000 mon.smithi033 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.33:0/3463056195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:29:01.996 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-15T18:29:02.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:00.564811+0000 mgr.smithi033.apxevf (mgr.14162) 252 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-02-15T18:29:02.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:01.602551+0000 mon.smithi033 (mon.0) 542 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:02.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:00.564811+0000 mgr.smithi033.apxevf (mgr.14162) 252 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-02-15T18:29:02.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:01.602551+0000 mon.smithi033 (mon.0) 542 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:04.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:02.565215+0000 mgr.smithi033.apxevf (mgr.14162) 253 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:29:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:02.565215+0000 mgr.smithi033.apxevf (mgr.14162) 253 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:29:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.293+0000 7fac4889f700 1 -- 172.21.15.33:0/471998080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 msgr2=0x7fac440fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:05.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.293+0000 7fac4889f700 1 --2- 172.21.15.33:0/471998080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 0x7fac440fbaf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fac38004660 tx=0x7fac38009b30).stop 2024-02-15T18:29:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.293+0000 7fac4889f700 1 -- 172.21.15.33:0/471998080 shutdown_connections 2024-02-15T18:29:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.293+0000 7fac4889f700 1 --2- 172.21.15.33:0/471998080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 0x7fac440fbaf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.293+0000 7fac4889f700 1 --2- 172.21.15.33:0/471998080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac44060270 0x7fac440f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.293+0000 7fac4889f700 1 -- 172.21.15.33:0/471998080 >> 172.21.15.33:0/471998080 conn(0x7fac440f0b90 msgr2=0x7fac440f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.293+0000 7fac4889f700 1 -- 172.21.15.33:0/471998080 shutdown_connections 2024-02-15T18:29:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.294+0000 7fac4889f700 1 -- 172.21.15.33:0/471998080 wait complete. 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.294+0000 7fac4889f700 1 Processor -- start 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.294+0000 7fac4889f700 1 -- start start 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4889f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac44060270 0x7fac44106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4889f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 0x7fac44107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4889f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac44107920 con 0x7fac440f96a0 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4889f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac44108130 con 0x7fac44060270 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 0x7fac44107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 0x7fac44107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42782/0 (socket says 172.21.15.33:42782) 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4259c700 1 -- 172.21.15.33:0/3774812077 learned_addr learned my addr 172.21.15.33:0/3774812077 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac42d9d700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac44060270 0x7fac44106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:05.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4259c700 1 -- 172.21.15.33:0/3774812077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac44060270 msgr2=0x7fac44106e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:05.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4259c700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac44060270 0x7fac44106e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:05.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.295+0000 7fac4259c700 1 -- 172.21.15.33:0/3774812077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38005040 con 0x7fac440f96a0 2024-02-15T18:29:05.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.296+0000 7fac4259c700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 0x7fac44107320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fac38004fe0 tx=0x7fac38009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:05.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.296+0000 7fac2b7fe700 1 -- 172.21.15.33:0/3774812077 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac38018070 con 0x7fac440f96a0 2024-02-15T18:29:05.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.296+0000 7fac2b7fe700 1 -- 172.21.15.33:0/3774812077 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac38007ba0 con 0x7fac440f96a0 2024-02-15T18:29:05.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.296+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac44108350 con 0x7fac440f96a0 2024-02-15T18:29:05.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.296+0000 7fac2b7fe700 1 -- 172.21.15.33:0/3774812077 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3801c3c0 con 0x7fac440f96a0 2024-02-15T18:29:05.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.296+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac441088b0 con 0x7fac440f96a0 2024-02-15T18:29:05.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.297+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac44059100 con 0x7fac440f96a0 2024-02-15T18:29:05.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.298+0000 7fac2b7fe700 1 -- 172.21.15.33:0/3774812077 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fac3801c640 con 0x7fac440f96a0 2024-02-15T18:29:05.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.298+0000 7fac2b7fe700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fac2c05c2f0 0x7fac2c05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:05.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.298+0000 7fac2b7fe700 1 -- 172.21.15.33:0/3774812077 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fac38077b20 con 0x7fac440f96a0 2024-02-15T18:29:05.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.298+0000 7fac42d9d700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fac2c05c2f0 0x7fac2c05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:05.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.299+0000 7fac42d9d700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fac2c05c2f0 0x7fac2c05e7b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fac44106ba0 tx=0x7fac3400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:05.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.303+0000 7fac2b7fe700 1 -- 172.21.15.33:0/3774812077 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fac3804a7e0 con 0x7fac440f96a0 2024-02-15T18:29:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.528+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fac44045ad0 con 0x7fac440f96a0 2024-02-15T18:29:05.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.528+0000 7fac2b7fe700 1 -- 172.21.15.33:0/3774812077 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+86 (secure 0 0 0) 0x7fac3804de00 con 0x7fac440f96a0 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fac2c05c2f0 msgr2=0x7fac2c05e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fac2c05c2f0 0x7fac2c05e7b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fac44106ba0 tx=0x7fac3400b040).stop 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 msgr2=0x7fac44107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 0x7fac44107320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fac38004fe0 tx=0x7fac38009b30).stop 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 shutdown_connections 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fac2c05c2f0 0x7fac2c05e7b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac44060270 0x7fac44106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 --2- 172.21.15.33:0/3774812077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440f96a0 0x7fac44107320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 >> 172.21.15.33:0/3774812077 conn(0x7fac440f0b90 msgr2=0x7fac440f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 shutdown_connections 2024-02-15T18:29:05.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:05.530+0000 7fac4889f700 1 -- 172.21.15.33:0/3774812077 wait complete. 2024-02-15T18:29:05.534 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:29:06.325 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-15T18:29:06.337 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T18:29:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:04.565639+0000 mgr.smithi033.apxevf (mgr.14162) 254 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-15T18:29:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:05.529164+0000 mon.smithi033 (mon.0) 543 : audit [DBG] from='client.? 172.21.15.33:0/3774812077' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-15T18:29:06.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:04.565639+0000 mgr.smithi033.apxevf (mgr.14162) 254 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-15T18:29:06.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:05.529164+0000 mon.smithi033 (mon.0) 543 : audit [DBG] from='client.? 172.21.15.33:0/3774812077' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-15T18:29:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.725+0000 7ff89cfde700 1 -- 172.21.15.33:0/1042943504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 msgr2=0x7ff8980fba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.725+0000 7ff89cfde700 1 --2- 172.21.15.33:0/1042943504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 0x7ff8980fba10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7ff880004660 tx=0x7ff880009b30).stop 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 -- 172.21.15.33:0/1042943504 shutdown_connections 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 --2- 172.21.15.33:0/1042943504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 0x7ff8980fba10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 --2- 172.21.15.33:0/1042943504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff89805fe80 0x7ff8980f9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 -- 172.21.15.33:0/1042943504 >> 172.21.15.33:0/1042943504 conn(0x7ff8980f0bd0 msgr2=0x7ff8980f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 -- 172.21.15.33:0/1042943504 shutdown_connections 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 -- 172.21.15.33:0/1042943504 wait complete. 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 Processor -- start 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 -- start start 2024-02-15T18:29:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff89805fe80 0x7ff898106cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 0x7ff8981071a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981077a0 con 0x7ff8980f9620 2024-02-15T18:29:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.726+0000 7ff89cfde700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981078e0 con 0x7ff89805fe80 2024-02-15T18:29:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 0x7ff8981071a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 0x7ff8981071a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60172/0 (socket says 172.21.15.33:60172) 2024-02-15T18:29:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff895d9b700 1 -- 172.21.15.33:0/1177396010 learned_addr learned my addr 172.21.15.33:0/1177396010 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff89659c700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff89805fe80 0x7ff898106cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff895d9b700 1 -- 172.21.15.33:0/1177396010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff89805fe80 msgr2=0x7ff898106cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff895d9b700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff89805fe80 0x7ff898106cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff895d9b700 1 -- 172.21.15.33:0/1177396010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880005040 con 0x7ff8980f9620 2024-02-15T18:29:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff895d9b700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 0x7ff8981071a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ff880009830 tx=0x7ff880009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff88effd700 1 -- 172.21.15.33:0/1177396010 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff880018070 con 0x7ff8980f9620 2024-02-15T18:29:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff88effd700 1 -- 172.21.15.33:0/1177396010 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff880007ba0 con 0x7ff8980f9620 2024-02-15T18:29:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89810c240 con 0x7ff8980f9620 2024-02-15T18:29:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff88effd700 1 -- 172.21.15.33:0/1177396010 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88001c440 con 0x7ff8980f9620 2024-02-15T18:29:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.727+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89810c7a0 con 0x7ff8980f9620 2024-02-15T18:29:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.728+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff898027a00 con 0x7ff8980f9620 2024-02-15T18:29:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.729+0000 7ff88effd700 1 -- 172.21.15.33:0/1177396010 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff88001d420 con 0x7ff8980f9620 2024-02-15T18:29:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.729+0000 7ff88effd700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff88405c370 0x7ff88405e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.729+0000 7ff88effd700 1 -- 172.21.15.33:0/1177396010 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff880077cb0 con 0x7ff8980f9620 2024-02-15T18:29:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.729+0000 7ff89659c700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff88405c370 0x7ff88405e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.729+0000 7ff89659c700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff88405c370 0x7ff88405e830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff898108150 tx=0x7ff888004d80).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.733+0000 7ff88effd700 1 -- 172.21.15.33:0/1177396010 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff88004a9f0 con 0x7ff8980f9620 2024-02-15T18:29:06.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.895+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8980fed90 con 0x7ff8980f9620 2024-02-15T18:29:06.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.896+0000 7ff88effd700 1 -- 172.21.15.33:0/1177396010 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+14071 (secure 0 0 0) 0x7ff88004e010 con 0x7ff8980f9620 2024-02-15T18:29:06.890 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:29:06.890 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":44,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:21:46.103137+0000","modified":"2024-02-15T18:28:38.652931+0000","last_up_change":"2024-02-15T18:27:07.699530+0000","last_in_change":"2024-02-15T18:26:50.170774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:26:18.348861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T18:28:35.597195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T18:28:36.072183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0ff15bf7-6db5-4333-82b6-b609dccf7266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6803","nonce":1923638632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6805","nonce":1923638632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6809","nonce":1923638632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1923638632},{"type":"v1","addr":"172.21.15.33:6807","nonce":1923638632}]},"public_addr":"172.21.15.33:6803/1923638632","cluster_addr":"172.21.15.33:6805/1923638632","heartbeat_back_addr":"172.21.15.33:6809/1923638632","heartbeat_front_addr":"172.21.15.33:6807/1923638632","state":["exists","up"]},{"osd":1,"uuid":"7b795f15-d524-44fd-8dca-d5b4653dafbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6811","nonce":318646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6813","nonce":318646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6817","nonce":318646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":318646837},{"type":"v1","addr":"172.21.15.33:6815","nonce":318646837}]},"public_addr":"172.21.15.33:6811/318646837","cluster_addr":"172.21.15.33:6813/318646837","heartbeat_back_addr":"172.21.15.33:6817/318646837","heartbeat_front_addr":"172.21.15.33:6815/318646837","state":["exists","up"]},{"osd":2,"uuid":"47a30c41-97a6-451b-9941-8e225aff3535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6819","nonce":3415315149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6821","nonce":3415315149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6825","nonce":3415315149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3415315149},{"type":"v1","addr":"172.21.15.33:6823","nonce":3415315149}]},"public_addr":"172.21.15.33:6819/3415315149","cluster_addr":"172.21.15.33:6821/3415315149","heartbeat_back_addr":"172.21.15.33:6825/3415315149","heartbeat_front_addr":"172.21.15.33:6823/3415315149","state":["exists","up"]},{"osd":3,"uuid":"d342c704-b853-421a-8f27-803f201e73c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6801","nonce":4035744604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6803","nonce":4035744604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6807","nonce":4035744604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4035744604},{"type":"v1","addr":"172.21.15.131:6805","nonce":4035744604}]},"public_addr":"172.21.15.131:6801/4035744604","cluster_addr":"172.21.15.131:6803/4035744604","heartbeat_back_addr":"172.21.15.131:6807/4035744604","heartbeat_front_addr":"172.21.15.131:6805/4035744604","state":["exists","up"]},{"osd":4,"uuid":"6a318488-8764-4284-b2c7-811c9bf5f312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6809","nonce":17489211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6811","nonce":17489211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6815","nonce":17489211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":17489211},{"type":"v1","addr":"172.21.15.131:6813","nonce":17489211}]},"public_addr":"172.21.15.131:6809/17489211","cluster_addr":"172.21.15.131:6811/17489211","heartbeat_back_addr":"172.21.15.131:6815/17489211","heartbeat_front_addr":"172.21.15.131:6813/17489211","state":["exists","up"]},{"osd":5,"uuid":"26789e21-a7cc-431d-b59e-5c06f9e676b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6817","nonce":3544205792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6819","nonce":3544205792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6823","nonce":3544205792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3544205792},{"type":"v1","addr":"172.21.15.131:6821","nonce":3544205792}]},"public_addr":"172.21.15.131:6817/3544205792","cluster_addr":"172.21.15.131:6819/3544205792","heartbeat_back_addr":"172.21.15.131:6823/3544205792","heartbeat_front_addr":"172.21.15.131:6821/3544205792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:06.812056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:38.581855+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:03.660797+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:22.777140+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:44.193385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:27:06.090258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2117788911":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6800/1651162060":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6801/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/9598196":"2024-02-16T18:22:37.704559+0000","172.21.15.33:6800/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/1847321696":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/1388323627":"2024-02-16T18:22:16.059979+0000","172.21.15.33:0/2037477695":"2024-02-16T18:22:54.446695+0000","172.21.15.33:0/805181307":"2024-02-16T18:22:16.059979+0000","172.21.15.33:6801/1651162060":"2024-02-16T18:22:54.446695+0000","172.21.15.33:6800/2905208543":"2024-02-16T18:22:16.059979+0000","172.21.15.33:6801/2905208543":"2024-02-16T18:22:16.059979+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:29:06.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.897+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff88405c370 msgr2=0x7ff88405e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:06.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.897+0000 7ff89cfde700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff88405c370 0x7ff88405e830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff898108150 tx=0x7ff888004d80).stop 2024-02-15T18:29:06.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.897+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 msgr2=0x7ff8981071a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:06.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.897+0000 7ff89cfde700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 0x7ff8981071a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ff880009830 tx=0x7ff880009b30).stop 2024-02-15T18:29:06.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.897+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 shutdown_connections 2024-02-15T18:29:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.897+0000 7ff89cfde700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff88405c370 0x7ff88405e830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.897+0000 7ff89cfde700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff89805fe80 0x7ff898106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.898+0000 7ff89cfde700 1 --2- 172.21.15.33:0/1177396010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8980f9620 0x7ff8981071a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.898+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 >> 172.21.15.33:0/1177396010 conn(0x7ff8980f0bd0 msgr2=0x7ff8980f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.898+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 shutdown_connections 2024-02-15T18:29:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:06.898+0000 7ff89cfde700 1 -- 172.21.15.33:0/1177396010 wait complete. 2024-02-15T18:29:06.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-15T18:26:18.348861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T18:28:35.597195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T18:28:36.072183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-15T18:29:06.907 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-15T18:29:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.040+0000 7fde58f4b700 1 -- 172.21.15.33:0/62501134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f7750 msgr2=0x7fde540f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.040+0000 7fde58f4b700 1 --2- 172.21.15.33:0/62501134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f7750 0x7fde540f7bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fde3c004660 tx=0x7fde3c009b30).stop 2024-02-15T18:29:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.040+0000 7fde58f4b700 1 -- 172.21.15.33:0/62501134 shutdown_connections 2024-02-15T18:29:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.040+0000 7fde58f4b700 1 --2- 172.21.15.33:0/62501134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f7750 0x7fde540f7bb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.040+0000 7fde58f4b700 1 --2- 172.21.15.33:0/62501134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde540f64b0 0x7fde540f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.040+0000 7fde58f4b700 1 -- 172.21.15.33:0/62501134 >> 172.21.15.33:0/62501134 conn(0x7fde540f1bf0 msgr2=0x7fde540f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.040+0000 7fde58f4b700 1 -- 172.21.15.33:0/62501134 shutdown_connections 2024-02-15T18:29:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.040+0000 7fde58f4b700 1 -- 172.21.15.33:0/62501134 wait complete. 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde58f4b700 1 Processor -- start 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde58f4b700 1 -- start start 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde58f4b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f64b0 0x7fde5406b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde58f4b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde540f7750 0x7fde54069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde58f4b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5406bd20 con 0x7fde540f64b0 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde58f4b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5406a310 con 0x7fde540f7750 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde5259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f64b0 0x7fde5406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde5259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f64b0 0x7fde5406b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60184/0 (socket says 172.21.15.33:60184) 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde5259c700 1 -- 172.21.15.33:0/925078677 learned_addr learned my addr 172.21.15.33:0/925078677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde51d9b700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde540f7750 0x7fde54069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde5259c700 1 -- 172.21.15.33:0/925078677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde540f7750 msgr2=0x7fde54069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde5259c700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde540f7750 0x7fde54069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde5259c700 1 -- 172.21.15.33:0/925078677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c005040 con 0x7fde540f64b0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde51d9b700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde540f7750 0x7fde54069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde5259c700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f64b0 0x7fde5406b770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fde4400d7f0 tx=0x7fde44004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde4affd700 1 -- 172.21.15.33:0/925078677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde4400b4f0 con 0x7fde540f64b0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde4affd700 1 -- 172.21.15.33:0/925078677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde4400f040 con 0x7fde540f64b0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5406a5f0 con 0x7fde540f64b0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde4affd700 1 -- 172.21.15.33:0/925078677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde44013a30 con 0x7fde540f64b0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.041+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5406abb0 con 0x7fde540f64b0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.042+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde54027a00 con 0x7fde540f64b0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.043+0000 7fde4affd700 1 -- 172.21.15.33:0/925078677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fde4401a030 con 0x7fde540f64b0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.043+0000 7fde4affd700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fde4005c370 0x7fde4005e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.043+0000 7fde4affd700 1 -- 172.21.15.33:0/925078677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fde44075d90 con 0x7fde540f64b0 2024-02-15T18:29:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.043+0000 7fde51d9b700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fde4005c370 0x7fde4005e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.044+0000 7fde51d9b700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fde4005c370 0x7fde4005e830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fde3c005010 tx=0x7fde3c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.047+0000 7fde4affd700 1 -- 172.21.15.33:0/925078677 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fde44048a50 con 0x7fde540f64b0 2024-02-15T18:29:07.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.211+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fde540fed10 con 0x7fde540f64b0 2024-02-15T18:29:07.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.211+0000 7fde4affd700 1 -- 172.21.15.33:0/925078677 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v44) v1 ==== 110+0+10 (secure 0 0 0) 0x7fde44018020 con 0x7fde540f64b0 2024-02-15T18:29:07.206 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-02-15T18:29:07.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fde4005c370 msgr2=0x7fde4005e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fde4005c370 0x7fde4005e830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fde3c005010 tx=0x7fde3c009b30).stop 2024-02-15T18:29:07.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f64b0 msgr2=0x7fde5406b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f64b0 0x7fde5406b770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fde4400d7f0 tx=0x7fde44004e80).stop 2024-02-15T18:29:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 shutdown_connections 2024-02-15T18:29:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fde4005c370 0x7fde4005e830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde540f64b0 0x7fde5406b770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 --2- 172.21.15.33:0/925078677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde540f7750 0x7fde54069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 >> 172.21.15.33:0/925078677 conn(0x7fde540f1bf0 msgr2=0x7fde540fb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 shutdown_connections 2024-02-15T18:29:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.213+0000 7fde58f4b700 1 -- 172.21.15.33:0/925078677 wait complete. 2024-02-15T18:29:07.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T18:29:07.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.359+0000 7fb6325d6700 1 -- 172.21.15.33:0/3761030975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 msgr2=0x7fb62c0f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.359+0000 7fb6325d6700 1 --2- 172.21.15.33:0/3761030975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 0x7fb62c0f7bd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fb620004660 tx=0x7fb620009b30).stop 2024-02-15T18:29:07.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 -- 172.21.15.33:0/3761030975 shutdown_connections 2024-02-15T18:29:07.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 --2- 172.21.15.33:0/3761030975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 0x7fb62c0f7bd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 --2- 172.21.15.33:0/3761030975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0f64d0 0x7fb62c0f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 -- 172.21.15.33:0/3761030975 >> 172.21.15.33:0/3761030975 conn(0x7fb62c0f1c30 msgr2=0x7fb62c0f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 -- 172.21.15.33:0/3761030975 shutdown_connections 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 -- 172.21.15.33:0/3761030975 wait complete. 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 Processor -- start 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 -- start start 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0f64d0 0x7fb62c106c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 0x7fb62c107120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c107720 con 0x7fb62c0f7770 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.360+0000 7fb6325d6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c107860 con 0x7fb62c0f64d0 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb62b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 0x7fb62c107120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb62b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 0x7fb62c107120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60194/0 (socket says 172.21.15.33:60194) 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb62b7fe700 1 -- 172.21.15.33:0/3447854539 learned_addr learned my addr 172.21.15.33:0/3447854539 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb62bfff700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0f64d0 0x7fb62c106c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb62b7fe700 1 -- 172.21.15.33:0/3447854539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0f64d0 msgr2=0x7fb62c106c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb62b7fe700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0f64d0 0x7fb62c106c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb62b7fe700 1 -- 172.21.15.33:0/3447854539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb620005040 con 0x7fb62c0f7770 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb62b7fe700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 0x7fb62c107120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fb620009830 tx=0x7fb620009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb628ff9700 1 -- 172.21.15.33:0/3447854539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb620018070 con 0x7fb62c0f7770 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb628ff9700 1 -- 172.21.15.33:0/3447854539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb620007d70 con 0x7fb62c0f7770 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb628ff9700 1 -- 172.21.15.33:0/3447854539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb62001c620 con 0x7fb62c0f7770 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c10c210 con 0x7fb62c0f7770 2024-02-15T18:29:07.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.361+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c10c770 con 0x7fb62c0f7770 2024-02-15T18:29:07.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.362+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c027a00 con 0x7fb62c0f7770 2024-02-15T18:29:07.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.362+0000 7fb628ff9700 1 -- 172.21.15.33:0/3447854539 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb62001d980 con 0x7fb62c0f7770 2024-02-15T18:29:07.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.363+0000 7fb628ff9700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb61405c370 0x7fb61405e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.363+0000 7fb628ff9700 1 -- 172.21.15.33:0/3447854539 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb620077ce0 con 0x7fb62c0f7770 2024-02-15T18:29:07.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.363+0000 7fb62bfff700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb61405c370 0x7fb61405e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.363+0000 7fb62bfff700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb61405c370 0x7fb61405e830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb62c108120 tx=0x7fb61c009040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:07.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.367+0000 7fb628ff9700 1 -- 172.21.15.33:0/3447854539 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb62004a9c0 con 0x7fb62c0f7770 2024-02-15T18:29:07.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.525+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fb62c0fed30 con 0x7fb62c0f7770 2024-02-15T18:29:07.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.526+0000 7fb628ff9700 1 -- 172.21.15.33:0/3447854539 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb62004dfe0 con 0x7fb62c0f7770 2024-02-15T18:29:07.520 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T18:29:07.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb61405c370 msgr2=0x7fb61405e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb61405c370 0x7fb61405e830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb62c108120 tx=0x7fb61c009040).stop 2024-02-15T18:29:07.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 msgr2=0x7fb62c107120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 0x7fb62c107120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fb620009830 tx=0x7fb620009b30).stop 2024-02-15T18:29:07.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 shutdown_connections 2024-02-15T18:29:07.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb61405c370 0x7fb61405e830 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb62c0f64d0 0x7fb62c106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 --2- 172.21.15.33:0/3447854539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb62c0f7770 0x7fb62c107120 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 >> 172.21.15.33:0/3447854539 conn(0x7fb62c0f1c30 msgr2=0x7fb62c0fb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:07.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 shutdown_connections 2024-02-15T18:29:07.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.528+0000 7fb6325d6700 1 -- 172.21.15.33:0/3447854539 wait complete. 2024-02-15T18:29:07.533 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:06.896211+0000 mon.smithi033 (mon.0) 544 : audit [DBG] from='client.? 172.21.15.33:0/1177396010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:29:07.533 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:07.212017+0000 mon.smithi033 (mon.0) 545 : audit [DBG] from='client.? 172.21.15.33:0/925078677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:29:07.534 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T18:29:07.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.663+0000 7fb75c97f700 1 -- 172.21.15.33:0/3688799437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5390 msgr2=0x7fb7580f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.663+0000 7fb75c97f700 1 --2- 172.21.15.33:0/3688799437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5390 0x7fb7580f57b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fb748004660 tx=0x7fb748009b30).stop 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.663+0000 7fb75c97f700 1 -- 172.21.15.33:0/3688799437 shutdown_connections 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.663+0000 7fb75c97f700 1 --2- 172.21.15.33:0/3688799437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7580f5ca0 0x7fb7580f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.663+0000 7fb75c97f700 1 --2- 172.21.15.33:0/3688799437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5390 0x7fb7580f57b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.663+0000 7fb75c97f700 1 -- 172.21.15.33:0/3688799437 >> 172.21.15.33:0/3688799437 conn(0x7fb7580f0b70 msgr2=0x7fb7580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.663+0000 7fb75c97f700 1 -- 172.21.15.33:0/3688799437 shutdown_connections 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.663+0000 7fb75c97f700 1 -- 172.21.15.33:0/3688799437 wait complete. 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb75c97f700 1 Processor -- start 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb75c97f700 1 -- start start 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb75c97f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7580f5390 0x7fb758106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb75c97f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5ca0 0x7fb758107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb75c97f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7581077d0 con 0x7fb7580f5ca0 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb75c97f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758107910 con 0x7fb7580f5390 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb755d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5ca0 0x7fb758107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb755d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5ca0 0x7fb758107220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60212/0 (socket says 172.21.15.33:60212) 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb755d9b700 1 -- 172.21.15.33:0/2329635115 learned_addr learned my addr 172.21.15.33:0/2329635115 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb75659c700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7580f5390 0x7fb758106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb755d9b700 1 -- 172.21.15.33:0/2329635115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7580f5390 msgr2=0x7fb758106d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb755d9b700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7580f5390 0x7fb758106d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb755d9b700 1 -- 172.21.15.33:0/2329635115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748005040 con 0x7fb7580f5ca0 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb75659c700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7580f5390 0x7fb758106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb755d9b700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5ca0 0x7fb758107220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb74c0026d0 tx=0x7fb74c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb746ffd700 1 -- 172.21.15.33:0/2329635115 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb74c009320 con 0x7fb7580f5ca0 2024-02-15T18:29:07.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75810c3b0 con 0x7fb7580f5ca0 2024-02-15T18:29:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb746ffd700 1 -- 172.21.15.33:0/2329635115 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb74c00f040 con 0x7fb7580f5ca0 2024-02-15T18:29:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.664+0000 7fb746ffd700 1 -- 172.21.15.33:0/2329635115 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb74c014910 con 0x7fb7580f5ca0 2024-02-15T18:29:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.665+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75810c970 con 0x7fb7580f5ca0 2024-02-15T18:29:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.665+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb758046330 con 0x7fb7580f5ca0 2024-02-15T18:29:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.666+0000 7fb746ffd700 1 -- 172.21.15.33:0/2329635115 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb74c0077b0 con 0x7fb7580f5ca0 2024-02-15T18:29:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.666+0000 7fb746ffd700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb74005c2b0 0x7fb74005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.666+0000 7fb746ffd700 1 -- 172.21.15.33:0/2329635115 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb74c0764d0 con 0x7fb7580f5ca0 2024-02-15T18:29:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.666+0000 7fb75659c700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb74005c2b0 0x7fb74005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.667+0000 7fb75659c700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb74005c2b0 0x7fb74005e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb748005010 tx=0x7fb748009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:07.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.670+0000 7fb746ffd700 1 -- 172.21.15.33:0/2329635115 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb74c049190 con 0x7fb7580f5ca0 2024-02-15T18:29:07.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:06.896211+0000 mon.smithi033 (mon.0) 544 : audit [DBG] from='client.? 172.21.15.33:0/1177396010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:29:07.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:07.212017+0000 mon.smithi033 (mon.0) 545 : audit [DBG] from='client.? 172.21.15.33:0/925078677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:29:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.855+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fb7580fdc90 con 0x7fb7580f5ca0 2024-02-15T18:29:07.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.856+0000 7fb746ffd700 1 -- 172.21.15.33:0/2329635115 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v44) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb74c04c7b0 con 0x7fb7580f5ca0 2024-02-15T18:29:07.851 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T18:29:07.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb74005c2b0 msgr2=0x7fb74005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb74005c2b0 0x7fb74005e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb748005010 tx=0x7fb748009b30).stop 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5ca0 msgr2=0x7fb758107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5ca0 0x7fb758107220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb74c0026d0 tx=0x7fb74c009de0).stop 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 shutdown_connections 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb74005c2b0 0x7fb74005e770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7580f5390 0x7fb758106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 --2- 172.21.15.33:0/2329635115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5ca0 0x7fb758107220 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 >> 172.21.15.33:0/2329635115 conn(0x7fb7580f0b70 msgr2=0x7fb75805f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 shutdown_connections 2024-02-15T18:29:07.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:07.858+0000 7fb75c97f700 1 -- 172.21.15.33:0/2329635115 wait complete. 2024-02-15T18:29:07.865 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-15T18:29:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.001+0000 7fdbf49d2700 1 -- 172.21.15.33:0/2572953546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 msgr2=0x7fdbf00f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.001+0000 7fdbf49d2700 1 --2- 172.21.15.33:0/2572953546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 0x7fdbf00f6910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fdbe0004660 tx=0x7fdbe0009b30).stop 2024-02-15T18:29:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.002+0000 7fdbf49d2700 1 -- 172.21.15.33:0/2572953546 shutdown_connections 2024-02-15T18:29:07.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.002+0000 7fdbf49d2700 1 --2- 172.21.15.33:0/2572953546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf00f7790 0x7fdbf00f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.002+0000 7fdbf49d2700 1 --2- 172.21.15.33:0/2572953546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 0x7fdbf00f6910 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.002+0000 7fdbf49d2700 1 -- 172.21.15.33:0/2572953546 >> 172.21.15.33:0/2572953546 conn(0x7fdbf00f1c30 msgr2=0x7fdbf00f4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.002+0000 7fdbf49d2700 1 -- 172.21.15.33:0/2572953546 shutdown_connections 2024-02-15T18:29:07.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.002+0000 7fdbf49d2700 1 -- 172.21.15.33:0/2572953546 wait complete. 2024-02-15T18:29:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.002+0000 7fdbf49d2700 1 Processor -- start 2024-02-15T18:29:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.002+0000 7fdbf49d2700 1 -- start start 2024-02-15T18:29:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbf49d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 0x7fdbf0106c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbf49d2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf00f7790 0x7fdbf0107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbf49d2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0107760 con 0x7fdbf00f64f0 2024-02-15T18:29:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbf49d2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf01078d0 con 0x7fdbf00f7790 2024-02-15T18:29:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbee59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 0x7fdbf0106c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbee59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 0x7fdbf0106c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60224/0 (socket says 172.21.15.33:60224) 2024-02-15T18:29:07.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbee59c700 1 -- 172.21.15.33:0/3354648690 learned_addr learned my addr 172.21.15.33:0/3354648690 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbedd9b700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf00f7790 0x7fdbf0107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbee59c700 1 -- 172.21.15.33:0/3354648690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf00f7790 msgr2=0x7fdbf0107160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbee59c700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf00f7790 0x7fdbf0107160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbee59c700 1 -- 172.21.15.33:0/3354648690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0005040 con 0x7fdbf00f64f0 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbedd9b700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf00f7790 0x7fdbf0107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbee59c700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 0x7fdbf0106c70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fdbe0002040 tx=0x7fdbe000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbdeffd700 1 -- 172.21.15.33:0/3354648690 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe0019070 con 0x7fdbf00f64f0 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbdeffd700 1 -- 172.21.15.33:0/3354648690 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbe0007e90 con 0x7fdbf00f64f0 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf010c2e0 con 0x7fdbf00f64f0 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbdeffd700 1 -- 172.21.15.33:0/3354648690 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe0014d90 con 0x7fdbf00f64f0 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.003+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf010c810 con 0x7fdbf00f64f0 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.005+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf0046330 con 0x7fdbf00f64f0 2024-02-15T18:29:08.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.005+0000 7fdbdeffd700 1 -- 172.21.15.33:0/3354648690 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdbe0025070 con 0x7fdbf00f64f0 2024-02-15T18:29:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.005+0000 7fdbdeffd700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fdbd805c370 0x7fdbd805e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.005+0000 7fdbdeffd700 1 -- 172.21.15.33:0/3354648690 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fdbe0076e50 con 0x7fdbf00f64f0 2024-02-15T18:29:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.005+0000 7fdbedd9b700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fdbd805c370 0x7fdbd805e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:08.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.006+0000 7fdbedd9b700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fdbd805c370 0x7fdbd805e830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fdbf0108190 tx=0x7fdbe400b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:08.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.009+0000 7fdbdeffd700 1 -- 172.21.15.33:0/3354648690 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdbe0049b10 con 0x7fdbf00f64f0 2024-02-15T18:29:08.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.211+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbf00feee0 con 0x7fdbf00f64f0 2024-02-15T18:29:08.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.211+0000 7fdbdeffd700 1 -- 172.21.15.33:0/3354648690 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3018 (secure 0 0 0) 0x7fdbe004d130 con 0x7fdbf00f64f0 2024-02-15T18:29:08.206 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:29:08.206 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14432,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6827/3858685802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3858685802},{"type":"v1","addr":"172.21.15.33:6827","nonce":3858685802}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":11},{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:28:52.769887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:29:08.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fdbd805c370 msgr2=0x7fdbd805e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:08.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fdbd805c370 0x7fdbd805e830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fdbf0108190 tx=0x7fdbe400b040).stop 2024-02-15T18:29:08.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 msgr2=0x7fdbf0106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:08.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 0x7fdbf0106c70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fdbe0002040 tx=0x7fdbe000b040).stop 2024-02-15T18:29:08.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 shutdown_connections 2024-02-15T18:29:08.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fdbd805c370 0x7fdbd805e830 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf00f64f0 0x7fdbf0106c70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 --2- 172.21.15.33:0/3354648690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf00f7790 0x7fdbf0107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 >> 172.21.15.33:0/3354648690 conn(0x7fdbf00f1c30 msgr2=0x7fdbf00fb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:08.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 shutdown_connections 2024-02-15T18:29:08.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.213+0000 7fdbf49d2700 1 -- 172.21.15.33:0/3354648690 wait complete. 2024-02-15T18:29:08.209 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-02-15T18:29:08.220 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 2, 'flags': 18} 2024-02-15T18:29:08.220 INFO:teuthology.run_tasks:Running task kclient... 2024-02-15T18:29:08.247 INFO:tasks.kclient:Mounting kernel clients... 2024-02-15T18:29:08.248 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-02-15T18:29:08.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:08.248 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-02-15T18:29:08.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:08.268 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-02-15T18:29:08.338 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-02-15T18:29:08.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:29:08.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:08.340 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-02-15T18:29:08.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:08.364 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-02-15T18:29:08.443 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2024-02-15T18:29:08.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:29:08.445 INFO:tasks.kclient:client.0 config is {} 2024-02-15T18:29:08.445 DEBUG:teuthology.orchestra.run.smithi033:> ceph fs ls 2024-02-15T18:29:08.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:06.566063+0000 mgr.smithi033.apxevf (mgr.14162) 255 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-15T18:29:08.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:07.526731+0000 mon.smithi033 (mon.0) 546 : audit [DBG] from='client.? 172.21.15.33:0/3447854539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T18:29:08.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:07.856444+0000 mon.smithi033 (mon.0) 547 : audit [DBG] from='client.? 172.21.15.33:0/2329635115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T18:29:08.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:08.026027+0000 mon.smithi033 (mon.0) 548 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:08.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:08.031732+0000 mon.smithi033 (mon.0) 549 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:08.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:08.212298+0000 mon.smithi033 (mon.0) 550 : audit [DBG] from='client.? 172.21.15.33:0/3354648690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:29:08.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:06.566063+0000 mgr.smithi033.apxevf (mgr.14162) 255 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-15T18:29:08.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:07.526731+0000 mon.smithi033 (mon.0) 546 : audit [DBG] from='client.? 172.21.15.33:0/3447854539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T18:29:08.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:07.856444+0000 mon.smithi033 (mon.0) 547 : audit [DBG] from='client.? 172.21.15.33:0/2329635115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T18:29:08.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:08.026027+0000 mon.smithi033 (mon.0) 548 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:08.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:08.031732+0000 mon.smithi033 (mon.0) 549 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:08.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:08.212298+0000 mon.smithi033 (mon.0) 550 : audit [DBG] from='client.? 172.21.15.33:0/3354648690' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:29:08.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.559+0000 7f0241a9e700 1 -- 172.21.15.33:0/3405066706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f53d0 msgr2=0x7f023c0f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.559+0000 7f0241a9e700 1 --2- 172.21.15.33:0/3405066706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f53d0 0x7f023c0f57f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f022c004660 tx=0x7f022c009b30).stop 2024-02-15T18:29:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.559+0000 7f0241a9e700 1 -- 172.21.15.33:0/3405066706 shutdown_connections 2024-02-15T18:29:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.559+0000 7f0241a9e700 1 --2- 172.21.15.33:0/3405066706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f023c0f5ce0 0x7f023c0f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.559+0000 7f0241a9e700 1 --2- 172.21.15.33:0/3405066706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f53d0 0x7f023c0f57f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.559+0000 7f0241a9e700 1 -- 172.21.15.33:0/3405066706 >> 172.21.15.33:0/3405066706 conn(0x7f023c0f0bd0 msgr2=0x7f023c0f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.559+0000 7f0241a9e700 1 -- 172.21.15.33:0/3405066706 shutdown_connections 2024-02-15T18:29:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.559+0000 7f0241a9e700 1 -- 172.21.15.33:0/3405066706 wait complete. 2024-02-15T18:29:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.560+0000 7f0241a9e700 1 Processor -- start 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.560+0000 7f0241a9e700 1 -- start start 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.560+0000 7f0241a9e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f023c0f53d0 0x7f023c105c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.560+0000 7f0241a9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f5ce0 0x7f023c106160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.560+0000 7f0241a9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c106760 con 0x7f023c0f5ce0 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.560+0000 7f0241a9e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c1068d0 con 0x7f023c0f53d0 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f023affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f5ce0 0x7f023c106160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f023affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f5ce0 0x7f023c106160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60262/0 (socket says 172.21.15.33:60262) 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f023affd700 1 -- 172.21.15.33:0/367331241 learned_addr learned my addr 172.21.15.33:0/367331241 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f023b7fe700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f023c0f53d0 0x7f023c105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f023affd700 1 -- 172.21.15.33:0/367331241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f023c0f53d0 msgr2=0x7f023c105c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f023affd700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f023c0f53d0 0x7f023c105c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f023affd700 1 -- 172.21.15.33:0/367331241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c005040 con 0x7f023c0f5ce0 2024-02-15T18:29:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f023affd700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f5ce0 0x7f023c106160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f02240026d0 tx=0x7f0224009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f0233fff700 1 -- 172.21.15.33:0/367331241 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02240079c0 con 0x7f023c0f5ce0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f0233fff700 1 -- 172.21.15.33:0/367331241 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f022400f040 con 0x7f023c0f5ce0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c10b340 con 0x7f023c0f5ce0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f0233fff700 1 -- 172.21.15.33:0/367331241 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0224014980 con 0x7f023c0f5ce0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.561+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c10b8d0 con 0x7f023c0f5ce0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.562+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023c046330 con 0x7f023c0f5ce0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.562+0000 7f0233fff700 1 -- 172.21.15.33:0/367331241 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f02240090d0 con 0x7f023c0f5ce0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.563+0000 7f0233fff700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f022805c2b0 0x7f022805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.563+0000 7f0233fff700 1 -- 172.21.15.33:0/367331241 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0224075ef0 con 0x7f023c0f5ce0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.563+0000 7f023b7fe700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f022805c2b0 0x7f022805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:08.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.563+0000 7f023b7fe700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f022805c2b0 0x7f022805e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f022c004630 tx=0x7f022c009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.567+0000 7f0233fff700 1 -- 172.21.15.33:0/367331241 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0224048bb0 con 0x7f023c0f5ce0 2024-02-15T18:29:08.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.767+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f023c027a00 con 0x7f023c0f5ce0 2024-02-15T18:29:08.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.768+0000 7f0233fff700 1 -- 172.21.15.33:0/367331241 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f022404c1d0 con 0x7f023c0f5ce0 2024-02-15T18:29:08.762 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f022805c2b0 msgr2=0x7f022805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f022805c2b0 0x7f022805e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f022c004630 tx=0x7f022c009b30).stop 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f5ce0 msgr2=0x7f023c106160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f5ce0 0x7f023c106160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f02240026d0 tx=0x7f0224009de0).stop 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 shutdown_connections 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f022805c2b0 0x7f022805e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f023c0f53d0 0x7f023c105c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 --2- 172.21.15.33:0/367331241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f023c0f5ce0 0x7f023c106160 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 >> 172.21.15.33:0/367331241 conn(0x7f023c0f0bd0 msgr2=0x7f023c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 shutdown_connections 2024-02-15T18:29:08.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:08.769+0000 7f0241a9e700 1 -- 172.21.15.33:0/367331241 wait complete. 2024-02-15T18:29:08.774 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-15T18:29:08.774 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-15T18:29:08.774 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-02-15T18:29:08.775 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-15T18:29:08.775 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-15T18:29:08.775 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-15T18:29:08.775 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-15T18:29:08.775 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-15T18:29:08.775 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-15T18:29:08.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:08.775 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-02-15T18:29:08.794 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-15T18:29:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-15T18:29:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-02-15T18:29:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:29:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-02-15T18:29:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:29:08.794 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:29:08.794 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42061sec preferred_lft 42061sec 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:29:08.795 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-02-15T18:29:08.796 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-15T18:29:08.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:08.796 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T18:29:08.796 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T18:29:08.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-02-15T18:29:08.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-02-15T18:29:08.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-02-15T18:29:08.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-15T18:29:08.796 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T18:29:08.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:08.960 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-15T18:29:08.991 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-02-15T18:29:08.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:08.992 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-02-15T18:29:09.074 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-02-15T18:29:09.074 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-15T18:29:09.074 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-15T18:29:09.074 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-15T18:29:09.075 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-15T18:29:09.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:09.075 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T18:29:09.075 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T18:29:09.075 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-15T18:29:09.075 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-15T18:29:09.075 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-15T18:29:09.076 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T18:29:09.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:09.362 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-02-15T18:29:09.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:09.381 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-02-15T18:29:09.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:09.440 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T18:29:09.440 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T18:29:09.440 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-15T18:29:09.440 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-15T18:29:09.440 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T18:29:09.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:08.390536+0000 mon.smithi033 (mon.0) 551 : cluster [INF] MDS daemon mds.cephfs.smithi033.qszefh is removed because it is dead or otherwise unavailable. 2024-02-15T18:29:09.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:08.394517+0000 mon.smithi033 (mon.0) 552 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:29:09.520 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:08.768588+0000 mon.smithi033 (mon.0) 553 : audit [DBG] from='client.? 172.21.15.33:0/367331241' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T18:29:09.536 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-15T18:29:09.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:09.536 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T18:29:09.536 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T18:29:09.536 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-15T18:29:09.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-15T18:29:09.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-15T18:29:09.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-15T18:29:09.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-15T18:29:09.537 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T18:29:09.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:08.390536+0000 mon.smithi033 (mon.0) 551 : cluster [INF] MDS daemon mds.cephfs.smithi033.qszefh is removed because it is dead or otherwise unavailable. 2024-02-15T18:29:09.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:08.394517+0000 mon.smithi033 (mon.0) 552 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 1 up:standby 2024-02-15T18:29:09.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:08.768588+0000 mon.smithi033 (mon.0) 553 : audit [DBG] from='client.? 172.21.15.33:0/367331241' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T18:29:09.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:09.767 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-02-15T18:29:09.767 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-02-15T18:29:09.767 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-02-15T18:29:09.767 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-02-15T18:29:09.767 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-02-15T18:29:09.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:09.866 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-02-15T18:29:09.884 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-02-15T18:29:09.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:29:09.990 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:29:09.990 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-02-15T18:29:10.012 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:29:10.012 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-02-15T18:29:10.015 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-15T18:29:10.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:10.015 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-15T18:29:10.047 INFO:tasks.kclient:client.1 config is {} 2024-02-15T18:29:10.047 DEBUG:teuthology.orchestra.run.smithi131:> ceph fs ls 2024-02-15T18:29:10.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.253+0000 7f48222ab700 1 -- 172.21.15.131:0/585437620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 msgr2=0x7f481c0f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:10.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.253+0000 7f48222ab700 1 --2- 172.21.15.131:0/585437620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 0x7f481c0f57f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f480c004660 tx=0x7f480c009b30).stop 2024-02-15T18:29:10.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.253+0000 7f48222ab700 1 -- 172.21.15.131:0/585437620 shutdown_connections 2024-02-15T18:29:10.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.253+0000 7f48222ab700 1 --2- 172.21.15.131:0/585437620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481c0f5ce0 0x7f481c0f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:10.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.253+0000 7f48222ab700 1 --2- 172.21.15.131:0/585437620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 0x7f481c0f57f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:10.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.253+0000 7f48222ab700 1 -- 172.21.15.131:0/585437620 >> 172.21.15.131:0/585437620 conn(0x7f481c0f0bd0 msgr2=0x7f481c0f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.253+0000 7f48222ab700 1 -- 172.21.15.131:0/585437620 shutdown_connections 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.253+0000 7f48222ab700 1 -- 172.21.15.131:0/585437620 wait complete. 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.253+0000 7f48222ab700 1 Processor -- start 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f48222ab700 1 -- start start 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f48222ab700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 0x7f481c105bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f48222ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481c0f5ce0 0x7f481c1060a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f48222ab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c106650 con 0x7f481c0f5ce0 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f48222ab700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c106790 con 0x7f481c0f53d0 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f481bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 0x7f481c105bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f481bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 0x7f481c105bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33126/0 (socket says 172.21.15.131:33126) 2024-02-15T18:29:10.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f481bfff700 1 -- 172.21.15.131:0/324513980 learned_addr learned my addr 172.21.15.131:0/324513980 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f481b7fe700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481c0f5ce0 0x7f481c1060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f481bfff700 1 -- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481c0f5ce0 msgr2=0x7f481c1060a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f481bfff700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481c0f5ce0 0x7f481c1060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f481bfff700 1 -- 172.21.15.131:0/324513980 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c005040 con 0x7f481c0f53d0 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f481bfff700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 0x7f481c105bb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f480c000c00 tx=0x7f480c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.254+0000 7f4818ff9700 1 -- 172.21.15.131:0/324513980 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f480c01b070 con 0x7f481c0f53d0 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.255+0000 7f4818ff9700 1 -- 172.21.15.131:0/324513980 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f480c007e90 con 0x7f481c0f53d0 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.255+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c05f8a0 con 0x7f481c0f53d0 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.255+0000 7f4818ff9700 1 -- 172.21.15.131:0/324513980 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f480c014d90 con 0x7f481c0f53d0 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.255+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c05fe60 con 0x7f481c0f53d0 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.255+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c0fdcd0 con 0x7f481c0f53d0 2024-02-15T18:29:10.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.256+0000 7f4818ff9700 1 -- 172.21.15.131:0/324513980 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f480c027070 con 0x7f481c0f53d0 2024-02-15T18:29:10.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.256+0000 7f4818ff9700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f480405c2b0 0x7f480405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:10.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.256+0000 7f4818ff9700 1 -- 172.21.15.131:0/324513980 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f480c078b90 con 0x7f481c0f53d0 2024-02-15T18:29:10.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.256+0000 7f481b7fe700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f480405c2b0 0x7f480405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:10.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.257+0000 7f481b7fe700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f480405c2b0 0x7f480405e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f4810009da0 tx=0x7f481000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:10.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.260+0000 7f4818ff9700 1 -- 172.21.15.131:0/324513980 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f480c04b8d0 con 0x7f481c0f53d0 2024-02-15T18:29:10.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.447+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f481c10b1d0 con 0x7f481c0f53d0 2024-02-15T18:29:10.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.448+0000 7f4818ff9700 1 -- 172.21.15.131:0/324513980 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f480c04eef0 con 0x7f481c0f53d0 2024-02-15T18:29:10.442 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-15T18:29:10.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f480405c2b0 msgr2=0x7f480405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:10.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f480405c2b0 0x7f480405e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f4810009da0 tx=0x7f481000b040).stop 2024-02-15T18:29:10.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 msgr2=0x7f481c105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:10.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 0x7f481c105bb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f480c000c00 tx=0x7f480c00b040).stop 2024-02-15T18:29:10.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 shutdown_connections 2024-02-15T18:29:10.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f480405c2b0 0x7f480405e770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:10.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f481c0f53d0 0x7f481c105bb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:10.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 --2- 172.21.15.131:0/324513980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f481c0f5ce0 0x7f481c1060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:10.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 >> 172.21.15.131:0/324513980 conn(0x7f481c0f0bd0 msgr2=0x7f481c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:10.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 shutdown_connections 2024-02-15T18:29:10.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-02-15T18:29:10.449+0000 7f48222ab700 1 -- 172.21.15.131:0/324513980 wait complete. 2024-02-15T18:29:10.454 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-15T18:29:10.454 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-15T18:29:10.454 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-02-15T18:29:10.454 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-15T18:29:10.454 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-15T18:29:10.454 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-15T18:29:10.454 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-15T18:29:10.454 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-15T18:29:10.454 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-15T18:29:10.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:10.454 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-02-15T18:29:10.472 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:29:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-15T18:29:10.474 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-02-15T18:29:10.474 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-15T18:29:10.474 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42083sec preferred_lft 42083sec 2024-02-15T18:29:10.474 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-02-15T18:29:10.474 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-02-15T18:29:10.474 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-15T18:29:10.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:10.474 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2024-02-15T18:29:10.474 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-02-15T18:29:10.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2024-02-15T18:29:10.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2024-02-15T18:29:10.475 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2024-02-15T18:29:10.475 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-15T18:29:10.475 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-02-15T18:29:10.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:08.566336+0000 mgr.smithi033.apxevf (mgr.14162) 256 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:10.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:09.400950+0000 mon.smithi033 (mon.0) 554 : cluster [DBG] mds.? [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] up:boot 2024-02-15T18:29:10.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:09.401012+0000 mon.smithi033 (mon.0) 555 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:29:10.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:09.401115+0000 mon.smithi033 (mon.0) 556 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:29:10.552 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:08.566336+0000 mgr.smithi033.apxevf (mgr.14162) 256 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:10.552 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:09.400950+0000 mon.smithi033 (mon.0) 554 : cluster [DBG] mds.? [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] up:boot 2024-02-15T18:29:10.552 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:09.401012+0000 mon.smithi033 (mon.0) 555 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:29:10.552 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:09.401115+0000 mon.smithi033 (mon.0) 556 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:29:10.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:10.640 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-15T18:29:10.708 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-02-15T18:29:10.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:10.710 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-02-15T18:29:10.789 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-02-15T18:29:10.789 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-15T18:29:10.789 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-15T18:29:10.789 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-15T18:29:10.789 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-15T18:29:10.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:10.790 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2024-02-15T18:29:10.790 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-02-15T18:29:10.790 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-15T18:29:10.790 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-15T18:29:10.790 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-15T18:29:10.790 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-02-15T18:29:11.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:11.077 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-02-15T18:29:11.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:11.095 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-02-15T18:29:11.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:11.152 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2024-02-15T18:29:11.152 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-02-15T18:29:11.152 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-15T18:29:11.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-15T18:29:11.153 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-02-15T18:29:11.249 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-15T18:29:11.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:11.250 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2024-02-15T18:29:11.250 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-02-15T18:29:11.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-15T18:29:11.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-15T18:29:11.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-15T18:29:11.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-15T18:29:11.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-15T18:29:11.250 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-02-15T18:29:11.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:11.452 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec bash -c ' 2024-02-15T18:29:11.452 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-02-15T18:29:11.452 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-02-15T18:29:11.452 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2024-02-15T18:29:11.453 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-02-15T18:29:11.491 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:10.448197+0000 mon.smithi131 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.131:0/324513980' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T18:29:11.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:11.549 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p /home/ubuntu/cephtest/mnt.1 2024-02-15T18:29:11.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:10.448197+0000 mon.smithi131 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.131:0/324513980' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-15T18:29:11.607 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-02-15T18:29:11.608 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:29:11.705 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:29:11.705 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-02-15T18:29:11.726 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-02-15T18:29:11.726 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-02-15T18:29:11.729 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-15T18:29:11.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:29:11.729 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-15T18:29:12.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:10.566944+0000 mgr.smithi033.apxevf (mgr.14162) 257 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:12.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:10.566944+0000 mgr.smithi033.apxevf (mgr.14162) 257 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 3.6 KiB data, 32 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:13.997 INFO:teuthology.run_tasks:Running task print... 2024-02-15T18:29:14.007 INFO:teuthology.task.print:**** done client 2024-02-15T18:29:14.008 INFO:teuthology.run_tasks:Running task parallel... 2024-02-15T18:29:14.045 INFO:teuthology.task.parallel:starting parallel... 2024-02-15T18:29:14.045 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-15T18:29:14.046 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T18:29:14.046 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:29:14.046 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-15T18:29:14.047 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-15T18:29:14.047 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-15T18:29:14.050 INFO:tasks.workunit:Pulling workunits from ref bedfc49c6a823fb0ff75911e476e1f3cb464ad3e 2024-02-15T18:29:14.050 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-15T18:29:14.050 INFO:tasks.workunit:timeout=3h 2024-02-15T18:29:14.050 INFO:tasks.workunit:cleanup=True 2024-02-15T18:29:14.051 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-15T18:29:14.075 INFO:teuthology.orchestra.run.smithi033.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-15T18:29:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-15T18:29:14.076 INFO:teuthology.orchestra.run.smithi033.stdout:Device: a1h/161d Inode: 1 Links: 2 2024-02-15T18:29:14.076 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:29:14.076 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:cephfs_t:s0 2024-02-15T18:29:14.076 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-15T18:29:14.076 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-02-15 18:28:39.663710305 +0000 2024-02-15T18:29:14.076 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-02-15 18:29:10.047446303 +0000 2024-02-15T18:29:14.076 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-02-15 18:28:39.663710305 +0000 2024-02-15T18:29:14.076 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-15T18:29:14.076 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-15T18:29:14.157 DEBUG:teuthology.orchestra.run.smithi131:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-15T18:29:14.180 INFO:teuthology.orchestra.run.smithi131.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-15T18:29:14.180 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-02-15T18:29:14.180 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 7dh/125d Inode: 1 Links: 3 2024-02-15T18:29:14.181 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-15T18:29:14.181 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:cephfs_t:s0 2024-02-15T18:29:14.181 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-15T18:29:14.181 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-02-15 18:29:14.151380232 +0000 2024-02-15T18:29:14.181 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-02-15 18:29:14.151380232 +0000 2024-02-15T18:29:14.181 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-02-15T18:29:14.181 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-15T18:29:14.181 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-15T18:29:14.259 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ljflores/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bedfc49c6a823fb0ff75911e476e1f3cb464ad3e 2024-02-15T18:29:14.260 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ljflores/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout bedfc49c6a823fb0ff75911e476e1f3cb464ad3e 2024-02-15T18:29:14.280 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-15T18:29:14.321 INFO:tasks.workunit.client.1.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-15T18:29:14.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:12.567571+0000 mgr.smithi033.apxevf (mgr.14162) 258 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 3.8 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:29:14.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:13.279326+0000 mon.smithi033 (mon.0) 557 : cluster [DBG] mds.? [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] up:standby 2024-02-15T18:29:14.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:13.279398+0000 mon.smithi033 (mon.0) 558 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:29:14.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:12.567571+0000 mgr.smithi033.apxevf (mgr.14162) 258 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 3.8 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:29:14.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:13.279326+0000 mon.smithi033 (mon.0) 557 : cluster [DBG] mds.? [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] up:standby 2024-02-15T18:29:14.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:13.279398+0000 mon.smithi033 (mon.0) 558 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:29:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.266+0000 7f8741ced700 1 -- 172.21.15.33:0/3703787208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 msgr2=0x7f873c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.266+0000 7f8741ced700 1 --2- 172.21.15.33:0/3703787208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 0x7f873c0f7c30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8728004660 tx=0x7f8728009b30).stop 2024-02-15T18:29:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.266+0000 7f8741ced700 1 -- 172.21.15.33:0/3703787208 shutdown_connections 2024-02-15T18:29:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.266+0000 7f8741ced700 1 --2- 172.21.15.33:0/3703787208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 0x7f873c0f7c30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.266+0000 7f8741ced700 1 --2- 172.21.15.33:0/3703787208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f873c0f6530 0x7f873c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.266+0000 7f8741ced700 1 -- 172.21.15.33:0/3703787208 >> 172.21.15.33:0/3703787208 conn(0x7f873c0f1c90 msgr2=0x7f873c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.266+0000 7f8741ced700 1 -- 172.21.15.33:0/3703787208 shutdown_connections 2024-02-15T18:29:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.266+0000 7f8741ced700 1 -- 172.21.15.33:0/3703787208 wait complete. 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.267+0000 7f8741ced700 1 Processor -- start 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.267+0000 7f8741ced700 1 -- start start 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f8741ced700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f873c0f6530 0x7f873c106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f8741ced700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 0x7f873c107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f8741ced700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c107910 con 0x7f873c0f77d0 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f8741ced700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c108120 con 0x7f873c0f6530 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f873bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 0x7f873c107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f873bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 0x7f873c107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49770/0 (socket says 172.21.15.33:49770) 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f873bfff700 1 -- 172.21.15.33:0/807167350 learned_addr learned my addr 172.21.15.33:0/807167350 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f8740ceb700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f873c0f6530 0x7f873c106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f873bfff700 1 -- 172.21.15.33:0/807167350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f873c0f6530 msgr2=0x7f873c106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f873bfff700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f873c0f6530 0x7f873c106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f873bfff700 1 -- 172.21.15.33:0/807167350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8728005040 con 0x7f873c0f77d0 2024-02-15T18:29:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f8740ceb700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f873c0f6530 0x7f873c106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:29:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f873bfff700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 0x7f873c107310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f8728000c00 tx=0x7f872800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f87397fa700 1 -- 172.21.15.33:0/807167350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8728019070 con 0x7f873c0f77d0 2024-02-15T18:29:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c108340 con 0x7f873c0f77d0 2024-02-15T18:29:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f87397fa700 1 -- 172.21.15.33:0/807167350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8728007e90 con 0x7f873c0f77d0 2024-02-15T18:29:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f87397fa700 1 -- 172.21.15.33:0/807167350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8728014d50 con 0x7f873c0f77d0 2024-02-15T18:29:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.268+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c1088a0 con 0x7f873c0f77d0 2024-02-15T18:29:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.269+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c059100 con 0x7f873c0f77d0 2024-02-15T18:29:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.270+0000 7f87397fa700 1 -- 172.21.15.33:0/807167350 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8728025070 con 0x7f873c0f77d0 2024-02-15T18:29:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.271+0000 7f87397fa700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f872c05c300 0x7f872c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.271+0000 7f87397fa700 1 -- 172.21.15.33:0/807167350 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f87280771c0 con 0x7f873c0f77d0 2024-02-15T18:29:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.271+0000 7f8740ceb700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f872c05c300 0x7f872c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.271+0000 7f8740ceb700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f872c05c300 0x7f872c05e7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f873c106b90 tx=0x7f873000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:16.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.275+0000 7f87397fa700 1 -- 172.21.15.33:0/807167350 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f872804de60 con 0x7f873c0f77d0 2024-02-15T18:29:16.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.436+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f873c045ad0 con 0x7f873c0f77d0 2024-02-15T18:29:16.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.436+0000 7f87397fa700 1 -- 172.21.15.33:0/807167350 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v16)=0 v16) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8728023070 con 0x7f873c0f77d0 2024-02-15T18:29:16.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f872c05c300 msgr2=0x7f872c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:16.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f872c05c300 0x7f872c05e7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f873c106b90 tx=0x7f873000b040).stop 2024-02-15T18:29:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 msgr2=0x7f873c107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 0x7f873c107310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f8728000c00 tx=0x7f872800b040).stop 2024-02-15T18:29:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 shutdown_connections 2024-02-15T18:29:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f872c05c300 0x7f872c05e7c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f873c0f6530 0x7f873c106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 --2- 172.21.15.33:0/807167350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f873c0f77d0 0x7f873c107310 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 >> 172.21.15.33:0/807167350 conn(0x7f873c0f1c90 msgr2=0x7f873c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 shutdown_connections 2024-02-15T18:29:16.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:16.438+0000 7f8741ced700 1 -- 172.21.15.33:0/807167350 wait complete. 2024-02-15T18:29:16.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:14.567950+0000 mgr.smithi033.apxevf (mgr.14162) 259 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 4.1 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:29:16.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:14.567950+0000 mgr.smithi033.apxevf (mgr.14162) 259 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 4.1 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:29:17.165 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-15T18:29:18.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:16.568328+0000 mgr.smithi033.apxevf (mgr.14162) 260 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 4.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-15T18:29:18.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:16.568328+0000 mgr.smithi033.apxevf (mgr.14162) 260 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 4.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-15T18:29:19.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.246+0000 7ff300842700 1 -- 172.21.15.33:0/4041118943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0f6530 msgr2=0x7ff2fc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.246+0000 7ff300842700 1 --2- 172.21.15.33:0/4041118943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0f6530 0x7ff2fc0f6950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff2ec004660 tx=0x7ff2ec009b30).stop 2024-02-15T18:29:19.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.246+0000 7ff300842700 1 -- 172.21.15.33:0/4041118943 shutdown_connections 2024-02-15T18:29:19.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.246+0000 7ff300842700 1 --2- 172.21.15.33:0/4041118943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2fc0f77d0 0x7ff2fc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.246+0000 7ff300842700 1 --2- 172.21.15.33:0/4041118943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0f6530 0x7ff2fc0f6950 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.246+0000 7ff300842700 1 -- 172.21.15.33:0/4041118943 >> 172.21.15.33:0/4041118943 conn(0x7ff2fc0f1c90 msgr2=0x7ff2fc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:19.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.246+0000 7ff300842700 1 -- 172.21.15.33:0/4041118943 shutdown_connections 2024-02-15T18:29:19.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.247+0000 7ff300842700 1 -- 172.21.15.33:0/4041118943 wait complete. 2024-02-15T18:29:19.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.247+0000 7ff300842700 1 Processor -- start 2024-02-15T18:29:19.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.247+0000 7ff300842700 1 -- start start 2024-02-15T18:29:19.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.247+0000 7ff300842700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0f6530 0x7ff2fc106ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.247+0000 7ff300842700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2fc0f77d0 0x7ff2fc107390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.247+0000 7ff300842700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc107940 con 0x7ff2fc0f77d0 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.247+0000 7ff300842700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc108140 con 0x7ff2fc0f6530 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2faffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2fc0f77d0 0x7ff2fc107390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2fb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0f6530 0x7ff2fc106ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2faffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2fc0f77d0 0x7ff2fc107390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49782/0 (socket says 172.21.15.33:49782) 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2faffd700 1 -- 172.21.15.33:0/4290266410 learned_addr learned my addr 172.21.15.33:0/4290266410 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2fb7fe700 1 -- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2fc0f77d0 msgr2=0x7ff2fc107390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2fb7fe700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2fc0f77d0 0x7ff2fc107390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2fb7fe700 1 -- 172.21.15.33:0/4290266410 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec005040 con 0x7ff2fc0f6530 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2faffd700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2fc0f77d0 0x7ff2fc107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:29:19.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2fb7fe700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0f6530 0x7ff2fc106ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff2ec004660 tx=0x7ff2ec00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:19.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2e3fff700 1 -- 172.21.15.33:0/4290266410 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ec019070 con 0x7ff2fc0f6530 2024-02-15T18:29:19.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc1083c0 con 0x7ff2fc0f6530 2024-02-15T18:29:19.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2e3fff700 1 -- 172.21.15.33:0/4290266410 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2ec007e90 con 0x7ff2fc0f6530 2024-02-15T18:29:19.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff2e3fff700 1 -- 172.21.15.33:0/4290266410 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2ec014d60 con 0x7ff2fc0f6530 2024-02-15T18:29:19.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.248+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc108920 con 0x7ff2fc0f6530 2024-02-15T18:29:19.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.249+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc059100 con 0x7ff2fc0f6530 2024-02-15T18:29:19.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.250+0000 7ff2e3fff700 1 -- 172.21.15.33:0/4290266410 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff2ec025070 con 0x7ff2fc0f6530 2024-02-15T18:29:19.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.250+0000 7ff2e3fff700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff2e405c300 0x7ff2e405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:19.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.250+0000 7ff2e3fff700 1 -- 172.21.15.33:0/4290266410 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff2ec076cc0 con 0x7ff2fc0f6530 2024-02-15T18:29:19.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.250+0000 7ff2faffd700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff2e405c300 0x7ff2e405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:19.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.251+0000 7ff2faffd700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff2e405c300 0x7ff2e405e7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff2f0007a30 tx=0x7ff2f000b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:19.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.254+0000 7ff2e3fff700 1 -- 172.21.15.33:0/4290266410 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff2ec049980 con 0x7ff2fc0f6530 2024-02-15T18:29:19.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.425+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7ff2fc0008d0 con 0x7ff2fc0f6530 2024-02-15T18:29:19.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.426+0000 7ff2e3fff700 1 -- 172.21.15.33:0/4290266410 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v16)=0 v16) v1 ==== 163+0+0 (secure 0 0 0) 0x7ff2ec04cfa0 con 0x7ff2fc0f6530 2024-02-15T18:29:19.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.427+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff2e405c300 msgr2=0x7ff2e405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.427+0000 7ff300842700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff2e405c300 0x7ff2e405e7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff2f0007a30 tx=0x7ff2f000b040).stop 2024-02-15T18:29:19.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.427+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0f6530 msgr2=0x7ff2fc106ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:19.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.427+0000 7ff300842700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0f6530 0x7ff2fc106ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff2ec004660 tx=0x7ff2ec00b040).stop 2024-02-15T18:29:19.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.427+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 shutdown_connections 2024-02-15T18:29:19.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.427+0000 7ff300842700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7ff2e405c300 0x7ff2e405e7c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.427+0000 7ff300842700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0f6530 0x7ff2fc106ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.427+0000 7ff300842700 1 --2- 172.21.15.33:0/4290266410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2fc0f77d0 0x7ff2fc107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:19.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.427+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 >> 172.21.15.33:0/4290266410 conn(0x7ff2fc0f1c90 msgr2=0x7ff2fc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:19.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.428+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 shutdown_connections 2024-02-15T18:29:19.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:19.428+0000 7ff300842700 1 -- 172.21.15.33:0/4290266410 wait complete. 2024-02-15T18:29:19.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:18.568687+0000 mgr.smithi033.apxevf (mgr.14162) 261 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 4.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-15T18:29:19.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:18.568687+0000 mgr.smithi033.apxevf (mgr.14162) 261 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 4.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-15T18:29:20.214 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-15T18:29:21.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:20.569124+0000 mgr.smithi033.apxevf (mgr.14162) 262 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-15T18:29:22.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:20.569124+0000 mgr.smithi033.apxevf (mgr.14162) 262 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-02-15T18:29:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.436+0000 7f00566d8700 1 -- 172.21.15.33:0/288936660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 msgr2=0x7f00500f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.436+0000 7f00566d8700 1 --2- 172.21.15.33:0/288936660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 0x7f00500f7c30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f0040004660 tx=0x7f0040009b30).stop 2024-02-15T18:29:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.436+0000 7f00566d8700 1 -- 172.21.15.33:0/288936660 shutdown_connections 2024-02-15T18:29:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.436+0000 7f00566d8700 1 --2- 172.21.15.33:0/288936660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 0x7f00500f7c30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.436+0000 7f00566d8700 1 --2- 172.21.15.33:0/288936660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500f6530 0x7f00500f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.436+0000 7f00566d8700 1 -- 172.21.15.33:0/288936660 >> 172.21.15.33:0/288936660 conn(0x7f00500f1c90 msgr2=0x7f00500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.436+0000 7f00566d8700 1 -- 172.21.15.33:0/288936660 shutdown_connections 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.436+0000 7f00566d8700 1 -- 172.21.15.33:0/288936660 wait complete. 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f00566d8700 1 Processor -- start 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f00566d8700 1 -- start start 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f00566d8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500f6530 0x7f005006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f00566d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 0x7f0050069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f00566d8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005006a410 con 0x7f00500f77d0 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f00566d8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005006a550 con 0x7f00500f6530 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f0054ed5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 0x7f0050069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f0054ed5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 0x7f0050069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49794/0 (socket says 172.21.15.33:49794) 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f0054ed5700 1 -- 172.21.15.33:0/1738493892 learned_addr learned my addr 172.21.15.33:0/1738493892 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.437+0000 7f00556d6700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500f6530 0x7f005006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.438+0000 7f0054ed5700 1 -- 172.21.15.33:0/1738493892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500f6530 msgr2=0x7f005006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:22.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.438+0000 7f0054ed5700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500f6530 0x7f005006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:22.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.438+0000 7f0054ed5700 1 -- 172.21.15.33:0/1738493892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040005040 con 0x7f00500f77d0 2024-02-15T18:29:22.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.438+0000 7f0054ed5700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 0x7f0050069e20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f0040009830 tx=0x7f0040009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:22.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.438+0000 7f0045ffb700 1 -- 172.21.15.33:0/1738493892 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0040018070 con 0x7f00500f77d0 2024-02-15T18:29:22.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.438+0000 7f0045ffb700 1 -- 172.21.15.33:0/1738493892 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0040007d70 con 0x7f00500f77d0 2024-02-15T18:29:22.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.438+0000 7f0045ffb700 1 -- 172.21.15.33:0/1738493892 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f004001c620 con 0x7f00500f77d0 2024-02-15T18:29:22.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.438+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005006a7d0 con 0x7f00500f77d0 2024-02-15T18:29:22.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.438+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005010ee80 con 0x7f00500f77d0 2024-02-15T18:29:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.439+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0050045ad0 con 0x7f00500f77d0 2024-02-15T18:29:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.439+0000 7f0045ffb700 1 -- 172.21.15.33:0/1738493892 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f004001d980 con 0x7f00500f77d0 2024-02-15T18:29:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.440+0000 7f0045ffb700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f003c05c300 0x7f003c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.440+0000 7f0045ffb700 1 -- 172.21.15.33:0/1738493892 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0040077db0 con 0x7f00500f77d0 2024-02-15T18:29:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.440+0000 7f00556d6700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f003c05c300 0x7f003c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.440+0000 7f00556d6700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f003c05c300 0x7f003c05e7c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f005006b730 tx=0x7f004c008040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.444+0000 7f0045ffb700 1 -- 172.21.15.33:0/1738493892 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f004004aa10 con 0x7f00500f77d0 2024-02-15T18:29:22.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.602+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f0050027a00 con 0x7f00500f77d0 2024-02-15T18:29:22.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.606+0000 7f0045ffb700 1 -- 172.21.15.33:0/1738493892 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f004004aa10 con 0x7f00500f77d0 2024-02-15T18:29:22.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.606+0000 7f0045ffb700 1 -- 172.21.15.33:0/1738493892 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v17)=0 v17) v1 ==== 135+0+0 (secure 0 0 0) 0x7f004004e030 con 0x7f00500f77d0 2024-02-15T18:29:22.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.608+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f003c05c300 msgr2=0x7f003c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:22.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.608+0000 7f00566d8700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f003c05c300 0x7f003c05e7c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f005006b730 tx=0x7f004c008040).stop 2024-02-15T18:29:22.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.608+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 msgr2=0x7f0050069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:22.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.608+0000 7f00566d8700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 0x7f0050069e20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f0040009830 tx=0x7f0040009b30).stop 2024-02-15T18:29:22.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.609+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 shutdown_connections 2024-02-15T18:29:22.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.609+0000 7f00566d8700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f003c05c300 0x7f003c05e7c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:22.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.609+0000 7f00566d8700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500f6530 0x7f005006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:22.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.609+0000 7f00566d8700 1 --2- 172.21.15.33:0/1738493892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00500f77d0 0x7f0050069e20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:22.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.609+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 >> 172.21.15.33:0/1738493892 conn(0x7f00500f1c90 msgr2=0x7f00500fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:22.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.609+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 shutdown_connections 2024-02-15T18:29:22.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:22.609+0000 7f00566d8700 1 -- 172.21.15.33:0/1738493892 wait complete. 2024-02-15T18:29:23.391 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-15T18:29:23.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:22.569488+0000 mgr.smithi033.apxevf (mgr.14162) 263 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-02-15T18:29:23.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:22.606684+0000 mon.smithi033 (mon.0) 559 : audit [INF] from='client.? 172.21.15.33:0/1738493892' entity='client.admin' 2024-02-15T18:29:23.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:22.610386+0000 mon.smithi033 (mon.0) 560 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:23.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:22.967636+0000 mon.smithi033 (mon.0) 561 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:24.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:22.569488+0000 mgr.smithi033.apxevf (mgr.14162) 263 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 1 op/s 2024-02-15T18:29:24.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:22.606684+0000 mon.smithi033 (mon.0) 559 : audit [INF] from='client.? 172.21.15.33:0/1738493892' entity='client.admin' 2024-02-15T18:29:24.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:22.610386+0000 mon.smithi033 (mon.0) 560 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:24.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:22.967636+0000 mon.smithi033 (mon.0) 561 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:25.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.658+0000 7f8dff0d9700 1 -- 172.21.15.33:0/3946320905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 msgr2=0x7f8df80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:25.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.658+0000 7f8dff0d9700 1 --2- 172.21.15.33:0/3946320905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 0x7f8df80f6cc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f8de4004660 tx=0x7f8de4009b30).stop 2024-02-15T18:29:25.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.659+0000 7f8dff0d9700 1 -- 172.21.15.33:0/3946320905 shutdown_connections 2024-02-15T18:29:25.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.659+0000 7f8dff0d9700 1 --2- 172.21.15.33:0/3946320905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 0x7f8df80f6cc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:25.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.659+0000 7f8dff0d9700 1 --2- 172.21.15.33:0/3946320905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80f55c0 0x7f8df80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:25.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.659+0000 7f8dff0d9700 1 -- 172.21.15.33:0/3946320905 >> 172.21.15.33:0/3946320905 conn(0x7f8df80f0d40 msgr2=0x7f8df80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:25.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.659+0000 7f8dff0d9700 1 -- 172.21.15.33:0/3946320905 shutdown_connections 2024-02-15T18:29:25.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.659+0000 7f8dff0d9700 1 -- 172.21.15.33:0/3946320905 wait complete. 2024-02-15T18:29:25.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.659+0000 7f8dff0d9700 1 Processor -- start 2024-02-15T18:29:25.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.659+0000 7f8dff0d9700 1 -- start start 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8dff0d9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80f55c0 0x7f8df8109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8dff0d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 0x7f8df810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8dff0d9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80603e0 con 0x7f8df80f6860 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8dff0d9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8060520 con 0x7f8df80f55c0 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8df7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 0x7f8df810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8dfce75700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80f55c0 0x7f8df8109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8df7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 0x7f8df810c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41142/0 (socket says 172.21.15.33:41142) 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8df7fff700 1 -- 172.21.15.33:0/2655586018 learned_addr learned my addr 172.21.15.33:0/2655586018 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8df7fff700 1 -- 172.21.15.33:0/2655586018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80f55c0 msgr2=0x7f8df8109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8df7fff700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80f55c0 0x7f8df8109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:25.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8df7fff700 1 -- 172.21.15.33:0/2655586018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4005040 con 0x7f8df80f6860 2024-02-15T18:29:25.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8df7fff700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 0x7f8df810c1b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f8de4000c00 tx=0x7f8de400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:25.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.660+0000 7f8df57fa700 1 -- 172.21.15.33:0/2655586018 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8de4019070 con 0x7f8df80f6860 2024-02-15T18:29:25.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.661+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df810c700 con 0x7f8df80f6860 2024-02-15T18:29:25.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.661+0000 7f8df57fa700 1 -- 172.21.15.33:0/2655586018 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f8de4007e80 con 0x7f8df80f6860 2024-02-15T18:29:25.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.661+0000 7f8df57fa700 1 -- 172.21.15.33:0/2655586018 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8de4014db0 con 0x7f8df80f6860 2024-02-15T18:29:25.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.661+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df810cc60 con 0x7f8df80f6860 2024-02-15T18:29:25.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.662+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df8045ad0 con 0x7f8df80f6860 2024-02-15T18:29:25.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.662+0000 7f8df57fa700 1 -- 172.21.15.33:0/2655586018 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8de4025070 con 0x7f8df80f6860 2024-02-15T18:29:25.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.662+0000 7f8df57fa700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8de805c250 0x7f8de805e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:25.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.663+0000 7f8df57fa700 1 -- 172.21.15.33:0/2655586018 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8de4076db0 con 0x7f8df80f6860 2024-02-15T18:29:25.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.663+0000 7f8dfce75700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8de805c250 0x7f8de805e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:25.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.663+0000 7f8dfce75700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8de805c250 0x7f8de805e710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f8df8060060 tx=0x7f8dec00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:25.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.667+0000 7f8df57fa700 1 -- 172.21.15.33:0/2655586018 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8de4049a10 con 0x7f8df80f6860 2024-02-15T18:29:25.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:24.570071+0000 mgr.smithi033.apxevf (mgr.14162) 264 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-15T18:29:25.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.884+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8df80fe040 con 0x7f8de805c250 2024-02-15T18:29:25.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.889+0000 7f8df57fa700 1 -- 172.21.15.33:0/2655586018 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f8dec00f040 con 0x7f8de805c250 2024-02-15T18:29:25.883 INFO:teuthology.orchestra.run.smithi033.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:29:25.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8de805c250 msgr2=0x7f8de805e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:25.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8de805c250 0x7f8de805e710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f8df8060060 tx=0x7f8dec00b040).stop 2024-02-15T18:29:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 msgr2=0x7f8df810c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 0x7f8df810c1b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f8de4000c00 tx=0x7f8de400b040).stop 2024-02-15T18:29:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 shutdown_connections 2024-02-15T18:29:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f8de805c250 0x7f8de805e710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8df80f55c0 0x7f8df8109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 --2- 172.21.15.33:0/2655586018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8df80f6860 0x7f8df810c1b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 >> 172.21.15.33:0/2655586018 conn(0x7f8df80f0d40 msgr2=0x7f8df80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 shutdown_connections 2024-02-15T18:29:25.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:25.891+0000 7f8dff0d9700 1 -- 172.21.15.33:0/2655586018 wait complete. 2024-02-15T18:29:26.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:24.570071+0000 mgr.smithi033.apxevf (mgr.14162) 264 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-15T18:29:26.682 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-15T18:29:26.683 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:29:26.683 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; sleep 30 ; done' 2024-02-15T18:29:27.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:25.885750+0000 mgr.smithi033.apxevf (mgr.14162) 265 : audit [DBG] from='client.14510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:27.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:29:25.886314+0000 mgr.smithi033.apxevf (mgr.14162) 266 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:29:27.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:25.889533+0000 mon.smithi033 (mon.0) 562 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:27.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:25.890042+0000 mon.smithi033 (mon.0) 563 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:27.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:25.906105+0000 mon.smithi033 (mon.0) 564 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:27.050 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:29:25.909543+0000 mgr.smithi033.apxevf (mgr.14162) 267 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:29:27.251 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:25.885750+0000 mgr.smithi033.apxevf (mgr.14162) 265 : audit [DBG] from='client.14510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:27.251 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:29:25.886314+0000 mgr.smithi033.apxevf (mgr.14162) 266 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:29:27.251 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:25.889533+0000 mon.smithi033 (mon.0) 562 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:27.251 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:25.890042+0000 mon.smithi033 (mon.0) 563 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:27.251 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:25.906105+0000 mon.smithi033 (mon.0) 564 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:27.251 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:29:25.909543+0000 mgr.smithi033.apxevf (mgr.14162) 267 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-15T18:29:28.229 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:26.570434+0000 mgr.smithi033.apxevf (mgr.14162) 268 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-15T18:29:28.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:26.570434+0000 mgr.smithi033.apxevf (mgr.14162) 268 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-15T18:29:28.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.921+0000 7f003f59e700 1 -- 172.21.15.33:0/750246530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f77d0 msgr2=0x7f00400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:28.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.921+0000 7f003f59e700 1 --2- 172.21.15.33:0/750246530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f77d0 0x7f00400f7c30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f0034004660 tx=0x7f0034009b30).stop 2024-02-15T18:29:28.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.921+0000 7f003f59e700 1 -- 172.21.15.33:0/750246530 shutdown_connections 2024-02-15T18:29:28.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.921+0000 7f003f59e700 1 --2- 172.21.15.33:0/750246530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f77d0 0x7f00400f7c30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:28.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.921+0000 7f003f59e700 1 --2- 172.21.15.33:0/750246530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00400f6530 0x7f00400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:28.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.921+0000 7f003f59e700 1 -- 172.21.15.33:0/750246530 >> 172.21.15.33:0/750246530 conn(0x7f00400f1c90 msgr2=0x7f00400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:28.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.921+0000 7f003f59e700 1 -- 172.21.15.33:0/750246530 shutdown_connections 2024-02-15T18:29:28.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.921+0000 7f003f59e700 1 -- 172.21.15.33:0/750246530 wait complete. 2024-02-15T18:29:28.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.922+0000 7f003f59e700 1 Processor -- start 2024-02-15T18:29:28.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.922+0000 7f003f59e700 1 -- start start 2024-02-15T18:29:28.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.922+0000 7f003f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f6530 0x7f004006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:28.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.922+0000 7f003f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00400f77d0 0x7f0040069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:28.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.922+0000 7f003f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004006a380 con 0x7f00400f6530 2024-02-15T18:29:28.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.922+0000 7f003f59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004006a4c0 con 0x7f00400f77d0 2024-02-15T18:29:28.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f6530 0x7f004006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f6530 0x7f004006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41158/0 (socket says 172.21.15.33:41158) 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003e59c700 1 -- 172.21.15.33:0/1994939522 learned_addr learned my addr 172.21.15.33:0/1994939522 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003dd9b700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00400f77d0 0x7f0040069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003e59c700 1 -- 172.21.15.33:0/1994939522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00400f77d0 msgr2=0x7f0040069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003e59c700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00400f77d0 0x7f0040069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003e59c700 1 -- 172.21.15.33:0/1994939522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034005040 con 0x7f00400f6530 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003e59c700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f6530 0x7f004006b9a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f003000e7c0 tx=0x7f003000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f002effd700 1 -- 172.21.15.33:0/1994939522 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00300092e0 con 0x7f00400f6530 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f002effd700 1 -- 172.21.15.33:0/1994939522 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f003000f040 con 0x7f00400f6530 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004006a7a0 con 0x7f00400f6530 2024-02-15T18:29:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f002effd700 1 -- 172.21.15.33:0/1994939522 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0030014920 con 0x7f00400f6530 2024-02-15T18:29:28.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.923+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004010ede0 con 0x7f00400f6530 2024-02-15T18:29:28.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.925+0000 7f002effd700 1 -- 172.21.15.33:0/1994939522 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f003001b030 con 0x7f00400f6530 2024-02-15T18:29:28.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.925+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0040045ad0 con 0x7f00400f6530 2024-02-15T18:29:28.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.926+0000 7f002effd700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f002805c350 0x7f002805e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:28.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.926+0000 7f002effd700 1 -- 172.21.15.33:0/1994939522 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0030075de0 con 0x7f00400f6530 2024-02-15T18:29:28.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.926+0000 7f003dd9b700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f002805c350 0x7f002805e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:28.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.926+0000 7f003dd9b700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f002805c350 0x7f002805e810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0034009720 tx=0x7f0034016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:28.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:28.933+0000 7f002effd700 1 -- 172.21.15.33:0/1994939522 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f00300489e0 con 0x7f00400f6530 2024-02-15T18:29:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.226+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00400fef10 con 0x7f002805c350 2024-02-15T18:29:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.227+0000 7f002effd700 1 -- 172.21.15.33:0/1994939522 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f00400fef10 con 0x7f002805c350 2024-02-15T18:29:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f002805c350 msgr2=0x7f002805e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f002805c350 0x7f002805e810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0034009720 tx=0x7f0034016040).stop 2024-02-15T18:29:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f6530 msgr2=0x7f004006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f6530 0x7f004006b9a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f003000e7c0 tx=0x7f003000b040).stop 2024-02-15T18:29:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 shutdown_connections 2024-02-15T18:29:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f002805c350 0x7f002805e810 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00400f6530 0x7f004006b9a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 --2- 172.21.15.33:0/1994939522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00400f77d0 0x7f0040069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 >> 172.21.15.33:0/1994939522 conn(0x7f00400f1c90 msgr2=0x7f00400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 shutdown_connections 2024-02-15T18:29:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.229+0000 7f003f59e700 1 -- 172.21.15.33:0/1994939522 wait complete. 2024-02-15T18:29:29.235 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:29:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.375+0000 7f762ed8d700 1 -- 172.21.15.33:0/513797133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76280f7980 msgr2=0x7f76280f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.375+0000 7f762ed8d700 1 --2- 172.21.15.33:0/513797133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76280f7980 0x7f76280f7de0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f7618004660 tx=0x7f7618009b30).stop 2024-02-15T18:29:29.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.376+0000 7f762ed8d700 1 -- 172.21.15.33:0/513797133 shutdown_connections 2024-02-15T18:29:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.376+0000 7f762ed8d700 1 --2- 172.21.15.33:0/513797133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76280f7980 0x7f76280f7de0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.376+0000 7f762ed8d700 1 --2- 172.21.15.33:0/513797133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76280f66e0 0x7f76280f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.376+0000 7f762ed8d700 1 -- 172.21.15.33:0/513797133 >> 172.21.15.33:0/513797133 conn(0x7f76280f1e40 msgr2=0x7f76280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.376+0000 7f762ed8d700 1 -- 172.21.15.33:0/513797133 shutdown_connections 2024-02-15T18:29:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.376+0000 7f762ed8d700 1 -- 172.21.15.33:0/513797133 wait complete. 2024-02-15T18:29:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.376+0000 7f762ed8d700 1 Processor -- start 2024-02-15T18:29:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.376+0000 7f762ed8d700 1 -- start start 2024-02-15T18:29:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f762ed8d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76280f66e0 0x7f762806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f762ed8d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76280f7980 0x7f7628069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f762ed8d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762806a380 con 0x7f76280f66e0 2024-02-15T18:29:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f762ed8d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762806a4c0 con 0x7f76280f7980 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f7627fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76280f7980 0x7f7628069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f7627fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76280f7980 0x7f7628069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.33:44986/0 (socket says 172.21.15.33:44986) 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f7627fff700 1 -- 172.21.15.33:0/3580491158 learned_addr learned my addr 172.21.15.33:0/3580491158 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f762cb29700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76280f66e0 0x7f762806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f7627fff700 1 -- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76280f66e0 msgr2=0x7f762806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f7627fff700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76280f66e0 0x7f762806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f7627fff700 1 -- 172.21.15.33:0/3580491158 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618005040 con 0x7f76280f7980 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.377+0000 7f7627fff700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76280f7980 0x7f7628069e20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7618000c00 tx=0x7f761800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.378+0000 7f76257fa700 1 -- 172.21.15.33:0/3580491158 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7618019070 con 0x7f76280f7980 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.378+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762806a740 con 0x7f76280f7980 2024-02-15T18:29:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.378+0000 7f76257fa700 1 -- 172.21.15.33:0/3580491158 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f7618007e80 con 0x7f76280f7980 2024-02-15T18:29:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.378+0000 7f76257fa700 1 -- 172.21.15.33:0/3580491158 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7618014db0 con 0x7f76280f7980 2024-02-15T18:29:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.378+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762806aca0 con 0x7f76280f7980 2024-02-15T18:29:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.379+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7628045ad0 con 0x7f76280f7980 2024-02-15T18:29:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.379+0000 7f76257fa700 1 -- 172.21.15.33:0/3580491158 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7618025070 con 0x7f76280f7980 2024-02-15T18:29:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.380+0000 7f76257fa700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f761005c250 0x7f761005e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.380+0000 7f76257fa700 1 -- 172.21.15.33:0/3580491158 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7618076e60 con 0x7f76280f7980 2024-02-15T18:29:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.380+0000 7f762cb29700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f761005c250 0x7f761005e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.381+0000 7f762cb29700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f761005c250 0x7f761005e710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f762806b730 tx=0x7f761c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:29.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.384+0000 7f76257fa700 1 -- 172.21.15.33:0/3580491158 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7618049a40 con 0x7f76280f7980 2024-02-15T18:29:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.715+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7628057f10 con 0x7f761005c250 2024-02-15T18:29:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.716+0000 7f76257fa700 1 -- 172.21.15.33:0/3580491158 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f7628057f10 con 0x7f761005c250 2024-02-15T18:29:29.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f761005c250 msgr2=0x7f761005e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f761005c250 0x7f761005e710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f762806b730 tx=0x7f761c00b040).stop 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76280f7980 msgr2=0x7f7628069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76280f7980 0x7f7628069e20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7618000c00 tx=0x7f761800b040).stop 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 shutdown_connections 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f761005c250 0x7f761005e710 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76280f66e0 0x7f762806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 --2- 172.21.15.33:0/3580491158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76280f7980 0x7f7628069e20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 >> 172.21.15.33:0/3580491158 conn(0x7f76280f1e40 msgr2=0x7f76280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 shutdown_connections 2024-02-15T18:29:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.718+0000 7f762ed8d700 1 -- 172.21.15.33:0/3580491158 wait complete. 2024-02-15T18:29:29.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:28.570738+0000 mgr.smithi033.apxevf (mgr.14162) 269 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-15T18:29:29.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:29.227743+0000 mgr.smithi033.apxevf (mgr.14162) 270 : audit [DBG] from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:29.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:28.570738+0000 mgr.smithi033.apxevf (mgr.14162) 269 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-15T18:29:29.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:29.227743+0000 mgr.smithi033.apxevf (mgr.14162) 270 : audit [DBG] from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:29.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.858+0000 7f5245ddd700 1 -- 172.21.15.33:0/4239217658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5240060290 msgr2=0x7f52400f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:29.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.858+0000 7f5245ddd700 1 --2- 172.21.15.33:0/4239217658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5240060290 0x7f52400f9190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5234004620 tx=0x7f5234009b30).stop 2024-02-15T18:29:29.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.858+0000 7f5245ddd700 1 -- 172.21.15.33:0/4239217658 shutdown_connections 2024-02-15T18:29:29.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.858+0000 7f5245ddd700 1 --2- 172.21.15.33:0/4239217658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52400f9710 0x7f52400fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.858+0000 7f5245ddd700 1 --2- 172.21.15.33:0/4239217658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5240060290 0x7f52400f9190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.858+0000 7f5245ddd700 1 -- 172.21.15.33:0/4239217658 >> 172.21.15.33:0/4239217658 conn(0x7f52400f0b90 msgr2=0x7f52400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:29.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.858+0000 7f5245ddd700 1 -- 172.21.15.33:0/4239217658 shutdown_connections 2024-02-15T18:29:29.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.858+0000 7f5245ddd700 1 -- 172.21.15.33:0/4239217658 wait complete. 2024-02-15T18:29:29.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.859+0000 7f5245ddd700 1 Processor -- start 2024-02-15T18:29:29.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.859+0000 7f5245ddd700 1 -- start start 2024-02-15T18:29:29.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5245ddd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5240060290 0x7f5240068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:29.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5245ddd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52400f9710 0x7f52400690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:29.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5245ddd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400696f0 con 0x7f5240060290 2024-02-15T18:29:29.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5245ddd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524011f750 con 0x7f52400f9710 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5244ddb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5240060290 0x7f5240068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5244ddb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5240060290 0x7f5240068c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41196/0 (socket says 172.21.15.33:41196) 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5244ddb700 1 -- 172.21.15.33:0/2707333314 learned_addr learned my addr 172.21.15.33:0/2707333314 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f523ffff700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52400f9710 0x7f52400690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5244ddb700 1 -- 172.21.15.33:0/2707333314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52400f9710 msgr2=0x7f52400690f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5244ddb700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52400f9710 0x7f52400690f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5244ddb700 1 -- 172.21.15.33:0/2707333314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234005040 con 0x7f5240060290 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.860+0000 7f5244ddb700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5240060290 0x7f5240068c00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f523400f840 tx=0x7f523400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.861+0000 7f523d7fa700 1 -- 172.21.15.33:0/2707333314 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523400e040 con 0x7f5240060290 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.861+0000 7f523d7fa700 1 -- 172.21.15.33:0/2707333314 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f5234008c30 con 0x7f5240060290 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.861+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524011f9a0 con 0x7f5240060290 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.861+0000 7f523d7fa700 1 -- 172.21.15.33:0/2707333314 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5234017390 con 0x7f5240060290 2024-02-15T18:29:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.861+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524011ff00 con 0x7f5240060290 2024-02-15T18:29:29.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.862+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5240059100 con 0x7f5240060290 2024-02-15T18:29:29.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.863+0000 7f523d7fa700 1 -- 172.21.15.33:0/2707333314 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5234008da0 con 0x7f5240060290 2024-02-15T18:29:29.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.863+0000 7f523d7fa700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f522405c250 0x7f522405e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:29.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.863+0000 7f523ffff700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f522405c250 0x7f522405e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:29.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.864+0000 7f523ffff700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f522405c250 0x7f522405e710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f5240069a40 tx=0x7f522c00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:29.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.865+0000 7f523d7fa700 1 -- 172.21.15.33:0/2707333314 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f523401f310 con 0x7f5240060290 2024-02-15T18:29:29.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:29.868+0000 7f523d7fa700 1 -- 172.21.15.33:0/2707333314 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f523407c060 con 0x7f5240060290 2024-02-15T18:29:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.187+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f52401200c0 con 0x7f522405c250 2024-02-15T18:29:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.200+0000 7f523d7fa700 1 -- 172.21.15.33:0/2707333314 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7f52401200c0 con 0x7f522405c250 2024-02-15T18:29:30.194 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2024-02-15T18:29:30.194 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (4m) 22s ago 6m 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:29:30.194 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (6m) 22s ago 6m 16.2.4 8d91d370c2b8 6deae8bbd6c5 2024-02-15T18:29:30.194 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (5m) 28s ago 5m 16.2.4 8d91d370c2b8 e45b11308af7 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (4m) 22s ago 5m 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (40s) 22s ago 39s 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (48s) 22s ago 46s 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (44s) 28s ago 44s 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (51s) 28s ago 51s 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:9283 running (7m) 22s ago 7m 16.2.4 8d91d370c2b8 c319170b238f 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (5m) 28s ago 5m 16.2.4 8d91d370c2b8 636ca5f9c9dd 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (7m) 22s ago 7m 16.2.4 8d91d370c2b8 04c43c0cba21 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (5m) 28s ago 5m 16.2.4 8d91d370c2b8 710ae4544ec3 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (5m) 22s ago 5m 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (4m) 28s ago 4m 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (4m) 22s ago 4m 16.2.4 8d91d370c2b8 8fd8ca242c54 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (3m) 22s ago 3m 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (3m) 22s ago 3m 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (3m) 28s ago 3m 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (2m) 28s ago 2m 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:29:30.195 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (2m) 28s ago 2m 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:29:30.196 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (4m) 22s ago 5m 2.18.1 de242295e225 0b5ba62c4d4c 2024-02-15T18:29:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f522405c250 msgr2=0x7f522405e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f522405c250 0x7f522405e710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f5240069a40 tx=0x7f522c00b040).stop 2024-02-15T18:29:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5240060290 msgr2=0x7f5240068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5240060290 0x7f5240068c00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f523400f840 tx=0x7f523400b040).stop 2024-02-15T18:29:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 shutdown_connections 2024-02-15T18:29:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f522405c250 0x7f522405e710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5240060290 0x7f5240068c00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 --2- 172.21.15.33:0/2707333314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52400f9710 0x7f52400690f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 >> 172.21.15.33:0/2707333314 conn(0x7f52400f0b90 msgr2=0x7f52400f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 shutdown_connections 2024-02-15T18:29:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.202+0000 7f5245ddd700 1 -- 172.21.15.33:0/2707333314 wait complete. 2024-02-15T18:29:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.341+0000 7f1854efd700 1 -- 172.21.15.33:0/585582578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18500f6530 msgr2=0x7f18500f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.341+0000 7f1854efd700 1 --2- 172.21.15.33:0/585582578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18500f6530 0x7f18500f6950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f1840004660 tx=0x7f1840009b30).stop 2024-02-15T18:29:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.341+0000 7f1854efd700 1 -- 172.21.15.33:0/585582578 shutdown_connections 2024-02-15T18:29:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.341+0000 7f1854efd700 1 --2- 172.21.15.33:0/585582578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18500f77d0 0x7f18500f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.341+0000 7f1854efd700 1 --2- 172.21.15.33:0/585582578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18500f6530 0x7f18500f6950 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.341+0000 7f1854efd700 1 -- 172.21.15.33:0/585582578 >> 172.21.15.33:0/585582578 conn(0x7f18500f1c90 msgr2=0x7f18500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.341+0000 7f1854efd700 1 -- 172.21.15.33:0/585582578 shutdown_connections 2024-02-15T18:29:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.341+0000 7f1854efd700 1 -- 172.21.15.33:0/585582578 wait complete. 2024-02-15T18:29:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.342+0000 7f1854efd700 1 Processor -- start 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.342+0000 7f1854efd700 1 -- start start 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.342+0000 7f1854efd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18500f6530 0x7f1850109050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.342+0000 7f1854efd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18500f77d0 0x7f1850109540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.342+0000 7f1854efd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1850109af0 con 0x7f18500f6530 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.342+0000 7f1854efd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1850109c30 con 0x7f18500f77d0 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f184effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18500f77d0 0x7f1850109540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f184f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18500f6530 0x7f1850109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f184effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18500f77d0 0x7f1850109540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.33:45028/0 (socket says 172.21.15.33:45028) 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f184effd700 1 -- 172.21.15.33:0/2025106435 learned_addr learned my addr 172.21.15.33:0/2025106435 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f184effd700 1 -- 172.21.15.33:0/2025106435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18500f6530 msgr2=0x7f1850109050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f184effd700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18500f6530 0x7f1850109050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f184effd700 1 -- 172.21.15.33:0/2025106435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1840005040 con 0x7f18500f77d0 2024-02-15T18:29:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f184effd700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18500f77d0 0x7f1850109540 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f184400e7f0 tx=0x7f184400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f1837fff700 1 -- 172.21.15.33:0/2025106435 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18440092e0 con 0x7f18500f77d0 2024-02-15T18:29:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185010a5d0 con 0x7f18500f77d0 2024-02-15T18:29:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f1837fff700 1 -- 172.21.15.33:0/2025106435 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f184400f040 con 0x7f18500f77d0 2024-02-15T18:29:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f1837fff700 1 -- 172.21.15.33:0/2025106435 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1844014850 con 0x7f18500f77d0 2024-02-15T18:29:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.343+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185010ab90 con 0x7f18500f77d0 2024-02-15T18:29:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.345+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1850045ad0 con 0x7f18500f77d0 2024-02-15T18:29:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.345+0000 7f1837fff700 1 -- 172.21.15.33:0/2025106435 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f184401b030 con 0x7f18500f77d0 2024-02-15T18:29:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.345+0000 7f1837fff700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f183805c300 0x7f183805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.345+0000 7f1837fff700 1 -- 172.21.15.33:0/2025106435 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1844075c10 con 0x7f18500f77d0 2024-02-15T18:29:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.345+0000 7f184f7fe700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f183805c300 0x7f183805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.346+0000 7f184f7fe700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f183805c300 0x7f183805e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f1840009720 tx=0x7f1840016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:30.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.349+0000 7f1837fff700 1 -- 172.21.15.33:0/2025106435 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1844048980 con 0x7f18500f77d0 2024-02-15T18:29:30.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.710+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1850027a00 con 0x7f18500f77d0 2024-02-15T18:29:30.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.711+0000 7f1837fff700 1 -- 172.21.15.33:0/2025106435 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7f1844019070 con 0x7f18500f77d0 2024-02-15T18:29:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:29:30.705 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:29:30.705 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:29:30.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:29:30.705 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:29:30.705 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:29:30.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:29:30.706 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:29:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f183805c300 msgr2=0x7f183805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f183805c300 0x7f183805e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f1840009720 tx=0x7f1840016040).stop 2024-02-15T18:29:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18500f77d0 msgr2=0x7f1850109540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18500f77d0 0x7f1850109540 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f184400e7f0 tx=0x7f184400b040).stop 2024-02-15T18:29:30.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 shutdown_connections 2024-02-15T18:29:30.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f183805c300 0x7f183805e7c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18500f6530 0x7f1850109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 --2- 172.21.15.33:0/2025106435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18500f77d0 0x7f1850109540 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 >> 172.21.15.33:0/2025106435 conn(0x7f18500f1c90 msgr2=0x7f185006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:30.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 shutdown_connections 2024-02-15T18:29:30.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.713+0000 7f1854efd700 1 -- 172.21.15.33:0/2025106435 wait complete. 2024-02-15T18:29:30.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:29.717190+0000 mgr.smithi033.apxevf (mgr.14162) 271 : audit [DBG] from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:30.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:30.188600+0000 mgr.smithi033.apxevf (mgr.14162) 272 : audit [DBG] from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:30.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:29.717190+0000 mgr.smithi033.apxevf (mgr.14162) 271 : audit [DBG] from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:30.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:30.188600+0000 mgr.smithi033.apxevf (mgr.14162) 272 : audit [DBG] from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:30.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.848+0000 7fa516887700 1 -- 172.21.15.33:0/566591878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f6880 msgr2=0x7fa5100f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:30.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.848+0000 7fa516887700 1 --2- 172.21.15.33:0/566591878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f6880 0x7fa5100f6ce0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fa504004660 tx=0x7fa504009b30).stop 2024-02-15T18:29:30.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.849+0000 7fa516887700 1 -- 172.21.15.33:0/566591878 shutdown_connections 2024-02-15T18:29:30.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.849+0000 7fa516887700 1 --2- 172.21.15.33:0/566591878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f6880 0x7fa5100f6ce0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.849+0000 7fa516887700 1 --2- 172.21.15.33:0/566591878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5100f55e0 0x7fa5100f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.849+0000 7fa516887700 1 -- 172.21.15.33:0/566591878 >> 172.21.15.33:0/566591878 conn(0x7fa5100f0d40 msgr2=0x7fa5100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:30.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.849+0000 7fa516887700 1 -- 172.21.15.33:0/566591878 shutdown_connections 2024-02-15T18:29:30.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.849+0000 7fa516887700 1 -- 172.21.15.33:0/566591878 wait complete. 2024-02-15T18:29:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.849+0000 7fa516887700 1 Processor -- start 2024-02-15T18:29:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa516887700 1 -- start start 2024-02-15T18:29:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa516887700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f55e0 0x7fa5100f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa516887700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5100f6880 0x7fa5100f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa516887700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100f8120 con 0x7fa5100f55e0 2024-02-15T18:29:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa516887700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100f8260 con 0x7fa5100f6880 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa50ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f55e0 0x7fa5100f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa50ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f55e0 0x7fa5100f9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41232/0 (socket says 172.21.15.33:41232) 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa50ffff700 1 -- 172.21.15.33:0/2186285071 learned_addr learned my addr 172.21.15.33:0/2186285071 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa50f7fe700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5100f6880 0x7fa5100f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa50ffff700 1 -- 172.21.15.33:0/2186285071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5100f6880 msgr2=0x7fa5100f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa50ffff700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5100f6880 0x7fa5100f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa50ffff700 1 -- 172.21.15.33:0/2186285071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504005040 con 0x7fa5100f55e0 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.850+0000 7fa50f7fe700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5100f6880 0x7fa5100f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.851+0000 7fa50ffff700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f55e0 0x7fa5100f9740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fa50000e7c0 tx=0x7fa50000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.851+0000 7fa50cff9700 1 -- 172.21.15.33:0/2186285071 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5000092e0 con 0x7fa5100f55e0 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.851+0000 7fa50cff9700 1 -- 172.21.15.33:0/2186285071 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa50000f040 con 0x7fa5100f55e0 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.851+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5100f8540 con 0x7fa5100f55e0 2024-02-15T18:29:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.851+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51010efe0 con 0x7fa5100f55e0 2024-02-15T18:29:30.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.851+0000 7fa50cff9700 1 -- 172.21.15.33:0/2186285071 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa500014920 con 0x7fa5100f55e0 2024-02-15T18:29:30.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.852+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f0004fa0 con 0x7fa5100f55e0 2024-02-15T18:29:30.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.853+0000 7fa50cff9700 1 -- 172.21.15.33:0/2186285071 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa50001b030 con 0x7fa5100f55e0 2024-02-15T18:29:30.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.853+0000 7fa50cff9700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa4f805c2b0 0x7fa4f805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:30.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.853+0000 7fa50cff9700 1 -- 172.21.15.33:0/2186285071 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa500075d10 con 0x7fa5100f55e0 2024-02-15T18:29:30.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.854+0000 7fa50f7fe700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa4f805c2b0 0x7fa4f805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:30.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.854+0000 7fa50f7fe700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa4f805c2b0 0x7fa4f805e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa504005010 tx=0x7fa504016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:30.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:30.857+0000 7fa50cff9700 1 -- 172.21.15.33:0/2186285071 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa5000489d0 con 0x7fa5100f55e0 2024-02-15T18:29:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.137+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4f0005e80 con 0x7fa5100f55e0 2024-02-15T18:29:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.137+0000 7fa50cff9700 1 -- 172.21.15.33:0/2186285071 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1673 (secure 0 0 0) 0x7fa500019070 con 0x7fa5100f55e0 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:e17 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 12 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:28:52.769887+0000 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:29:31.132 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:29:31.133 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707]] 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411]] 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613]] 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278]] 2024-02-15T18:29:31.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.139+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa4f805c2b0 msgr2=0x7fa4f805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:31.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.139+0000 7fa516887700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa4f805c2b0 0x7fa4f805e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa504005010 tx=0x7fa504016040).stop 2024-02-15T18:29:31.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.139+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f55e0 msgr2=0x7fa5100f9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:31.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.139+0000 7fa516887700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f55e0 0x7fa5100f9740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fa50000e7c0 tx=0x7fa50000b040).stop 2024-02-15T18:29:31.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.142+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 shutdown_connections 2024-02-15T18:29:31.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.142+0000 7fa516887700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fa4f805c2b0 0x7fa4f805e770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:31.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.142+0000 7fa516887700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5100f55e0 0x7fa5100f9740 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:31.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.142+0000 7fa516887700 1 --2- 172.21.15.33:0/2186285071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5100f6880 0x7fa5100f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:31.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.142+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 >> 172.21.15.33:0/2186285071 conn(0x7fa5100f0d40 msgr2=0x7fa51005ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:31.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.142+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 shutdown_connections 2024-02-15T18:29:31.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.142+0000 7fa516887700 1 -- 172.21.15.33:0/2186285071 wait complete. 2024-02-15T18:29:31.137 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 17 2024-02-15T18:29:31.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.275+0000 7f55e4f24700 1 -- 172.21.15.33:0/692303793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e00f9690 msgr2=0x7f55e00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:31.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.275+0000 7f55e4f24700 1 --2- 172.21.15.33:0/692303793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e00f9690 0x7f55e00fbae0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f55c8004660 tx=0x7f55c8009b30).stop 2024-02-15T18:29:31.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.275+0000 7f55e4f24700 1 -- 172.21.15.33:0/692303793 shutdown_connections 2024-02-15T18:29:31.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.275+0000 7f55e4f24700 1 --2- 172.21.15.33:0/692303793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e00f9690 0x7f55e00fbae0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:31.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.275+0000 7f55e4f24700 1 --2- 172.21.15.33:0/692303793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55e0060310 0x7f55e00f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:31.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.275+0000 7f55e4f24700 1 -- 172.21.15.33:0/692303793 >> 172.21.15.33:0/692303793 conn(0x7f55e00f0b90 msgr2=0x7f55e00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:31.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.275+0000 7f55e4f24700 1 -- 172.21.15.33:0/692303793 shutdown_connections 2024-02-15T18:29:31.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.275+0000 7f55e4f24700 1 -- 172.21.15.33:0/692303793 wait complete. 2024-02-15T18:29:31.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.276+0000 7f55e4f24700 1 Processor -- start 2024-02-15T18:29:31.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.276+0000 7f55e4f24700 1 -- start start 2024-02-15T18:29:31.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.276+0000 7f55e4f24700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e0060310 0x7f55e0106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:31.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.276+0000 7f55e4f24700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55e00f9690 0x7f55e0107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:31.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.276+0000 7f55e4f24700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0107900 con 0x7f55e0060310 2024-02-15T18:29:31.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.276+0000 7f55e4f24700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0108110 con 0x7f55e00f9690 2024-02-15T18:29:31.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55df7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e0060310 0x7f55e0106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55deffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55e00f9690 0x7f55e0107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55df7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e0060310 0x7f55e0106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41246/0 (socket says 172.21.15.33:41246) 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55deffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55e00f9690 0x7f55e0107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.33:45060/0 (socket says 172.21.15.33:45060) 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55df7fe700 1 -- 172.21.15.33:0/1973331066 learned_addr learned my addr 172.21.15.33:0/1973331066 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55df7fe700 1 -- 172.21.15.33:0/1973331066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55e00f9690 msgr2=0x7f55e0107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55df7fe700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55e00f9690 0x7f55e0107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55df7fe700 1 -- 172.21.15.33:0/1973331066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8005040 con 0x7f55e0060310 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55df7fe700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e0060310 0x7f55e0106e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f55d000e7f0 tx=0x7f55d000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55d7fff700 1 -- 172.21.15.33:0/1973331066 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55d00092e0 con 0x7f55e0060310 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e0108330 con 0x7f55e0060310 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e0108840 con 0x7f55e0060310 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55d7fff700 1 -- 172.21.15.33:0/1973331066 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f55d000f040 con 0x7f55e0060310 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.277+0000 7f55d7fff700 1 -- 172.21.15.33:0/1973331066 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55d0014850 con 0x7f55e0060310 2024-02-15T18:29:31.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.279+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e0045ad0 con 0x7f55e0060310 2024-02-15T18:29:31.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.279+0000 7f55d7fff700 1 -- 172.21.15.33:0/1973331066 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f55d001b030 con 0x7f55e0060310 2024-02-15T18:29:31.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.279+0000 7f55d7fff700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f55cc05c350 0x7f55cc05e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:29:31.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.279+0000 7f55d7fff700 1 -- 172.21.15.33:0/1973331066 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f55d0075be0 con 0x7f55e0060310 2024-02-15T18:29:31.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.279+0000 7f55deffd700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f55cc05c350 0x7f55cc05e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:29:31.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.280+0000 7f55deffd700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f55cc05c350 0x7f55cc05e810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f55c8009720 tx=0x7f55c801a040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:29:31.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.285+0000 7f55d7fff700 1 -- 172.21.15.33:0/1973331066 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f55d0048890 con 0x7f55e0060310 2024-02-15T18:29:31.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.583+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55e00feff0 con 0x7f55cc05c350 2024-02-15T18:29:31.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.584+0000 7f55d7fff700 1 -- 172.21.15.33:0/1973331066 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7f55c800f070 con 0x7f55cc05c350 2024-02-15T18:29:31.579 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:29:31.579 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1", 2024-02-15T18:29:31.579 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:29:31.579 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T18:29:31.579 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "", 2024-02-15T18:29:31.579 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 image" 2024-02-15T18:29:31.579 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:29:31.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.587+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f55cc05c350 msgr2=0x7f55cc05e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:31.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.587+0000 7f55e4f24700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f55cc05c350 0x7f55cc05e810 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f55c8009720 tx=0x7f55c801a040).stop 2024-02-15T18:29:31.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.587+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e0060310 msgr2=0x7f55e0106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:29:31.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.587+0000 7f55e4f24700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e0060310 0x7f55e0106e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f55d000e7f0 tx=0x7f55d000b040).stop 2024-02-15T18:29:31.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.588+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 shutdown_connections 2024-02-15T18:29:31.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.588+0000 7f55e4f24700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f55cc05c350 0x7f55cc05e810 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:31.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.588+0000 7f55e4f24700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55e0060310 0x7f55e0106e10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:31.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.588+0000 7f55e4f24700 1 --2- 172.21.15.33:0/1973331066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55e00f9690 0x7f55e0107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:29:31.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.588+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 >> 172.21.15.33:0/1973331066 conn(0x7f55e00f0b90 msgr2=0x7f55e00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:29:31.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.590+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 shutdown_connections 2024-02-15T18:29:31.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:29:31.590+0000 7f55e4f24700 1 -- 172.21.15.33:0/1973331066 wait complete. 2024-02-15T18:29:31.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:30.571237+0000 mgr.smithi033.apxevf (mgr.14162) 273 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-15T18:29:31.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:30.711638+0000 mon.smithi131 (mon.1) 16 : audit [DBG] from='client.? 172.21.15.33:0/2025106435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:31.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:31.137918+0000 mon.smithi033 (mon.0) 565 : audit [DBG] from='client.? 172.21.15.33:0/2186285071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:29:31.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:30.571237+0000 mgr.smithi033.apxevf (mgr.14162) 273 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-15T18:29:31.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:30.711638+0000 mon.smithi131 (mon.1) 16 : audit [DBG] from='client.? 172.21.15.33:0/2025106435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:29:31.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:31.137918+0000 mon.smithi033 (mon.0) 565 : audit [DBG] from='client.? 172.21.15.33:0/2186285071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:29:32.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:31.585045+0000 mgr.smithi033.apxevf (mgr.14162) 274 : audit [DBG] from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:32.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:31.585045+0000 mgr.smithi033.apxevf (mgr.14162) 274 : audit [DBG] from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:29:33.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:32.571694+0000 mgr.smithi033.apxevf (mgr.14162) 275 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-15T18:29:33.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:32.571694+0000 mgr.smithi033.apxevf (mgr.14162) 275 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-15T18:29:35.916 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:34.572136+0000 mgr.smithi033.apxevf (mgr.14162) 276 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:36.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:34.572136+0000 mgr.smithi033.apxevf (mgr.14162) 276 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:38.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:36.572509+0000 mgr.smithi033.apxevf (mgr.14162) 277 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:38.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:36.572509+0000 mgr.smithi033.apxevf (mgr.14162) 277 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:39.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:38.572835+0000 mgr.smithi033.apxevf (mgr.14162) 278 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:39.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:38.572835+0000 mgr.smithi033.apxevf (mgr.14162) 278 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:42.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:40.573250+0000 mgr.smithi033.apxevf (mgr.14162) 279 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:42.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:40.573250+0000 mgr.smithi033.apxevf (mgr.14162) 279 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:44.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:42.573616+0000 mgr.smithi033.apxevf (mgr.14162) 280 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:44.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:42.573616+0000 mgr.smithi033.apxevf (mgr.14162) 280 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:45.916 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:44.574051+0000 mgr.smithi033.apxevf (mgr.14162) 281 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:45.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:44.574051+0000 mgr.smithi033.apxevf (mgr.14162) 281 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:47.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:46.574429+0000 mgr.smithi033.apxevf (mgr.14162) 282 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:48.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:46.574429+0000 mgr.smithi033.apxevf (mgr.14162) 282 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:49.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:48.574745+0000 mgr.smithi033.apxevf (mgr.14162) 283 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:49.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:48.574745+0000 mgr.smithi033.apxevf (mgr.14162) 283 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 9.3 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:29:51.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:50.575106+0000 mgr.smithi033.apxevf (mgr.14162) 284 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-15T18:29:52.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:50.575106+0000 mgr.smithi033.apxevf (mgr.14162) 284 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-15T18:29:53.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:52.575491+0000 mgr.smithi033.apxevf (mgr.14162) 285 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:29:54.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:52.575491+0000 mgr.smithi033.apxevf (mgr.14162) 285 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 11 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:29:55.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:54.575957+0000 mgr.smithi033.apxevf (mgr.14162) 286 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-15T18:29:55.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:54.678818+0000 mon.smithi033 (mon.0) 566 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:29:55.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:54.679085+0000 mon.smithi033 (mon.0) 567 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:29:55.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:54.575957+0000 mgr.smithi033.apxevf (mgr.14162) 286 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-15T18:29:56.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:54.678818+0000 mon.smithi033 (mon.0) 566 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:29:56.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:54.679085+0000 mon.smithi033 (mon.0) 567 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:29:57.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:55.811252+0000 mon.smithi033 (mon.0) 568 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:57.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:29:55.811699+0000 mgr.smithi033.apxevf (mgr.14162) 287 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-15T18:29:57.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:29:55.811784+0000 mgr.smithi033.apxevf (mgr.14162) 288 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-15T18:29:57.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:29:55.812935+0000 mon.smithi033 (mon.0) 569 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:57.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:29:55.814231+0000 mgr.smithi033.apxevf (mgr.14162) 289 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi033.apxevf) 2024-02-15T18:29:57.250 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:29:56.053955+0000 mgr.smithi033.apxevf (mgr.14162) 290 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc on smithi131 2024-02-15T18:29:57.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:55.811252+0000 mon.smithi033 (mon.0) 568 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:29:57.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:29:55.811699+0000 mgr.smithi033.apxevf (mgr.14162) 287 : cephadm [INF] Upgrade: Target is version 16.2.14-521-g0e714d9a (pacific) 2024-02-15T18:29:57.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:29:55.811784+0000 mgr.smithi033.apxevf (mgr.14162) 288 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc'] 2024-02-15T18:29:57.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:29:55.812935+0000 mon.smithi033 (mon.0) 569 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:29:57.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:29:55.814231+0000 mgr.smithi033.apxevf (mgr.14162) 289 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi033.apxevf) 2024-02-15T18:29:57.300 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:29:56.053955+0000 mgr.smithi033.apxevf (mgr.14162) 290 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc on smithi131 2024-02-15T18:29:58.229 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:56.576433+0000 mgr.smithi033.apxevf (mgr.14162) 291 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:29:58.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:56.576433+0000 mgr.smithi033.apxevf (mgr.14162) 291 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:29:59.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:29:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:29:58.576764+0000 mgr.smithi033.apxevf (mgr.14162) 292 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:29:59.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:29:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:29:58.576764+0000 mgr.smithi033.apxevf (mgr.14162) 292 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:30:00.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:00.000113+0000 mon.smithi033 (mon.0) 570 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-15T18:30:00.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:00.000148+0000 mon.smithi033 (mon.0) 571 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-15T18:30:00.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:00.000167+0000 mon.smithi033 (mon.0) 572 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2024-02-15T18:30:00.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:00.000113+0000 mon.smithi033 (mon.0) 570 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-15T18:30:00.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:00.000148+0000 mon.smithi033 (mon.0) 571 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-15T18:30:00.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:00.000167+0000 mon.smithi033 (mon.0) 572 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2024-02-15T18:30:01.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.744+0000 7fcc904da700 1 -- 172.21.15.33:0/1016528065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc88060250 msgr2=0x7fcc880f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:01.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.744+0000 7fcc904da700 1 --2- 172.21.15.33:0/1016528065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc88060250 0x7fcc880f9360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fcc84004660 tx=0x7fcc84009b30).stop 2024-02-15T18:30:01.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.744+0000 7fcc904da700 1 -- 172.21.15.33:0/1016528065 shutdown_connections 2024-02-15T18:30:01.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.744+0000 7fcc904da700 1 --2- 172.21.15.33:0/1016528065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc880f9850 0x7fcc880fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:01.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.744+0000 7fcc904da700 1 --2- 172.21.15.33:0/1016528065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc88060250 0x7fcc880f9360 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:01.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.744+0000 7fcc904da700 1 -- 172.21.15.33:0/1016528065 >> 172.21.15.33:0/1016528065 conn(0x7fcc880f0d40 msgr2=0x7fcc880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:01.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.744+0000 7fcc904da700 1 -- 172.21.15.33:0/1016528065 shutdown_connections 2024-02-15T18:30:01.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.744+0000 7fcc904da700 1 -- 172.21.15.33:0/1016528065 wait complete. 2024-02-15T18:30:01.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.745+0000 7fcc904da700 1 Processor -- start 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.745+0000 7fcc904da700 1 -- start start 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.745+0000 7fcc904da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88060250 0x7fcc880f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.745+0000 7fcc904da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc880f9850 0x7fcc880f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.745+0000 7fcc904da700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8810ac70 con 0x7fcc880f9850 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.745+0000 7fcc904da700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8810adb0 con 0x7fcc88060250 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.745+0000 7fcc8e276700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88060250 0x7fcc880f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.745+0000 7fcc8e276700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88060250 0x7fcc880f6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.33:40000/0 (socket says 172.21.15.33:40000) 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.745+0000 7fcc8e276700 1 -- 172.21.15.33:0/3212945143 learned_addr learned my addr 172.21.15.33:0/3212945143 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc8da75700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc880f9850 0x7fcc880f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc8e276700 1 -- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc880f9850 msgr2=0x7fcc880f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc8e276700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc880f9850 0x7fcc880f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc8e276700 1 -- 172.21.15.33:0/3212945143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc84005040 con 0x7fcc88060250 2024-02-15T18:30:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc8da75700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc880f9850 0x7fcc880f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:30:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc8e276700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88060250 0x7fcc880f6de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcc84000c00 tx=0x7fcc8400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc7effd700 1 -- 172.21.15.33:0/3212945143 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc84019070 con 0x7fcc88060250 2024-02-15T18:30:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc7effd700 1 -- 172.21.15.33:0/3212945143 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fcc84014420 con 0x7fcc88060250 2024-02-15T18:30:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc7effd700 1 -- 172.21.15.33:0/3212945143 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc8401d600 con 0x7fcc88060250 2024-02-15T18:30:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.746+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8810b030 con 0x7fcc88060250 2024-02-15T18:30:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.747+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8810b590 con 0x7fcc88060250 2024-02-15T18:30:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.748+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc88045ad0 con 0x7fcc88060250 2024-02-15T18:30:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.748+0000 7fcc7effd700 1 -- 172.21.15.33:0/3212945143 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fcc84025070 con 0x7fcc88060250 2024-02-15T18:30:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.749+0000 7fcc7effd700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcc7405c2b0 0x7fcc7405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.749+0000 7fcc7effd700 1 -- 172.21.15.33:0/3212945143 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fcc84076ea0 con 0x7fcc88060250 2024-02-15T18:30:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.749+0000 7fcc8da75700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcc7405c2b0 0x7fcc7405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.749+0000 7fcc8da75700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcc7405c2b0 0x7fcc7405e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fcc88060020 tx=0x7fcc7800b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:01.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:01.753+0000 7fcc7effd700 1 -- 172.21.15.33:0/3212945143 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcc84049ac0 con 0x7fcc88060250 2024-02-15T18:30:01.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:00.577221+0000 mgr.smithi033.apxevf (mgr.14162) 293 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:30:01.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:00.577221+0000 mgr.smithi033.apxevf (mgr.14162) 293 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-15T18:30:02.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.087+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc880f6120 con 0x7fcc7405c2b0 2024-02-15T18:30:02.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.088+0000 7fcc7effd700 1 -- 172.21.15.33:0/3212945143 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7fcc880f6120 con 0x7fcc7405c2b0 2024-02-15T18:30:02.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.089+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcc7405c2b0 msgr2=0x7fcc7405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.089+0000 7fcc904da700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcc7405c2b0 0x7fcc7405e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fcc88060020 tx=0x7fcc7800b040).stop 2024-02-15T18:30:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.089+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88060250 msgr2=0x7fcc880f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.089+0000 7fcc904da700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88060250 0x7fcc880f6de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcc84000c00 tx=0x7fcc8400b040).stop 2024-02-15T18:30:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.090+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 shutdown_connections 2024-02-15T18:30:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.090+0000 7fcc904da700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcc7405c2b0 0x7fcc7405e770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.090+0000 7fcc904da700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88060250 0x7fcc880f6de0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.090+0000 7fcc904da700 1 --2- 172.21.15.33:0/3212945143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc880f9850 0x7fcc880f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.090+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 >> 172.21.15.33:0/3212945143 conn(0x7fcc880f0d40 msgr2=0x7fcc880f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.090+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 shutdown_connections 2024-02-15T18:30:02.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.090+0000 7fcc904da700 1 -- 172.21.15.33:0/3212945143 wait complete. 2024-02-15T18:30:02.094 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:30:02.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.197+0000 7fafb1476700 1 -- 172.21.15.33:0/2575592182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 msgr2=0x7fafac0f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.197+0000 7fafb1476700 1 --2- 172.21.15.33:0/2575592182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 0x7fafac0f62d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7faf94004770 tx=0x7faf9400ac40).stop 2024-02-15T18:30:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.197+0000 7fafb1476700 1 -- 172.21.15.33:0/2575592182 shutdown_connections 2024-02-15T18:30:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.197+0000 7fafb1476700 1 --2- 172.21.15.33:0/2575592182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 0x7fafac0f62d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.197+0000 7fafb1476700 1 --2- 172.21.15.33:0/2575592182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafac0f4bd0 0x7fafac0f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.197+0000 7fafb1476700 1 -- 172.21.15.33:0/2575592182 >> 172.21.15.33:0/2575592182 conn(0x7fafac0f0330 msgr2=0x7fafac0f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.197+0000 7fafb1476700 1 -- 172.21.15.33:0/2575592182 shutdown_connections 2024-02-15T18:30:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.197+0000 7fafb1476700 1 -- 172.21.15.33:0/2575592182 wait complete. 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafb1476700 1 Processor -- start 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafb1476700 1 -- start start 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafb1476700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafac0f4bd0 0x7fafac104ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafb1476700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 0x7fafac104fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafb1476700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1055d0 con 0x7fafac0f5e70 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafb1476700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac105710 con 0x7fafac0f4bd0 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 0x7fafac104fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafaaffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafac0f4bd0 0x7fafac104ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 0x7fafac104fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37288/0 (socket says 172.21.15.33:37288) 2024-02-15T18:30:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafa3fff700 1 -- 172.21.15.33:0/454107141 learned_addr learned my addr 172.21.15.33:0/454107141 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:02.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.198+0000 7fafaaffd700 1 -- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 msgr2=0x7fafac104fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.199+0000 7fafaaffd700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 0x7fafac104fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.199+0000 7fafaaffd700 1 -- 172.21.15.33:0/454107141 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94005040 con 0x7fafac0f4bd0 2024-02-15T18:30:02.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.199+0000 7fafa3fff700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 0x7fafac104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:30:02.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.199+0000 7fafaaffd700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafac0f4bd0 0x7fafac104ae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fafac0f5cd0 tx=0x7faf9c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:02.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.199+0000 7fafa37fe700 1 -- 172.21.15.33:0/454107141 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf9c0092e0 con 0x7fafac0f4bd0 2024-02-15T18:30:02.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.199+0000 7fafa37fe700 1 -- 172.21.15.33:0/454107141 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7faf9c00f040 con 0x7fafac0f4bd0 2024-02-15T18:30:02.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.199+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac10a3a0 con 0x7fafac0f4bd0 2024-02-15T18:30:02.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.199+0000 7fafa37fe700 1 -- 172.21.15.33:0/454107141 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf9c014900 con 0x7fafac0f4bd0 2024-02-15T18:30:02.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.199+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac10a910 con 0x7fafac0f4bd0 2024-02-15T18:30:02.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.200+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac059100 con 0x7fafac0f4bd0 2024-02-15T18:30:02.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.202+0000 7fafa37fe700 1 -- 172.21.15.33:0/454107141 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7faf9c014a60 con 0x7fafac0f4bd0 2024-02-15T18:30:02.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.203+0000 7fafa37fe700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7faf9805c300 0x7faf9805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:02.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.203+0000 7fafa37fe700 1 -- 172.21.15.33:0/454107141 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7faf9c0762d0 con 0x7fafac0f4bd0 2024-02-15T18:30:02.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.203+0000 7fafa3fff700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7faf9805c300 0x7faf9805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:02.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.203+0000 7fafa3fff700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7faf9805c300 0x7faf9805e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7faf94004e90 tx=0x7faf94016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:02.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.209+0000 7fafa37fe700 1 -- 172.21.15.33:0/454107141 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7faf9c049010 con 0x7fafac0f4bd0 2024-02-15T18:30:02.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.449+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafac0fcc10 con 0x7faf9805c300 2024-02-15T18:30:02.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.451+0000 7fafa37fe700 1 -- 172.21.15.33:0/454107141 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7fafac0fcc10 con 0x7faf9805c300 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7faf9805c300 msgr2=0x7faf9805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7faf9805c300 0x7faf9805e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7faf94004e90 tx=0x7faf94016040).stop 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafac0f4bd0 msgr2=0x7fafac104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafac0f4bd0 0x7fafac104ae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fafac0f5cd0 tx=0x7faf9c00b040).stop 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 shutdown_connections 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7faf9805c300 0x7faf9805e7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafac0f4bd0 0x7fafac104ae0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 --2- 172.21.15.33:0/454107141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafac0f5e70 0x7fafac104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 >> 172.21.15.33:0/454107141 conn(0x7fafac0f0330 msgr2=0x7fafac0f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 shutdown_connections 2024-02-15T18:30:02.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.453+0000 7fafb1476700 1 -- 172.21.15.33:0/454107141 wait complete. 2024-02-15T18:30:02.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.561+0000 7f8411798700 1 -- 172.21.15.33:0/836595291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f840c0f5e70 msgr2=0x7f840c0f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.561+0000 7f8411798700 1 --2- 172.21.15.33:0/836595291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f840c0f5e70 0x7f840c0f62d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f8400004660 tx=0x7f8400009b30).stop 2024-02-15T18:30:02.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.561+0000 7f8411798700 1 -- 172.21.15.33:0/836595291 shutdown_connections 2024-02-15T18:30:02.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.561+0000 7f8411798700 1 --2- 172.21.15.33:0/836595291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f840c0f5e70 0x7f840c0f62d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.561+0000 7f8411798700 1 --2- 172.21.15.33:0/836595291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c0f4bd0 0x7f840c0f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.561+0000 7f8411798700 1 -- 172.21.15.33:0/836595291 >> 172.21.15.33:0/836595291 conn(0x7f840c0f0330 msgr2=0x7f840c0f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:02.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.562+0000 7f8411798700 1 -- 172.21.15.33:0/836595291 shutdown_connections 2024-02-15T18:30:02.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.562+0000 7f8411798700 1 -- 172.21.15.33:0/836595291 wait complete. 2024-02-15T18:30:02.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f8411798700 1 Processor -- start 2024-02-15T18:30:02.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f8411798700 1 -- start start 2024-02-15T18:30:02.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f8411798700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f840c0f4bd0 0x7f840c0fd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:02.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f8411798700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c0f5e70 0x7f840c0fde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:02.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f8411798700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c114780 con 0x7f840c0f4bd0 2024-02-15T18:30:02.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f8411798700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c1148c0 con 0x7f840c0f5e70 2024-02-15T18:30:02.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f840a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c0f5e70 0x7f840c0fde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:02.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f840a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c0f5e70 0x7f840c0fde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.33:40016/0 (socket says 172.21.15.33:40016) 2024-02-15T18:30:02.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f840a7fc700 1 -- 172.21.15.33:0/4014228153 learned_addr learned my addr 172.21.15.33:0/4014228153 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f840a7fc700 1 -- 172.21.15.33:0/4014228153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f840c0f4bd0 msgr2=0x7f840c0fd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f840a7fc700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f840c0f4bd0 0x7f840c0fd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:30:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.563+0000 7f840a7fc700 1 -- 172.21.15.33:0/4014228153 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8400005040 con 0x7f840c0f5e70 2024-02-15T18:30:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.564+0000 7f840a7fc700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c0f5e70 0x7f840c0fde20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8400000c00 tx=0x7f840000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.564+0000 7f83f37fe700 1 -- 172.21.15.33:0/4014228153 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8400019070 con 0x7f840c0f5e70 2024-02-15T18:30:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.564+0000 7f83f37fe700 1 -- 172.21.15.33:0/4014228153 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f8400014420 con 0x7f840c0f5e70 2024-02-15T18:30:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.564+0000 7f83f37fe700 1 -- 172.21.15.33:0/4014228153 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f840001d600 con 0x7f840c0f5e70 2024-02-15T18:30:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.564+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c114b10 con 0x7f840c0f5e70 2024-02-15T18:30:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.564+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c115070 con 0x7f840c0f5e70 2024-02-15T18:30:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.566+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c045ad0 con 0x7f840c0f5e70 2024-02-15T18:30:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.566+0000 7f83f37fe700 1 -- 172.21.15.33:0/4014228153 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8400025070 con 0x7f840c0f5e70 2024-02-15T18:30:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.566+0000 7f83f37fe700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f83f405c300 0x7f83f405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.567+0000 7f83f37fe700 1 -- 172.21.15.33:0/4014228153 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8400076e50 con 0x7f840c0f5e70 2024-02-15T18:30:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.567+0000 7f840affd700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f83f405c300 0x7f83f405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.567+0000 7f840affd700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f83f405c300 0x7f83f405e7c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f840c0fd6c0 tx=0x7f83fc00b040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.574+0000 7f83f37fe700 1 -- 172.21.15.33:0/4014228153 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8400049b10 con 0x7f840c0f5e70 2024-02-15T18:30:02.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:02.088468+0000 mgr.smithi033.apxevf (mgr.14162) 294 : audit [DBG] from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:02.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:02.088468+0000 mgr.smithi033.apxevf (mgr.14162) 294 : audit [DBG] from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:02.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.850+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f840c0fc460 con 0x7f83f405c300 2024-02-15T18:30:02.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.858+0000 7f83f37fe700 1 -- 172.21.15.33:0/4014228153 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7f840c0fc460 con 0x7f83f405c300 2024-02-15T18:30:02.852 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2024-02-15T18:30:02.852 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (4m) 54s ago 6m 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:30:02.852 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (6m) 54s ago 6m 16.2.4 8d91d370c2b8 6deae8bbd6c5 2024-02-15T18:30:02.852 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (5m) 61s ago 5m 16.2.4 8d91d370c2b8 e45b11308af7 2024-02-15T18:30:02.852 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (4m) 54s ago 6m 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:30:02.852 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (73s) 54s ago 72s 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:30:02.852 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (80s) 54s ago 79s 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (77s) 61s ago 76s 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (84s) 61s ago 83s 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:9283 running (8m) 54s ago 8m 16.2.4 8d91d370c2b8 c319170b238f 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (5m) 61s ago 5m 16.2.4 8d91d370c2b8 636ca5f9c9dd 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (8m) 54s ago 8m 16.2.4 8d91d370c2b8 04c43c0cba21 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (5m) 61s ago 5m 16.2.4 8d91d370c2b8 710ae4544ec3 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (6m) 54s ago 6m 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (5m) 61s ago 5m 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (5m) 54s ago 5m 16.2.4 8d91d370c2b8 8fd8ca242c54 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (4m) 54s ago 4m 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (4m) 54s ago 4m 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (3m) 61s ago 3m 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (3m) 61s ago 3m 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (3m) 61s ago 3m 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:30:02.853 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (4m) 54s ago 5m 2.18.1 de242295e225 0b5ba62c4d4c 2024-02-15T18:30:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.860+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f83f405c300 msgr2=0x7f83f405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.860+0000 7f8411798700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f83f405c300 0x7f83f405e7c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f840c0fd6c0 tx=0x7f83fc00b040).stop 2024-02-15T18:30:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.861+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c0f5e70 msgr2=0x7f840c0fde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.861+0000 7f8411798700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c0f5e70 0x7f840c0fde20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f8400000c00 tx=0x7f840000b040).stop 2024-02-15T18:30:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.861+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 shutdown_connections 2024-02-15T18:30:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.861+0000 7f8411798700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f83f405c300 0x7f83f405e7c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.861+0000 7f8411798700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f840c0f4bd0 0x7f840c0fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:30:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.861+0000 7f8411798700 1 --2- 172.21.15.33:0/4014228153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f840c0f5e70 0x7f840c0fde20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.861+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 >> 172.21.15.33:0/4014228153 conn(0x7f840c0f0330 msgr2=0x7f840c0f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.861+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 shutdown_connections 2024-02-15T18:30:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.861+0000 7f8411798700 1 -- 172.21.15.33:0/4014228153 wait complete. 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.973+0000 7fcd52b29700 1 -- 172.21.15.33:0/2022600232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f6860 msgr2=0x7fcd4c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.973+0000 7fcd52b29700 1 --2- 172.21.15.33:0/2022600232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f6860 0x7fcd4c0f6cc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fcd38004660 tx=0x7fcd38009b30).stop 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.973+0000 7fcd52b29700 1 -- 172.21.15.33:0/2022600232 shutdown_connections 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.973+0000 7fcd52b29700 1 --2- 172.21.15.33:0/2022600232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f6860 0x7fcd4c0f6cc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.973+0000 7fcd52b29700 1 --2- 172.21.15.33:0/2022600232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0f55c0 0x7fcd4c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.973+0000 7fcd52b29700 1 -- 172.21.15.33:0/2022600232 >> 172.21.15.33:0/2022600232 conn(0x7fcd4c0f0d40 msgr2=0x7fcd4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.973+0000 7fcd52b29700 1 -- 172.21.15.33:0/2022600232 shutdown_connections 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.973+0000 7fcd52b29700 1 -- 172.21.15.33:0/2022600232 wait complete. 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.974+0000 7fcd52b29700 1 Processor -- start 2024-02-15T18:30:02.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.974+0000 7fcd52b29700 1 -- start start 2024-02-15T18:30:02.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.974+0000 7fcd52b29700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f55c0 0x7fcd4c107050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:02.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.974+0000 7fcd52b29700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0f6860 0x7fcd4c107540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.974+0000 7fcd52b29700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c107b80 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.974+0000 7fcd52b29700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c108430 con 0x7fcd4c0f6860 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd508c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f55c0 0x7fcd4c107050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd4bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0f6860 0x7fcd4c107540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd508c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f55c0 0x7fcd4c107050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37322/0 (socket says 172.21.15.33:37322) 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd508c5700 1 -- 172.21.15.33:0/893472896 learned_addr learned my addr 172.21.15.33:0/893472896 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd508c5700 1 -- 172.21.15.33:0/893472896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0f6860 msgr2=0x7fcd4c107540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd508c5700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0f6860 0x7fcd4c107540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd508c5700 1 -- 172.21.15.33:0/893472896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38005040 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd508c5700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f55c0 0x7fcd4c107050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fcd400093f0 tx=0x7fcd40006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd497fa700 1 -- 172.21.15.33:0/893472896 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd40013640 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd497fa700 1 -- 172.21.15.33:0/893472896 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fcd40013c90 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd497fa700 1 -- 172.21.15.33:0/893472896 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd40012de0 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.975+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c1086b0 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.976+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c108b40 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.977+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c0f49b0 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.977+0000 7fcd497fa700 1 -- 172.21.15.33:0/893472896 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fcd4001a060 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.978+0000 7fcd497fa700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd3c05c2b0 0x7fcd3c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:02.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.978+0000 7fcd497fa700 1 -- 172.21.15.33:0/893472896 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fcd40075e50 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.985+0000 7fcd497fa700 1 -- 172.21.15.33:0/893472896 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcd40048ab0 con 0x7fcd4c0f55c0 2024-02-15T18:30:02.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.986+0000 7fcd4bfff700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd3c05c2b0 0x7fcd3c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:02.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:02.986+0000 7fcd4bfff700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd3c05c2b0 0x7fcd3c05e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcd38004e30 tx=0x7fcd38009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:03.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.210+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcd4c045ad0 con 0x7fcd4c0f55c0 2024-02-15T18:30:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.210+0000 7fcd497fa700 1 -- 172.21.15.33:0/893472896 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7fcd4004c0d0 con 0x7fcd4c0f55c0 2024-02-15T18:30:03.204 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:30:03.204 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:30:03.204 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:30:03.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:30:03.204 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:30:03.205 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:30:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.212+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd3c05c2b0 msgr2=0x7fcd3c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.212+0000 7fcd52b29700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd3c05c2b0 0x7fcd3c05e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcd38004e30 tx=0x7fcd38009b30).stop 2024-02-15T18:30:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.212+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f55c0 msgr2=0x7fcd4c107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.212+0000 7fcd52b29700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f55c0 0x7fcd4c107050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fcd400093f0 tx=0x7fcd40006ec0).stop 2024-02-15T18:30:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.213+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 shutdown_connections 2024-02-15T18:30:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.213+0000 7fcd52b29700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fcd3c05c2b0 0x7fcd3c05e770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.213+0000 7fcd52b29700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c0f55c0 0x7fcd4c107050 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.213+0000 7fcd52b29700 1 --2- 172.21.15.33:0/893472896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd4c0f6860 0x7fcd4c107540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.213+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 >> 172.21.15.33:0/893472896 conn(0x7fcd4c0f0d40 msgr2=0x7fcd4c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:03.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.213+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 shutdown_connections 2024-02-15T18:30:03.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.213+0000 7fcd52b29700 1 -- 172.21.15.33:0/893472896 wait complete. 2024-02-15T18:30:03.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.334+0000 7f8851a89700 1 -- 172.21.15.33:0/1321435307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f7980 msgr2=0x7f884c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:03.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.334+0000 7f8851a89700 1 --2- 172.21.15.33:0/1321435307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f7980 0x7f884c0f7de0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f8840004660 tx=0x7f8840009b30).stop 2024-02-15T18:30:03.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.334+0000 7f8851a89700 1 -- 172.21.15.33:0/1321435307 shutdown_connections 2024-02-15T18:30:03.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.334+0000 7f8851a89700 1 --2- 172.21.15.33:0/1321435307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f7980 0x7f884c0f7de0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.334+0000 7f8851a89700 1 --2- 172.21.15.33:0/1321435307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c0f66e0 0x7f884c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.334+0000 7f8851a89700 1 -- 172.21.15.33:0/1321435307 >> 172.21.15.33:0/1321435307 conn(0x7f884c0f1e40 msgr2=0x7f884c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:03.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.334+0000 7f8851a89700 1 -- 172.21.15.33:0/1321435307 shutdown_connections 2024-02-15T18:30:03.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.334+0000 7f8851a89700 1 -- 172.21.15.33:0/1321435307 wait complete. 2024-02-15T18:30:03.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f8851a89700 1 Processor -- start 2024-02-15T18:30:03.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f8851a89700 1 -- start start 2024-02-15T18:30:03.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f8851a89700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f66e0 0x7f884c107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:03.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f8851a89700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c0f7980 0x7f884c1074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:03.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f8851a89700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c107aa0 con 0x7f884c0f66e0 2024-02-15T18:30:03.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f8851a89700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c107be0 con 0x7f884c0f7980 2024-02-15T18:30:03.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f884b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f66e0 0x7f884c107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:03.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f884b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f66e0 0x7f884c107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37348/0 (socket says 172.21.15.33:37348) 2024-02-15T18:30:03.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f884b7fe700 1 -- 172.21.15.33:0/798854724 learned_addr learned my addr 172.21.15.33:0/798854724 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:03.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.335+0000 7f884affd700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c0f7980 0x7f884c1074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:03.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.336+0000 7f884b7fe700 1 -- 172.21.15.33:0/798854724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c0f7980 msgr2=0x7f884c1074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:03.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.336+0000 7f884b7fe700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c0f7980 0x7f884c1074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.336+0000 7f884b7fe700 1 -- 172.21.15.33:0/798854724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840005040 con 0x7f884c0f66e0 2024-02-15T18:30:03.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.336+0000 7f884b7fe700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f66e0 0x7f884c107000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f883c00e7c0 tx=0x7f883c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:03.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.336+0000 7f8833fff700 1 -- 172.21.15.33:0/798854724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f883c0092e0 con 0x7f884c0f66e0 2024-02-15T18:30:03.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.336+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c108580 con 0x7f884c0f66e0 2024-02-15T18:30:03.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.336+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c108b40 con 0x7f884c0f66e0 2024-02-15T18:30:03.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.337+0000 7f8833fff700 1 -- 172.21.15.33:0/798854724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f883c00f040 con 0x7f884c0f66e0 2024-02-15T18:30:03.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.337+0000 7f8833fff700 1 -- 172.21.15.33:0/798854724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f883c014920 con 0x7f884c0f66e0 2024-02-15T18:30:03.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.337+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882c004fa0 con 0x7f884c0f66e0 2024-02-15T18:30:03.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.339+0000 7f8833fff700 1 -- 172.21.15.33:0/798854724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f883c01b030 con 0x7f884c0f66e0 2024-02-15T18:30:03.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.339+0000 7f8833fff700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f883405c2a0 0x7f883405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:03.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.339+0000 7f8833fff700 1 -- 172.21.15.33:0/798854724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f883c075df0 con 0x7f884c0f66e0 2024-02-15T18:30:03.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.340+0000 7f884affd700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f883405c2a0 0x7f883405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:03.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.340+0000 7f884affd700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f883405c2a0 0x7f883405e760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8840004630 tx=0x7f8840016040).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:03.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.346+0000 7f8833fff700 1 -- 172.21.15.33:0/798854724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f883c04c4d0 con 0x7f884c0f66e0 2024-02-15T18:30:03.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.741+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f882c005940 con 0x7f884c0f66e0 2024-02-15T18:30:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.742+0000 7f8833fff700 1 -- 172.21.15.33:0/798854724 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1673 (secure 0 0 0) 0x7f883c04c0c0 con 0x7f884c0f66e0 2024-02-15T18:30:03.736 INFO:teuthology.orchestra.run.smithi033.stdout:e17 2024-02-15T18:30:03.736 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:30:03.736 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:30:03.736 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:30:03.736 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:30:03.736 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:30:03.736 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 12 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:28:52.769887+0000 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:30:03.737 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707]] 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411]] 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613]] 2024-02-15T18:30:03.738 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278]] 2024-02-15T18:30:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.744+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f883405c2a0 msgr2=0x7f883405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.744+0000 7f8851a89700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f883405c2a0 0x7f883405e760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8840004630 tx=0x7f8840016040).stop 2024-02-15T18:30:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.744+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f66e0 msgr2=0x7f884c107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.744+0000 7f8851a89700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f66e0 0x7f884c107000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f883c00e7c0 tx=0x7f883c00b040).stop 2024-02-15T18:30:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.745+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 shutdown_connections 2024-02-15T18:30:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.745+0000 7f8851a89700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7f883405c2a0 0x7f883405e760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.745+0000 7f8851a89700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c0f66e0 0x7f884c107000 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.745+0000 7f8851a89700 1 --2- 172.21.15.33:0/798854724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c0f7980 0x7f884c1074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.745+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 >> 172.21.15.33:0/798854724 conn(0x7f884c0f1e40 msgr2=0x7f884c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.745+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 shutdown_connections 2024-02-15T18:30:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.745+0000 7f8851a89700 1 -- 172.21.15.33:0/798854724 wait complete. 2024-02-15T18:30:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 17 2024-02-15T18:30:03.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:02.451235+0000 mgr.smithi033.apxevf (mgr.14162) 295 : audit [DBG] from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:03.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:02.579365+0000 mgr.smithi033.apxevf (mgr.14162) 296 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-15T18:30:03.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:02.851840+0000 mgr.smithi033.apxevf (mgr.14162) 297 : audit [DBG] from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:03.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:03.211131+0000 mon.smithi033 (mon.0) 573 : audit [DBG] from='client.? 172.21.15.33:0/893472896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:03.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:02.451235+0000 mgr.smithi033.apxevf (mgr.14162) 295 : audit [DBG] from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:03.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:02.579365+0000 mgr.smithi033.apxevf (mgr.14162) 296 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-15T18:30:03.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:02.851840+0000 mgr.smithi033.apxevf (mgr.14162) 297 : audit [DBG] from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:03.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:03.211131+0000 mon.smithi033 (mon.0) 573 : audit [DBG] from='client.? 172.21.15.33:0/893472896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:03.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.906+0000 7fb5da272700 1 -- 172.21.15.33:0/53693481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f5440 msgr2=0x7fb5d40f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:03.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.906+0000 7fb5da272700 1 --2- 172.21.15.33:0/53693481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f5440 0x7fb5d40f5860 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fb5d0004660 tx=0x7fb5d0009b30).stop 2024-02-15T18:30:03.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.907+0000 7fb5da272700 1 -- 172.21.15.33:0/53693481 shutdown_connections 2024-02-15T18:30:03.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.907+0000 7fb5da272700 1 --2- 172.21.15.33:0/53693481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5d40f66e0 0x7fb5d40f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:30:03.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.907+0000 7fb5da272700 1 --2- 172.21.15.33:0/53693481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f5440 0x7fb5d40f5860 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.907+0000 7fb5da272700 1 -- 172.21.15.33:0/53693481 >> 172.21.15.33:0/53693481 conn(0x7fb5d40f0ba0 msgr2=0x7fb5d40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:03.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.907+0000 7fb5da272700 1 -- 172.21.15.33:0/53693481 shutdown_connections 2024-02-15T18:30:03.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.907+0000 7fb5da272700 1 -- 172.21.15.33:0/53693481 wait complete. 2024-02-15T18:30:03.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.907+0000 7fb5da272700 1 Processor -- start 2024-02-15T18:30:03.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.907+0000 7fb5da272700 1 -- start start 2024-02-15T18:30:03.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5da272700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5d40f5440 0x7fb5d40fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:03.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5da272700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f66e0 0x7fb5d40fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5da272700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40fc030 con 0x7fb5d40f66e0 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5da272700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40fc170 con 0x7fb5d40f5440 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5d8a6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f66e0 0x7fb5d40fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5d9270700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5d40f5440 0x7fb5d40fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5d8a6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f66e0 0x7fb5d40fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37358/0 (socket says 172.21.15.33:37358) 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5d9270700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5d40f5440 0x7fb5d40fd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.33:40072/0 (socket says 172.21.15.33:40072) 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5d8a6f700 1 -- 172.21.15.33:0/2647313230 learned_addr learned my addr 172.21.15.33:0/2647313230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5d8a6f700 1 -- 172.21.15.33:0/2647313230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5d40f5440 msgr2=0x7fb5d40fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5d8a6f700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5d40f5440 0x7fb5d40fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5d8a6f700 1 -- 172.21.15.33:0/2647313230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d0005040 con 0x7fb5d40f66e0 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.908+0000 7fb5d8a6f700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f66e0 0x7fb5d40fba40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb5c400b410 tx=0x7fb5c4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.909+0000 7fb5c9ffb700 1 -- 172.21.15.33:0/2647313230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c40125f0 con 0x7fb5d40f66e0 2024-02-15T18:30:03.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.909+0000 7fb5c9ffb700 1 -- 172.21.15.33:0/2647313230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fb5c4012c40 con 0x7fb5d40f66e0 2024-02-15T18:30:03.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.909+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d40fc450 con 0x7fb5d40f66e0 2024-02-15T18:30:03.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.909+0000 7fb5c9ffb700 1 -- 172.21.15.33:0/2647313230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c4002b80 con 0x7fb5d40f66e0 2024-02-15T18:30:03.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.909+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d410eeb0 con 0x7fb5d40f66e0 2024-02-15T18:30:03.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.911+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b4004fa0 con 0x7fb5d40f66e0 2024-02-15T18:30:03.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.912+0000 7fb5c9ffb700 1 -- 172.21.15.33:0/2647313230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb5c400f030 con 0x7fb5d40f66e0 2024-02-15T18:30:03.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.913+0000 7fb5c9ffb700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb5c005c300 0x7fb5c005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:03.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.913+0000 7fb5c9ffb700 1 -- 172.21.15.33:0/2647313230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb5c40762b0 con 0x7fb5d40f66e0 2024-02-15T18:30:03.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.914+0000 7fb5d9270700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb5c005c300 0x7fb5c005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:03.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.914+0000 7fb5d9270700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb5c005c300 0x7fb5c005e7c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fb5d40fd350 tx=0x7fb5d0009b30).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:03.921+0000 7fb5c9ffb700 1 -- 172.21.15.33:0/2647313230 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb5c4048f30 con 0x7fb5d40f66e0 2024-02-15T18:30:04.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.137+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 --> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5b4000bc0 con 0x7fb5c005c300 2024-02-15T18:30:04.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.138+0000 7fb5c9ffb700 1 -- 172.21.15.33:0/2647313230 <== mgr.14162 v2:172.21.15.33:6800/1351334089 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7fb5b4000bc0 con 0x7fb5c005c300 2024-02-15T18:30:04.132 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:30:04.132 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:30:04.132 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:30:04.132 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T18:30:04.132 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "0/21 ceph daemons upgraded", 2024-02-15T18:30:04.132 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc image on host smithi131" 2024-02-15T18:30:04.132 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:30:04.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.140+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb5c005c300 msgr2=0x7fb5c005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:04.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.140+0000 7fb5da272700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb5c005c300 0x7fb5c005e7c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fb5d40fd350 tx=0x7fb5d0009b30).stop 2024-02-15T18:30:04.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.140+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f66e0 msgr2=0x7fb5d40fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:04.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.140+0000 7fb5da272700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f66e0 0x7fb5d40fba40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb5c400b410 tx=0x7fb5c4006ef0).stop 2024-02-15T18:30:04.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.143+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 shutdown_connections 2024-02-15T18:30:04.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.143+0000 7fb5da272700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:6800/1351334089,v1:172.21.15.33:6801/1351334089] conn(0x7fb5c005c300 0x7fb5c005e7c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:04.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.143+0000 7fb5da272700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5d40f5440 0x7fb5d40fd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:04.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.143+0000 7fb5da272700 1 --2- 172.21.15.33:0/2647313230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5d40f66e0 0x7fb5d40fba40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:04.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.143+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 >> 172.21.15.33:0/2647313230 conn(0x7fb5d40f0ba0 msgr2=0x7fb5d40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:04.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.143+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 shutdown_connections 2024-02-15T18:30:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:04.143+0000 7fb5da272700 1 -- 172.21.15.33:0/2647313230 wait complete. 2024-02-15T18:30:04.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:03.742859+0000 mon.smithi033 (mon.0) 574 : audit [DBG] from='client.? 172.21.15.33:0/798854724' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:30:04.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:04.138700+0000 mgr.smithi033.apxevf (mgr.14162) 298 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:04.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:03.742859+0000 mon.smithi033 (mon.0) 574 : audit [DBG] from='client.? 172.21.15.33:0/798854724' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:30:04.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:04.138700+0000 mgr.smithi033.apxevf (mgr.14162) 298 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:05.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:04.579763+0000 mgr.smithi033.apxevf (mgr.14162) 299 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:30:05.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:04.579763+0000 mgr.smithi033.apxevf (mgr.14162) 299 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-15T18:30:07.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:06.580220+0000 mgr.smithi033.apxevf (mgr.14162) 300 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-15T18:30:08.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:06.580220+0000 mgr.smithi033.apxevf (mgr.14162) 300 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-15T18:30:09.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:08.580584+0000 mgr.smithi033.apxevf (mgr.14162) 301 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:30:09.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:08.580584+0000 mgr.smithi033.apxevf (mgr.14162) 301 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:30:11.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:10.581098+0000 mgr.smithi033.apxevf (mgr.14162) 302 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:30:12.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:10.581098+0000 mgr.smithi033.apxevf (mgr.14162) 302 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:30:13.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:12.581552+0000 mgr.smithi033.apxevf (mgr.14162) 303 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:30:14.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:12.581552+0000 mgr.smithi033.apxevf (mgr.14162) 303 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-15T18:30:15.916 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:14.581998+0000 mgr.smithi033.apxevf (mgr.14162) 304 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:15.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:14.581998+0000 mgr.smithi033.apxevf (mgr.14162) 304 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:17.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:16.582437+0000 mgr.smithi033.apxevf (mgr.14162) 305 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:18.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:16.582437+0000 mgr.smithi033.apxevf (mgr.14162) 305 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:19.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:18.582806+0000 mgr.smithi033.apxevf (mgr.14162) 306 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:19.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:18.582806+0000 mgr.smithi033.apxevf (mgr.14162) 306 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:21.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:20.583457+0000 mgr.smithi033.apxevf (mgr.14162) 307 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:22.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:20.583457+0000 mgr.smithi033.apxevf (mgr.14162) 307 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:22.152 INFO:tasks.workunit.client.0.smithi033.stderr:Updating files: 95% (11630/12167) Updating files: 96% (11681/12167) Updating files: 97% (11802/12167) Updating files: 98% (11924/12167) Updating files: 99% (12046/12167) Updating files: 100% (12167/12167) Updating files: 100% (12167/12167), done. 2024-02-15T18:30:22.512 INFO:tasks.workunit.client.1.smithi131.stderr:Updating files: 95% (11651/12167) Updating files: 96% (11681/12167) Updating files: 97% (11802/12167) Updating files: 98% (11924/12167) Updating files: 99% (12046/12167) Updating files: 100% (12167/12167) Updating files: 100% (12167/12167), done. 2024-02-15T18:30:22.840 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to 'bedfc49c6a823fb0ff75911e476e1f3cb464ad3e'. 2024-02-15T18:30:22.840 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T18:30:22.841 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-15T18:30:22.842 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-02-15T18:30:22.842 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at bedfc49c6a8 qa/suites/orch: whitelist warnings that are expected in test environments 2024-02-15T18:30:22.847 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-15T18:30:22.992 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-15T18:30:22.994 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-15T18:30:22.994 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-15T18:30:23.443 INFO:tasks.workunit.client.1.smithi131.stderr:Note: switching to 'bedfc49c6a823fb0ff75911e476e1f3cb464ad3e'. 2024-02-15T18:30:23.444 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-02-15T18:30:23.444 INFO:tasks.workunit.client.1.smithi131.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-15T18:30:23.444 INFO:tasks.workunit.client.1.smithi131.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-15T18:30:23.444 INFO:tasks.workunit.client.1.smithi131.stderr:state without impacting any branches by switching back to a branch. 2024-02-15T18:30:23.444 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-02-15T18:30:23.444 INFO:tasks.workunit.client.1.smithi131.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-15T18:30:23.444 INFO:tasks.workunit.client.1.smithi131.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr: git switch -c 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr:Or undo this operation with: 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr: git switch - 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-02-15T18:30:23.447 INFO:tasks.workunit.client.1.smithi131.stderr:HEAD is now at bedfc49c6a8 qa/suites/orch: whitelist warnings that are expected in test environments 2024-02-15T18:30:23.449 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-15T18:30:23.547 INFO:tasks.workunit.client.1.smithi131.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-15T18:30:23.549 INFO:tasks.workunit.client.1.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-15T18:30:23.549 INFO:tasks.workunit.client.1.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-15T18:30:23.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:22.583833+0000 mgr.smithi033.apxevf (mgr.14162) 308 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:23.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:22.583833+0000 mgr.smithi033.apxevf (mgr.14162) 308 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:25.011 INFO:tasks.workunit.client.1.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-15T18:30:25.109 INFO:tasks.workunit.client.1.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-15T18:30:25.148 INFO:tasks.workunit.client.1.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-15T18:30:25.150 INFO:tasks.workunit.client.1.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-15T18:30:25.150 INFO:tasks.workunit.client.1.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-15T18:30:25.191 INFO:tasks.workunit.client.1.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-15T18:30:25.195 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-02-15T18:30:25.195 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-15T18:30:25.212 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-15T18:30:25.214 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-15T18:30:25.214 DEBUG:teuthology.orchestra.run.smithi131:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedfc49c6a823fb0ff75911e476e1f3cb464ad3e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-15T18:30:25.277 INFO:tasks.workunit.client.1.smithi131.stderr:+ mkdir -p fsstress 2024-02-15T18:30:25.278 INFO:tasks.workunit.client.1.smithi131.stderr:+ pushd fsstress 2024-02-15T18:30:25.278 INFO:tasks.workunit.client.1.smithi131.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T18:30:25.279 INFO:tasks.workunit.client.1.smithi131.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-15T18:30:26.419 INFO:tasks.workunit.client.1.smithi131.stderr:+ tar xzf ltp-full.tgz 2024-02-15T18:30:26.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:24.584310+0000 mgr.smithi033.apxevf (mgr.14162) 309 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:26.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:30:25.255472+0000 mgr.smithi033.apxevf (mgr.14162) 310 : cephadm [INF] Upgrade: Updating mgr.smithi131.buibla 2024-02-15T18:30:26.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:25.260598+0000 mon.smithi033 (mon.0) 575 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:30:26.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:25.261630+0000 mon.smithi033 (mon.0) 576 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.buibla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:30:26.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:25.262735+0000 mon.smithi033 (mon.0) 577 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:30:26.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:25.263617+0000 mon.smithi033 (mon.0) 578 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:26.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:30:25.264550+0000 mgr.smithi033.apxevf (mgr.14162) 311 : cephadm [INF] Deploying daemon mgr.smithi131.buibla on smithi131 2024-02-15T18:30:26.687 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:24.584310+0000 mgr.smithi033.apxevf (mgr.14162) 309 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:26.687 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:30:25.255472+0000 mgr.smithi033.apxevf (mgr.14162) 310 : cephadm [INF] Upgrade: Updating mgr.smithi131.buibla 2024-02-15T18:30:26.687 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:25.260598+0000 mon.smithi033 (mon.0) 575 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:30:26.687 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:25.261630+0000 mon.smithi033 (mon.0) 576 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.buibla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:30:26.687 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:25.262735+0000 mon.smithi033 (mon.0) 577 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:30:26.687 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:25.263617+0000 mon.smithi033 (mon.0) 578 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:30:26.687 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:30:25.264550+0000 mgr.smithi033.apxevf (mgr.14162) 311 : cephadm [INF] Deploying daemon mgr.smithi131.buibla on smithi131 2024-02-15T18:30:26.961 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-15T18:30:27.047 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-15T18:30:27.089 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-15T18:30:27.090 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-15T18:30:27.091 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-15T18:30:27.130 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-15T18:30:27.133 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-02-15T18:30:27.134 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-15T18:30:27.152 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-15T18:30:27.153 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-15T18:30:27.153 DEBUG:teuthology.orchestra.run.smithi033:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedfc49c6a823fb0ff75911e476e1f3cb464ad3e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-15T18:30:27.217 INFO:tasks.workunit.client.0.smithi033.stderr:+ mkdir -p fsstress 2024-02-15T18:30:27.220 INFO:tasks.workunit.client.0.smithi033.stderr:+ pushd fsstress 2024-02-15T18:30:27.220 INFO:tasks.workunit.client.0.smithi033.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T18:30:27.220 INFO:tasks.workunit.client.0.smithi033.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-15T18:30:27.757 INFO:tasks.workunit.client.0.smithi033.stderr:+ tar xzf ltp-full.tgz 2024-02-15T18:30:28.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:26.584874+0000 mgr.smithi033.apxevf (mgr.14162) 312 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:28.573 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:26.584874+0000 mgr.smithi033.apxevf (mgr.14162) 312 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:29.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:28.585231+0000 mgr.smithi033.apxevf (mgr.14162) 313 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:29.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:28.644999+0000 mon.smithi033 (mon.0) 579 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:30:29.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:28.645771+0000 mon.smithi033 (mon.0) 580 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:28.585231+0000 mgr.smithi033.apxevf (mgr.14162) 313 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 13 KiB data, 33 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:28.644999+0000 mon.smithi033 (mon.0) 579 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:30:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:28.645771+0000 mon.smithi033 (mon.0) 580 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:31.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:30.585849+0000 mgr.smithi033.apxevf (mgr.14162) 314 : cluster [DBG] pgmap v261: 65 pgs: 65 active+clean; 4.0 MiB data, 41 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-02-15T18:30:32.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:30.585849+0000 mgr.smithi033.apxevf (mgr.14162) 314 : cluster [DBG] pgmap v261: 65 pgs: 65 active+clean; 4.0 MiB data, 41 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s wr, 0 op/s 2024-02-15T18:30:33.482 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:32.139948+0000 mon.smithi033 (mon.0) 581 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:30:33.482 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:32.487985+0000 mon.smithi033 (mon.0) 582 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:30:33.482 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:32.492031+0000 mon.smithi033 (mon.0) 583 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:33.482 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:32.495412+0000 mon.smithi033 (mon.0) 584 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr fail", "who": "smithi033.apxevf"}]: dispatch 2024-02-15T18:30:33.482 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:32.501544+0000 mon.smithi033 (mon.0) 585 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-02-15T18:30:33.483 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:32.636444+0000 mon.smithi033 (mon.0) 586 : cluster [DBG] Standby manager daemon smithi033.apxevf started 2024-02-15T18:30:33.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:32.139948+0000 mon.smithi033 (mon.0) 581 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:30:33.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:32.487985+0000 mon.smithi033 (mon.0) 582 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' 2024-02-15T18:30:33.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:32.492031+0000 mon.smithi033 (mon.0) 583 : audit [DBG] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:33.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:32.495412+0000 mon.smithi033 (mon.0) 584 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr fail", "who": "smithi033.apxevf"}]: dispatch 2024-02-15T18:30:33.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:32.501544+0000 mon.smithi033 (mon.0) 585 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-02-15T18:30:33.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:32.636444+0000 mon.smithi033 (mon.0) 586 : cluster [DBG] Standby manager daemon smithi033.apxevf started 2024-02-15T18:30:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:30:32.493041+0000 mgr.smithi033.apxevf (mgr.14162) 315 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi033.apxevf) 2024-02-15T18:30:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:30:32.495174+0000 mgr.smithi033.apxevf (mgr.14162) 316 : cephadm [INF] Failing over to other MGR 2024-02-15T18:30:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:32.586143+0000 mgr.smithi033.apxevf (mgr.14162) 317 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 14 MiB data, 61 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s wr, 64 op/s 2024-02-15T18:30:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:33.493073+0000 mon.smithi033 (mon.0) 587 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "mgr fail", "who": "smithi033.apxevf"}]': finished 2024-02-15T18:30:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:33.493140+0000 mon.smithi033 (mon.0) 588 : cluster [DBG] mgrmap e19: smithi131.buibla(active, starting, since 0.99709s), standbys: smithi033.apxevf 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.260+0000 7f176759e700 1 -- 172.21.15.33:0/3312757227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f77d0 msgr2=0x7f17680f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.260+0000 7f176759e700 1 --2- 172.21.15.33:0/3312757227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f77d0 0x7f17680f7c30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f175c004660 tx=0x7f175c009b30).stop 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 -- 172.21.15.33:0/3312757227 shutdown_connections 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 --2- 172.21.15.33:0/3312757227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f77d0 0x7f17680f7c30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 --2- 172.21.15.33:0/3312757227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680f6530 0x7f17680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 -- 172.21.15.33:0/3312757227 >> 172.21.15.33:0/3312757227 conn(0x7f17680f1c90 msgr2=0x7f17680f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 -- 172.21.15.33:0/3312757227 shutdown_connections 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 -- 172.21.15.33:0/3312757227 wait complete. 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 Processor -- start 2024-02-15T18:30:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 -- start start 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f6530 0x7f176806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680f77d0 0x7f1768069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176806a380 con 0x7f17680f6530 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176759e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176806a4c0 con 0x7f17680f77d0 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f6530 0x7f176806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f6530 0x7f176806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52936/0 (socket says 172.21.15.33:52936) 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.261+0000 7f176659c700 1 -- 172.21.15.33:0/751724896 learned_addr learned my addr 172.21.15.33:0/751724896 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f1765d9b700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680f77d0 0x7f1768069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f176659c700 1 -- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680f77d0 msgr2=0x7f1768069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f176659c700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680f77d0 0x7f1768069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f176659c700 1 -- 172.21.15.33:0/751724896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c005040 con 0x7f17680f6530 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f1765d9b700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680f77d0 0x7f1768069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f176659c700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f6530 0x7f176806b9a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f175800e7c0 tx=0x7f175800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17580092e0 con 0x7f17680f6530 2024-02-15T18:30:34.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f175800f040 con 0x7f17680f6530 2024-02-15T18:30:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f176759e700 1 -- 172.21.15.33:0/751724896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176806a7a0 con 0x7f17680f6530 2024-02-15T18:30:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1758014920 con 0x7f17680f6530 2024-02-15T18:30:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.262+0000 7f176759e700 1 -- 172.21.15.33:0/751724896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176810ede0 con 0x7f17680f6530 2024-02-15T18:30:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.263+0000 7f176759e700 1 -- 172.21.15.33:0/751724896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1768045ad0 con 0x7f17680f6530 2024-02-15T18:30:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.264+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) v1 ==== 71921+0+0 (secure 0 0 0) 0x7f175801b030 con 0x7f17680f6530 2024-02-15T18:30:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.264+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1758075b80 con 0x7f17680f6530 2024-02-15T18:30:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:34.268+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f17580488a0 con 0x7f17680f6530 2024-02-15T18:30:34.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:30:32.493041+0000 mgr.smithi033.apxevf (mgr.14162) 315 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi033.apxevf) 2024-02-15T18:30:34.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:30:32.495174+0000 mgr.smithi033.apxevf (mgr.14162) 316 : cephadm [INF] Failing over to other MGR 2024-02-15T18:30:34.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:32.586143+0000 mgr.smithi033.apxevf (mgr.14162) 317 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 14 MiB data, 61 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s wr, 64 op/s 2024-02-15T18:30:34.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:33.493073+0000 mon.smithi033 (mon.0) 587 : audit [INF] from='mgr.14162 172.21.15.33:0/1951866191' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "mgr fail", "who": "smithi033.apxevf"}]': finished 2024-02-15T18:30:34.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:33.493140+0000 mon.smithi033 (mon.0) 588 : cluster [DBG] mgrmap e19: smithi131.buibla(active, starting, since 0.99709s), standbys: smithi033.apxevf 2024-02-15T18:30:35.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:35.506+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 20) v1 ==== 74396+0+0 (secure 0 0 0) 0x7f1758074080 con 0x7f17680f6530 2024-02-15T18:30:35.699 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:34.502821+0000 mon.smithi033 (mon.0) 589 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:30:35.699 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:35.332586+0000 mon.smithi033 (mon.0) 590 : cluster [INF] Active manager daemon smithi131.buibla restarted 2024-02-15T18:30:35.699 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:35.333141+0000 mon.smithi033 (mon.0) 591 : cluster [INF] Activating manager daemon smithi131.buibla 2024-02-15T18:30:35.699 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.337374+0000 mon.smithi131 (mon.1) 17 : audit [DBG] from='mgr.? 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/crt"}]: dispatch 2024-02-15T18:30:35.699 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:35.338244+0000 mon.smithi033 (mon.0) 592 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-02-15T18:30:35.699 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.338911+0000 mon.smithi131 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:30:35.699 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.339939+0000 mon.smithi131 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/key"}]: dispatch 2024-02-15T18:30:35.699 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.340238+0000 mon.smithi131 (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:30:35.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:34.502821+0000 mon.smithi033 (mon.0) 589 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:30:35.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:35.332586+0000 mon.smithi033 (mon.0) 590 : cluster [INF] Active manager daemon smithi131.buibla restarted 2024-02-15T18:30:35.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:35.333141+0000 mon.smithi033 (mon.0) 591 : cluster [INF] Activating manager daemon smithi131.buibla 2024-02-15T18:30:35.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.337374+0000 mon.smithi131 (mon.1) 17 : audit [DBG] from='mgr.? 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/crt"}]: dispatch 2024-02-15T18:30:35.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:35.338244+0000 mon.smithi033 (mon.0) 592 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-02-15T18:30:35.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.338911+0000 mon.smithi131 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:30:35.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.339939+0000 mon.smithi131 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/key"}]: dispatch 2024-02-15T18:30:35.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.340238+0000 mon.smithi131 (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:30:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.527+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mgrmap(e 21) v1 ==== 74466+0+0 (secure 0 0 0) 0x7f1758048350 con 0x7f17680f6530 2024-02-15T18:30:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.528+0000 7f1756ffd700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f1750026200 0x7f1750028610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.528+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 --> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1750034480 con 0x7f1750026200 2024-02-15T18:30:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.534+0000 7f1765d9b700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f1750026200 0x7f1750028610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.535+0000 7f1765d9b700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f1750026200 0x7f1750028610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f175c005010 tx=0x7f175c016040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.537+0000 7f1756ffd700 1 -- 172.21.15.33:0/751724896 <== mgr.24387 v2:172.21.15.131:6828/3968122283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f175c00f070 con 0x7f1750026200 2024-02-15T18:30:36.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 -- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f1750026200 msgr2=0x7f1750028610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:36.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f1750026200 0x7f1750028610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f175c005010 tx=0x7f175c016040).stop 2024-02-15T18:30:36.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 -- 172.21.15.33:0/751724896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f6530 msgr2=0x7f176806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:36.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f6530 0x7f176806b9a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f175800e7c0 tx=0x7f175800b040).stop 2024-02-15T18:30:36.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 -- 172.21.15.33:0/751724896 shutdown_connections 2024-02-15T18:30:36.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f1750026200 0x7f1750028610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17680f6530 0x7f176806b9a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 --2- 172.21.15.33:0/751724896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17680f77d0 0x7f1768069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 -- 172.21.15.33:0/751724896 >> 172.21.15.33:0/751724896 conn(0x7f17680f1c90 msgr2=0x7f17680fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:36.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 -- 172.21.15.33:0/751724896 shutdown_connections 2024-02-15T18:30:36.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.540+0000 7f176759e700 1 -- 172.21.15.33:0/751724896 wait complete. 2024-02-15T18:30:36.548 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:30:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.659+0000 7f0bb9f81700 1 -- 172.21.15.33:0/3468557169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 msgr2=0x7f0bb40f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.659+0000 7f0bb9f81700 1 --2- 172.21.15.33:0/3468557169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 0x7f0bb40f6ce0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f0b9c004660 tx=0x7f0b9c009b30).stop 2024-02-15T18:30:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.659+0000 7f0bb9f81700 1 -- 172.21.15.33:0/3468557169 shutdown_connections 2024-02-15T18:30:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.659+0000 7f0bb9f81700 1 --2- 172.21.15.33:0/3468557169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 0x7f0bb40f6ce0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.659+0000 7f0bb9f81700 1 --2- 172.21.15.33:0/3468557169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bb40f55e0 0x7f0bb40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.659+0000 7f0bb9f81700 1 -- 172.21.15.33:0/3468557169 >> 172.21.15.33:0/3468557169 conn(0x7f0bb40f0d40 msgr2=0x7f0bb40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.659+0000 7f0bb9f81700 1 -- 172.21.15.33:0/3468557169 shutdown_connections 2024-02-15T18:30:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.659+0000 7f0bb9f81700 1 -- 172.21.15.33:0/3468557169 wait complete. 2024-02-15T18:30:36.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.660+0000 7f0bb9f81700 1 Processor -- start 2024-02-15T18:30:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.660+0000 7f0bb9f81700 1 -- start start 2024-02-15T18:30:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.660+0000 7f0bb9f81700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bb40f55e0 0x7f0bb4109210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.660+0000 7f0bb9f81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 0x7f0bb4109700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.660+0000 7f0bb9f81700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4109cb0 con 0x7f0bb40f6880 2024-02-15T18:30:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.660+0000 7f0bb9f81700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4109df0 con 0x7f0bb40f55e0 2024-02-15T18:30:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0baaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 0x7f0bb4109700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bb40f55e0 0x7f0bb4109210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:36.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bb40f55e0 0x7f0bb4109210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.33:47020/0 (socket says 172.21.15.33:47020) 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0baaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 0x7f0bb4109700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46552/0 (socket says 172.21.15.33:46552) 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb37fe700 1 -- 172.21.15.33:0/4128491732 learned_addr learned my addr 172.21.15.33:0/4128491732 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb37fe700 1 -- 172.21.15.33:0/4128491732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 msgr2=0x7f0bb4109700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb37fe700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 0x7f0bb4109700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb37fe700 1 -- 172.21.15.33:0/4128491732 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c005040 con 0x7f0bb40f55e0 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0baaffd700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 0x7f0bb4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb37fe700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bb40f55e0 0x7f0bb4109210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0ba400e7c0 tx=0x7f0ba400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb0ff9700 1 -- 172.21.15.33:0/4128491732 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ba40092e0 con 0x7f0bb40f55e0 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb0ff9700 1 -- 172.21.15.33:0/4128491732 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0ba400f040 con 0x7f0bb40f55e0 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb410a790 con 0x7f0bb40f55e0 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb0ff9700 1 -- 172.21.15.33:0/4128491732 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ba4014920 con 0x7f0bb40f55e0 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.661+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb410ad50 con 0x7f0bb40f55e0 2024-02-15T18:30:36.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.662+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb4045ad0 con 0x7f0bb40f55e0 2024-02-15T18:30:36.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.663+0000 7f0bb0ff9700 1 -- 172.21.15.33:0/4128491732 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 21) v1 ==== 74466+0+0 (secure 0 0 0) 0x7f0ba401b030 con 0x7f0bb40f55e0 2024-02-15T18:30:36.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.663+0000 7f0bb0ff9700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f0ba005e6f0 0x7f0ba0060bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:36.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.663+0000 7f0bb0ff9700 1 -- 172.21.15.33:0/4128491732 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0ba4078b90 con 0x7f0bb40f55e0 2024-02-15T18:30:36.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.663+0000 7f0baaffd700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f0ba005e6f0 0x7f0ba0060bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:36.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.664+0000 7f0baaffd700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f0ba005e6f0 0x7f0ba0060bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0b9c005010 tx=0x7f0b9c016040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:36.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.671+0000 7f0bb0ff9700 1 -- 172.21.15.33:0/4128491732 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f0ba4049280 con 0x7f0bb40f55e0 2024-02-15T18:30:36.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:35.508575+0000 mon.smithi033 (mon.0) 593 : cluster [DBG] mgrmap e20: smithi131.buibla(active, starting, since 0.175617s), standbys: smithi033.apxevf 2024-02-15T18:30:36.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.511296+0000 mon.smithi131 (mon.1) 21 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:30:36.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.511481+0000 mon.smithi131 (mon.1) 22 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:30:36.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.515382+0000 mon.smithi131 (mon.1) 23 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:30:36.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.515655+0000 mon.smithi131 (mon.1) 24 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:30:36.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.515905+0000 mon.smithi131 (mon.1) 25 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.516165+0000 mon.smithi131 (mon.1) 26 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.516470+0000 mon.smithi131 (mon.1) 27 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr metadata", "who": "smithi131.buibla", "id": "smithi131.buibla"}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.516836+0000 mon.smithi131 (mon.1) 28 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr metadata", "who": "smithi033.apxevf", "id": "smithi033.apxevf"}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.517078+0000 mon.smithi131 (mon.1) 29 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.517397+0000 mon.smithi131 (mon.1) 30 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.517683+0000 mon.smithi131 (mon.1) 31 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.517966+0000 mon.smithi131 (mon.1) 32 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.518260+0000 mon.smithi131 (mon.1) 33 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.518545+0000 mon.smithi131 (mon.1) 34 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.518861+0000 mon.smithi131 (mon.1) 35 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.519485+0000 mon.smithi131 (mon.1) 36 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.520063+0000 mon.smithi131 (mon.1) 37 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:35.547844+0000 mon.smithi033 (mon.0) 594 : cluster [INF] Manager daemon smithi131.buibla is now available 2024-02-15T18:30:36.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.660362+0000 mon.smithi131 (mon.1) 38 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:36.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.661897+0000 mon.smithi131 (mon.1) 39 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:36.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.702244+0000 mon.smithi033 (mon.0) 595 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:36.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.723467+0000 mon.smithi033 (mon.0) 596 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:36.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.730690+0000 mon.smithi131 (mon.1) 40 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.buibla/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:30:36.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.730982+0000 mon.smithi033 (mon.0) 597 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.buibla/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:30:36.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.746363+0000 mon.smithi131 (mon.1) 41 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.buibla/trash_purge_schedule"}]: dispatch 2024-02-15T18:30:36.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:35.746756+0000 mon.smithi033 (mon.0) 598 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.buibla/trash_purge_schedule"}]: dispatch 2024-02-15T18:30:36.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.861+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 --> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bb40fb2e0 con 0x7f0ba005e6f0 2024-02-15T18:30:36.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.863+0000 7f0bb0ff9700 1 -- 172.21.15.33:0/4128491732 <== mgr.24387 v2:172.21.15.131:6828/3968122283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0bb40fb2e0 con 0x7f0ba005e6f0 2024-02-15T18:30:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f0ba005e6f0 msgr2=0x7f0ba0060bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f0ba005e6f0 0x7f0ba0060bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0b9c005010 tx=0x7f0b9c016040).stop 2024-02-15T18:30:36.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bb40f55e0 msgr2=0x7f0bb4109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bb40f55e0 0x7f0bb4109210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0ba400e7c0 tx=0x7f0ba400b040).stop 2024-02-15T18:30:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 shutdown_connections 2024-02-15T18:30:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f0ba005e6f0 0x7f0ba0060bb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0bb40f55e0 0x7f0bb4109210 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 --2- 172.21.15.33:0/4128491732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bb40f6880 0x7f0bb4109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 >> 172.21.15.33:0/4128491732 conn(0x7f0bb40f0d40 msgr2=0x7f0bb405f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 shutdown_connections 2024-02-15T18:30:36.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.865+0000 7f0bb9f81700 1 -- 172.21.15.33:0/4128491732 wait complete. 2024-02-15T18:30:36.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.978+0000 7f2fe8841700 1 -- 172.21.15.33:0/982401187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 msgr2=0x7f2fe40f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.978+0000 7f2fe8841700 1 --2- 172.21.15.33:0/982401187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 0x7f2fe40f5810 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2fd8004660 tx=0x7f2fd8009b30).stop 2024-02-15T18:30:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.978+0000 7f2fe8841700 1 -- 172.21.15.33:0/982401187 shutdown_connections 2024-02-15T18:30:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.978+0000 7f2fe8841700 1 --2- 172.21.15.33:0/982401187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 0x7f2fe40f5810 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.978+0000 7f2fe8841700 1 --2- 172.21.15.33:0/982401187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fe40f6a20 0x7f2fe40f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.978+0000 7f2fe8841700 1 -- 172.21.15.33:0/982401187 >> 172.21.15.33:0/982401187 conn(0x7f2fe40f0320 msgr2=0x7f2fe40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.978+0000 7f2fe8841700 1 -- 172.21.15.33:0/982401187 shutdown_connections 2024-02-15T18:30:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.978+0000 7f2fe8841700 1 -- 172.21.15.33:0/982401187 wait complete. 2024-02-15T18:30:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe8841700 1 Processor -- start 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe8841700 1 -- start start 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe8841700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fe40f6a20 0x7f2fe4106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe8841700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 0x7f2fe4107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe8841700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe4107940 con 0x7f2fe40f73c0 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe8841700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe4108150 con 0x7f2fe40f6a20 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 0x7f2fe4107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 0x7f2fe4107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46572/0 (socket says 172.21.15.33:46572) 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe259c700 1 -- 172.21.15.33:0/201516119 learned_addr learned my addr 172.21.15.33:0/201516119 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe2d9d700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fe40f6a20 0x7f2fe4106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe259c700 1 -- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fe40f6a20 msgr2=0x7f2fe4106e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe259c700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fe40f6a20 0x7f2fe4106e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.979+0000 7f2fe259c700 1 -- 172.21.15.33:0/201516119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8005040 con 0x7f2fe40f73c0 2024-02-15T18:30:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.980+0000 7f2fe259c700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 0x7f2fe4107340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f2fd8002040 tx=0x7f2fd800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:36.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.980+0000 7f2fcb7fe700 1 -- 172.21.15.33:0/201516119 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd8019070 con 0x7f2fe40f73c0 2024-02-15T18:30:36.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.980+0000 7f2fcb7fe700 1 -- 172.21.15.33:0/201516119 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f2fd8007e80 con 0x7f2fe40f73c0 2024-02-15T18:30:36.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.980+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe4108370 con 0x7f2fe40f73c0 2024-02-15T18:30:36.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.980+0000 7f2fcb7fe700 1 -- 172.21.15.33:0/201516119 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd8014db0 con 0x7f2fe40f73c0 2024-02-15T18:30:36.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.980+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe41088d0 con 0x7f2fe40f73c0 2024-02-15T18:30:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.981+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe4059100 con 0x7f2fe40f73c0 2024-02-15T18:30:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.981+0000 7f2fcb7fe700 1 -- 172.21.15.33:0/201516119 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) v1 ==== 74466+0+0 (secure 0 0 0) 0x7f2fd8025070 con 0x7f2fe40f73c0 2024-02-15T18:30:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.982+0000 7f2fcb7fe700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f2fcc05e6e0 0x7f2fcc060ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.982+0000 7f2fcb7fe700 1 -- 172.21.15.33:0/201516119 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2fd8079c10 con 0x7f2fe40f73c0 2024-02-15T18:30:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.982+0000 7f2fe2d9d700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f2fcc05e6e0 0x7f2fcc060ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.983+0000 7f2fe2d9d700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f2fcc05e6e0 0x7f2fcc060ba0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f2fe4106bc0 tx=0x7f2fd400b040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:36.987+0000 7f2fcb7fe700 1 -- 172.21.15.33:0/201516119 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f2fd804a2a0 con 0x7f2fe40f73c0 2024-02-15T18:30:36.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:35.508575+0000 mon.smithi033 (mon.0) 593 : cluster [DBG] mgrmap e20: smithi131.buibla(active, starting, since 0.175617s), standbys: smithi033.apxevf 2024-02-15T18:30:36.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.511296+0000 mon.smithi131 (mon.1) 21 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:30:36.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.511481+0000 mon.smithi131 (mon.1) 22 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:30:36.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.515382+0000 mon.smithi131 (mon.1) 23 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.515655+0000 mon.smithi131 (mon.1) 24 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.515905+0000 mon.smithi131 (mon.1) 25 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.516165+0000 mon.smithi131 (mon.1) 26 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.516470+0000 mon.smithi131 (mon.1) 27 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr metadata", "who": "smithi131.buibla", "id": "smithi131.buibla"}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.516836+0000 mon.smithi131 (mon.1) 28 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr metadata", "who": "smithi033.apxevf", "id": "smithi033.apxevf"}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.517078+0000 mon.smithi131 (mon.1) 29 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.517397+0000 mon.smithi131 (mon.1) 30 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.517683+0000 mon.smithi131 (mon.1) 31 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.517966+0000 mon.smithi131 (mon.1) 32 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.518260+0000 mon.smithi131 (mon.1) 33 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.518545+0000 mon.smithi131 (mon.1) 34 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.518861+0000 mon.smithi131 (mon.1) 35 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.519485+0000 mon.smithi131 (mon.1) 36 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.520063+0000 mon.smithi131 (mon.1) 37 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:30:37.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:35.547844+0000 mon.smithi033 (mon.0) 594 : cluster [INF] Manager daemon smithi131.buibla is now available 2024-02-15T18:30:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.660362+0000 mon.smithi131 (mon.1) 38 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.661897+0000 mon.smithi131 (mon.1) 39 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:30:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.702244+0000 mon.smithi033 (mon.0) 595 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.723467+0000 mon.smithi033 (mon.0) 596 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.730690+0000 mon.smithi131 (mon.1) 40 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.buibla/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:30:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.730982+0000 mon.smithi033 (mon.0) 597 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.buibla/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:30:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.746363+0000 mon.smithi131 (mon.1) 41 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.buibla/trash_purge_schedule"}]: dispatch 2024-02-15T18:30:37.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:35.746756+0000 mon.smithi033 (mon.0) 598 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.buibla/trash_purge_schedule"}]: dispatch 2024-02-15T18:30:37.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.182+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 --> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fe40f4e10 con 0x7f2fcc05e6e0 2024-02-15T18:30:37.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.195+0000 7f2fcb7fe700 1 -- 172.21.15.33:0/201516119 <== mgr.24387 v2:172.21.15.131:6828/3968122283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f2fe40f4e10 con 0x7f2fcc05e6e0 2024-02-15T18:30:37.189 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:30:37.189 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (5m) 89s ago 7m 15.9M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:30:37.189 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (7m) 89s ago 7m 6391k - 16.2.4 8d91d370c2b8 6deae8bbd6c5 2024-02-15T18:30:37.189 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (6m) 5s ago 6m 6395k - 16.2.4 8d91d370c2b8 e45b11308af7 2024-02-15T18:30:37.189 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (5m) 89s ago 6m 29.2M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:30:37.189 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (107s) 89s ago 106s 14.5M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:30:37.189 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (115s) 89s ago 113s 11.5M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:30:37.189 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (111s) 5s ago 111s 19.6M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (118s) 5s ago 118s 65.5M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:9283 running (8m) 89s ago 8m 407M - 16.2.4 8d91d370c2b8 c319170b238f 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (9s) 5s ago 6m 41.9M - 16.2.14-521-g0e714d9a 1fbc92c859dc 220e23710038 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (8m) 89s ago 8m 60.3M 2048M 16.2.4 8d91d370c2b8 04c43c0cba21 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (6m) 5s ago 6m 38.4M 2048M 16.2.4 8d91d370c2b8 710ae4544ec3 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (6m) 89s ago 6m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (5m) 5s ago 5m 17.0M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (5m) 89s ago 5m 39.7M 4096M 16.2.4 8d91d370c2b8 8fd8ca242c54 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (5m) 89s ago 5m 39.9M 4096M 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (4m) 89s ago 4m 39.6M 4096M 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (4m) 5s ago 4m 46.4M 4096M 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:30:37.190 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (3m) 5s ago 3m 45.9M 4096M 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:30:37.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (3m) 5s ago 3m 48.0M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:30:37.191 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (5m) 89s ago 6m 29.9M - 2.18.1 de242295e225 0b5ba62c4d4c 2024-02-15T18:30:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f2fcc05e6e0 msgr2=0x7f2fcc060ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f2fcc05e6e0 0x7f2fcc060ba0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f2fe4106bc0 tx=0x7f2fd400b040).stop 2024-02-15T18:30:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 msgr2=0x7f2fe4107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 0x7f2fe4107340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f2fd8002040 tx=0x7f2fd800b040).stop 2024-02-15T18:30:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 shutdown_connections 2024-02-15T18:30:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f2fcc05e6e0 0x7f2fcc060ba0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fe40f6a20 0x7f2fe4106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 --2- 172.21.15.33:0/201516119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fe40f73c0 0x7f2fe4107340 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 >> 172.21.15.33:0/201516119 conn(0x7f2fe40f0320 msgr2=0x7f2fe40f4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 shutdown_connections 2024-02-15T18:30:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.197+0000 7f2fe8841700 1 -- 172.21.15.33:0/201516119 wait complete. 2024-02-15T18:30:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.301+0000 7f4221e9d700 1 -- 172.21.15.33:0/829848534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 msgr2=0x7f421c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.301+0000 7f4221e9d700 1 --2- 172.21.15.33:0/829848534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 0x7f421c0f59e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f420c004660 tx=0x7f420c009b30).stop 2024-02-15T18:30:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.301+0000 7f4221e9d700 1 -- 172.21.15.33:0/829848534 shutdown_connections 2024-02-15T18:30:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.301+0000 7f4221e9d700 1 --2- 172.21.15.33:0/829848534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f421c0f6860 0x7f421c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.301+0000 7f4221e9d700 1 --2- 172.21.15.33:0/829848534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 0x7f421c0f59e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.301+0000 7f4221e9d700 1 -- 172.21.15.33:0/829848534 >> 172.21.15.33:0/829848534 conn(0x7f421c0f0d40 msgr2=0x7f421c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.301+0000 7f4221e9d700 1 -- 172.21.15.33:0/829848534 shutdown_connections 2024-02-15T18:30:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.301+0000 7f4221e9d700 1 -- 172.21.15.33:0/829848534 wait complete. 2024-02-15T18:30:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.302+0000 7f4221e9d700 1 Processor -- start 2024-02-15T18:30:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.302+0000 7f4221e9d700 1 -- start start 2024-02-15T18:30:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.302+0000 7f4221e9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 0x7f421c106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.302+0000 7f4221e9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f421c0f6860 0x7f421c1074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.302+0000 7f4221e9d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c107a90 con 0x7f421c0f55c0 2024-02-15T18:30:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.302+0000 7f4221e9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c107bd0 con 0x7f421c0f6860 2024-02-15T18:30:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f421b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 0x7f421c106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f421b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 0x7f421c106ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46586/0 (socket says 172.21.15.33:46586) 2024-02-15T18:30:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f421b7fe700 1 -- 172.21.15.33:0/2422617920 learned_addr learned my addr 172.21.15.33:0/2422617920 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f421affd700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f421c0f6860 0x7f421c1074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f421b7fe700 1 -- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f421c0f6860 msgr2=0x7f421c1074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f421b7fe700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f421c0f6860 0x7f421c1074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f421b7fe700 1 -- 172.21.15.33:0/2422617920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c005040 con 0x7f421c0f55c0 2024-02-15T18:30:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f421b7fe700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 0x7f421c106ff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f420c002040 tx=0x7f420c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f4203fff700 1 -- 172.21.15.33:0/2422617920 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420c019070 con 0x7f421c0f55c0 2024-02-15T18:30:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c108510 con 0x7f421c0f55c0 2024-02-15T18:30:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f4203fff700 1 -- 172.21.15.33:0/2422617920 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f420c007e80 con 0x7f421c0f55c0 2024-02-15T18:30:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f4203fff700 1 -- 172.21.15.33:0/2422617920 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420c014db0 con 0x7f421c0f55c0 2024-02-15T18:30:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.303+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c108a70 con 0x7f421c0f55c0 2024-02-15T18:30:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.304+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c045ad0 con 0x7f421c0f55c0 2024-02-15T18:30:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.305+0000 7f4203fff700 1 -- 172.21.15.33:0/2422617920 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) v1 ==== 74466+0+0 (secure 0 0 0) 0x7f420c025070 con 0x7f421c0f55c0 2024-02-15T18:30:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.305+0000 7f4203fff700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f420405e690 0x7f4204060b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.305+0000 7f4203fff700 1 -- 172.21.15.33:0/2422617920 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f420c079c80 con 0x7f421c0f55c0 2024-02-15T18:30:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.306+0000 7f421affd700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f420405e690 0x7f4204060b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.306+0000 7f421affd700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f420405e690 0x7f4204060b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4210009fd0 tx=0x7f421000b040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.310+0000 7f4203fff700 1 -- 172.21.15.33:0/2422617920 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f420c04a250 con 0x7f421c0f55c0 2024-02-15T18:30:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.533+0000 7f4203fff700 1 -- 172.21.15.33:0/2422617920 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 22) v1 ==== 74714+0+0 (secure 0 0 0) 0x7f420c077d40 con 0x7f421c0f55c0 2024-02-15T18:30:37.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.572+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f421c10d610 con 0x7f421c0f55c0 2024-02-15T18:30:37.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.572+0000 7f4203fff700 1 -- 172.21.15.33:0/2422617920 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f420c03f110 con 0x7f421c0f55c0 2024-02-15T18:30:37.566 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:30:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:30:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:30:37.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 13 2024-02-15T18:30:37.567 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:30:37.568 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:30:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.574+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f420405e690 msgr2=0x7f4204060b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.574+0000 7f4221e9d700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f420405e690 0x7f4204060b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4210009fd0 tx=0x7f421000b040).stop 2024-02-15T18:30:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.575+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 msgr2=0x7f421c106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.575+0000 7f4221e9d700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 0x7f421c106ff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f420c002040 tx=0x7f420c00b040).stop 2024-02-15T18:30:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.575+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 shutdown_connections 2024-02-15T18:30:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.575+0000 7f4221e9d700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f420405e690 0x7f4204060b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.575+0000 7f4221e9d700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f421c0f55c0 0x7f421c106ff0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.575+0000 7f4221e9d700 1 --2- 172.21.15.33:0/2422617920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f421c0f6860 0x7f421c1074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.575+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 >> 172.21.15.33:0/2422617920 conn(0x7f421c0f0d40 msgr2=0x7f421c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.575+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 shutdown_connections 2024-02-15T18:30:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.575+0000 7f4221e9d700 1 -- 172.21.15.33:0/2422617920 wait complete. 2024-02-15T18:30:37.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.699+0000 7f8eb78bd700 1 -- 172.21.15.33:0/3265351780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f4de0 msgr2=0x7f8eb00f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:37.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.699+0000 7f8eb78bd700 1 --2- 172.21.15.33:0/3265351780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f4de0 0x7f8eb00f5200 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f8eac004770 tx=0x7f8eac00ac40).stop 2024-02-15T18:30:37.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.699+0000 7f8eb78bd700 1 -- 172.21.15.33:0/3265351780 shutdown_connections 2024-02-15T18:30:37.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.699+0000 7f8eb78bd700 1 --2- 172.21.15.33:0/3265351780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eb00f5fe0 0x7f8eb00f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.699+0000 7f8eb78bd700 1 --2- 172.21.15.33:0/3265351780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f4de0 0x7f8eb00f5200 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.699+0000 7f8eb78bd700 1 -- 172.21.15.33:0/3265351780 >> 172.21.15.33:0/3265351780 conn(0x7f8eb00f0540 msgr2=0x7f8eb00f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:37.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.699+0000 7f8eb78bd700 1 -- 172.21.15.33:0/3265351780 shutdown_connections 2024-02-15T18:30:37.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.699+0000 7f8eb78bd700 1 -- 172.21.15.33:0/3265351780 wait complete. 2024-02-15T18:30:37.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb78bd700 1 Processor -- start 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb78bd700 1 -- start start 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb78bd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eb00f4de0 0x7f8eb0068c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb78bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f5fe0 0x7f8eb0069170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb78bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0069720 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb78bd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0069860 con 0x7f8eb00f4de0 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb4e58700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f5fe0 0x7f8eb0069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb4e58700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f5fe0 0x7f8eb0069170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46606/0 (socket says 172.21.15.33:46606) 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb4e58700 1 -- 172.21.15.33:0/490808998 learned_addr learned my addr 172.21.15.33:0/490808998 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb5659700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eb00f4de0 0x7f8eb0068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb4e58700 1 -- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eb00f4de0 msgr2=0x7f8eb0068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb4e58700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eb00f4de0 0x7f8eb0068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:37.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.700+0000 7f8eb4e58700 1 -- 172.21.15.33:0/490808998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac005040 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.701+0000 7f8eb4e58700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f5fe0 0x7f8eb0069170 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f8ea00026d0 tx=0x7f8ea0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:37.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.701+0000 7f8ea5ffb700 1 -- 172.21.15.33:0/490808998 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea00079c0 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.701+0000 7f8ea5ffb700 1 -- 172.21.15.33:0/490808998 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f8ea000f040 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.701+0000 7f8ea5ffb700 1 -- 172.21.15.33:0/490808998 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea00149f0 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.701+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb0110dc0 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.701+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb0111380 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.702+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb0045ad0 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.703+0000 7f8ea5ffb700 1 -- 172.21.15.33:0/490808998 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) v1 ==== 74714+0+0 (secure 0 0 0) 0x7f8ea0007b20 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.703+0000 7f8ea5ffb700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f8e9c05e960 0x7f8e9c060e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:37.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.703+0000 7f8ea5ffb700 1 -- 172.21.15.33:0/490808998 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8ea007c070 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.704+0000 7f8eb5659700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f8e9c05e960 0x7f8e9c060e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:37.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.704+0000 7f8eb5659700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f8e9c05e960 0x7f8e9c060e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8eac004740 tx=0x7f8eac016040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:37.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:37.708+0000 7f8ea5ffb700 1 -- 172.21.15.33:0/490808998 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f8ea004c600 con 0x7f8eb00f5fe0 2024-02-15T18:30:37.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:36.526442+0000 mon.smithi033 (mon.0) 599 : cluster [DBG] mgrmap e21: smithi131.buibla(active, since 1.19348s), standbys: smithi033.apxevf 2024-02-15T18:30:37.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:36.536150+0000 mgr.smithi131.buibla (mgr.24387) 1 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 64 MiB data, 279 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:37.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:36.537013+0000 mgr.smithi131.buibla (mgr.24387) 2 : audit [DBG] from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:37.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:36.863386+0000 mgr.smithi131.buibla (mgr.24387) 3 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:37.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:37.183724+0000 mgr.smithi131.buibla (mgr.24387) 4 : audit [DBG] from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:37.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:36.526442+0000 mon.smithi033 (mon.0) 599 : cluster [DBG] mgrmap e21: smithi131.buibla(active, since 1.19348s), standbys: smithi033.apxevf 2024-02-15T18:30:37.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:36.536150+0000 mgr.smithi131.buibla (mgr.24387) 1 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 64 MiB data, 279 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:37.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:36.537013+0000 mgr.smithi131.buibla (mgr.24387) 2 : audit [DBG] from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:37.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:36.863386+0000 mgr.smithi131.buibla (mgr.24387) 3 : audit [DBG] from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:38.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:37.183724+0000 mgr.smithi131.buibla (mgr.24387) 4 : audit [DBG] from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:38.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.018+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8eb0027a00 con 0x7f8eb00f5fe0 2024-02-15T18:30:38.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.018+0000 7f8ea5ffb700 1 -- 172.21.15.33:0/490808998 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1690 (secure 0 0 0) 0x7f8ea004c1f0 con 0x7f8eb00f5fe0 2024-02-15T18:30:38.012 INFO:teuthology.orchestra.run.smithi033.stdout:e18 2024-02-15T18:30:38.012 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:30:38.012 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:30:38.012 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:30:38.012 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:30:38.012 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:30:38.012 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 18 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:30:34.499671+0000 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:30:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707]] 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411]] 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:30:38.014 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:30:38.015 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:30:38.015 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:30:38.015 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613]] 2024-02-15T18:30:38.015 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278]] 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f8e9c05e960 msgr2=0x7f8e9c060e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f8e9c05e960 0x7f8e9c060e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8eac004740 tx=0x7f8eac016040).stop 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f5fe0 msgr2=0x7f8eb0069170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f5fe0 0x7f8eb0069170 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f8ea00026d0 tx=0x7f8ea0009de0).stop 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 shutdown_connections 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f8e9c05e960 0x7f8e9c060e20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8eb00f4de0 0x7f8eb0068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 --2- 172.21.15.33:0/490808998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb00f5fe0 0x7f8eb0069170 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 >> 172.21.15.33:0/490808998 conn(0x7f8eb00f0540 msgr2=0x7f8eb00f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 shutdown_connections 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.020+0000 7f8eb78bd700 1 -- 172.21.15.33:0/490808998 wait complete. 2024-02-15T18:30:38.016 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 18 2024-02-15T18:30:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.127+0000 7f85ce47a700 1 -- 172.21.15.33:0/2049148466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f66d0 msgr2=0x7f85c80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.127+0000 7f85ce47a700 1 --2- 172.21.15.33:0/2049148466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f66d0 0x7f85c80f6b30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f85b8004660 tx=0x7f85b8009b30).stop 2024-02-15T18:30:38.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 -- 172.21.15.33:0/2049148466 shutdown_connections 2024-02-15T18:30:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 --2- 172.21.15.33:0/2049148466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f66d0 0x7f85c80f6b30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 --2- 172.21.15.33:0/2049148466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c80f5430 0x7f85c80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 -- 172.21.15.33:0/2049148466 >> 172.21.15.33:0/2049148466 conn(0x7f85c80f0b90 msgr2=0x7f85c80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 -- 172.21.15.33:0/2049148466 shutdown_connections 2024-02-15T18:30:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 -- 172.21.15.33:0/2049148466 wait complete. 2024-02-15T18:30:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 Processor -- start 2024-02-15T18:30:38.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 -- start start 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f5430 0x7f85c80f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.128+0000 7f85ce47a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c80f66d0 0x7f85c80f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85ce47a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80f7f70 con 0x7f85c80f5430 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85ce47a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80f80b0 con 0x7f85c80f66d0 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85cd478700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f5430 0x7f85c80f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85cd478700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f5430 0x7f85c80f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46628/0 (socket says 172.21.15.33:46628) 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85cd478700 1 -- 172.21.15.33:0/738210736 learned_addr learned my addr 172.21.15.33:0/738210736 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85ccc77700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c80f66d0 0x7f85c80f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85cd478700 1 -- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c80f66d0 msgr2=0x7f85c80f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85cd478700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c80f66d0 0x7f85c80f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85cd478700 1 -- 172.21.15.33:0/738210736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8005040 con 0x7f85c80f5430 2024-02-15T18:30:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85cd478700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f5430 0x7f85c80f9590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f85c400e7c0 tx=0x7f85c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85bdffb700 1 -- 172.21.15.33:0/738210736 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c40092e0 con 0x7f85c80f5430 2024-02-15T18:30:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c80f8390 con 0x7f85c80f5430 2024-02-15T18:30:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85bdffb700 1 -- 172.21.15.33:0/738210736 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f85c400f040 con 0x7f85c80f5430 2024-02-15T18:30:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.129+0000 7f85bdffb700 1 -- 172.21.15.33:0/738210736 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c4014920 con 0x7f85c80f5430 2024-02-15T18:30:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.130+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c810edf0 con 0x7f85c80f5430 2024-02-15T18:30:38.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.131+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c8045ad0 con 0x7f85c80f5430 2024-02-15T18:30:38.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.132+0000 7f85bdffb700 1 -- 172.21.15.33:0/738210736 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) v1 ==== 74714+0+0 (secure 0 0 0) 0x7f85c401b030 con 0x7f85c80f5430 2024-02-15T18:30:38.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.132+0000 7f85bdffb700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f85b405e9b0 0x7f85b4060e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:30:38.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.132+0000 7f85bdffb700 1 -- 172.21.15.33:0/738210736 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f85c40799f0 con 0x7f85c80f5430 2024-02-15T18:30:38.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.133+0000 7f85ccc77700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f85b405e9b0 0x7f85b4060e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:30:38.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.133+0000 7f85ccc77700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f85b405e9b0 0x7f85b4060e70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f85b8009720 tx=0x7f85b8016040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:30:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.136+0000 7f85bdffb700 1 -- 172.21.15.33:0/738210736 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f85c404b000 con 0x7f85c80f5430 2024-02-15T18:30:38.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.343+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 --> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85c80fab10 con 0x7f85b405e9b0 2024-02-15T18:30:38.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.344+0000 7f85bdffb700 1 -- 172.21.15.33:0/738210736 <== mgr.24387 v2:172.21.15.131:6828/3968122283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f85c80fab10 con 0x7f85b405e9b0 2024-02-15T18:30:38.338 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:30:38.338 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:30:38.338 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:30:38.338 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:30:38.338 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T18:30:38.338 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "1/21 daemons upgraded", 2024-02-15T18:30:38.338 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "", 2024-02-15T18:30:38.338 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:30:38.338 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f85b405e9b0 msgr2=0x7f85b4060e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f85b405e9b0 0x7f85b4060e70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f85b8009720 tx=0x7f85b8016040).stop 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f5430 msgr2=0x7f85c80f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f5430 0x7f85c80f9590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f85c400e7c0 tx=0x7f85c400b040).stop 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 shutdown_connections 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f85b405e9b0 0x7f85b4060e70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85c80f5430 0x7f85c80f9590 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 --2- 172.21.15.33:0/738210736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85c80f66d0 0x7f85c80f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 >> 172.21.15.33:0/738210736 conn(0x7f85c80f0b90 msgr2=0x7f85c805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 shutdown_connections 2024-02-15T18:30:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:30:38.346+0000 7f85ce47a700 1 -- 172.21.15.33:0/738210736 wait complete. 2024-02-15T18:30:38.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:37.515217+0000 mgr.smithi131.buibla (mgr.24387) 5 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 64 MiB data, 279 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:38.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:37.532967+0000 mon.smithi033 (mon.0) 600 : cluster [DBG] mgrmap e22: smithi131.buibla(active, since 2s), standbys: smithi033.apxevf 2024-02-15T18:30:38.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:37.573225+0000 mon.smithi033 (mon.0) 601 : audit [DBG] from='client.? 172.21.15.33:0/2422617920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:38.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:38.019317+0000 mon.smithi033 (mon.0) 602 : audit [DBG] from='client.? 172.21.15.33:0/490808998' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:30:38.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:38.344708+0000 mgr.smithi131.buibla (mgr.24387) 6 : audit [DBG] from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:38.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:37.515217+0000 mgr.smithi131.buibla (mgr.24387) 5 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 64 MiB data, 279 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:38.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:37.532967+0000 mon.smithi033 (mon.0) 600 : cluster [DBG] mgrmap e22: smithi131.buibla(active, since 2s), standbys: smithi033.apxevf 2024-02-15T18:30:38.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:37.573225+0000 mon.smithi033 (mon.0) 601 : audit [DBG] from='client.? 172.21.15.33:0/2422617920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:30:39.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:38.019317+0000 mon.smithi033 (mon.0) 602 : audit [DBG] from='client.? 172.21.15.33:0/490808998' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:30:39.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:38.344708+0000 mgr.smithi131.buibla (mgr.24387) 6 : audit [DBG] from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:30:39.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:39.062219+0000 mon.smithi033 (mon.0) 603 : cluster [DBG] Standby manager daemon smithi033.apxevf restarted 2024-02-15T18:30:39.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:39.062340+0000 mon.smithi033 (mon.0) 604 : cluster [DBG] Standby manager daemon smithi033.apxevf started 2024-02-15T18:30:39.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:39.063832+0000 mon.smithi033 (mon.0) 605 : audit [DBG] from='mgr.? 172.21.15.33:0/96508376' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.apxevf/crt"}]: dispatch 2024-02-15T18:30:39.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:39.066855+0000 mon.smithi033 (mon.0) 606 : audit [DBG] from='mgr.? 172.21.15.33:0/96508376' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:30:39.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:39.068584+0000 mon.smithi033 (mon.0) 607 : audit [DBG] from='mgr.? 172.21.15.33:0/96508376' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.apxevf/key"}]: dispatch 2024-02-15T18:30:39.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:39.068890+0000 mon.smithi033 (mon.0) 608 : audit [DBG] from='mgr.? 172.21.15.33:0/96508376' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:30:39.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:39.062219+0000 mon.smithi033 (mon.0) 603 : cluster [DBG] Standby manager daemon smithi033.apxevf restarted 2024-02-15T18:30:39.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:39.062340+0000 mon.smithi033 (mon.0) 604 : cluster [DBG] Standby manager daemon smithi033.apxevf started 2024-02-15T18:30:39.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:39.063832+0000 mon.smithi033 (mon.0) 605 : audit [DBG] from='mgr.? 172.21.15.33:0/96508376' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.apxevf/crt"}]: dispatch 2024-02-15T18:30:40.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:39.066855+0000 mon.smithi033 (mon.0) 606 : audit [DBG] from='mgr.? 172.21.15.33:0/96508376' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:30:40.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:39.068584+0000 mon.smithi033 (mon.0) 607 : audit [DBG] from='mgr.? 172.21.15.33:0/96508376' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.apxevf/key"}]: dispatch 2024-02-15T18:30:40.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:39.068890+0000 mon.smithi033 (mon.0) 608 : audit [DBG] from='mgr.? 172.21.15.33:0/96508376' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:30:40.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:39.515542+0000 mgr.smithi131.buibla (mgr.24387) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 64 MiB data, 279 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:40.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:39.538063+0000 mon.smithi033 (mon.0) 609 : cluster [DBG] mgrmap e23: smithi131.buibla(active, since 4s), standbys: smithi033.apxevf 2024-02-15T18:30:40.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:40.379554+0000 mon.smithi033 (mon.0) 610 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:41.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:39.515542+0000 mgr.smithi131.buibla (mgr.24387) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 64 MiB data, 279 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:41.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:39.538063+0000 mon.smithi033 (mon.0) 609 : cluster [DBG] mgrmap e23: smithi131.buibla(active, since 4s), standbys: smithi033.apxevf 2024-02-15T18:30:41.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:40.379554+0000 mon.smithi033 (mon.0) 610 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:41.515834+0000 mgr.smithi131.buibla (mgr.24387) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 64 MiB data, 279 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:43.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:42.350194+0000 mon.smithi033 (mon.0) 611 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:42.670018+0000 mon.smithi033 (mon.0) 612 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:42.675199+0000 mon.smithi033 (mon.0) 613 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:42.679958+0000 mon.smithi033 (mon.0) 614 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:42.685749+0000 mon.smithi033 (mon.0) 615 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:30:42.692518+0000 mon.smithi033 (mon.0) 616 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:41.515834+0000 mgr.smithi131.buibla (mgr.24387) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 64 MiB data, 279 MiB used, 536 GiB / 536 GiB avail 2024-02-15T18:30:43.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:42.350194+0000 mon.smithi033 (mon.0) 611 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:42.670018+0000 mon.smithi033 (mon.0) 612 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:42.675199+0000 mon.smithi033 (mon.0) 613 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:42.679958+0000 mon.smithi033 (mon.0) 614 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:42.685749+0000 mon.smithi033 (mon.0) 615 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:43.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:30:42.692518+0000 mon.smithi033 (mon.0) 616 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:30:44.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:30:42.707976+0000 mgr.smithi131.buibla (mgr.24387) 9 : cephadm [INF] Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T18:30:44.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:30:42.726258+0000 mgr.smithi131.buibla (mgr.24387) 10 : cephadm [INF] Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T18:30:44.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:30:42.707976+0000 mgr.smithi131.buibla (mgr.24387) 9 : cephadm [INF] Reconfiguring prometheus.smithi033 (dependencies changed)... 2024-02-15T18:30:44.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:30:42.726258+0000 mgr.smithi131.buibla (mgr.24387) 10 : cephadm [INF] Reconfiguring daemon prometheus.smithi033 on smithi033 2024-02-15T18:30:44.903 INFO:tasks.workunit.client.1.smithi131.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-15T18:30:44.904 INFO:tasks.workunit.client.1.smithi131.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T18:30:44.904 INFO:tasks.workunit.client.1.smithi131.stderr:+ make 2024-02-15T18:30:44.928 INFO:tasks.workunit.client.1.smithi131.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-15T18:30:45.185 INFO:tasks.workunit.client.1.smithi131.stderr:++ readlink -f fsstress 2024-02-15T18:30:45.186 INFO:tasks.workunit.client.1.smithi131.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-15T18:30:45.186 INFO:tasks.workunit.client.1.smithi131.stderr:+ popd 2024-02-15T18:30:45.186 INFO:tasks.workunit.client.1.smithi131.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-15T18:30:45.186 INFO:tasks.workunit.client.1.smithi131.stderr:+ popd 2024-02-15T18:30:45.187 INFO:tasks.workunit.client.1.smithi131.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-15T18:30:45.187 INFO:tasks.workunit.client.1.smithi131.stderr:++ mktemp -d -p . 2024-02-15T18:30:45.188 INFO:tasks.workunit.client.1.smithi131.stderr:+ T=./tmp.I3dcBQJZUq 2024-02-15T18:30:45.188 INFO:tasks.workunit.client.1.smithi131.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.I3dcBQJZUq -l 1 -n 1000 -p 10 -v 2024-02-15T18:30:45.189 INFO:tasks.workunit.client.1.smithi131.stdout:seed = 1707956859 2024-02-15T18:30:45.191 INFO:tasks.workunit.client.1.smithi131.stdout:0/0: dwrite - no filename 2024-02-15T18:30:45.192 INFO:tasks.workunit.client.1.smithi131.stdout:1/0: link - no file 2024-02-15T18:30:45.192 INFO:tasks.workunit.client.1.smithi131.stdout:1/1: dwrite - no filename 2024-02-15T18:30:45.192 INFO:tasks.workunit.client.1.smithi131.stdout:1/2: write - no filename 2024-02-15T18:30:45.192 INFO:tasks.workunit.client.1.smithi131.stdout:0/1: creat f0 x:0 0 0 2024-02-15T18:30:45.193 INFO:tasks.workunit.client.1.smithi131.stdout:0/2: chown f0 10 1 2024-02-15T18:30:45.193 INFO:tasks.workunit.client.1.smithi131.stdout:2/0: rename - no filename 2024-02-15T18:30:45.193 INFO:tasks.workunit.client.1.smithi131.stdout:2/1: chown . 10 1 2024-02-15T18:30:45.193 INFO:tasks.workunit.client.1.smithi131.stdout:2/2: rename - no filename 2024-02-15T18:30:45.193 INFO:tasks.workunit.client.1.smithi131.stdout:2/3: write - no filename 2024-02-15T18:30:45.193 INFO:tasks.workunit.client.1.smithi131.stdout:2/4: truncate - no filename 2024-02-15T18:30:45.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/3: mkdir d0 0 2024-02-15T18:30:45.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/4: truncate - no filename 2024-02-15T18:30:45.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/5: dwrite - no filename 2024-02-15T18:30:45.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/6: getdents d0 0 2024-02-15T18:30:45.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/7: dread - no filename 2024-02-15T18:30:45.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/8: chown d0 127 1 2024-02-15T18:30:45.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/9: readlink - no filename 2024-02-15T18:30:45.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/10: chown d0 12 1 2024-02-15T18:30:45.195 INFO:tasks.workunit.client.1.smithi131.stdout:4/0: dread - no filename 2024-02-15T18:30:45.195 INFO:tasks.workunit.client.1.smithi131.stdout:1/11: mkdir d0/d1 0 2024-02-15T18:30:45.195 INFO:tasks.workunit.client.1.smithi131.stdout:1/12: write - no filename 2024-02-15T18:30:45.199 INFO:tasks.workunit.client.1.smithi131.stdout:0/3: fsync f0 0 2024-02-15T18:30:45.199 INFO:tasks.workunit.client.1.smithi131.stdout:0/4: truncate f0 220579 0 2024-02-15T18:30:45.200 INFO:tasks.workunit.client.1.smithi131.stdout:4/1: mkdir d0 0 2024-02-15T18:30:45.201 INFO:tasks.workunit.client.1.smithi131.stdout:1/13: mkdir d0/d2 0 2024-02-15T18:30:45.201 INFO:tasks.workunit.client.1.smithi131.stdout:1/14: chown d0/d2 57508 1 2024-02-15T18:30:45.201 INFO:tasks.workunit.client.1.smithi131.stdout:1/15: stat d0 0 2024-02-15T18:30:45.202 INFO:tasks.workunit.client.1.smithi131.stdout:5/0: write - no filename 2024-02-15T18:30:45.202 INFO:tasks.workunit.client.1.smithi131.stdout:0/5: getdents . 0 2024-02-15T18:30:45.204 INFO:tasks.workunit.client.1.smithi131.stdout:4/2: rmdir d0 0 2024-02-15T18:30:45.204 INFO:tasks.workunit.client.1.smithi131.stdout:4/3: write - no filename 2024-02-15T18:30:45.206 INFO:tasks.workunit.client.1.smithi131.stdout:6/0: stat - no entries 2024-02-15T18:30:45.206 INFO:tasks.workunit.client.1.smithi131.stdout:6/1: rename - no filename 2024-02-15T18:30:45.207 INFO:tasks.workunit.client.1.smithi131.stdout:6/2: write - no filename 2024-02-15T18:30:45.207 INFO:tasks.workunit.client.1.smithi131.stdout:6/3: rename - no filename 2024-02-15T18:30:45.207 INFO:tasks.workunit.client.1.smithi131.stdout:6/4: dread - no filename 2024-02-15T18:30:45.207 INFO:tasks.workunit.client.1.smithi131.stdout:6/5: dread - no filename 2024-02-15T18:30:45.209 INFO:tasks.workunit.client.1.smithi131.stdout:5/1: symlink l0 0 2024-02-15T18:30:45.210 INFO:tasks.workunit.client.1.smithi131.stdout:5/2: dread - no filename 2024-02-15T18:30:45.210 INFO:tasks.workunit.client.1.smithi131.stdout:0/6: creat f1 x:0 0 0 2024-02-15T18:30:45.210 INFO:tasks.workunit.client.1.smithi131.stdout:4/4: mknod c1 0 2024-02-15T18:30:45.210 INFO:tasks.workunit.client.1.smithi131.stdout:4/5: fsync - no filename 2024-02-15T18:30:45.210 INFO:tasks.workunit.client.1.smithi131.stdout:4/6: write - no filename 2024-02-15T18:30:45.212 INFO:tasks.workunit.client.1.smithi131.stdout:6/6: creat f0 x:0 0 0 2024-02-15T18:30:45.214 INFO:tasks.workunit.client.1.smithi131.stdout:7/0: fdatasync - no filename 2024-02-15T18:30:45.214 INFO:tasks.workunit.client.1.smithi131.stdout:7/1: truncate - no filename 2024-02-15T18:30:45.217 INFO:tasks.workunit.client.1.smithi131.stdout:4/7: mkdir d2 0 2024-02-15T18:30:45.218 INFO:tasks.workunit.client.1.smithi131.stdout:7/2: mkdir d0 0 2024-02-15T18:30:45.218 INFO:tasks.workunit.client.1.smithi131.stdout:7/3: dwrite - no filename 2024-02-15T18:30:45.220 INFO:tasks.workunit.client.1.smithi131.stdout:7/4: creat d0/f1 x:0 0 0 2024-02-15T18:30:45.221 INFO:tasks.workunit.client.1.smithi131.stdout:7/5: dread - d0/f1 zero size 2024-02-15T18:30:45.221 INFO:tasks.workunit.client.1.smithi131.stdout:4/8: mknod d2/c3 0 2024-02-15T18:30:45.221 INFO:tasks.workunit.client.1.smithi131.stdout:4/9: write - no filename 2024-02-15T18:30:45.221 INFO:tasks.workunit.client.1.smithi131.stdout:7/6: mknod d0/c2 0 2024-02-15T18:30:45.222 INFO:tasks.workunit.client.1.smithi131.stdout:4/10: creat d2/f4 x:0 0 0 2024-02-15T18:30:45.223 INFO:tasks.workunit.client.1.smithi131.stdout:0/7: dread f0 [0,4194304] 0 2024-02-15T18:30:45.223 INFO:tasks.workunit.client.1.smithi131.stdout:0/8: write f1 [299751,121121] 0 2024-02-15T18:30:45.226 INFO:tasks.workunit.client.1.smithi131.stdout:7/7: mknod d0/c3 0 2024-02-15T18:30:45.226 INFO:tasks.workunit.client.1.smithi131.stdout:0/9: creat f2 x:0 0 0 2024-02-15T18:30:45.227 INFO:tasks.workunit.client.1.smithi131.stdout:7/8: truncate d0/f1 512681 0 2024-02-15T18:30:45.227 INFO:tasks.workunit.client.1.smithi131.stdout:7/9: truncate d0/f1 1494971 0 2024-02-15T18:30:45.227 INFO:tasks.workunit.client.1.smithi131.stdout:4/11: link d2/c3 d2/c5 0 2024-02-15T18:30:45.228 INFO:tasks.workunit.client.1.smithi131.stdout:8/0: link - no file 2024-02-15T18:30:45.230 INFO:tasks.workunit.client.1.smithi131.stdout:7/10: unlink d0/c3 0 2024-02-15T18:30:45.230 INFO:tasks.workunit.client.1.smithi131.stdout:0/10: dread f0 [0,4194304] 0 2024-02-15T18:30:45.230 INFO:tasks.workunit.client.1.smithi131.stdout:0/11: rmdir - no directory 2024-02-15T18:30:45.230 INFO:tasks.workunit.client.1.smithi131.stdout:0/12: truncate f0 652355 0 2024-02-15T18:30:45.230 INFO:tasks.workunit.client.1.smithi131.stdout:4/12: creat d2/f6 x:0 0 0 2024-02-15T18:30:45.231 INFO:tasks.workunit.client.1.smithi131.stdout:8/1: creat f0 x:0 0 0 2024-02-15T18:30:45.235 INFO:tasks.workunit.client.1.smithi131.stdout:7/11: link d0/c2 d0/c4 0 2024-02-15T18:30:45.235 INFO:tasks.workunit.client.1.smithi131.stdout:9/0: fdatasync - no filename 2024-02-15T18:30:45.235 INFO:tasks.workunit.client.1.smithi131.stdout:9/1: read - no filename 2024-02-15T18:30:45.235 INFO:tasks.workunit.client.1.smithi131.stdout:9/2: chown . 236740 1 2024-02-15T18:30:45.235 INFO:tasks.workunit.client.1.smithi131.stdout:9/3: unlink - no file 2024-02-15T18:30:45.235 INFO:tasks.workunit.client.1.smithi131.stdout:9/4: write - no filename 2024-02-15T18:30:45.235 INFO:tasks.workunit.client.1.smithi131.stdout:9/5: write - no filename 2024-02-15T18:30:45.236 INFO:tasks.workunit.client.1.smithi131.stdout:0/13: creat f3 x:0 0 0 2024-02-15T18:30:45.236 INFO:tasks.workunit.client.1.smithi131.stdout:0/14: readlink - no filename 2024-02-15T18:30:45.242 INFO:tasks.workunit.client.1.smithi131.stdout:0/15: creat f4 x:0 0 0 2024-02-15T18:30:45.242 INFO:tasks.workunit.client.1.smithi131.stdout:9/6: creat f0 x:0 0 0 2024-02-15T18:30:45.242 INFO:tasks.workunit.client.1.smithi131.stdout:9/7: fdatasync f0 0 2024-02-15T18:30:45.242 INFO:tasks.workunit.client.1.smithi131.stdout:9/8: dread - f0 zero size 2024-02-15T18:30:45.242 INFO:tasks.workunit.client.1.smithi131.stdout:9/9: creat f1 x:0 0 0 2024-02-15T18:30:45.244 INFO:tasks.workunit.client.1.smithi131.stdout:9/10: link f1 f2 0 2024-02-15T18:30:45.244 INFO:tasks.workunit.client.1.smithi131.stdout:9/11: dread - f2 zero size 2024-02-15T18:30:45.247 INFO:tasks.workunit.client.1.smithi131.stdout:9/12: creat f3 x:0 0 0 2024-02-15T18:30:45.247 INFO:tasks.workunit.client.1.smithi131.stdout:9/13: read - f2 zero size 2024-02-15T18:30:45.247 INFO:tasks.workunit.client.1.smithi131.stdout:9/14: chown f2 24 1 2024-02-15T18:30:45.250 INFO:tasks.workunit.client.1.smithi131.stdout:9/15: mkdir d4 0 2024-02-15T18:30:45.250 INFO:tasks.workunit.client.1.smithi131.stdout:9/16: dread - f0 zero size 2024-02-15T18:30:45.250 INFO:tasks.workunit.client.1.smithi131.stdout:9/17: dread - f1 zero size 2024-02-15T18:30:45.258 INFO:tasks.workunit.client.1.smithi131.stdout:9/18: mknod d4/c5 0 2024-02-15T18:30:45.733 INFO:tasks.workunit.client.1.smithi131.stdout:5/3: getdents . 0 2024-02-15T18:30:45.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/19: fsync f3 0 2024-02-15T18:30:45.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/20: rename d4 to d4/d6 22 2024-02-15T18:30:45.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/21: chown d4 16457384 1 2024-02-15T18:30:45.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/22: read - f2 zero size 2024-02-15T18:30:45.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/23: write f1 [416197,57871] 0 2024-02-15T18:30:45.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/24: write f0 [34869,3844] 0 2024-02-15T18:30:45.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/25: rename d4 to d4/d7 22 2024-02-15T18:30:45.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/26: chown f0 33366401 1 2024-02-15T18:30:45.748 INFO:tasks.workunit.client.1.smithi131.stdout:8/2: getdents . 0 2024-02-15T18:30:45.748 INFO:tasks.workunit.client.1.smithi131.stdout:4/13: rmdir d2 39 2024-02-15T18:30:45.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:43.516320+0000 mgr.smithi131.buibla (mgr.24387) 11 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 80 MiB data, 334 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 8 op/s 2024-02-15T18:30:45.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:43.516320+0000 mgr.smithi131.buibla (mgr.24387) 11 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 80 MiB data, 334 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 8 op/s 2024-02-15T18:30:46.017 INFO:tasks.workunit.client.1.smithi131.stdout:7/12: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:30:46.445 INFO:tasks.workunit.client.1.smithi131.stdout:6/7: dwrite f0 [0,4194304] 0 2024-02-15T18:30:46.630 INFO:tasks.workunit.client.1.smithi131.stdout:0/16: dwrite f4 [0,4194304] 0 2024-02-15T18:30:46.878 INFO:tasks.workunit.client.1.smithi131.stdout:0/17: dread f4 [0,4194304] 0 2024-02-15T18:30:46.879 INFO:tasks.workunit.client.1.smithi131.stdout:0/18: chown f3 226895812 1 2024-02-15T18:30:46.879 INFO:tasks.workunit.client.1.smithi131.stdout:0/19: readlink - no filename 2024-02-15T18:30:46.879 INFO:tasks.workunit.client.1.smithi131.stdout:0/20: rmdir - no directory 2024-02-15T18:30:46.879 INFO:tasks.workunit.client.1.smithi131.stdout:0/21: truncate f2 279148 0 2024-02-15T18:30:47.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:45.519457+0000 mgr.smithi131.buibla (mgr.24387) 12 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 80 MiB data, 334 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s wr, 6 op/s 2024-02-15T18:30:47.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:45.519457+0000 mgr.smithi131.buibla (mgr.24387) 12 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 80 MiB data, 334 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s wr, 6 op/s 2024-02-15T18:30:48.927 INFO:tasks.workunit.client.0.smithi033.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-15T18:30:48.930 INFO:tasks.workunit.client.0.smithi033.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T18:30:48.930 INFO:tasks.workunit.client.0.smithi033.stderr:+ make 2024-02-15T18:30:49.088 INFO:tasks.workunit.client.0.smithi033.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-15T18:30:49.392 INFO:tasks.workunit.client.0.smithi033.stderr:++ readlink -f fsstress 2024-02-15T18:30:49.393 INFO:tasks.workunit.client.0.smithi033.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-15T18:30:49.393 INFO:tasks.workunit.client.0.smithi033.stderr:+ popd 2024-02-15T18:30:49.395 INFO:tasks.workunit.client.0.smithi033.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-15T18:30:49.395 INFO:tasks.workunit.client.0.smithi033.stderr:+ popd 2024-02-15T18:30:49.395 INFO:tasks.workunit.client.0.smithi033.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-15T18:30:49.395 INFO:tasks.workunit.client.0.smithi033.stderr:++ mktemp -d -p . 2024-02-15T18:30:49.397 INFO:tasks.workunit.client.0.smithi033.stderr:+ T=./tmp.bIiB2KrkYv 2024-02-15T18:30:49.397 INFO:tasks.workunit.client.0.smithi033.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.bIiB2KrkYv -l 1 -n 1000 -p 10 -v 2024-02-15T18:30:49.398 INFO:tasks.workunit.client.0.smithi033.stdout:seed = 1707633894 2024-02-15T18:30:49.401 INFO:tasks.workunit.client.0.smithi033.stdout:0/0: stat - no entries 2024-02-15T18:30:49.402 INFO:tasks.workunit.client.0.smithi033.stdout:0/1: rename - no filename 2024-02-15T18:30:49.403 INFO:tasks.workunit.client.0.smithi033.stdout:1/0: dread - no filename 2024-02-15T18:30:49.403 INFO:tasks.workunit.client.0.smithi033.stdout:1/1: rename - no filename 2024-02-15T18:30:49.403 INFO:tasks.workunit.client.0.smithi033.stdout:1/2: write - no filename 2024-02-15T18:30:49.403 INFO:tasks.workunit.client.0.smithi033.stdout:0/2: mkdir d0 0 2024-02-15T18:30:49.404 INFO:tasks.workunit.client.0.smithi033.stdout:0/3: readlink - no filename 2024-02-15T18:30:49.406 INFO:tasks.workunit.client.0.smithi033.stdout:1/3: symlink l0 0 2024-02-15T18:30:49.408 INFO:tasks.workunit.client.0.smithi033.stdout:2/0: creat f0 x:0 0 0 2024-02-15T18:30:49.408 INFO:tasks.workunit.client.0.smithi033.stdout:2/1: truncate f0 195187 0 2024-02-15T18:30:49.409 INFO:tasks.workunit.client.0.smithi033.stdout:1/4: rename l0 to l1 0 2024-02-15T18:30:49.410 INFO:tasks.workunit.client.0.smithi033.stdout:4/0: chown . 0 1 2024-02-15T18:30:49.410 INFO:tasks.workunit.client.0.smithi033.stdout:4/1: write - no filename 2024-02-15T18:30:49.411 INFO:tasks.workunit.client.0.smithi033.stdout:3/0: creat f0 x:0 0 0 2024-02-15T18:30:49.412 INFO:tasks.workunit.client.0.smithi033.stdout:2/2: creat f1 x:0 0 0 2024-02-15T18:30:49.413 INFO:tasks.workunit.client.0.smithi033.stdout:1/5: creat f2 x:0 0 0 2024-02-15T18:30:49.413 INFO:tasks.workunit.client.0.smithi033.stdout:1/6: truncate f2 510951 0 2024-02-15T18:30:49.414 INFO:tasks.workunit.client.0.smithi033.stdout:5/0: write - no filename 2024-02-15T18:30:49.414 INFO:tasks.workunit.client.0.smithi033.stdout:5/1: dwrite - no filename 2024-02-15T18:30:49.414 INFO:tasks.workunit.client.0.smithi033.stdout:5/2: dread - no filename 2024-02-15T18:30:49.414 INFO:tasks.workunit.client.0.smithi033.stdout:5/3: unlink - no file 2024-02-15T18:30:49.414 INFO:tasks.workunit.client.0.smithi033.stdout:5/4: rmdir - no directory 2024-02-15T18:30:49.414 INFO:tasks.workunit.client.0.smithi033.stdout:5/5: chown . 1119 1 2024-02-15T18:30:49.414 INFO:tasks.workunit.client.0.smithi033.stdout:5/6: link - no file 2024-02-15T18:30:49.414 INFO:tasks.workunit.client.0.smithi033.stdout:5/7: unlink - no file 2024-02-15T18:30:49.415 INFO:tasks.workunit.client.0.smithi033.stdout:5/8: dread - no filename 2024-02-15T18:30:49.415 INFO:tasks.workunit.client.0.smithi033.stdout:4/2: creat f0 x:0 0 0 2024-02-15T18:30:49.416 INFO:tasks.workunit.client.0.smithi033.stdout:3/1: mknod c1 0 2024-02-15T18:30:49.416 INFO:tasks.workunit.client.0.smithi033.stdout:3/2: stat f0 0 2024-02-15T18:30:49.416 INFO:tasks.workunit.client.0.smithi033.stdout:3/3: truncate f0 136119 0 2024-02-15T18:30:49.420 INFO:tasks.workunit.client.0.smithi033.stdout:5/9: creat f0 x:0 0 0 2024-02-15T18:30:49.420 INFO:tasks.workunit.client.0.smithi033.stdout:5/10: chown f0 65395 1 2024-02-15T18:30:49.420 INFO:tasks.workunit.client.0.smithi033.stdout:5/11: read - f0 zero size 2024-02-15T18:30:49.420 INFO:tasks.workunit.client.0.smithi033.stdout:1/7: unlink f2 0 2024-02-15T18:30:49.420 INFO:tasks.workunit.client.0.smithi033.stdout:1/8: dwrite - no filename 2024-02-15T18:30:49.421 INFO:tasks.workunit.client.0.smithi033.stdout:1/9: write - no filename 2024-02-15T18:30:49.421 INFO:tasks.workunit.client.0.smithi033.stdout:1/10: dwrite - no filename 2024-02-15T18:30:49.421 INFO:tasks.workunit.client.0.smithi033.stdout:6/0: chown . 22 1 2024-02-15T18:30:49.440 INFO:tasks.workunit.client.0.smithi033.stdout:4/3: mknod c1 0 2024-02-15T18:30:49.440 INFO:tasks.workunit.client.0.smithi033.stdout:4/4: stat f0 0 2024-02-15T18:30:49.440 INFO:tasks.workunit.client.0.smithi033.stdout:4/5: write f0 [327032,9997] 0 2024-02-15T18:30:49.441 INFO:tasks.workunit.client.0.smithi033.stdout:5/12: unlink f0 0 2024-02-15T18:30:49.441 INFO:tasks.workunit.client.0.smithi033.stdout:5/13: write - no filename 2024-02-15T18:30:49.441 INFO:tasks.workunit.client.0.smithi033.stdout:5/14: truncate - no filename 2024-02-15T18:30:49.441 INFO:tasks.workunit.client.0.smithi033.stdout:1/11: symlink l3 0 2024-02-15T18:30:49.441 INFO:tasks.workunit.client.0.smithi033.stdout:1/12: write - no filename 2024-02-15T18:30:49.441 INFO:tasks.workunit.client.0.smithi033.stdout:1/13: write - no filename 2024-02-15T18:30:49.441 INFO:tasks.workunit.client.0.smithi033.stdout:1/14: write - no filename 2024-02-15T18:30:49.448 INFO:tasks.workunit.client.0.smithi033.stdout:5/15: mkdir d1 0 2024-02-15T18:30:49.448 INFO:tasks.workunit.client.0.smithi033.stdout:5/16: dwrite - no filename 2024-02-15T18:30:49.448 INFO:tasks.workunit.client.0.smithi033.stdout:1/15: unlink l3 0 2024-02-15T18:30:49.448 INFO:tasks.workunit.client.0.smithi033.stdout:1/16: dwrite - no filename 2024-02-15T18:30:49.448 INFO:tasks.workunit.client.0.smithi033.stdout:6/1: creat f0 x:0 0 0 2024-02-15T18:30:49.454 INFO:tasks.workunit.client.0.smithi033.stdout:5/17: symlink d1/l2 0 2024-02-15T18:30:49.456 INFO:tasks.workunit.client.0.smithi033.stdout:7/0: mkdir d0 0 2024-02-15T18:30:49.456 INFO:tasks.workunit.client.0.smithi033.stdout:7/1: readlink - no filename 2024-02-15T18:30:49.456 INFO:tasks.workunit.client.0.smithi033.stdout:7/2: link - no file 2024-02-15T18:30:49.456 INFO:tasks.workunit.client.0.smithi033.stdout:7/3: dwrite - no filename 2024-02-15T18:30:49.456 INFO:tasks.workunit.client.0.smithi033.stdout:7/4: truncate - no filename 2024-02-15T18:30:49.456 INFO:tasks.workunit.client.0.smithi033.stdout:1/17: symlink l4 0 2024-02-15T18:30:49.456 INFO:tasks.workunit.client.0.smithi033.stdout:1/18: dwrite - no filename 2024-02-15T18:30:49.456 INFO:tasks.workunit.client.0.smithi033.stdout:6/2: creat f1 x:0 0 0 2024-02-15T18:30:49.459 INFO:tasks.workunit.client.0.smithi033.stdout:8/0: rmdir - no directory 2024-02-15T18:30:49.459 INFO:tasks.workunit.client.0.smithi033.stdout:8/1: dwrite - no filename 2024-02-15T18:30:49.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/2: chown . 16077 1 2024-02-15T18:30:49.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/3: read - no filename 2024-02-15T18:30:49.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/4: fdatasync - no filename 2024-02-15T18:30:49.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/5: dwrite - no filename 2024-02-15T18:30:49.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/6: write - no filename 2024-02-15T18:30:49.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/7: read - no filename 2024-02-15T18:30:49.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/8: dwrite - no filename 2024-02-15T18:30:49.460 INFO:tasks.workunit.client.0.smithi033.stdout:5/18: symlink d1/l3 0 2024-02-15T18:30:49.461 INFO:tasks.workunit.client.0.smithi033.stdout:5/19: fsync - no filename 2024-02-15T18:30:49.461 INFO:tasks.workunit.client.0.smithi033.stdout:5/20: write - no filename 2024-02-15T18:30:49.467 INFO:tasks.workunit.client.0.smithi033.stdout:7/5: creat d0/f1 x:0 0 0 2024-02-15T18:30:49.471 INFO:tasks.workunit.client.0.smithi033.stdout:8/9: mkdir d0 0 2024-02-15T18:30:49.471 INFO:tasks.workunit.client.0.smithi033.stdout:8/10: chown d0 389080 1 2024-02-15T18:30:49.471 INFO:tasks.workunit.client.0.smithi033.stdout:8/11: dwrite - no filename 2024-02-15T18:30:49.471 INFO:tasks.workunit.client.0.smithi033.stdout:8/12: chown d0 1 1 2024-02-15T18:30:49.472 INFO:tasks.workunit.client.0.smithi033.stdout:5/21: creat d1/f4 x:0 0 0 2024-02-15T18:30:49.479 INFO:tasks.workunit.client.0.smithi033.stdout:9/0: creat f0 x:0 0 0 2024-02-15T18:30:49.481 INFO:tasks.workunit.client.0.smithi033.stdout:9/1: symlink l1 0 2024-02-15T18:30:49.481 INFO:tasks.workunit.client.0.smithi033.stdout:9/2: fdatasync f0 0 2024-02-15T18:30:49.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:47.519999+0000 mgr.smithi131.buibla (mgr.24387) 13 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 146 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 93 B/s rd, 7.8 MiB/s wr, 683 op/s 2024-02-15T18:30:49.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:47.519999+0000 mgr.smithi131.buibla (mgr.24387) 13 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 146 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 93 B/s rd, 7.8 MiB/s wr, 683 op/s 2024-02-15T18:30:49.821 INFO:tasks.workunit.client.0.smithi033.stdout:2/3: dwrite f1 [0,4194304] 0 2024-02-15T18:30:49.822 INFO:tasks.workunit.client.0.smithi033.stdout:2/4: chown f1 31883 1 2024-02-15T18:30:49.822 INFO:tasks.workunit.client.0.smithi033.stdout:2/5: fdatasync f1 0 2024-02-15T18:30:49.951 INFO:tasks.workunit.client.0.smithi033.stdout:3/4: dwrite f0 [0,4194304] 0 2024-02-15T18:30:49.951 INFO:tasks.workunit.client.0.smithi033.stdout:3/5: stat f0 0 2024-02-15T18:30:50.006 INFO:tasks.workunit.client.0.smithi033.stdout:9/3: fsync f0 0 2024-02-15T18:30:50.009 INFO:tasks.workunit.client.0.smithi033.stdout:6/3: fsync f1 0 2024-02-15T18:30:50.009 INFO:tasks.workunit.client.0.smithi033.stdout:6/4: dread - f1 zero size 2024-02-15T18:30:50.009 INFO:tasks.workunit.client.0.smithi033.stdout:7/6: getdents d0 0 2024-02-15T18:30:50.374 INFO:tasks.workunit.client.0.smithi033.stdout:2/6: write f1 [1853998,69012] 0 2024-02-15T18:30:50.474 INFO:tasks.workunit.client.0.smithi033.stdout:5/22: dwrite d1/f4 [0,4194304] 0 2024-02-15T18:30:50.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/23: dread d1/f4 [0,4194304] 0 2024-02-15T18:30:50.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/24: chown d1/l2 490 1 2024-02-15T18:30:50.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/25: chown d1 15280 1 2024-02-15T18:30:50.720 INFO:tasks.workunit.client.0.smithi033.stdout:3/6: mkdir d2 0 2024-02-15T18:30:50.791 INFO:tasks.workunit.client.0.smithi033.stdout:4/6: dread f0 [0,4194304] 0 2024-02-15T18:30:50.799 INFO:tasks.workunit.client.0.smithi033.stdout:5/26: dwrite d1/f4 [0,4194304] 0 2024-02-15T18:30:51.414 INFO:tasks.workunit.client.0.smithi033.stdout:9/4: creat f2 x:0 0 0 2024-02-15T18:30:51.463 INFO:tasks.workunit.client.0.smithi033.stdout:9/5: dwrite f2 [0,4194304] 0 2024-02-15T18:30:51.625 INFO:tasks.workunit.client.0.smithi033.stdout:6/5: dwrite f1 [0,4194304] 0 2024-02-15T18:30:51.655 INFO:tasks.workunit.client.0.smithi033.stdout:6/6: dread f1 [0,4194304] 0 2024-02-15T18:30:51.655 INFO:tasks.workunit.client.0.smithi033.stdout:6/7: chown f0 375 1 2024-02-15T18:30:51.657 INFO:tasks.workunit.client.0.smithi033.stdout:6/8: write f1 [2467995,26501] 0 2024-02-15T18:30:51.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:49.521083+0000 mgr.smithi131.buibla (mgr.24387) 14 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 146 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 7.2 MiB/s wr, 625 op/s 2024-02-15T18:30:51.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:49.521083+0000 mgr.smithi131.buibla (mgr.24387) 14 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 146 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 7.2 MiB/s wr, 625 op/s 2024-02-15T18:30:52.518 INFO:tasks.workunit.client.0.smithi033.stdout:2/7: mknod c2 0 2024-02-15T18:30:52.964 INFO:tasks.workunit.client.1.smithi131.stdout:5/4: creat f1 x:0 0 0 2024-02-15T18:30:52.964 INFO:tasks.workunit.client.1.smithi131.stdout:5/5: dread - f1 zero size 2024-02-15T18:30:52.975 INFO:tasks.workunit.client.1.smithi131.stdout:4/14: mkdir d2/d7 0 2024-02-15T18:30:52.975 INFO:tasks.workunit.client.1.smithi131.stdout:4/15: dread - d2/f4 zero size 2024-02-15T18:30:53.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:51.521478+0000 mgr.smithi131.buibla (mgr.24387) 15 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 146 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 7.2 MiB/s wr, 625 op/s 2024-02-15T18:30:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:51.521478+0000 mgr.smithi131.buibla (mgr.24387) 15 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 146 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 7.2 MiB/s wr, 625 op/s 2024-02-15T18:30:53.919 INFO:tasks.workunit.client.0.smithi033.stdout:3/7: mkdir d2/d3 0 2024-02-15T18:30:54.317 INFO:tasks.workunit.client.1.smithi131.stdout:7/13: stat d0/c4 0 2024-02-15T18:30:54.492 INFO:tasks.workunit.client.0.smithi033.stdout:4/7: symlink l2 0 2024-02-15T18:30:54.513 INFO:tasks.workunit.client.0.smithi033.stdout:5/27: creat d1/f5 x:0 0 0 2024-02-15T18:30:55.459 INFO:tasks.workunit.client.1.smithi131.stdout:6/8: symlink l1 0 2024-02-15T18:30:55.459 INFO:tasks.workunit.client.1.smithi131.stdout:6/9: stat l1 0 2024-02-15T18:30:55.462 INFO:tasks.workunit.client.1.smithi131.stdout:6/10: write f0 [3104135,115780] 0 2024-02-15T18:30:55.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:53.521895+0000 mgr.smithi131.buibla (mgr.24387) 16 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 244 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 16 MiB/s wr, 1.39k op/s 2024-02-15T18:30:55.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:53.521895+0000 mgr.smithi131.buibla (mgr.24387) 16 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 244 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 16 MiB/s wr, 1.39k op/s 2024-02-15T18:30:55.850 INFO:tasks.workunit.client.1.smithi131.stdout:8/3: rename f0 to f1 0 2024-02-15T18:30:55.850 INFO:tasks.workunit.client.1.smithi131.stdout:8/4: truncate f1 153774 0 2024-02-15T18:30:55.912 INFO:tasks.workunit.client.1.smithi131.stdout:0/22: getdents . 0 2024-02-15T18:30:55.914 INFO:tasks.workunit.client.1.smithi131.stdout:5/6: unlink l0 0 2024-02-15T18:30:55.915 INFO:tasks.workunit.client.1.smithi131.stdout:4/16: creat d2/f8 x:0 0 0 2024-02-15T18:30:55.916 INFO:tasks.workunit.client.1.smithi131.stdout:7/14: mknod d0/c5 0 2024-02-15T18:30:55.917 INFO:tasks.workunit.client.1.smithi131.stdout:6/11: mkdir d2 0 2024-02-15T18:30:55.918 INFO:tasks.workunit.client.1.smithi131.stdout:6/12: write f0 [3648832,15402] 0 2024-02-15T18:30:55.918 INFO:tasks.workunit.client.1.smithi131.stdout:6/13: chown l1 50247432 1 2024-02-15T18:30:55.920 INFO:tasks.workunit.client.1.smithi131.stdout:8/5: symlink l2 0 2024-02-15T18:30:55.924 INFO:tasks.workunit.client.1.smithi131.stdout:7/15: dread d0/f1 [0,4194304] 0 2024-02-15T18:30:55.925 INFO:tasks.workunit.client.1.smithi131.stdout:7/16: write d0/f1 [4833961,105945] 0 2024-02-15T18:30:55.931 INFO:tasks.workunit.client.1.smithi131.stdout:0/23: mkdir d5 0 2024-02-15T18:30:55.944 INFO:tasks.workunit.client.1.smithi131.stdout:5/7: creat f2 x:0 0 0 2024-02-15T18:30:55.944 INFO:tasks.workunit.client.1.smithi131.stdout:5/8: write f1 [241819,77189] 0 2024-02-15T18:30:55.945 INFO:tasks.workunit.client.1.smithi131.stdout:4/17: creat d2/f9 x:0 0 0 2024-02-15T18:30:55.945 INFO:tasks.workunit.client.1.smithi131.stdout:4/18: dread - d2/f6 zero size 2024-02-15T18:30:55.947 INFO:tasks.workunit.client.1.smithi131.stdout:6/14: creat d2/f3 x:0 0 0 2024-02-15T18:30:55.947 INFO:tasks.workunit.client.1.smithi131.stdout:6/15: write f0 [4598024,93249] 0 2024-02-15T18:30:55.948 INFO:tasks.workunit.client.1.smithi131.stdout:8/6: unlink f1 0 2024-02-15T18:30:55.948 INFO:tasks.workunit.client.1.smithi131.stdout:8/7: stat l2 0 2024-02-15T18:30:55.949 INFO:tasks.workunit.client.1.smithi131.stdout:0/24: dread f0 [0,4194304] 0 2024-02-15T18:30:55.951 INFO:tasks.workunit.client.1.smithi131.stdout:4/19: unlink c1 0 2024-02-15T18:30:55.951 INFO:tasks.workunit.client.1.smithi131.stdout:4/20: read - d2/f6 zero size 2024-02-15T18:30:55.951 INFO:tasks.workunit.client.1.smithi131.stdout:4/21: truncate d2/f4 348243 0 2024-02-15T18:30:55.951 INFO:tasks.workunit.client.1.smithi131.stdout:4/22: stat d2/f6 0 2024-02-15T18:30:55.953 INFO:tasks.workunit.client.1.smithi131.stdout:5/9: dread f1 [0,4194304] 0 2024-02-15T18:30:55.953 INFO:tasks.workunit.client.1.smithi131.stdout:5/10: write f1 [674057,3780] 0 2024-02-15T18:30:55.953 INFO:tasks.workunit.client.1.smithi131.stdout:8/8: rename l2 to l3 0 2024-02-15T18:30:55.953 INFO:tasks.workunit.client.1.smithi131.stdout:8/9: write - no filename 2024-02-15T18:30:55.953 INFO:tasks.workunit.client.1.smithi131.stdout:8/10: dwrite - no filename 2024-02-15T18:30:55.954 INFO:tasks.workunit.client.1.smithi131.stdout:0/25: symlink d5/l6 0 2024-02-15T18:30:55.954 INFO:tasks.workunit.client.1.smithi131.stdout:0/26: truncate f3 205395 0 2024-02-15T18:30:55.954 INFO:tasks.workunit.client.1.smithi131.stdout:0/27: fdatasync f2 0 2024-02-15T18:30:55.955 INFO:tasks.workunit.client.1.smithi131.stdout:7/17: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:30:55.956 INFO:tasks.workunit.client.1.smithi131.stdout:5/11: symlink l3 0 2024-02-15T18:30:55.956 INFO:tasks.workunit.client.1.smithi131.stdout:5/12: chown f1 1716 1 2024-02-15T18:30:55.966 INFO:tasks.workunit.client.1.smithi131.stdout:8/11: mknod c4 0 2024-02-15T18:30:55.966 INFO:tasks.workunit.client.1.smithi131.stdout:8/12: dread - no filename 2024-02-15T18:30:55.967 INFO:tasks.workunit.client.1.smithi131.stdout:8/13: chown c4 231 1 2024-02-15T18:30:55.967 INFO:tasks.workunit.client.1.smithi131.stdout:8/14: dwrite - no filename 2024-02-15T18:30:55.967 INFO:tasks.workunit.client.1.smithi131.stdout:8/15: read - no filename 2024-02-15T18:30:55.967 INFO:tasks.workunit.client.1.smithi131.stdout:8/16: read - no filename 2024-02-15T18:30:55.967 INFO:tasks.workunit.client.1.smithi131.stdout:8/17: dread - no filename 2024-02-15T18:30:55.967 INFO:tasks.workunit.client.1.smithi131.stdout:8/18: dwrite - no filename 2024-02-15T18:30:55.981 INFO:tasks.workunit.client.1.smithi131.stdout:0/28: dread f0 [0,4194304] 0 2024-02-15T18:30:55.983 INFO:tasks.workunit.client.1.smithi131.stdout:5/13: symlink l4 0 2024-02-15T18:30:55.984 INFO:tasks.workunit.client.1.smithi131.stdout:8/19: creat f5 x:0 0 0 2024-02-15T18:30:55.984 INFO:tasks.workunit.client.1.smithi131.stdout:8/20: readlink l3 0 2024-02-15T18:30:55.986 INFO:tasks.workunit.client.1.smithi131.stdout:0/29: rename d5/l6 to d5/l7 0 2024-02-15T18:30:55.988 INFO:tasks.workunit.client.1.smithi131.stdout:5/14: rename f1 to f5 0 2024-02-15T18:30:55.991 INFO:tasks.workunit.client.1.smithi131.stdout:7/18: dwrite d0/f1 [4194304,4194304] 0 2024-02-15T18:30:55.996 INFO:tasks.workunit.client.1.smithi131.stdout:6/16: dwrite f0 [0,4194304] 0 2024-02-15T18:30:56.001 INFO:tasks.workunit.client.1.smithi131.stdout:6/17: creat d2/f4 x:0 0 0 2024-02-15T18:30:56.005 INFO:tasks.workunit.client.1.smithi131.stdout:6/18: rename d2/f3 to d2/f5 0 2024-02-15T18:30:56.018 INFO:tasks.workunit.client.1.smithi131.stdout:0/30: dwrite f2 [0,4194304] 0 2024-02-15T18:30:56.023 INFO:tasks.workunit.client.1.smithi131.stdout:8/21: dwrite f5 [0,4194304] 0 2024-02-15T18:30:56.023 INFO:tasks.workunit.client.1.smithi131.stdout:5/15: truncate f5 472475 0 2024-02-15T18:30:56.025 INFO:tasks.workunit.client.1.smithi131.stdout:0/31: dread f1 [0,4194304] 0 2024-02-15T18:30:56.025 INFO:tasks.workunit.client.1.smithi131.stdout:0/32: fsync f3 0 2024-02-15T18:30:56.026 INFO:tasks.workunit.client.1.smithi131.stdout:8/22: symlink l6 0 2024-02-15T18:30:56.026 INFO:tasks.workunit.client.1.smithi131.stdout:5/16: truncate f5 1016791 0 2024-02-15T18:30:56.033 INFO:tasks.workunit.client.1.smithi131.stdout:6/19: dwrite f0 [0,4194304] 0 2024-02-15T18:30:56.033 INFO:tasks.workunit.client.1.smithi131.stdout:6/20: truncate d2/f5 719949 0 2024-02-15T18:30:56.040 INFO:tasks.workunit.client.1.smithi131.stdout:0/33: dread f2 [0,4194304] 0 2024-02-15T18:30:56.040 INFO:tasks.workunit.client.1.smithi131.stdout:0/34: chown f2 0 1 2024-02-15T18:30:56.040 INFO:tasks.workunit.client.1.smithi131.stdout:0/35: fdatasync f3 0 2024-02-15T18:30:56.040 INFO:tasks.workunit.client.1.smithi131.stdout:7/19: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:30:56.040 INFO:tasks.workunit.client.1.smithi131.stdout:7/20: stat d0/c5 0 2024-02-15T18:30:56.040 INFO:tasks.workunit.client.1.smithi131.stdout:6/21: link f0 d2/f6 0 2024-02-15T18:30:56.041 INFO:tasks.workunit.client.1.smithi131.stdout:5/17: unlink f5 0 2024-02-15T18:30:56.042 INFO:tasks.workunit.client.1.smithi131.stdout:0/36: creat d5/f8 x:0 0 0 2024-02-15T18:30:56.042 INFO:tasks.workunit.client.1.smithi131.stdout:0/37: write f2 [4994070,11798] 0 2024-02-15T18:30:56.043 INFO:tasks.workunit.client.1.smithi131.stdout:5/18: creat f6 x:0 0 0 2024-02-15T18:30:56.043 INFO:tasks.workunit.client.1.smithi131.stdout:5/19: fdatasync f2 0 2024-02-15T18:30:56.045 INFO:tasks.workunit.client.1.smithi131.stdout:7/21: write d0/f1 [5511735,36759] 0 2024-02-15T18:30:56.045 INFO:tasks.workunit.client.1.smithi131.stdout:0/38: mkdir d5/d9 0 2024-02-15T18:30:56.046 INFO:tasks.workunit.client.1.smithi131.stdout:7/22: mknod d0/c6 0 2024-02-15T18:30:56.047 INFO:tasks.workunit.client.1.smithi131.stdout:0/39: rename d5/f8 to d5/fa 0 2024-02-15T18:30:56.049 INFO:tasks.workunit.client.1.smithi131.stdout:0/40: symlink d5/d9/lb 0 2024-02-15T18:30:56.050 INFO:tasks.workunit.client.1.smithi131.stdout:8/23: dwrite f5 [0,4194304] 0 2024-02-15T18:30:56.051 INFO:tasks.workunit.client.1.smithi131.stdout:8/24: mknod c7 0 2024-02-15T18:30:56.054 INFO:tasks.workunit.client.1.smithi131.stdout:8/25: rename c7 to c8 0 2024-02-15T18:30:56.068 INFO:tasks.workunit.client.1.smithi131.stdout:6/22: dwrite f0 [0,4194304] 0 2024-02-15T18:30:56.070 INFO:tasks.workunit.client.1.smithi131.stdout:8/26: link c8 c9 0 2024-02-15T18:30:56.072 INFO:tasks.workunit.client.1.smithi131.stdout:7/23: dread d0/f1 [0,4194304] 0 2024-02-15T18:30:56.072 INFO:tasks.workunit.client.1.smithi131.stdout:5/20: dwrite f6 [0,4194304] 0 2024-02-15T18:30:56.072 INFO:tasks.workunit.client.1.smithi131.stdout:7/24: readlink - no filename 2024-02-15T18:30:56.072 INFO:tasks.workunit.client.1.smithi131.stdout:6/23: mkdir d2/d7 0 2024-02-15T18:30:56.075 INFO:tasks.workunit.client.1.smithi131.stdout:8/27: symlink la 0 2024-02-15T18:30:56.076 INFO:tasks.workunit.client.1.smithi131.stdout:6/24: symlink d2/d7/l8 0 2024-02-15T18:30:56.076 INFO:tasks.workunit.client.1.smithi131.stdout:6/25: stat d2/f5 0 2024-02-15T18:30:56.078 INFO:tasks.workunit.client.1.smithi131.stdout:6/26: rename d2/f6 to d2/f9 0 2024-02-15T18:30:56.079 INFO:tasks.workunit.client.1.smithi131.stdout:0/41: dwrite d5/fa [0,4194304] 0 2024-02-15T18:30:56.080 INFO:tasks.workunit.client.1.smithi131.stdout:6/27: unlink d2/f4 0 2024-02-15T18:30:56.080 INFO:tasks.workunit.client.1.smithi131.stdout:6/28: chown f0 351 1 2024-02-15T18:30:56.083 INFO:tasks.workunit.client.1.smithi131.stdout:5/21: truncate f6 3044612 0 2024-02-15T18:30:56.083 INFO:tasks.workunit.client.1.smithi131.stdout:5/22: write f2 [275726,19924] 0 2024-02-15T18:30:56.084 INFO:tasks.workunit.client.1.smithi131.stdout:8/28: dread f5 [0,4194304] 0 2024-02-15T18:30:56.088 INFO:tasks.workunit.client.1.smithi131.stdout:5/23: fsync f2 0 2024-02-15T18:30:56.088 INFO:tasks.workunit.client.1.smithi131.stdout:5/24: stat f6 0 2024-02-15T18:30:56.090 INFO:tasks.workunit.client.1.smithi131.stdout:5/25: mknod c7 0 2024-02-15T18:30:56.093 INFO:tasks.workunit.client.1.smithi131.stdout:5/26: link c7 c8 0 2024-02-15T18:30:56.094 INFO:tasks.workunit.client.1.smithi131.stdout:5/27: symlink l9 0 2024-02-15T18:30:56.095 INFO:tasks.workunit.client.1.smithi131.stdout:5/28: chown l4 653 1 2024-02-15T18:30:56.095 INFO:tasks.workunit.client.1.smithi131.stdout:5/29: write f2 [1302001,86147] 0 2024-02-15T18:30:56.098 INFO:tasks.workunit.client.1.smithi131.stdout:6/29: truncate d2/f5 411910 0 2024-02-15T18:30:56.098 INFO:tasks.workunit.client.1.smithi131.stdout:6/30: readlink d2/d7/l8 0 2024-02-15T18:30:56.098 INFO:tasks.workunit.client.1.smithi131.stdout:5/30: symlink la 0 2024-02-15T18:30:56.109 INFO:tasks.workunit.client.1.smithi131.stdout:5/31: write f6 [2922720,79738] 0 2024-02-15T18:30:56.110 INFO:tasks.workunit.client.1.smithi131.stdout:5/32: write f6 [4068242,112161] 0 2024-02-15T18:30:56.111 INFO:tasks.workunit.client.1.smithi131.stdout:0/42: dwrite d5/fa [0,4194304] 0 2024-02-15T18:30:56.112 INFO:tasks.workunit.client.1.smithi131.stdout:8/29: dwrite f5 [4194304,4194304] 0 2024-02-15T18:30:56.112 INFO:tasks.workunit.client.1.smithi131.stdout:0/43: creat d5/fc x:0 0 0 2024-02-15T18:30:56.112 INFO:tasks.workunit.client.1.smithi131.stdout:0/44: chown f2 29474384 1 2024-02-15T18:30:56.114 INFO:tasks.workunit.client.1.smithi131.stdout:8/30: creat fb x:0 0 0 2024-02-15T18:30:56.116 INFO:tasks.workunit.client.1.smithi131.stdout:0/45: creat d5/fd x:0 0 0 2024-02-15T18:30:56.117 INFO:tasks.workunit.client.1.smithi131.stdout:8/31: symlink lc 0 2024-02-15T18:30:56.127 INFO:tasks.workunit.client.1.smithi131.stdout:6/31: rename d2/f5 to d2/d7/fa 0 2024-02-15T18:30:56.143 INFO:tasks.workunit.client.1.smithi131.stdout:5/33: dwrite f2 [0,4194304] 0 2024-02-15T18:30:56.143 INFO:tasks.workunit.client.1.smithi131.stdout:5/34: fsync f2 0 2024-02-15T18:30:56.143 INFO:tasks.workunit.client.1.smithi131.stdout:6/32: dwrite d2/d7/fa [0,4194304] 0 2024-02-15T18:30:56.148 INFO:tasks.workunit.client.1.smithi131.stdout:8/32: truncate f5 640333 0 2024-02-15T18:30:56.150 INFO:tasks.workunit.client.1.smithi131.stdout:5/35: creat fb x:0 0 0 2024-02-15T18:30:56.152 INFO:tasks.workunit.client.1.smithi131.stdout:5/36: write f2 [139408,79862] 0 2024-02-15T18:30:56.154 INFO:tasks.workunit.client.1.smithi131.stdout:5/37: link la lc 0 2024-02-15T18:30:56.154 INFO:tasks.workunit.client.1.smithi131.stdout:5/38: chown la 1 1 2024-02-15T18:30:56.155 INFO:tasks.workunit.client.1.smithi131.stdout:5/39: creat fd x:0 0 0 2024-02-15T18:30:56.155 INFO:tasks.workunit.client.1.smithi131.stdout:5/40: chown fb 180803454 1 2024-02-15T18:30:56.161 INFO:tasks.workunit.client.1.smithi131.stdout:6/33: dwrite d2/d7/fa [0,4194304] 0 2024-02-15T18:30:56.162 INFO:tasks.workunit.client.1.smithi131.stdout:6/34: fdatasync f0 0 2024-02-15T18:30:56.163 INFO:tasks.workunit.client.1.smithi131.stdout:6/35: write d2/d7/fa [1547061,125629] 0 2024-02-15T18:30:56.164 INFO:tasks.workunit.client.1.smithi131.stdout:6/36: creat d2/d7/fb x:0 0 0 2024-02-15T18:30:56.165 INFO:tasks.workunit.client.1.smithi131.stdout:5/41: getdents . 0 2024-02-15T18:30:56.166 INFO:tasks.workunit.client.1.smithi131.stdout:6/37: mkdir d2/dc 0 2024-02-15T18:30:56.168 INFO:tasks.workunit.client.1.smithi131.stdout:5/42: mknod ce 0 2024-02-15T18:30:56.168 INFO:tasks.workunit.client.1.smithi131.stdout:5/43: write fd [571166,6383] 0 2024-02-15T18:30:56.176 INFO:tasks.workunit.client.1.smithi131.stdout:6/38: dread d2/f9 [0,4194304] 0 2024-02-15T18:30:56.188 INFO:tasks.workunit.client.1.smithi131.stdout:5/44: dwrite fb [0,4194304] 0 2024-02-15T18:30:56.191 INFO:tasks.workunit.client.1.smithi131.stdout:5/45: mknod cf 0 2024-02-15T18:30:56.193 INFO:tasks.workunit.client.1.smithi131.stdout:5/46: link l3 l10 0 2024-02-15T18:30:56.195 INFO:tasks.workunit.client.1.smithi131.stdout:5/47: creat f11 x:0 0 0 2024-02-15T18:30:56.195 INFO:tasks.workunit.client.1.smithi131.stdout:5/48: truncate f11 101689 0 2024-02-15T18:30:56.196 INFO:tasks.workunit.client.1.smithi131.stdout:5/49: dread f11 [0,4194304] 0 2024-02-15T18:30:56.198 INFO:tasks.workunit.client.1.smithi131.stdout:5/50: unlink fd 0 2024-02-15T18:30:56.198 INFO:tasks.workunit.client.1.smithi131.stdout:5/51: fdatasync f11 0 2024-02-15T18:30:56.202 INFO:tasks.workunit.client.1.smithi131.stdout:5/52: rename c8 to c12 0 2024-02-15T18:30:56.202 INFO:tasks.workunit.client.1.smithi131.stdout:6/39: dwrite d2/f9 [0,4194304] 0 2024-02-15T18:30:56.203 INFO:tasks.workunit.client.1.smithi131.stdout:6/40: creat d2/d7/fd x:0 0 0 2024-02-15T18:30:56.203 INFO:tasks.workunit.client.1.smithi131.stdout:6/41: creat d2/fe x:0 0 0 2024-02-15T18:30:56.215 INFO:tasks.workunit.client.1.smithi131.stdout:6/42: dread f0 [0,4194304] 0 2024-02-15T18:30:56.215 INFO:tasks.workunit.client.1.smithi131.stdout:6/43: chown f0 83 1 2024-02-15T18:30:56.216 INFO:tasks.workunit.client.1.smithi131.stdout:6/44: read d2/d7/fa [2799065,5310] 0 2024-02-15T18:30:56.216 INFO:tasks.workunit.client.1.smithi131.stdout:6/45: chown d2/d7/fb 49359980 1 2024-02-15T18:30:56.216 INFO:tasks.workunit.client.1.smithi131.stdout:6/46: dread - d2/d7/fb zero size 2024-02-15T18:30:56.217 INFO:tasks.workunit.client.1.smithi131.stdout:6/47: rename l1 to d2/lf 0 2024-02-15T18:30:56.217 INFO:tasks.workunit.client.1.smithi131.stdout:6/48: chown d2 16266 1 2024-02-15T18:30:56.217 INFO:tasks.workunit.client.1.smithi131.stdout:6/49: fdatasync f0 0 2024-02-15T18:30:56.218 INFO:tasks.workunit.client.1.smithi131.stdout:6/50: mknod d2/d7/c10 0 2024-02-15T18:30:56.218 INFO:tasks.workunit.client.1.smithi131.stdout:6/51: chown d2/f9 26505 1 2024-02-15T18:30:56.218 INFO:tasks.workunit.client.1.smithi131.stdout:6/52: stat d2 0 2024-02-15T18:30:56.222 INFO:tasks.workunit.client.1.smithi131.stdout:5/53: dwrite f6 [0,4194304] 0 2024-02-15T18:30:56.223 INFO:tasks.workunit.client.1.smithi131.stdout:5/54: dread f11 [0,4194304] 0 2024-02-15T18:30:56.223 INFO:tasks.workunit.client.1.smithi131.stdout:5/55: rmdir - no directory 2024-02-15T18:30:56.242 INFO:tasks.workunit.client.1.smithi131.stdout:6/53: dwrite d2/fe [0,4194304] 0 2024-02-15T18:30:56.243 INFO:tasks.workunit.client.1.smithi131.stdout:5/56: dwrite f2 [0,4194304] 0 2024-02-15T18:30:56.243 INFO:tasks.workunit.client.1.smithi131.stdout:5/57: truncate fb 4308115 0 2024-02-15T18:30:56.245 INFO:tasks.workunit.client.1.smithi131.stdout:5/58: creat f13 x:0 0 0 2024-02-15T18:30:56.246 INFO:tasks.workunit.client.1.smithi131.stdout:5/59: write f6 [756889,10373] 0 2024-02-15T18:30:56.251 INFO:tasks.workunit.client.1.smithi131.stdout:5/60: dread f11 [0,4194304] 0 2024-02-15T18:30:56.252 INFO:tasks.workunit.client.1.smithi131.stdout:6/54: getdents d2 0 2024-02-15T18:30:56.253 INFO:tasks.workunit.client.1.smithi131.stdout:6/55: write d2/f9 [3665333,71176] 0 2024-02-15T18:30:56.253 INFO:tasks.workunit.client.1.smithi131.stdout:6/56: chown d2/fe 14441180 1 2024-02-15T18:30:56.253 INFO:tasks.workunit.client.1.smithi131.stdout:5/61: chown la 90 1 2024-02-15T18:30:56.256 INFO:tasks.workunit.client.1.smithi131.stdout:5/62: rename lc to l14 0 2024-02-15T18:30:56.257 INFO:tasks.workunit.client.1.smithi131.stdout:5/63: readlink l4 0 2024-02-15T18:30:56.261 INFO:tasks.workunit.client.1.smithi131.stdout:6/57: dread f0 [0,4194304] 0 2024-02-15T18:30:56.262 INFO:tasks.workunit.client.1.smithi131.stdout:5/64: getdents . 0 2024-02-15T18:30:56.264 INFO:tasks.workunit.client.1.smithi131.stdout:5/65: symlink l15 0 2024-02-15T18:30:56.264 INFO:tasks.workunit.client.1.smithi131.stdout:5/66: fdatasync f2 0 2024-02-15T18:30:56.264 INFO:tasks.workunit.client.1.smithi131.stdout:5/67: fdatasync f13 0 2024-02-15T18:30:56.264 INFO:tasks.workunit.client.1.smithi131.stdout:5/68: write f11 [897186,76653] 0 2024-02-15T18:30:56.264 INFO:tasks.workunit.client.1.smithi131.stdout:5/69: fdatasync f13 0 2024-02-15T18:30:56.270 INFO:tasks.workunit.client.1.smithi131.stdout:6/58: truncate d2/f9 3447220 0 2024-02-15T18:30:56.270 INFO:tasks.workunit.client.1.smithi131.stdout:6/59: write d2/d7/fd [838914,39752] 0 2024-02-15T18:30:56.274 INFO:tasks.workunit.client.1.smithi131.stdout:6/60: write d2/d7/fa [3354829,28128] 0 2024-02-15T18:30:56.279 INFO:tasks.workunit.client.1.smithi131.stdout:5/70: dwrite f2 [0,4194304] 0 2024-02-15T18:30:56.284 INFO:tasks.workunit.client.1.smithi131.stdout:6/61: dread f0 [0,4194304] 0 2024-02-15T18:30:56.286 INFO:tasks.workunit.client.1.smithi131.stdout:6/62: mknod d2/c11 0 2024-02-15T18:30:56.286 INFO:tasks.workunit.client.1.smithi131.stdout:6/63: chown d2/lf 28 1 2024-02-15T18:30:56.289 INFO:tasks.workunit.client.1.smithi131.stdout:5/71: dread f2 [0,4194304] 0 2024-02-15T18:30:56.290 INFO:tasks.workunit.client.1.smithi131.stdout:5/72: write fb [2700462,118030] 0 2024-02-15T18:30:56.293 INFO:tasks.workunit.client.1.smithi131.stdout:5/73: dread f2 [0,4194304] 0 2024-02-15T18:30:56.311 INFO:tasks.workunit.client.1.smithi131.stdout:5/74: dwrite fb [0,4194304] 0 2024-02-15T18:30:56.313 INFO:tasks.workunit.client.0.smithi033.stdout:9/6: mknod c3 0 2024-02-15T18:30:56.378 INFO:tasks.workunit.client.1.smithi131.stdout:5/75: dwrite f11 [0,4194304] 0 2024-02-15T18:30:56.391 INFO:tasks.workunit.client.1.smithi131.stdout:5/76: dwrite fb [0,4194304] 0 2024-02-15T18:30:56.399 INFO:tasks.workunit.client.1.smithi131.stdout:5/77: dread fb [0,4194304] 0 2024-02-15T18:30:56.411 INFO:tasks.workunit.client.1.smithi131.stdout:5/78: dwrite f6 [4194304,4194304] 0 2024-02-15T18:30:56.412 INFO:tasks.workunit.client.1.smithi131.stdout:5/79: write f13 [670868,97080] 0 2024-02-15T18:30:56.413 INFO:tasks.workunit.client.1.smithi131.stdout:5/80: creat f16 x:0 0 0 2024-02-15T18:30:56.415 INFO:tasks.workunit.client.1.smithi131.stdout:5/81: rename f2 to f17 0 2024-02-15T18:30:56.415 INFO:tasks.workunit.client.1.smithi131.stdout:5/82: write f16 [687336,11865] 0 2024-02-15T18:30:56.415 INFO:tasks.workunit.client.1.smithi131.stdout:5/83: fsync fb 0 2024-02-15T18:30:56.417 INFO:tasks.workunit.client.1.smithi131.stdout:5/84: mkdir d18 0 2024-02-15T18:30:56.436 INFO:tasks.workunit.client.1.smithi131.stdout:5/85: dwrite f16 [0,4194304] 0 2024-02-15T18:30:56.438 INFO:tasks.workunit.client.1.smithi131.stdout:5/86: creat d18/f19 x:0 0 0 2024-02-15T18:30:56.439 INFO:tasks.workunit.client.1.smithi131.stdout:5/87: mknod d18/c1a 0 2024-02-15T18:30:56.444 INFO:tasks.workunit.client.1.smithi131.stdout:5/88: truncate f13 85385 0 2024-02-15T18:30:56.459 INFO:tasks.workunit.client.1.smithi131.stdout:5/89: dwrite f13 [0,4194304] 0 2024-02-15T18:30:56.468 INFO:tasks.workunit.client.1.smithi131.stdout:5/90: dread f6 [0,4194304] 0 2024-02-15T18:30:56.469 INFO:tasks.workunit.client.1.smithi131.stdout:5/91: write f17 [3492297,72088] 0 2024-02-15T18:30:56.471 INFO:tasks.workunit.client.1.smithi131.stdout:5/92: link f11 d18/f1b 0 2024-02-15T18:30:56.471 INFO:tasks.workunit.client.1.smithi131.stdout:5/93: truncate d18/f19 583543 0 2024-02-15T18:30:56.471 INFO:tasks.workunit.client.1.smithi131.stdout:5/94: mknod d18/c1c 0 2024-02-15T18:30:56.479 INFO:tasks.workunit.client.1.smithi131.stdout:5/95: dread f6 [4194304,4194304] 0 2024-02-15T18:30:56.480 INFO:tasks.workunit.client.1.smithi131.stdout:5/96: unlink cf 0 2024-02-15T18:30:56.497 INFO:tasks.workunit.client.1.smithi131.stdout:5/97: dwrite f17 [0,4194304] 0 2024-02-15T18:30:56.497 INFO:tasks.workunit.client.1.smithi131.stdout:5/98: write f16 [4603934,114667] 0 2024-02-15T18:30:56.497 INFO:tasks.workunit.client.1.smithi131.stdout:5/99: stat l15 0 2024-02-15T18:30:56.497 INFO:tasks.workunit.client.1.smithi131.stdout:5/100: rename d18/c1a to d18/c1d 0 2024-02-15T18:30:56.498 INFO:tasks.workunit.client.1.smithi131.stdout:5/101: creat d18/f1e x:0 0 0 2024-02-15T18:30:56.498 INFO:tasks.workunit.client.1.smithi131.stdout:5/102: chown f13 57 1 2024-02-15T18:30:56.516 INFO:tasks.workunit.client.1.smithi131.stdout:5/103: dwrite f6 [0,4194304] 0 2024-02-15T18:30:56.517 INFO:tasks.workunit.client.1.smithi131.stdout:5/104: mkdir d18/d1f 0 2024-02-15T18:30:56.622 INFO:tasks.workunit.client.0.smithi033.stdout:6/9: symlink l2 0 2024-02-15T18:30:56.684 INFO:tasks.workunit.client.0.smithi033.stdout:2/8: mknod c3 0 2024-02-15T18:30:56.685 INFO:tasks.workunit.client.0.smithi033.stdout:3/8: unlink c1 0 2024-02-15T18:30:56.686 INFO:tasks.workunit.client.0.smithi033.stdout:4/8: mknod c3 0 2024-02-15T18:30:56.686 INFO:tasks.workunit.client.0.smithi033.stdout:4/9: write f0 [1286368,4885] 0 2024-02-15T18:30:56.686 INFO:tasks.workunit.client.0.smithi033.stdout:5/28: symlink d1/l6 0 2024-02-15T18:30:56.693 INFO:tasks.workunit.client.0.smithi033.stdout:2/9: mknod c4 0 2024-02-15T18:30:56.693 INFO:tasks.workunit.client.0.smithi033.stdout:6/10: creat f3 x:0 0 0 2024-02-15T18:30:56.693 INFO:tasks.workunit.client.0.smithi033.stdout:2/10: chown c3 9555282 1 2024-02-15T18:30:56.694 INFO:tasks.workunit.client.0.smithi033.stdout:2/11: creat f5 x:0 0 0 2024-02-15T18:30:56.694 INFO:tasks.workunit.client.0.smithi033.stdout:4/10: dread f0 [0,4194304] 0 2024-02-15T18:30:56.695 INFO:tasks.workunit.client.0.smithi033.stdout:4/11: mkdir d4 0 2024-02-15T18:30:56.696 INFO:tasks.workunit.client.0.smithi033.stdout:4/12: readlink l2 0 2024-02-15T18:30:56.696 INFO:tasks.workunit.client.0.smithi033.stdout:4/13: mkdir d4/d5 0 2024-02-15T18:30:56.697 INFO:tasks.workunit.client.0.smithi033.stdout:4/14: write f0 [1574629,116097] 0 2024-02-15T18:30:56.697 INFO:tasks.workunit.client.0.smithi033.stdout:4/15: read f0 [928749,31774] 0 2024-02-15T18:30:56.701 INFO:tasks.workunit.client.0.smithi033.stdout:4/16: fdatasync f0 0 2024-02-15T18:30:56.703 INFO:tasks.workunit.client.0.smithi033.stdout:3/9: dwrite f0 [0,4194304] 0 2024-02-15T18:30:56.718 INFO:tasks.workunit.client.0.smithi033.stdout:6/11: dwrite f1 [0,4194304] 0 2024-02-15T18:30:56.718 INFO:tasks.workunit.client.0.smithi033.stdout:6/12: read - f3 zero size 2024-02-15T18:30:56.719 INFO:tasks.workunit.client.0.smithi033.stdout:2/12: dwrite f5 [0,4194304] 0 2024-02-15T18:30:56.719 INFO:tasks.workunit.client.0.smithi033.stdout:2/13: fsync f1 0 2024-02-15T18:30:56.720 INFO:tasks.workunit.client.0.smithi033.stdout:4/17: dwrite f0 [0,4194304] 0 2024-02-15T18:30:56.720 INFO:tasks.workunit.client.0.smithi033.stdout:4/18: stat d4/d5 0 2024-02-15T18:30:56.723 INFO:tasks.workunit.client.0.smithi033.stdout:2/14: mknod c6 0 2024-02-15T18:30:56.724 INFO:tasks.workunit.client.0.smithi033.stdout:2/15: mknod c7 0 2024-02-15T18:30:56.724 INFO:tasks.workunit.client.0.smithi033.stdout:2/16: creat f8 x:0 0 0 2024-02-15T18:30:56.729 INFO:tasks.workunit.client.0.smithi033.stdout:4/19: dread f0 [0,4194304] 0 2024-02-15T18:30:56.729 INFO:tasks.workunit.client.0.smithi033.stdout:6/13: dread f1 [0,4194304] 0 2024-02-15T18:30:56.729 INFO:tasks.workunit.client.0.smithi033.stdout:6/14: rmdir - no directory 2024-02-15T18:30:56.744 INFO:tasks.workunit.client.0.smithi033.stdout:4/20: mkdir d4/d6 0 2024-02-15T18:30:56.747 INFO:tasks.workunit.client.0.smithi033.stdout:4/21: dread f0 [0,4194304] 0 2024-02-15T18:30:56.747 INFO:tasks.workunit.client.0.smithi033.stdout:6/15: rename l2 to l4 0 2024-02-15T18:30:56.747 INFO:tasks.workunit.client.0.smithi033.stdout:4/22: fdatasync f0 0 2024-02-15T18:30:56.748 INFO:tasks.workunit.client.0.smithi033.stdout:4/23: read f0 [4156900,45865] 0 2024-02-15T18:30:56.754 INFO:tasks.workunit.client.0.smithi033.stdout:6/16: rename f1 to f5 0 2024-02-15T18:30:56.755 INFO:tasks.workunit.client.0.smithi033.stdout:6/17: readlink l4 0 2024-02-15T18:30:56.763 INFO:tasks.workunit.client.0.smithi033.stdout:4/24: creat d4/f7 x:0 0 0 2024-02-15T18:30:56.797 INFO:tasks.workunit.client.0.smithi033.stdout:4/25: mknod d4/d6/c8 0 2024-02-15T18:30:56.799 INFO:tasks.workunit.client.0.smithi033.stdout:4/26: creat d4/d6/f9 x:0 0 0 2024-02-15T18:30:56.800 INFO:tasks.workunit.client.0.smithi033.stdout:4/27: write d4/d6/f9 [863835,89856] 0 2024-02-15T18:30:56.800 INFO:tasks.workunit.client.0.smithi033.stdout:4/28: truncate d4/d6/f9 1483312 0 2024-02-15T18:30:56.800 INFO:tasks.workunit.client.0.smithi033.stdout:4/29: getdents d4/d5 0 2024-02-15T18:30:56.800 INFO:tasks.workunit.client.0.smithi033.stdout:2/17: getdents . 0 2024-02-15T18:30:56.800 INFO:tasks.workunit.client.0.smithi033.stdout:4/30: symlink d4/d5/la 0 2024-02-15T18:30:56.801 INFO:tasks.workunit.client.0.smithi033.stdout:2/18: link f1 f9 0 2024-02-15T18:30:56.816 INFO:tasks.workunit.client.0.smithi033.stdout:4/31: dwrite d4/f7 [0,4194304] 0 2024-02-15T18:30:56.817 INFO:tasks.workunit.client.0.smithi033.stdout:4/32: creat d4/d6/fb x:0 0 0 2024-02-15T18:30:56.821 INFO:tasks.workunit.client.0.smithi033.stdout:4/33: write d4/f7 [221698,107964] 0 2024-02-15T18:30:56.822 INFO:tasks.workunit.client.0.smithi033.stdout:4/34: truncate f0 1863173 0 2024-02-15T18:30:56.823 INFO:tasks.workunit.client.0.smithi033.stdout:2/19: dwrite f9 [4194304,4194304] 0 2024-02-15T18:30:56.824 INFO:tasks.workunit.client.0.smithi033.stdout:2/20: chown f5 153 1 2024-02-15T18:30:56.826 INFO:tasks.workunit.client.0.smithi033.stdout:4/35: dread d4/d6/f9 [0,4194304] 0 2024-02-15T18:30:56.829 INFO:tasks.workunit.client.0.smithi033.stdout:4/36: rmdir d4/d5 39 2024-02-15T18:30:56.830 INFO:tasks.workunit.client.0.smithi033.stdout:2/21: rename c6 to ca 0 2024-02-15T18:30:56.831 INFO:tasks.workunit.client.0.smithi033.stdout:4/37: creat d4/d5/fc x:0 0 0 2024-02-15T18:30:56.831 INFO:tasks.workunit.client.0.smithi033.stdout:4/38: stat d4/d6/c8 0 2024-02-15T18:30:56.833 INFO:tasks.workunit.client.0.smithi033.stdout:4/39: symlink d4/d5/ld 0 2024-02-15T18:30:56.834 INFO:tasks.workunit.client.0.smithi033.stdout:4/40: dread f0 [0,4194304] 0 2024-02-15T18:30:56.834 INFO:tasks.workunit.client.0.smithi033.stdout:4/41: readlink d4/d5/la 0 2024-02-15T18:30:56.851 INFO:tasks.workunit.client.0.smithi033.stdout:2/22: dwrite f0 [0,4194304] 0 2024-02-15T18:30:56.857 INFO:tasks.workunit.client.0.smithi033.stdout:4/42: dwrite d4/f7 [0,4194304] 0 2024-02-15T18:30:56.859 INFO:tasks.workunit.client.0.smithi033.stdout:4/43: getdents d4/d5 0 2024-02-15T18:30:56.861 INFO:tasks.workunit.client.0.smithi033.stdout:4/44: rename d4/d5/fc to d4/d6/fe 0 2024-02-15T18:30:56.861 INFO:tasks.workunit.client.0.smithi033.stdout:4/45: readlink l2 0 2024-02-15T18:30:56.861 INFO:tasks.workunit.client.0.smithi033.stdout:4/46: dread - d4/d6/fb zero size 2024-02-15T18:30:56.861 INFO:tasks.workunit.client.0.smithi033.stdout:4/47: dread - d4/d6/fe zero size 2024-02-15T18:30:56.861 INFO:tasks.workunit.client.0.smithi033.stdout:4/48: dread - d4/d6/fe zero size 2024-02-15T18:30:56.861 INFO:tasks.workunit.client.0.smithi033.stdout:4/49: truncate d4/d6/fe 780214 0 2024-02-15T18:30:56.862 INFO:tasks.workunit.client.0.smithi033.stdout:4/50: creat d4/d6/ff x:0 0 0 2024-02-15T18:30:56.863 INFO:tasks.workunit.client.0.smithi033.stdout:4/51: read d4/d6/fe [548523,126147] 0 2024-02-15T18:30:56.863 INFO:tasks.workunit.client.0.smithi033.stdout:4/52: dread - d4/d6/fb zero size 2024-02-15T18:30:56.871 INFO:tasks.workunit.client.0.smithi033.stdout:2/23: dwrite f0 [0,4194304] 0 2024-02-15T18:30:56.871 INFO:tasks.workunit.client.0.smithi033.stdout:2/24: fsync f0 0 2024-02-15T18:30:56.889 INFO:tasks.workunit.client.0.smithi033.stdout:4/53: dwrite d4/d6/ff [0,4194304] 0 2024-02-15T18:30:56.891 INFO:tasks.workunit.client.0.smithi033.stdout:2/25: dwrite f0 [0,4194304] 0 2024-02-15T18:30:56.891 INFO:tasks.workunit.client.0.smithi033.stdout:4/54: link d4/d6/c8 d4/d6/c10 0 2024-02-15T18:30:56.893 INFO:tasks.workunit.client.0.smithi033.stdout:2/26: rename f8 to fb 0 2024-02-15T18:30:56.894 INFO:tasks.workunit.client.0.smithi033.stdout:2/27: mkdir dc 0 2024-02-15T18:30:56.894 INFO:tasks.workunit.client.0.smithi033.stdout:2/28: dread - fb zero size 2024-02-15T18:30:56.895 INFO:tasks.workunit.client.0.smithi033.stdout:2/29: write f1 [8328743,12193] 0 2024-02-15T18:30:56.895 INFO:tasks.workunit.client.0.smithi033.stdout:2/30: read - fb zero size 2024-02-15T18:30:56.900 INFO:tasks.workunit.client.0.smithi033.stdout:4/55: dread d4/d6/ff [0,4194304] 0 2024-02-15T18:30:56.902 INFO:tasks.workunit.client.0.smithi033.stdout:4/56: rename f0 to d4/d6/f11 0 2024-02-15T18:30:56.902 INFO:tasks.workunit.client.0.smithi033.stdout:4/57: read d4/d6/fe [747141,44037] 0 2024-02-15T18:30:56.908 INFO:tasks.workunit.client.0.smithi033.stdout:4/58: truncate d4/f7 2142112 0 2024-02-15T18:30:56.908 INFO:tasks.workunit.client.0.smithi033.stdout:4/59: truncate d4/d6/fe 1497706 0 2024-02-15T18:30:56.909 INFO:tasks.workunit.client.0.smithi033.stdout:4/60: mknod d4/d6/c12 0 2024-02-15T18:30:56.909 INFO:tasks.workunit.client.0.smithi033.stdout:4/61: chown d4/d6/c10 1964 1 2024-02-15T18:30:56.909 INFO:tasks.workunit.client.0.smithi033.stdout:4/62: write d4/d6/f9 [2030546,102090] 0 2024-02-15T18:30:56.926 INFO:tasks.workunit.client.0.smithi033.stdout:4/63: dwrite d4/d6/fe [0,4194304] 0 2024-02-15T18:30:56.929 INFO:tasks.workunit.client.0.smithi033.stdout:4/64: mkdir d4/d6/d13 0 2024-02-15T18:30:56.930 INFO:tasks.workunit.client.0.smithi033.stdout:4/65: unlink c3 0 2024-02-15T18:30:56.931 INFO:tasks.workunit.client.0.smithi033.stdout:4/66: write d4/d6/f9 [544788,76] 0 2024-02-15T18:30:56.931 INFO:tasks.workunit.client.0.smithi033.stdout:4/67: write d4/d6/ff [3535994,125437] 0 2024-02-15T18:30:56.933 INFO:tasks.workunit.client.0.smithi033.stdout:4/68: mknod d4/c14 0 2024-02-15T18:30:56.958 INFO:tasks.workunit.client.0.smithi033.stdout:4/69: dread d4/d6/fe [0,4194304] 0 2024-02-15T18:30:56.959 INFO:tasks.workunit.client.0.smithi033.stdout:4/70: link d4/d6/fe d4/f15 0 2024-02-15T18:30:56.959 INFO:tasks.workunit.client.0.smithi033.stdout:4/71: write d4/d6/f9 [2382743,56760] 0 2024-02-15T18:30:56.964 INFO:tasks.workunit.client.0.smithi033.stdout:4/72: dread d4/d6/fe [0,4194304] 0 2024-02-15T18:30:56.964 INFO:tasks.workunit.client.0.smithi033.stdout:4/73: fdatasync d4/d6/fe 0 2024-02-15T18:30:56.965 INFO:tasks.workunit.client.0.smithi033.stdout:4/74: mkdir d4/d6/d16 0 2024-02-15T18:30:56.965 INFO:tasks.workunit.client.0.smithi033.stdout:4/75: write d4/d6/fb [1003914,127485] 0 2024-02-15T18:30:56.967 INFO:tasks.workunit.client.0.smithi033.stdout:4/76: fdatasync d4/d6/f9 0 2024-02-15T18:30:56.968 INFO:tasks.workunit.client.0.smithi033.stdout:4/77: creat d4/f17 x:0 0 0 2024-02-15T18:30:56.968 INFO:tasks.workunit.client.0.smithi033.stdout:4/78: write d4/d6/fb [1047422,32106] 0 2024-02-15T18:30:56.968 INFO:tasks.workunit.client.0.smithi033.stdout:4/79: stat d4/c14 0 2024-02-15T18:30:56.971 INFO:tasks.workunit.client.0.smithi033.stdout:4/80: dread d4/d6/f9 [0,4194304] 0 2024-02-15T18:30:56.971 INFO:tasks.workunit.client.0.smithi033.stdout:4/81: dread - d4/f17 zero size 2024-02-15T18:30:56.983 INFO:tasks.workunit.client.0.smithi033.stdout:4/82: dwrite d4/d6/f11 [0,4194304] 0 2024-02-15T18:30:56.983 INFO:tasks.workunit.client.0.smithi033.stdout:4/83: stat l2 0 2024-02-15T18:30:56.984 INFO:tasks.workunit.client.0.smithi033.stdout:4/84: write d4/f15 [37152,124625] 0 2024-02-15T18:30:56.986 INFO:tasks.workunit.client.0.smithi033.stdout:4/85: write d4/d6/f11 [2979070,85539] 0 2024-02-15T18:30:56.986 INFO:tasks.workunit.client.0.smithi033.stdout:4/86: chown d4/c14 2598 1 2024-02-15T18:30:56.987 INFO:tasks.workunit.client.0.smithi033.stdout:4/87: link l2 d4/d6/l18 0 2024-02-15T18:30:56.988 INFO:tasks.workunit.client.0.smithi033.stdout:4/88: rename d4/d6/d16 to d4/d6/d13/d19 0 2024-02-15T18:30:56.988 INFO:tasks.workunit.client.0.smithi033.stdout:4/89: chown d4/d6/fb 23662034 1 2024-02-15T18:30:56.991 INFO:tasks.workunit.client.0.smithi033.stdout:4/90: fdatasync d4/d6/ff 0 2024-02-15T18:30:56.992 INFO:tasks.workunit.client.0.smithi033.stdout:4/91: link d4/d5/ld d4/d5/l1a 0 2024-02-15T18:30:56.993 INFO:tasks.workunit.client.0.smithi033.stdout:4/92: write d4/d6/ff [2715070,17815] 0 2024-02-15T18:30:56.999 INFO:tasks.workunit.client.0.smithi033.stdout:4/93: rename d4/d6/d13/d19 to d4/d6/d13/d1b 0 2024-02-15T18:30:57.003 INFO:tasks.workunit.client.0.smithi033.stdout:4/94: truncate d4/d6/f11 3424874 0 2024-02-15T18:30:57.004 INFO:tasks.workunit.client.0.smithi033.stdout:4/95: getdents d4/d6/d13/d1b 0 2024-02-15T18:30:57.005 INFO:tasks.workunit.client.0.smithi033.stdout:4/96: dread d4/d6/f9 [0,4194304] 0 2024-02-15T18:30:57.007 INFO:tasks.workunit.client.0.smithi033.stdout:4/97: dread d4/d6/f9 [0,4194304] 0 2024-02-15T18:30:57.010 INFO:tasks.workunit.client.0.smithi033.stdout:4/98: fsync d4/f15 0 2024-02-15T18:30:57.010 INFO:tasks.workunit.client.0.smithi033.stdout:4/99: chown d4/d6/fe 232462 1 2024-02-15T18:30:57.012 INFO:tasks.workunit.client.0.smithi033.stdout:4/100: unlink d4/c14 0 2024-02-15T18:30:57.013 INFO:tasks.workunit.client.0.smithi033.stdout:4/101: rename l2 to d4/d6/d13/l1c 0 2024-02-15T18:30:57.014 INFO:tasks.workunit.client.0.smithi033.stdout:4/102: mknod d4/d5/c1d 0 2024-02-15T18:30:57.015 INFO:tasks.workunit.client.0.smithi033.stdout:4/103: creat d4/d5/f1e x:0 0 0 2024-02-15T18:30:57.016 INFO:tasks.workunit.client.0.smithi033.stdout:4/104: creat d4/d6/f1f x:0 0 0 2024-02-15T18:30:57.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:55.522218+0000 mgr.smithi131.buibla (mgr.24387) 17 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 244 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2024-02-15T18:30:57.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:55.522218+0000 mgr.smithi131.buibla (mgr.24387) 17 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 244 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2024-02-15T18:30:59.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:30:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:57.522922+0000 mgr.smithi131.buibla (mgr.24387) 18 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 325 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 28 MiB/s wr, 1.41k op/s 2024-02-15T18:30:59.922 INFO:tasks.workunit.client.0.smithi033.stdout:2/31: sync 2024-02-15T18:30:59.922 INFO:tasks.workunit.client.0.smithi033.stdout:0/4: sync 2024-02-15T18:30:59.922 INFO:tasks.workunit.client.0.smithi033.stdout:0/5: stat d0 0 2024-02-15T18:30:59.922 INFO:tasks.workunit.client.0.smithi033.stdout:9/7: sync 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:6/18: sync 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:3/10: sync 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:7/7: sync 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:1/19: sync 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:1/20: write - no filename 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:8/13: sync 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:5/29: sync 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:4/105: sync 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:8/14: stat d0 0 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:8/15: readlink - no filename 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:8/16: chown d0 10 1 2024-02-15T18:30:59.923 INFO:tasks.workunit.client.0.smithi033.stdout:5/30: dread - d1/f5 zero size 2024-02-15T18:30:59.924 INFO:tasks.workunit.client.0.smithi033.stdout:5/31: chown d1/f5 8 1 2024-02-15T18:30:59.924 INFO:tasks.workunit.client.0.smithi033.stdout:2/32: rmdir dc 0 2024-02-15T18:30:59.924 INFO:tasks.workunit.client.0.smithi033.stdout:9/8: mkdir d4 0 2024-02-15T18:30:59.924 INFO:tasks.workunit.client.0.smithi033.stdout:9/9: chown f2 5 1 2024-02-15T18:30:59.925 INFO:tasks.workunit.client.0.smithi033.stdout:9/10: chown c3 26935721 1 2024-02-15T18:30:59.925 INFO:tasks.workunit.client.0.smithi033.stdout:6/19: mknod c6 0 2024-02-15T18:30:59.925 INFO:tasks.workunit.client.0.smithi033.stdout:0/6: symlink d0/l1 0 2024-02-15T18:30:59.925 INFO:tasks.workunit.client.0.smithi033.stdout:0/7: dwrite - no filename 2024-02-15T18:30:59.925 INFO:tasks.workunit.client.0.smithi033.stdout:1/21: mkdir d5 0 2024-02-15T18:30:59.926 INFO:tasks.workunit.client.0.smithi033.stdout:1/22: write - no filename 2024-02-15T18:30:59.926 INFO:tasks.workunit.client.0.smithi033.stdout:1/23: dread - no filename 2024-02-15T18:30:59.926 INFO:tasks.workunit.client.0.smithi033.stdout:1/24: write - no filename 2024-02-15T18:30:59.926 INFO:tasks.workunit.client.0.smithi033.stdout:1/25: chown d5 9 1 2024-02-15T18:30:59.926 INFO:tasks.workunit.client.0.smithi033.stdout:1/26: dwrite - no filename 2024-02-15T18:30:59.927 INFO:tasks.workunit.client.0.smithi033.stdout:7/8: link d0/f1 d0/f2 0 2024-02-15T18:30:59.928 INFO:tasks.workunit.client.0.smithi033.stdout:4/106: rename d4/d6 to d4/d20 0 2024-02-15T18:30:59.928 INFO:tasks.workunit.client.0.smithi033.stdout:4/107: fdatasync d4/d20/fe 0 2024-02-15T18:30:59.929 INFO:tasks.workunit.client.0.smithi033.stdout:8/17: mkdir d0/d1 0 2024-02-15T18:30:59.929 INFO:tasks.workunit.client.0.smithi033.stdout:8/18: dread - no filename 2024-02-15T18:30:59.929 INFO:tasks.workunit.client.0.smithi033.stdout:8/19: chown d0/d1 669 1 2024-02-15T18:30:59.929 INFO:tasks.workunit.client.0.smithi033.stdout:5/32: unlink d1/l2 0 2024-02-15T18:30:59.931 INFO:tasks.workunit.client.0.smithi033.stdout:2/33: creat fd x:0 0 0 2024-02-15T18:30:59.931 INFO:tasks.workunit.client.0.smithi033.stdout:4/108: dread d4/d20/f9 [0,4194304] 0 2024-02-15T18:30:59.932 INFO:tasks.workunit.client.0.smithi033.stdout:9/11: creat d4/f5 x:0 0 0 2024-02-15T18:30:59.933 INFO:tasks.workunit.client.0.smithi033.stdout:6/20: creat f7 x:0 0 0 2024-02-15T18:30:59.933 INFO:tasks.workunit.client.0.smithi033.stdout:6/21: write f3 [159232,32054] 0 2024-02-15T18:30:59.936 INFO:tasks.workunit.client.0.smithi033.stdout:0/8: mkdir d0/d2 0 2024-02-15T18:30:59.938 INFO:tasks.workunit.client.0.smithi033.stdout:1/27: mknod d5/c6 0 2024-02-15T18:30:59.939 INFO:tasks.workunit.client.0.smithi033.stdout:7/9: unlink d0/f2 0 2024-02-15T18:30:59.940 INFO:tasks.workunit.client.0.smithi033.stdout:7/10: rename d0 to d0/d3 22 2024-02-15T18:30:59.940 INFO:tasks.workunit.client.0.smithi033.stdout:2/34: write f1 [707087,54788] 0 2024-02-15T18:30:59.940 INFO:tasks.workunit.client.0.smithi033.stdout:2/35: dread - fb zero size 2024-02-15T18:30:59.940 INFO:tasks.workunit.client.0.smithi033.stdout:3/11: dwrite f0 [0,4194304] 0 2024-02-15T18:30:59.941 INFO:tasks.workunit.client.0.smithi033.stdout:8/20: rename d0/d1 to d0/d2 0 2024-02-15T18:30:59.941 INFO:tasks.workunit.client.0.smithi033.stdout:8/21: fdatasync - no filename 2024-02-15T18:30:59.941 INFO:tasks.workunit.client.0.smithi033.stdout:5/33: creat d1/f7 x:0 0 0 2024-02-15T18:30:59.941 INFO:tasks.workunit.client.0.smithi033.stdout:2/36: write f1 [7041339,29846] 0 2024-02-15T18:30:59.941 INFO:tasks.workunit.client.0.smithi033.stdout:4/109: creat d4/f21 x:0 0 0 2024-02-15T18:30:59.942 INFO:tasks.workunit.client.0.smithi033.stdout:9/12: creat d4/f6 x:0 0 0 2024-02-15T18:30:59.942 INFO:tasks.workunit.client.0.smithi033.stdout:9/13: dread - f0 zero size 2024-02-15T18:30:59.942 INFO:tasks.workunit.client.0.smithi033.stdout:9/14: write d4/f6 [1020244,113788] 0 2024-02-15T18:30:59.942 INFO:tasks.workunit.client.0.smithi033.stdout:9/15: truncate f0 272072 0 2024-02-15T18:30:59.943 INFO:tasks.workunit.client.0.smithi033.stdout:0/9: creat d0/d2/f3 x:0 0 0 2024-02-15T18:30:59.943 INFO:tasks.workunit.client.0.smithi033.stdout:0/10: read - d0/d2/f3 zero size 2024-02-15T18:30:59.943 INFO:tasks.workunit.client.0.smithi033.stdout:0/11: dread - d0/d2/f3 zero size 2024-02-15T18:30:59.943 INFO:tasks.workunit.client.0.smithi033.stdout:0/12: chown d0/l1 530 1 2024-02-15T18:30:59.944 INFO:tasks.workunit.client.0.smithi033.stdout:1/28: mknod d5/c7 0 2024-02-15T18:30:59.944 INFO:tasks.workunit.client.0.smithi033.stdout:1/29: write - no filename 2024-02-15T18:30:59.944 INFO:tasks.workunit.client.0.smithi033.stdout:1/30: dread - no filename 2024-02-15T18:30:59.944 INFO:tasks.workunit.client.0.smithi033.stdout:1/31: dwrite - no filename 2024-02-15T18:30:59.944 INFO:tasks.workunit.client.0.smithi033.stdout:1/32: write - no filename 2024-02-15T18:30:59.947 INFO:tasks.workunit.client.0.smithi033.stdout:8/22: mknod d0/d2/c3 0 2024-02-15T18:30:59.947 INFO:tasks.workunit.client.0.smithi033.stdout:3/12: creat d2/f4 x:0 0 0 2024-02-15T18:30:59.947 INFO:tasks.workunit.client.0.smithi033.stdout:5/34: creat d1/f8 x:0 0 0 2024-02-15T18:30:59.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/110: truncate d4/d20/f11 68155 0 2024-02-15T18:30:59.951 INFO:tasks.workunit.client.0.smithi033.stdout:0/13: creat d0/f4 x:0 0 0 2024-02-15T18:30:59.951 INFO:tasks.workunit.client.0.smithi033.stdout:0/14: write d0/f4 [73233,92808] 0 2024-02-15T18:30:59.951 INFO:tasks.workunit.client.0.smithi033.stdout:0/15: write d0/d2/f3 [97455,83469] 0 2024-02-15T18:30:59.954 INFO:tasks.workunit.client.0.smithi033.stdout:8/23: rmdir d0 39 2024-02-15T18:30:59.954 INFO:tasks.workunit.client.0.smithi033.stdout:8/24: dread - no filename 2024-02-15T18:30:59.954 INFO:tasks.workunit.client.0.smithi033.stdout:8/25: dread - no filename 2024-02-15T18:30:59.954 INFO:tasks.workunit.client.0.smithi033.stdout:8/26: fsync - no filename 2024-02-15T18:30:59.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/13: unlink f0 0 2024-02-15T18:30:59.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/14: write d2/f4 [310217,6583] 0 2024-02-15T18:30:59.955 INFO:tasks.workunit.client.0.smithi033.stdout:5/35: creat d1/f9 x:0 0 0 2024-02-15T18:30:59.956 INFO:tasks.workunit.client.0.smithi033.stdout:2/37: mknod ce 0 2024-02-15T18:30:59.956 INFO:tasks.workunit.client.0.smithi033.stdout:8/27: creat d0/d2/f4 x:0 0 0 2024-02-15T18:30:59.957 INFO:tasks.workunit.client.0.smithi033.stdout:9/16: dread d4/f6 [0,4194304] 0 2024-02-15T18:30:59.957 INFO:tasks.workunit.client.0.smithi033.stdout:3/15: creat d2/f5 x:0 0 0 2024-02-15T18:30:59.957 INFO:tasks.workunit.client.0.smithi033.stdout:3/16: write d2/f5 [533449,40971] 0 2024-02-15T18:30:59.957 INFO:tasks.workunit.client.0.smithi033.stdout:3/17: write d2/f4 [809749,55168] 0 2024-02-15T18:30:59.958 INFO:tasks.workunit.client.0.smithi033.stdout:6/22: dwrite f7 [0,4194304] 0 2024-02-15T18:30:59.959 INFO:tasks.workunit.client.0.smithi033.stdout:9/17: mknod d4/c7 0 2024-02-15T18:30:59.961 INFO:tasks.workunit.client.0.smithi033.stdout:7/11: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:30:59.962 INFO:tasks.workunit.client.0.smithi033.stdout:0/16: dread d0/d2/f3 [0,4194304] 0 2024-02-15T18:30:59.968 INFO:tasks.workunit.client.0.smithi033.stdout:4/111: dwrite d4/d20/f9 [0,4194304] 0 2024-02-15T18:30:59.969 INFO:tasks.workunit.client.0.smithi033.stdout:4/112: read d4/d20/ff [1913948,35668] 0 2024-02-15T18:30:59.969 INFO:tasks.workunit.client.0.smithi033.stdout:6/23: mkdir d8 0 2024-02-15T18:30:59.969 INFO:tasks.workunit.client.0.smithi033.stdout:1/33: getdents d5 0 2024-02-15T18:30:59.972 INFO:tasks.workunit.client.0.smithi033.stdout:7/12: dread d0/f1 [0,4194304] 0 2024-02-15T18:30:59.972 INFO:tasks.workunit.client.0.smithi033.stdout:3/18: dread d2/f5 [0,4194304] 0 2024-02-15T18:30:59.972 INFO:tasks.workunit.client.0.smithi033.stdout:4/113: read d4/d20/f9 [2326604,77285] 0 2024-02-15T18:30:59.972 INFO:tasks.workunit.client.0.smithi033.stdout:9/18: mkdir d4/d8 0 2024-02-15T18:30:59.972 INFO:tasks.workunit.client.0.smithi033.stdout:9/19: chown d4/f6 52079635 1 2024-02-15T18:30:59.976 INFO:tasks.workunit.client.0.smithi033.stdout:5/36: getdents d1 0 2024-02-15T18:30:59.976 INFO:tasks.workunit.client.0.smithi033.stdout:5/37: chown d1/l6 2 1 2024-02-15T18:30:59.976 INFO:tasks.workunit.client.0.smithi033.stdout:5/38: stat d1/f9 0 2024-02-15T18:30:59.976 INFO:tasks.workunit.client.0.smithi033.stdout:5/39: dread - d1/f9 zero size 2024-02-15T18:30:59.977 INFO:tasks.workunit.client.0.smithi033.stdout:8/28: dwrite d0/d2/f4 [0,4194304] 0 2024-02-15T18:30:59.978 INFO:tasks.workunit.client.0.smithi033.stdout:7/13: dread d0/f1 [0,4194304] 0 2024-02-15T18:30:59.980 INFO:tasks.workunit.client.0.smithi033.stdout:0/17: getdents d0 0 2024-02-15T18:30:59.981 INFO:tasks.workunit.client.0.smithi033.stdout:0/18: read d0/d2/f3 [128082,76510] 0 2024-02-15T18:30:59.984 INFO:tasks.workunit.client.0.smithi033.stdout:6/24: symlink d8/l9 0 2024-02-15T18:30:59.984 INFO:tasks.workunit.client.0.smithi033.stdout:1/34: creat d5/f8 x:0 0 0 2024-02-15T18:30:59.984 INFO:tasks.workunit.client.0.smithi033.stdout:2/38: rename c3 to cf 0 2024-02-15T18:30:59.984 INFO:tasks.workunit.client.0.smithi033.stdout:3/19: mknod d2/d3/c6 0 2024-02-15T18:30:59.984 INFO:tasks.workunit.client.0.smithi033.stdout:3/20: rename d2 to d2/d3/d7 22 2024-02-15T18:30:59.985 INFO:tasks.workunit.client.0.smithi033.stdout:5/40: mkdir d1/da 0 2024-02-15T18:30:59.987 INFO:tasks.workunit.client.0.smithi033.stdout:7/14: write d0/f1 [3500327,15158] 0 2024-02-15T18:30:59.987 INFO:tasks.workunit.client.0.smithi033.stdout:8/29: creat d0/d2/f5 x:0 0 0 2024-02-15T18:30:59.987 INFO:tasks.workunit.client.0.smithi033.stdout:8/30: stat d0/d2/c3 0 2024-02-15T18:30:59.987 INFO:tasks.workunit.client.0.smithi033.stdout:8/31: readlink - no filename 2024-02-15T18:30:59.989 INFO:tasks.workunit.client.0.smithi033.stdout:3/21: mknod d2/d3/c8 0 2024-02-15T18:30:59.991 INFO:tasks.workunit.client.0.smithi033.stdout:7/15: mknod d0/c4 0 2024-02-15T18:30:59.992 INFO:tasks.workunit.client.0.smithi033.stdout:2/39: mkdir d10 0 2024-02-15T18:30:59.992 INFO:tasks.workunit.client.0.smithi033.stdout:1/35: mkdir d5/d9 0 2024-02-15T18:30:59.992 INFO:tasks.workunit.client.0.smithi033.stdout:1/36: chown d5/f8 116798914 1 2024-02-15T18:30:59.993 INFO:tasks.workunit.client.0.smithi033.stdout:5/41: truncate d1/f4 2364778 0 2024-02-15T18:30:59.995 INFO:tasks.workunit.client.0.smithi033.stdout:9/20: dwrite f2 [0,4194304] 0 2024-02-15T18:30:59.995 INFO:tasks.workunit.client.0.smithi033.stdout:4/114: dwrite d4/d20/f1f [0,4194304] 0 2024-02-15T18:30:59.995 INFO:tasks.workunit.client.0.smithi033.stdout:4/115: chown d4/d20/fe 1 1 2024-02-15T18:30:59.996 INFO:tasks.workunit.client.0.smithi033.stdout:2/40: rmdir d10 0 2024-02-15T18:30:59.998 INFO:tasks.workunit.client.0.smithi033.stdout:1/37: creat d5/d9/fa x:0 0 0 2024-02-15T18:30:59.998 INFO:tasks.workunit.client.0.smithi033.stdout:1/38: dread - d5/d9/fa zero size 2024-02-15T18:30:59.998 INFO:tasks.workunit.client.0.smithi033.stdout:6/25: getdents d8 0 2024-02-15T18:30:59.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:30:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:57.522922+0000 mgr.smithi131.buibla (mgr.24387) 18 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 325 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 28 MiB/s wr, 1.41k op/s 2024-02-15T18:31:00.002 INFO:tasks.workunit.client.0.smithi033.stdout:5/42: creat d1/da/fb x:0 0 0 2024-02-15T18:31:00.003 INFO:tasks.workunit.client.0.smithi033.stdout:7/16: dread d0/f1 [0,4194304] 0 2024-02-15T18:31:00.003 INFO:tasks.workunit.client.0.smithi033.stdout:7/17: chown d0/f1 241595 1 2024-02-15T18:31:00.007 INFO:tasks.workunit.client.0.smithi033.stdout:9/21: creat d4/f9 x:0 0 0 2024-02-15T18:31:00.011 INFO:tasks.workunit.client.0.smithi033.stdout:7/18: rmdir d0 39 2024-02-15T18:31:00.011 INFO:tasks.workunit.client.0.smithi033.stdout:1/39: chown d5/c7 26425212 1 2024-02-15T18:31:00.011 INFO:tasks.workunit.client.0.smithi033.stdout:5/43: dread - d1/f8 zero size 2024-02-15T18:31:00.011 INFO:tasks.workunit.client.0.smithi033.stdout:6/26: unlink l4 0 2024-02-15T18:31:00.013 INFO:tasks.workunit.client.0.smithi033.stdout:5/44: rmdir d1 39 2024-02-15T18:31:00.013 INFO:tasks.workunit.client.0.smithi033.stdout:6/27: creat d8/fa x:0 0 0 2024-02-15T18:31:00.015 INFO:tasks.workunit.client.0.smithi033.stdout:6/28: creat d8/fb x:0 0 0 2024-02-15T18:31:00.017 INFO:tasks.workunit.client.0.smithi033.stdout:7/19: dread d0/f1 [0,4194304] 0 2024-02-15T18:31:00.017 INFO:tasks.workunit.client.0.smithi033.stdout:5/45: link d1/l6 d1/lc 0 2024-02-15T18:31:00.020 INFO:tasks.workunit.client.0.smithi033.stdout:6/29: unlink c6 0 2024-02-15T18:31:00.026 INFO:tasks.workunit.client.0.smithi033.stdout:3/22: dwrite d2/f5 [0,4194304] 0 2024-02-15T18:31:00.027 INFO:tasks.workunit.client.0.smithi033.stdout:3/23: getdents d2 0 2024-02-15T18:31:00.034 INFO:tasks.workunit.client.0.smithi033.stdout:4/116: dwrite d4/d20/fe [0,4194304] 0 2024-02-15T18:31:00.034 INFO:tasks.workunit.client.0.smithi033.stdout:4/117: read - d4/d5/f1e zero size 2024-02-15T18:31:00.035 INFO:tasks.workunit.client.0.smithi033.stdout:4/118: unlink d4/d20/c12 0 2024-02-15T18:31:00.038 INFO:tasks.workunit.client.0.smithi033.stdout:4/119: link d4/d20/ff d4/f22 0 2024-02-15T18:31:00.039 INFO:tasks.workunit.client.0.smithi033.stdout:4/120: symlink d4/l23 0 2024-02-15T18:31:00.040 INFO:tasks.workunit.client.0.smithi033.stdout:8/32: dwrite d0/d2/f4 [4194304,4194304] 0 2024-02-15T18:31:00.041 INFO:tasks.workunit.client.0.smithi033.stdout:2/41: dwrite f9 [8388608,4194304] 0 2024-02-15T18:31:00.041 INFO:tasks.workunit.client.0.smithi033.stdout:9/22: dwrite f0 [0,4194304] 0 2024-02-15T18:31:00.041 INFO:tasks.workunit.client.0.smithi033.stdout:1/40: dwrite d5/d9/fa [0,4194304] 0 2024-02-15T18:31:00.042 INFO:tasks.workunit.client.0.smithi033.stdout:7/20: getdents d0 0 2024-02-15T18:31:00.042 INFO:tasks.workunit.client.0.smithi033.stdout:9/23: dread d4/f6 [0,4194304] 0 2024-02-15T18:31:00.046 INFO:tasks.workunit.client.0.smithi033.stdout:7/21: dread d0/f1 [0,4194304] 0 2024-02-15T18:31:00.046 INFO:tasks.workunit.client.0.smithi033.stdout:7/22: stat d0/f1 0 2024-02-15T18:31:00.047 INFO:tasks.workunit.client.0.smithi033.stdout:9/24: dread d4/f6 [0,4194304] 0 2024-02-15T18:31:00.047 INFO:tasks.workunit.client.0.smithi033.stdout:3/24: dread d2/f5 [0,4194304] 0 2024-02-15T18:31:00.052 INFO:tasks.workunit.client.0.smithi033.stdout:8/33: write d0/d2/f4 [1002304,78300] 0 2024-02-15T18:31:00.057 INFO:tasks.workunit.client.0.smithi033.stdout:7/23: truncate d0/f1 3117396 0 2024-02-15T18:31:00.058 INFO:tasks.workunit.client.0.smithi033.stdout:9/25: symlink d4/d8/la 0 2024-02-15T18:31:00.060 INFO:tasks.workunit.client.0.smithi033.stdout:2/42: symlink l11 0 2024-02-15T18:31:00.060 INFO:tasks.workunit.client.0.smithi033.stdout:2/43: read - fb zero size 2024-02-15T18:31:00.061 INFO:tasks.workunit.client.0.smithi033.stdout:1/41: symlink d5/lb 0 2024-02-15T18:31:00.062 INFO:tasks.workunit.client.0.smithi033.stdout:7/24: symlink d0/l5 0 2024-02-15T18:31:00.063 INFO:tasks.workunit.client.0.smithi033.stdout:1/42: stat d5/c6 0 2024-02-15T18:31:00.063 INFO:tasks.workunit.client.0.smithi033.stdout:1/43: fdatasync d5/f8 0 2024-02-15T18:31:00.064 INFO:tasks.workunit.client.0.smithi033.stdout:7/25: mkdir d0/d6 0 2024-02-15T18:31:00.065 INFO:tasks.workunit.client.0.smithi033.stdout:7/26: chown d0 2046870819 1 2024-02-15T18:31:00.066 INFO:tasks.workunit.client.0.smithi033.stdout:2/44: mknod c12 0 2024-02-15T18:31:00.069 INFO:tasks.workunit.client.0.smithi033.stdout:2/45: mknod c13 0 2024-02-15T18:31:00.071 INFO:tasks.workunit.client.0.smithi033.stdout:5/46: dwrite d1/f9 [0,4194304] 0 2024-02-15T18:31:00.071 INFO:tasks.workunit.client.0.smithi033.stdout:5/47: stat d1/f9 0 2024-02-15T18:31:00.071 INFO:tasks.workunit.client.0.smithi033.stdout:5/48: dread - d1/da/fb zero size 2024-02-15T18:31:00.071 INFO:tasks.workunit.client.0.smithi033.stdout:5/49: read - d1/da/fb zero size 2024-02-15T18:31:00.073 INFO:tasks.workunit.client.0.smithi033.stdout:5/50: truncate d1/f4 2220869 0 2024-02-15T18:31:00.075 INFO:tasks.workunit.client.0.smithi033.stdout:5/51: creat d1/fd x:0 0 0 2024-02-15T18:31:00.075 INFO:tasks.workunit.client.0.smithi033.stdout:5/52: chown d1 1972 1 2024-02-15T18:31:00.075 INFO:tasks.workunit.client.0.smithi033.stdout:5/53: write d1/da/fb [639090,21712] 0 2024-02-15T18:31:00.075 INFO:tasks.workunit.client.0.smithi033.stdout:5/54: truncate d1/f7 1009504 0 2024-02-15T18:31:00.077 INFO:tasks.workunit.client.0.smithi033.stdout:5/55: creat d1/fe x:0 0 0 2024-02-15T18:31:00.078 INFO:tasks.workunit.client.0.smithi033.stdout:5/56: link d1/fe d1/da/ff 0 2024-02-15T18:31:00.078 INFO:tasks.workunit.client.0.smithi033.stdout:5/57: read d1/f7 [895039,6926] 0 2024-02-15T18:31:00.080 INFO:tasks.workunit.client.0.smithi033.stdout:3/25: dwrite d2/f5 [0,4194304] 0 2024-02-15T18:31:00.080 INFO:tasks.workunit.client.0.smithi033.stdout:4/121: dwrite d4/f22 [0,4194304] 0 2024-02-15T18:31:00.084 INFO:tasks.workunit.client.0.smithi033.stdout:4/122: link d4/d20/fb d4/d5/f24 0 2024-02-15T18:31:00.084 INFO:tasks.workunit.client.0.smithi033.stdout:4/123: write d4/d5/f1e [801180,92904] 0 2024-02-15T18:31:00.086 INFO:tasks.workunit.client.0.smithi033.stdout:1/44: getdents d5 0 2024-02-15T18:31:00.089 INFO:tasks.workunit.client.0.smithi033.stdout:9/26: dwrite d4/f9 [0,4194304] 0 2024-02-15T18:31:00.090 INFO:tasks.workunit.client.0.smithi033.stdout:1/45: symlink d5/lc 0 2024-02-15T18:31:00.090 INFO:tasks.workunit.client.0.smithi033.stdout:2/46: dwrite f1 [4194304,4194304] 0 2024-02-15T18:31:00.090 INFO:tasks.workunit.client.0.smithi033.stdout:7/27: write d0/f1 [3076842,122255] 0 2024-02-15T18:31:00.097 INFO:tasks.workunit.client.0.smithi033.stdout:9/27: rename f2 to d4/d8/fb 0 2024-02-15T18:31:00.098 INFO:tasks.workunit.client.0.smithi033.stdout:4/124: dread d4/d20/f1f [0,4194304] 0 2024-02-15T18:31:00.098 INFO:tasks.workunit.client.0.smithi033.stdout:2/47: mknod c14 0 2024-02-15T18:31:00.100 INFO:tasks.workunit.client.0.smithi033.stdout:7/28: fdatasync d0/f1 0 2024-02-15T18:31:00.101 INFO:tasks.workunit.client.0.smithi033.stdout:4/125: unlink d4/d20/d13/l1c 0 2024-02-15T18:31:00.102 INFO:tasks.workunit.client.0.smithi033.stdout:7/29: mknod d0/d6/c7 0 2024-02-15T18:31:00.104 INFO:tasks.workunit.client.0.smithi033.stdout:2/48: rename c13 to c15 0 2024-02-15T18:31:00.105 INFO:tasks.workunit.client.0.smithi033.stdout:7/30: mknod d0/d6/c8 0 2024-02-15T18:31:00.106 INFO:tasks.workunit.client.0.smithi033.stdout:4/126: link d4/f15 d4/d5/f25 0 2024-02-15T18:31:00.106 INFO:tasks.workunit.client.0.smithi033.stdout:4/127: chown d4/d20/d13 64863202 1 2024-02-15T18:31:00.107 INFO:tasks.workunit.client.0.smithi033.stdout:1/46: dread d5/d9/fa [0,4194304] 0 2024-02-15T18:31:00.109 INFO:tasks.workunit.client.0.smithi033.stdout:1/47: unlink l1 0 2024-02-15T18:31:00.110 INFO:tasks.workunit.client.0.smithi033.stdout:1/48: chown d5/lb 12665 1 2024-02-15T18:31:00.111 INFO:tasks.workunit.client.0.smithi033.stdout:3/26: dwrite d2/f5 [0,4194304] 0 2024-02-15T18:31:00.111 INFO:tasks.workunit.client.0.smithi033.stdout:7/31: dread d0/f1 [0,4194304] 0 2024-02-15T18:31:00.111 INFO:tasks.workunit.client.0.smithi033.stdout:7/32: stat d0/d6 0 2024-02-15T18:31:00.111 INFO:tasks.workunit.client.0.smithi033.stdout:8/34: dwrite d0/d2/f4 [4194304,4194304] 0 2024-02-15T18:31:00.112 INFO:tasks.workunit.client.0.smithi033.stdout:8/35: write d0/d2/f5 [648961,61237] 0 2024-02-15T18:31:00.112 INFO:tasks.workunit.client.0.smithi033.stdout:1/49: mkdir d5/dd 0 2024-02-15T18:31:00.113 INFO:tasks.workunit.client.0.smithi033.stdout:3/27: creat d2/f9 x:0 0 0 2024-02-15T18:31:00.115 INFO:tasks.workunit.client.0.smithi033.stdout:7/33: creat d0/f9 x:0 0 0 2024-02-15T18:31:00.115 INFO:tasks.workunit.client.0.smithi033.stdout:7/34: dread - d0/f9 zero size 2024-02-15T18:31:00.115 INFO:tasks.workunit.client.0.smithi033.stdout:7/35: write d0/f9 [804764,46095] 0 2024-02-15T18:31:00.116 INFO:tasks.workunit.client.0.smithi033.stdout:9/28: rmdir d4 39 2024-02-15T18:31:00.116 INFO:tasks.workunit.client.0.smithi033.stdout:5/58: write d1/f4 [1830849,81503] 0 2024-02-15T18:31:00.119 INFO:tasks.workunit.client.0.smithi033.stdout:4/128: truncate d4/f22 1936280 0 2024-02-15T18:31:00.120 INFO:tasks.workunit.client.0.smithi033.stdout:4/129: read d4/d5/f24 [1000629,91499] 0 2024-02-15T18:31:00.120 INFO:tasks.workunit.client.0.smithi033.stdout:4/130: fdatasync d4/d20/f1f 0 2024-02-15T18:31:00.121 INFO:tasks.workunit.client.0.smithi033.stdout:8/36: rmdir d0/d2 39 2024-02-15T18:31:00.121 INFO:tasks.workunit.client.0.smithi033.stdout:8/37: chown d0/d2 1802990 1 2024-02-15T18:31:00.121 INFO:tasks.workunit.client.0.smithi033.stdout:2/49: dwrite f5 [4194304,4194304] 0 2024-02-15T18:31:00.122 INFO:tasks.workunit.client.0.smithi033.stdout:1/50: write d5/f8 [345742,21020] 0 2024-02-15T18:31:00.124 INFO:tasks.workunit.client.0.smithi033.stdout:3/28: creat d2/fa x:0 0 0 2024-02-15T18:31:00.124 INFO:tasks.workunit.client.0.smithi033.stdout:7/36: creat d0/fa x:0 0 0 2024-02-15T18:31:00.128 INFO:tasks.workunit.client.0.smithi033.stdout:9/29: creat d4/fc x:0 0 0 2024-02-15T18:31:00.130 INFO:tasks.workunit.client.0.smithi033.stdout:8/38: creat d0/d2/f6 x:0 0 0 2024-02-15T18:31:00.130 INFO:tasks.workunit.client.0.smithi033.stdout:8/39: write d0/d2/f5 [885702,54575] 0 2024-02-15T18:31:00.130 INFO:tasks.workunit.client.0.smithi033.stdout:8/40: readlink - no filename 2024-02-15T18:31:00.130 INFO:tasks.workunit.client.0.smithi033.stdout:2/50: creat f16 x:0 0 0 2024-02-15T18:31:00.131 INFO:tasks.workunit.client.0.smithi033.stdout:2/51: readlink l11 0 2024-02-15T18:31:00.132 INFO:tasks.workunit.client.0.smithi033.stdout:1/51: link d5/d9/fa d5/dd/fe 0 2024-02-15T18:31:00.135 INFO:tasks.workunit.client.0.smithi033.stdout:4/131: rename d4/f17 to d4/d20/f26 0 2024-02-15T18:31:00.135 INFO:tasks.workunit.client.0.smithi033.stdout:1/52: dread d5/d9/fa [0,4194304] 0 2024-02-15T18:31:00.135 INFO:tasks.workunit.client.0.smithi033.stdout:3/29: rmdir d2/d3 39 2024-02-15T18:31:00.136 INFO:tasks.workunit.client.0.smithi033.stdout:7/37: creat d0/fb x:0 0 0 2024-02-15T18:31:00.136 INFO:tasks.workunit.client.0.smithi033.stdout:7/38: write d0/fb [217841,38103] 0 2024-02-15T18:31:00.136 INFO:tasks.workunit.client.0.smithi033.stdout:9/30: getdents d4/d8 0 2024-02-15T18:31:00.137 INFO:tasks.workunit.client.0.smithi033.stdout:8/41: symlink d0/l7 0 2024-02-15T18:31:00.137 INFO:tasks.workunit.client.0.smithi033.stdout:5/59: dwrite d1/da/fb [0,4194304] 0 2024-02-15T18:31:00.137 INFO:tasks.workunit.client.0.smithi033.stdout:5/60: write d1/fe [646100,95859] 0 2024-02-15T18:31:00.137 INFO:tasks.workunit.client.0.smithi033.stdout:5/61: readlink d1/lc 0 2024-02-15T18:31:00.138 INFO:tasks.workunit.client.0.smithi033.stdout:2/52: creat f17 x:0 0 0 2024-02-15T18:31:00.138 INFO:tasks.workunit.client.0.smithi033.stdout:2/53: dread - fb zero size 2024-02-15T18:31:00.138 INFO:tasks.workunit.client.0.smithi033.stdout:2/54: fdatasync f16 0 2024-02-15T18:31:00.141 INFO:tasks.workunit.client.0.smithi033.stdout:4/132: readlink d4/d5/la 0 2024-02-15T18:31:00.145 INFO:tasks.workunit.client.0.smithi033.stdout:1/53: creat d5/d9/ff x:0 0 0 2024-02-15T18:31:00.145 INFO:tasks.workunit.client.0.smithi033.stdout:1/54: fsync d5/d9/fa 0 2024-02-15T18:31:00.146 INFO:tasks.workunit.client.0.smithi033.stdout:3/30: mkdir d2/db 0 2024-02-15T18:31:00.147 INFO:tasks.workunit.client.0.smithi033.stdout:9/31: unlink d4/f9 0 2024-02-15T18:31:00.148 INFO:tasks.workunit.client.0.smithi033.stdout:8/42: getdents d0 0 2024-02-15T18:31:00.148 INFO:tasks.workunit.client.0.smithi033.stdout:8/43: fsync d0/d2/f6 0 2024-02-15T18:31:00.148 INFO:tasks.workunit.client.0.smithi033.stdout:8/44: dread - d0/d2/f6 zero size 2024-02-15T18:31:00.149 INFO:tasks.workunit.client.0.smithi033.stdout:5/62: rmdir d1 39 2024-02-15T18:31:00.150 INFO:tasks.workunit.client.0.smithi033.stdout:4/133: chown d4/d20/d13 419986 1 2024-02-15T18:31:00.151 INFO:tasks.workunit.client.0.smithi033.stdout:1/55: creat d5/dd/f10 x:0 0 0 2024-02-15T18:31:00.152 INFO:tasks.workunit.client.0.smithi033.stdout:3/31: link d2/d3/c6 d2/d3/cc 0 2024-02-15T18:31:00.154 INFO:tasks.workunit.client.0.smithi033.stdout:2/55: dread f5 [4194304,4194304] 0 2024-02-15T18:31:00.156 INFO:tasks.workunit.client.0.smithi033.stdout:8/45: mkdir d0/d2/d8 0 2024-02-15T18:31:00.156 INFO:tasks.workunit.client.0.smithi033.stdout:8/46: rename d0/d2 to d0/d2/d9 22 2024-02-15T18:31:00.156 INFO:tasks.workunit.client.0.smithi033.stdout:4/134: chown d4/d20/f11 14570963 1 2024-02-15T18:31:00.157 INFO:tasks.workunit.client.0.smithi033.stdout:1/56: truncate d5/dd/fe 1134186 0 2024-02-15T18:31:00.158 INFO:tasks.workunit.client.0.smithi033.stdout:3/32: mknod d2/cd 0 2024-02-15T18:31:00.159 INFO:tasks.workunit.client.0.smithi033.stdout:5/63: dread d1/da/ff [0,4194304] 0 2024-02-15T18:31:00.159 INFO:tasks.workunit.client.0.smithi033.stdout:8/47: link d0/d2/c3 d0/d2/d8/ca 0 2024-02-15T18:31:00.161 INFO:tasks.workunit.client.0.smithi033.stdout:8/48: mkdir d0/d2/d8/db 0 2024-02-15T18:31:00.162 INFO:tasks.workunit.client.0.smithi033.stdout:2/56: dread f5 [4194304,4194304] 0 2024-02-15T18:31:00.166 INFO:tasks.workunit.client.0.smithi033.stdout:4/135: dread d4/f7 [0,4194304] 0 2024-02-15T18:31:00.169 INFO:tasks.workunit.client.0.smithi033.stdout:4/136: rmdir d4 39 2024-02-15T18:31:00.170 INFO:tasks.workunit.client.0.smithi033.stdout:3/33: dread d2/f5 [0,4194304] 0 2024-02-15T18:31:00.171 INFO:tasks.workunit.client.0.smithi033.stdout:3/34: read d2/f4 [741367,115478] 0 2024-02-15T18:31:00.172 INFO:tasks.workunit.client.0.smithi033.stdout:4/137: unlink d4/d20/fe 0 2024-02-15T18:31:00.173 INFO:tasks.workunit.client.0.smithi033.stdout:3/35: truncate d2/f4 527211 0 2024-02-15T18:31:00.173 INFO:tasks.workunit.client.0.smithi033.stdout:4/138: write d4/d20/fb [1766222,88032] 0 2024-02-15T18:31:00.174 INFO:tasks.workunit.client.0.smithi033.stdout:3/36: mkdir d2/de 0 2024-02-15T18:31:00.174 INFO:tasks.workunit.client.0.smithi033.stdout:3/37: chown d2/f5 854316 1 2024-02-15T18:31:00.175 INFO:tasks.workunit.client.0.smithi033.stdout:4/139: read d4/d20/f1f [539363,1231] 0 2024-02-15T18:31:00.176 INFO:tasks.workunit.client.0.smithi033.stdout:4/140: creat d4/d20/f27 x:0 0 0 2024-02-15T18:31:00.176 INFO:tasks.workunit.client.0.smithi033.stdout:4/141: write d4/d5/f1e [970279,85571] 0 2024-02-15T18:31:00.177 INFO:tasks.workunit.client.0.smithi033.stdout:4/142: mkdir d4/d5/d28 0 2024-02-15T18:31:00.178 INFO:tasks.workunit.client.0.smithi033.stdout:4/143: mknod d4/d5/c29 0 2024-02-15T18:31:00.178 INFO:tasks.workunit.client.0.smithi033.stdout:9/32: dwrite f0 [0,4194304] 0 2024-02-15T18:31:00.179 INFO:tasks.workunit.client.0.smithi033.stdout:4/144: link c1 d4/d20/d13/d1b/c2a 0 2024-02-15T18:31:00.179 INFO:tasks.workunit.client.0.smithi033.stdout:9/33: mkdir d4/d8/dd 0 2024-02-15T18:31:00.181 INFO:tasks.workunit.client.0.smithi033.stdout:9/34: creat d4/d8/dd/fe x:0 0 0 2024-02-15T18:31:00.182 INFO:tasks.workunit.client.0.smithi033.stdout:9/35: unlink d4/f6 0 2024-02-15T18:31:00.182 INFO:tasks.workunit.client.0.smithi033.stdout:9/36: truncate d4/f5 250723 0 2024-02-15T18:31:00.184 INFO:tasks.workunit.client.0.smithi033.stdout:9/37: rename d4/f5 to d4/d8/ff 0 2024-02-15T18:31:00.184 INFO:tasks.workunit.client.0.smithi033.stdout:7/39: dwrite d0/fb [0,4194304] 0 2024-02-15T18:31:00.184 INFO:tasks.workunit.client.0.smithi033.stdout:7/40: fsync d0/fb 0 2024-02-15T18:31:00.185 INFO:tasks.workunit.client.0.smithi033.stdout:5/64: dwrite d1/f7 [0,4194304] 0 2024-02-15T18:31:00.186 INFO:tasks.workunit.client.0.smithi033.stdout:2/57: dwrite fd [0,4194304] 0 2024-02-15T18:31:00.186 INFO:tasks.workunit.client.0.smithi033.stdout:2/58: write f1 [13240888,39439] 0 2024-02-15T18:31:00.186 INFO:tasks.workunit.client.0.smithi033.stdout:9/38: rename d4/fc to d4/d8/f10 0 2024-02-15T18:31:00.186 INFO:tasks.workunit.client.0.smithi033.stdout:9/39: chown f0 15731 1 2024-02-15T18:31:00.186 INFO:tasks.workunit.client.0.smithi033.stdout:1/57: fsync d5/dd/f10 0 2024-02-15T18:31:00.186 INFO:tasks.workunit.client.0.smithi033.stdout:1/58: chown d5/dd/f10 148610474 1 2024-02-15T18:31:00.186 INFO:tasks.workunit.client.0.smithi033.stdout:2/59: write f5 [4796843,69750] 0 2024-02-15T18:31:00.186 INFO:tasks.workunit.client.0.smithi033.stdout:2/60: chown f0 2 1 2024-02-15T18:31:00.188 INFO:tasks.workunit.client.0.smithi033.stdout:8/49: getdents d0/d2/d8 0 2024-02-15T18:31:00.189 INFO:tasks.workunit.client.0.smithi033.stdout:8/50: write d0/d2/f4 [5308125,66418] 0 2024-02-15T18:31:00.189 INFO:tasks.workunit.client.0.smithi033.stdout:8/51: chown d0/d2/d8/db 2208 1 2024-02-15T18:31:00.189 INFO:tasks.workunit.client.0.smithi033.stdout:8/52: read d0/d2/f5 [126888,21483] 0 2024-02-15T18:31:00.192 INFO:tasks.workunit.client.0.smithi033.stdout:3/38: dread d2/f4 [0,4194304] 0 2024-02-15T18:31:00.193 INFO:tasks.workunit.client.0.smithi033.stdout:4/145: rmdir d4/d20 39 2024-02-15T18:31:00.193 INFO:tasks.workunit.client.0.smithi033.stdout:4/146: chown d4/d20/fb 26143496 1 2024-02-15T18:31:00.196 INFO:tasks.workunit.client.0.smithi033.stdout:7/41: mkdir d0/dc 0 2024-02-15T18:31:00.196 INFO:tasks.workunit.client.0.smithi033.stdout:7/42: write d0/f9 [1056495,8183] 0 2024-02-15T18:31:00.200 INFO:tasks.workunit.client.0.smithi033.stdout:5/65: mkdir d1/da/d10 0 2024-02-15T18:31:00.200 INFO:tasks.workunit.client.0.smithi033.stdout:5/66: chown d1/lc 199 1 2024-02-15T18:31:00.200 INFO:tasks.workunit.client.0.smithi033.stdout:5/67: chown d1/f8 2 1 2024-02-15T18:31:00.202 INFO:tasks.workunit.client.0.smithi033.stdout:9/40: rename d4/d8/la to d4/d8/dd/l11 0 2024-02-15T18:31:00.203 INFO:tasks.workunit.client.0.smithi033.stdout:2/61: creat f18 x:0 0 0 2024-02-15T18:31:00.203 INFO:tasks.workunit.client.0.smithi033.stdout:8/53: creat d0/d2/d8/db/fc x:0 0 0 2024-02-15T18:31:00.204 INFO:tasks.workunit.client.0.smithi033.stdout:3/39: rmdir d2/de 0 2024-02-15T18:31:00.208 INFO:tasks.workunit.client.0.smithi033.stdout:5/68: mkdir d1/da/d11 0 2024-02-15T18:31:00.209 INFO:tasks.workunit.client.0.smithi033.stdout:1/59: rename l4 to d5/d9/l11 0 2024-02-15T18:31:00.209 INFO:tasks.workunit.client.0.smithi033.stdout:1/60: dread - d5/d9/ff zero size 2024-02-15T18:31:00.209 INFO:tasks.workunit.client.0.smithi033.stdout:1/61: write d5/d9/ff [836520,119525] 0 2024-02-15T18:31:00.210 INFO:tasks.workunit.client.0.smithi033.stdout:9/41: symlink d4/d8/dd/l12 0 2024-02-15T18:31:00.210 INFO:tasks.workunit.client.0.smithi033.stdout:8/54: stat d0/d2/d8/ca 0 2024-02-15T18:31:00.211 INFO:tasks.workunit.client.0.smithi033.stdout:3/40: mkdir d2/d3/df 0 2024-02-15T18:31:00.213 INFO:tasks.workunit.client.0.smithi033.stdout:7/43: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:31:00.213 INFO:tasks.workunit.client.0.smithi033.stdout:7/44: write d0/fa [10996,27681] 0 2024-02-15T18:31:00.213 INFO:tasks.workunit.client.0.smithi033.stdout:7/45: chown d0/d6 265149323 1 2024-02-15T18:31:00.213 INFO:tasks.workunit.client.0.smithi033.stdout:7/46: chown d0/fa 37778 1 2024-02-15T18:31:00.215 INFO:tasks.workunit.client.0.smithi033.stdout:7/47: write d0/f1 [1786135,90085] 0 2024-02-15T18:31:00.215 INFO:tasks.workunit.client.0.smithi033.stdout:7/48: stat d0/d6/c7 0 2024-02-15T18:31:00.216 INFO:tasks.workunit.client.0.smithi033.stdout:4/147: symlink d4/d5/l2b 0 2024-02-15T18:31:00.218 INFO:tasks.workunit.client.0.smithi033.stdout:5/69: rename d1/fd to d1/da/f12 0 2024-02-15T18:31:00.220 INFO:tasks.workunit.client.0.smithi033.stdout:3/41: dread d2/f4 [0,4194304] 0 2024-02-15T18:31:00.221 INFO:tasks.workunit.client.0.smithi033.stdout:9/42: creat d4/d8/dd/f13 x:0 0 0 2024-02-15T18:31:00.221 INFO:tasks.workunit.client.0.smithi033.stdout:9/43: dread - d4/d8/f10 zero size 2024-02-15T18:31:00.221 INFO:tasks.workunit.client.0.smithi033.stdout:9/44: chown d4/d8/dd/fe 1675 1 2024-02-15T18:31:00.221 INFO:tasks.workunit.client.0.smithi033.stdout:9/45: write d4/d8/dd/f13 [427107,122836] 0 2024-02-15T18:31:00.222 INFO:tasks.workunit.client.0.smithi033.stdout:7/49: creat d0/fd x:0 0 0 2024-02-15T18:31:00.223 INFO:tasks.workunit.client.0.smithi033.stdout:4/148: rmdir d4/d20 39 2024-02-15T18:31:00.223 INFO:tasks.workunit.client.0.smithi033.stdout:5/70: rmdir d1 39 2024-02-15T18:31:00.224 INFO:tasks.workunit.client.0.smithi033.stdout:5/71: truncate d1/f8 391627 0 2024-02-15T18:31:00.225 INFO:tasks.workunit.client.0.smithi033.stdout:3/42: rename d2/d3/c8 to d2/c10 0 2024-02-15T18:31:00.225 INFO:tasks.workunit.client.0.smithi033.stdout:9/46: creat d4/d8/dd/f14 x:0 0 0 2024-02-15T18:31:00.225 INFO:tasks.workunit.client.0.smithi033.stdout:9/47: chown d4/d8/dd/f14 7862 1 2024-02-15T18:31:00.226 INFO:tasks.workunit.client.0.smithi033.stdout:2/62: rename f18 to f19 0 2024-02-15T18:31:00.226 INFO:tasks.workunit.client.0.smithi033.stdout:2/63: write f16 [747046,53432] 0 2024-02-15T18:31:00.227 INFO:tasks.workunit.client.0.smithi033.stdout:7/50: creat d0/dc/fe x:0 0 0 2024-02-15T18:31:00.227 INFO:tasks.workunit.client.0.smithi033.stdout:4/149: symlink d4/l2c 0 2024-02-15T18:31:00.227 INFO:tasks.workunit.client.0.smithi033.stdout:5/72: fsync d1/f5 0 2024-02-15T18:31:00.228 INFO:tasks.workunit.client.0.smithi033.stdout:5/73: write d1/da/ff [996720,95530] 0 2024-02-15T18:31:00.229 INFO:tasks.workunit.client.0.smithi033.stdout:1/62: dwrite d5/dd/fe [0,4194304] 0 2024-02-15T18:31:00.229 INFO:tasks.workunit.client.0.smithi033.stdout:3/43: rmdir d2/db 0 2024-02-15T18:31:00.229 INFO:tasks.workunit.client.0.smithi033.stdout:9/48: read d4/d8/ff [66674,19490] 0 2024-02-15T18:31:00.231 INFO:tasks.workunit.client.0.smithi033.stdout:7/51: creat d0/ff x:0 0 0 2024-02-15T18:31:00.231 INFO:tasks.workunit.client.0.smithi033.stdout:7/52: readlink d0/l5 0 2024-02-15T18:31:00.233 INFO:tasks.workunit.client.0.smithi033.stdout:9/49: creat d4/d8/dd/f15 x:0 0 0 2024-02-15T18:31:00.233 INFO:tasks.workunit.client.0.smithi033.stdout:2/64: mknod c1a 0 2024-02-15T18:31:00.233 INFO:tasks.workunit.client.0.smithi033.stdout:4/150: mknod d4/d5/d28/c2d 0 2024-02-15T18:31:00.235 INFO:tasks.workunit.client.0.smithi033.stdout:7/53: rename d0/d6 to d0/dc/d10 0 2024-02-15T18:31:00.236 INFO:tasks.workunit.client.0.smithi033.stdout:9/50: symlink d4/d8/dd/l16 0 2024-02-15T18:31:00.236 INFO:tasks.workunit.client.0.smithi033.stdout:9/51: dread - d4/d8/f10 zero size 2024-02-15T18:31:00.236 INFO:tasks.workunit.client.0.smithi033.stdout:4/151: symlink d4/d5/d28/l2e 0 2024-02-15T18:31:00.237 INFO:tasks.workunit.client.0.smithi033.stdout:7/54: mknod d0/c11 0 2024-02-15T18:31:00.237 INFO:tasks.workunit.client.0.smithi033.stdout:9/52: creat d4/f17 x:0 0 0 2024-02-15T18:31:00.238 INFO:tasks.workunit.client.0.smithi033.stdout:4/152: rename d4/d5/l2b to d4/d20/d13/d1b/l2f 0 2024-02-15T18:31:00.239 INFO:tasks.workunit.client.0.smithi033.stdout:7/55: symlink d0/dc/l12 0 2024-02-15T18:31:00.239 INFO:tasks.workunit.client.0.smithi033.stdout:9/53: symlink d4/d8/dd/l18 0 2024-02-15T18:31:00.240 INFO:tasks.workunit.client.0.smithi033.stdout:4/153: creat d4/d5/f30 x:0 0 0 2024-02-15T18:31:00.241 INFO:tasks.workunit.client.0.smithi033.stdout:7/56: link d0/fd d0/dc/d10/f13 0 2024-02-15T18:31:00.242 INFO:tasks.workunit.client.0.smithi033.stdout:9/54: mknod d4/d8/dd/c19 0 2024-02-15T18:31:00.242 INFO:tasks.workunit.client.0.smithi033.stdout:9/55: write d4/d8/dd/fe [515790,48148] 0 2024-02-15T18:31:00.242 INFO:tasks.workunit.client.0.smithi033.stdout:9/56: stat d4/d8/dd 0 2024-02-15T18:31:00.244 INFO:tasks.workunit.client.0.smithi033.stdout:4/154: rename d4/d5/f30 to d4/d20/d13/f31 0 2024-02-15T18:31:00.244 INFO:tasks.workunit.client.0.smithi033.stdout:7/57: link d0/dc/l12 d0/l14 0 2024-02-15T18:31:00.245 INFO:tasks.workunit.client.0.smithi033.stdout:1/63: dwrite d5/dd/fe [0,4194304] 0 2024-02-15T18:31:00.245 INFO:tasks.workunit.client.0.smithi033.stdout:1/64: truncate d5/dd/f10 688962 0 2024-02-15T18:31:00.246 INFO:tasks.workunit.client.0.smithi033.stdout:5/74: getdents d1/da 0 2024-02-15T18:31:00.246 INFO:tasks.workunit.client.0.smithi033.stdout:5/75: getdents d1/da 0 2024-02-15T18:31:00.247 INFO:tasks.workunit.client.0.smithi033.stdout:5/76: write d1/f5 [556386,90146] 0 2024-02-15T18:31:00.247 INFO:tasks.workunit.client.0.smithi033.stdout:5/77: stat d1 0 2024-02-15T18:31:00.247 INFO:tasks.workunit.client.0.smithi033.stdout:8/55: dwrite d0/d2/d8/db/fc [0,4194304] 0 2024-02-15T18:31:00.255 INFO:tasks.workunit.client.0.smithi033.stdout:1/65: mkdir d5/dd/d12 0 2024-02-15T18:31:00.257 INFO:tasks.workunit.client.0.smithi033.stdout:3/44: getdents d2 0 2024-02-15T18:31:00.258 INFO:tasks.workunit.client.0.smithi033.stdout:2/65: dread f1 [4194304,4194304] 0 2024-02-15T18:31:00.264 INFO:tasks.workunit.client.0.smithi033.stdout:1/66: mknod d5/d9/c13 0 2024-02-15T18:31:00.272 INFO:tasks.workunit.client.0.smithi033.stdout:9/57: dwrite d4/f17 [0,4194304] 0 2024-02-15T18:31:00.272 INFO:tasks.workunit.client.0.smithi033.stdout:3/45: creat d2/f11 x:0 0 0 2024-02-15T18:31:00.279 INFO:tasks.workunit.client.0.smithi033.stdout:2/66: creat f1b x:0 0 0 2024-02-15T18:31:00.279 INFO:tasks.workunit.client.0.smithi033.stdout:2/67: chown c14 581 1 2024-02-15T18:31:00.280 INFO:tasks.workunit.client.0.smithi033.stdout:1/67: creat d5/d9/f14 x:0 0 0 2024-02-15T18:31:00.283 INFO:tasks.workunit.client.0.smithi033.stdout:9/58: link d4/d8/dd/l11 d4/d8/dd/l1a 0 2024-02-15T18:31:00.284 INFO:tasks.workunit.client.0.smithi033.stdout:3/46: creat d2/f12 x:0 0 0 2024-02-15T18:31:00.284 INFO:tasks.workunit.client.0.smithi033.stdout:3/47: truncate d2/f12 128632 0 2024-02-15T18:31:00.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/59: read f0 [4011063,57280] 0 2024-02-15T18:31:00.286 INFO:tasks.workunit.client.0.smithi033.stdout:2/68: rename cf to c1c 0 2024-02-15T18:31:00.286 INFO:tasks.workunit.client.0.smithi033.stdout:8/56: dwrite d0/d2/f5 [0,4194304] 0 2024-02-15T18:31:00.287 INFO:tasks.workunit.client.0.smithi033.stdout:5/78: dwrite d1/f9 [0,4194304] 0 2024-02-15T18:31:00.288 INFO:tasks.workunit.client.0.smithi033.stdout:9/60: mkdir d4/d8/d1b 0 2024-02-15T18:31:00.290 INFO:tasks.workunit.client.0.smithi033.stdout:3/48: dread d2/f5 [0,4194304] 0 2024-02-15T18:31:00.290 INFO:tasks.workunit.client.0.smithi033.stdout:4/155: dwrite d4/d20/d13/f31 [0,4194304] 0 2024-02-15T18:31:00.290 INFO:tasks.workunit.client.0.smithi033.stdout:3/49: write d2/f4 [1494017,26617] 0 2024-02-15T18:31:00.290 INFO:tasks.workunit.client.0.smithi033.stdout:3/50: truncate d2/f12 727137 0 2024-02-15T18:31:00.290 INFO:tasks.workunit.client.0.smithi033.stdout:1/68: symlink d5/l15 0 2024-02-15T18:31:00.290 INFO:tasks.workunit.client.0.smithi033.stdout:1/69: write d5/dd/f10 [258791,80939] 0 2024-02-15T18:31:00.296 INFO:tasks.workunit.client.0.smithi033.stdout:8/57: rmdir d0/d2/d8/db 39 2024-02-15T18:31:00.300 INFO:tasks.workunit.client.0.smithi033.stdout:4/156: creat d4/d20/d13/f32 x:0 0 0 2024-02-15T18:31:00.300 INFO:tasks.workunit.client.0.smithi033.stdout:4/157: chown c1 84834150 1 2024-02-15T18:31:00.301 INFO:tasks.workunit.client.0.smithi033.stdout:1/70: truncate d5/d9/fa 3494766 0 2024-02-15T18:31:00.303 INFO:tasks.workunit.client.0.smithi033.stdout:2/69: rename c14 to c1d 0 2024-02-15T18:31:00.306 INFO:tasks.workunit.client.0.smithi033.stdout:2/70: write f5 [7888615,23483] 0 2024-02-15T18:31:00.306 INFO:tasks.workunit.client.0.smithi033.stdout:8/58: unlink d0/d2/f4 0 2024-02-15T18:31:00.308 INFO:tasks.workunit.client.0.smithi033.stdout:2/71: unlink ca 0 2024-02-15T18:31:00.313 INFO:tasks.workunit.client.0.smithi033.stdout:8/59: mknod d0/d2/cd 0 2024-02-15T18:31:00.315 INFO:tasks.workunit.client.0.smithi033.stdout:2/72: truncate fd 3120956 0 2024-02-15T18:31:00.317 INFO:tasks.workunit.client.0.smithi033.stdout:8/60: creat d0/fe x:0 0 0 2024-02-15T18:31:00.318 INFO:tasks.workunit.client.0.smithi033.stdout:8/61: rename d0/d2/d8 to d0/df 0 2024-02-15T18:31:00.318 INFO:tasks.workunit.client.0.smithi033.stdout:8/62: chown d0/d2/f6 1358599 1 2024-02-15T18:31:00.319 INFO:tasks.workunit.client.0.smithi033.stdout:8/63: fsync d0/d2/f5 0 2024-02-15T18:31:00.319 INFO:tasks.workunit.client.0.smithi033.stdout:2/73: mknod c1e 0 2024-02-15T18:31:00.320 INFO:tasks.workunit.client.0.smithi033.stdout:8/64: symlink d0/l10 0 2024-02-15T18:31:00.322 INFO:tasks.workunit.client.0.smithi033.stdout:2/74: rename c7 to c1f 0 2024-02-15T18:31:00.322 INFO:tasks.workunit.client.0.smithi033.stdout:2/75: truncate fb 740426 0 2024-02-15T18:31:00.323 INFO:tasks.workunit.client.0.smithi033.stdout:2/76: mkdir d20 0 2024-02-15T18:31:00.324 INFO:tasks.workunit.client.0.smithi033.stdout:2/77: unlink f9 0 2024-02-15T18:31:00.329 INFO:tasks.workunit.client.0.smithi033.stdout:9/61: dwrite d4/d8/f10 [0,4194304] 0 2024-02-15T18:31:00.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/71: fdatasync d5/dd/f10 0 2024-02-15T18:31:00.331 INFO:tasks.workunit.client.0.smithi033.stdout:4/158: dwrite d4/d20/f9 [4194304,4194304] 0 2024-02-15T18:31:00.331 INFO:tasks.workunit.client.0.smithi033.stdout:1/72: read d5/dd/fe [3234791,53387] 0 2024-02-15T18:31:00.332 INFO:tasks.workunit.client.0.smithi033.stdout:5/79: dwrite d1/f4 [0,4194304] 0 2024-02-15T18:31:00.332 INFO:tasks.workunit.client.0.smithi033.stdout:3/51: dwrite d2/f12 [0,4194304] 0 2024-02-15T18:31:00.340 INFO:tasks.workunit.client.0.smithi033.stdout:2/78: dread f0 [0,4194304] 0 2024-02-15T18:31:00.340 INFO:tasks.workunit.client.0.smithi033.stdout:2/79: fdatasync f1b 0 2024-02-15T18:31:00.340 INFO:tasks.workunit.client.0.smithi033.stdout:3/52: dread d2/f12 [0,4194304] 0 2024-02-15T18:31:00.340 INFO:tasks.workunit.client.0.smithi033.stdout:4/159: symlink d4/d20/d13/d1b/l33 0 2024-02-15T18:31:00.342 INFO:tasks.workunit.client.0.smithi033.stdout:9/62: truncate d4/d8/f10 4124449 0 2024-02-15T18:31:00.345 INFO:tasks.workunit.client.0.smithi033.stdout:1/73: getdents d5 0 2024-02-15T18:31:00.348 INFO:tasks.workunit.client.0.smithi033.stdout:5/80: rename d1/f8 to d1/da/f13 0 2024-02-15T18:31:00.353 INFO:tasks.workunit.client.0.smithi033.stdout:1/74: dread d5/d9/fa [0,4194304] 0 2024-02-15T18:31:00.354 INFO:tasks.workunit.client.0.smithi033.stdout:1/75: write d5/dd/fe [355621,44945] 0 2024-02-15T18:31:00.354 INFO:tasks.workunit.client.0.smithi033.stdout:1/76: write d5/d9/fa [770969,53756] 0 2024-02-15T18:31:00.359 INFO:tasks.workunit.client.0.smithi033.stdout:2/80: creat d20/f21 x:0 0 0 2024-02-15T18:31:00.359 INFO:tasks.workunit.client.0.smithi033.stdout:2/81: write f1b [94112,47297] 0 2024-02-15T18:31:00.359 INFO:tasks.workunit.client.0.smithi033.stdout:2/82: fdatasync f5 0 2024-02-15T18:31:00.360 INFO:tasks.workunit.client.0.smithi033.stdout:2/83: fsync f17 0 2024-02-15T18:31:00.360 INFO:tasks.workunit.client.0.smithi033.stdout:4/160: mkdir d4/d20/d13/d34 0 2024-02-15T18:31:00.360 INFO:tasks.workunit.client.0.smithi033.stdout:4/161: fdatasync d4/d20/d13/f32 0 2024-02-15T18:31:00.362 INFO:tasks.workunit.client.0.smithi033.stdout:5/81: truncate d1/f7 3029190 0 2024-02-15T18:31:00.362 INFO:tasks.workunit.client.0.smithi033.stdout:5/82: fsync d1/fe 0 2024-02-15T18:31:00.362 INFO:tasks.workunit.client.0.smithi033.stdout:5/83: write d1/f5 [766200,60833] 0 2024-02-15T18:31:00.364 INFO:tasks.workunit.client.0.smithi033.stdout:1/77: mkdir d5/dd/d16 0 2024-02-15T18:31:00.364 INFO:tasks.workunit.client.0.smithi033.stdout:2/84: mkdir d20/d22 0 2024-02-15T18:31:00.366 INFO:tasks.workunit.client.0.smithi033.stdout:2/85: creat d20/d22/f23 x:0 0 0 2024-02-15T18:31:00.366 INFO:tasks.workunit.client.0.smithi033.stdout:2/86: dread - f17 zero size 2024-02-15T18:31:00.366 INFO:tasks.workunit.client.0.smithi033.stdout:1/78: fdatasync d5/d9/fa 0 2024-02-15T18:31:00.367 INFO:tasks.workunit.client.0.smithi033.stdout:5/84: write d1/f9 [175573,85442] 0 2024-02-15T18:31:00.368 INFO:tasks.workunit.client.0.smithi033.stdout:2/87: rename fb to d20/d22/f24 0 2024-02-15T18:31:00.368 INFO:tasks.workunit.client.0.smithi033.stdout:2/88: write f1b [599806,61843] 0 2024-02-15T18:31:00.368 INFO:tasks.workunit.client.0.smithi033.stdout:3/53: dwrite d2/f5 [4194304,4194304] 0 2024-02-15T18:31:00.368 INFO:tasks.workunit.client.0.smithi033.stdout:3/54: truncate d2/f11 511310 0 2024-02-15T18:31:00.368 INFO:tasks.workunit.client.0.smithi033.stdout:3/55: readlink - no filename 2024-02-15T18:31:00.369 INFO:tasks.workunit.client.0.smithi033.stdout:9/63: dwrite d4/d8/dd/f14 [0,4194304] 0 2024-02-15T18:31:00.369 INFO:tasks.workunit.client.0.smithi033.stdout:9/64: fsync d4/d8/dd/fe 0 2024-02-15T18:31:00.371 INFO:tasks.workunit.client.0.smithi033.stdout:4/162: write d4/d20/f26 [93947,129694] 0 2024-02-15T18:31:00.373 INFO:tasks.workunit.client.0.smithi033.stdout:2/89: link ce d20/c25 0 2024-02-15T18:31:00.373 INFO:tasks.workunit.client.0.smithi033.stdout:2/90: fdatasync fd 0 2024-02-15T18:31:00.373 INFO:tasks.workunit.client.0.smithi033.stdout:2/91: readlink l11 0 2024-02-15T18:31:00.374 INFO:tasks.workunit.client.0.smithi033.stdout:2/92: read f0 [1945884,92302] 0 2024-02-15T18:31:00.374 INFO:tasks.workunit.client.0.smithi033.stdout:2/93: write d20/f21 [881370,86995] 0 2024-02-15T18:31:00.374 INFO:tasks.workunit.client.0.smithi033.stdout:2/94: chown d20/d22 0 1 2024-02-15T18:31:00.375 INFO:tasks.workunit.client.0.smithi033.stdout:2/95: write f1b [109988,60743] 0 2024-02-15T18:31:00.375 INFO:tasks.workunit.client.0.smithi033.stdout:2/96: write d20/d22/f23 [449143,47588] 0 2024-02-15T18:31:00.375 INFO:tasks.workunit.client.0.smithi033.stdout:3/56: mknod d2/d3/df/c13 0 2024-02-15T18:31:00.378 INFO:tasks.workunit.client.0.smithi033.stdout:9/65: truncate f0 3163002 0 2024-02-15T18:31:00.378 INFO:tasks.workunit.client.0.smithi033.stdout:9/66: chown d4/d8/dd/c19 1 1 2024-02-15T18:31:00.382 INFO:tasks.workunit.client.0.smithi033.stdout:3/57: mkdir d2/d14 0 2024-02-15T18:31:00.384 INFO:tasks.workunit.client.0.smithi033.stdout:9/67: creat d4/d8/f1c x:0 0 0 2024-02-15T18:31:00.384 INFO:tasks.workunit.client.0.smithi033.stdout:3/58: mknod d2/d14/c15 0 2024-02-15T18:31:00.385 INFO:tasks.workunit.client.0.smithi033.stdout:3/59: fsync d2/fa 0 2024-02-15T18:31:00.386 INFO:tasks.workunit.client.0.smithi033.stdout:9/68: creat d4/d8/f1d x:0 0 0 2024-02-15T18:31:00.386 INFO:tasks.workunit.client.0.smithi033.stdout:5/85: write d1/f7 [1876121,53693] 0 2024-02-15T18:31:00.386 INFO:tasks.workunit.client.0.smithi033.stdout:1/79: dwrite d5/dd/f10 [0,4194304] 0 2024-02-15T18:31:00.387 INFO:tasks.workunit.client.0.smithi033.stdout:3/60: creat d2/d14/f16 x:0 0 0 2024-02-15T18:31:00.388 INFO:tasks.workunit.client.0.smithi033.stdout:9/69: creat d4/d8/d1b/f1e x:0 0 0 2024-02-15T18:31:00.390 INFO:tasks.workunit.client.0.smithi033.stdout:1/80: dread d5/d9/fa [0,4194304] 0 2024-02-15T18:31:00.390 INFO:tasks.workunit.client.0.smithi033.stdout:1/81: write d5/d9/f14 [776260,50023] 0 2024-02-15T18:31:00.390 INFO:tasks.workunit.client.0.smithi033.stdout:5/86: creat d1/f14 x:0 0 0 2024-02-15T18:31:00.395 INFO:tasks.workunit.client.0.smithi033.stdout:5/87: symlink d1/l15 0 2024-02-15T18:31:00.396 INFO:tasks.workunit.client.0.smithi033.stdout:4/163: dread d4/d5/f25 [0,4194304] 0 2024-02-15T18:31:00.413 INFO:tasks.workunit.client.0.smithi033.stdout:2/97: dwrite f1 [4194304,4194304] 0 2024-02-15T18:31:00.419 INFO:tasks.workunit.client.0.smithi033.stdout:2/98: creat d20/d22/f26 x:0 0 0 2024-02-15T18:31:00.419 INFO:tasks.workunit.client.0.smithi033.stdout:2/99: fdatasync f5 0 2024-02-15T18:31:00.421 INFO:tasks.workunit.client.0.smithi033.stdout:2/100: link c12 d20/c27 0 2024-02-15T18:31:00.421 INFO:tasks.workunit.client.0.smithi033.stdout:2/101: fsync f19 0 2024-02-15T18:31:00.421 INFO:tasks.workunit.client.0.smithi033.stdout:2/102: chown c12 30 1 2024-02-15T18:31:00.421 INFO:tasks.workunit.client.0.smithi033.stdout:2/103: dread - f19 zero size 2024-02-15T18:31:00.436 INFO:tasks.workunit.client.0.smithi033.stdout:3/61: dwrite d2/f5 [0,4194304] 0 2024-02-15T18:31:00.436 INFO:tasks.workunit.client.0.smithi033.stdout:3/62: readlink - no filename 2024-02-15T18:31:00.436 INFO:tasks.workunit.client.0.smithi033.stdout:1/82: dwrite d5/d9/ff [0,4194304] 0 2024-02-15T18:31:00.437 INFO:tasks.workunit.client.0.smithi033.stdout:4/164: dwrite d4/d20/f27 [0,4194304] 0 2024-02-15T18:31:00.437 INFO:tasks.workunit.client.0.smithi033.stdout:5/88: dwrite d1/f9 [0,4194304] 0 2024-02-15T18:31:00.438 INFO:tasks.workunit.client.0.smithi033.stdout:2/104: getdents d20/d22 0 2024-02-15T18:31:00.439 INFO:tasks.workunit.client.0.smithi033.stdout:5/89: dread d1/da/ff [0,4194304] 0 2024-02-15T18:31:00.439 INFO:tasks.workunit.client.0.smithi033.stdout:3/63: mkdir d2/d3/d17 0 2024-02-15T18:31:00.440 INFO:tasks.workunit.client.0.smithi033.stdout:2/105: read fd [2092929,4855] 0 2024-02-15T18:31:00.442 INFO:tasks.workunit.client.0.smithi033.stdout:1/83: mkdir d5/d17 0 2024-02-15T18:31:00.449 INFO:tasks.workunit.client.0.smithi033.stdout:3/64: unlink d2/d3/cc 0 2024-02-15T18:31:00.450 INFO:tasks.workunit.client.0.smithi033.stdout:2/106: rename f16 to d20/d22/f28 0 2024-02-15T18:31:00.451 INFO:tasks.workunit.client.0.smithi033.stdout:3/65: write d2/f4 [925833,44070] 0 2024-02-15T18:31:00.452 INFO:tasks.workunit.client.0.smithi033.stdout:3/66: write d2/f11 [1531538,75194] 0 2024-02-15T18:31:00.452 INFO:tasks.workunit.client.0.smithi033.stdout:2/107: creat d20/f29 x:0 0 0 2024-02-15T18:31:00.452 INFO:tasks.workunit.client.0.smithi033.stdout:2/108: dread - d20/f29 zero size 2024-02-15T18:31:00.455 INFO:tasks.workunit.client.0.smithi033.stdout:3/67: symlink d2/d3/df/l18 0 2024-02-15T18:31:00.456 INFO:tasks.workunit.client.0.smithi033.stdout:2/109: link d20/c27 d20/c2a 0 2024-02-15T18:31:00.456 INFO:tasks.workunit.client.0.smithi033.stdout:1/84: dread d5/dd/f10 [0,4194304] 0 2024-02-15T18:31:00.456 INFO:tasks.workunit.client.0.smithi033.stdout:2/110: creat d20/f2b x:0 0 0 2024-02-15T18:31:00.462 INFO:tasks.workunit.client.0.smithi033.stdout:4/165: dwrite d4/d20/f26 [0,4194304] 0 2024-02-15T18:31:00.463 INFO:tasks.workunit.client.0.smithi033.stdout:4/166: truncate d4/d20/f11 1085806 0 2024-02-15T18:31:00.463 INFO:tasks.workunit.client.0.smithi033.stdout:5/90: dwrite d1/f5 [0,4194304] 0 2024-02-15T18:31:00.466 INFO:tasks.workunit.client.0.smithi033.stdout:4/167: symlink d4/d5/d28/l35 0 2024-02-15T18:31:00.468 INFO:tasks.workunit.client.0.smithi033.stdout:4/168: chown d4/d20/ff 912724 1 2024-02-15T18:31:00.471 INFO:tasks.workunit.client.0.smithi033.stdout:4/169: creat d4/d5/d28/f36 x:0 0 0 2024-02-15T18:31:00.496 INFO:tasks.workunit.client.0.smithi033.stdout:2/111: dwrite f5 [4194304,4194304] 0 2024-02-15T18:31:00.497 INFO:tasks.workunit.client.0.smithi033.stdout:1/85: dwrite d5/d9/ff [0,4194304] 0 2024-02-15T18:31:00.497 INFO:tasks.workunit.client.0.smithi033.stdout:1/86: chown d5/dd/d16 95534 1 2024-02-15T18:31:00.497 INFO:tasks.workunit.client.0.smithi033.stdout:2/112: mknod d20/c2c 0 2024-02-15T18:31:00.498 INFO:tasks.workunit.client.0.smithi033.stdout:2/113: dread - d20/f2b zero size 2024-02-15T18:31:00.498 INFO:tasks.workunit.client.0.smithi033.stdout:1/87: read d5/d9/fa [2312762,82803] 0 2024-02-15T18:31:00.498 INFO:tasks.workunit.client.0.smithi033.stdout:1/88: readlink d5/lb 0 2024-02-15T18:31:00.499 INFO:tasks.workunit.client.0.smithi033.stdout:3/68: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:00.499 INFO:tasks.workunit.client.0.smithi033.stdout:3/69: read - d2/d14/f16 zero size 2024-02-15T18:31:00.499 INFO:tasks.workunit.client.0.smithi033.stdout:5/91: dwrite d1/fe [0,4194304] 0 2024-02-15T18:31:00.500 INFO:tasks.workunit.client.0.smithi033.stdout:2/114: getdents d20/d22 0 2024-02-15T18:31:00.500 INFO:tasks.workunit.client.0.smithi033.stdout:2/115: write d20/d22/f26 [976284,36122] 0 2024-02-15T18:31:00.500 INFO:tasks.workunit.client.0.smithi033.stdout:3/70: write d2/f11 [821193,94585] 0 2024-02-15T18:31:00.501 INFO:tasks.workunit.client.0.smithi033.stdout:3/71: stat d2/f5 0 2024-02-15T18:31:00.505 INFO:tasks.workunit.client.0.smithi033.stdout:2/116: creat d20/f2d x:0 0 0 2024-02-15T18:31:00.505 INFO:tasks.workunit.client.0.smithi033.stdout:2/117: readlink l11 0 2024-02-15T18:31:00.505 INFO:tasks.workunit.client.0.smithi033.stdout:3/72: write d2/f5 [543419,122865] 0 2024-02-15T18:31:00.506 INFO:tasks.workunit.client.0.smithi033.stdout:6/30: sync 2024-02-15T18:31:00.506 INFO:tasks.workunit.client.0.smithi033.stdout:8/65: sync 2024-02-15T18:31:00.506 INFO:tasks.workunit.client.0.smithi033.stdout:0/19: sync 2024-02-15T18:31:00.508 INFO:tasks.workunit.client.0.smithi033.stdout:2/118: link d20/f21 d20/d22/f2e 0 2024-02-15T18:31:00.508 INFO:tasks.workunit.client.0.smithi033.stdout:7/58: sync 2024-02-15T18:31:00.508 INFO:tasks.workunit.client.0.smithi033.stdout:7/59: chown d0/l5 46042 1 2024-02-15T18:31:00.509 INFO:tasks.workunit.client.0.smithi033.stdout:1/89: truncate d5/d9/ff 2913467 0 2024-02-15T18:31:00.509 INFO:tasks.workunit.client.0.smithi033.stdout:1/90: chown d5 0 1 2024-02-15T18:31:00.509 INFO:tasks.workunit.client.0.smithi033.stdout:1/91: write d5/dd/f10 [5191651,70893] 0 2024-02-15T18:31:00.509 INFO:tasks.workunit.client.0.smithi033.stdout:1/92: write d5/d9/f14 [1867476,30354] 0 2024-02-15T18:31:00.510 INFO:tasks.workunit.client.0.smithi033.stdout:3/73: rmdir d2/d14 39 2024-02-15T18:31:00.510 INFO:tasks.workunit.client.0.smithi033.stdout:8/66: rmdir d0/df 39 2024-02-15T18:31:00.512 INFO:tasks.workunit.client.0.smithi033.stdout:6/31: mkdir d8/dc 0 2024-02-15T18:31:00.512 INFO:tasks.workunit.client.0.smithi033.stdout:6/32: chown d8/dc 2358 1 2024-02-15T18:31:00.512 INFO:tasks.workunit.client.0.smithi033.stdout:6/33: write f0 [815070,123654] 0 2024-02-15T18:31:00.512 INFO:tasks.workunit.client.0.smithi033.stdout:0/20: link d0/d2/f3 d0/f5 0 2024-02-15T18:31:00.514 INFO:tasks.workunit.client.0.smithi033.stdout:5/92: dwrite d1/da/f13 [0,4194304] 0 2024-02-15T18:31:00.515 INFO:tasks.workunit.client.0.smithi033.stdout:2/119: link d20/c25 d20/c2f 0 2024-02-15T18:31:00.515 INFO:tasks.workunit.client.0.smithi033.stdout:2/120: write d20/f2d [832639,117104] 0 2024-02-15T18:31:00.515 INFO:tasks.workunit.client.0.smithi033.stdout:5/93: read d1/da/ff [488413,95087] 0 2024-02-15T18:31:00.515 INFO:tasks.workunit.client.0.smithi033.stdout:5/94: chown d1/da/ff 25 1 2024-02-15T18:31:00.517 INFO:tasks.workunit.client.0.smithi033.stdout:7/60: link d0/dc/d10/c7 d0/dc/c15 0 2024-02-15T18:31:00.519 INFO:tasks.workunit.client.0.smithi033.stdout:3/74: dread d2/f11 [0,4194304] 0 2024-02-15T18:31:00.520 INFO:tasks.workunit.client.0.smithi033.stdout:1/93: rename d5/lb to d5/dd/d12/l18 0 2024-02-15T18:31:00.520 INFO:tasks.workunit.client.0.smithi033.stdout:0/21: rename d0 to d0/d2/d6 22 2024-02-15T18:31:00.521 INFO:tasks.workunit.client.0.smithi033.stdout:8/67: rmdir d0/d2 39 2024-02-15T18:31:00.522 INFO:tasks.workunit.client.0.smithi033.stdout:6/34: mknod d8/dc/cd 0 2024-02-15T18:31:00.522 INFO:tasks.workunit.client.0.smithi033.stdout:6/35: fdatasync d8/fa 0 2024-02-15T18:31:00.523 INFO:tasks.workunit.client.0.smithi033.stdout:5/95: dread d1/f4 [0,4194304] 0 2024-02-15T18:31:00.524 INFO:tasks.workunit.client.0.smithi033.stdout:6/36: dread f0 [0,4194304] 0 2024-02-15T18:31:00.527 INFO:tasks.workunit.client.0.smithi033.stdout:7/61: mknod d0/dc/c16 0 2024-02-15T18:31:00.527 INFO:tasks.workunit.client.0.smithi033.stdout:7/62: chown d0/dc/l12 763809 1 2024-02-15T18:31:00.529 INFO:tasks.workunit.client.0.smithi033.stdout:3/75: rename d2/d14/c15 to d2/c19 0 2024-02-15T18:31:00.529 INFO:tasks.workunit.client.0.smithi033.stdout:3/76: chown d2/d14 86 1 2024-02-15T18:31:00.529 INFO:tasks.workunit.client.0.smithi033.stdout:1/94: rmdir d5 39 2024-02-15T18:31:00.529 INFO:tasks.workunit.client.0.smithi033.stdout:0/22: creat d0/d2/f7 x:0 0 0 2024-02-15T18:31:00.531 INFO:tasks.workunit.client.0.smithi033.stdout:8/68: creat d0/df/f11 x:0 0 0 2024-02-15T18:31:00.531 INFO:tasks.workunit.client.0.smithi033.stdout:8/69: write d0/df/f11 [759253,57372] 0 2024-02-15T18:31:00.532 INFO:tasks.workunit.client.0.smithi033.stdout:5/96: symlink d1/da/l16 0 2024-02-15T18:31:00.533 INFO:tasks.workunit.client.0.smithi033.stdout:7/63: dread d0/f1 [0,4194304] 0 2024-02-15T18:31:00.533 INFO:tasks.workunit.client.0.smithi033.stdout:7/64: chown d0/f9 3919 1 2024-02-15T18:31:00.533 INFO:tasks.workunit.client.0.smithi033.stdout:7/65: read - d0/ff zero size 2024-02-15T18:31:00.533 INFO:tasks.workunit.client.0.smithi033.stdout:7/66: chown d0/l14 7145 1 2024-02-15T18:31:00.533 INFO:tasks.workunit.client.0.smithi033.stdout:7/67: dread - d0/ff zero size 2024-02-15T18:31:00.534 INFO:tasks.workunit.client.0.smithi033.stdout:6/37: link d8/l9 d8/le 0 2024-02-15T18:31:00.534 INFO:tasks.workunit.client.0.smithi033.stdout:3/77: symlink d2/l1a 0 2024-02-15T18:31:00.534 INFO:tasks.workunit.client.0.smithi033.stdout:3/78: fdatasync d2/d14/f16 0 2024-02-15T18:31:00.534 INFO:tasks.workunit.client.0.smithi033.stdout:3/79: fsync d2/f5 0 2024-02-15T18:31:00.536 INFO:tasks.workunit.client.0.smithi033.stdout:7/68: dread d0/f1 [0,4194304] 0 2024-02-15T18:31:00.537 INFO:tasks.workunit.client.0.smithi033.stdout:1/95: creat d5/f19 x:0 0 0 2024-02-15T18:31:00.537 INFO:tasks.workunit.client.0.smithi033.stdout:0/23: mkdir d0/d8 0 2024-02-15T18:31:00.537 INFO:tasks.workunit.client.0.smithi033.stdout:1/96: readlink d5/dd/d12/l18 0 2024-02-15T18:31:00.537 INFO:tasks.workunit.client.0.smithi033.stdout:8/70: symlink d0/d2/l12 0 2024-02-15T18:31:00.537 INFO:tasks.workunit.client.0.smithi033.stdout:8/71: fsync d0/d2/f6 0 2024-02-15T18:31:00.537 INFO:tasks.workunit.client.0.smithi033.stdout:8/72: truncate d0/fe 965690 0 2024-02-15T18:31:00.537 INFO:tasks.workunit.client.0.smithi033.stdout:5/97: creat d1/da/d11/f17 x:0 0 0 2024-02-15T18:31:00.537 INFO:tasks.workunit.client.0.smithi033.stdout:5/98: chown d1/da/fb 24692 1 2024-02-15T18:31:00.538 INFO:tasks.workunit.client.0.smithi033.stdout:6/38: mknod d8/dc/cf 0 2024-02-15T18:31:00.538 INFO:tasks.workunit.client.0.smithi033.stdout:5/99: write d1/f7 [2894457,8665] 0 2024-02-15T18:31:00.538 INFO:tasks.workunit.client.0.smithi033.stdout:0/24: mknod d0/d8/c9 0 2024-02-15T18:31:00.539 INFO:tasks.workunit.client.0.smithi033.stdout:8/73: symlink d0/df/db/l13 0 2024-02-15T18:31:00.539 INFO:tasks.workunit.client.0.smithi033.stdout:6/39: mkdir d8/d10 0 2024-02-15T18:31:00.539 INFO:tasks.workunit.client.0.smithi033.stdout:6/40: read - d8/fb zero size 2024-02-15T18:31:00.540 INFO:tasks.workunit.client.0.smithi033.stdout:0/25: symlink d0/d8/la 0 2024-02-15T18:31:00.540 INFO:tasks.workunit.client.0.smithi033.stdout:0/26: dread - d0/d2/f7 zero size 2024-02-15T18:31:00.541 INFO:tasks.workunit.client.0.smithi033.stdout:8/74: getdents d0 0 2024-02-15T18:31:00.542 INFO:tasks.workunit.client.0.smithi033.stdout:8/75: truncate d0/df/db/fc 2914677 0 2024-02-15T18:31:00.542 INFO:tasks.workunit.client.0.smithi033.stdout:8/76: chown d0/df/db 254 1 2024-02-15T18:31:00.543 INFO:tasks.workunit.client.0.smithi033.stdout:5/100: write d1/f5 [1124832,7584] 0 2024-02-15T18:31:00.543 INFO:tasks.workunit.client.0.smithi033.stdout:5/101: chown d1/f7 0 1 2024-02-15T18:31:00.544 INFO:tasks.workunit.client.0.smithi033.stdout:7/69: read d0/fa [3283,1545] 0 2024-02-15T18:31:00.544 INFO:tasks.workunit.client.0.smithi033.stdout:7/70: chown d0/ff 425 1 2024-02-15T18:31:00.547 INFO:tasks.workunit.client.0.smithi033.stdout:5/102: stat d1/l6 0 2024-02-15T18:31:00.549 INFO:tasks.workunit.client.0.smithi033.stdout:7/71: rename d0/fb to d0/dc/d10/f17 0 2024-02-15T18:31:00.553 INFO:tasks.workunit.client.0.smithi033.stdout:7/72: dread d0/f1 [0,4194304] 0 2024-02-15T18:31:00.553 INFO:tasks.workunit.client.0.smithi033.stdout:7/73: rename d0/dc to d0/dc/d18 22 2024-02-15T18:31:00.553 INFO:tasks.workunit.client.0.smithi033.stdout:7/74: fsync d0/fa 0 2024-02-15T18:31:00.554 INFO:tasks.workunit.client.0.smithi033.stdout:7/75: truncate d0/dc/fe 946877 0 2024-02-15T18:31:00.555 INFO:tasks.workunit.client.0.smithi033.stdout:3/80: dwrite d2/f12 [4194304,4194304] 0 2024-02-15T18:31:00.555 INFO:tasks.workunit.client.0.smithi033.stdout:3/81: write d2/d14/f16 [453699,47261] 0 2024-02-15T18:31:00.560 INFO:tasks.workunit.client.0.smithi033.stdout:5/103: write d1/f5 [79418,126428] 0 2024-02-15T18:31:00.563 INFO:tasks.workunit.client.0.smithi033.stdout:5/104: dread d1/f4 [0,4194304] 0 2024-02-15T18:31:00.564 INFO:tasks.workunit.client.0.smithi033.stdout:7/76: mknod d0/dc/c19 0 2024-02-15T18:31:00.568 INFO:tasks.workunit.client.0.smithi033.stdout:5/105: mknod d1/c18 0 2024-02-15T18:31:00.576 INFO:tasks.workunit.client.0.smithi033.stdout:0/27: dwrite d0/d2/f7 [0,4194304] 0 2024-02-15T18:31:00.576 INFO:tasks.workunit.client.0.smithi033.stdout:0/28: chown d0/d8/la 44754827 1 2024-02-15T18:31:00.577 INFO:tasks.workunit.client.0.smithi033.stdout:0/29: write d0/f4 [200426,37435] 0 2024-02-15T18:31:00.578 INFO:tasks.workunit.client.0.smithi033.stdout:8/77: dwrite d0/fe [0,4194304] 0 2024-02-15T18:31:00.581 INFO:tasks.workunit.client.0.smithi033.stdout:3/82: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:00.582 INFO:tasks.workunit.client.0.smithi033.stdout:0/30: creat d0/d8/fb x:0 0 0 2024-02-15T18:31:00.583 INFO:tasks.workunit.client.0.smithi033.stdout:7/77: dwrite d0/fa [0,4194304] 0 2024-02-15T18:31:00.584 INFO:tasks.workunit.client.0.smithi033.stdout:6/41: dwrite f5 [0,4194304] 0 2024-02-15T18:31:00.588 INFO:tasks.workunit.client.0.smithi033.stdout:3/83: creat d2/f1b x:0 0 0 2024-02-15T18:31:00.593 INFO:tasks.workunit.client.0.smithi033.stdout:6/42: rename d8/fa to d8/d10/f11 0 2024-02-15T18:31:00.595 INFO:tasks.workunit.client.0.smithi033.stdout:5/106: dwrite d1/f9 [0,4194304] 0 2024-02-15T18:31:00.597 INFO:tasks.workunit.client.0.smithi033.stdout:3/84: mkdir d2/d3/d17/d1c 0 2024-02-15T18:31:00.597 INFO:tasks.workunit.client.0.smithi033.stdout:3/85: chown d2/d3/df 556836981 1 2024-02-15T18:31:00.599 INFO:tasks.workunit.client.0.smithi033.stdout:3/86: creat d2/f1d x:0 0 0 2024-02-15T18:31:00.600 INFO:tasks.workunit.client.0.smithi033.stdout:3/87: mkdir d2/d3/d1e 0 2024-02-15T18:31:00.601 INFO:tasks.workunit.client.0.smithi033.stdout:0/31: truncate d0/f4 127233 0 2024-02-15T18:31:00.602 INFO:tasks.workunit.client.0.smithi033.stdout:0/32: readlink d0/l1 0 2024-02-15T18:31:00.603 INFO:tasks.workunit.client.0.smithi033.stdout:3/88: dread d2/f12 [0,4194304] 0 2024-02-15T18:31:00.619 INFO:tasks.workunit.client.0.smithi033.stdout:5/107: dread d1/f9 [0,4194304] 0 2024-02-15T18:31:00.619 INFO:tasks.workunit.client.0.smithi033.stdout:5/108: chown d1 233 1 2024-02-15T18:31:00.619 INFO:tasks.workunit.client.0.smithi033.stdout:5/109: readlink d1/lc 0 2024-02-15T18:31:00.620 INFO:tasks.workunit.client.0.smithi033.stdout:5/110: mkdir d1/da/d19 0 2024-02-15T18:31:00.621 INFO:tasks.workunit.client.0.smithi033.stdout:5/111: rename d1/lc to d1/l1a 0 2024-02-15T18:31:00.623 INFO:tasks.workunit.client.0.smithi033.stdout:5/112: unlink d1/fe 0 2024-02-15T18:31:00.623 INFO:tasks.workunit.client.0.smithi033.stdout:5/113: write d1/f9 [4498135,29487] 0 2024-02-15T18:31:00.623 INFO:tasks.workunit.client.0.smithi033.stdout:7/78: dwrite d0/dc/d10/f17 [4194304,4194304] 0 2024-02-15T18:31:00.623 INFO:tasks.workunit.client.0.smithi033.stdout:7/79: chown d0/c4 54449 1 2024-02-15T18:31:00.623 INFO:tasks.workunit.client.0.smithi033.stdout:7/80: truncate d0/dc/d10/f13 788094 0 2024-02-15T18:31:00.625 INFO:tasks.workunit.client.0.smithi033.stdout:8/78: dwrite d0/df/f11 [0,4194304] 0 2024-02-15T18:31:00.625 INFO:tasks.workunit.client.0.smithi033.stdout:6/43: dwrite d8/d10/f11 [0,4194304] 0 2024-02-15T18:31:00.625 INFO:tasks.workunit.client.0.smithi033.stdout:6/44: write f0 [1608045,24603] 0 2024-02-15T18:31:00.628 INFO:tasks.workunit.client.0.smithi033.stdout:8/79: mkdir d0/d2/d14 0 2024-02-15T18:31:00.630 INFO:tasks.workunit.client.0.smithi033.stdout:8/80: write d0/df/db/fc [1802750,18529] 0 2024-02-15T18:31:00.630 INFO:tasks.workunit.client.0.smithi033.stdout:0/33: dwrite d0/d2/f3 [0,4194304] 0 2024-02-15T18:31:00.633 INFO:tasks.workunit.client.0.smithi033.stdout:3/89: getdents d2 0 2024-02-15T18:31:00.634 INFO:tasks.workunit.client.0.smithi033.stdout:5/114: getdents d1/da 0 2024-02-15T18:31:00.636 INFO:tasks.workunit.client.0.smithi033.stdout:9/70: sync 2024-02-15T18:31:00.637 INFO:tasks.workunit.client.0.smithi033.stdout:6/45: dread f5 [0,4194304] 0 2024-02-15T18:31:00.638 INFO:tasks.workunit.client.0.smithi033.stdout:7/81: dwrite d0/f1 [4194304,4194304] 0 2024-02-15T18:31:00.639 INFO:tasks.workunit.client.0.smithi033.stdout:8/81: rmdir d0/df 39 2024-02-15T18:31:00.644 INFO:tasks.workunit.client.0.smithi033.stdout:0/34: mkdir d0/dc 0 2024-02-15T18:31:00.644 INFO:tasks.workunit.client.0.smithi033.stdout:3/90: rmdir d2/d3/d17 39 2024-02-15T18:31:00.644 INFO:tasks.workunit.client.0.smithi033.stdout:0/35: readlink d0/d8/la 0 2024-02-15T18:31:00.644 INFO:tasks.workunit.client.0.smithi033.stdout:0/36: truncate d0/f4 1105142 0 2024-02-15T18:31:00.644 INFO:tasks.workunit.client.0.smithi033.stdout:0/37: write d0/f4 [847007,69361] 0 2024-02-15T18:31:00.645 INFO:tasks.workunit.client.0.smithi033.stdout:6/46: symlink d8/d10/l12 0 2024-02-15T18:31:00.648 INFO:tasks.workunit.client.0.smithi033.stdout:7/82: rename d0/ff to d0/dc/f1a 0 2024-02-15T18:31:00.648 INFO:tasks.workunit.client.0.smithi033.stdout:7/83: chown d0/dc/f1a 48095201 1 2024-02-15T18:31:00.648 INFO:tasks.workunit.client.0.smithi033.stdout:7/84: fdatasync d0/dc/d10/f17 0 2024-02-15T18:31:00.649 INFO:tasks.workunit.client.0.smithi033.stdout:8/82: truncate d0/d2/f5 2277354 0 2024-02-15T18:31:00.649 INFO:tasks.workunit.client.0.smithi033.stdout:9/71: dwrite d4/d8/dd/f13 [0,4194304] 0 2024-02-15T18:31:00.653 INFO:tasks.workunit.client.0.smithi033.stdout:5/115: creat d1/da/f1b x:0 0 0 2024-02-15T18:31:00.653 INFO:tasks.workunit.client.0.smithi033.stdout:5/116: chown d1/l15 51 1 2024-02-15T18:31:00.654 INFO:tasks.workunit.client.0.smithi033.stdout:5/117: readlink d1/l6 0 2024-02-15T18:31:00.654 INFO:tasks.workunit.client.0.smithi033.stdout:5/118: dread - d1/da/f1b zero size 2024-02-15T18:31:00.654 INFO:tasks.workunit.client.0.smithi033.stdout:3/91: getdents d2/d3 0 2024-02-15T18:31:00.654 INFO:tasks.workunit.client.0.smithi033.stdout:3/92: chown d2/d3/df/c13 90 1 2024-02-15T18:31:00.654 INFO:tasks.workunit.client.0.smithi033.stdout:3/93: chown d2/f11 114 1 2024-02-15T18:31:00.656 INFO:tasks.workunit.client.0.smithi033.stdout:6/47: link f3 d8/dc/f13 0 2024-02-15T18:31:00.656 INFO:tasks.workunit.client.0.smithi033.stdout:6/48: chown d8/d10 5545 1 2024-02-15T18:31:00.657 INFO:tasks.workunit.client.0.smithi033.stdout:7/85: getdents d0/dc/d10 0 2024-02-15T18:31:00.658 INFO:tasks.workunit.client.0.smithi033.stdout:8/83: symlink d0/df/db/l15 0 2024-02-15T18:31:00.658 INFO:tasks.workunit.client.0.smithi033.stdout:8/84: chown d0/df/db 154359105 1 2024-02-15T18:31:00.663 INFO:tasks.workunit.client.0.smithi033.stdout:3/94: creat d2/d3/d17/f1f x:0 0 0 2024-02-15T18:31:00.664 INFO:tasks.workunit.client.0.smithi033.stdout:7/86: creat d0/f1b x:0 0 0 2024-02-15T18:31:00.665 INFO:tasks.workunit.client.0.smithi033.stdout:8/85: creat d0/d2/f16 x:0 0 0 2024-02-15T18:31:00.667 INFO:tasks.workunit.client.0.smithi033.stdout:7/87: write d0/f1 [6476205,85274] 0 2024-02-15T18:31:00.669 INFO:tasks.workunit.client.0.smithi033.stdout:0/38: dwrite d0/f5 [0,4194304] 0 2024-02-15T18:31:00.669 INFO:tasks.workunit.client.0.smithi033.stdout:3/95: rmdir d2/d3/d17/d1c 0 2024-02-15T18:31:00.671 INFO:tasks.workunit.client.0.smithi033.stdout:6/49: rename d8/dc to d8/d10/d14 0 2024-02-15T18:31:00.673 INFO:tasks.workunit.client.0.smithi033.stdout:5/119: unlink d1/da/ff 0 2024-02-15T18:31:00.675 INFO:tasks.workunit.client.0.smithi033.stdout:7/88: link d0/dc/d10/f17 d0/f1c 0 2024-02-15T18:31:00.675 INFO:tasks.workunit.client.0.smithi033.stdout:7/89: readlink d0/l14 0 2024-02-15T18:31:00.675 INFO:tasks.workunit.client.0.smithi033.stdout:7/90: chown d0/dc/fe 16272 1 2024-02-15T18:31:00.676 INFO:tasks.workunit.client.0.smithi033.stdout:7/91: read d0/f1 [5693341,21540] 0 2024-02-15T18:31:00.676 INFO:tasks.workunit.client.0.smithi033.stdout:7/92: chown d0/dc/d10/f13 233 1 2024-02-15T18:31:00.676 INFO:tasks.workunit.client.0.smithi033.stdout:0/39: creat d0/fd x:0 0 0 2024-02-15T18:31:00.681 INFO:tasks.workunit.client.0.smithi033.stdout:8/86: rename d0/d2/l12 to d0/l17 0 2024-02-15T18:31:00.681 INFO:tasks.workunit.client.0.smithi033.stdout:8/87: write d0/d2/f5 [2621255,69439] 0 2024-02-15T18:31:00.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/120: stat d1/da/f13 0 2024-02-15T18:31:00.685 INFO:tasks.workunit.client.0.smithi033.stdout:7/93: mkdir d0/dc/d10/d1d 0 2024-02-15T18:31:00.687 INFO:tasks.workunit.client.0.smithi033.stdout:8/88: mkdir d0/df/d18 0 2024-02-15T18:31:00.689 INFO:tasks.workunit.client.0.smithi033.stdout:7/94: rename d0/l14 to d0/l1e 0 2024-02-15T18:31:00.690 INFO:tasks.workunit.client.0.smithi033.stdout:8/89: creat d0/df/f19 x:0 0 0 2024-02-15T18:31:00.690 INFO:tasks.workunit.client.0.smithi033.stdout:8/90: truncate d0/df/f19 495068 0 2024-02-15T18:31:00.691 INFO:tasks.workunit.client.0.smithi033.stdout:0/40: dread d0/d2/f3 [0,4194304] 0 2024-02-15T18:31:00.691 INFO:tasks.workunit.client.0.smithi033.stdout:0/41: stat d0/d8 0 2024-02-15T18:31:00.691 INFO:tasks.workunit.client.0.smithi033.stdout:0/42: write d0/f4 [1765882,100054] 0 2024-02-15T18:31:00.691 INFO:tasks.workunit.client.0.smithi033.stdout:8/91: creat d0/df/d18/f1a x:0 0 0 2024-02-15T18:31:00.691 INFO:tasks.workunit.client.0.smithi033.stdout:8/92: truncate d0/d2/f16 977657 0 2024-02-15T18:31:00.693 INFO:tasks.workunit.client.0.smithi033.stdout:5/121: rename d1/l3 to d1/da/l1c 0 2024-02-15T18:31:00.693 INFO:tasks.workunit.client.0.smithi033.stdout:5/122: dread - d1/f14 zero size 2024-02-15T18:31:00.693 INFO:tasks.workunit.client.0.smithi033.stdout:5/123: fsync d1/da/f13 0 2024-02-15T18:31:00.694 INFO:tasks.workunit.client.0.smithi033.stdout:3/96: dwrite d2/d3/d17/f1f [0,4194304] 0 2024-02-15T18:31:00.694 INFO:tasks.workunit.client.0.smithi033.stdout:8/93: mkdir d0/df/db/d1b 0 2024-02-15T18:31:00.694 INFO:tasks.workunit.client.0.smithi033.stdout:6/50: dwrite f0 [0,4194304] 0 2024-02-15T18:31:00.696 INFO:tasks.workunit.client.0.smithi033.stdout:3/97: mkdir d2/d20 0 2024-02-15T18:31:00.696 INFO:tasks.workunit.client.0.smithi033.stdout:5/124: write d1/f5 [2085723,122500] 0 2024-02-15T18:31:00.701 INFO:tasks.workunit.client.0.smithi033.stdout:5/125: creat d1/da/d10/f1d x:0 0 0 2024-02-15T18:31:00.708 INFO:tasks.workunit.client.0.smithi033.stdout:6/51: dread f5 [0,4194304] 0 2024-02-15T18:31:00.708 INFO:tasks.workunit.client.0.smithi033.stdout:6/52: chown f3 67384026 1 2024-02-15T18:31:00.712 INFO:tasks.workunit.client.0.smithi033.stdout:6/53: write f7 [535029,53680] 0 2024-02-15T18:31:00.713 INFO:tasks.workunit.client.0.smithi033.stdout:0/43: dread d0/f5 [0,4194304] 0 2024-02-15T18:31:00.715 INFO:tasks.workunit.client.0.smithi033.stdout:6/54: dread d8/d10/d14/f13 [0,4194304] 0 2024-02-15T18:31:00.716 INFO:tasks.workunit.client.0.smithi033.stdout:7/95: dwrite d0/f1c [4194304,4194304] 0 2024-02-15T18:31:00.716 INFO:tasks.workunit.client.0.smithi033.stdout:7/96: truncate d0/f1b 877437 0 2024-02-15T18:31:00.716 INFO:tasks.workunit.client.0.smithi033.stdout:7/97: dread - d0/dc/f1a zero size 2024-02-15T18:31:00.716 INFO:tasks.workunit.client.0.smithi033.stdout:7/98: write d0/dc/d10/f13 [1818392,81501] 0 2024-02-15T18:31:00.716 INFO:tasks.workunit.client.0.smithi033.stdout:7/99: readlink d0/dc/l12 0 2024-02-15T18:31:00.719 INFO:tasks.workunit.client.0.smithi033.stdout:0/44: link d0/d8/la d0/d8/le 0 2024-02-15T18:31:00.720 INFO:tasks.workunit.client.0.smithi033.stdout:7/100: creat d0/f1f x:0 0 0 2024-02-15T18:31:00.720 INFO:tasks.workunit.client.0.smithi033.stdout:7/101: symlink d0/dc/l20 0 2024-02-15T18:31:00.722 INFO:tasks.workunit.client.0.smithi033.stdout:7/102: creat d0/dc/d10/f21 x:0 0 0 2024-02-15T18:31:00.722 INFO:tasks.workunit.client.0.smithi033.stdout:7/103: mknod d0/dc/d10/d1d/c22 0 2024-02-15T18:31:00.733 INFO:tasks.workunit.client.0.smithi033.stdout:3/98: dwrite d2/fa [0,4194304] 0 2024-02-15T18:31:00.733 INFO:tasks.workunit.client.0.smithi033.stdout:3/99: write d2/f9 [996801,62003] 0 2024-02-15T18:31:00.733 INFO:tasks.workunit.client.0.smithi033.stdout:6/55: dread f7 [0,4194304] 0 2024-02-15T18:31:00.734 INFO:tasks.workunit.client.0.smithi033.stdout:8/94: dwrite d0/d2/f16 [0,4194304] 0 2024-02-15T18:31:00.737 INFO:tasks.workunit.client.0.smithi033.stdout:5/126: dread d1/f5 [0,4194304] 0 2024-02-15T18:31:00.738 INFO:tasks.workunit.client.0.smithi033.stdout:6/56: rename f3 to d8/f15 0 2024-02-15T18:31:00.738 INFO:tasks.workunit.client.0.smithi033.stdout:6/57: fdatasync d8/fb 0 2024-02-15T18:31:00.738 INFO:tasks.workunit.client.0.smithi033.stdout:6/58: dread - d8/fb zero size 2024-02-15T18:31:00.744 INFO:tasks.workunit.client.0.smithi033.stdout:6/59: write f0 [1144167,122010] 0 2024-02-15T18:31:00.745 INFO:tasks.workunit.client.0.smithi033.stdout:0/45: dwrite d0/d2/f3 [0,4194304] 0 2024-02-15T18:31:00.745 INFO:tasks.workunit.client.0.smithi033.stdout:0/46: chown d0/d8 6741 1 2024-02-15T18:31:00.746 INFO:tasks.workunit.client.0.smithi033.stdout:8/95: mkdir d0/d1c 0 2024-02-15T18:31:00.748 INFO:tasks.workunit.client.0.smithi033.stdout:5/127: rmdir d1 39 2024-02-15T18:31:00.749 INFO:tasks.workunit.client.0.smithi033.stdout:6/60: mknod d8/d10/c16 0 2024-02-15T18:31:00.750 INFO:tasks.workunit.client.0.smithi033.stdout:6/61: read d8/f15 [84760,86038] 0 2024-02-15T18:31:00.750 INFO:tasks.workunit.client.0.smithi033.stdout:8/96: write d0/df/f11 [292833,95772] 0 2024-02-15T18:31:00.750 INFO:tasks.workunit.client.0.smithi033.stdout:8/97: write d0/df/db/fc [2984290,44222] 0 2024-02-15T18:31:00.750 INFO:tasks.workunit.client.0.smithi033.stdout:6/62: write f5 [2728858,119531] 0 2024-02-15T18:31:00.750 INFO:tasks.workunit.client.0.smithi033.stdout:0/47: link d0/d8/fb d0/dc/ff 0 2024-02-15T18:31:00.752 INFO:tasks.workunit.client.0.smithi033.stdout:3/100: dwrite d2/d3/d17/f1f [0,4194304] 0 2024-02-15T18:31:00.752 INFO:tasks.workunit.client.0.smithi033.stdout:5/128: unlink d1/c18 0 2024-02-15T18:31:00.752 INFO:tasks.workunit.client.0.smithi033.stdout:5/129: chown d1/l15 64492 1 2024-02-15T18:31:00.753 INFO:tasks.workunit.client.0.smithi033.stdout:5/130: read d1/f5 [1814342,129150] 0 2024-02-15T18:31:00.755 INFO:tasks.workunit.client.0.smithi033.stdout:8/98: unlink d0/d2/cd 0 2024-02-15T18:31:00.760 INFO:tasks.workunit.client.0.smithi033.stdout:8/99: symlink d0/df/db/l1d 0 2024-02-15T18:31:00.762 INFO:tasks.workunit.client.0.smithi033.stdout:5/131: mknod d1/da/d11/c1e 0 2024-02-15T18:31:00.762 INFO:tasks.workunit.client.0.smithi033.stdout:5/132: write d1/da/d10/f1d [293369,21916] 0 2024-02-15T18:31:00.763 INFO:tasks.workunit.client.0.smithi033.stdout:8/100: symlink d0/d2/l1e 0 2024-02-15T18:31:00.763 INFO:tasks.workunit.client.0.smithi033.stdout:5/133: truncate d1/da/f12 169241 0 2024-02-15T18:31:00.765 INFO:tasks.workunit.client.0.smithi033.stdout:5/134: creat d1/da/f1f x:0 0 0 2024-02-15T18:31:00.765 INFO:tasks.workunit.client.0.smithi033.stdout:5/135: truncate d1/da/f1f 459046 0 2024-02-15T18:31:00.766 INFO:tasks.workunit.client.0.smithi033.stdout:6/63: dread f0 [0,4194304] 0 2024-02-15T18:31:00.766 INFO:tasks.workunit.client.0.smithi033.stdout:6/64: dread - d8/fb zero size 2024-02-15T18:31:00.766 INFO:tasks.workunit.client.0.smithi033.stdout:6/65: chown d8/d10/d14 476370 1 2024-02-15T18:31:00.768 INFO:tasks.workunit.client.0.smithi033.stdout:5/136: link d1/da/l16 d1/da/d11/l20 0 2024-02-15T18:31:00.769 INFO:tasks.workunit.client.0.smithi033.stdout:3/101: dwrite d2/f11 [0,4194304] 0 2024-02-15T18:31:00.780 INFO:tasks.workunit.client.0.smithi033.stdout:0/48: truncate d0/f5 1537623 0 2024-02-15T18:31:00.780 INFO:tasks.workunit.client.0.smithi033.stdout:0/49: dread - d0/d8/fb zero size 2024-02-15T18:31:00.802 INFO:tasks.workunit.client.0.smithi033.stdout:6/66: dwrite d8/d10/f11 [0,4194304] 0 2024-02-15T18:31:00.803 INFO:tasks.workunit.client.0.smithi033.stdout:8/101: dwrite d0/df/f19 [0,4194304] 0 2024-02-15T18:31:00.803 INFO:tasks.workunit.client.0.smithi033.stdout:8/102: chown d0/df/db/fc 634115 1 2024-02-15T18:31:00.804 INFO:tasks.workunit.client.0.smithi033.stdout:5/137: dwrite d1/da/d11/f17 [0,4194304] 0 2024-02-15T18:31:00.804 INFO:tasks.workunit.client.0.smithi033.stdout:5/138: chown d1/da/f12 2873047 1 2024-02-15T18:31:00.804 INFO:tasks.workunit.client.0.smithi033.stdout:3/102: truncate d2/f11 1027033 0 2024-02-15T18:31:00.804 INFO:tasks.workunit.client.0.smithi033.stdout:3/103: fdatasync d2/f1d 0 2024-02-15T18:31:00.804 INFO:tasks.workunit.client.0.smithi033.stdout:3/104: fdatasync d2/fa 0 2024-02-15T18:31:00.811 INFO:tasks.workunit.client.0.smithi033.stdout:0/50: dread d0/f5 [0,4194304] 0 2024-02-15T18:31:00.811 INFO:tasks.workunit.client.0.smithi033.stdout:8/103: symlink d0/df/d18/l1f 0 2024-02-15T18:31:00.814 INFO:tasks.workunit.client.0.smithi033.stdout:5/139: symlink d1/da/d10/l21 0 2024-02-15T18:31:00.815 INFO:tasks.workunit.client.0.smithi033.stdout:3/105: symlink d2/d20/l21 0 2024-02-15T18:31:00.815 INFO:tasks.workunit.client.0.smithi033.stdout:3/106: truncate d2/d14/f16 1268475 0 2024-02-15T18:31:00.815 INFO:tasks.workunit.client.0.smithi033.stdout:3/107: stat d2/c10 0 2024-02-15T18:31:00.816 INFO:tasks.workunit.client.0.smithi033.stdout:0/51: creat d0/f10 x:0 0 0 2024-02-15T18:31:00.818 INFO:tasks.workunit.client.0.smithi033.stdout:0/52: dread d0/f4 [0,4194304] 0 2024-02-15T18:31:00.819 INFO:tasks.workunit.client.0.smithi033.stdout:0/53: dread - d0/f10 zero size 2024-02-15T18:31:00.819 INFO:tasks.workunit.client.0.smithi033.stdout:8/104: symlink d0/df/l20 0 2024-02-15T18:31:00.819 INFO:tasks.workunit.client.0.smithi033.stdout:8/105: write d0/df/f11 [4764548,20021] 0 2024-02-15T18:31:00.819 INFO:tasks.workunit.client.0.smithi033.stdout:8/106: read - d0/d2/f6 zero size 2024-02-15T18:31:00.822 INFO:tasks.workunit.client.0.smithi033.stdout:3/108: truncate d2/f9 529141 0 2024-02-15T18:31:00.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/54: creat d0/dc/f11 x:0 0 0 2024-02-15T18:31:00.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/55: fsync d0/f5 0 2024-02-15T18:31:00.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/56: stat d0/dc/f11 0 2024-02-15T18:31:00.824 INFO:tasks.workunit.client.0.smithi033.stdout:8/107: rename d0/df/db/l1d to d0/d2/l21 0 2024-02-15T18:31:00.825 INFO:tasks.workunit.client.0.smithi033.stdout:4/170: sync 2024-02-15T18:31:00.825 INFO:tasks.workunit.client.0.smithi033.stdout:1/97: sync 2024-02-15T18:31:00.825 INFO:tasks.workunit.client.0.smithi033.stdout:2/121: sync 2024-02-15T18:31:00.826 INFO:tasks.workunit.client.0.smithi033.stdout:9/72: sync 2024-02-15T18:31:00.826 INFO:tasks.workunit.client.0.smithi033.stdout:7/104: sync 2024-02-15T18:31:00.826 INFO:tasks.workunit.client.0.smithi033.stdout:9/73: dread - d4/d8/f1d zero size 2024-02-15T18:31:00.826 INFO:tasks.workunit.client.0.smithi033.stdout:9/74: fdatasync d4/d8/dd/fe 0 2024-02-15T18:31:00.826 INFO:tasks.workunit.client.0.smithi033.stdout:5/140: creat d1/da/d19/f22 x:0 0 0 2024-02-15T18:31:00.826 INFO:tasks.workunit.client.0.smithi033.stdout:4/171: write d4/f7 [151396,107606] 0 2024-02-15T18:31:00.827 INFO:tasks.workunit.client.0.smithi033.stdout:6/67: dwrite f7 [0,4194304] 0 2024-02-15T18:31:00.827 INFO:tasks.workunit.client.0.smithi033.stdout:8/108: creat d0/df/db/d1b/f22 x:0 0 0 2024-02-15T18:31:00.828 INFO:tasks.workunit.client.0.smithi033.stdout:2/122: unlink c1c 0 2024-02-15T18:31:00.829 INFO:tasks.workunit.client.0.smithi033.stdout:1/98: dread d5/dd/fe [0,4194304] 0 2024-02-15T18:31:00.831 INFO:tasks.workunit.client.0.smithi033.stdout:9/75: link d4/d8/f10 d4/d8/d1b/f1f 0 2024-02-15T18:31:00.834 INFO:tasks.workunit.client.0.smithi033.stdout:5/141: creat d1/da/d11/f23 x:0 0 0 2024-02-15T18:31:00.834 INFO:tasks.workunit.client.0.smithi033.stdout:0/57: getdents d0 0 2024-02-15T18:31:00.834 INFO:tasks.workunit.client.0.smithi033.stdout:0/58: dread - d0/fd zero size 2024-02-15T18:31:00.836 INFO:tasks.workunit.client.0.smithi033.stdout:8/109: creat d0/df/db/f23 x:0 0 0 2024-02-15T18:31:00.837 INFO:tasks.workunit.client.0.smithi033.stdout:2/123: mkdir d20/d30 0 2024-02-15T18:31:00.840 INFO:tasks.workunit.client.0.smithi033.stdout:1/99: rmdir d5 39 2024-02-15T18:31:00.840 INFO:tasks.workunit.client.0.smithi033.stdout:6/68: write d8/d10/f11 [2897762,121725] 0 2024-02-15T18:31:00.842 INFO:tasks.workunit.client.0.smithi033.stdout:9/76: rename d4/d8/f1c to d4/d8/f20 0 2024-02-15T18:31:00.842 INFO:tasks.workunit.client.0.smithi033.stdout:9/77: chown d4/d8/dd 59 1 2024-02-15T18:31:00.844 INFO:tasks.workunit.client.0.smithi033.stdout:3/109: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:00.846 INFO:tasks.workunit.client.0.smithi033.stdout:0/59: mknod d0/c12 0 2024-02-15T18:31:00.846 INFO:tasks.workunit.client.0.smithi033.stdout:2/124: mkdir d20/d31 0 2024-02-15T18:31:00.846 INFO:tasks.workunit.client.0.smithi033.stdout:8/110: symlink d0/d2/l24 0 2024-02-15T18:31:00.846 INFO:tasks.workunit.client.0.smithi033.stdout:8/111: truncate d0/df/db/d1b/f22 557435 0 2024-02-15T18:31:00.847 INFO:tasks.workunit.client.0.smithi033.stdout:3/110: mkdir d2/d3/d1e/d22 0 2024-02-15T18:31:00.847 INFO:tasks.workunit.client.0.smithi033.stdout:6/69: truncate f0 3992210 0 2024-02-15T18:31:00.847 INFO:tasks.workunit.client.0.smithi033.stdout:5/142: dread d1/da/f12 [0,4194304] 0 2024-02-15T18:31:00.847 INFO:tasks.workunit.client.0.smithi033.stdout:2/125: mkdir d20/d31/d32 0 2024-02-15T18:31:00.848 INFO:tasks.workunit.client.0.smithi033.stdout:2/126: read - d20/f2b zero size 2024-02-15T18:31:00.848 INFO:tasks.workunit.client.0.smithi033.stdout:8/112: mknod d0/df/db/d1b/c25 0 2024-02-15T18:31:00.850 INFO:tasks.workunit.client.0.smithi033.stdout:7/105: dwrite d0/dc/f1a [0,4194304] 0 2024-02-15T18:31:00.850 INFO:tasks.workunit.client.0.smithi033.stdout:7/106: chown d0/dc/d10 9 1 2024-02-15T18:31:00.850 INFO:tasks.workunit.client.0.smithi033.stdout:7/107: fsync d0/dc/d10/f13 0 2024-02-15T18:31:00.850 INFO:tasks.workunit.client.0.smithi033.stdout:6/70: creat d8/d10/f17 x:0 0 0 2024-02-15T18:31:00.851 INFO:tasks.workunit.client.0.smithi033.stdout:2/127: dread d20/d22/f23 [0,4194304] 0 2024-02-15T18:31:00.853 INFO:tasks.workunit.client.0.smithi033.stdout:5/143: creat d1/da/f24 x:0 0 0 2024-02-15T18:31:00.853 INFO:tasks.workunit.client.0.smithi033.stdout:7/108: rename d0/dc/d10/c7 to d0/dc/d10/d1d/c23 0 2024-02-15T18:31:00.854 INFO:tasks.workunit.client.0.smithi033.stdout:5/144: symlink d1/da/d19/l25 0 2024-02-15T18:31:00.859 INFO:tasks.workunit.client.0.smithi033.stdout:7/109: rename d0/l5 to d0/dc/d10/d1d/l24 0 2024-02-15T18:31:00.866 INFO:tasks.workunit.client.0.smithi033.stdout:5/145: dread d1/f5 [0,4194304] 0 2024-02-15T18:31:00.868 INFO:tasks.workunit.client.0.smithi033.stdout:5/146: creat d1/da/d10/f26 x:0 0 0 2024-02-15T18:31:00.872 INFO:tasks.workunit.client.0.smithi033.stdout:5/147: write d1/da/f13 [1751845,126505] 0 2024-02-15T18:31:00.874 INFO:tasks.workunit.client.0.smithi033.stdout:1/100: dwrite d5/d9/fa [0,4194304] 0 2024-02-15T18:31:00.874 INFO:tasks.workunit.client.0.smithi033.stdout:1/101: write d5/d9/f14 [2321781,9502] 0 2024-02-15T18:31:00.875 INFO:tasks.workunit.client.0.smithi033.stdout:1/102: unlink d5/l15 0 2024-02-15T18:31:00.876 INFO:tasks.workunit.client.0.smithi033.stdout:8/113: dread d0/df/f19 [0,4194304] 0 2024-02-15T18:31:00.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/114: fdatasync d0/d2/f6 0 2024-02-15T18:31:00.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/115: chown d0/df/f19 812146 1 2024-02-15T18:31:00.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/116: read - d0/df/d18/f1a zero size 2024-02-15T18:31:00.877 INFO:tasks.workunit.client.0.smithi033.stdout:1/103: creat d5/f1a x:0 0 0 2024-02-15T18:31:00.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/117: write d0/df/f19 [3161445,114388] 0 2024-02-15T18:31:00.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/118: write d0/d2/f6 [329735,50932] 0 2024-02-15T18:31:00.878 INFO:tasks.workunit.client.0.smithi033.stdout:8/119: dread - d0/df/d18/f1a zero size 2024-02-15T18:31:00.885 INFO:tasks.workunit.client.0.smithi033.stdout:6/71: dwrite d8/f15 [0,4194304] 0 2024-02-15T18:31:00.889 INFO:tasks.workunit.client.0.smithi033.stdout:6/72: getdents d8 0 2024-02-15T18:31:00.890 INFO:tasks.workunit.client.0.smithi033.stdout:4/172: dwrite d4/d20/d13/f32 [0,4194304] 0 2024-02-15T18:31:00.891 INFO:tasks.workunit.client.0.smithi033.stdout:6/73: link f5 d8/d10/f18 0 2024-02-15T18:31:00.892 INFO:tasks.workunit.client.0.smithi033.stdout:0/60: dwrite d0/f5 [0,4194304] 0 2024-02-15T18:31:00.892 INFO:tasks.workunit.client.0.smithi033.stdout:0/61: chown d0/dc/f11 1 1 2024-02-15T18:31:00.892 INFO:tasks.workunit.client.0.smithi033.stdout:0/62: dread - d0/f10 zero size 2024-02-15T18:31:00.892 INFO:tasks.workunit.client.0.smithi033.stdout:7/110: dwrite d0/dc/f1a [0,4194304] 0 2024-02-15T18:31:00.892 INFO:tasks.workunit.client.0.smithi033.stdout:2/128: dwrite d20/f21 [0,4194304] 0 2024-02-15T18:31:00.896 INFO:tasks.workunit.client.0.smithi033.stdout:6/74: mkdir d8/d10/d19 0 2024-02-15T18:31:00.896 INFO:tasks.workunit.client.0.smithi033.stdout:6/75: read - d8/fb zero size 2024-02-15T18:31:00.896 INFO:tasks.workunit.client.0.smithi033.stdout:6/76: write d8/fb [842754,80834] 0 2024-02-15T18:31:00.896 INFO:tasks.workunit.client.0.smithi033.stdout:0/63: link d0/f4 d0/f13 0 2024-02-15T18:31:00.900 INFO:tasks.workunit.client.0.smithi033.stdout:8/120: dread d0/df/db/fc [0,4194304] 0 2024-02-15T18:31:00.903 INFO:tasks.workunit.client.0.smithi033.stdout:7/111: dread d0/fa [0,4194304] 0 2024-02-15T18:31:00.903 INFO:tasks.workunit.client.0.smithi033.stdout:7/112: stat d0/f1 0 2024-02-15T18:31:00.905 INFO:tasks.workunit.client.0.smithi033.stdout:1/104: rmdir d5 39 2024-02-15T18:31:00.905 INFO:tasks.workunit.client.0.smithi033.stdout:2/129: link l11 d20/l33 0 2024-02-15T18:31:00.905 INFO:tasks.workunit.client.0.smithi033.stdout:1/105: write d5/f8 [833211,29099] 0 2024-02-15T18:31:00.906 INFO:tasks.workunit.client.0.smithi033.stdout:4/173: mkdir d4/d20/d37 0 2024-02-15T18:31:00.907 INFO:tasks.workunit.client.0.smithi033.stdout:6/77: creat d8/f1a x:0 0 0 2024-02-15T18:31:00.908 INFO:tasks.workunit.client.0.smithi033.stdout:8/121: rename d0/l17 to d0/l26 0 2024-02-15T18:31:00.910 INFO:tasks.workunit.client.0.smithi033.stdout:7/113: creat d0/dc/d10/d1d/f25 x:0 0 0 2024-02-15T18:31:00.910 INFO:tasks.workunit.client.0.smithi033.stdout:7/114: fsync d0/f9 0 2024-02-15T18:31:00.911 INFO:tasks.workunit.client.0.smithi033.stdout:2/130: creat d20/d31/d32/f34 x:0 0 0 2024-02-15T18:31:00.911 INFO:tasks.workunit.client.0.smithi033.stdout:2/131: truncate d20/d31/d32/f34 312185 0 2024-02-15T18:31:00.912 INFO:tasks.workunit.client.0.smithi033.stdout:0/64: dwrite d0/d8/fb [0,4194304] 0 2024-02-15T18:31:00.914 INFO:tasks.workunit.client.0.smithi033.stdout:1/106: creat d5/dd/d12/f1b x:0 0 0 2024-02-15T18:31:00.917 INFO:tasks.workunit.client.0.smithi033.stdout:4/174: rmdir d4/d5/d28 39 2024-02-15T18:31:00.917 INFO:tasks.workunit.client.0.smithi033.stdout:6/78: creat d8/d10/d19/f1b x:0 0 0 2024-02-15T18:31:00.918 INFO:tasks.workunit.client.0.smithi033.stdout:7/115: getdents d0 0 2024-02-15T18:31:00.919 INFO:tasks.workunit.client.0.smithi033.stdout:2/132: creat d20/d22/f35 x:0 0 0 2024-02-15T18:31:00.922 INFO:tasks.workunit.client.0.smithi033.stdout:1/107: mkdir d5/dd/d1c 0 2024-02-15T18:31:00.922 INFO:tasks.workunit.client.0.smithi033.stdout:1/108: dread - d5/f1a zero size 2024-02-15T18:31:00.922 INFO:tasks.workunit.client.0.smithi033.stdout:1/109: write d5/f19 [814806,73967] 0 2024-02-15T18:31:00.922 INFO:tasks.workunit.client.0.smithi033.stdout:1/110: chown d5/d17 15873 1 2024-02-15T18:31:00.923 INFO:tasks.workunit.client.0.smithi033.stdout:4/175: mknod d4/d20/d13/d34/c38 0 2024-02-15T18:31:00.925 INFO:tasks.workunit.client.0.smithi033.stdout:4/176: write d4/f15 [2352546,51923] 0 2024-02-15T18:31:00.925 INFO:tasks.workunit.client.0.smithi033.stdout:4/177: write d4/d20/f11 [1972414,49599] 0 2024-02-15T18:31:00.927 INFO:tasks.workunit.client.0.smithi033.stdout:7/116: dread d0/dc/f1a [0,4194304] 0 2024-02-15T18:31:00.927 INFO:tasks.workunit.client.0.smithi033.stdout:6/79: mknod d8/d10/c1c 0 2024-02-15T18:31:00.931 INFO:tasks.workunit.client.0.smithi033.stdout:8/122: dwrite d0/d2/f16 [0,4194304] 0 2024-02-15T18:31:00.931 INFO:tasks.workunit.client.0.smithi033.stdout:8/123: fsync d0/df/db/fc 0 2024-02-15T18:31:00.931 INFO:tasks.workunit.client.0.smithi033.stdout:2/133: mknod d20/c36 0 2024-02-15T18:31:00.943 INFO:tasks.workunit.client.0.smithi033.stdout:0/65: truncate d0/dc/ff 679625 0 2024-02-15T18:31:00.943 INFO:tasks.workunit.client.0.smithi033.stdout:1/111: creat d5/dd/d1c/f1d x:0 0 0 2024-02-15T18:31:00.943 INFO:tasks.workunit.client.0.smithi033.stdout:4/178: mkdir d4/d5/d28/d39 0 2024-02-15T18:31:00.944 INFO:tasks.workunit.client.0.smithi033.stdout:6/80: rename d8/d10/d19 to d8/d1d 0 2024-02-15T18:31:00.944 INFO:tasks.workunit.client.0.smithi033.stdout:8/124: link d0/d2/f6 d0/df/db/d1b/f27 0 2024-02-15T18:31:00.945 INFO:tasks.workunit.client.0.smithi033.stdout:7/117: dread d0/f1b [0,4194304] 0 2024-02-15T18:31:00.946 INFO:tasks.workunit.client.0.smithi033.stdout:1/112: unlink d5/d9/fa 0 2024-02-15T18:31:00.946 INFO:tasks.workunit.client.0.smithi033.stdout:1/113: fsync d5/d9/ff 0 2024-02-15T18:31:00.947 INFO:tasks.workunit.client.0.smithi033.stdout:6/81: truncate f0 1457402 0 2024-02-15T18:31:00.948 INFO:tasks.workunit.client.0.smithi033.stdout:2/134: dwrite f17 [0,4194304] 0 2024-02-15T18:31:00.949 INFO:tasks.workunit.client.0.smithi033.stdout:8/125: rename d0/df/db/d1b/c25 to d0/c28 0 2024-02-15T18:31:00.950 INFO:tasks.workunit.client.0.smithi033.stdout:7/118: rename d0/dc/fe to d0/dc/f26 0 2024-02-15T18:31:00.955 INFO:tasks.workunit.client.0.smithi033.stdout:1/114: getdents d5/dd/d12 0 2024-02-15T18:31:00.955 INFO:tasks.workunit.client.0.smithi033.stdout:1/115: chown d5/d9/c13 162 1 2024-02-15T18:31:00.956 INFO:tasks.workunit.client.0.smithi033.stdout:1/116: write d5/dd/f10 [4484560,73423] 0 2024-02-15T18:31:00.956 INFO:tasks.workunit.client.0.smithi033.stdout:1/117: getdents d5/dd/d12 0 2024-02-15T18:31:00.957 INFO:tasks.workunit.client.0.smithi033.stdout:6/82: mkdir d8/d10/d14/d1e 0 2024-02-15T18:31:00.957 INFO:tasks.workunit.client.0.smithi033.stdout:6/83: write d8/f1a [562311,104424] 0 2024-02-15T18:31:00.957 INFO:tasks.workunit.client.0.smithi033.stdout:6/84: write d8/d1d/f1b [113414,22254] 0 2024-02-15T18:31:00.965 INFO:tasks.workunit.client.0.smithi033.stdout:6/85: dread d8/fb [0,4194304] 0 2024-02-15T18:31:00.965 INFO:tasks.workunit.client.0.smithi033.stdout:6/86: chown d8 2121343 1 2024-02-15T18:31:00.965 INFO:tasks.workunit.client.0.smithi033.stdout:6/87: readlink d8/l9 0 2024-02-15T18:31:00.965 INFO:tasks.workunit.client.0.smithi033.stdout:6/88: write d8/f1a [1185171,17380] 0 2024-02-15T18:31:00.965 INFO:tasks.workunit.client.0.smithi033.stdout:6/89: dread - d8/d10/f17 zero size 2024-02-15T18:31:00.965 INFO:tasks.workunit.client.0.smithi033.stdout:2/135: creat d20/d31/f37 x:0 0 0 2024-02-15T18:31:00.967 INFO:tasks.workunit.client.0.smithi033.stdout:8/126: mkdir d0/df/d18/d29 0 2024-02-15T18:31:00.968 INFO:tasks.workunit.client.0.smithi033.stdout:6/90: symlink d8/l1f 0 2024-02-15T18:31:00.971 INFO:tasks.workunit.client.0.smithi033.stdout:8/127: link d0/df/db/l15 d0/df/db/l2a 0 2024-02-15T18:31:00.973 INFO:tasks.workunit.client.0.smithi033.stdout:8/128: link d0/df/ca d0/df/c2b 0 2024-02-15T18:31:00.986 INFO:tasks.workunit.client.0.smithi033.stdout:0/66: dwrite d0/d2/f7 [0,4194304] 0 2024-02-15T18:31:00.986 INFO:tasks.workunit.client.0.smithi033.stdout:1/118: dwrite d5/dd/d1c/f1d [0,4194304] 0 2024-02-15T18:31:00.986 INFO:tasks.workunit.client.0.smithi033.stdout:0/67: fsync d0/d8/fb 0 2024-02-15T18:31:00.986 INFO:tasks.workunit.client.0.smithi033.stdout:1/119: stat d5 0 2024-02-15T18:31:00.986 INFO:tasks.workunit.client.0.smithi033.stdout:0/68: chown d0/f4 1174284 1 2024-02-15T18:31:00.986 INFO:tasks.workunit.client.0.smithi033.stdout:0/69: write d0/d8/fb [1033617,94424] 0 2024-02-15T18:31:00.986 INFO:tasks.workunit.client.0.smithi033.stdout:4/179: dwrite d4/f21 [0,4194304] 0 2024-02-15T18:31:01.001 INFO:tasks.workunit.client.0.smithi033.stdout:6/91: dwrite d8/d10/f11 [0,4194304] 0 2024-02-15T18:31:01.007 INFO:tasks.workunit.client.0.smithi033.stdout:8/129: dwrite d0/df/db/fc [0,4194304] 0 2024-02-15T18:31:01.008 INFO:tasks.workunit.client.0.smithi033.stdout:0/70: dwrite d0/fd [0,4194304] 0 2024-02-15T18:31:01.018 INFO:tasks.workunit.client.0.smithi033.stdout:6/92: dwrite d8/d10/f17 [0,4194304] 0 2024-02-15T18:31:01.018 INFO:tasks.workunit.client.0.smithi033.stdout:6/93: write d8/d10/f18 [4711501,34031] 0 2024-02-15T18:31:01.022 INFO:tasks.workunit.client.0.smithi033.stdout:7/119: rename d0/dc/f26 to d0/f27 0 2024-02-15T18:31:01.024 INFO:tasks.workunit.client.0.smithi033.stdout:2/136: fsync d20/d31/f37 0 2024-02-15T18:31:01.024 INFO:tasks.workunit.client.0.smithi033.stdout:2/137: write d20/f2b [847300,67824] 0 2024-02-15T18:31:01.024 INFO:tasks.workunit.client.0.smithi033.stdout:2/138: truncate d20/d22/f35 383048 0 2024-02-15T18:31:01.027 INFO:tasks.workunit.client.0.smithi033.stdout:8/130: dwrite d0/d2/f6 [0,4194304] 0 2024-02-15T18:31:01.029 INFO:tasks.workunit.client.0.smithi033.stdout:8/131: read d0/fe [1460263,15700] 0 2024-02-15T18:31:01.029 INFO:tasks.workunit.client.0.smithi033.stdout:8/132: readlink d0/l7 0 2024-02-15T18:31:01.044 INFO:tasks.workunit.client.0.smithi033.stdout:2/139: dwrite f1b [0,4194304] 0 2024-02-15T18:31:01.044 INFO:tasks.workunit.client.0.smithi033.stdout:2/140: chown d20/d22/f23 114 1 2024-02-15T18:31:01.044 INFO:tasks.workunit.client.0.smithi033.stdout:2/141: chown d20/c2a 0 1 2024-02-15T18:31:01.066 INFO:tasks.workunit.client.0.smithi033.stdout:1/120: mkdir d5/d9/d1e 0 2024-02-15T18:31:01.069 INFO:tasks.workunit.client.0.smithi033.stdout:4/180: creat d4/d20/f3a x:0 0 0 2024-02-15T18:31:01.069 INFO:tasks.workunit.client.0.smithi033.stdout:4/181: truncate d4/d20/f1f 4612776 0 2024-02-15T18:31:01.075 INFO:tasks.workunit.client.0.smithi033.stdout:0/71: symlink d0/l14 0 2024-02-15T18:31:01.078 INFO:tasks.workunit.client.0.smithi033.stdout:6/94: mkdir d8/d10/d20 0 2024-02-15T18:31:01.078 INFO:tasks.workunit.client.0.smithi033.stdout:6/95: read f0 [1126525,81697] 0 2024-02-15T18:31:01.079 INFO:tasks.workunit.client.0.smithi033.stdout:7/120: symlink d0/dc/d10/d1d/l28 0 2024-02-15T18:31:01.082 INFO:tasks.workunit.client.0.smithi033.stdout:8/133: creat d0/df/f2c x:0 0 0 2024-02-15T18:31:01.084 INFO:tasks.workunit.client.0.smithi033.stdout:2/142: symlink d20/d22/l38 0 2024-02-15T18:31:01.084 INFO:tasks.workunit.client.0.smithi033.stdout:8/134: write d0/df/f19 [1420357,46563] 0 2024-02-15T18:31:01.085 INFO:tasks.workunit.client.0.smithi033.stdout:0/72: mkdir d0/d8/d15 0 2024-02-15T18:31:01.087 INFO:tasks.workunit.client.0.smithi033.stdout:1/121: dwrite d5/f8 [0,4194304] 0 2024-02-15T18:31:01.087 INFO:tasks.workunit.client.0.smithi033.stdout:6/96: link f5 d8/d10/d14/d1e/f21 0 2024-02-15T18:31:01.087 INFO:tasks.workunit.client.0.smithi033.stdout:6/97: chown d8/d10/f18 50369 1 2024-02-15T18:31:01.087 INFO:tasks.workunit.client.0.smithi033.stdout:8/135: write d0/df/f11 [3868260,7055] 0 2024-02-15T18:31:01.090 INFO:tasks.workunit.client.0.smithi033.stdout:3/111: sync 2024-02-15T18:31:01.090 INFO:tasks.workunit.client.0.smithi033.stdout:9/78: sync 2024-02-15T18:31:01.091 INFO:tasks.workunit.client.0.smithi033.stdout:5/148: sync 2024-02-15T18:31:01.091 INFO:tasks.workunit.client.0.smithi033.stdout:3/112: write d2/f11 [1824952,50520] 0 2024-02-15T18:31:01.092 INFO:tasks.workunit.client.0.smithi033.stdout:3/113: read d2/f11 [1083546,33576] 0 2024-02-15T18:31:01.092 INFO:tasks.workunit.client.0.smithi033.stdout:4/182: mknod d4/d20/c3b 0 2024-02-15T18:31:01.098 INFO:tasks.workunit.client.0.smithi033.stdout:0/73: dread d0/f5 [0,4194304] 0 2024-02-15T18:31:01.099 INFO:tasks.workunit.client.0.smithi033.stdout:0/74: fsync d0/d2/f3 0 2024-02-15T18:31:01.099 INFO:tasks.workunit.client.0.smithi033.stdout:6/98: symlink d8/d10/d14/d1e/l22 0 2024-02-15T18:31:01.099 INFO:tasks.workunit.client.0.smithi033.stdout:8/136: symlink d0/d2/l2d 0 2024-02-15T18:31:01.103 INFO:tasks.workunit.client.0.smithi033.stdout:4/183: readlink d4/d5/la 0 2024-02-15T18:31:01.103 INFO:tasks.workunit.client.0.smithi033.stdout:1/122: truncate d5/dd/f10 4717323 0 2024-02-15T18:31:01.103 INFO:tasks.workunit.client.0.smithi033.stdout:1/123: fsync d5/f8 0 2024-02-15T18:31:01.106 INFO:tasks.workunit.client.0.smithi033.stdout:0/75: mknod d0/d8/d15/c16 0 2024-02-15T18:31:01.106 INFO:tasks.workunit.client.0.smithi033.stdout:6/99: mkdir d8/d10/d14/d23 0 2024-02-15T18:31:01.106 INFO:tasks.workunit.client.0.smithi033.stdout:0/76: dread - d0/dc/f11 zero size 2024-02-15T18:31:01.106 INFO:tasks.workunit.client.0.smithi033.stdout:8/137: unlink d0/l26 0 2024-02-15T18:31:01.106 INFO:tasks.workunit.client.0.smithi033.stdout:8/138: stat d0/df/db 0 2024-02-15T18:31:01.107 INFO:tasks.workunit.client.0.smithi033.stdout:2/143: dwrite d20/f21 [0,4194304] 0 2024-02-15T18:31:01.111 INFO:tasks.workunit.client.0.smithi033.stdout:1/124: chown d5/dd/d12 9578 1 2024-02-15T18:31:01.111 INFO:tasks.workunit.client.0.smithi033.stdout:1/125: dread - d5/f1a zero size 2024-02-15T18:31:01.112 INFO:tasks.workunit.client.0.smithi033.stdout:5/149: dread d1/da/d11/f17 [0,4194304] 0 2024-02-15T18:31:01.113 INFO:tasks.workunit.client.0.smithi033.stdout:0/77: unlink d0/d8/la 0 2024-02-15T18:31:01.116 INFO:tasks.workunit.client.0.smithi033.stdout:6/100: dread d8/d10/d14/f13 [0,4194304] 0 2024-02-15T18:31:01.118 INFO:tasks.workunit.client.0.smithi033.stdout:5/150: write d1/da/d11/f17 [2724062,129215] 0 2024-02-15T18:31:01.118 INFO:tasks.workunit.client.0.smithi033.stdout:1/126: fdatasync d5/dd/fe 0 2024-02-15T18:31:01.119 INFO:tasks.workunit.client.0.smithi033.stdout:0/78: creat d0/d8/d15/f17 x:0 0 0 2024-02-15T18:31:01.120 INFO:tasks.workunit.client.0.smithi033.stdout:5/151: dread d1/da/d10/f1d [0,4194304] 0 2024-02-15T18:31:01.121 INFO:tasks.workunit.client.0.smithi033.stdout:1/127: creat d5/dd/d12/f1f x:0 0 0 2024-02-15T18:31:01.121 INFO:tasks.workunit.client.0.smithi033.stdout:1/128: write d5/f1a [932138,119386] 0 2024-02-15T18:31:01.121 INFO:tasks.workunit.client.0.smithi033.stdout:0/79: symlink d0/d8/d15/l18 0 2024-02-15T18:31:01.123 INFO:tasks.workunit.client.0.smithi033.stdout:0/80: mknod d0/d2/c19 0 2024-02-15T18:31:01.123 INFO:tasks.workunit.client.0.smithi033.stdout:0/81: truncate d0/d8/d15/f17 181660 0 2024-02-15T18:31:01.125 INFO:tasks.workunit.client.0.smithi033.stdout:8/139: dread d0/d2/f6 [0,4194304] 0 2024-02-15T18:31:01.126 INFO:tasks.workunit.client.0.smithi033.stdout:1/129: rename d5/dd/d16 to d5/d9/d1e/d20 0 2024-02-15T18:31:01.127 INFO:tasks.workunit.client.0.smithi033.stdout:1/130: write d5/dd/fe [1644778,461] 0 2024-02-15T18:31:01.128 INFO:tasks.workunit.client.0.smithi033.stdout:8/140: creat d0/df/d18/d29/f2e x:0 0 0 2024-02-15T18:31:01.129 INFO:tasks.workunit.client.0.smithi033.stdout:1/131: getdents d5/d9 0 2024-02-15T18:31:01.129 INFO:tasks.workunit.client.0.smithi033.stdout:1/132: readlink d5/lc 0 2024-02-15T18:31:01.129 INFO:tasks.workunit.client.0.smithi033.stdout:1/133: stat d5/d9 0 2024-02-15T18:31:01.129 INFO:tasks.workunit.client.0.smithi033.stdout:0/82: dread d0/d8/fb [0,4194304] 0 2024-02-15T18:31:01.131 INFO:tasks.workunit.client.0.smithi033.stdout:1/134: creat d5/dd/d1c/f21 x:0 0 0 2024-02-15T18:31:01.131 INFO:tasks.workunit.client.0.smithi033.stdout:1/135: symlink d5/d17/l22 0 2024-02-15T18:31:01.132 INFO:tasks.workunit.client.0.smithi033.stdout:1/136: mkdir d5/dd/d1c/d23 0 2024-02-15T18:31:01.133 INFO:tasks.workunit.client.0.smithi033.stdout:0/83: write d0/d2/f3 [889779,120032] 0 2024-02-15T18:31:01.135 INFO:tasks.workunit.client.0.smithi033.stdout:0/84: dread d0/f13 [0,4194304] 0 2024-02-15T18:31:01.135 INFO:tasks.workunit.client.0.smithi033.stdout:0/85: write d0/dc/ff [1832269,11890] 0 2024-02-15T18:31:01.135 INFO:tasks.workunit.client.0.smithi033.stdout:0/86: chown d0/d2 4794 1 2024-02-15T18:31:01.135 INFO:tasks.workunit.client.0.smithi033.stdout:0/87: readlink d0/l1 0 2024-02-15T18:31:01.135 INFO:tasks.workunit.client.0.smithi033.stdout:0/88: fdatasync d0/fd 0 2024-02-15T18:31:01.137 INFO:tasks.workunit.client.0.smithi033.stdout:0/89: mknod d0/dc/c1a 0 2024-02-15T18:31:01.137 INFO:tasks.workunit.client.0.smithi033.stdout:0/90: truncate d0/dc/f11 108685 0 2024-02-15T18:31:01.138 INFO:tasks.workunit.client.0.smithi033.stdout:0/91: symlink d0/d8/l1b 0 2024-02-15T18:31:01.140 INFO:tasks.workunit.client.0.smithi033.stdout:0/92: read d0/d2/f7 [310072,123135] 0 2024-02-15T18:31:01.140 INFO:tasks.workunit.client.0.smithi033.stdout:9/79: dwrite d4/f17 [0,4194304] 0 2024-02-15T18:31:01.140 INFO:tasks.workunit.client.0.smithi033.stdout:9/80: stat d4/d8/dd/l1a 0 2024-02-15T18:31:01.142 INFO:tasks.workunit.client.0.smithi033.stdout:9/81: link d4/d8/dd/l16 d4/d8/l21 0 2024-02-15T18:31:01.142 INFO:tasks.workunit.client.0.smithi033.stdout:9/82: write f0 [3506008,56908] 0 2024-02-15T18:31:01.143 INFO:tasks.workunit.client.0.smithi033.stdout:9/83: mknod d4/c22 0 2024-02-15T18:31:01.156 INFO:tasks.workunit.client.0.smithi033.stdout:2/144: dwrite d20/f2b [0,4194304] 0 2024-02-15T18:31:01.156 INFO:tasks.workunit.client.0.smithi033.stdout:9/84: dread d4/d8/dd/f14 [0,4194304] 0 2024-02-15T18:31:01.156 INFO:tasks.workunit.client.0.smithi033.stdout:3/114: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:01.157 INFO:tasks.workunit.client.0.smithi033.stdout:4/184: dwrite d4/d20/d13/f31 [0,4194304] 0 2024-02-15T18:31:01.158 INFO:tasks.workunit.client.0.smithi033.stdout:2/145: mkdir d20/d39 0 2024-02-15T18:31:01.158 INFO:tasks.workunit.client.0.smithi033.stdout:6/101: dwrite f0 [0,4194304] 0 2024-02-15T18:31:01.159 INFO:tasks.workunit.client.0.smithi033.stdout:5/152: dwrite d1/da/f1b [0,4194304] 0 2024-02-15T18:31:01.159 INFO:tasks.workunit.client.0.smithi033.stdout:8/141: dwrite d0/df/d18/f1a [0,4194304] 0 2024-02-15T18:31:01.160 INFO:tasks.workunit.client.0.smithi033.stdout:8/142: chown d0/df/db/l15 89679160 1 2024-02-15T18:31:01.160 INFO:tasks.workunit.client.0.smithi033.stdout:9/85: rename d4/d8/f10 to d4/d8/dd/f23 0 2024-02-15T18:31:01.162 INFO:tasks.workunit.client.0.smithi033.stdout:3/115: mkdir d2/d14/d23 0 2024-02-15T18:31:01.162 INFO:tasks.workunit.client.0.smithi033.stdout:3/116: chown d2/d14/f16 121303 1 2024-02-15T18:31:01.162 INFO:tasks.workunit.client.0.smithi033.stdout:2/146: write f17 [3070599,27121] 0 2024-02-15T18:31:01.163 INFO:tasks.workunit.client.0.smithi033.stdout:4/185: mkdir d4/d3c 0 2024-02-15T18:31:01.163 INFO:tasks.workunit.client.0.smithi033.stdout:1/137: dread d5/f1a [0,4194304] 0 2024-02-15T18:31:01.163 INFO:tasks.workunit.client.0.smithi033.stdout:1/138: write d5/dd/d1c/f21 [606162,15255] 0 2024-02-15T18:31:01.165 INFO:tasks.workunit.client.0.smithi033.stdout:3/117: dread d2/d14/f16 [0,4194304] 0 2024-02-15T18:31:01.171 INFO:tasks.workunit.client.0.smithi033.stdout:6/102: creat d8/d10/d14/f24 x:0 0 0 2024-02-15T18:31:01.173 INFO:tasks.workunit.client.0.smithi033.stdout:3/118: dread d2/f5 [4194304,4194304] 0 2024-02-15T18:31:01.178 INFO:tasks.workunit.client.0.smithi033.stdout:0/93: getdents d0/d8/d15 0 2024-02-15T18:31:01.181 INFO:tasks.workunit.client.0.smithi033.stdout:8/143: creat d0/df/db/f2f x:0 0 0 2024-02-15T18:31:01.181 INFO:tasks.workunit.client.0.smithi033.stdout:8/144: readlink d0/df/db/l15 0 2024-02-15T18:31:01.181 INFO:tasks.workunit.client.0.smithi033.stdout:8/145: fdatasync d0/df/db/f23 0 2024-02-15T18:31:01.182 INFO:tasks.workunit.client.0.smithi033.stdout:9/86: rename d4/f17 to d4/d8/dd/f24 0 2024-02-15T18:31:01.183 INFO:tasks.workunit.client.0.smithi033.stdout:9/87: write f0 [1301879,68972] 0 2024-02-15T18:31:01.183 INFO:tasks.workunit.client.0.smithi033.stdout:9/88: truncate d4/d8/f20 532213 0 2024-02-15T18:31:01.184 INFO:tasks.workunit.client.0.smithi033.stdout:2/147: mkdir d20/d3a 0 2024-02-15T18:31:01.184 INFO:tasks.workunit.client.0.smithi033.stdout:4/186: readlink d4/d20/l18 0 2024-02-15T18:31:01.186 INFO:tasks.workunit.client.0.smithi033.stdout:6/103: mknod d8/d10/d14/d1e/c25 0 2024-02-15T18:31:01.189 INFO:tasks.workunit.client.0.smithi033.stdout:0/94: mkdir d0/d2/d1c 0 2024-02-15T18:31:01.190 INFO:tasks.workunit.client.0.smithi033.stdout:8/146: mkdir d0/d1c/d30 0 2024-02-15T18:31:01.191 INFO:tasks.workunit.client.0.smithi033.stdout:5/153: dwrite d1/da/d11/f17 [0,4194304] 0 2024-02-15T18:31:01.191 INFO:tasks.workunit.client.0.smithi033.stdout:2/148: mkdir d20/d3a/d3b 0 2024-02-15T18:31:01.195 INFO:tasks.workunit.client.0.smithi033.stdout:4/187: symlink d4/l3d 0 2024-02-15T18:31:01.196 INFO:tasks.workunit.client.0.smithi033.stdout:6/104: mknod d8/c26 0 2024-02-15T18:31:01.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/139: dwrite d5/f8 [0,4194304] 0 2024-02-15T18:31:01.196 INFO:tasks.workunit.client.0.smithi033.stdout:0/95: rename d0/d2/d1c to d0/dc/d1d 0 2024-02-15T18:31:01.196 INFO:tasks.workunit.client.0.smithi033.stdout:1/140: write d5/dd/d12/f1f [710271,7139] 0 2024-02-15T18:31:01.200 INFO:tasks.workunit.client.0.smithi033.stdout:2/149: creat d20/f3c x:0 0 0 2024-02-15T18:31:01.201 INFO:tasks.workunit.client.0.smithi033.stdout:6/105: getdents d8/d10 0 2024-02-15T18:31:01.204 INFO:tasks.workunit.client.0.smithi033.stdout:6/106: rename d8/d10/d14/d1e/f21 to d8/d10/d14/d1e/f27 0 2024-02-15T18:31:01.204 INFO:tasks.workunit.client.0.smithi033.stdout:0/96: dread d0/d8/d15/f17 [0,4194304] 0 2024-02-15T18:31:01.205 INFO:tasks.workunit.client.0.smithi033.stdout:0/97: chown d0/d2/c19 6662 1 2024-02-15T18:31:01.205 INFO:tasks.workunit.client.0.smithi033.stdout:0/98: chown d0/f13 1 1 2024-02-15T18:31:01.205 INFO:tasks.workunit.client.0.smithi033.stdout:1/141: mkdir d5/dd/d24 0 2024-02-15T18:31:01.206 INFO:tasks.workunit.client.0.smithi033.stdout:6/107: unlink f5 0 2024-02-15T18:31:01.209 INFO:tasks.workunit.client.0.smithi033.stdout:6/108: truncate d8/d10/d14/f13 1203592 0 2024-02-15T18:31:01.211 INFO:tasks.workunit.client.0.smithi033.stdout:3/119: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:01.211 INFO:tasks.workunit.client.0.smithi033.stdout:3/120: chown d2/d3 182794202 1 2024-02-15T18:31:01.211 INFO:tasks.workunit.client.0.smithi033.stdout:3/121: dread - d2/f1d zero size 2024-02-15T18:31:01.211 INFO:tasks.workunit.client.0.smithi033.stdout:3/122: fsync d2/f1d 0 2024-02-15T18:31:01.212 INFO:tasks.workunit.client.0.smithi033.stdout:4/188: dread d4/d20/f26 [0,4194304] 0 2024-02-15T18:31:01.212 INFO:tasks.workunit.client.0.smithi033.stdout:4/189: write d4/f22 [2430735,116199] 0 2024-02-15T18:31:01.212 INFO:tasks.workunit.client.0.smithi033.stdout:2/150: write d20/f21 [3445353,85718] 0 2024-02-15T18:31:01.213 INFO:tasks.workunit.client.0.smithi033.stdout:2/151: fsync f1 0 2024-02-15T18:31:01.213 INFO:tasks.workunit.client.0.smithi033.stdout:2/152: fsync f0 0 2024-02-15T18:31:01.213 INFO:tasks.workunit.client.0.smithi033.stdout:2/153: fsync d20/f29 0 2024-02-15T18:31:01.214 INFO:tasks.workunit.client.0.smithi033.stdout:4/190: mknod d4/d5/d28/c3e 0 2024-02-15T18:31:01.214 INFO:tasks.workunit.client.0.smithi033.stdout:3/123: dread d2/f12 [0,4194304] 0 2024-02-15T18:31:01.214 INFO:tasks.workunit.client.0.smithi033.stdout:4/191: chown d4/d5/f1e 13 1 2024-02-15T18:31:01.216 INFO:tasks.workunit.client.0.smithi033.stdout:3/124: link d2/f5 d2/d3/d1e/f24 0 2024-02-15T18:31:01.216 INFO:tasks.workunit.client.0.smithi033.stdout:3/125: fdatasync d2/f4 0 2024-02-15T18:31:01.216 INFO:tasks.workunit.client.0.smithi033.stdout:3/126: truncate d2/f1d 223107 0 2024-02-15T18:31:01.216 INFO:tasks.workunit.client.0.smithi033.stdout:3/127: chown d2/d3/df/l18 21251 1 2024-02-15T18:31:01.216 INFO:tasks.workunit.client.0.smithi033.stdout:3/128: stat d2/d3 0 2024-02-15T18:31:01.216 INFO:tasks.workunit.client.0.smithi033.stdout:3/129: creat d2/d3/d1e/d22/f25 x:0 0 0 2024-02-15T18:31:01.218 INFO:tasks.workunit.client.0.smithi033.stdout:3/130: link d2/f4 d2/f26 0 2024-02-15T18:31:01.224 INFO:tasks.workunit.client.0.smithi033.stdout:9/89: dwrite d4/d8/ff [0,4194304] 0 2024-02-15T18:31:01.224 INFO:tasks.workunit.client.0.smithi033.stdout:5/154: dwrite d1/f14 [0,4194304] 0 2024-02-15T18:31:01.224 INFO:tasks.workunit.client.0.smithi033.stdout:1/142: fdatasync d5/dd/d12/f1f 0 2024-02-15T18:31:01.224 INFO:tasks.workunit.client.0.smithi033.stdout:0/99: dwrite d0/d8/d15/f17 [0,4194304] 0 2024-02-15T18:31:01.224 INFO:tasks.workunit.client.0.smithi033.stdout:2/154: fsync d20/f21 0 2024-02-15T18:31:01.225 INFO:tasks.workunit.client.0.smithi033.stdout:8/147: dwrite d0/fe [0,4194304] 0 2024-02-15T18:31:01.225 INFO:tasks.workunit.client.0.smithi033.stdout:8/148: stat d0/df/db/f23 0 2024-02-15T18:31:01.236 INFO:tasks.workunit.client.0.smithi033.stdout:5/155: unlink d1/da/d11/l20 0 2024-02-15T18:31:01.238 INFO:tasks.workunit.client.0.smithi033.stdout:9/90: symlink d4/d8/l25 0 2024-02-15T18:31:01.238 INFO:tasks.workunit.client.0.smithi033.stdout:0/100: chown d0/d8/l1b 255 1 2024-02-15T18:31:01.240 INFO:tasks.workunit.client.0.smithi033.stdout:2/155: symlink d20/d39/l3d 0 2024-02-15T18:31:01.240 INFO:tasks.workunit.client.0.smithi033.stdout:2/156: write d20/d22/f23 [1398757,89439] 0 2024-02-15T18:31:01.244 INFO:tasks.workunit.client.0.smithi033.stdout:6/109: dread d8/f15 [0,4194304] 0 2024-02-15T18:31:01.244 INFO:tasks.workunit.client.0.smithi033.stdout:6/110: chown d8/d10/d14/d23 31374125 1 2024-02-15T18:31:01.244 INFO:tasks.workunit.client.0.smithi033.stdout:6/111: write d8/d10/f11 [4651060,84631] 0 2024-02-15T18:31:01.248 INFO:tasks.workunit.client.0.smithi033.stdout:5/156: dread d1/da/f13 [0,4194304] 0 2024-02-15T18:31:01.248 INFO:tasks.workunit.client.0.smithi033.stdout:5/157: chown d1/da/d10/l21 55326 1 2024-02-15T18:31:01.249 INFO:tasks.workunit.client.0.smithi033.stdout:3/131: dwrite d2/fa [0,4194304] 0 2024-02-15T18:31:01.249 INFO:tasks.workunit.client.0.smithi033.stdout:4/192: dwrite d4/d20/d13/f31 [0,4194304] 0 2024-02-15T18:31:01.252 INFO:tasks.workunit.client.0.smithi033.stdout:5/158: read d1/f14 [4022713,97178] 0 2024-02-15T18:31:01.252 INFO:tasks.workunit.client.0.smithi033.stdout:5/159: fsync d1/da/d10/f26 0 2024-02-15T18:31:01.255 INFO:tasks.workunit.client.0.smithi033.stdout:8/149: dwrite d0/df/d18/f1a [4194304,4194304] 0 2024-02-15T18:31:01.257 INFO:tasks.workunit.client.0.smithi033.stdout:1/143: mknod d5/dd/c25 0 2024-02-15T18:31:01.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/91: mknod d4/d8/c26 0 2024-02-15T18:31:01.258 INFO:tasks.workunit.client.0.smithi033.stdout:0/101: creat d0/dc/d1d/f1e x:0 0 0 2024-02-15T18:31:01.260 INFO:tasks.workunit.client.0.smithi033.stdout:2/157: dwrite d20/f29 [0,4194304] 0 2024-02-15T18:31:01.262 INFO:tasks.workunit.client.0.smithi033.stdout:1/144: dread d5/dd/d1c/f21 [0,4194304] 0 2024-02-15T18:31:01.262 INFO:tasks.workunit.client.0.smithi033.stdout:1/145: readlink d5/lc 0 2024-02-15T18:31:01.266 INFO:tasks.workunit.client.0.smithi033.stdout:3/132: creat d2/f27 x:0 0 0 2024-02-15T18:31:01.269 INFO:tasks.workunit.client.0.smithi033.stdout:7/121: sync 2024-02-15T18:31:01.269 INFO:tasks.workunit.client.0.smithi033.stdout:7/122: chown d0/f1b 1417655 1 2024-02-15T18:31:01.269 INFO:tasks.workunit.client.0.smithi033.stdout:7/123: chown d0/dc/d10/c8 225 1 2024-02-15T18:31:01.269 INFO:tasks.workunit.client.0.smithi033.stdout:7/124: chown d0/dc/d10/f21 182 1 2024-02-15T18:31:01.269 INFO:tasks.workunit.client.0.smithi033.stdout:7/125: chown d0/dc/c16 792307107 1 2024-02-15T18:31:01.269 INFO:tasks.workunit.client.0.smithi033.stdout:7/126: readlink d0/dc/d10/d1d/l24 0 2024-02-15T18:31:01.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/112: rename d8/d10 to d8/d28 0 2024-02-15T18:31:01.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/113: readlink d8/d28/l12 0 2024-02-15T18:31:01.271 INFO:tasks.workunit.client.0.smithi033.stdout:6/114: dread d8/fb [0,4194304] 0 2024-02-15T18:31:01.271 INFO:tasks.workunit.client.0.smithi033.stdout:6/115: fsync f7 0 2024-02-15T18:31:01.271 INFO:tasks.workunit.client.0.smithi033.stdout:8/150: creat d0/df/db/f31 x:0 0 0 2024-02-15T18:31:01.276 INFO:tasks.workunit.client.0.smithi033.stdout:2/158: link d20/d31/d32/f34 d20/d22/f3e 0 2024-02-15T18:31:01.276 INFO:tasks.workunit.client.0.smithi033.stdout:2/159: readlink l11 0 2024-02-15T18:31:01.276 INFO:tasks.workunit.client.0.smithi033.stdout:2/160: chown d20/d22/f26 162 1 2024-02-15T18:31:01.276 INFO:tasks.workunit.client.0.smithi033.stdout:1/146: rmdir d5 39 2024-02-15T18:31:01.276 INFO:tasks.workunit.client.0.smithi033.stdout:1/147: chown d5/d9 0 1 2024-02-15T18:31:01.279 INFO:tasks.workunit.client.0.smithi033.stdout:3/133: rmdir d2 39 2024-02-15T18:31:01.280 INFO:tasks.workunit.client.0.smithi033.stdout:4/193: mknod d4/d5/c3f 0 2024-02-15T18:31:01.280 INFO:tasks.workunit.client.0.smithi033.stdout:4/194: chown d4/d20/d13/d1b 180727377 1 2024-02-15T18:31:01.282 INFO:tasks.workunit.client.0.smithi033.stdout:1/148: dread d5/d9/ff [0,4194304] 0 2024-02-15T18:31:01.282 INFO:tasks.workunit.client.0.smithi033.stdout:1/149: truncate d5/dd/d12/f1b 99797 0 2024-02-15T18:31:01.282 INFO:tasks.workunit.client.0.smithi033.stdout:1/150: chown d5/d9 8 1 2024-02-15T18:31:01.282 INFO:tasks.workunit.client.0.smithi033.stdout:5/160: rename d1/da/d11/f23 to d1/f27 0 2024-02-15T18:31:01.282 INFO:tasks.workunit.client.0.smithi033.stdout:5/161: stat d1/f27 0 2024-02-15T18:31:01.283 INFO:tasks.workunit.client.0.smithi033.stdout:7/127: creat d0/dc/f29 x:0 0 0 2024-02-15T18:31:01.284 INFO:tasks.workunit.client.0.smithi033.stdout:6/116: mkdir d8/d28/d14/d23/d29 0 2024-02-15T18:31:01.286 INFO:tasks.workunit.client.0.smithi033.stdout:9/92: dread d4/d8/f20 [0,4194304] 0 2024-02-15T18:31:01.286 INFO:tasks.workunit.client.0.smithi033.stdout:9/93: chown d4/d8/dd/l12 8164141 1 2024-02-15T18:31:01.287 INFO:tasks.workunit.client.0.smithi033.stdout:0/102: link d0/dc/d1d/f1e d0/dc/d1d/f1f 0 2024-02-15T18:31:01.288 INFO:tasks.workunit.client.0.smithi033.stdout:0/103: truncate d0/dc/f11 337320 0 2024-02-15T18:31:01.290 INFO:tasks.workunit.client.0.smithi033.stdout:2/161: symlink d20/d31/l3f 0 2024-02-15T18:31:01.290 INFO:tasks.workunit.client.0.smithi033.stdout:3/134: getdents d2/d3/d1e/d22 0 2024-02-15T18:31:01.291 INFO:tasks.workunit.client.0.smithi033.stdout:5/162: truncate d1/f9 458473 0 2024-02-15T18:31:01.294 INFO:tasks.workunit.client.0.smithi033.stdout:3/135: write d2/f9 [320228,46788] 0 2024-02-15T18:31:01.294 INFO:tasks.workunit.client.0.smithi033.stdout:3/136: fsync d2/f1b 0 2024-02-15T18:31:01.294 INFO:tasks.workunit.client.0.smithi033.stdout:8/151: dwrite d0/df/d18/f1a [4194304,4194304] 0 2024-02-15T18:31:01.294 INFO:tasks.workunit.client.0.smithi033.stdout:8/152: stat d0/df 0 2024-02-15T18:31:01.294 INFO:tasks.workunit.client.0.smithi033.stdout:0/104: symlink d0/dc/d1d/l20 0 2024-02-15T18:31:01.295 INFO:tasks.workunit.client.0.smithi033.stdout:7/128: dread d0/fd [0,4194304] 0 2024-02-15T18:31:01.296 INFO:tasks.workunit.client.0.smithi033.stdout:0/105: dread d0/f13 [0,4194304] 0 2024-02-15T18:31:01.297 INFO:tasks.workunit.client.0.smithi033.stdout:3/137: creat d2/d14/d23/f28 x:0 0 0 2024-02-15T18:31:01.299 INFO:tasks.workunit.client.0.smithi033.stdout:8/153: unlink d0/df/ca 0 2024-02-15T18:31:01.300 INFO:tasks.workunit.client.0.smithi033.stdout:3/138: mkdir d2/d3/df/d29 0 2024-02-15T18:31:01.307 INFO:tasks.workunit.client.0.smithi033.stdout:7/129: dread d0/f1c [4194304,4194304] 0 2024-02-15T18:31:01.307 INFO:tasks.workunit.client.0.smithi033.stdout:7/130: truncate d0/f1b 1112835 0 2024-02-15T18:31:01.307 INFO:tasks.workunit.client.0.smithi033.stdout:7/131: chown d0/dc/l20 1956 1 2024-02-15T18:31:01.309 INFO:tasks.workunit.client.0.smithi033.stdout:7/132: creat d0/dc/f2a x:0 0 0 2024-02-15T18:31:01.309 INFO:tasks.workunit.client.0.smithi033.stdout:7/133: write d0/dc/d10/d1d/f25 [862869,127406] 0 2024-02-15T18:31:01.309 INFO:tasks.workunit.client.0.smithi033.stdout:7/134: write d0/dc/d10/f13 [2682173,125681] 0 2024-02-15T18:31:01.312 INFO:tasks.workunit.client.0.smithi033.stdout:2/162: dread d20/f29 [0,4194304] 0 2024-02-15T18:31:01.312 INFO:tasks.workunit.client.0.smithi033.stdout:2/163: chown d20/d22/f26 1649659 1 2024-02-15T18:31:01.312 INFO:tasks.workunit.client.0.smithi033.stdout:2/164: chown d20/c25 3325 1 2024-02-15T18:31:01.312 INFO:tasks.workunit.client.0.smithi033.stdout:7/135: mkdir d0/dc/d10/d1d/d2b 0 2024-02-15T18:31:01.312 INFO:tasks.workunit.client.0.smithi033.stdout:7/136: chown d0/dc/f1a 11759247 1 2024-02-15T18:31:01.313 INFO:tasks.workunit.client.0.smithi033.stdout:7/137: dread - d0/dc/f29 zero size 2024-02-15T18:31:01.313 INFO:tasks.workunit.client.0.smithi033.stdout:7/138: creat d0/dc/d10/f2c x:0 0 0 2024-02-15T18:31:01.314 INFO:tasks.workunit.client.0.smithi033.stdout:7/139: truncate d0/dc/d10/f2c 834514 0 2024-02-15T18:31:01.314 INFO:tasks.workunit.client.0.smithi033.stdout:7/140: write d0/f1b [156463,10885] 0 2024-02-15T18:31:01.315 INFO:tasks.workunit.client.0.smithi033.stdout:7/141: creat d0/dc/d10/d1d/f2d x:0 0 0 2024-02-15T18:31:01.316 INFO:tasks.workunit.client.0.smithi033.stdout:8/154: dread d0/df/db/fc [0,4194304] 0 2024-02-15T18:31:01.317 INFO:tasks.workunit.client.0.smithi033.stdout:7/142: write d0/dc/d10/f17 [128759,18120] 0 2024-02-15T18:31:01.319 INFO:tasks.workunit.client.0.smithi033.stdout:4/195: dwrite d4/f15 [0,4194304] 0 2024-02-15T18:31:01.319 INFO:tasks.workunit.client.0.smithi033.stdout:4/196: stat d4/d5/d28/l35 0 2024-02-15T18:31:01.319 INFO:tasks.workunit.client.0.smithi033.stdout:4/197: chown d4/d20/ff 176988912 1 2024-02-15T18:31:01.322 INFO:tasks.workunit.client.0.smithi033.stdout:9/94: dwrite d4/d8/dd/f15 [0,4194304] 0 2024-02-15T18:31:01.323 INFO:tasks.workunit.client.0.smithi033.stdout:3/139: fsync d2/f9 0 2024-02-15T18:31:01.323 INFO:tasks.workunit.client.0.smithi033.stdout:0/106: dwrite d0/dc/ff [0,4194304] 0 2024-02-15T18:31:01.323 INFO:tasks.workunit.client.0.smithi033.stdout:6/117: dwrite d8/d28/f18 [0,4194304] 0 2024-02-15T18:31:01.324 INFO:tasks.workunit.client.0.smithi033.stdout:8/155: write d0/df/db/d1b/f27 [2602125,121436] 0 2024-02-15T18:31:01.326 INFO:tasks.workunit.client.0.smithi033.stdout:9/95: creat d4/d8/dd/f27 x:0 0 0 2024-02-15T18:31:01.326 INFO:tasks.workunit.client.0.smithi033.stdout:9/96: truncate d4/d8/dd/f24 4317230 0 2024-02-15T18:31:01.326 INFO:tasks.workunit.client.0.smithi033.stdout:9/97: chown f0 6728 1 2024-02-15T18:31:01.326 INFO:tasks.workunit.client.0.smithi033.stdout:9/98: truncate d4/d8/f1d 522174 0 2024-02-15T18:31:01.328 INFO:tasks.workunit.client.0.smithi033.stdout:3/140: rename d2/d3/df/c13 to d2/d20/c2a 0 2024-02-15T18:31:01.328 INFO:tasks.workunit.client.0.smithi033.stdout:3/141: fdatasync d2/f27 0 2024-02-15T18:31:01.329 INFO:tasks.workunit.client.0.smithi033.stdout:6/118: unlink d8/d28/c1c 0 2024-02-15T18:31:01.331 INFO:tasks.workunit.client.0.smithi033.stdout:0/107: link d0/dc/f11 d0/dc/d1d/f21 0 2024-02-15T18:31:01.331 INFO:tasks.workunit.client.0.smithi033.stdout:8/156: write d0/d2/f6 [273369,67072] 0 2024-02-15T18:31:01.332 INFO:tasks.workunit.client.0.smithi033.stdout:0/108: dread d0/f13 [0,4194304] 0 2024-02-15T18:31:01.332 INFO:tasks.workunit.client.0.smithi033.stdout:4/198: link d4/d20/c10 d4/d20/d37/c40 0 2024-02-15T18:31:01.332 INFO:tasks.workunit.client.0.smithi033.stdout:4/199: chown d4/d20/f9 2352822 1 2024-02-15T18:31:01.336 INFO:tasks.workunit.client.0.smithi033.stdout:9/99: mkdir d4/d8/dd/d28 0 2024-02-15T18:31:01.337 INFO:tasks.workunit.client.0.smithi033.stdout:6/119: mkdir d8/d1d/d2a 0 2024-02-15T18:31:01.338 INFO:tasks.workunit.client.0.smithi033.stdout:8/157: creat d0/d2/d14/f32 x:0 0 0 2024-02-15T18:31:01.340 INFO:tasks.workunit.client.0.smithi033.stdout:4/200: symlink d4/d20/d13/l41 0 2024-02-15T18:31:01.341 INFO:tasks.workunit.client.0.smithi033.stdout:9/100: creat d4/d8/dd/f29 x:0 0 0 2024-02-15T18:31:01.342 INFO:tasks.workunit.client.0.smithi033.stdout:3/142: dread d2/d3/d1e/f24 [0,4194304] 0 2024-02-15T18:31:01.342 INFO:tasks.workunit.client.0.smithi033.stdout:8/158: symlink d0/l33 0 2024-02-15T18:31:01.344 INFO:tasks.workunit.client.0.smithi033.stdout:9/101: read d4/d8/d1b/f1f [157344,11524] 0 2024-02-15T18:31:01.344 INFO:tasks.workunit.client.0.smithi033.stdout:3/143: truncate d2/f4 563215 0 2024-02-15T18:31:01.344 INFO:tasks.workunit.client.0.smithi033.stdout:3/144: readlink d2/d20/l21 0 2024-02-15T18:31:01.345 INFO:tasks.workunit.client.0.smithi033.stdout:3/145: fdatasync d2/d3/d1e/d22/f25 0 2024-02-15T18:31:01.345 INFO:tasks.workunit.client.0.smithi033.stdout:2/165: dwrite f1b [0,4194304] 0 2024-02-15T18:31:01.346 INFO:tasks.workunit.client.0.smithi033.stdout:8/159: rename d0/df/db/f31 to d0/d2/d14/f34 0 2024-02-15T18:31:01.346 INFO:tasks.workunit.client.0.smithi033.stdout:7/143: dwrite d0/dc/f2a [0,4194304] 0 2024-02-15T18:31:01.346 INFO:tasks.workunit.client.0.smithi033.stdout:7/144: write d0/dc/d10/d1d/f25 [1206906,12315] 0 2024-02-15T18:31:01.347 INFO:tasks.workunit.client.0.smithi033.stdout:9/102: symlink d4/d8/d1b/l2a 0 2024-02-15T18:31:01.353 INFO:tasks.workunit.client.0.smithi033.stdout:3/146: unlink d2/f9 0 2024-02-15T18:31:01.360 INFO:tasks.workunit.client.0.smithi033.stdout:0/109: rmdir d0/dc 39 2024-02-15T18:31:01.361 INFO:tasks.workunit.client.0.smithi033.stdout:4/201: getdents d4/d20/d37 0 2024-02-15T18:31:01.361 INFO:tasks.workunit.client.0.smithi033.stdout:4/202: chown d4/d20 126966199 1 2024-02-15T18:31:01.362 INFO:tasks.workunit.client.0.smithi033.stdout:2/166: dread f1b [0,4194304] 0 2024-02-15T18:31:01.363 INFO:tasks.workunit.client.0.smithi033.stdout:6/120: rmdir d8 39 2024-02-15T18:31:01.366 INFO:tasks.workunit.client.0.smithi033.stdout:7/145: rename d0/dc/d10/d1d/l28 to d0/dc/d10/d1d/d2b/l2e 0 2024-02-15T18:31:01.370 INFO:tasks.workunit.client.0.smithi033.stdout:8/160: dwrite d0/df/db/fc [0,4194304] 0 2024-02-15T18:31:01.371 INFO:tasks.workunit.client.0.smithi033.stdout:3/147: creat d2/d14/f2b x:0 0 0 2024-02-15T18:31:01.372 INFO:tasks.workunit.client.0.smithi033.stdout:0/110: truncate d0/fd 292495 0 2024-02-15T18:31:01.373 INFO:tasks.workunit.client.0.smithi033.stdout:0/111: write d0/f13 [42852,9326] 0 2024-02-15T18:31:01.373 INFO:tasks.workunit.client.0.smithi033.stdout:0/112: readlink d0/d8/d15/l18 0 2024-02-15T18:31:01.373 INFO:tasks.workunit.client.0.smithi033.stdout:4/203: creat d4/d20/d37/f42 x:0 0 0 2024-02-15T18:31:01.374 INFO:tasks.workunit.client.0.smithi033.stdout:2/167: symlink d20/d3a/l40 0 2024-02-15T18:31:01.376 INFO:tasks.workunit.client.0.smithi033.stdout:7/146: mknod d0/dc/d10/d1d/c2f 0 2024-02-15T18:31:01.377 INFO:tasks.workunit.client.0.smithi033.stdout:8/161: dread d0/df/db/d1b/f22 [0,4194304] 0 2024-02-15T18:31:01.377 INFO:tasks.workunit.client.0.smithi033.stdout:8/162: stat d0/df/db/f2f 0 2024-02-15T18:31:01.377 INFO:tasks.workunit.client.0.smithi033.stdout:3/148: mknod d2/d3/c2c 0 2024-02-15T18:31:01.378 INFO:tasks.workunit.client.0.smithi033.stdout:0/113: rename d0/dc/d1d/l20 to d0/d8/d15/l22 0 2024-02-15T18:31:01.378 INFO:tasks.workunit.client.0.smithi033.stdout:0/114: stat d0/dc/d1d/f21 0 2024-02-15T18:31:01.378 INFO:tasks.workunit.client.0.smithi033.stdout:0/115: fdatasync d0/fd 0 2024-02-15T18:31:01.379 INFO:tasks.workunit.client.0.smithi033.stdout:7/147: creat d0/f30 x:0 0 0 2024-02-15T18:31:01.379 INFO:tasks.workunit.client.0.smithi033.stdout:3/149: getdents d2/d3/d17 0 2024-02-15T18:31:01.379 INFO:tasks.workunit.client.0.smithi033.stdout:3/150: stat d2/d3/df 0 2024-02-15T18:31:01.381 INFO:tasks.workunit.client.0.smithi033.stdout:2/168: rename f17 to d20/d22/f41 0 2024-02-15T18:31:01.381 INFO:tasks.workunit.client.0.smithi033.stdout:7/148: creat d0/dc/f31 x:0 0 0 2024-02-15T18:31:01.382 INFO:tasks.workunit.client.0.smithi033.stdout:2/169: write f1b [4024128,85945] 0 2024-02-15T18:31:01.382 INFO:tasks.workunit.client.0.smithi033.stdout:6/121: dwrite d8/fb [0,4194304] 0 2024-02-15T18:31:01.382 INFO:tasks.workunit.client.0.smithi033.stdout:6/122: getdents d8/d28/d14/d23/d29 0 2024-02-15T18:31:01.384 INFO:tasks.workunit.client.0.smithi033.stdout:8/163: rename d0/df/d18 to d0/d2/d35 0 2024-02-15T18:31:01.384 INFO:tasks.workunit.client.0.smithi033.stdout:8/164: chown d0/fe 710 1 2024-02-15T18:31:01.384 INFO:tasks.workunit.client.0.smithi033.stdout:7/149: dread d0/f1 [0,4194304] 0 2024-02-15T18:31:01.388 INFO:tasks.workunit.client.0.smithi033.stdout:4/204: dread d4/f21 [0,4194304] 0 2024-02-15T18:31:01.389 INFO:tasks.workunit.client.0.smithi033.stdout:2/170: dread d20/d22/f3e [0,4194304] 0 2024-02-15T18:31:01.391 INFO:tasks.workunit.client.0.smithi033.stdout:0/116: rename d0/dc/f11 to d0/d2/f23 0 2024-02-15T18:31:01.391 INFO:tasks.workunit.client.0.smithi033.stdout:3/151: rename d2 to d2/d2d 22 2024-02-15T18:31:01.397 INFO:tasks.workunit.client.0.smithi033.stdout:8/165: rmdir d0/df/db 39 2024-02-15T18:31:01.398 INFO:tasks.workunit.client.0.smithi033.stdout:4/205: symlink d4/d5/d28/l43 0 2024-02-15T18:31:01.399 INFO:tasks.workunit.client.0.smithi033.stdout:8/166: dread d0/df/f11 [4194304,4194304] 0 2024-02-15T18:31:01.399 INFO:tasks.workunit.client.0.smithi033.stdout:8/167: chown d0/df/db/f23 19482 1 2024-02-15T18:31:01.399 INFO:tasks.workunit.client.0.smithi033.stdout:8/168: readlink d0/df/l20 0 2024-02-15T18:31:01.399 INFO:tasks.workunit.client.0.smithi033.stdout:8/169: write d0/d2/d14/f32 [807429,61318] 0 2024-02-15T18:31:01.399 INFO:tasks.workunit.client.0.smithi033.stdout:8/170: fdatasync d0/d2/d35/d29/f2e 0 2024-02-15T18:31:01.400 INFO:tasks.workunit.client.0.smithi033.stdout:2/171: chown c2 30 1 2024-02-15T18:31:01.401 INFO:tasks.workunit.client.0.smithi033.stdout:6/123: mknod d8/d28/d14/d1e/c2b 0 2024-02-15T18:31:01.401 INFO:tasks.workunit.client.0.smithi033.stdout:6/124: truncate d8/d28/d14/f13 1733400 0 2024-02-15T18:31:01.402 INFO:tasks.workunit.client.0.smithi033.stdout:0/117: creat d0/d8/f24 x:0 0 0 2024-02-15T18:31:01.403 INFO:tasks.workunit.client.0.smithi033.stdout:7/150: rename d0/dc/d10/f21 to d0/f32 0 2024-02-15T18:31:01.403 INFO:tasks.workunit.client.0.smithi033.stdout:7/151: write d0/dc/f29 [852888,21835] 0 2024-02-15T18:31:01.403 INFO:tasks.workunit.client.0.smithi033.stdout:7/152: dread - d0/f32 zero size 2024-02-15T18:31:01.403 INFO:tasks.workunit.client.0.smithi033.stdout:7/153: chown d0/l1e 11625373 1 2024-02-15T18:31:01.405 INFO:tasks.workunit.client.0.smithi033.stdout:8/171: symlink d0/d2/d14/l36 0 2024-02-15T18:31:01.406 INFO:tasks.workunit.client.0.smithi033.stdout:3/152: dwrite d2/f12 [4194304,4194304] 0 2024-02-15T18:31:01.407 INFO:tasks.workunit.client.0.smithi033.stdout:2/172: symlink d20/l42 0 2024-02-15T18:31:01.409 INFO:tasks.workunit.client.0.smithi033.stdout:0/118: dread d0/f13 [0,4194304] 0 2024-02-15T18:31:01.409 INFO:tasks.workunit.client.0.smithi033.stdout:0/119: truncate d0/dc/d1d/f1f 836844 0 2024-02-15T18:31:01.409 INFO:tasks.workunit.client.0.smithi033.stdout:6/125: rmdir d8/d28/d20 0 2024-02-15T18:31:01.411 INFO:tasks.workunit.client.0.smithi033.stdout:8/172: rename d0/df/db/l13 to d0/df/db/d1b/l37 0 2024-02-15T18:31:01.412 INFO:tasks.workunit.client.0.smithi033.stdout:3/153: link d2/f1d d2/f2e 0 2024-02-15T18:31:01.413 INFO:tasks.workunit.client.0.smithi033.stdout:3/154: truncate d2/d3/d1e/d22/f25 797193 0 2024-02-15T18:31:01.413 INFO:tasks.workunit.client.0.smithi033.stdout:2/173: creat d20/f43 x:0 0 0 2024-02-15T18:31:01.413 INFO:tasks.workunit.client.0.smithi033.stdout:2/174: getdents d20/d30 0 2024-02-15T18:31:01.414 INFO:tasks.workunit.client.0.smithi033.stdout:0/120: link d0/f13 d0/dc/d1d/f25 0 2024-02-15T18:31:01.416 INFO:tasks.workunit.client.0.smithi033.stdout:6/126: mkdir d8/d28/d14/d2c 0 2024-02-15T18:31:01.416 INFO:tasks.workunit.client.0.smithi033.stdout:3/155: creat d2/d14/d23/f2f x:0 0 0 2024-02-15T18:31:01.417 INFO:tasks.workunit.client.0.smithi033.stdout:3/156: fdatasync d2/f11 0 2024-02-15T18:31:01.417 INFO:tasks.workunit.client.0.smithi033.stdout:3/157: write d2/d3/d1e/f24 [4811664,91839] 0 2024-02-15T18:31:01.417 INFO:tasks.workunit.client.0.smithi033.stdout:2/175: creat d20/d30/f44 x:0 0 0 2024-02-15T18:31:01.418 INFO:tasks.workunit.client.0.smithi033.stdout:0/121: creat d0/d8/f26 x:0 0 0 2024-02-15T18:31:01.418 INFO:tasks.workunit.client.0.smithi033.stdout:6/127: dread d8/f1a [0,4194304] 0 2024-02-15T18:31:01.419 INFO:tasks.workunit.client.0.smithi033.stdout:2/176: rename d20/d22/l38 to d20/d3a/l45 0 2024-02-15T18:31:01.420 INFO:tasks.workunit.client.0.smithi033.stdout:4/206: dwrite d4/d5/f1e [0,4194304] 0 2024-02-15T18:31:01.420 INFO:tasks.workunit.client.0.smithi033.stdout:4/207: fsync d4/d5/d28/f36 0 2024-02-15T18:31:01.421 INFO:tasks.workunit.client.0.smithi033.stdout:0/122: getdents d0 0 2024-02-15T18:31:01.421 INFO:tasks.workunit.client.0.smithi033.stdout:0/123: dread - d0/d8/f24 zero size 2024-02-15T18:31:01.421 INFO:tasks.workunit.client.0.smithi033.stdout:0/124: fdatasync d0/dc/ff 0 2024-02-15T18:31:01.422 INFO:tasks.workunit.client.0.smithi033.stdout:7/154: dwrite d0/dc/d10/f13 [0,4194304] 0 2024-02-15T18:31:01.422 INFO:tasks.workunit.client.0.smithi033.stdout:7/155: dread - d0/f32 zero size 2024-02-15T18:31:01.423 INFO:tasks.workunit.client.0.smithi033.stdout:2/177: rmdir d20/d3a/d3b 0 2024-02-15T18:31:01.424 INFO:tasks.workunit.client.0.smithi033.stdout:2/178: stat d20/d31 0 2024-02-15T18:31:01.424 INFO:tasks.workunit.client.0.smithi033.stdout:2/179: write f19 [48635,9782] 0 2024-02-15T18:31:01.424 INFO:tasks.workunit.client.0.smithi033.stdout:2/180: read f0 [2564468,31363] 0 2024-02-15T18:31:01.425 INFO:tasks.workunit.client.0.smithi033.stdout:4/208: creat d4/d20/d37/f44 x:0 0 0 2024-02-15T18:31:01.425 INFO:tasks.workunit.client.0.smithi033.stdout:0/125: rmdir d0/dc/d1d 39 2024-02-15T18:31:01.426 INFO:tasks.workunit.client.0.smithi033.stdout:4/209: write d4/d20/f9 [4637172,8930] 0 2024-02-15T18:31:01.426 INFO:tasks.workunit.client.0.smithi033.stdout:0/126: read d0/f5 [2223233,12495] 0 2024-02-15T18:31:01.432 INFO:tasks.workunit.client.0.smithi033.stdout:3/158: truncate d2/d3/d1e/d22/f25 271985 0 2024-02-15T18:31:01.432 INFO:tasks.workunit.client.0.smithi033.stdout:3/159: chown d2/l1a 526 1 2024-02-15T18:31:01.434 INFO:tasks.workunit.client.0.smithi033.stdout:4/210: dread d4/d20/ff [0,4194304] 0 2024-02-15T18:31:01.434 INFO:tasks.workunit.client.0.smithi033.stdout:4/211: chown d4/d20/f26 1 1 2024-02-15T18:31:01.435 INFO:tasks.workunit.client.0.smithi033.stdout:4/212: write d4/d20/f11 [821291,65334] 0 2024-02-15T18:31:01.437 INFO:tasks.workunit.client.0.smithi033.stdout:7/156: rename d0/f30 to d0/f33 0 2024-02-15T18:31:01.439 INFO:tasks.workunit.client.0.smithi033.stdout:0/127: dwrite d0/f4 [0,4194304] 0 2024-02-15T18:31:01.439 INFO:tasks.workunit.client.0.smithi033.stdout:2/181: mknod d20/d39/c46 0 2024-02-15T18:31:01.439 INFO:tasks.workunit.client.0.smithi033.stdout:0/128: chown d0/d2 824575 1 2024-02-15T18:31:01.443 INFO:tasks.workunit.client.0.smithi033.stdout:4/213: mknod d4/d20/d13/d1b/c45 0 2024-02-15T18:31:01.445 INFO:tasks.workunit.client.0.smithi033.stdout:6/128: truncate d8/d28/d14/d1e/f27 338249 0 2024-02-15T18:31:01.446 INFO:tasks.workunit.client.0.smithi033.stdout:2/182: rmdir d20/d3a 39 2024-02-15T18:31:01.446 INFO:tasks.workunit.client.0.smithi033.stdout:2/183: fsync f19 0 2024-02-15T18:31:01.447 INFO:tasks.workunit.client.0.smithi033.stdout:0/129: mknod d0/c27 0 2024-02-15T18:31:01.447 INFO:tasks.workunit.client.0.smithi033.stdout:0/130: chown d0/l14 13 1 2024-02-15T18:31:01.447 INFO:tasks.workunit.client.0.smithi033.stdout:0/131: write d0/d2/f23 [291368,14365] 0 2024-02-15T18:31:01.449 INFO:tasks.workunit.client.0.smithi033.stdout:3/160: rename d2/d3/d1e/d22/f25 to d2/d14/f30 0 2024-02-15T18:31:01.449 INFO:tasks.workunit.client.0.smithi033.stdout:3/161: fsync d2/d3/d17/f1f 0 2024-02-15T18:31:01.449 INFO:tasks.workunit.client.0.smithi033.stdout:3/162: fsync d2/f5 0 2024-02-15T18:31:01.451 INFO:tasks.workunit.client.0.smithi033.stdout:3/163: write d2/f11 [631903,87503] 0 2024-02-15T18:31:01.451 INFO:tasks.workunit.client.0.smithi033.stdout:3/164: write d2/f5 [8450061,54129] 0 2024-02-15T18:31:01.451 INFO:tasks.workunit.client.0.smithi033.stdout:3/165: chown d2/l1a 4 1 2024-02-15T18:31:01.451 INFO:tasks.workunit.client.0.smithi033.stdout:3/166: truncate d2/d14/d23/f28 649601 0 2024-02-15T18:31:01.451 INFO:tasks.workunit.client.0.smithi033.stdout:3/167: read - d2/f27 zero size 2024-02-15T18:31:01.453 INFO:tasks.workunit.client.0.smithi033.stdout:4/214: dread d4/d5/f25 [0,4194304] 0 2024-02-15T18:31:01.456 INFO:tasks.workunit.client.0.smithi033.stdout:2/184: truncate d20/f2d 260596 0 2024-02-15T18:31:01.457 INFO:tasks.workunit.client.0.smithi033.stdout:0/132: symlink d0/dc/l28 0 2024-02-15T18:31:01.457 INFO:tasks.workunit.client.0.smithi033.stdout:0/133: readlink d0/l14 0 2024-02-15T18:31:01.458 INFO:tasks.workunit.client.0.smithi033.stdout:6/129: rename d8/f15 to d8/d28/d14/d23/f2d 0 2024-02-15T18:31:01.459 INFO:tasks.workunit.client.0.smithi033.stdout:4/215: creat d4/f46 x:0 0 0 2024-02-15T18:31:01.459 INFO:tasks.workunit.client.0.smithi033.stdout:3/168: dread d2/f11 [0,4194304] 0 2024-02-15T18:31:01.465 INFO:tasks.workunit.client.0.smithi033.stdout:4/216: creat d4/d5/d28/f47 x:0 0 0 2024-02-15T18:31:01.465 INFO:tasks.workunit.client.0.smithi033.stdout:3/169: symlink d2/d3/d17/l31 0 2024-02-15T18:31:01.466 INFO:tasks.workunit.client.0.smithi033.stdout:2/185: unlink c4 0 2024-02-15T18:31:01.467 INFO:tasks.workunit.client.0.smithi033.stdout:4/217: stat d4/d20/c8 0 2024-02-15T18:31:01.467 INFO:tasks.workunit.client.0.smithi033.stdout:4/218: stat d4/d5/d28/l43 0 2024-02-15T18:31:01.467 INFO:tasks.workunit.client.0.smithi033.stdout:3/170: mknod d2/d3/c32 0 2024-02-15T18:31:01.468 INFO:tasks.workunit.client.0.smithi033.stdout:4/219: mknod d4/d5/d28/c48 0 2024-02-15T18:31:01.469 INFO:tasks.workunit.client.0.smithi033.stdout:3/171: symlink d2/d3/d17/l33 0 2024-02-15T18:31:01.469 INFO:tasks.workunit.client.0.smithi033.stdout:3/172: chown d2/d14 4365 1 2024-02-15T18:31:01.470 INFO:tasks.workunit.client.0.smithi033.stdout:2/186: dread d20/d22/f24 [0,4194304] 0 2024-02-15T18:31:01.471 INFO:tasks.workunit.client.0.smithi033.stdout:0/134: dread d0/d8/fb [0,4194304] 0 2024-02-15T18:31:01.471 INFO:tasks.workunit.client.0.smithi033.stdout:3/173: creat d2/d3/df/f34 x:0 0 0 2024-02-15T18:31:01.472 INFO:tasks.workunit.client.0.smithi033.stdout:4/220: mknod d4/d20/c49 0 2024-02-15T18:31:01.472 INFO:tasks.workunit.client.0.smithi033.stdout:4/221: chown d4/d5/d28/f47 87274743 1 2024-02-15T18:31:01.472 INFO:tasks.workunit.client.0.smithi033.stdout:4/222: chown d4/d20/d13/d1b/l33 223 1 2024-02-15T18:31:01.473 INFO:tasks.workunit.client.0.smithi033.stdout:4/223: chown d4/f46 20793107 1 2024-02-15T18:31:01.473 INFO:tasks.workunit.client.0.smithi033.stdout:0/135: mknod d0/dc/d1d/c29 0 2024-02-15T18:31:01.474 INFO:tasks.workunit.client.0.smithi033.stdout:6/130: dwrite d8/d28/d14/f13 [0,4194304] 0 2024-02-15T18:31:01.474 INFO:tasks.workunit.client.0.smithi033.stdout:6/131: chown d8/d28 13 1 2024-02-15T18:31:01.474 INFO:tasks.workunit.client.0.smithi033.stdout:3/174: truncate d2/f26 540197 0 2024-02-15T18:31:01.474 INFO:tasks.workunit.client.0.smithi033.stdout:3/175: readlink d2/l1a 0 2024-02-15T18:31:01.475 INFO:tasks.workunit.client.0.smithi033.stdout:6/132: dread d8/d28/d14/d1e/f27 [0,4194304] 0 2024-02-15T18:31:01.476 INFO:tasks.workunit.client.0.smithi033.stdout:4/224: mknod d4/d5/d28/c4a 0 2024-02-15T18:31:01.481 INFO:tasks.workunit.client.0.smithi033.stdout:0/136: rmdir d0 39 2024-02-15T18:31:01.483 INFO:tasks.workunit.client.0.smithi033.stdout:6/133: creat d8/d28/f2e x:0 0 0 2024-02-15T18:31:01.489 INFO:tasks.workunit.client.0.smithi033.stdout:4/225: unlink d4/d20/d13/d1b/c45 0 2024-02-15T18:31:01.489 INFO:tasks.workunit.client.0.smithi033.stdout:6/134: creat d8/d28/d14/d2c/f2f x:0 0 0 2024-02-15T18:31:01.489 INFO:tasks.workunit.client.0.smithi033.stdout:4/226: chown d4/d5/l1a 8229 1 2024-02-15T18:31:01.489 INFO:tasks.workunit.client.0.smithi033.stdout:6/135: read f0 [1945532,38287] 0 2024-02-15T18:31:01.490 INFO:tasks.workunit.client.0.smithi033.stdout:6/136: dread - d8/d28/f2e zero size 2024-02-15T18:31:01.514 INFO:tasks.workunit.client.0.smithi033.stdout:0/137: dwrite d0/f10 [0,4194304] 0 2024-02-15T18:31:01.516 INFO:tasks.workunit.client.0.smithi033.stdout:0/138: symlink d0/l2a 0 2024-02-15T18:31:01.516 INFO:tasks.workunit.client.0.smithi033.stdout:4/227: dwrite d4/d20/d13/f31 [0,4194304] 0 2024-02-15T18:31:01.516 INFO:tasks.workunit.client.0.smithi033.stdout:6/137: dwrite d8/d28/f11 [0,4194304] 0 2024-02-15T18:31:01.519 INFO:tasks.workunit.client.0.smithi033.stdout:0/139: truncate d0/f4 2465808 0 2024-02-15T18:31:01.520 INFO:tasks.workunit.client.0.smithi033.stdout:4/228: link d4/f46 d4/d20/d13/d34/f4b 0 2024-02-15T18:31:01.520 INFO:tasks.workunit.client.0.smithi033.stdout:4/229: dread - d4/d5/d28/f36 zero size 2024-02-15T18:31:01.521 INFO:tasks.workunit.client.0.smithi033.stdout:6/138: unlink d8/d28/d14/cd 0 2024-02-15T18:31:01.524 INFO:tasks.workunit.client.0.smithi033.stdout:0/140: link d0/l2a d0/dc/d1d/l2b 0 2024-02-15T18:31:01.525 INFO:tasks.workunit.client.0.smithi033.stdout:4/230: creat d4/f4c x:0 0 0 2024-02-15T18:31:01.525 INFO:tasks.workunit.client.0.smithi033.stdout:4/231: truncate d4/d20/d13/f32 5006468 0 2024-02-15T18:31:01.526 INFO:tasks.workunit.client.0.smithi033.stdout:0/141: mknod d0/dc/c2c 0 2024-02-15T18:31:01.528 INFO:tasks.workunit.client.0.smithi033.stdout:6/139: rename d8/d28/d14/d23 to d8/d28/d14/d1e/d30 0 2024-02-15T18:31:01.530 INFO:tasks.workunit.client.0.smithi033.stdout:0/142: mkdir d0/d8/d15/d2d 0 2024-02-15T18:31:01.534 INFO:tasks.workunit.client.0.smithi033.stdout:4/232: dread d4/d20/d13/f31 [0,4194304] 0 2024-02-15T18:31:01.534 INFO:tasks.workunit.client.0.smithi033.stdout:4/233: write d4/f4c [785634,42183] 0 2024-02-15T18:31:01.537 INFO:tasks.workunit.client.0.smithi033.stdout:4/234: creat d4/d20/d37/f4d x:0 0 0 2024-02-15T18:31:01.539 INFO:tasks.workunit.client.0.smithi033.stdout:4/235: write d4/f21 [3887118,23888] 0 2024-02-15T18:31:01.539 INFO:tasks.workunit.client.0.smithi033.stdout:4/236: fsync d4/f46 0 2024-02-15T18:31:01.539 INFO:tasks.workunit.client.0.smithi033.stdout:4/237: chown d4/d20/f9 2425565 1 2024-02-15T18:31:01.540 INFO:tasks.workunit.client.0.smithi033.stdout:6/140: rename d8/d28/d14/d1e to d8/d28/d14/d2c/d31 0 2024-02-15T18:31:01.542 INFO:tasks.workunit.client.0.smithi033.stdout:6/141: chown d8/d28/d14/d2c/d31/l22 2672 1 2024-02-15T18:31:01.543 INFO:tasks.workunit.client.0.smithi033.stdout:6/142: write d8/d28/d14/d2c/d31/d30/f2d [2901727,50637] 0 2024-02-15T18:31:01.544 INFO:tasks.workunit.client.0.smithi033.stdout:6/143: mknod d8/d1d/c32 0 2024-02-15T18:31:01.545 INFO:tasks.workunit.client.0.smithi033.stdout:6/144: creat d8/f33 x:0 0 0 2024-02-15T18:31:01.546 INFO:tasks.workunit.client.0.smithi033.stdout:6/145: creat d8/d28/d14/f34 x:0 0 0 2024-02-15T18:31:01.546 INFO:tasks.workunit.client.0.smithi033.stdout:6/146: fdatasync d8/d28/f11 0 2024-02-15T18:31:01.546 INFO:tasks.workunit.client.0.smithi033.stdout:6/147: truncate d8/d28/d14/d2c/f2f 884743 0 2024-02-15T18:31:01.547 INFO:tasks.workunit.client.0.smithi033.stdout:6/148: chown d8/d28/d14/d2c/d31/d30/d29 437 1 2024-02-15T18:31:01.547 INFO:tasks.workunit.client.0.smithi033.stdout:6/149: creat d8/d28/f35 x:0 0 0 2024-02-15T18:31:01.547 INFO:tasks.workunit.client.0.smithi033.stdout:6/150: dread d8/d28/d14/d2c/f2f [0,4194304] 0 2024-02-15T18:31:01.548 INFO:tasks.workunit.client.0.smithi033.stdout:6/151: mkdir d8/d28/d36 0 2024-02-15T18:31:01.548 INFO:tasks.workunit.client.0.smithi033.stdout:6/152: stat d8/d28/d14/f24 0 2024-02-15T18:31:01.550 INFO:tasks.workunit.client.0.smithi033.stdout:6/153: mkdir d8/d1d/d37 0 2024-02-15T18:31:01.550 INFO:tasks.workunit.client.0.smithi033.stdout:6/154: chown d8 174195085 1 2024-02-15T18:31:01.550 INFO:tasks.workunit.client.0.smithi033.stdout:6/155: truncate d8/f1a 1331402 0 2024-02-15T18:31:01.550 INFO:tasks.workunit.client.0.smithi033.stdout:0/143: dwrite d0/d2/f23 [0,4194304] 0 2024-02-15T18:31:01.550 INFO:tasks.workunit.client.0.smithi033.stdout:0/144: chown d0/f5 485048745 1 2024-02-15T18:31:01.550 INFO:tasks.workunit.client.0.smithi033.stdout:0/145: chown d0/dc/d1d/f1f 10535 1 2024-02-15T18:31:01.552 INFO:tasks.workunit.client.0.smithi033.stdout:4/238: truncate d4/d20/d13/f32 1558634 0 2024-02-15T18:31:01.553 INFO:tasks.workunit.client.0.smithi033.stdout:6/156: mkdir d8/d28/d14/d2c/d31/d30/d29/d38 0 2024-02-15T18:31:01.554 INFO:tasks.workunit.client.0.smithi033.stdout:0/146: mkdir d0/d8/d15/d2d/d2e 0 2024-02-15T18:31:01.554 INFO:tasks.workunit.client.0.smithi033.stdout:0/147: fsync d0/d8/fb 0 2024-02-15T18:31:01.558 INFO:tasks.workunit.client.0.smithi033.stdout:4/239: truncate d4/d20/f26 248790 0 2024-02-15T18:31:01.558 INFO:tasks.workunit.client.0.smithi033.stdout:0/148: creat d0/d8/d15/f2f x:0 0 0 2024-02-15T18:31:01.559 INFO:tasks.workunit.client.0.smithi033.stdout:4/240: creat d4/d20/f4e x:0 0 0 2024-02-15T18:31:01.559 INFO:tasks.workunit.client.0.smithi033.stdout:4/241: fdatasync d4/f7 0 2024-02-15T18:31:01.559 INFO:tasks.workunit.client.0.smithi033.stdout:4/242: chown d4/d20/d13/d1b 43 1 2024-02-15T18:31:01.560 INFO:tasks.workunit.client.0.smithi033.stdout:4/243: getdents d4/d20/d37 0 2024-02-15T18:31:01.561 INFO:tasks.workunit.client.0.smithi033.stdout:4/244: symlink d4/d5/d28/l4f 0 2024-02-15T18:31:01.563 INFO:tasks.workunit.client.0.smithi033.stdout:4/245: chown d4/d5/c1d 16347137 1 2024-02-15T18:31:01.563 INFO:tasks.workunit.client.0.smithi033.stdout:4/246: fdatasync d4/f46 0 2024-02-15T18:31:01.564 INFO:tasks.workunit.client.0.smithi033.stdout:4/247: getdents d4/d20/d13 0 2024-02-15T18:31:01.564 INFO:tasks.workunit.client.0.smithi033.stdout:4/248: read d4/f22 [348512,117285] 0 2024-02-15T18:31:01.567 INFO:tasks.workunit.client.0.smithi033.stdout:0/149: dread d0/dc/d1d/f25 [0,4194304] 0 2024-02-15T18:31:01.568 INFO:tasks.workunit.client.0.smithi033.stdout:6/157: dwrite d8/f1a [0,4194304] 0 2024-02-15T18:31:01.569 INFO:tasks.workunit.client.0.smithi033.stdout:6/158: chown d8/f1a 791693 1 2024-02-15T18:31:01.573 INFO:tasks.workunit.client.0.smithi033.stdout:0/150: rename d0/dc/d1d/l2b to d0/d8/l30 0 2024-02-15T18:31:01.584 INFO:tasks.workunit.client.0.smithi033.stdout:0/151: dread d0/dc/d1d/f21 [0,4194304] 0 2024-02-15T18:31:01.584 INFO:tasks.workunit.client.0.smithi033.stdout:0/152: readlink d0/l2a 0 2024-02-15T18:31:01.589 INFO:tasks.workunit.client.0.smithi033.stdout:6/159: dwrite d8/d28/f35 [0,4194304] 0 2024-02-15T18:31:01.589 INFO:tasks.workunit.client.0.smithi033.stdout:6/160: truncate d8/d1d/f1b 426770 0 2024-02-15T18:31:01.589 INFO:tasks.workunit.client.0.smithi033.stdout:6/161: chown d8/d28/f17 7 1 2024-02-15T18:31:01.590 INFO:tasks.workunit.client.0.smithi033.stdout:4/249: dwrite d4/f15 [0,4194304] 0 2024-02-15T18:31:01.591 INFO:tasks.workunit.client.0.smithi033.stdout:4/250: read - d4/f46 zero size 2024-02-15T18:31:01.592 INFO:tasks.workunit.client.0.smithi033.stdout:6/162: unlink d8/d28/f2e 0 2024-02-15T18:31:01.593 INFO:tasks.workunit.client.0.smithi033.stdout:4/251: rmdir d4/d20/d37 39 2024-02-15T18:31:01.593 INFO:tasks.workunit.client.0.smithi033.stdout:6/163: dread d8/d28/d14/d2c/d31/f27 [0,4194304] 0 2024-02-15T18:31:01.595 INFO:tasks.workunit.client.0.smithi033.stdout:6/164: creat d8/f39 x:0 0 0 2024-02-15T18:31:01.595 INFO:tasks.workunit.client.0.smithi033.stdout:4/252: dread d4/d20/f26 [0,4194304] 0 2024-02-15T18:31:01.595 INFO:tasks.workunit.client.0.smithi033.stdout:6/165: mknod d8/d1d/d2a/c3a 0 2024-02-15T18:31:01.596 INFO:tasks.workunit.client.0.smithi033.stdout:6/166: dread d8/d28/d14/d2c/f2f [0,4194304] 0 2024-02-15T18:31:01.596 INFO:tasks.workunit.client.0.smithi033.stdout:4/253: write d4/d20/d13/f31 [4008988,75573] 0 2024-02-15T18:31:01.597 INFO:tasks.workunit.client.0.smithi033.stdout:6/167: mkdir d8/d28/d14/d2c/d3b 0 2024-02-15T18:31:01.598 INFO:tasks.workunit.client.0.smithi033.stdout:0/153: dwrite d0/d8/fb [0,4194304] 0 2024-02-15T18:31:01.598 INFO:tasks.workunit.client.0.smithi033.stdout:0/154: truncate d0/dc/d1d/f1e 1752933 0 2024-02-15T18:31:01.599 INFO:tasks.workunit.client.0.smithi033.stdout:0/155: fdatasync d0/d2/f23 0 2024-02-15T18:31:01.599 INFO:tasks.workunit.client.0.smithi033.stdout:6/168: fsync d8/d28/d14/f13 0 2024-02-15T18:31:01.602 INFO:tasks.workunit.client.0.smithi033.stdout:4/254: dread d4/d5/f24 [0,4194304] 0 2024-02-15T18:31:01.603 INFO:tasks.workunit.client.0.smithi033.stdout:0/156: link d0/dc/c1a d0/dc/c31 0 2024-02-15T18:31:01.604 INFO:tasks.workunit.client.0.smithi033.stdout:6/169: creat d8/d1d/f3c x:0 0 0 2024-02-15T18:31:01.607 INFO:tasks.workunit.client.0.smithi033.stdout:4/255: rename d4/d5/d28/c48 to d4/d20/c50 0 2024-02-15T18:31:01.607 INFO:tasks.workunit.client.0.smithi033.stdout:4/256: read - d4/f46 zero size 2024-02-15T18:31:01.608 INFO:tasks.workunit.client.0.smithi033.stdout:4/257: creat d4/d3c/f51 x:0 0 0 2024-02-15T18:31:01.609 INFO:tasks.workunit.client.0.smithi033.stdout:6/170: getdents d8/d28/d14/d2c 0 2024-02-15T18:31:01.609 INFO:tasks.workunit.client.0.smithi033.stdout:6/171: read - d8/f39 zero size 2024-02-15T18:31:01.610 INFO:tasks.workunit.client.0.smithi033.stdout:6/172: write d8/d28/f35 [3423456,106456] 0 2024-02-15T18:31:01.610 INFO:tasks.workunit.client.0.smithi033.stdout:6/173: truncate d8/d1d/f1b 914801 0 2024-02-15T18:31:01.611 INFO:tasks.workunit.client.0.smithi033.stdout:0/157: dread d0/f10 [0,4194304] 0 2024-02-15T18:31:01.612 INFO:tasks.workunit.client.0.smithi033.stdout:4/258: mknod d4/c52 0 2024-02-15T18:31:01.612 INFO:tasks.workunit.client.0.smithi033.stdout:4/259: fsync d4/d20/f3a 0 2024-02-15T18:31:01.614 INFO:tasks.workunit.client.0.smithi033.stdout:1/151: sync 2024-02-15T18:31:01.614 INFO:tasks.workunit.client.0.smithi033.stdout:9/103: sync 2024-02-15T18:31:01.614 INFO:tasks.workunit.client.0.smithi033.stdout:5/163: sync 2024-02-15T18:31:01.614 INFO:tasks.workunit.client.0.smithi033.stdout:2/187: sync 2024-02-15T18:31:01.614 INFO:tasks.workunit.client.0.smithi033.stdout:9/104: read - d4/d8/dd/f29 zero size 2024-02-15T18:31:01.614 INFO:tasks.workunit.client.0.smithi033.stdout:2/188: fsync d20/f2b 0 2024-02-15T18:31:01.614 INFO:tasks.workunit.client.0.smithi033.stdout:9/105: readlink d4/d8/l21 0 2024-02-15T18:31:01.614 INFO:tasks.workunit.client.0.smithi033.stdout:2/189: readlink d20/d31/l3f 0 2024-02-15T18:31:01.615 INFO:tasks.workunit.client.0.smithi033.stdout:7/157: sync 2024-02-15T18:31:01.615 INFO:tasks.workunit.client.0.smithi033.stdout:8/173: sync 2024-02-15T18:31:01.615 INFO:tasks.workunit.client.0.smithi033.stdout:3/176: sync 2024-02-15T18:31:01.615 INFO:tasks.workunit.client.0.smithi033.stdout:7/158: fsync d0/dc/f1a 0 2024-02-15T18:31:01.615 INFO:tasks.workunit.client.0.smithi033.stdout:3/177: dread - d2/d14/f2b zero size 2024-02-15T18:31:01.615 INFO:tasks.workunit.client.0.smithi033.stdout:7/159: write d0/f1 [9369400,99942] 0 2024-02-15T18:31:01.617 INFO:tasks.workunit.client.0.smithi033.stdout:6/174: mkdir d8/d28/d14/d2c/d3b/d3d 0 2024-02-15T18:31:01.617 INFO:tasks.workunit.client.0.smithi033.stdout:0/158: dread d0/f5 [0,4194304] 0 2024-02-15T18:31:01.619 INFO:tasks.workunit.client.0.smithi033.stdout:1/152: rename d5/f1a to d5/dd/d1c/d23/f26 0 2024-02-15T18:31:01.619 INFO:tasks.workunit.client.0.smithi033.stdout:6/175: dread d8/d1d/f1b [0,4194304] 0 2024-02-15T18:31:01.620 INFO:tasks.workunit.client.0.smithi033.stdout:5/164: symlink d1/da/d19/l28 0 2024-02-15T18:31:01.620 INFO:tasks.workunit.client.0.smithi033.stdout:5/165: read - d1/da/d19/f22 zero size 2024-02-15T18:31:01.620 INFO:tasks.workunit.client.0.smithi033.stdout:5/166: dread - d1/f27 zero size 2024-02-15T18:31:01.624 INFO:tasks.workunit.client.0.smithi033.stdout:9/106: getdents d4/d8 0 2024-02-15T18:31:01.624 INFO:tasks.workunit.client.0.smithi033.stdout:2/190: mkdir d20/d31/d47 0 2024-02-15T18:31:01.624 INFO:tasks.workunit.client.0.smithi033.stdout:3/178: getdents d2/d3 0 2024-02-15T18:31:01.624 INFO:tasks.workunit.client.0.smithi033.stdout:2/191: write d20/d31/d32/f34 [250358,118177] 0 2024-02-15T18:31:01.625 INFO:tasks.workunit.client.0.smithi033.stdout:7/160: creat d0/dc/d10/d1d/f34 x:0 0 0 2024-02-15T18:31:01.627 INFO:tasks.workunit.client.0.smithi033.stdout:8/174: rename d0/d2/d14/f34 to d0/df/f38 0 2024-02-15T18:31:01.628 INFO:tasks.workunit.client.0.smithi033.stdout:1/153: read d5/dd/d12/f1b [83298,37545] 0 2024-02-15T18:31:01.629 INFO:tasks.workunit.client.0.smithi033.stdout:2/192: creat d20/d39/f48 x:0 0 0 2024-02-15T18:31:01.630 INFO:tasks.workunit.client.0.smithi033.stdout:7/161: rename d0/c4 to d0/c35 0 2024-02-15T18:31:01.632 INFO:tasks.workunit.client.0.smithi033.stdout:5/167: rename d1/l6 to d1/da/d10/l29 0 2024-02-15T18:31:01.632 INFO:tasks.workunit.client.0.smithi033.stdout:5/168: chown d1/da/d19/l28 1589 1 2024-02-15T18:31:01.634 INFO:tasks.workunit.client.0.smithi033.stdout:1/154: truncate d5/dd/d1c/f1d 1922925 0 2024-02-15T18:31:01.634 INFO:tasks.workunit.client.0.smithi033.stdout:1/155: write d5/f19 [819582,44861] 0 2024-02-15T18:31:01.634 INFO:tasks.workunit.client.0.smithi033.stdout:3/179: dread d2/fa [0,4194304] 0 2024-02-15T18:31:01.635 INFO:tasks.workunit.client.0.smithi033.stdout:2/193: creat d20/f49 x:0 0 0 2024-02-15T18:31:01.638 INFO:tasks.workunit.client.0.smithi033.stdout:7/162: mknod d0/dc/c36 0 2024-02-15T18:31:01.639 INFO:tasks.workunit.client.0.smithi033.stdout:5/169: creat d1/f2a x:0 0 0 2024-02-15T18:31:01.639 INFO:tasks.workunit.client.0.smithi033.stdout:5/170: chown d1/l1a 3 1 2024-02-15T18:31:01.640 INFO:tasks.workunit.client.0.smithi033.stdout:4/260: dwrite d4/f7 [0,4194304] 0 2024-02-15T18:31:01.641 INFO:tasks.workunit.client.0.smithi033.stdout:9/107: dread d4/d8/ff [0,4194304] 0 2024-02-15T18:31:01.641 INFO:tasks.workunit.client.0.smithi033.stdout:1/156: mkdir d5/d17/d27 0 2024-02-15T18:31:01.641 INFO:tasks.workunit.client.0.smithi033.stdout:1/157: chown d5/d9/l11 4501319 1 2024-02-15T18:31:01.641 INFO:tasks.workunit.client.0.smithi033.stdout:1/158: write d5/dd/d1c/f21 [626786,120533] 0 2024-02-15T18:31:01.641 INFO:tasks.workunit.client.0.smithi033.stdout:3/180: getdents d2/d20 0 2024-02-15T18:31:01.641 INFO:tasks.workunit.client.0.smithi033.stdout:2/194: mkdir d20/d3a/d4a 0 2024-02-15T18:31:01.642 INFO:tasks.workunit.client.0.smithi033.stdout:5/171: rmdir d1/da/d11 39 2024-02-15T18:31:01.642 INFO:tasks.workunit.client.0.smithi033.stdout:5/172: readlink d1/da/d10/l21 0 2024-02-15T18:31:01.644 INFO:tasks.workunit.client.0.smithi033.stdout:9/108: rename d4/d8/dd/f14 to d4/d8/dd/d28/f2b 0 2024-02-15T18:31:01.645 INFO:tasks.workunit.client.0.smithi033.stdout:1/159: unlink d5/dd/fe 0 2024-02-15T18:31:01.646 INFO:tasks.workunit.client.0.smithi033.stdout:4/261: write d4/d20/f27 [3726845,122335] 0 2024-02-15T18:31:01.647 INFO:tasks.workunit.client.0.smithi033.stdout:3/181: unlink d2/d3/d17/l33 0 2024-02-15T18:31:01.647 INFO:tasks.workunit.client.0.smithi033.stdout:3/182: write d2/f27 [599424,54190] 0 2024-02-15T18:31:01.649 INFO:tasks.workunit.client.0.smithi033.stdout:9/109: mkdir d4/d2c 0 2024-02-15T18:31:01.651 INFO:tasks.workunit.client.0.smithi033.stdout:1/160: truncate d5/dd/d12/f1f 449326 0 2024-02-15T18:31:01.655 INFO:tasks.workunit.client.0.smithi033.stdout:0/159: dwrite d0/f10 [4194304,4194304] 0 2024-02-15T18:31:01.655 INFO:tasks.workunit.client.0.smithi033.stdout:4/262: getdents d4/d5/d28 0 2024-02-15T18:31:01.655 INFO:tasks.workunit.client.0.smithi033.stdout:3/183: symlink d2/d14/l35 0 2024-02-15T18:31:01.656 INFO:tasks.workunit.client.0.smithi033.stdout:1/161: truncate d5/d9/f14 1087863 0 2024-02-15T18:31:01.656 INFO:tasks.workunit.client.0.smithi033.stdout:6/176: dwrite d8/f39 [0,4194304] 0 2024-02-15T18:31:01.657 INFO:tasks.workunit.client.0.smithi033.stdout:0/160: mkdir d0/dc/d32 0 2024-02-15T18:31:01.658 INFO:tasks.workunit.client.0.smithi033.stdout:8/175: dwrite d0/fe [4194304,4194304] 0 2024-02-15T18:31:01.658 INFO:tasks.workunit.client.0.smithi033.stdout:7/163: dread d0/dc/d10/f13 [0,4194304] 0 2024-02-15T18:31:01.658 INFO:tasks.workunit.client.0.smithi033.stdout:3/184: write d2/f5 [3181803,20060] 0 2024-02-15T18:31:01.662 INFO:tasks.workunit.client.0.smithi033.stdout:2/195: rmdir d20/d39 39 2024-02-15T18:31:01.662 INFO:tasks.workunit.client.0.smithi033.stdout:0/161: dread d0/d2/f3 [0,4194304] 0 2024-02-15T18:31:01.663 INFO:tasks.workunit.client.0.smithi033.stdout:5/173: dwrite d1/f14 [0,4194304] 0 2024-02-15T18:31:01.663 INFO:tasks.workunit.client.0.smithi033.stdout:5/174: fsync d1/da/f1b 0 2024-02-15T18:31:01.663 INFO:tasks.workunit.client.0.smithi033.stdout:4/263: rmdir d4/d20/d13/d34 39 2024-02-15T18:31:01.671 INFO:tasks.workunit.client.0.smithi033.stdout:1/162: dread d5/d9/f14 [0,4194304] 0 2024-02-15T18:31:01.672 INFO:tasks.workunit.client.0.smithi033.stdout:6/177: rmdir d8/d28/d14/d2c/d31/d30/d29 39 2024-02-15T18:31:01.672 INFO:tasks.workunit.client.0.smithi033.stdout:6/178: chown d8 1324326 1 2024-02-15T18:31:01.672 INFO:tasks.workunit.client.0.smithi033.stdout:6/179: fdatasync d8/f1a 0 2024-02-15T18:31:01.673 INFO:tasks.workunit.client.0.smithi033.stdout:7/164: symlink d0/dc/l37 0 2024-02-15T18:31:01.674 INFO:tasks.workunit.client.0.smithi033.stdout:8/176: creat d0/d2/f39 x:0 0 0 2024-02-15T18:31:01.676 INFO:tasks.workunit.client.0.smithi033.stdout:3/185: mknod d2/c36 0 2024-02-15T18:31:01.680 INFO:tasks.workunit.client.0.smithi033.stdout:2/196: rename d20/f2d to d20/f4b 0 2024-02-15T18:31:01.682 INFO:tasks.workunit.client.0.smithi033.stdout:2/197: dread f1 [12582912,4194304] 0 2024-02-15T18:31:01.686 INFO:tasks.workunit.client.0.smithi033.stdout:5/175: mkdir d1/da/d10/d2b 0 2024-02-15T18:31:01.686 INFO:tasks.workunit.client.0.smithi033.stdout:5/176: dread - d1/da/f24 zero size 2024-02-15T18:31:01.688 INFO:tasks.workunit.client.0.smithi033.stdout:4/264: rmdir d4 39 2024-02-15T18:31:01.693 INFO:tasks.workunit.client.0.smithi033.stdout:1/163: dread d5/dd/d12/f1b [0,4194304] 0 2024-02-15T18:31:01.694 INFO:tasks.workunit.client.0.smithi033.stdout:6/180: creat d8/d28/d14/d2c/d31/d30/f3e x:0 0 0 2024-02-15T18:31:01.696 INFO:tasks.workunit.client.0.smithi033.stdout:7/165: mkdir d0/dc/d10/d1d/d38 0 2024-02-15T18:31:01.697 INFO:tasks.workunit.client.0.smithi033.stdout:8/177: creat d0/f3a x:0 0 0 2024-02-15T18:31:01.699 INFO:tasks.workunit.client.0.smithi033.stdout:3/186: rename d2/f12 to d2/d14/f37 0 2024-02-15T18:31:01.701 INFO:tasks.workunit.client.0.smithi033.stdout:0/162: mknod d0/d8/c33 0 2024-02-15T18:31:01.701 INFO:tasks.workunit.client.0.smithi033.stdout:0/163: readlink d0/d8/l30 0 2024-02-15T18:31:01.701 INFO:tasks.workunit.client.0.smithi033.stdout:0/164: readlink d0/d8/l1b 0 2024-02-15T18:31:01.701 INFO:tasks.workunit.client.0.smithi033.stdout:0/165: readlink d0/d8/d15/l22 0 2024-02-15T18:31:01.701 INFO:tasks.workunit.client.0.smithi033.stdout:3/187: write d2/d3/d17/f1f [443131,124464] 0 2024-02-15T18:31:01.701 INFO:tasks.workunit.client.0.smithi033.stdout:3/188: fdatasync d2/f11 0 2024-02-15T18:31:01.701 INFO:tasks.workunit.client.0.smithi033.stdout:3/189: truncate d2/d14/f30 940970 0 2024-02-15T18:31:01.702 INFO:tasks.workunit.client.0.smithi033.stdout:5/177: creat d1/da/f2c x:0 0 0 2024-02-15T18:31:01.702 INFO:tasks.workunit.client.0.smithi033.stdout:5/178: write d1/da/f1b [1325800,5436] 0 2024-02-15T18:31:01.702 INFO:tasks.workunit.client.0.smithi033.stdout:5/179: readlink d1/da/d19/l25 0 2024-02-15T18:31:01.702 INFO:tasks.workunit.client.0.smithi033.stdout:1/164: mknod d5/dd/d12/c28 0 2024-02-15T18:31:01.702 INFO:tasks.workunit.client.0.smithi033.stdout:5/180: read d1/da/d10/f1d [250382,92713] 0 2024-02-15T18:31:01.704 INFO:tasks.workunit.client.0.smithi033.stdout:7/166: link d0/dc/f31 d0/f39 0 2024-02-15T18:31:01.704 INFO:tasks.workunit.client.0.smithi033.stdout:1/165: dread d5/d9/f14 [0,4194304] 0 2024-02-15T18:31:01.706 INFO:tasks.workunit.client.0.smithi033.stdout:2/198: rename d20/d31/d32 to d20/d31/d47/d4c 0 2024-02-15T18:31:01.706 INFO:tasks.workunit.client.0.smithi033.stdout:6/181: rename d8/d28/d14/d2c/d31 to d8/d28/d14/d2c/d31/d30/d3f 22 2024-02-15T18:31:01.706 INFO:tasks.workunit.client.0.smithi033.stdout:6/182: getdents d8/d28/d14/d2c 0 2024-02-15T18:31:01.707 INFO:tasks.workunit.client.0.smithi033.stdout:6/183: stat d8/d28/f17 0 2024-02-15T18:31:01.707 INFO:tasks.workunit.client.0.smithi033.stdout:1/166: dread d5/dd/f10 [4194304,4194304] 0 2024-02-15T18:31:01.707 INFO:tasks.workunit.client.0.smithi033.stdout:0/166: creat d0/d2/f34 x:0 0 0 2024-02-15T18:31:01.708 INFO:tasks.workunit.client.0.smithi033.stdout:5/181: creat d1/da/d11/f2d x:0 0 0 2024-02-15T18:31:01.709 INFO:tasks.workunit.client.0.smithi033.stdout:7/167: mkdir d0/dc/d10/d1d/d38/d3a 0 2024-02-15T18:31:01.710 INFO:tasks.workunit.client.0.smithi033.stdout:4/265: dwrite d4/d20/d37/f42 [0,4194304] 0 2024-02-15T18:31:01.710 INFO:tasks.workunit.client.0.smithi033.stdout:4/266: read d4/d20/f27 [3399216,1701] 0 2024-02-15T18:31:01.711 INFO:tasks.workunit.client.0.smithi033.stdout:4/267: truncate d4/d20/f4e 527058 0 2024-02-15T18:31:01.715 INFO:tasks.workunit.client.0.smithi033.stdout:3/190: rename d2/d14/l35 to d2/d14/d23/l38 0 2024-02-15T18:31:01.715 INFO:tasks.workunit.client.0.smithi033.stdout:3/191: chown d2/fa 929524 1 2024-02-15T18:31:01.715 INFO:tasks.workunit.client.0.smithi033.stdout:6/184: mknod d8/d1d/c40 0 2024-02-15T18:31:01.716 INFO:tasks.workunit.client.0.smithi033.stdout:1/167: creat d5/d17/f29 x:0 0 0 2024-02-15T18:31:01.717 INFO:tasks.workunit.client.0.smithi033.stdout:7/168: symlink d0/dc/l3b 0 2024-02-15T18:31:01.719 INFO:tasks.workunit.client.0.smithi033.stdout:4/268: dread d4/f7 [0,4194304] 0 2024-02-15T18:31:01.721 INFO:tasks.workunit.client.0.smithi033.stdout:3/192: link d2/f11 d2/d3/f39 0 2024-02-15T18:31:01.722 INFO:tasks.workunit.client.0.smithi033.stdout:1/168: mknod d5/dd/d1c/c2a 0 2024-02-15T18:31:01.724 INFO:tasks.workunit.client.0.smithi033.stdout:7/169: symlink d0/dc/l3c 0 2024-02-15T18:31:01.725 INFO:tasks.workunit.client.0.smithi033.stdout:6/185: dread d8/d28/f35 [0,4194304] 0 2024-02-15T18:31:01.726 INFO:tasks.workunit.client.0.smithi033.stdout:1/169: creat d5/dd/d1c/f2b x:0 0 0 2024-02-15T18:31:01.729 INFO:tasks.workunit.client.0.smithi033.stdout:7/170: mknod d0/dc/d10/d1d/d38/c3d 0 2024-02-15T18:31:01.729 INFO:tasks.workunit.client.0.smithi033.stdout:7/171: truncate d0/dc/f31 805990 0 2024-02-15T18:31:01.732 INFO:tasks.workunit.client.0.smithi033.stdout:4/269: mkdir d4/d20/d53 0 2024-02-15T18:31:01.732 INFO:tasks.workunit.client.0.smithi033.stdout:5/182: getdents d1/da/d11 0 2024-02-15T18:31:01.734 INFO:tasks.workunit.client.0.smithi033.stdout:6/186: creat d8/d28/d36/f41 x:0 0 0 2024-02-15T18:31:01.734 INFO:tasks.workunit.client.0.smithi033.stdout:6/187: stat d8/d28 0 2024-02-15T18:31:01.734 INFO:tasks.workunit.client.0.smithi033.stdout:6/188: write f0 [4677673,108834] 0 2024-02-15T18:31:01.734 INFO:tasks.workunit.client.0.smithi033.stdout:1/170: mkdir d5/d9/d1e/d20/d2c 0 2024-02-15T18:31:01.734 INFO:tasks.workunit.client.0.smithi033.stdout:1/171: stat d5/lc 0 2024-02-15T18:31:01.734 INFO:tasks.workunit.client.0.smithi033.stdout:1/172: readlink d5/d17/l22 0 2024-02-15T18:31:01.734 INFO:tasks.workunit.client.0.smithi033.stdout:1/173: getdents d5/d9/d1e/d20/d2c 0 2024-02-15T18:31:01.735 INFO:tasks.workunit.client.0.smithi033.stdout:7/172: getdents d0/dc/d10/d1d/d2b 0 2024-02-15T18:31:01.735 INFO:tasks.workunit.client.0.smithi033.stdout:4/270: creat d4/f54 x:0 0 0 2024-02-15T18:31:01.735 INFO:tasks.workunit.client.0.smithi033.stdout:4/271: readlink d4/l23 0 2024-02-15T18:31:01.736 INFO:tasks.workunit.client.0.smithi033.stdout:5/183: getdents d1/da 0 2024-02-15T18:31:01.737 INFO:tasks.workunit.client.0.smithi033.stdout:5/184: chown d1/da/d10/f1d 997981002 1 2024-02-15T18:31:01.737 INFO:tasks.workunit.client.0.smithi033.stdout:5/185: fdatasync d1/da/d19/f22 0 2024-02-15T18:31:01.737 INFO:tasks.workunit.client.0.smithi033.stdout:6/189: mknod d8/d28/d14/d2c/d31/d30/d29/d38/c42 0 2024-02-15T18:31:01.739 INFO:tasks.workunit.client.0.smithi033.stdout:7/173: link d0/dc/c15 d0/dc/d10/d1d/c3e 0 2024-02-15T18:31:01.739 INFO:tasks.workunit.client.0.smithi033.stdout:7/174: chown d0/l1e 58 1 2024-02-15T18:31:01.739 INFO:tasks.workunit.client.0.smithi033.stdout:7/175: chown d0/dc/d10/f2c 209570 1 2024-02-15T18:31:01.739 INFO:tasks.workunit.client.0.smithi033.stdout:7/176: getdents d0/dc/d10/d1d/d2b 0 2024-02-15T18:31:01.739 INFO:tasks.workunit.client.0.smithi033.stdout:4/272: creat d4/d5/f55 x:0 0 0 2024-02-15T18:31:01.739 INFO:tasks.workunit.client.0.smithi033.stdout:4/273: write d4/d5/d28/f47 [1018279,21659] 0 2024-02-15T18:31:01.740 INFO:tasks.workunit.client.0.smithi033.stdout:5/186: mkdir d1/da/d11/d2e 0 2024-02-15T18:31:01.740 INFO:tasks.workunit.client.0.smithi033.stdout:5/187: fdatasync d1/f5 0 2024-02-15T18:31:01.741 INFO:tasks.workunit.client.0.smithi033.stdout:7/177: truncate d0/dc/d10/f13 792013 0 2024-02-15T18:31:01.742 INFO:tasks.workunit.client.0.smithi033.stdout:4/274: mknod d4/d20/d13/c56 0 2024-02-15T18:31:01.742 INFO:tasks.workunit.client.0.smithi033.stdout:4/275: readlink d4/d5/l1a 0 2024-02-15T18:31:01.742 INFO:tasks.workunit.client.0.smithi033.stdout:4/276: fsync d4/d5/d28/f36 0 2024-02-15T18:31:01.742 INFO:tasks.workunit.client.0.smithi033.stdout:1/174: dread d5/dd/d1c/f1d [0,4194304] 0 2024-02-15T18:31:01.742 INFO:tasks.workunit.client.0.smithi033.stdout:5/188: symlink d1/da/l2f 0 2024-02-15T18:31:01.743 INFO:tasks.workunit.client.0.smithi033.stdout:7/178: creat d0/dc/d10/d1d/d38/d3a/f3f x:0 0 0 2024-02-15T18:31:01.744 INFO:tasks.workunit.client.0.smithi033.stdout:4/277: symlink d4/l57 0 2024-02-15T18:31:01.745 INFO:tasks.workunit.client.0.smithi033.stdout:1/175: symlink d5/dd/d12/l2d 0 2024-02-15T18:31:01.745 INFO:tasks.workunit.client.0.smithi033.stdout:5/189: rmdir d1/da/d11 39 2024-02-15T18:31:01.745 INFO:tasks.workunit.client.0.smithi033.stdout:5/190: truncate d1/da/d10/f26 419656 0 2024-02-15T18:31:01.746 INFO:tasks.workunit.client.0.smithi033.stdout:2/199: dwrite d20/f43 [0,4194304] 0 2024-02-15T18:31:01.746 INFO:tasks.workunit.client.0.smithi033.stdout:2/200: truncate d20/d31/f37 718093 0 2024-02-15T18:31:01.746 INFO:tasks.workunit.client.0.smithi033.stdout:1/176: write d5/dd/f10 [608079,7942] 0 2024-02-15T18:31:01.747 INFO:tasks.workunit.client.0.smithi033.stdout:0/167: dwrite d0/dc/d1d/f1e [0,4194304] 0 2024-02-15T18:31:01.747 INFO:tasks.workunit.client.0.smithi033.stdout:0/168: write d0/d8/d15/f2f [579243,20461] 0 2024-02-15T18:31:01.747 INFO:tasks.workunit.client.0.smithi033.stdout:0/169: chown d0/d2/f23 985 1 2024-02-15T18:31:01.748 INFO:tasks.workunit.client.0.smithi033.stdout:3/193: dwrite d2/f1d [0,4194304] 0 2024-02-15T18:31:01.748 INFO:tasks.workunit.client.0.smithi033.stdout:3/194: fsync d2/d3/df/f34 0 2024-02-15T18:31:01.749 INFO:tasks.workunit.client.0.smithi033.stdout:1/177: fsync d5/dd/f10 0 2024-02-15T18:31:01.751 INFO:tasks.workunit.client.0.smithi033.stdout:7/179: link d0/dc/c36 d0/c40 0 2024-02-15T18:31:01.751 INFO:tasks.workunit.client.0.smithi033.stdout:5/191: dread d1/da/f12 [0,4194304] 0 2024-02-15T18:31:01.752 INFO:tasks.workunit.client.0.smithi033.stdout:5/192: readlink d1/da/d10/l29 0 2024-02-15T18:31:01.756 INFO:tasks.workunit.client.0.smithi033.stdout:2/201: mknod d20/d30/c4d 0 2024-02-15T18:31:01.758 INFO:tasks.workunit.client.0.smithi033.stdout:6/190: dread f0 [0,4194304] 0 2024-02-15T18:31:01.758 INFO:tasks.workunit.client.0.smithi033.stdout:0/170: creat d0/d8/f35 x:0 0 0 2024-02-15T18:31:01.758 INFO:tasks.workunit.client.0.smithi033.stdout:4/278: dwrite d4/d5/f55 [0,4194304] 0 2024-02-15T18:31:01.761 INFO:tasks.workunit.client.0.smithi033.stdout:3/195: symlink d2/d14/d23/l3a 0 2024-02-15T18:31:01.761 INFO:tasks.workunit.client.0.smithi033.stdout:3/196: fsync d2/d14/f30 0 2024-02-15T18:31:01.764 INFO:tasks.workunit.client.0.smithi033.stdout:0/171: write d0/d2/f3 [3236132,76964] 0 2024-02-15T18:31:01.764 INFO:tasks.workunit.client.0.smithi033.stdout:5/193: rename d1/da/f13 to d1/da/d11/f30 0 2024-02-15T18:31:01.765 INFO:tasks.workunit.client.0.smithi033.stdout:2/202: mknod d20/d31/d47/c4e 0 2024-02-15T18:31:01.771 INFO:tasks.workunit.client.0.smithi033.stdout:6/191: unlink d8/d28/d14/d2c/d31/l22 0 2024-02-15T18:31:01.773 INFO:tasks.workunit.client.0.smithi033.stdout:1/178: dwrite d5/dd/d1c/d23/f26 [0,4194304] 0 2024-02-15T18:31:01.773 INFO:tasks.workunit.client.0.smithi033.stdout:4/279: creat d4/d20/d13/f58 x:0 0 0 2024-02-15T18:31:01.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:30:59.523227+0000 mgr.smithi131.buibla (mgr.24387) 19 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 325 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 22 MiB/s wr, 791 op/s 2024-02-15T18:31:01.782 INFO:tasks.workunit.client.0.smithi033.stdout:3/197: unlink d2/c36 0 2024-02-15T18:31:01.782 INFO:tasks.workunit.client.0.smithi033.stdout:3/198: chown d2/d14/d23/l3a 0 1 2024-02-15T18:31:01.782 INFO:tasks.workunit.client.0.smithi033.stdout:0/172: symlink d0/dc/d1d/l36 0 2024-02-15T18:31:01.782 INFO:tasks.workunit.client.0.smithi033.stdout:3/199: chown d2/d20/c2a 274623701 1 2024-02-15T18:31:01.782 INFO:tasks.workunit.client.0.smithi033.stdout:3/200: readlink d2/l1a 0 2024-02-15T18:31:01.782 INFO:tasks.workunit.client.0.smithi033.stdout:5/194: creat d1/da/d11/d2e/f31 x:0 0 0 2024-02-15T18:31:01.782 INFO:tasks.workunit.client.0.smithi033.stdout:5/195: dread - d1/f27 zero size 2024-02-15T18:31:01.783 INFO:tasks.workunit.client.0.smithi033.stdout:2/203: creat d20/d30/f4f x:0 0 0 2024-02-15T18:31:01.784 INFO:tasks.workunit.client.0.smithi033.stdout:6/192: creat d8/d28/d14/f43 x:0 0 0 2024-02-15T18:31:01.785 INFO:tasks.workunit.client.0.smithi033.stdout:6/193: chown d8/d28/f35 1194 1 2024-02-15T18:31:01.789 INFO:tasks.workunit.client.0.smithi033.stdout:3/201: rename d2/d14/f30 to d2/f3b 0 2024-02-15T18:31:01.792 INFO:tasks.workunit.client.0.smithi033.stdout:0/173: dread d0/d2/f7 [0,4194304] 0 2024-02-15T18:31:01.792 INFO:tasks.workunit.client.0.smithi033.stdout:0/174: chown d0/dc/d1d/f21 2155956 1 2024-02-15T18:31:01.795 INFO:tasks.workunit.client.0.smithi033.stdout:2/204: unlink f0 0 2024-02-15T18:31:01.797 INFO:tasks.workunit.client.0.smithi033.stdout:1/179: dwrite d5/d9/f14 [0,4194304] 0 2024-02-15T18:31:01.797 INFO:tasks.workunit.client.0.smithi033.stdout:6/194: symlink d8/d28/d14/d2c/d3b/d3d/l44 0 2024-02-15T18:31:01.797 INFO:tasks.workunit.client.0.smithi033.stdout:6/195: write d8/d1d/f3c [279042,101509] 0 2024-02-15T18:31:01.797 INFO:tasks.workunit.client.0.smithi033.stdout:6/196: chown d8/d28/d14 0 1 2024-02-15T18:31:01.797 INFO:tasks.workunit.client.0.smithi033.stdout:4/280: dwrite d4/d20/f9 [0,4194304] 0 2024-02-15T18:31:01.797 INFO:tasks.workunit.client.0.smithi033.stdout:1/180: read d5/dd/d1c/f1d [1844542,55281] 0 2024-02-15T18:31:01.797 INFO:tasks.workunit.client.0.smithi033.stdout:1/181: chown d5/f19 2594478 1 2024-02-15T18:31:01.797 INFO:tasks.workunit.client.0.smithi033.stdout:3/202: symlink d2/d3/l3c 0 2024-02-15T18:31:01.797 INFO:tasks.workunit.client.0.smithi033.stdout:3/203: write d2/f4 [587125,43069] 0 2024-02-15T18:31:01.801 INFO:tasks.workunit.client.0.smithi033.stdout:5/196: mknod d1/c32 0 2024-02-15T18:31:01.802 INFO:tasks.workunit.client.0.smithi033.stdout:2/205: unlink d20/l42 0 2024-02-15T18:31:01.802 INFO:tasks.workunit.client.0.smithi033.stdout:6/197: symlink d8/d28/d14/d2c/d31/d30/d29/d38/l45 0 2024-02-15T18:31:01.804 INFO:tasks.workunit.client.0.smithi033.stdout:4/281: unlink d4/f4c 0 2024-02-15T18:31:01.804 INFO:tasks.workunit.client.0.smithi033.stdout:1/182: creat d5/dd/f2e x:0 0 0 2024-02-15T18:31:01.805 INFO:tasks.workunit.client.0.smithi033.stdout:1/183: write d5/dd/d1c/f2b [533151,42119] 0 2024-02-15T18:31:01.805 INFO:tasks.workunit.client.0.smithi033.stdout:3/204: creat d2/d14/d23/f3d x:0 0 0 2024-02-15T18:31:01.806 INFO:tasks.workunit.client.0.smithi033.stdout:5/197: truncate d1/da/d11/f17 2680802 0 2024-02-15T18:31:01.807 INFO:tasks.workunit.client.0.smithi033.stdout:1/184: dread d5/f19 [0,4194304] 0 2024-02-15T18:31:01.807 INFO:tasks.workunit.client.0.smithi033.stdout:1/185: write d5/f19 [1694392,102980] 0 2024-02-15T18:31:01.808 INFO:tasks.workunit.client.0.smithi033.stdout:0/175: rename d0/d8/d15/f2f to d0/d8/f37 0 2024-02-15T18:31:01.808 INFO:tasks.workunit.client.0.smithi033.stdout:0/176: readlink d0/l14 0 2024-02-15T18:31:01.808 INFO:tasks.workunit.client.0.smithi033.stdout:0/177: write d0/d2/f23 [320716,117967] 0 2024-02-15T18:31:01.809 INFO:tasks.workunit.client.0.smithi033.stdout:2/206: symlink d20/l50 0 2024-02-15T18:31:01.809 INFO:tasks.workunit.client.0.smithi033.stdout:2/207: stat d20/d31/d47/d4c 0 2024-02-15T18:31:01.809 INFO:tasks.workunit.client.0.smithi033.stdout:2/208: read d20/d22/f41 [1367369,110501] 0 2024-02-15T18:31:01.811 INFO:tasks.workunit.client.0.smithi033.stdout:2/209: dread f19 [0,4194304] 0 2024-02-15T18:31:01.811 INFO:tasks.workunit.client.0.smithi033.stdout:2/210: fdatasync f1b 0 2024-02-15T18:31:01.811 INFO:tasks.workunit.client.0.smithi033.stdout:2/211: write d20/d22/f3e [875935,3021] 0 2024-02-15T18:31:01.811 INFO:tasks.workunit.client.0.smithi033.stdout:2/212: fdatasync f5 0 2024-02-15T18:31:01.813 INFO:tasks.workunit.client.0.smithi033.stdout:3/205: creat d2/d14/d23/f3e x:0 0 0 2024-02-15T18:31:01.814 INFO:tasks.workunit.client.0.smithi033.stdout:3/206: write d2/f27 [414159,126161] 0 2024-02-15T18:31:01.814 INFO:tasks.workunit.client.0.smithi033.stdout:5/198: mkdir d1/da/d10/d2b/d33 0 2024-02-15T18:31:01.814 INFO:tasks.workunit.client.0.smithi033.stdout:5/199: dread - d1/da/d11/f2d zero size 2024-02-15T18:31:01.817 INFO:tasks.workunit.client.0.smithi033.stdout:1/186: dread d5/dd/d12/f1b [0,4194304] 0 2024-02-15T18:31:01.817 INFO:tasks.workunit.client.0.smithi033.stdout:1/187: chown d5/dd/d12/f1b 23149 1 2024-02-15T18:31:01.819 INFO:tasks.workunit.client.0.smithi033.stdout:6/198: rename d8/f33 to d8/d28/f46 0 2024-02-15T18:31:01.821 INFO:tasks.workunit.client.0.smithi033.stdout:0/178: creat d0/d8/f38 x:0 0 0 2024-02-15T18:31:01.821 INFO:tasks.workunit.client.0.smithi033.stdout:0/179: chown d0/d2/f23 0 1 2024-02-15T18:31:01.821 INFO:tasks.workunit.client.0.smithi033.stdout:0/180: truncate d0/d8/f38 74194 0 2024-02-15T18:31:01.821 INFO:tasks.workunit.client.0.smithi033.stdout:0/181: dread - d0/d8/f24 zero size 2024-02-15T18:31:01.821 INFO:tasks.workunit.client.0.smithi033.stdout:3/207: truncate d2/d14/f37 175241 0 2024-02-15T18:31:01.821 INFO:tasks.workunit.client.0.smithi033.stdout:3/208: read - d2/d14/f2b zero size 2024-02-15T18:31:01.822 INFO:tasks.workunit.client.0.smithi033.stdout:3/209: truncate d2/d14/d23/f3d 326232 0 2024-02-15T18:31:01.822 INFO:tasks.workunit.client.0.smithi033.stdout:3/210: chown d2/d14/f2b 106 1 2024-02-15T18:31:01.824 INFO:tasks.workunit.client.0.smithi033.stdout:5/200: creat d1/da/d19/f34 x:0 0 0 2024-02-15T18:31:01.825 INFO:tasks.workunit.client.0.smithi033.stdout:5/201: fsync d1/da/fb 0 2024-02-15T18:31:01.825 INFO:tasks.workunit.client.0.smithi033.stdout:5/202: read d1/da/d10/f1d [155,2257] 0 2024-02-15T18:31:01.826 INFO:tasks.workunit.client.0.smithi033.stdout:5/203: write d1/f7 [1197795,35448] 0 2024-02-15T18:31:01.829 INFO:tasks.workunit.client.0.smithi033.stdout:2/213: rename d20/d31/d47/d4c/f34 to d20/d31/f51 0 2024-02-15T18:31:01.831 INFO:tasks.workunit.client.0.smithi033.stdout:1/188: dread d5/d9/f14 [0,4194304] 0 2024-02-15T18:31:01.832 INFO:tasks.workunit.client.0.smithi033.stdout:6/199: unlink d8/fb 0 2024-02-15T18:31:01.832 INFO:tasks.workunit.client.0.smithi033.stdout:1/189: chown d5/dd/d1c/f1d 740 1 2024-02-15T18:31:01.837 INFO:tasks.workunit.client.0.smithi033.stdout:2/214: dread d20/d22/f24 [0,4194304] 0 2024-02-15T18:31:01.839 INFO:tasks.workunit.client.0.smithi033.stdout:2/215: rmdir d20/d30 39 2024-02-15T18:31:01.841 INFO:tasks.workunit.client.0.smithi033.stdout:2/216: unlink d20/c2a 0 2024-02-15T18:31:01.846 INFO:tasks.workunit.client.0.smithi033.stdout:0/182: dwrite d0/f10 [4194304,4194304] 0 2024-02-15T18:31:01.846 INFO:tasks.workunit.client.0.smithi033.stdout:0/183: chown d0/c27 7 1 2024-02-15T18:31:01.847 INFO:tasks.workunit.client.0.smithi033.stdout:0/184: stat d0/c27 0 2024-02-15T18:31:01.847 INFO:tasks.workunit.client.0.smithi033.stdout:0/185: creat d0/d8/f39 x:0 0 0 2024-02-15T18:31:01.848 INFO:tasks.workunit.client.0.smithi033.stdout:0/186: write d0/f5 [2778853,116169] 0 2024-02-15T18:31:01.853 INFO:tasks.workunit.client.0.smithi033.stdout:2/217: dread f1 [0,4194304] 0 2024-02-15T18:31:01.854 INFO:tasks.workunit.client.0.smithi033.stdout:6/200: dwrite d8/f1a [0,4194304] 0 2024-02-15T18:31:01.857 INFO:tasks.workunit.client.0.smithi033.stdout:2/218: creat d20/d3a/d4a/f52 x:0 0 0 2024-02-15T18:31:01.858 INFO:tasks.workunit.client.0.smithi033.stdout:6/201: write d8/d28/f17 [3055601,26442] 0 2024-02-15T18:31:01.858 INFO:tasks.workunit.client.0.smithi033.stdout:6/202: rename d8 to d8/d28/d14/d2c/d3b/d47 22 2024-02-15T18:31:01.859 INFO:tasks.workunit.client.0.smithi033.stdout:6/203: fdatasync d8/d28/d14/f34 0 2024-02-15T18:31:01.859 INFO:tasks.workunit.client.0.smithi033.stdout:2/219: symlink d20/d31/d47/l53 0 2024-02-15T18:31:01.859 INFO:tasks.workunit.client.0.smithi033.stdout:1/190: dwrite d5/dd/d1c/f1d [0,4194304] 0 2024-02-15T18:31:01.860 INFO:tasks.workunit.client.0.smithi033.stdout:6/204: link d8/d28/f35 d8/d28/d14/d2c/d3b/d3d/f48 0 2024-02-15T18:31:01.861 INFO:tasks.workunit.client.0.smithi033.stdout:2/220: unlink d20/c2f 0 2024-02-15T18:31:01.862 INFO:tasks.workunit.client.0.smithi033.stdout:6/205: dread d8/d28/d14/d2c/f2f [0,4194304] 0 2024-02-15T18:31:01.862 INFO:tasks.workunit.client.0.smithi033.stdout:6/206: chown d8 800768 1 2024-02-15T18:31:01.864 INFO:tasks.workunit.client.0.smithi033.stdout:6/207: creat d8/d28/d14/d2c/d3b/f49 x:0 0 0 2024-02-15T18:31:01.873 INFO:tasks.workunit.client.0.smithi033.stdout:1/191: dread d5/dd/d1c/f1d [0,4194304] 0 2024-02-15T18:31:01.876 INFO:tasks.workunit.client.0.smithi033.stdout:1/192: dread d5/dd/d1c/f21 [0,4194304] 0 2024-02-15T18:31:01.877 INFO:tasks.workunit.client.0.smithi033.stdout:1/193: symlink d5/d9/d1e/d20/l2f 0 2024-02-15T18:31:01.879 INFO:tasks.workunit.client.0.smithi033.stdout:1/194: mknod d5/dd/d12/c30 0 2024-02-15T18:31:01.879 INFO:tasks.workunit.client.0.smithi033.stdout:2/221: dread f1 [8388608,4194304] 0 2024-02-15T18:31:01.881 INFO:tasks.workunit.client.0.smithi033.stdout:2/222: dread d20/f4b [0,4194304] 0 2024-02-15T18:31:01.881 INFO:tasks.workunit.client.0.smithi033.stdout:2/223: chown d20/d31/f51 2102 1 2024-02-15T18:31:01.881 INFO:tasks.workunit.client.0.smithi033.stdout:2/224: chown d20/d39 2031339 1 2024-02-15T18:31:01.882 INFO:tasks.workunit.client.0.smithi033.stdout:2/225: link d20/l50 d20/d31/d47/l54 0 2024-02-15T18:31:01.882 INFO:tasks.workunit.client.0.smithi033.stdout:2/226: chown d20/d31/l3f 0 1 2024-02-15T18:31:01.883 INFO:tasks.workunit.client.0.smithi033.stdout:6/208: dwrite d8/d28/d14/f13 [0,4194304] 0 2024-02-15T18:31:01.883 INFO:tasks.workunit.client.0.smithi033.stdout:0/187: dwrite d0/d2/f23 [0,4194304] 0 2024-02-15T18:31:01.884 INFO:tasks.workunit.client.0.smithi033.stdout:0/188: truncate d0/dc/d1d/f1f 4508009 0 2024-02-15T18:31:01.884 INFO:tasks.workunit.client.0.smithi033.stdout:2/227: symlink d20/l55 0 2024-02-15T18:31:01.884 INFO:tasks.workunit.client.0.smithi033.stdout:2/228: chown d20/d22 201 1 2024-02-15T18:31:01.891 INFO:tasks.workunit.client.0.smithi033.stdout:0/189: creat d0/d8/d15/f3a x:0 0 0 2024-02-15T18:31:01.892 INFO:tasks.workunit.client.0.smithi033.stdout:6/209: dread d8/f39 [0,4194304] 0 2024-02-15T18:31:01.894 INFO:tasks.workunit.client.0.smithi033.stdout:1/195: dwrite d5/d17/f29 [0,4194304] 0 2024-02-15T18:31:01.895 INFO:tasks.workunit.client.0.smithi033.stdout:2/229: rename d20/f29 to d20/d31/d47/d4c/f56 0 2024-02-15T18:31:01.895 INFO:tasks.workunit.client.0.smithi033.stdout:2/230: chown d20/f43 0 1 2024-02-15T18:31:01.896 INFO:tasks.workunit.client.0.smithi033.stdout:0/190: unlink d0/d8/f24 0 2024-02-15T18:31:01.901 INFO:tasks.workunit.client.0.smithi033.stdout:6/210: creat d8/d28/d36/f4a x:0 0 0 2024-02-15T18:31:01.904 INFO:tasks.workunit.client.0.smithi033.stdout:2/231: rename f1b to d20/d3a/f57 0 2024-02-15T18:31:01.905 INFO:tasks.workunit.client.0.smithi033.stdout:0/191: mkdir d0/dc/d3b 0 2024-02-15T18:31:01.906 INFO:tasks.workunit.client.0.smithi033.stdout:6/211: creat d8/d28/d14/d2c/f4b x:0 0 0 2024-02-15T18:31:01.906 INFO:tasks.workunit.client.0.smithi033.stdout:9/110: sync 2024-02-15T18:31:01.906 INFO:tasks.workunit.client.0.smithi033.stdout:0/192: creat d0/d2/f3c x:0 0 0 2024-02-15T18:31:01.907 INFO:tasks.workunit.client.0.smithi033.stdout:6/212: symlink d8/d1d/l4c 0 2024-02-15T18:31:01.907 INFO:tasks.workunit.client.0.smithi033.stdout:9/111: symlink d4/l2d 0 2024-02-15T18:31:01.908 INFO:tasks.workunit.client.0.smithi033.stdout:9/112: chown d4/d8 0 1 2024-02-15T18:31:01.908 INFO:tasks.workunit.client.0.smithi033.stdout:9/113: write d4/d8/d1b/f1e [33267,25516] 0 2024-02-15T18:31:01.908 INFO:tasks.workunit.client.0.smithi033.stdout:2/232: dread d20/d22/f23 [0,4194304] 0 2024-02-15T18:31:01.909 INFO:tasks.workunit.client.0.smithi033.stdout:6/213: dread d8/d28/f18 [0,4194304] 0 2024-02-15T18:31:01.909 INFO:tasks.workunit.client.0.smithi033.stdout:6/214: fsync d8/d28/d36/f41 0 2024-02-15T18:31:01.909 INFO:tasks.workunit.client.0.smithi033.stdout:1/196: dwrite d5/dd/d12/f1b [0,4194304] 0 2024-02-15T18:31:01.909 INFO:tasks.workunit.client.0.smithi033.stdout:0/193: symlink d0/d8/d15/l3d 0 2024-02-15T18:31:01.909 INFO:tasks.workunit.client.0.smithi033.stdout:0/194: write d0/dc/d1d/f1f [4989948,119614] 0 2024-02-15T18:31:01.911 INFO:tasks.workunit.client.0.smithi033.stdout:9/114: creat d4/d8/dd/f2e x:0 0 0 2024-02-15T18:31:01.911 INFO:tasks.workunit.client.0.smithi033.stdout:1/197: write d5/dd/d1c/d23/f26 [945175,15069] 0 2024-02-15T18:31:01.911 INFO:tasks.workunit.client.0.smithi033.stdout:6/215: symlink d8/d28/d36/l4d 0 2024-02-15T18:31:01.912 INFO:tasks.workunit.client.0.smithi033.stdout:1/198: read d5/dd/d1c/f21 [36436,57876] 0 2024-02-15T18:31:01.914 INFO:tasks.workunit.client.0.smithi033.stdout:0/195: rmdir d0/dc/d32 0 2024-02-15T18:31:01.919 INFO:tasks.workunit.client.0.smithi033.stdout:9/115: mkdir d4/d8/d1b/d2f 0 2024-02-15T18:31:01.919 INFO:tasks.workunit.client.0.smithi033.stdout:6/216: creat d8/f4e x:0 0 0 2024-02-15T18:31:01.921 INFO:tasks.workunit.client.0.smithi033.stdout:9/116: rename d4/d8/dd/f24 to d4/d8/d1b/d2f/f30 0 2024-02-15T18:31:01.923 INFO:tasks.workunit.client.0.smithi033.stdout:1/199: dread d5/dd/f10 [0,4194304] 0 2024-02-15T18:31:01.923 INFO:tasks.workunit.client.0.smithi033.stdout:1/200: chown d5/dd/d12/l18 3150 1 2024-02-15T18:31:01.923 INFO:tasks.workunit.client.0.smithi033.stdout:1/201: chown d5/dd 0 1 2024-02-15T18:31:01.924 INFO:tasks.workunit.client.0.smithi033.stdout:6/217: mkdir d8/d1d/d37/d4f 0 2024-02-15T18:31:01.925 INFO:tasks.workunit.client.0.smithi033.stdout:2/233: dwrite d20/d39/f48 [0,4194304] 0 2024-02-15T18:31:01.925 INFO:tasks.workunit.client.0.smithi033.stdout:2/234: write d20/d22/f24 [330320,99072] 0 2024-02-15T18:31:01.925 INFO:tasks.workunit.client.0.smithi033.stdout:2/235: chown d20/c2c 1 1 2024-02-15T18:31:01.925 INFO:tasks.workunit.client.0.smithi033.stdout:9/117: mknod d4/d2c/c31 0 2024-02-15T18:31:01.926 INFO:tasks.workunit.client.0.smithi033.stdout:1/202: creat d5/d17/f31 x:0 0 0 2024-02-15T18:31:01.927 INFO:tasks.workunit.client.0.smithi033.stdout:6/218: creat d8/d28/d36/f50 x:0 0 0 2024-02-15T18:31:01.929 INFO:tasks.workunit.client.0.smithi033.stdout:9/118: mkdir d4/d32 0 2024-02-15T18:31:01.929 INFO:tasks.workunit.client.0.smithi033.stdout:9/119: write d4/d8/f1d [1465636,87089] 0 2024-02-15T18:31:01.930 INFO:tasks.workunit.client.0.smithi033.stdout:6/219: dread d8/d1d/f1b [0,4194304] 0 2024-02-15T18:31:01.932 INFO:tasks.workunit.client.0.smithi033.stdout:1/203: unlink d5/dd/d12/f1f 0 2024-02-15T18:31:01.938 INFO:tasks.workunit.client.0.smithi033.stdout:6/220: mknod d8/d28/d36/c51 0 2024-02-15T18:31:01.939 INFO:tasks.workunit.client.0.smithi033.stdout:1/204: creat d5/d9/f32 x:0 0 0 2024-02-15T18:31:01.940 INFO:tasks.workunit.client.0.smithi033.stdout:1/205: truncate d5/f8 1250016 0 2024-02-15T18:31:01.941 INFO:tasks.workunit.client.0.smithi033.stdout:1/206: write d5/dd/d1c/f1d [1399464,51846] 0 2024-02-15T18:31:01.942 INFO:tasks.workunit.client.0.smithi033.stdout:6/221: write d8/d28/d14/f13 [3380129,52648] 0 2024-02-15T18:31:01.949 INFO:tasks.workunit.client.0.smithi033.stdout:9/120: dwrite d4/d8/dd/f27 [0,4194304] 0 2024-02-15T18:31:01.949 INFO:tasks.workunit.client.0.smithi033.stdout:2/236: dwrite d20/f4b [0,4194304] 0 2024-02-15T18:31:01.956 INFO:tasks.workunit.client.0.smithi033.stdout:2/237: symlink d20/d30/l58 0 2024-02-15T18:31:01.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/238: mknod d20/d39/c59 0 2024-02-15T18:31:01.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/239: truncate d20/f3c 160949 0 2024-02-15T18:31:01.959 INFO:tasks.workunit.client.0.smithi033.stdout:4/282: sync 2024-02-15T18:31:01.959 INFO:tasks.workunit.client.0.smithi033.stdout:8/178: sync 2024-02-15T18:31:01.959 INFO:tasks.workunit.client.0.smithi033.stdout:7/180: sync 2024-02-15T18:31:01.959 INFO:tasks.workunit.client.0.smithi033.stdout:8/179: write d0/df/db/f23 [164219,67761] 0 2024-02-15T18:31:01.960 INFO:tasks.workunit.client.0.smithi033.stdout:7/181: creat d0/dc/f41 x:0 0 0 2024-02-15T18:31:01.960 INFO:tasks.workunit.client.0.smithi033.stdout:2/240: write d20/d22/f2e [2834850,94671] 0 2024-02-15T18:31:01.960 INFO:tasks.workunit.client.0.smithi033.stdout:2/241: chown d20/f21 20001 1 2024-02-15T18:31:01.961 INFO:tasks.workunit.client.0.smithi033.stdout:4/283: symlink d4/d20/d37/l59 0 2024-02-15T18:31:01.962 INFO:tasks.workunit.client.0.smithi033.stdout:7/182: unlink d0/dc/c36 0 2024-02-15T18:31:01.964 INFO:tasks.workunit.client.0.smithi033.stdout:4/284: creat d4/d20/d13/d34/f5a x:0 0 0 2024-02-15T18:31:01.979 INFO:tasks.workunit.client.0.smithi033.stdout:4/285: dread d4/d5/f55 [0,4194304] 0 2024-02-15T18:31:01.980 INFO:tasks.workunit.client.0.smithi033.stdout:4/286: rmdir d4/d5/d28 39 2024-02-15T18:31:01.980 INFO:tasks.workunit.client.0.smithi033.stdout:4/287: write d4/d20/f11 [2971667,43474] 0 2024-02-15T18:31:01.983 INFO:tasks.workunit.client.0.smithi033.stdout:4/288: write d4/d5/f25 [2408260,89437] 0 2024-02-15T18:31:01.983 INFO:tasks.workunit.client.0.smithi033.stdout:4/289: chown d4/d20/f26 15929783 1 2024-02-15T18:31:01.984 INFO:tasks.workunit.client.0.smithi033.stdout:2/242: dwrite f19 [0,4194304] 0 2024-02-15T18:31:01.984 INFO:tasks.workunit.client.0.smithi033.stdout:7/183: dwrite d0/fa [0,4194304] 0 2024-02-15T18:31:01.984 INFO:tasks.workunit.client.0.smithi033.stdout:4/290: mkdir d4/d20/d13/d5b 0 2024-02-15T18:31:01.987 INFO:tasks.workunit.client.0.smithi033.stdout:7/184: mknod d0/c42 0 2024-02-15T18:31:01.988 INFO:tasks.workunit.client.0.smithi033.stdout:7/185: creat d0/dc/d10/d1d/d38/f43 x:0 0 0 2024-02-15T18:31:01.988 INFO:tasks.workunit.client.0.smithi033.stdout:7/186: write d0/dc/d10/d1d/d38/f43 [187199,129525] 0 2024-02-15T18:31:01.988 INFO:tasks.workunit.client.0.smithi033.stdout:7/187: truncate d0/dc/d10/d1d/d38/d3a/f3f 293628 0 2024-02-15T18:31:01.993 INFO:tasks.workunit.client.0.smithi033.stdout:7/188: dread d0/dc/d10/d1d/d38/d3a/f3f [0,4194304] 0 2024-02-15T18:31:01.996 INFO:tasks.workunit.client.0.smithi033.stdout:7/189: fsync d0/dc/d10/d1d/d38/f43 0 2024-02-15T18:31:01.997 INFO:tasks.workunit.client.0.smithi033.stdout:7/190: readlink d0/l1e 0 2024-02-15T18:31:01.997 INFO:tasks.workunit.client.0.smithi033.stdout:7/191: truncate d0/dc/d10/f17 6576028 0 2024-02-15T18:31:01.998 INFO:tasks.workunit.client.0.smithi033.stdout:7/192: write d0/dc/f29 [474286,60161] 0 2024-02-15T18:31:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:30:59.523227+0000 mgr.smithi131.buibla (mgr.24387) 19 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 325 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 22 MiB/s wr, 791 op/s 2024-02-15T18:31:01.999 INFO:tasks.workunit.client.0.smithi033.stdout:7/193: chown d0/f33 31713009 1 2024-02-15T18:31:02.003 INFO:tasks.workunit.client.0.smithi033.stdout:7/194: rename d0/dc/d10/f17 to d0/dc/d10/d1d/d38/d3a/f44 0 2024-02-15T18:31:02.003 INFO:tasks.workunit.client.0.smithi033.stdout:7/195: chown d0/fa 809 1 2024-02-15T18:31:02.004 INFO:tasks.workunit.client.0.smithi033.stdout:7/196: mknod d0/dc/d10/d1d/d2b/c45 0 2024-02-15T18:31:02.006 INFO:tasks.workunit.client.0.smithi033.stdout:7/197: rename d0/dc/d10/d1d/c2f to d0/dc/d10/d1d/d38/c46 0 2024-02-15T18:31:02.006 INFO:tasks.workunit.client.0.smithi033.stdout:7/198: dread - d0/f33 zero size 2024-02-15T18:31:02.008 INFO:tasks.workunit.client.0.smithi033.stdout:7/199: rename d0/dc/c15 to d0/dc/d10/d1d/d38/d3a/c47 0 2024-02-15T18:31:02.008 INFO:tasks.workunit.client.0.smithi033.stdout:7/200: chown d0/dc/d10/f2c 40054065 1 2024-02-15T18:31:02.030 INFO:tasks.workunit.client.0.smithi033.stdout:7/201: dwrite d0/f1f [0,4194304] 0 2024-02-15T18:31:02.030 INFO:tasks.workunit.client.0.smithi033.stdout:7/202: chown d0/l1e 86 1 2024-02-15T18:31:02.030 INFO:tasks.workunit.client.0.smithi033.stdout:7/203: readlink d0/dc/l12 0 2024-02-15T18:31:02.034 INFO:tasks.workunit.client.0.smithi033.stdout:7/204: mkdir d0/dc/d10/d48 0 2024-02-15T18:31:02.037 INFO:tasks.workunit.client.0.smithi033.stdout:5/204: sync 2024-02-15T18:31:02.037 INFO:tasks.workunit.client.0.smithi033.stdout:3/211: sync 2024-02-15T18:31:02.037 INFO:tasks.workunit.client.0.smithi033.stdout:3/212: fdatasync d2/f5 0 2024-02-15T18:31:02.038 INFO:tasks.workunit.client.0.smithi033.stdout:5/205: mknod d1/da/d10/c35 0 2024-02-15T18:31:02.039 INFO:tasks.workunit.client.0.smithi033.stdout:3/213: mkdir d2/d14/d3f 0 2024-02-15T18:31:02.039 INFO:tasks.workunit.client.0.smithi033.stdout:3/214: chown d2/d3/l3c 30 1 2024-02-15T18:31:02.039 INFO:tasks.workunit.client.0.smithi033.stdout:3/215: write d2/d3/f39 [2867087,127233] 0 2024-02-15T18:31:02.040 INFO:tasks.workunit.client.0.smithi033.stdout:5/206: creat d1/da/d10/d2b/d33/f36 x:0 0 0 2024-02-15T18:31:02.041 INFO:tasks.workunit.client.0.smithi033.stdout:3/216: mknod d2/d14/c40 0 2024-02-15T18:31:02.041 INFO:tasks.workunit.client.0.smithi033.stdout:3/217: dread - d2/d3/df/f34 zero size 2024-02-15T18:31:02.042 INFO:tasks.workunit.client.0.smithi033.stdout:3/218: creat d2/d20/f41 x:0 0 0 2024-02-15T18:31:02.042 INFO:tasks.workunit.client.0.smithi033.stdout:3/219: truncate d2/f1b 465804 0 2024-02-15T18:31:02.042 INFO:tasks.workunit.client.0.smithi033.stdout:3/220: fsync d2/d14/f2b 0 2024-02-15T18:31:02.044 INFO:tasks.workunit.client.0.smithi033.stdout:3/221: dread d2/f27 [0,4194304] 0 2024-02-15T18:31:02.045 INFO:tasks.workunit.client.0.smithi033.stdout:7/205: dread d0/dc/f2a [0,4194304] 0 2024-02-15T18:31:02.045 INFO:tasks.workunit.client.0.smithi033.stdout:3/222: unlink d2/f3b 0 2024-02-15T18:31:02.046 INFO:tasks.workunit.client.0.smithi033.stdout:7/206: mknod d0/dc/d10/d48/c49 0 2024-02-15T18:31:02.047 INFO:tasks.workunit.client.0.smithi033.stdout:3/223: getdents d2/d3/df 0 2024-02-15T18:31:02.048 INFO:tasks.workunit.client.0.smithi033.stdout:7/207: write d0/dc/f1a [3733736,6421] 0 2024-02-15T18:31:02.048 INFO:tasks.workunit.client.0.smithi033.stdout:3/224: rmdir d2/d14/d23 39 2024-02-15T18:31:02.050 INFO:tasks.workunit.client.0.smithi033.stdout:7/208: creat d0/dc/d10/d1d/d2b/f4a x:0 0 0 2024-02-15T18:31:02.050 INFO:tasks.workunit.client.0.smithi033.stdout:3/225: write d2/d3/d17/f1f [2216318,91701] 0 2024-02-15T18:31:02.054 INFO:tasks.workunit.client.0.smithi033.stdout:7/209: mkdir d0/dc/d10/d48/d4b 0 2024-02-15T18:31:02.055 INFO:tasks.workunit.client.0.smithi033.stdout:7/210: chown d0/dc/d10/d1d/d38 1566825 1 2024-02-15T18:31:02.055 INFO:tasks.workunit.client.0.smithi033.stdout:7/211: readlink d0/dc/d10/d1d/l24 0 2024-02-15T18:31:02.055 INFO:tasks.workunit.client.0.smithi033.stdout:7/212: write d0/f1c [7297527,60172] 0 2024-02-15T18:31:02.056 INFO:tasks.workunit.client.0.smithi033.stdout:7/213: dread d0/dc/d10/d1d/d38/d3a/f3f [0,4194304] 0 2024-02-15T18:31:02.057 INFO:tasks.workunit.client.0.smithi033.stdout:7/214: unlink d0/dc/c19 0 2024-02-15T18:31:02.058 INFO:tasks.workunit.client.0.smithi033.stdout:7/215: mknod d0/dc/d10/d1d/c4c 0 2024-02-15T18:31:02.059 INFO:tasks.workunit.client.0.smithi033.stdout:7/216: unlink d0/dc/d10/d1d/d38/c46 0 2024-02-15T18:31:02.060 INFO:tasks.workunit.client.0.smithi033.stdout:7/217: read d0/dc/f2a [2161765,93837] 0 2024-02-15T18:31:02.061 INFO:tasks.workunit.client.0.smithi033.stdout:7/218: write d0/f1b [152532,72128] 0 2024-02-15T18:31:02.063 INFO:tasks.workunit.client.0.smithi033.stdout:5/207: dwrite d1/da/f2c [0,4194304] 0 2024-02-15T18:31:02.065 INFO:tasks.workunit.client.0.smithi033.stdout:5/208: creat d1/da/f37 x:0 0 0 2024-02-15T18:31:02.085 INFO:tasks.workunit.client.0.smithi033.stdout:7/219: dwrite d0/dc/d10/d1d/f25 [0,4194304] 0 2024-02-15T18:31:02.087 INFO:tasks.workunit.client.0.smithi033.stdout:5/209: dwrite d1/f5 [0,4194304] 0 2024-02-15T18:31:02.087 INFO:tasks.workunit.client.0.smithi033.stdout:5/210: write d1/f14 [4333894,94397] 0 2024-02-15T18:31:02.094 INFO:tasks.workunit.client.0.smithi033.stdout:5/211: dread d1/f4 [0,4194304] 0 2024-02-15T18:31:02.102 INFO:tasks.workunit.client.0.smithi033.stdout:5/212: dread d1/da/f2c [0,4194304] 0 2024-02-15T18:31:02.103 INFO:tasks.workunit.client.0.smithi033.stdout:5/213: mknod d1/da/d11/d2e/c38 0 2024-02-15T18:31:02.103 INFO:tasks.workunit.client.0.smithi033.stdout:5/214: fsync d1/f4 0 2024-02-15T18:31:02.103 INFO:tasks.workunit.client.0.smithi033.stdout:5/215: write d1/da/f2c [4409578,30108] 0 2024-02-15T18:31:02.103 INFO:tasks.workunit.client.0.smithi033.stdout:5/216: chown d1/da/d11/f17 0 1 2024-02-15T18:31:02.104 INFO:tasks.workunit.client.0.smithi033.stdout:5/217: mknod d1/c39 0 2024-02-15T18:31:02.104 INFO:tasks.workunit.client.0.smithi033.stdout:5/218: dread d1/da/f12 [0,4194304] 0 2024-02-15T18:31:02.104 INFO:tasks.workunit.client.0.smithi033.stdout:5/219: read d1/da/d10/f1d [136129,74343] 0 2024-02-15T18:31:02.106 INFO:tasks.workunit.client.0.smithi033.stdout:5/220: rename d1/da/d11/f17 to d1/da/d19/f3a 0 2024-02-15T18:31:02.107 INFO:tasks.workunit.client.0.smithi033.stdout:5/221: rename d1/da/d19/l25 to d1/da/d19/l3b 0 2024-02-15T18:31:02.107 INFO:tasks.workunit.client.0.smithi033.stdout:5/222: write d1/f7 [3891130,123344] 0 2024-02-15T18:31:02.108 INFO:tasks.workunit.client.0.smithi033.stdout:5/223: mkdir d1/da/d19/d3c 0 2024-02-15T18:31:02.108 INFO:tasks.workunit.client.0.smithi033.stdout:5/224: fdatasync d1/da/d11/d2e/f31 0 2024-02-15T18:31:02.108 INFO:tasks.workunit.client.0.smithi033.stdout:7/220: dwrite d0/f1f [0,4194304] 0 2024-02-15T18:31:02.108 INFO:tasks.workunit.client.0.smithi033.stdout:5/225: dread d1/da/f12 [0,4194304] 0 2024-02-15T18:31:02.109 INFO:tasks.workunit.client.0.smithi033.stdout:7/221: mknod d0/dc/d10/d1d/c4d 0 2024-02-15T18:31:02.110 INFO:tasks.workunit.client.0.smithi033.stdout:7/222: read d0/dc/f2a [1478207,89184] 0 2024-02-15T18:31:02.110 INFO:tasks.workunit.client.0.smithi033.stdout:7/223: chown d0/dc/d10/d1d/d2b/l2e 208687479 1 2024-02-15T18:31:02.110 INFO:tasks.workunit.client.0.smithi033.stdout:5/226: creat d1/da/d10/d2b/f3d x:0 0 0 2024-02-15T18:31:02.112 INFO:tasks.workunit.client.0.smithi033.stdout:7/224: getdents d0/dc/d10/d1d/d38/d3a 0 2024-02-15T18:31:02.130 INFO:tasks.workunit.client.0.smithi033.stdout:7/225: dwrite d0/dc/d10/d1d/f25 [0,4194304] 0 2024-02-15T18:31:02.132 INFO:tasks.workunit.client.0.smithi033.stdout:7/226: stat d0/dc/d10/d1d/c3e 0 2024-02-15T18:31:02.158 INFO:tasks.workunit.client.0.smithi033.stdout:0/196: sync 2024-02-15T18:31:02.158 INFO:tasks.workunit.client.0.smithi033.stdout:1/207: sync 2024-02-15T18:31:02.158 INFO:tasks.workunit.client.0.smithi033.stdout:1/208: chown d5/d17/l22 135741 1 2024-02-15T18:31:02.158 INFO:tasks.workunit.client.0.smithi033.stdout:1/209: symlink d5/l33 0 2024-02-15T18:31:02.175 INFO:tasks.workunit.client.0.smithi033.stdout:1/210: dwrite d5/d9/f14 [0,4194304] 0 2024-02-15T18:31:02.175 INFO:tasks.workunit.client.0.smithi033.stdout:1/211: stat d5/d9/l11 0 2024-02-15T18:31:02.175 INFO:tasks.workunit.client.0.smithi033.stdout:1/212: stat d5/d9/c13 0 2024-02-15T18:31:02.176 INFO:tasks.workunit.client.0.smithi033.stdout:1/213: rename d5/dd/d24 to d5/d9/d1e/d20/d2c/d34 0 2024-02-15T18:31:02.177 INFO:tasks.workunit.client.0.smithi033.stdout:1/214: link d5/dd/f10 d5/d17/f35 0 2024-02-15T18:31:02.181 INFO:tasks.workunit.client.0.smithi033.stdout:1/215: dread d5/f8 [0,4194304] 0 2024-02-15T18:31:02.181 INFO:tasks.workunit.client.0.smithi033.stdout:1/216: chown d5/dd/d1c 305770020 1 2024-02-15T18:31:02.182 INFO:tasks.workunit.client.0.smithi033.stdout:1/217: symlink d5/d9/d1e/d20/d2c/l36 0 2024-02-15T18:31:02.183 INFO:tasks.workunit.client.0.smithi033.stdout:1/218: fdatasync d5/d9/ff 0 2024-02-15T18:31:02.183 INFO:tasks.workunit.client.0.smithi033.stdout:1/219: write d5/d9/ff [2163995,99611] 0 2024-02-15T18:31:02.185 INFO:tasks.workunit.client.0.smithi033.stdout:1/220: unlink d5/c7 0 2024-02-15T18:31:02.185 INFO:tasks.workunit.client.0.smithi033.stdout:1/221: write d5/dd/f2e [271968,24870] 0 2024-02-15T18:31:02.185 INFO:tasks.workunit.client.0.smithi033.stdout:1/222: write d5/dd/d1c/f2b [1520297,112729] 0 2024-02-15T18:31:02.185 INFO:tasks.workunit.client.0.smithi033.stdout:1/223: chown d5/d9/ff 1201541029 1 2024-02-15T18:31:02.185 INFO:tasks.workunit.client.0.smithi033.stdout:1/224: rename d5/d9 to d5/d9/d1e/d20/d37 22 2024-02-15T18:31:02.185 INFO:tasks.workunit.client.0.smithi033.stdout:1/225: readlink d5/lc 0 2024-02-15T18:31:02.185 INFO:tasks.workunit.client.0.smithi033.stdout:1/226: truncate d5/dd/d1c/f21 712060 0 2024-02-15T18:31:02.186 INFO:tasks.workunit.client.0.smithi033.stdout:1/227: mkdir d5/d38 0 2024-02-15T18:31:02.186 INFO:tasks.workunit.client.0.smithi033.stdout:1/228: chown d5/dd/d1c/f1d 60265267 1 2024-02-15T18:31:02.187 INFO:tasks.workunit.client.0.smithi033.stdout:1/229: creat d5/d17/d27/f39 x:0 0 0 2024-02-15T18:31:02.189 INFO:tasks.workunit.client.0.smithi033.stdout:1/230: creat d5/dd/d1c/f3a x:0 0 0 2024-02-15T18:31:02.190 INFO:tasks.workunit.client.0.smithi033.stdout:1/231: write d5/dd/d1c/d23/f26 [1548515,109137] 0 2024-02-15T18:31:02.197 INFO:tasks.workunit.client.0.smithi033.stdout:1/232: dread d5/d9/ff [0,4194304] 0 2024-02-15T18:31:02.198 INFO:tasks.workunit.client.0.smithi033.stdout:1/233: creat d5/dd/f3b x:0 0 0 2024-02-15T18:31:02.199 INFO:tasks.workunit.client.0.smithi033.stdout:1/234: creat d5/d9/d1e/d20/d2c/f3c x:0 0 0 2024-02-15T18:31:02.201 INFO:tasks.workunit.client.0.smithi033.stdout:1/235: unlink d5/d17/l22 0 2024-02-15T18:31:02.202 INFO:tasks.workunit.client.0.smithi033.stdout:1/236: write d5/dd/d12/f1b [991540,56335] 0 2024-02-15T18:31:02.202 INFO:tasks.workunit.client.0.smithi033.stdout:1/237: write d5/dd/d1c/f2b [1186609,40544] 0 2024-02-15T18:31:02.226 INFO:tasks.workunit.client.0.smithi033.stdout:1/238: dwrite d5/d17/f31 [0,4194304] 0 2024-02-15T18:31:02.226 INFO:tasks.workunit.client.0.smithi033.stdout:1/239: chown d5/d9/d1e/d20 6281671 1 2024-02-15T18:31:02.227 INFO:tasks.workunit.client.0.smithi033.stdout:1/240: write d5/d17/f29 [1331973,4682] 0 2024-02-15T18:31:02.238 INFO:tasks.workunit.client.0.smithi033.stdout:1/241: dread d5/dd/d1c/d23/f26 [0,4194304] 0 2024-02-15T18:31:02.242 INFO:tasks.workunit.client.0.smithi033.stdout:3/226: sync 2024-02-15T18:31:02.242 INFO:tasks.workunit.client.0.smithi033.stdout:5/227: sync 2024-02-15T18:31:02.242 INFO:tasks.workunit.client.0.smithi033.stdout:6/222: sync 2024-02-15T18:31:02.242 INFO:tasks.workunit.client.0.smithi033.stdout:0/197: sync 2024-02-15T18:31:02.243 INFO:tasks.workunit.client.0.smithi033.stdout:4/291: sync 2024-02-15T18:31:02.243 INFO:tasks.workunit.client.0.smithi033.stdout:9/121: sync 2024-02-15T18:31:02.243 INFO:tasks.workunit.client.0.smithi033.stdout:8/180: sync 2024-02-15T18:31:02.243 INFO:tasks.workunit.client.0.smithi033.stdout:9/122: readlink d4/d8/dd/l16 0 2024-02-15T18:31:02.243 INFO:tasks.workunit.client.0.smithi033.stdout:2/243: sync 2024-02-15T18:31:02.243 INFO:tasks.workunit.client.0.smithi033.stdout:4/292: readlink d4/d5/d28/l2e 0 2024-02-15T18:31:02.243 INFO:tasks.workunit.client.0.smithi033.stdout:2/244: chown d20/d31 122658 1 2024-02-15T18:31:02.243 INFO:tasks.workunit.client.0.smithi033.stdout:7/227: sync 2024-02-15T18:31:02.243 INFO:tasks.workunit.client.0.smithi033.stdout:7/228: readlink d0/dc/l20 0 2024-02-15T18:31:02.244 INFO:tasks.workunit.client.0.smithi033.stdout:0/198: write d0/dc/d1d/f21 [1501558,1806] 0 2024-02-15T18:31:02.248 INFO:tasks.workunit.client.0.smithi033.stdout:6/223: symlink d8/d28/d14/d2c/d31/d30/d29/l52 0 2024-02-15T18:31:02.248 INFO:tasks.workunit.client.0.smithi033.stdout:9/123: symlink d4/d2c/l33 0 2024-02-15T18:31:02.248 INFO:tasks.workunit.client.0.smithi033.stdout:6/224: readlink d8/d28/d36/l4d 0 2024-02-15T18:31:02.248 INFO:tasks.workunit.client.0.smithi033.stdout:2/245: creat d20/d39/f5a x:0 0 0 2024-02-15T18:31:02.248 INFO:tasks.workunit.client.0.smithi033.stdout:4/293: mkdir d4/d20/d13/d5c 0 2024-02-15T18:31:02.249 INFO:tasks.workunit.client.0.smithi033.stdout:7/229: stat d0/f32 0 2024-02-15T18:31:02.249 INFO:tasks.workunit.client.0.smithi033.stdout:7/230: fdatasync d0/dc/f1a 0 2024-02-15T18:31:02.249 INFO:tasks.workunit.client.0.smithi033.stdout:6/225: write d8/d28/d14/f13 [2509412,75069] 0 2024-02-15T18:31:02.249 INFO:tasks.workunit.client.0.smithi033.stdout:6/226: chown d8/d28/f35 4 1 2024-02-15T18:31:02.250 INFO:tasks.workunit.client.0.smithi033.stdout:9/124: unlink d4/d8/f1d 0 2024-02-15T18:31:02.252 INFO:tasks.workunit.client.0.smithi033.stdout:2/246: symlink d20/d39/l5b 0 2024-02-15T18:31:02.253 INFO:tasks.workunit.client.0.smithi033.stdout:2/247: chown d20/f3c 1 1 2024-02-15T18:31:02.253 INFO:tasks.workunit.client.0.smithi033.stdout:6/227: symlink d8/d28/d14/d2c/d3b/l53 0 2024-02-15T18:31:02.253 INFO:tasks.workunit.client.0.smithi033.stdout:6/228: chown d8/f4e 4381873 1 2024-02-15T18:31:02.253 INFO:tasks.workunit.client.0.smithi033.stdout:6/229: write d8/d28/f46 [491356,57608] 0 2024-02-15T18:31:02.254 INFO:tasks.workunit.client.0.smithi033.stdout:6/230: mkdir d8/d28/d14/d2c/d31/d30/d29/d38/d54 0 2024-02-15T18:31:02.265 INFO:tasks.workunit.client.0.smithi033.stdout:9/125: dread d4/d8/dd/f15 [0,4194304] 0 2024-02-15T18:31:02.266 INFO:tasks.workunit.client.0.smithi033.stdout:2/248: dread d20/f2b [0,4194304] 0 2024-02-15T18:31:02.267 INFO:tasks.workunit.client.0.smithi033.stdout:9/126: symlink d4/d8/dd/d28/l34 0 2024-02-15T18:31:02.267 INFO:tasks.workunit.client.0.smithi033.stdout:2/249: mknod d20/d3a/d4a/c5c 0 2024-02-15T18:31:02.267 INFO:tasks.workunit.client.0.smithi033.stdout:2/250: chown c1d 1908047 1 2024-02-15T18:31:02.268 INFO:tasks.workunit.client.0.smithi033.stdout:2/251: rmdir d20/d31/d47/d4c 39 2024-02-15T18:31:02.271 INFO:tasks.workunit.client.0.smithi033.stdout:2/252: creat d20/d3a/f5d x:0 0 0 2024-02-15T18:31:02.271 INFO:tasks.workunit.client.0.smithi033.stdout:2/253: fdatasync fd 0 2024-02-15T18:31:02.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/228: dwrite d1/da/f1b [0,4194304] 0 2024-02-15T18:31:02.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/229: write d1/da/f37 [48333,21420] 0 2024-02-15T18:31:02.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/230: truncate d1/da/d10/f1d 799493 0 2024-02-15T18:31:02.279 INFO:tasks.workunit.client.0.smithi033.stdout:1/242: dwrite d5/d9/f14 [0,4194304] 0 2024-02-15T18:31:02.282 INFO:tasks.workunit.client.0.smithi033.stdout:1/243: creat d5/d9/d1e/d20/f3d x:0 0 0 2024-02-15T18:31:02.282 INFO:tasks.workunit.client.0.smithi033.stdout:1/244: truncate d5/dd/d1c/f1d 4279291 0 2024-02-15T18:31:02.286 INFO:tasks.workunit.client.0.smithi033.stdout:1/245: read d5/d17/f35 [1898787,121706] 0 2024-02-15T18:31:02.303 INFO:tasks.workunit.client.0.smithi033.stdout:3/227: dwrite d2/d3/df/f34 [0,4194304] 0 2024-02-15T18:31:02.304 INFO:tasks.workunit.client.0.smithi033.stdout:3/228: write d2/f26 [769591,114820] 0 2024-02-15T18:31:02.306 INFO:tasks.workunit.client.0.smithi033.stdout:3/229: rename d2/d3/df/f34 to d2/d14/f42 0 2024-02-15T18:31:02.306 INFO:tasks.workunit.client.0.smithi033.stdout:3/230: readlink d2/l1a 0 2024-02-15T18:31:02.306 INFO:tasks.workunit.client.0.smithi033.stdout:3/231: write d2/d3/f39 [1760430,57362] 0 2024-02-15T18:31:02.307 INFO:tasks.workunit.client.0.smithi033.stdout:3/232: getdents d2/d20 0 2024-02-15T18:31:02.316 INFO:tasks.workunit.client.0.smithi033.stdout:7/231: dwrite d0/f32 [0,4194304] 0 2024-02-15T18:31:02.316 INFO:tasks.workunit.client.0.smithi033.stdout:0/199: dwrite d0/dc/d1d/f1f [0,4194304] 0 2024-02-15T18:31:02.316 INFO:tasks.workunit.client.0.smithi033.stdout:5/231: dwrite d1/da/d11/f30 [0,4194304] 0 2024-02-15T18:31:02.316 INFO:tasks.workunit.client.0.smithi033.stdout:6/231: dwrite d8/d28/d14/f34 [0,4194304] 0 2024-02-15T18:31:02.316 INFO:tasks.workunit.client.0.smithi033.stdout:5/232: readlink d1/da/l16 0 2024-02-15T18:31:02.316 INFO:tasks.workunit.client.0.smithi033.stdout:4/294: dwrite d4/d5/f24 [0,4194304] 0 2024-02-15T18:31:02.316 INFO:tasks.workunit.client.0.smithi033.stdout:4/295: chown d4/d20/d37/f4d 11179485 1 2024-02-15T18:31:02.317 INFO:tasks.workunit.client.0.smithi033.stdout:9/127: dwrite d4/d8/f20 [0,4194304] 0 2024-02-15T18:31:02.317 INFO:tasks.workunit.client.0.smithi033.stdout:1/246: dwrite d5/dd/f10 [0,4194304] 0 2024-02-15T18:31:02.321 INFO:tasks.workunit.client.0.smithi033.stdout:1/247: dread d5/dd/d1c/d23/f26 [0,4194304] 0 2024-02-15T18:31:02.321 INFO:tasks.workunit.client.0.smithi033.stdout:1/248: write d5/d9/d1e/d20/f3d [195701,74599] 0 2024-02-15T18:31:02.321 INFO:tasks.workunit.client.0.smithi033.stdout:2/254: getdents d20/d3a 0 2024-02-15T18:31:02.326 INFO:tasks.workunit.client.0.smithi033.stdout:0/200: unlink d0/d8/d15/l3d 0 2024-02-15T18:31:02.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/201: readlink d0/l2a 0 2024-02-15T18:31:02.329 INFO:tasks.workunit.client.0.smithi033.stdout:3/233: dwrite d2/d14/f16 [0,4194304] 0 2024-02-15T18:31:02.329 INFO:tasks.workunit.client.0.smithi033.stdout:3/234: chown d2/d20/c2a 5263 1 2024-02-15T18:31:02.329 INFO:tasks.workunit.client.0.smithi033.stdout:3/235: fsync d2/d20/f41 0 2024-02-15T18:31:02.329 INFO:tasks.workunit.client.0.smithi033.stdout:7/232: dread d0/f1c [0,4194304] 0 2024-02-15T18:31:02.333 INFO:tasks.workunit.client.0.smithi033.stdout:6/232: mkdir d8/d1d/d2a/d55 0 2024-02-15T18:31:02.334 INFO:tasks.workunit.client.0.smithi033.stdout:6/233: chown d8/d1d/d2a/d55 1710 1 2024-02-15T18:31:02.335 INFO:tasks.workunit.client.0.smithi033.stdout:5/233: truncate d1/da/f2c 3619975 0 2024-02-15T18:31:02.335 INFO:tasks.workunit.client.0.smithi033.stdout:5/234: truncate d1/da/d11/f30 4903497 0 2024-02-15T18:31:02.335 INFO:tasks.workunit.client.0.smithi033.stdout:4/296: mknod d4/d5/d28/c5d 0 2024-02-15T18:31:02.337 INFO:tasks.workunit.client.0.smithi033.stdout:9/128: unlink d4/d8/dd/l11 0 2024-02-15T18:31:02.337 INFO:tasks.workunit.client.0.smithi033.stdout:9/129: fdatasync d4/d8/dd/f27 0 2024-02-15T18:31:02.337 INFO:tasks.workunit.client.0.smithi033.stdout:9/130: write d4/d8/dd/f29 [422478,116192] 0 2024-02-15T18:31:02.345 INFO:tasks.workunit.client.0.smithi033.stdout:1/249: creat d5/dd/f3e x:0 0 0 2024-02-15T18:31:02.345 INFO:tasks.workunit.client.0.smithi033.stdout:1/250: chown d5/d17/f29 489598 1 2024-02-15T18:31:02.347 INFO:tasks.workunit.client.0.smithi033.stdout:2/255: mkdir d20/d3a/d4a/d5e 0 2024-02-15T18:31:02.351 INFO:tasks.workunit.client.0.smithi033.stdout:0/202: creat d0/d8/d15/d2d/f3e x:0 0 0 2024-02-15T18:31:02.353 INFO:tasks.workunit.client.0.smithi033.stdout:3/236: getdents d2/d3/df 0 2024-02-15T18:31:02.356 INFO:tasks.workunit.client.0.smithi033.stdout:6/234: creat d8/d1d/d2a/f56 x:0 0 0 2024-02-15T18:31:02.357 INFO:tasks.workunit.client.0.smithi033.stdout:5/235: creat d1/da/d19/f3e x:0 0 0 2024-02-15T18:31:02.357 INFO:tasks.workunit.client.0.smithi033.stdout:5/236: dread - d1/da/d19/f34 zero size 2024-02-15T18:31:02.357 INFO:tasks.workunit.client.0.smithi033.stdout:5/237: chown d1/da/d19/l3b 53 1 2024-02-15T18:31:02.357 INFO:tasks.workunit.client.0.smithi033.stdout:5/238: dread - d1/da/f24 zero size 2024-02-15T18:31:02.357 INFO:tasks.workunit.client.0.smithi033.stdout:5/239: dread - d1/f2a zero size 2024-02-15T18:31:02.358 INFO:tasks.workunit.client.0.smithi033.stdout:4/297: creat d4/d20/d37/f5e x:0 0 0 2024-02-15T18:31:02.358 INFO:tasks.workunit.client.0.smithi033.stdout:4/298: stat d4/d20/d37/c40 0 2024-02-15T18:31:02.360 INFO:tasks.workunit.client.0.smithi033.stdout:9/131: rename d4/l2d to d4/d8/dd/d28/l35 0 2024-02-15T18:31:02.361 INFO:tasks.workunit.client.0.smithi033.stdout:2/256: creat d20/d3a/d4a/f5f x:0 0 0 2024-02-15T18:31:02.365 INFO:tasks.workunit.client.0.smithi033.stdout:0/203: mkdir d0/d8/d15/d2d/d3f 0 2024-02-15T18:31:02.365 INFO:tasks.workunit.client.0.smithi033.stdout:0/204: readlink d0/dc/d1d/l36 0 2024-02-15T18:31:02.367 INFO:tasks.workunit.client.0.smithi033.stdout:3/237: rmdir d2/d3/d1e 39 2024-02-15T18:31:02.369 INFO:tasks.workunit.client.0.smithi033.stdout:6/235: mkdir d8/d1d/d2a/d57 0 2024-02-15T18:31:02.369 INFO:tasks.workunit.client.0.smithi033.stdout:6/236: chown d8/d28/d14/d2c/d31/c2b 318408849 1 2024-02-15T18:31:02.370 INFO:tasks.workunit.client.0.smithi033.stdout:6/237: chown d8/d28/d14/d2c/d31/d30/d29 0 1 2024-02-15T18:31:02.370 INFO:tasks.workunit.client.0.smithi033.stdout:6/238: truncate d8/d28/f18 1340529 0 2024-02-15T18:31:02.370 INFO:tasks.workunit.client.0.smithi033.stdout:6/239: dread - d8/d28/d14/d2c/d3b/f49 zero size 2024-02-15T18:31:02.370 INFO:tasks.workunit.client.0.smithi033.stdout:5/240: read d1/da/d10/f26 [410386,84990] 0 2024-02-15T18:31:02.370 INFO:tasks.workunit.client.0.smithi033.stdout:4/299: getdents d4/d20/d13/d1b 0 2024-02-15T18:31:02.370 INFO:tasks.workunit.client.0.smithi033.stdout:4/300: readlink d4/l23 0 2024-02-15T18:31:02.371 INFO:tasks.workunit.client.0.smithi033.stdout:1/251: link d5/dd/f3e d5/dd/f3f 0 2024-02-15T18:31:02.371 INFO:tasks.workunit.client.0.smithi033.stdout:0/205: mkdir d0/d2/d40 0 2024-02-15T18:31:02.373 INFO:tasks.workunit.client.0.smithi033.stdout:3/238: rename d2/f1b to d2/d14/d23/f43 0 2024-02-15T18:31:02.373 INFO:tasks.workunit.client.0.smithi033.stdout:7/233: dread d0/f27 [0,4194304] 0 2024-02-15T18:31:02.374 INFO:tasks.workunit.client.0.smithi033.stdout:6/240: mknod d8/d1d/d2a/d55/c58 0 2024-02-15T18:31:02.374 INFO:tasks.workunit.client.0.smithi033.stdout:6/241: chown d8/d1d/c32 502785 1 2024-02-15T18:31:02.375 INFO:tasks.workunit.client.0.smithi033.stdout:5/241: mkdir d1/da/d19/d3f 0 2024-02-15T18:31:02.375 INFO:tasks.workunit.client.0.smithi033.stdout:5/242: chown d1/da/f37 25899 1 2024-02-15T18:31:02.375 INFO:tasks.workunit.client.0.smithi033.stdout:5/243: chown d1/da/l16 491608 1 2024-02-15T18:31:02.375 INFO:tasks.workunit.client.0.smithi033.stdout:5/244: write d1/da/f37 [141139,38035] 0 2024-02-15T18:31:02.375 INFO:tasks.workunit.client.0.smithi033.stdout:5/245: chown d1/da/d19/d3f 20079 1 2024-02-15T18:31:02.375 INFO:tasks.workunit.client.0.smithi033.stdout:3/239: read d2/d14/f37 [28370,121552] 0 2024-02-15T18:31:02.376 INFO:tasks.workunit.client.0.smithi033.stdout:4/301: symlink d4/d5/d28/d39/l5f 0 2024-02-15T18:31:02.378 INFO:tasks.workunit.client.0.smithi033.stdout:1/252: creat d5/d9/d1e/d20/d2c/d34/f40 x:0 0 0 2024-02-15T18:31:02.378 INFO:tasks.workunit.client.0.smithi033.stdout:2/257: dread d20/f3c [0,4194304] 0 2024-02-15T18:31:02.379 INFO:tasks.workunit.client.0.smithi033.stdout:4/302: symlink d4/d20/d13/d1b/l60 0 2024-02-15T18:31:02.381 INFO:tasks.workunit.client.0.smithi033.stdout:9/132: rename d4/d8/dd/f27 to d4/d8/dd/f36 0 2024-02-15T18:31:02.383 INFO:tasks.workunit.client.0.smithi033.stdout:2/258: creat d20/d31/d47/d4c/f60 x:0 0 0 2024-02-15T18:31:02.383 INFO:tasks.workunit.client.0.smithi033.stdout:2/259: write d20/d3a/d4a/f5f [689815,79871] 0 2024-02-15T18:31:02.384 INFO:tasks.workunit.client.0.smithi033.stdout:7/234: mknod d0/c4e 0 2024-02-15T18:31:02.384 INFO:tasks.workunit.client.0.smithi033.stdout:7/235: dread - d0/dc/d10/d1d/f2d zero size 2024-02-15T18:31:02.388 INFO:tasks.workunit.client.0.smithi033.stdout:9/133: truncate d4/d8/ff 2529937 0 2024-02-15T18:31:02.388 INFO:tasks.workunit.client.0.smithi033.stdout:7/236: fsync d0/f1 0 2024-02-15T18:31:02.388 INFO:tasks.workunit.client.0.smithi033.stdout:7/237: readlink d0/dc/d10/d1d/l24 0 2024-02-15T18:31:02.388 INFO:tasks.workunit.client.0.smithi033.stdout:7/238: fsync d0/f1c 0 2024-02-15T18:31:02.388 INFO:tasks.workunit.client.0.smithi033.stdout:7/239: stat d0/fa 0 2024-02-15T18:31:02.391 INFO:tasks.workunit.client.0.smithi033.stdout:7/240: creat d0/dc/d10/d1d/f4f x:0 0 0 2024-02-15T18:31:02.391 INFO:tasks.workunit.client.0.smithi033.stdout:7/241: readlink d0/dc/l20 0 2024-02-15T18:31:02.393 INFO:tasks.workunit.client.0.smithi033.stdout:4/303: dread d4/f21 [0,4194304] 0 2024-02-15T18:31:02.394 INFO:tasks.workunit.client.0.smithi033.stdout:7/242: creat d0/dc/d10/d1d/d38/d3a/f50 x:0 0 0 2024-02-15T18:31:02.396 INFO:tasks.workunit.client.0.smithi033.stdout:4/304: creat d4/d20/d53/f61 x:0 0 0 2024-02-15T18:31:02.396 INFO:tasks.workunit.client.0.smithi033.stdout:7/243: dread d0/f27 [0,4194304] 0 2024-02-15T18:31:02.397 INFO:tasks.workunit.client.0.smithi033.stdout:4/305: unlink d4/d20/f1f 0 2024-02-15T18:31:02.398 INFO:tasks.workunit.client.0.smithi033.stdout:7/244: rename d0/f32 to d0/dc/d10/d48/f51 0 2024-02-15T18:31:02.400 INFO:tasks.workunit.client.0.smithi033.stdout:7/245: unlink d0/dc/d10/d1d/d38/f43 0 2024-02-15T18:31:02.403 INFO:tasks.workunit.client.0.smithi033.stdout:0/206: dwrite d0/d8/fb [0,4194304] 0 2024-02-15T18:31:02.403 INFO:tasks.workunit.client.0.smithi033.stdout:0/207: stat d0/f5 0 2024-02-15T18:31:02.406 INFO:tasks.workunit.client.0.smithi033.stdout:0/208: mkdir d0/d8/d15/d2d/d41 0 2024-02-15T18:31:02.415 INFO:tasks.workunit.client.0.smithi033.stdout:7/246: dread d0/f1f [0,4194304] 0 2024-02-15T18:31:02.415 INFO:tasks.workunit.client.0.smithi033.stdout:7/247: fsync d0/dc/d10/d1d/f2d 0 2024-02-15T18:31:02.415 INFO:tasks.workunit.client.0.smithi033.stdout:0/209: creat d0/d8/f42 x:0 0 0 2024-02-15T18:31:02.418 INFO:tasks.workunit.client.0.smithi033.stdout:0/210: dread d0/f10 [0,4194304] 0 2024-02-15T18:31:02.419 INFO:tasks.workunit.client.0.smithi033.stdout:0/211: truncate d0/f4 2428427 0 2024-02-15T18:31:02.423 INFO:tasks.workunit.client.0.smithi033.stdout:5/246: dwrite d1/f5 [0,4194304] 0 2024-02-15T18:31:02.425 INFO:tasks.workunit.client.0.smithi033.stdout:5/247: rename d1/da/d11/d2e to d1/da/d19/d3c/d40 0 2024-02-15T18:31:02.425 INFO:tasks.workunit.client.0.smithi033.stdout:5/248: creat d1/da/f41 x:0 0 0 2024-02-15T18:31:02.426 INFO:tasks.workunit.client.0.smithi033.stdout:5/249: mkdir d1/da/d10/d2b/d42 0 2024-02-15T18:31:02.427 INFO:tasks.workunit.client.0.smithi033.stdout:5/250: symlink d1/da/d19/d3f/l43 0 2024-02-15T18:31:02.427 INFO:tasks.workunit.client.0.smithi033.stdout:5/251: write d1/da/d19/d3c/d40/f31 [626250,22811] 0 2024-02-15T18:31:02.430 INFO:tasks.workunit.client.0.smithi033.stdout:5/252: creat d1/da/d10/d2b/d42/f44 x:0 0 0 2024-02-15T18:31:02.431 INFO:tasks.workunit.client.0.smithi033.stdout:5/253: write d1/da/f1b [2670959,31282] 0 2024-02-15T18:31:02.435 INFO:tasks.workunit.client.0.smithi033.stdout:2/260: dwrite d20/d30/f4f [0,4194304] 0 2024-02-15T18:31:02.436 INFO:tasks.workunit.client.0.smithi033.stdout:5/254: unlink d1/da/l2f 0 2024-02-15T18:31:02.436 INFO:tasks.workunit.client.0.smithi033.stdout:5/255: read - d1/da/d19/f22 zero size 2024-02-15T18:31:02.436 INFO:tasks.workunit.client.0.smithi033.stdout:1/253: dwrite d5/d17/d27/f39 [0,4194304] 0 2024-02-15T18:31:02.436 INFO:tasks.workunit.client.0.smithi033.stdout:9/134: dwrite d4/d8/dd/f2e [0,4194304] 0 2024-02-15T18:31:02.436 INFO:tasks.workunit.client.0.smithi033.stdout:1/254: read d5/dd/d12/f1b [3383675,55693] 0 2024-02-15T18:31:02.436 INFO:tasks.workunit.client.0.smithi033.stdout:4/306: dwrite d4/d20/f27 [0,4194304] 0 2024-02-15T18:31:02.436 INFO:tasks.workunit.client.0.smithi033.stdout:2/261: truncate d20/d22/f26 386695 0 2024-02-15T18:31:02.437 INFO:tasks.workunit.client.0.smithi033.stdout:2/262: write d20/f21 [3674840,8692] 0 2024-02-15T18:31:02.437 INFO:tasks.workunit.client.0.smithi033.stdout:2/263: truncate d20/d22/f23 1610353 0 2024-02-15T18:31:02.452 INFO:tasks.workunit.client.0.smithi033.stdout:4/307: mkdir d4/d5/d28/d39/d62 0 2024-02-15T18:31:02.453 INFO:tasks.workunit.client.0.smithi033.stdout:2/264: link d20/d39/f48 d20/d3a/d4a/d5e/f61 0 2024-02-15T18:31:02.454 INFO:tasks.workunit.client.0.smithi033.stdout:2/265: fsync d20/f3c 0 2024-02-15T18:31:02.454 INFO:tasks.workunit.client.0.smithi033.stdout:2/266: read d20/d22/f41 [588455,79612] 0 2024-02-15T18:31:02.454 INFO:tasks.workunit.client.0.smithi033.stdout:9/135: unlink d4/d8/dd/f29 0 2024-02-15T18:31:02.457 INFO:tasks.workunit.client.0.smithi033.stdout:2/267: mknod d20/d3a/c62 0 2024-02-15T18:31:02.458 INFO:tasks.workunit.client.0.smithi033.stdout:2/268: creat d20/d31/d47/d4c/f63 x:0 0 0 2024-02-15T18:31:02.459 INFO:tasks.workunit.client.0.smithi033.stdout:9/136: mknod d4/d8/dd/c37 0 2024-02-15T18:31:02.459 INFO:tasks.workunit.client.0.smithi033.stdout:2/269: mkdir d20/d31/d47/d64 0 2024-02-15T18:31:02.460 INFO:tasks.workunit.client.0.smithi033.stdout:2/270: write d20/d22/f2e [4136733,122002] 0 2024-02-15T18:31:02.460 INFO:tasks.workunit.client.0.smithi033.stdout:2/271: readlink d20/d31/l3f 0 2024-02-15T18:31:02.460 INFO:tasks.workunit.client.0.smithi033.stdout:2/272: write d20/d22/f23 [1746404,95147] 0 2024-02-15T18:31:02.461 INFO:tasks.workunit.client.0.smithi033.stdout:9/137: symlink d4/d8/dd/d28/l38 0 2024-02-15T18:31:02.462 INFO:tasks.workunit.client.0.smithi033.stdout:2/273: rename d20/d31/d47/c4e to d20/c65 0 2024-02-15T18:31:02.462 INFO:tasks.workunit.client.0.smithi033.stdout:9/138: readlink d4/d8/dd/l1a 0 2024-02-15T18:31:02.463 INFO:tasks.workunit.client.0.smithi033.stdout:9/139: fdatasync d4/d8/d1b/d2f/f30 0 2024-02-15T18:31:02.463 INFO:tasks.workunit.client.0.smithi033.stdout:9/140: readlink d4/d8/l25 0 2024-02-15T18:31:02.463 INFO:tasks.workunit.client.0.smithi033.stdout:2/274: creat d20/d3a/d4a/d5e/f66 x:0 0 0 2024-02-15T18:31:02.464 INFO:tasks.workunit.client.0.smithi033.stdout:9/141: creat d4/d8/dd/f39 x:0 0 0 2024-02-15T18:31:02.464 INFO:tasks.workunit.client.0.smithi033.stdout:2/275: creat d20/d3a/d4a/f67 x:0 0 0 2024-02-15T18:31:02.465 INFO:tasks.workunit.client.0.smithi033.stdout:9/142: getdents d4/d8/d1b/d2f 0 2024-02-15T18:31:02.465 INFO:tasks.workunit.client.0.smithi033.stdout:9/143: chown d4/d2c 16136353 1 2024-02-15T18:31:02.466 INFO:tasks.workunit.client.0.smithi033.stdout:9/144: symlink d4/d2c/l3a 0 2024-02-15T18:31:02.466 INFO:tasks.workunit.client.0.smithi033.stdout:5/256: dwrite d1/da/d11/f2d [0,4194304] 0 2024-02-15T18:31:02.466 INFO:tasks.workunit.client.0.smithi033.stdout:5/257: write d1/da/f24 [313885,10252] 0 2024-02-15T18:31:02.467 INFO:tasks.workunit.client.0.smithi033.stdout:0/212: dwrite d0/f13 [0,4194304] 0 2024-02-15T18:31:02.467 INFO:tasks.workunit.client.0.smithi033.stdout:8/181: sync 2024-02-15T18:31:02.467 INFO:tasks.workunit.client.0.smithi033.stdout:9/145: creat d4/d32/f3b x:0 0 0 2024-02-15T18:31:02.469 INFO:tasks.workunit.client.0.smithi033.stdout:8/182: dread d0/d2/d14/f32 [0,4194304] 0 2024-02-15T18:31:02.469 INFO:tasks.workunit.client.0.smithi033.stdout:8/183: fsync d0/df/f2c 0 2024-02-15T18:31:02.474 INFO:tasks.workunit.client.0.smithi033.stdout:5/258: mknod d1/da/d19/d3c/c45 0 2024-02-15T18:31:02.474 INFO:tasks.workunit.client.0.smithi033.stdout:0/213: chown d0/d8/le 322365 1 2024-02-15T18:31:02.475 INFO:tasks.workunit.client.0.smithi033.stdout:9/146: rename d4/d8/dd/f2e to d4/d2c/f3c 0 2024-02-15T18:31:02.479 INFO:tasks.workunit.client.0.smithi033.stdout:5/259: dread d1/f4 [0,4194304] 0 2024-02-15T18:31:02.479 INFO:tasks.workunit.client.0.smithi033.stdout:8/184: creat d0/d1c/f3b x:0 0 0 2024-02-15T18:31:02.479 INFO:tasks.workunit.client.0.smithi033.stdout:0/214: creat d0/dc/d1d/f43 x:0 0 0 2024-02-15T18:31:02.489 INFO:tasks.workunit.client.0.smithi033.stdout:2/276: dwrite d20/f43 [0,4194304] 0 2024-02-15T18:31:02.491 INFO:tasks.workunit.client.0.smithi033.stdout:5/260: mkdir d1/da/d19/d3c/d40/d46 0 2024-02-15T18:31:02.492 INFO:tasks.workunit.client.0.smithi033.stdout:5/261: chown d1/da/d10/l29 117947 1 2024-02-15T18:31:02.492 INFO:tasks.workunit.client.0.smithi033.stdout:5/262: stat d1/c32 0 2024-02-15T18:31:02.492 INFO:tasks.workunit.client.0.smithi033.stdout:0/215: link d0/d2/f7 d0/d8/f44 0 2024-02-15T18:31:02.493 INFO:tasks.workunit.client.0.smithi033.stdout:9/147: dread d4/d8/dd/f23 [0,4194304] 0 2024-02-15T18:31:02.493 INFO:tasks.workunit.client.0.smithi033.stdout:2/277: rmdir d20/d22 39 2024-02-15T18:31:02.495 INFO:tasks.workunit.client.0.smithi033.stdout:9/148: getdents d4 0 2024-02-15T18:31:02.499 INFO:tasks.workunit.client.0.smithi033.stdout:8/185: dwrite d0/df/f38 [0,4194304] 0 2024-02-15T18:31:02.499 INFO:tasks.workunit.client.0.smithi033.stdout:8/186: write d0/d2/f16 [4562243,86990] 0 2024-02-15T18:31:02.499 INFO:tasks.workunit.client.0.smithi033.stdout:8/187: chown d0/d1c/d30 27608104 1 2024-02-15T18:31:02.502 INFO:tasks.workunit.client.0.smithi033.stdout:9/149: dread f0 [0,4194304] 0 2024-02-15T18:31:02.502 INFO:tasks.workunit.client.0.smithi033.stdout:9/150: stat d4/d8/d1b/d2f 0 2024-02-15T18:31:02.504 INFO:tasks.workunit.client.0.smithi033.stdout:0/216: write d0/dc/d1d/f25 [1321597,73520] 0 2024-02-15T18:31:02.504 INFO:tasks.workunit.client.0.smithi033.stdout:0/217: chown d0/dc/d1d/c29 2 1 2024-02-15T18:31:02.505 INFO:tasks.workunit.client.0.smithi033.stdout:8/188: creat d0/df/db/f3c x:0 0 0 2024-02-15T18:31:02.505 INFO:tasks.workunit.client.0.smithi033.stdout:9/151: creat d4/d8/dd/f3d x:0 0 0 2024-02-15T18:31:02.505 INFO:tasks.workunit.client.0.smithi033.stdout:8/189: symlink d0/d1c/d30/l3d 0 2024-02-15T18:31:02.506 INFO:tasks.workunit.client.0.smithi033.stdout:2/278: write f5 [2239436,43286] 0 2024-02-15T18:31:02.507 INFO:tasks.workunit.client.0.smithi033.stdout:8/190: link d0/fe d0/d1c/f3e 0 2024-02-15T18:31:02.508 INFO:tasks.workunit.client.0.smithi033.stdout:9/152: read d4/d8/d1b/d2f/f30 [2409631,20515] 0 2024-02-15T18:31:02.508 INFO:tasks.workunit.client.0.smithi033.stdout:2/279: creat d20/d3a/f68 x:0 0 0 2024-02-15T18:31:02.509 INFO:tasks.workunit.client.0.smithi033.stdout:5/263: dwrite d1/f4 [0,4194304] 0 2024-02-15T18:31:02.509 INFO:tasks.workunit.client.0.smithi033.stdout:5/264: write d1/da/d11/f30 [5352799,54470] 0 2024-02-15T18:31:02.511 INFO:tasks.workunit.client.0.smithi033.stdout:5/265: creat d1/da/d19/d3c/f47 x:0 0 0 2024-02-15T18:31:02.513 INFO:tasks.workunit.client.0.smithi033.stdout:5/266: rename d1/f5 to d1/da/d10/d2b/f48 0 2024-02-15T18:31:02.514 INFO:tasks.workunit.client.0.smithi033.stdout:5/267: creat d1/da/d11/f49 x:0 0 0 2024-02-15T18:31:02.515 INFO:tasks.workunit.client.0.smithi033.stdout:5/268: read d1/da/d10/f26 [229207,64408] 0 2024-02-15T18:31:02.517 INFO:tasks.workunit.client.0.smithi033.stdout:9/153: dread d4/d8/fb [0,4194304] 0 2024-02-15T18:31:02.519 INFO:tasks.workunit.client.0.smithi033.stdout:9/154: mknod d4/d8/d1b/d2f/c3e 0 2024-02-15T18:31:02.521 INFO:tasks.workunit.client.0.smithi033.stdout:9/155: mknod d4/d8/dd/d28/c3f 0 2024-02-15T18:31:02.522 INFO:tasks.workunit.client.0.smithi033.stdout:9/156: unlink d4/d8/dd/c19 0 2024-02-15T18:31:02.528 INFO:tasks.workunit.client.0.smithi033.stdout:0/218: dread d0/f13 [0,4194304] 0 2024-02-15T18:31:02.528 INFO:tasks.workunit.client.0.smithi033.stdout:0/219: dread - d0/d2/f34 zero size 2024-02-15T18:31:02.529 INFO:tasks.workunit.client.0.smithi033.stdout:8/191: dwrite d0/f3a [0,4194304] 0 2024-02-15T18:31:02.531 INFO:tasks.workunit.client.0.smithi033.stdout:8/192: symlink d0/d1c/d30/l3f 0 2024-02-15T18:31:02.532 INFO:tasks.workunit.client.0.smithi033.stdout:2/280: dwrite d20/f4b [0,4194304] 0 2024-02-15T18:31:02.536 INFO:tasks.workunit.client.0.smithi033.stdout:9/157: rmdir d4/d8/d1b 39 2024-02-15T18:31:02.538 INFO:tasks.workunit.client.0.smithi033.stdout:2/281: creat d20/d3a/d4a/d5e/f69 x:0 0 0 2024-02-15T18:31:02.539 INFO:tasks.workunit.client.0.smithi033.stdout:9/158: unlink d4/d2c/f3c 0 2024-02-15T18:31:02.540 INFO:tasks.workunit.client.0.smithi033.stdout:9/159: write d4/d8/fb [2257397,54703] 0 2024-02-15T18:31:02.541 INFO:tasks.workunit.client.0.smithi033.stdout:2/282: rename d20/d22 to d20/d31/d6a 0 2024-02-15T18:31:02.543 INFO:tasks.workunit.client.0.smithi033.stdout:1/255: sync 2024-02-15T18:31:02.543 INFO:tasks.workunit.client.0.smithi033.stdout:3/240: sync 2024-02-15T18:31:02.544 INFO:tasks.workunit.client.0.smithi033.stdout:7/248: sync 2024-02-15T18:31:02.544 INFO:tasks.workunit.client.0.smithi033.stdout:1/256: chown d5/c6 18495448 1 2024-02-15T18:31:02.544 INFO:tasks.workunit.client.0.smithi033.stdout:3/241: fsync d2/d14/f16 0 2024-02-15T18:31:02.544 INFO:tasks.workunit.client.0.smithi033.stdout:1/257: readlink d5/d9/l11 0 2024-02-15T18:31:02.544 INFO:tasks.workunit.client.0.smithi033.stdout:3/242: write d2/f27 [983427,46792] 0 2024-02-15T18:31:02.544 INFO:tasks.workunit.client.0.smithi033.stdout:3/243: truncate d2/d3/d17/f1f 4895229 0 2024-02-15T18:31:02.544 INFO:tasks.workunit.client.0.smithi033.stdout:6/242: sync 2024-02-15T18:31:02.545 INFO:tasks.workunit.client.0.smithi033.stdout:7/249: rmdir d0/dc/d10/d1d/d38 39 2024-02-15T18:31:02.548 INFO:tasks.workunit.client.0.smithi033.stdout:3/244: link d2/f5 d2/d14/f44 0 2024-02-15T18:31:02.548 INFO:tasks.workunit.client.0.smithi033.stdout:3/245: chown d2/d3/df/l18 60 1 2024-02-15T18:31:02.549 INFO:tasks.workunit.client.0.smithi033.stdout:7/250: creat d0/dc/d10/d1d/d2b/f52 x:0 0 0 2024-02-15T18:31:02.569 INFO:tasks.workunit.client.0.smithi033.stdout:9/160: dwrite d4/d8/dd/f13 [0,4194304] 0 2024-02-15T18:31:02.572 INFO:tasks.workunit.client.0.smithi033.stdout:9/161: truncate d4/d8/dd/f15 4159641 0 2024-02-15T18:31:02.575 INFO:tasks.workunit.client.0.smithi033.stdout:2/283: dwrite d20/f49 [0,4194304] 0 2024-02-15T18:31:02.576 INFO:tasks.workunit.client.0.smithi033.stdout:2/284: mkdir d20/d3a/d4a/d5e/d6b 0 2024-02-15T18:31:02.577 INFO:tasks.workunit.client.0.smithi033.stdout:2/285: write d20/f2b [766181,76594] 0 2024-02-15T18:31:02.587 INFO:tasks.workunit.client.0.smithi033.stdout:9/162: dread d4/d8/dd/d28/f2b [0,4194304] 0 2024-02-15T18:31:02.588 INFO:tasks.workunit.client.0.smithi033.stdout:9/163: rename d4/d8/ff to d4/d2c/f40 0 2024-02-15T18:31:02.589 INFO:tasks.workunit.client.0.smithi033.stdout:1/258: dwrite d5/dd/f2e [0,4194304] 0 2024-02-15T18:31:02.590 INFO:tasks.workunit.client.0.smithi033.stdout:7/251: dwrite d0/dc/d10/d1d/d38/d3a/f3f [0,4194304] 0 2024-02-15T18:31:02.590 INFO:tasks.workunit.client.0.smithi033.stdout:6/243: dwrite d8/d28/d14/f43 [0,4194304] 0 2024-02-15T18:31:02.593 INFO:tasks.workunit.client.0.smithi033.stdout:1/259: rename d5/dd/d1c to d5/d9/d1e/d41 0 2024-02-15T18:31:02.594 INFO:tasks.workunit.client.0.smithi033.stdout:1/260: truncate d5/dd/f3e 833407 0 2024-02-15T18:31:02.594 INFO:tasks.workunit.client.0.smithi033.stdout:2/286: dwrite d20/f3c [0,4194304] 0 2024-02-15T18:31:02.595 INFO:tasks.workunit.client.0.smithi033.stdout:9/164: mkdir d4/d8/dd/d41 0 2024-02-15T18:31:02.596 INFO:tasks.workunit.client.0.smithi033.stdout:7/252: dread d0/f1f [0,4194304] 0 2024-02-15T18:31:02.604 INFO:tasks.workunit.client.0.smithi033.stdout:1/261: symlink d5/d9/d1e/d20/d2c/d34/l42 0 2024-02-15T18:31:02.606 INFO:tasks.workunit.client.0.smithi033.stdout:7/253: creat d0/dc/d10/d48/f53 x:0 0 0 2024-02-15T18:31:02.606 INFO:tasks.workunit.client.0.smithi033.stdout:4/308: sync 2024-02-15T18:31:02.606 INFO:tasks.workunit.client.0.smithi033.stdout:1/262: symlink d5/dd/d12/l43 0 2024-02-15T18:31:02.607 INFO:tasks.workunit.client.0.smithi033.stdout:2/287: dwrite d20/d3a/d4a/d5e/f66 [0,4194304] 0 2024-02-15T18:31:02.608 INFO:tasks.workunit.client.0.smithi033.stdout:2/288: truncate d20/d39/f5a 16986 0 2024-02-15T18:31:02.608 INFO:tasks.workunit.client.0.smithi033.stdout:4/309: link d4/d20/d13/c56 d4/d5/d28/d39/c63 0 2024-02-15T18:31:02.609 INFO:tasks.workunit.client.0.smithi033.stdout:7/254: dread d0/dc/f31 [0,4194304] 0 2024-02-15T18:31:02.609 INFO:tasks.workunit.client.0.smithi033.stdout:7/255: stat d0/dc/d10/d1d/f25 0 2024-02-15T18:31:02.609 INFO:tasks.workunit.client.0.smithi033.stdout:4/310: write d4/d20/ff [1511741,40141] 0 2024-02-15T18:31:02.610 INFO:tasks.workunit.client.0.smithi033.stdout:6/244: write d8/d28/d14/f43 [4127384,99298] 0 2024-02-15T18:31:02.616 INFO:tasks.workunit.client.0.smithi033.stdout:2/289: mkdir d20/d31/d47/d4c/d6c 0 2024-02-15T18:31:02.619 INFO:tasks.workunit.client.0.smithi033.stdout:7/256: rmdir d0/dc/d10/d1d/d38/d3a 39 2024-02-15T18:31:02.619 INFO:tasks.workunit.client.0.smithi033.stdout:7/257: stat d0/dc/d10/d1d/f34 0 2024-02-15T18:31:02.619 INFO:tasks.workunit.client.0.smithi033.stdout:7/258: truncate d0/dc/f41 891096 0 2024-02-15T18:31:02.619 INFO:tasks.workunit.client.0.smithi033.stdout:7/259: dread - d0/dc/d10/d1d/d2b/f52 zero size 2024-02-15T18:31:02.620 INFO:tasks.workunit.client.0.smithi033.stdout:4/311: creat d4/d20/d13/d1b/f64 x:0 0 0 2024-02-15T18:31:02.620 INFO:tasks.workunit.client.0.smithi033.stdout:4/312: dread - d4/d20/d37/f5e zero size 2024-02-15T18:31:02.621 INFO:tasks.workunit.client.0.smithi033.stdout:7/260: link d0/dc/d10/f2c d0/dc/d10/d48/d4b/f54 0 2024-02-15T18:31:02.623 INFO:tasks.workunit.client.0.smithi033.stdout:4/313: unlink d4/l23 0 2024-02-15T18:31:02.625 INFO:tasks.workunit.client.0.smithi033.stdout:7/261: read d0/dc/f1a [3102407,67729] 0 2024-02-15T18:31:02.625 INFO:tasks.workunit.client.0.smithi033.stdout:4/314: rename d4/d5/d28/c4a to d4/d20/c65 0 2024-02-15T18:31:02.625 INFO:tasks.workunit.client.0.smithi033.stdout:4/315: chown d4/d5/c1d 1559 1 2024-02-15T18:31:02.627 INFO:tasks.workunit.client.0.smithi033.stdout:7/262: rename d0/f39 to d0/dc/d10/d1d/d2b/f55 0 2024-02-15T18:31:02.628 INFO:tasks.workunit.client.0.smithi033.stdout:4/316: mknod d4/d5/c66 0 2024-02-15T18:31:02.628 INFO:tasks.workunit.client.0.smithi033.stdout:4/317: chown d4/d3c/f51 101 1 2024-02-15T18:31:02.629 INFO:tasks.workunit.client.0.smithi033.stdout:7/263: getdents d0/dc/d10/d1d 0 2024-02-15T18:31:02.629 INFO:tasks.workunit.client.0.smithi033.stdout:7/264: chown d0/dc/d10/d48/f51 19012 1 2024-02-15T18:31:02.630 INFO:tasks.workunit.client.0.smithi033.stdout:4/318: creat d4/f67 x:0 0 0 2024-02-15T18:31:02.630 INFO:tasks.workunit.client.0.smithi033.stdout:7/265: chown d0/fd 105280228 1 2024-02-15T18:31:02.634 INFO:tasks.workunit.client.0.smithi033.stdout:6/245: dwrite d8/d28/f17 [0,4194304] 0 2024-02-15T18:31:02.634 INFO:tasks.workunit.client.0.smithi033.stdout:1/263: dwrite d5/dd/f3f [0,4194304] 0 2024-02-15T18:31:02.634 INFO:tasks.workunit.client.0.smithi033.stdout:6/246: write d8/d28/f11 [4789226,27152] 0 2024-02-15T18:31:02.634 INFO:tasks.workunit.client.0.smithi033.stdout:4/319: link d4/d5/ld d4/d5/l68 0 2024-02-15T18:31:02.635 INFO:tasks.workunit.client.0.smithi033.stdout:2/290: dwrite d20/d3a/f57 [0,4194304] 0 2024-02-15T18:31:02.637 INFO:tasks.workunit.client.0.smithi033.stdout:1/264: write d5/dd/d12/f1b [2731738,82812] 0 2024-02-15T18:31:02.638 INFO:tasks.workunit.client.0.smithi033.stdout:1/265: chown d5/dd/f2e 14105443 1 2024-02-15T18:31:02.639 INFO:tasks.workunit.client.0.smithi033.stdout:6/247: creat d8/d28/d14/d2c/d31/d30/d29/f59 x:0 0 0 2024-02-15T18:31:02.642 INFO:tasks.workunit.client.0.smithi033.stdout:2/291: dread d20/f2b [0,4194304] 0 2024-02-15T18:31:02.647 INFO:tasks.workunit.client.0.smithi033.stdout:6/248: getdents d8/d28/d14/d2c/d31/d30/d29/d38 0 2024-02-15T18:31:02.648 INFO:tasks.workunit.client.0.smithi033.stdout:2/292: creat d20/d31/d47/f6d x:0 0 0 2024-02-15T18:31:02.650 INFO:tasks.workunit.client.0.smithi033.stdout:4/320: rmdir d4/d5 39 2024-02-15T18:31:02.651 INFO:tasks.workunit.client.0.smithi033.stdout:7/266: dwrite d0/dc/f31 [0,4194304] 0 2024-02-15T18:31:02.654 INFO:tasks.workunit.client.0.smithi033.stdout:7/267: mkdir d0/d56 0 2024-02-15T18:31:02.656 INFO:tasks.workunit.client.0.smithi033.stdout:4/321: dread d4/d20/f26 [0,4194304] 0 2024-02-15T18:31:02.658 INFO:tasks.workunit.client.0.smithi033.stdout:1/266: dwrite d5/d9/ff [0,4194304] 0 2024-02-15T18:31:02.658 INFO:tasks.workunit.client.0.smithi033.stdout:1/267: readlink d5/dd/d12/l43 0 2024-02-15T18:31:02.661 INFO:tasks.workunit.client.0.smithi033.stdout:4/322: symlink d4/d5/d28/d39/d62/l69 0 2024-02-15T18:31:02.661 INFO:tasks.workunit.client.0.smithi033.stdout:4/323: chown d4/d20/c50 28424255 1 2024-02-15T18:31:02.661 INFO:tasks.workunit.client.0.smithi033.stdout:4/324: truncate d4/f67 229855 0 2024-02-15T18:31:02.661 INFO:tasks.workunit.client.0.smithi033.stdout:4/325: dread - d4/f46 zero size 2024-02-15T18:31:02.663 INFO:tasks.workunit.client.0.smithi033.stdout:1/268: rename d5/d9/f14 to d5/d9/d1e/d41/f44 0 2024-02-15T18:31:02.663 INFO:tasks.workunit.client.0.smithi033.stdout:1/269: chown d5/d38 286633828 1 2024-02-15T18:31:02.664 INFO:tasks.workunit.client.0.smithi033.stdout:4/326: creat d4/d20/d13/d1b/f6a x:0 0 0 2024-02-15T18:31:02.676 INFO:tasks.workunit.client.0.smithi033.stdout:6/249: dwrite d8/d28/d14/f13 [0,4194304] 0 2024-02-15T18:31:02.676 INFO:tasks.workunit.client.0.smithi033.stdout:6/250: dread - d8/d28/d14/d2c/d3b/f49 zero size 2024-02-15T18:31:02.676 INFO:tasks.workunit.client.0.smithi033.stdout:6/251: fdatasync d8/d28/d36/f50 0 2024-02-15T18:31:02.681 INFO:tasks.workunit.client.0.smithi033.stdout:6/252: write d8/d28/d14/d2c/d31/d30/f2d [2713976,53357] 0 2024-02-15T18:31:02.682 INFO:tasks.workunit.client.0.smithi033.stdout:6/253: rmdir d8/d1d/d37 39 2024-02-15T18:31:02.684 INFO:tasks.workunit.client.0.smithi033.stdout:2/293: dwrite d20/d31/d47/d4c/f63 [0,4194304] 0 2024-02-15T18:31:02.684 INFO:tasks.workunit.client.0.smithi033.stdout:7/268: dwrite d0/dc/d10/d1d/d38/d3a/f3f [0,4194304] 0 2024-02-15T18:31:02.684 INFO:tasks.workunit.client.0.smithi033.stdout:1/270: dwrite d5/d9/d1e/d41/f1d [4194304,4194304] 0 2024-02-15T18:31:02.685 INFO:tasks.workunit.client.0.smithi033.stdout:6/254: rename d8/d28/d14/d2c/f2f to d8/d1d/d2a/d57/f5a 0 2024-02-15T18:31:02.685 INFO:tasks.workunit.client.0.smithi033.stdout:6/255: write d8/d28/f46 [1481546,24142] 0 2024-02-15T18:31:02.685 INFO:tasks.workunit.client.0.smithi033.stdout:6/256: read - d8/d28/d36/f41 zero size 2024-02-15T18:31:02.698 INFO:tasks.workunit.client.0.smithi033.stdout:7/269: dread d0/f9 [0,4194304] 0 2024-02-15T18:31:02.698 INFO:tasks.workunit.client.0.smithi033.stdout:6/257: creat d8/f5b x:0 0 0 2024-02-15T18:31:02.699 INFO:tasks.workunit.client.0.smithi033.stdout:6/258: fdatasync d8/d28/d14/f34 0 2024-02-15T18:31:02.700 INFO:tasks.workunit.client.0.smithi033.stdout:6/259: symlink d8/d1d/d2a/d55/l5c 0 2024-02-15T18:31:02.700 INFO:tasks.workunit.client.0.smithi033.stdout:6/260: getdents d8/d28/d14/d2c/d31/d30/d29/d38 0 2024-02-15T18:31:02.707 INFO:tasks.workunit.client.0.smithi033.stdout:1/271: dwrite d5/d9/ff [0,4194304] 0 2024-02-15T18:31:02.708 INFO:tasks.workunit.client.0.smithi033.stdout:1/272: symlink d5/d9/l45 0 2024-02-15T18:31:02.715 INFO:tasks.workunit.client.0.smithi033.stdout:7/270: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:31:02.727 INFO:tasks.workunit.client.0.smithi033.stdout:7/271: dwrite d0/f27 [0,4194304] 0 2024-02-15T18:31:02.730 INFO:tasks.workunit.client.0.smithi033.stdout:5/269: sync 2024-02-15T18:31:02.730 INFO:tasks.workunit.client.0.smithi033.stdout:5/270: write d1/da/d10/f26 [1215055,129839] 0 2024-02-15T18:31:02.732 INFO:tasks.workunit.client.0.smithi033.stdout:5/271: rename d1/l1a to d1/da/d19/d3c/d40/d46/l4a 0 2024-02-15T18:31:02.733 INFO:tasks.workunit.client.0.smithi033.stdout:3/246: sync 2024-02-15T18:31:02.733 INFO:tasks.workunit.client.0.smithi033.stdout:0/220: sync 2024-02-15T18:31:02.733 INFO:tasks.workunit.client.0.smithi033.stdout:8/193: sync 2024-02-15T18:31:02.733 INFO:tasks.workunit.client.0.smithi033.stdout:9/165: sync 2024-02-15T18:31:02.733 INFO:tasks.workunit.client.0.smithi033.stdout:0/221: truncate d0/d8/d15/f3a 600195 0 2024-02-15T18:31:02.734 INFO:tasks.workunit.client.0.smithi033.stdout:5/272: rename d1/da/d11/c1e to d1/da/c4b 0 2024-02-15T18:31:02.736 INFO:tasks.workunit.client.0.smithi033.stdout:9/166: mknod d4/d2c/c42 0 2024-02-15T18:31:02.736 INFO:tasks.workunit.client.0.smithi033.stdout:0/222: creat d0/d8/f45 x:0 0 0 2024-02-15T18:31:02.736 INFO:tasks.workunit.client.0.smithi033.stdout:0/223: fsync d0/d2/f7 0 2024-02-15T18:31:02.737 INFO:tasks.workunit.client.0.smithi033.stdout:0/224: truncate d0/d8/f39 139664 0 2024-02-15T18:31:02.737 INFO:tasks.workunit.client.0.smithi033.stdout:0/225: fdatasync d0/d2/f7 0 2024-02-15T18:31:02.737 INFO:tasks.workunit.client.0.smithi033.stdout:0/226: truncate d0/d8/f38 978680 0 2024-02-15T18:31:02.737 INFO:tasks.workunit.client.0.smithi033.stdout:9/167: write d4/d8/fb [1396100,40949] 0 2024-02-15T18:31:02.738 INFO:tasks.workunit.client.0.smithi033.stdout:8/194: write d0/fe [4556110,2540] 0 2024-02-15T18:31:02.738 INFO:tasks.workunit.client.0.smithi033.stdout:7/272: dread d0/dc/d10/d48/f51 [0,4194304] 0 2024-02-15T18:31:02.738 INFO:tasks.workunit.client.0.smithi033.stdout:8/195: write d0/d2/d35/d29/f2e [185460,25078] 0 2024-02-15T18:31:02.738 INFO:tasks.workunit.client.0.smithi033.stdout:8/196: dread - d0/d1c/f3b zero size 2024-02-15T18:31:02.740 INFO:tasks.workunit.client.0.smithi033.stdout:0/227: link d0/dc/d1d/f25 d0/d2/d40/f46 0 2024-02-15T18:31:02.740 INFO:tasks.workunit.client.0.smithi033.stdout:0/228: fsync d0/d8/d15/f3a 0 2024-02-15T18:31:02.742 INFO:tasks.workunit.client.0.smithi033.stdout:8/197: creat d0/df/db/f40 x:0 0 0 2024-02-15T18:31:02.743 INFO:tasks.workunit.client.0.smithi033.stdout:5/273: dread d1/da/d11/f30 [0,4194304] 0 2024-02-15T18:31:02.746 INFO:tasks.workunit.client.0.smithi033.stdout:0/229: link d0/c27 d0/dc/c47 0 2024-02-15T18:31:02.746 INFO:tasks.workunit.client.0.smithi033.stdout:0/230: truncate d0/d8/f38 1357479 0 2024-02-15T18:31:02.747 INFO:tasks.workunit.client.0.smithi033.stdout:9/168: dread d4/d8/d1b/d2f/f30 [0,4194304] 0 2024-02-15T18:31:02.749 INFO:tasks.workunit.client.0.smithi033.stdout:0/231: mknod d0/dc/d1d/c48 0 2024-02-15T18:31:02.752 INFO:tasks.workunit.client.0.smithi033.stdout:9/169: mknod d4/d8/dd/d41/c43 0 2024-02-15T18:31:02.752 INFO:tasks.workunit.client.0.smithi033.stdout:0/232: rmdir d0/d2/d40 39 2024-02-15T18:31:02.754 INFO:tasks.workunit.client.0.smithi033.stdout:0/233: symlink d0/d8/d15/d2d/l49 0 2024-02-15T18:31:02.755 INFO:tasks.workunit.client.0.smithi033.stdout:3/247: dwrite d2/d14/f16 [4194304,4194304] 0 2024-02-15T18:31:02.755 INFO:tasks.workunit.client.0.smithi033.stdout:3/248: readlink d2/d3/d17/l31 0 2024-02-15T18:31:02.756 INFO:tasks.workunit.client.0.smithi033.stdout:0/234: unlink d0/dc/d1d/c29 0 2024-02-15T18:31:02.760 INFO:tasks.workunit.client.0.smithi033.stdout:9/170: rmdir d4/d8 39 2024-02-15T18:31:02.760 INFO:tasks.workunit.client.0.smithi033.stdout:9/171: read d4/d8/dd/f23 [3039371,75350] 0 2024-02-15T18:31:02.762 INFO:tasks.workunit.client.0.smithi033.stdout:0/235: creat d0/d8/d15/d2d/f4a x:0 0 0 2024-02-15T18:31:02.763 INFO:tasks.workunit.client.0.smithi033.stdout:9/172: symlink d4/l44 0 2024-02-15T18:31:02.769 INFO:tasks.workunit.client.0.smithi033.stdout:9/173: creat d4/f45 x:0 0 0 2024-02-15T18:31:02.770 INFO:tasks.workunit.client.0.smithi033.stdout:9/174: chown d4/d8/dd/l12 32116 1 2024-02-15T18:31:02.773 INFO:tasks.workunit.client.0.smithi033.stdout:9/175: getdents d4/d2c 0 2024-02-15T18:31:02.792 INFO:tasks.workunit.client.0.smithi033.stdout:7/273: dwrite d0/f9 [0,4194304] 0 2024-02-15T18:31:02.792 INFO:tasks.workunit.client.0.smithi033.stdout:5/274: dwrite d1/da/f2c [0,4194304] 0 2024-02-15T18:31:02.793 INFO:tasks.workunit.client.0.smithi033.stdout:0/236: dwrite d0/d2/d40/f46 [0,4194304] 0 2024-02-15T18:31:02.793 INFO:tasks.workunit.client.0.smithi033.stdout:8/198: dwrite d0/d2/f39 [0,4194304] 0 2024-02-15T18:31:02.793 INFO:tasks.workunit.client.0.smithi033.stdout:3/249: dwrite d2/f11 [0,4194304] 0 2024-02-15T18:31:02.794 INFO:tasks.workunit.client.0.smithi033.stdout:3/250: write d2/d20/f41 [647505,25846] 0 2024-02-15T18:31:02.794 INFO:tasks.workunit.client.0.smithi033.stdout:7/274: dread d0/f1b [0,4194304] 0 2024-02-15T18:31:02.794 INFO:tasks.workunit.client.0.smithi033.stdout:7/275: chown d0/dc/d10/d48/c49 25296426 1 2024-02-15T18:31:02.796 INFO:tasks.workunit.client.0.smithi033.stdout:0/237: dread d0/f10 [0,4194304] 0 2024-02-15T18:31:02.797 INFO:tasks.workunit.client.0.smithi033.stdout:5/275: getdents d1/da/d19 0 2024-02-15T18:31:02.797 INFO:tasks.workunit.client.0.smithi033.stdout:5/276: chown d1/da/d10/c35 32092 1 2024-02-15T18:31:02.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:01.523543+0000 mgr.smithi131.buibla (mgr.24387) 20 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 325 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 22 MiB/s wr, 791 op/s 2024-02-15T18:31:02.799 INFO:tasks.workunit.client.0.smithi033.stdout:8/199: write d0/d1c/f3e [4471482,65792] 0 2024-02-15T18:31:02.808 INFO:tasks.workunit.client.0.smithi033.stdout:3/251: creat d2/d20/f45 x:0 0 0 2024-02-15T18:31:02.808 INFO:tasks.workunit.client.0.smithi033.stdout:3/252: chown d2/fa 1252258 1 2024-02-15T18:31:02.808 INFO:tasks.workunit.client.0.smithi033.stdout:3/253: fdatasync d2/d14/f37 0 2024-02-15T18:31:02.809 INFO:tasks.workunit.client.0.smithi033.stdout:8/200: creat d0/d2/f41 x:0 0 0 2024-02-15T18:31:02.809 INFO:tasks.workunit.client.0.smithi033.stdout:8/201: dread - d0/df/db/f40 zero size 2024-02-15T18:31:02.812 INFO:tasks.workunit.client.0.smithi033.stdout:8/202: read d0/df/f38 [3981748,119097] 0 2024-02-15T18:31:02.812 INFO:tasks.workunit.client.0.smithi033.stdout:8/203: chown d0/l7 36 1 2024-02-15T18:31:02.812 INFO:tasks.workunit.client.0.smithi033.stdout:8/204: dread - d0/df/db/f40 zero size 2024-02-15T18:31:02.812 INFO:tasks.workunit.client.0.smithi033.stdout:8/205: fsync d0/d2/d14/f32 0 2024-02-15T18:31:02.813 INFO:tasks.workunit.client.0.smithi033.stdout:8/206: mknod d0/d2/d35/c42 0 2024-02-15T18:31:02.813 INFO:tasks.workunit.client.0.smithi033.stdout:8/207: mknod d0/df/db/d1b/c43 0 2024-02-15T18:31:02.818 INFO:tasks.workunit.client.0.smithi033.stdout:3/254: dread d2/d14/f16 [4194304,4194304] 0 2024-02-15T18:31:02.821 INFO:tasks.workunit.client.0.smithi033.stdout:5/277: dwrite d1/da/f2c [0,4194304] 0 2024-02-15T18:31:02.821 INFO:tasks.workunit.client.0.smithi033.stdout:4/327: sync 2024-02-15T18:31:02.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/238: dwrite d0/d2/f3 [0,4194304] 0 2024-02-15T18:31:02.823 INFO:tasks.workunit.client.0.smithi033.stdout:4/328: dread d4/d5/d28/f47 [0,4194304] 0 2024-02-15T18:31:02.823 INFO:tasks.workunit.client.0.smithi033.stdout:5/278: mkdir d1/da/d10/d2b/d42/d4c 0 2024-02-15T18:31:02.824 INFO:tasks.workunit.client.0.smithi033.stdout:0/239: getdents d0/d2/d40 0 2024-02-15T18:31:02.825 INFO:tasks.workunit.client.0.smithi033.stdout:4/329: symlink d4/d20/d13/d5c/l6b 0 2024-02-15T18:31:02.825 INFO:tasks.workunit.client.0.smithi033.stdout:4/330: truncate d4/d20/f26 1241209 0 2024-02-15T18:31:02.827 INFO:tasks.workunit.client.0.smithi033.stdout:5/279: creat d1/da/d10/d2b/f4d x:0 0 0 2024-02-15T18:31:02.827 INFO:tasks.workunit.client.0.smithi033.stdout:5/280: chown d1/da/d19/d3c/d40/c38 73587 1 2024-02-15T18:31:02.827 INFO:tasks.workunit.client.0.smithi033.stdout:0/240: mkdir d0/d8/d15/d4b 0 2024-02-15T18:31:02.827 INFO:tasks.workunit.client.0.smithi033.stdout:0/241: write d0/d8/d15/d2d/f4a [22993,96593] 0 2024-02-15T18:31:02.839 INFO:tasks.workunit.client.0.smithi033.stdout:4/331: dread d4/d20/f27 [0,4194304] 0 2024-02-15T18:31:02.842 INFO:tasks.workunit.client.0.smithi033.stdout:4/332: rmdir d4/d20/d13/d5b 0 2024-02-15T18:31:02.842 INFO:tasks.workunit.client.0.smithi033.stdout:4/333: rename d4/d20/d53 to d4/d20/d53/d6c 22 2024-02-15T18:31:02.843 INFO:tasks.workunit.client.0.smithi033.stdout:4/334: read d4/d5/f25 [3484856,31383] 0 2024-02-15T18:31:02.844 INFO:tasks.workunit.client.0.smithi033.stdout:4/335: rename d4/d20/d13/d5c/l6b to d4/d5/d28/d39/l6d 0 2024-02-15T18:31:02.845 INFO:tasks.workunit.client.0.smithi033.stdout:4/336: creat d4/d20/d13/f6e x:0 0 0 2024-02-15T18:31:02.854 INFO:tasks.workunit.client.0.smithi033.stdout:5/281: dwrite d1/da/d11/f30 [0,4194304] 0 2024-02-15T18:31:02.866 INFO:tasks.workunit.client.0.smithi033.stdout:0/242: dwrite d0/d8/f37 [0,4194304] 0 2024-02-15T18:31:02.867 INFO:tasks.workunit.client.0.smithi033.stdout:4/337: dwrite d4/d3c/f51 [0,4194304] 0 2024-02-15T18:31:02.867 INFO:tasks.workunit.client.0.smithi033.stdout:4/338: stat d4/d5/f24 0 2024-02-15T18:31:02.869 INFO:tasks.workunit.client.0.smithi033.stdout:0/243: symlink d0/d2/d40/l4c 0 2024-02-15T18:31:02.869 INFO:tasks.workunit.client.0.smithi033.stdout:5/282: getdents d1/da/d10/d2b/d42 0 2024-02-15T18:31:02.872 INFO:tasks.workunit.client.0.smithi033.stdout:2/294: sync 2024-02-15T18:31:02.873 INFO:tasks.workunit.client.0.smithi033.stdout:6/261: sync 2024-02-15T18:31:02.873 INFO:tasks.workunit.client.0.smithi033.stdout:2/295: fdatasync d20/d3a/d4a/d5e/f61 0 2024-02-15T18:31:02.873 INFO:tasks.workunit.client.0.smithi033.stdout:6/262: write d8/d28/d14/d2c/d31/d30/f2d [951000,28103] 0 2024-02-15T18:31:02.873 INFO:tasks.workunit.client.0.smithi033.stdout:2/296: write f5 [6098373,116421] 0 2024-02-15T18:31:02.873 INFO:tasks.workunit.client.0.smithi033.stdout:2/297: chown d20/f21 133407 1 2024-02-15T18:31:02.874 INFO:tasks.workunit.client.0.smithi033.stdout:4/339: rmdir d4/d20/d13/d34 39 2024-02-15T18:31:02.875 INFO:tasks.workunit.client.0.smithi033.stdout:0/244: mknod d0/dc/d1d/c4d 0 2024-02-15T18:31:02.876 INFO:tasks.workunit.client.0.smithi033.stdout:5/283: rmdir d1/da/d11 39 2024-02-15T18:31:02.877 INFO:tasks.workunit.client.0.smithi033.stdout:0/245: write d0/f13 [1190974,58327] 0 2024-02-15T18:31:02.878 INFO:tasks.workunit.client.0.smithi033.stdout:1/273: sync 2024-02-15T18:31:02.878 INFO:tasks.workunit.client.0.smithi033.stdout:1/274: fsync d5/d9/d1e/d41/f21 0 2024-02-15T18:31:02.880 INFO:tasks.workunit.client.0.smithi033.stdout:2/298: symlink d20/d31/d47/d4c/l6e 0 2024-02-15T18:31:02.881 INFO:tasks.workunit.client.0.smithi033.stdout:4/340: link d4/d5/d28/c2d d4/d20/d13/d1b/c6f 0 2024-02-15T18:31:02.881 INFO:tasks.workunit.client.0.smithi033.stdout:6/263: dread d8/d28/d14/f34 [0,4194304] 0 2024-02-15T18:31:02.882 INFO:tasks.workunit.client.0.smithi033.stdout:4/341: read d4/d5/f1e [1788750,29348] 0 2024-02-15T18:31:02.882 INFO:tasks.workunit.client.0.smithi033.stdout:1/275: creat d5/d9/d1e/d20/d2c/f46 x:0 0 0 2024-02-15T18:31:02.883 INFO:tasks.workunit.client.0.smithi033.stdout:2/299: mknod d20/d3a/d4a/d5e/d6b/c6f 0 2024-02-15T18:31:02.883 INFO:tasks.workunit.client.0.smithi033.stdout:6/264: dread d8/d28/f46 [0,4194304] 0 2024-02-15T18:31:02.884 INFO:tasks.workunit.client.0.smithi033.stdout:1/276: mkdir d5/dd/d12/d47 0 2024-02-15T18:31:02.885 INFO:tasks.workunit.client.0.smithi033.stdout:2/300: mknod d20/d30/c70 0 2024-02-15T18:31:02.887 INFO:tasks.workunit.client.0.smithi033.stdout:5/284: dread d1/f4 [0,4194304] 0 2024-02-15T18:31:02.887 INFO:tasks.workunit.client.0.smithi033.stdout:1/277: symlink d5/d9/d1e/d20/d2c/l48 0 2024-02-15T18:31:02.888 INFO:tasks.workunit.client.0.smithi033.stdout:2/301: mknod d20/d30/c71 0 2024-02-15T18:31:02.889 INFO:tasks.workunit.client.0.smithi033.stdout:5/285: creat d1/da/d19/d3c/d40/f4e x:0 0 0 2024-02-15T18:31:02.889 INFO:tasks.workunit.client.0.smithi033.stdout:5/286: chown d1/f4 1713979223 1 2024-02-15T18:31:02.890 INFO:tasks.workunit.client.0.smithi033.stdout:5/287: dread - d1/da/d19/d3c/f47 zero size 2024-02-15T18:31:02.890 INFO:tasks.workunit.client.0.smithi033.stdout:5/288: readlink d1/da/d19/l3b 0 2024-02-15T18:31:02.890 INFO:tasks.workunit.client.0.smithi033.stdout:5/289: fsync d1/da/f1f 0 2024-02-15T18:31:02.890 INFO:tasks.workunit.client.0.smithi033.stdout:1/278: getdents d5/d17/d27 0 2024-02-15T18:31:02.891 INFO:tasks.workunit.client.0.smithi033.stdout:2/302: creat d20/d31/d6a/f72 x:0 0 0 2024-02-15T18:31:02.892 INFO:tasks.workunit.client.0.smithi033.stdout:2/303: mkdir d20/d73 0 2024-02-15T18:31:02.898 INFO:tasks.workunit.client.0.smithi033.stdout:1/279: dread d5/d9/d1e/d41/d23/f26 [0,4194304] 0 2024-02-15T18:31:02.900 INFO:tasks.workunit.client.0.smithi033.stdout:5/290: dread d1/da/f1b [0,4194304] 0 2024-02-15T18:31:02.901 INFO:tasks.workunit.client.0.smithi033.stdout:1/280: getdents d5 0 2024-02-15T18:31:02.902 INFO:tasks.workunit.client.0.smithi033.stdout:6/265: dwrite d8/d1d/f1b [0,4194304] 0 2024-02-15T18:31:02.902 INFO:tasks.workunit.client.0.smithi033.stdout:1/281: write d5/f8 [373010,27273] 0 2024-02-15T18:31:02.902 INFO:tasks.workunit.client.0.smithi033.stdout:5/291: symlink d1/da/d19/l4f 0 2024-02-15T18:31:02.907 INFO:tasks.workunit.client.0.smithi033.stdout:6/266: mkdir d8/d28/d14/d2c/d31/d5d 0 2024-02-15T18:31:02.908 INFO:tasks.workunit.client.0.smithi033.stdout:6/267: truncate d8/d28/d14/d2c/d31/d30/f2d 3235256 0 2024-02-15T18:31:02.909 INFO:tasks.workunit.client.0.smithi033.stdout:1/282: dread d5/d17/d27/f39 [0,4194304] 0 2024-02-15T18:31:02.911 INFO:tasks.workunit.client.0.smithi033.stdout:1/283: rename d5/d9/d1e/d41 to d5/dd/d12/d49 0 2024-02-15T18:31:02.912 INFO:tasks.workunit.client.0.smithi033.stdout:2/304: dwrite d20/d31/d6a/f26 [0,4194304] 0 2024-02-15T18:31:02.915 INFO:tasks.workunit.client.0.smithi033.stdout:2/305: creat d20/d3a/d4a/f74 x:0 0 0 2024-02-15T18:31:02.916 INFO:tasks.workunit.client.0.smithi033.stdout:2/306: chown d20/d31/d47/l54 49 1 2024-02-15T18:31:02.918 INFO:tasks.workunit.client.0.smithi033.stdout:2/307: rename d20/d3a/d4a/f5f to d20/d3a/f75 0 2024-02-15T18:31:02.918 INFO:tasks.workunit.client.0.smithi033.stdout:2/308: fsync fd 0 2024-02-15T18:31:02.920 INFO:tasks.workunit.client.0.smithi033.stdout:5/292: dread d1/da/d11/f2d [0,4194304] 0 2024-02-15T18:31:02.922 INFO:tasks.workunit.client.0.smithi033.stdout:5/293: rmdir d1/da/d10/d2b 39 2024-02-15T18:31:02.925 INFO:tasks.workunit.client.0.smithi033.stdout:5/294: symlink d1/da/d10/l50 0 2024-02-15T18:31:02.927 INFO:tasks.workunit.client.0.smithi033.stdout:5/295: link d1/da/d19/f22 d1/da/d10/d2b/d33/f51 0 2024-02-15T18:31:02.928 INFO:tasks.workunit.client.0.smithi033.stdout:5/296: mkdir d1/da/d52 0 2024-02-15T18:31:02.929 INFO:tasks.workunit.client.0.smithi033.stdout:5/297: getdents d1/da/d19/d3c/d40 0 2024-02-15T18:31:02.933 INFO:tasks.workunit.client.0.smithi033.stdout:6/268: dwrite d8/d28/d36/f4a [0,4194304] 0 2024-02-15T18:31:02.936 INFO:tasks.workunit.client.0.smithi033.stdout:2/309: dwrite d20/d3a/f75 [0,4194304] 0 2024-02-15T18:31:02.936 INFO:tasks.workunit.client.0.smithi033.stdout:6/269: mkdir d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e 0 2024-02-15T18:31:02.936 INFO:tasks.workunit.client.0.smithi033.stdout:6/270: chown d8/d1d/d2a/d57 446 1 2024-02-15T18:31:02.938 INFO:tasks.workunit.client.0.smithi033.stdout:2/310: creat d20/d3a/d4a/d5e/f76 x:0 0 0 2024-02-15T18:31:02.938 INFO:tasks.workunit.client.0.smithi033.stdout:2/311: readlink d20/d31/d47/l54 0 2024-02-15T18:31:02.947 INFO:tasks.workunit.client.0.smithi033.stdout:5/298: dwrite d1/da/fb [0,4194304] 0 2024-02-15T18:31:02.947 INFO:tasks.workunit.client.0.smithi033.stdout:5/299: readlink d1/da/d19/d3c/d40/d46/l4a 0 2024-02-15T18:31:02.963 INFO:tasks.workunit.client.0.smithi033.stdout:6/271: dwrite d8/d28/d36/f4a [0,4194304] 0 2024-02-15T18:31:02.965 INFO:tasks.workunit.client.0.smithi033.stdout:5/300: dwrite d1/da/d19/f34 [0,4194304] 0 2024-02-15T18:31:02.965 INFO:tasks.workunit.client.0.smithi033.stdout:5/301: dread - d1/f2a zero size 2024-02-15T18:31:02.966 INFO:tasks.workunit.client.0.smithi033.stdout:5/302: truncate d1/da/f24 657902 0 2024-02-15T18:31:02.966 INFO:tasks.workunit.client.0.smithi033.stdout:5/303: chown d1/da/d19/d3f 319871 1 2024-02-15T18:31:02.967 INFO:tasks.workunit.client.0.smithi033.stdout:6/272: mknod d8/d1d/d37/c5f 0 2024-02-15T18:31:02.969 INFO:tasks.workunit.client.0.smithi033.stdout:5/304: link d1/da/d11/f2d d1/da/d10/d2b/d42/d4c/f53 0 2024-02-15T18:31:02.970 INFO:tasks.workunit.client.0.smithi033.stdout:6/273: mkdir d8/d1d/d2a/d55/d60 0 2024-02-15T18:31:02.970 INFO:tasks.workunit.client.0.smithi033.stdout:9/176: sync 2024-02-15T18:31:02.971 INFO:tasks.workunit.client.0.smithi033.stdout:7/276: sync 2024-02-15T18:31:02.971 INFO:tasks.workunit.client.0.smithi033.stdout:7/277: read d0/f1b [715929,43667] 0 2024-02-15T18:31:02.971 INFO:tasks.workunit.client.0.smithi033.stdout:7/278: dread - d0/dc/d10/d1d/f2d zero size 2024-02-15T18:31:02.972 INFO:tasks.workunit.client.0.smithi033.stdout:7/279: unlink d0/dc/l20 0 2024-02-15T18:31:02.973 INFO:tasks.workunit.client.0.smithi033.stdout:6/274: dread d8/d28/f18 [0,4194304] 0 2024-02-15T18:31:02.973 INFO:tasks.workunit.client.0.smithi033.stdout:6/275: write d8/d28/d14/f24 [460665,53172] 0 2024-02-15T18:31:02.973 INFO:tasks.workunit.client.0.smithi033.stdout:6/276: chown d8/d28/d14/d2c/d31/d30/d29/f59 108318670 1 2024-02-15T18:31:02.974 INFO:tasks.workunit.client.0.smithi033.stdout:7/280: dread d0/f1b [0,4194304] 0 2024-02-15T18:31:02.974 INFO:tasks.workunit.client.0.smithi033.stdout:7/281: read - d0/dc/d10/d1d/f34 zero size 2024-02-15T18:31:02.975 INFO:tasks.workunit.client.0.smithi033.stdout:7/282: symlink d0/dc/d10/d1d/l57 0 2024-02-15T18:31:02.976 INFO:tasks.workunit.client.0.smithi033.stdout:7/283: link d0/dc/l12 d0/dc/d10/d1d/d38/d3a/l58 0 2024-02-15T18:31:02.977 INFO:tasks.workunit.client.0.smithi033.stdout:7/284: write d0/f9 [1358561,90796] 0 2024-02-15T18:31:02.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/285: link d0/fd d0/dc/d10/d48/f59 0 2024-02-15T18:31:02.981 INFO:tasks.workunit.client.0.smithi033.stdout:6/277: read d8/d28/f17 [3471314,115500] 0 2024-02-15T18:31:02.992 INFO:tasks.workunit.client.0.smithi033.stdout:6/278: dread d8/d1d/f1b [0,4194304] 0 2024-02-15T18:31:02.993 INFO:tasks.workunit.client.0.smithi033.stdout:9/177: dwrite d4/d8/dd/f13 [0,4194304] 0 2024-02-15T18:31:02.995 INFO:tasks.workunit.client.0.smithi033.stdout:9/178: link d4/f45 d4/d8/f46 0 2024-02-15T18:31:02.996 INFO:tasks.workunit.client.0.smithi033.stdout:9/179: rename d4/d8/dd/c37 to d4/c47 0 2024-02-15T18:31:02.996 INFO:tasks.workunit.client.0.smithi033.stdout:9/180: chown d4/d32/f3b 2088031 1 2024-02-15T18:31:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:01.523543+0000 mgr.smithi131.buibla (mgr.24387) 20 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 325 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 22 MiB/s wr, 791 op/s 2024-02-15T18:31:03.000 INFO:tasks.workunit.client.0.smithi033.stdout:5/305: dwrite d1/da/d10/d2b/f3d [0,4194304] 0 2024-02-15T18:31:03.000 INFO:tasks.workunit.client.0.smithi033.stdout:9/181: dread d4/d8/dd/f15 [0,4194304] 0 2024-02-15T18:31:03.002 INFO:tasks.workunit.client.0.smithi033.stdout:5/306: symlink d1/da/d10/d2b/l54 0 2024-02-15T18:31:03.002 INFO:tasks.workunit.client.0.smithi033.stdout:5/307: fdatasync d1/da/f24 0 2024-02-15T18:31:03.002 INFO:tasks.workunit.client.0.smithi033.stdout:9/182: rmdir d4/d8 39 2024-02-15T18:31:03.004 INFO:tasks.workunit.client.0.smithi033.stdout:5/308: rename d1/da/d19/d3c/f47 to d1/da/f55 0 2024-02-15T18:31:03.004 INFO:tasks.workunit.client.0.smithi033.stdout:5/309: stat d1/da/d19/d3c/c45 0 2024-02-15T18:31:03.004 INFO:tasks.workunit.client.0.smithi033.stdout:9/183: chown d4/d8/dd/fe 60 1 2024-02-15T18:31:03.006 INFO:tasks.workunit.client.0.smithi033.stdout:5/310: mknod d1/c56 0 2024-02-15T18:31:03.006 INFO:tasks.workunit.client.0.smithi033.stdout:5/311: stat d1/da/d19/d3f/l43 0 2024-02-15T18:31:03.006 INFO:tasks.workunit.client.0.smithi033.stdout:5/312: write d1/da/d10/f1d [1667319,50624] 0 2024-02-15T18:31:03.009 INFO:tasks.workunit.client.0.smithi033.stdout:6/279: dwrite d8/d28/d14/f24 [0,4194304] 0 2024-02-15T18:31:03.009 INFO:tasks.workunit.client.0.smithi033.stdout:6/280: dread - d8/f4e zero size 2024-02-15T18:31:03.011 INFO:tasks.workunit.client.0.smithi033.stdout:6/281: rename d8/d28/d14/f24 to d8/d28/d14/d2c/f61 0 2024-02-15T18:31:03.011 INFO:tasks.workunit.client.0.smithi033.stdout:5/313: write d1/da/d10/d2b/d42/d4c/f53 [595209,57602] 0 2024-02-15T18:31:03.011 INFO:tasks.workunit.client.0.smithi033.stdout:5/314: chown d1/da/d10/l50 918308 1 2024-02-15T18:31:03.019 INFO:tasks.workunit.client.0.smithi033.stdout:5/315: dread d1/da/d11/f30 [0,4194304] 0 2024-02-15T18:31:03.019 INFO:tasks.workunit.client.0.smithi033.stdout:5/316: fdatasync d1/da/f41 0 2024-02-15T18:31:03.021 INFO:tasks.workunit.client.0.smithi033.stdout:5/317: creat d1/da/d19/f57 x:0 0 0 2024-02-15T18:31:03.021 INFO:tasks.workunit.client.0.smithi033.stdout:5/318: truncate d1/da/f37 1129453 0 2024-02-15T18:31:03.021 INFO:tasks.workunit.client.0.smithi033.stdout:5/319: truncate d1/da/d10/f1d 2176451 0 2024-02-15T18:31:03.022 INFO:tasks.workunit.client.0.smithi033.stdout:5/320: creat d1/da/d19/d3c/d40/f58 x:0 0 0 2024-02-15T18:31:03.023 INFO:tasks.workunit.client.0.smithi033.stdout:5/321: mknod d1/da/d10/d2b/d42/d4c/c59 0 2024-02-15T18:31:03.023 INFO:tasks.workunit.client.0.smithi033.stdout:5/322: fsync d1/da/d10/d2b/d33/f51 0 2024-02-15T18:31:03.025 INFO:tasks.workunit.client.0.smithi033.stdout:9/184: dwrite d4/d8/dd/f36 [0,4194304] 0 2024-02-15T18:31:03.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/323: fsync d1/da/d10/f1d 0 2024-02-15T18:31:03.027 INFO:tasks.workunit.client.0.smithi033.stdout:5/324: chown d1/da/c4b 1788080 1 2024-02-15T18:31:03.027 INFO:tasks.workunit.client.0.smithi033.stdout:5/325: fdatasync d1/da/d19/f3a 0 2024-02-15T18:31:03.027 INFO:tasks.workunit.client.0.smithi033.stdout:9/185: link d4/c7 d4/d8/d1b/d2f/c48 0 2024-02-15T18:31:03.027 INFO:tasks.workunit.client.0.smithi033.stdout:5/326: write d1/da/d10/d2b/d42/d4c/f53 [3338174,45746] 0 2024-02-15T18:31:03.028 INFO:tasks.workunit.client.0.smithi033.stdout:9/186: mknod d4/d8/dd/d28/c49 0 2024-02-15T18:31:03.034 INFO:tasks.workunit.client.0.smithi033.stdout:6/282: dwrite d8/f1a [4194304,4194304] 0 2024-02-15T18:31:03.038 INFO:tasks.workunit.client.0.smithi033.stdout:6/283: creat d8/d28/d14/d2c/d31/d30/d29/f62 x:0 0 0 2024-02-15T18:31:03.038 INFO:tasks.workunit.client.0.smithi033.stdout:6/284: chown d8/d1d/d37/c5f 0 1 2024-02-15T18:31:03.039 INFO:tasks.workunit.client.0.smithi033.stdout:6/285: dread d8/d28/d14/d2c/d31/f27 [0,4194304] 0 2024-02-15T18:31:03.040 INFO:tasks.workunit.client.0.smithi033.stdout:6/286: stat d8/f5b 0 2024-02-15T18:31:03.041 INFO:tasks.workunit.client.0.smithi033.stdout:6/287: mkdir d8/d1d/d2a/d55/d63 0 2024-02-15T18:31:03.043 INFO:tasks.workunit.client.0.smithi033.stdout:6/288: dread d8/d28/d14/d2c/d31/f27 [0,4194304] 0 2024-02-15T18:31:03.043 INFO:tasks.workunit.client.0.smithi033.stdout:6/289: stat d8/d28/d14/d2c/d3b/f49 0 2024-02-15T18:31:03.044 INFO:tasks.workunit.client.0.smithi033.stdout:6/290: symlink d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/l64 0 2024-02-15T18:31:03.044 INFO:tasks.workunit.client.0.smithi033.stdout:6/291: symlink d8/d1d/d37/l65 0 2024-02-15T18:31:03.045 INFO:tasks.workunit.client.0.smithi033.stdout:6/292: getdents d8/d28/d14/d2c/d31/d30/d29/d38/d54 0 2024-02-15T18:31:03.046 INFO:tasks.workunit.client.0.smithi033.stdout:6/293: symlink d8/d1d/d37/d4f/l66 0 2024-02-15T18:31:03.047 INFO:tasks.workunit.client.0.smithi033.stdout:6/294: mkdir d8/d28/d14/d2c/d31/d30/d29/d67 0 2024-02-15T18:31:03.047 INFO:tasks.workunit.client.0.smithi033.stdout:6/295: dread - d8/d28/d14/d2c/d31/d30/d29/f59 zero size 2024-02-15T18:31:03.048 INFO:tasks.workunit.client.0.smithi033.stdout:6/296: link d8/d28/d14/d2c/d31/c2b d8/d28/c68 0 2024-02-15T18:31:03.048 INFO:tasks.workunit.client.0.smithi033.stdout:6/297: chown d8/d28/d14/d2c/d31/d30/d29 224355 1 2024-02-15T18:31:03.048 INFO:tasks.workunit.client.0.smithi033.stdout:9/187: dwrite d4/d8/dd/f3d [0,4194304] 0 2024-02-15T18:31:03.048 INFO:tasks.workunit.client.0.smithi033.stdout:9/188: readlink d4/d8/dd/l12 0 2024-02-15T18:31:03.049 INFO:tasks.workunit.client.0.smithi033.stdout:9/189: chown d4/d8/d1b/d2f/f30 176 1 2024-02-15T18:31:03.049 INFO:tasks.workunit.client.0.smithi033.stdout:6/298: link d8/d28/d36/f50 d8/d28/d36/f69 0 2024-02-15T18:31:03.050 INFO:tasks.workunit.client.0.smithi033.stdout:6/299: write d8/d28/d14/f43 [3133141,96303] 0 2024-02-15T18:31:03.051 INFO:tasks.workunit.client.0.smithi033.stdout:9/190: creat d4/d8/d1b/f4a x:0 0 0 2024-02-15T18:31:03.051 INFO:tasks.workunit.client.0.smithi033.stdout:9/191: readlink d4/d8/dd/l12 0 2024-02-15T18:31:03.052 INFO:tasks.workunit.client.0.smithi033.stdout:6/300: truncate d8/d28/f35 3015101 0 2024-02-15T18:31:03.052 INFO:tasks.workunit.client.0.smithi033.stdout:5/327: dwrite d1/da/d19/f57 [0,4194304] 0 2024-02-15T18:31:03.052 INFO:tasks.workunit.client.0.smithi033.stdout:6/301: chown d8/d1d/d2a/d55/l5c 17 1 2024-02-15T18:31:03.056 INFO:tasks.workunit.client.0.smithi033.stdout:6/302: write d8/d28/f17 [2432917,30585] 0 2024-02-15T18:31:03.056 INFO:tasks.workunit.client.0.smithi033.stdout:6/303: stat d8/d28/f17 0 2024-02-15T18:31:03.056 INFO:tasks.workunit.client.0.smithi033.stdout:5/328: write d1/da/d11/f30 [3598456,71944] 0 2024-02-15T18:31:03.064 INFO:tasks.workunit.client.0.smithi033.stdout:6/304: dread d8/d1d/f1b [0,4194304] 0 2024-02-15T18:31:03.065 INFO:tasks.workunit.client.0.smithi033.stdout:6/305: creat d8/d28/d14/d2c/d31/d30/d29/d38/f6a x:0 0 0 2024-02-15T18:31:03.065 INFO:tasks.workunit.client.0.smithi033.stdout:6/306: dread - d8/d28/d14/d2c/d31/d30/d29/d38/f6a zero size 2024-02-15T18:31:03.066 INFO:tasks.workunit.client.0.smithi033.stdout:6/307: symlink d8/d1d/d37/d4f/l6b 0 2024-02-15T18:31:03.066 INFO:tasks.workunit.client.0.smithi033.stdout:6/308: readlink d8/d28/l12 0 2024-02-15T18:31:03.077 INFO:tasks.workunit.client.0.smithi033.stdout:5/329: dwrite d1/f2a [0,4194304] 0 2024-02-15T18:31:03.078 INFO:tasks.workunit.client.0.smithi033.stdout:9/192: dwrite d4/d2c/f40 [0,4194304] 0 2024-02-15T18:31:03.084 INFO:tasks.workunit.client.0.smithi033.stdout:5/330: dread d1/da/d11/f30 [0,4194304] 0 2024-02-15T18:31:03.085 INFO:tasks.workunit.client.0.smithi033.stdout:5/331: stat d1/da/f41 0 2024-02-15T18:31:03.085 INFO:tasks.workunit.client.0.smithi033.stdout:5/332: dread - d1/da/f55 zero size 2024-02-15T18:31:03.085 INFO:tasks.workunit.client.0.smithi033.stdout:3/255: sync 2024-02-15T18:31:03.085 INFO:tasks.workunit.client.0.smithi033.stdout:8/208: sync 2024-02-15T18:31:03.085 INFO:tasks.workunit.client.0.smithi033.stdout:3/256: truncate d2/d14/d23/f43 531473 0 2024-02-15T18:31:03.086 INFO:tasks.workunit.client.0.smithi033.stdout:3/257: mknod d2/d3/c46 0 2024-02-15T18:31:03.086 INFO:tasks.workunit.client.0.smithi033.stdout:3/258: write d2/d14/d23/f28 [860630,41579] 0 2024-02-15T18:31:03.086 INFO:tasks.workunit.client.0.smithi033.stdout:3/259: chown d2/d14/f2b 0 1 2024-02-15T18:31:03.098 INFO:tasks.workunit.client.0.smithi033.stdout:8/209: dread d0/df/db/fc [0,4194304] 0 2024-02-15T18:31:03.099 INFO:tasks.workunit.client.0.smithi033.stdout:8/210: link d0/d1c/d30/l3d d0/d2/l44 0 2024-02-15T18:31:03.100 INFO:tasks.workunit.client.0.smithi033.stdout:9/193: dwrite d4/d8/dd/d28/f2b [0,4194304] 0 2024-02-15T18:31:03.102 INFO:tasks.workunit.client.0.smithi033.stdout:9/194: rmdir d4/d8/d1b 39 2024-02-15T18:31:03.102 INFO:tasks.workunit.client.0.smithi033.stdout:9/195: dread - d4/d8/f46 zero size 2024-02-15T18:31:03.102 INFO:tasks.workunit.client.0.smithi033.stdout:9/196: dread - d4/d8/dd/f39 zero size 2024-02-15T18:31:03.119 INFO:tasks.workunit.client.0.smithi033.stdout:5/333: dwrite d1/da/d19/f3e [0,4194304] 0 2024-02-15T18:31:03.119 INFO:tasks.workunit.client.0.smithi033.stdout:3/260: dwrite d2/f2e [4194304,4194304] 0 2024-02-15T18:31:03.120 INFO:tasks.workunit.client.0.smithi033.stdout:8/211: dwrite d0/df/f2c [0,4194304] 0 2024-02-15T18:31:03.122 INFO:tasks.workunit.client.0.smithi033.stdout:5/334: unlink d1/da/d19/l4f 0 2024-02-15T18:31:03.122 INFO:tasks.workunit.client.0.smithi033.stdout:5/335: dread - d1/da/d19/f22 zero size 2024-02-15T18:31:03.122 INFO:tasks.workunit.client.0.smithi033.stdout:5/336: chown d1/f2a 4809 1 2024-02-15T18:31:03.125 INFO:tasks.workunit.client.0.smithi033.stdout:3/261: symlink d2/d3/d1e/d22/l47 0 2024-02-15T18:31:03.127 INFO:tasks.workunit.client.0.smithi033.stdout:8/212: mkdir d0/df/db/d45 0 2024-02-15T18:31:03.128 INFO:tasks.workunit.client.0.smithi033.stdout:7/286: sync 2024-02-15T18:31:03.128 INFO:tasks.workunit.client.0.smithi033.stdout:2/312: sync 2024-02-15T18:31:03.129 INFO:tasks.workunit.client.0.smithi033.stdout:0/246: sync 2024-02-15T18:31:03.129 INFO:tasks.workunit.client.0.smithi033.stdout:1/284: sync 2024-02-15T18:31:03.129 INFO:tasks.workunit.client.0.smithi033.stdout:4/342: sync 2024-02-15T18:31:03.129 INFO:tasks.workunit.client.0.smithi033.stdout:0/247: truncate d0/d8/d15/d2d/f4a 803442 0 2024-02-15T18:31:03.129 INFO:tasks.workunit.client.0.smithi033.stdout:1/285: write d5/d17/f35 [463625,2467] 0 2024-02-15T18:31:03.132 INFO:tasks.workunit.client.0.smithi033.stdout:3/262: truncate d2/d14/f44 2140144 0 2024-02-15T18:31:03.132 INFO:tasks.workunit.client.0.smithi033.stdout:6/309: sync 2024-02-15T18:31:03.134 INFO:tasks.workunit.client.0.smithi033.stdout:6/310: read d8/d28/d14/d2c/d3b/d3d/f48 [2807498,114756] 0 2024-02-15T18:31:03.134 INFO:tasks.workunit.client.0.smithi033.stdout:8/213: creat d0/d2/d35/d29/f46 x:0 0 0 2024-02-15T18:31:03.134 INFO:tasks.workunit.client.0.smithi033.stdout:8/214: readlink d0/d2/l1e 0 2024-02-15T18:31:03.136 INFO:tasks.workunit.client.0.smithi033.stdout:2/313: rmdir d20/d31 39 2024-02-15T18:31:03.136 INFO:tasks.workunit.client.0.smithi033.stdout:2/314: dread - d20/d3a/d4a/f52 zero size 2024-02-15T18:31:03.138 INFO:tasks.workunit.client.0.smithi033.stdout:7/287: getdents d0/dc/d10/d1d/d2b 0 2024-02-15T18:31:03.138 INFO:tasks.workunit.client.0.smithi033.stdout:7/288: fsync d0/f1b 0 2024-02-15T18:31:03.139 INFO:tasks.workunit.client.0.smithi033.stdout:0/248: mknod d0/d2/c4e 0 2024-02-15T18:31:03.140 INFO:tasks.workunit.client.0.smithi033.stdout:5/337: mknod d1/c5a 0 2024-02-15T18:31:03.140 INFO:tasks.workunit.client.0.smithi033.stdout:6/311: mknod d8/d1d/d37/c6c 0 2024-02-15T18:31:03.140 INFO:tasks.workunit.client.0.smithi033.stdout:6/312: chown d8/d28/d14/d2c/f61 58 1 2024-02-15T18:31:03.141 INFO:tasks.workunit.client.0.smithi033.stdout:8/215: symlink d0/l47 0 2024-02-15T18:31:03.141 INFO:tasks.workunit.client.0.smithi033.stdout:8/216: chown d0/l7 35 1 2024-02-15T18:31:03.142 INFO:tasks.workunit.client.0.smithi033.stdout:2/315: creat d20/f77 x:0 0 0 2024-02-15T18:31:03.142 INFO:tasks.workunit.client.0.smithi033.stdout:2/316: stat d20/d31/d6a/f2e 0 2024-02-15T18:31:03.142 INFO:tasks.workunit.client.0.smithi033.stdout:2/317: dread - d20/d3a/f68 zero size 2024-02-15T18:31:03.144 INFO:tasks.workunit.client.0.smithi033.stdout:7/289: rename d0/dc/d10/d1d/f4f to d0/dc/d10/d1d/d2b/f5a 0 2024-02-15T18:31:03.147 INFO:tasks.workunit.client.0.smithi033.stdout:0/249: truncate d0/dc/d1d/f21 4071434 0 2024-02-15T18:31:03.147 INFO:tasks.workunit.client.0.smithi033.stdout:0/250: read - d0/d8/f42 zero size 2024-02-15T18:31:03.147 INFO:tasks.workunit.client.0.smithi033.stdout:5/338: link d1/da/d10/d2b/f3d d1/da/d52/f5b 0 2024-02-15T18:31:03.149 INFO:tasks.workunit.client.0.smithi033.stdout:6/313: link d8/d28/d36/c51 d8/d1d/d2a/d55/d63/c6d 0 2024-02-15T18:31:03.149 INFO:tasks.workunit.client.0.smithi033.stdout:5/339: read d1/da/d10/d2b/f48 [2291812,38198] 0 2024-02-15T18:31:03.150 INFO:tasks.workunit.client.0.smithi033.stdout:5/340: chown d1/da/d10 319555 1 2024-02-15T18:31:03.150 INFO:tasks.workunit.client.0.smithi033.stdout:8/217: mkdir d0/df/d48 0 2024-02-15T18:31:03.150 INFO:tasks.workunit.client.0.smithi033.stdout:8/218: readlink d0/df/db/d1b/l37 0 2024-02-15T18:31:03.150 INFO:tasks.workunit.client.0.smithi033.stdout:8/219: stat d0/df 0 2024-02-15T18:31:03.151 INFO:tasks.workunit.client.0.smithi033.stdout:2/318: symlink d20/d3a/d4a/d5e/l78 0 2024-02-15T18:31:03.152 INFO:tasks.workunit.client.0.smithi033.stdout:7/290: link d0/fd d0/dc/d10/d48/f5b 0 2024-02-15T18:31:03.153 INFO:tasks.workunit.client.0.smithi033.stdout:0/251: truncate d0/d8/f37 2833878 0 2024-02-15T18:31:03.154 INFO:tasks.workunit.client.0.smithi033.stdout:5/341: creat d1/f5c x:0 0 0 2024-02-15T18:31:03.155 INFO:tasks.workunit.client.0.smithi033.stdout:8/220: creat d0/df/f49 x:0 0 0 2024-02-15T18:31:03.155 INFO:tasks.workunit.client.0.smithi033.stdout:5/342: creat d1/f5d x:0 0 0 2024-02-15T18:31:03.156 INFO:tasks.workunit.client.0.smithi033.stdout:5/343: fdatasync d1/f4 0 2024-02-15T18:31:03.167 INFO:tasks.workunit.client.0.smithi033.stdout:2/319: dread fd [0,4194304] 0 2024-02-15T18:31:03.171 INFO:tasks.workunit.client.0.smithi033.stdout:2/320: write d20/d3a/d4a/d5e/f61 [2535000,11126] 0 2024-02-15T18:31:03.172 INFO:tasks.workunit.client.0.smithi033.stdout:2/321: write d20/d3a/d4a/f52 [357561,80159] 0 2024-02-15T18:31:03.173 INFO:tasks.workunit.client.0.smithi033.stdout:2/322: symlink d20/d3a/d4a/d5e/l79 0 2024-02-15T18:31:03.175 INFO:tasks.workunit.client.0.smithi033.stdout:2/323: link d20/c65 d20/d31/d6a/c7a 0 2024-02-15T18:31:03.175 INFO:tasks.workunit.client.0.smithi033.stdout:2/324: truncate d20/d3a/f75 278536 0 2024-02-15T18:31:03.175 INFO:tasks.workunit.client.0.smithi033.stdout:2/325: fdatasync d20/d3a/f57 0 2024-02-15T18:31:03.177 INFO:tasks.workunit.client.0.smithi033.stdout:2/326: creat d20/d31/d47/d4c/d6c/f7b x:0 0 0 2024-02-15T18:31:03.177 INFO:tasks.workunit.client.0.smithi033.stdout:2/327: stat d20/l55 0 2024-02-15T18:31:03.178 INFO:tasks.workunit.client.0.smithi033.stdout:2/328: creat d20/d31/f7c x:0 0 0 2024-02-15T18:31:03.179 INFO:tasks.workunit.client.0.smithi033.stdout:2/329: link d20/d3a/d4a/f67 d20/d3a/d4a/d5e/f7d 0 2024-02-15T18:31:03.179 INFO:tasks.workunit.client.0.smithi033.stdout:2/330: creat d20/d31/f7e x:0 0 0 2024-02-15T18:31:03.180 INFO:tasks.workunit.client.0.smithi033.stdout:2/331: mknod d20/d31/d47/d64/c7f 0 2024-02-15T18:31:03.181 INFO:tasks.workunit.client.0.smithi033.stdout:2/332: mkdir d20/d31/d47/d4c/d6c/d80 0 2024-02-15T18:31:03.182 INFO:tasks.workunit.client.0.smithi033.stdout:2/333: creat d20/d31/d6a/f81 x:0 0 0 2024-02-15T18:31:03.183 INFO:tasks.workunit.client.0.smithi033.stdout:2/334: mkdir d20/d31/d47/d82 0 2024-02-15T18:31:03.185 INFO:tasks.workunit.client.0.smithi033.stdout:4/343: dwrite d4/d5/d28/f47 [0,4194304] 0 2024-02-15T18:31:03.189 INFO:tasks.workunit.client.0.smithi033.stdout:8/221: dwrite d0/df/db/fc [0,4194304] 0 2024-02-15T18:31:03.190 INFO:tasks.workunit.client.0.smithi033.stdout:7/291: dwrite d0/f27 [4194304,4194304] 0 2024-02-15T18:31:03.190 INFO:tasks.workunit.client.0.smithi033.stdout:3/263: dwrite d2/d20/f45 [0,4194304] 0 2024-02-15T18:31:03.192 INFO:tasks.workunit.client.0.smithi033.stdout:6/314: dwrite f7 [0,4194304] 0 2024-02-15T18:31:03.193 INFO:tasks.workunit.client.0.smithi033.stdout:8/222: creat d0/df/db/d45/f4a x:0 0 0 2024-02-15T18:31:03.193 INFO:tasks.workunit.client.0.smithi033.stdout:8/223: chown d0 39356 1 2024-02-15T18:31:03.194 INFO:tasks.workunit.client.0.smithi033.stdout:7/292: read d0/dc/f31 [4073131,23847] 0 2024-02-15T18:31:03.194 INFO:tasks.workunit.client.0.smithi033.stdout:7/293: write d0/dc/d10/d1d/d2b/f4a [254711,90282] 0 2024-02-15T18:31:03.201 INFO:tasks.workunit.client.0.smithi033.stdout:1/286: dwrite d5/d17/d27/f39 [4194304,4194304] 0 2024-02-15T18:31:03.201 INFO:tasks.workunit.client.0.smithi033.stdout:2/335: dread f1 [8388608,4194304] 0 2024-02-15T18:31:03.201 INFO:tasks.workunit.client.0.smithi033.stdout:1/287: read - d5/d9/f32 zero size 2024-02-15T18:31:03.212 INFO:tasks.workunit.client.0.smithi033.stdout:4/344: dwrite d4/d5/d28/f47 [0,4194304] 0 2024-02-15T18:31:03.218 INFO:tasks.workunit.client.0.smithi033.stdout:6/315: truncate d8/d28/d14/f34 1716220 0 2024-02-15T18:31:03.220 INFO:tasks.workunit.client.0.smithi033.stdout:2/336: mkdir d20/d3a/d4a/d5e/d6b/d83 0 2024-02-15T18:31:03.221 INFO:tasks.workunit.client.0.smithi033.stdout:4/345: truncate d4/f15 1374211 0 2024-02-15T18:31:03.221 INFO:tasks.workunit.client.0.smithi033.stdout:6/316: dread d8/d1d/d2a/d57/f5a [0,4194304] 0 2024-02-15T18:31:03.223 INFO:tasks.workunit.client.0.smithi033.stdout:4/346: rename d4/d20/d13/d34/c38 to d4/d20/d13/d34/c70 0 2024-02-15T18:31:03.232 INFO:tasks.workunit.client.0.smithi033.stdout:0/252: dwrite d0/dc/d1d/f21 [0,4194304] 0 2024-02-15T18:31:03.233 INFO:tasks.workunit.client.0.smithi033.stdout:1/288: dwrite d5/d17/f29 [0,4194304] 0 2024-02-15T18:31:03.240 INFO:tasks.workunit.client.0.smithi033.stdout:7/294: dwrite d0/dc/d10/f13 [0,4194304] 0 2024-02-15T18:31:03.255 INFO:tasks.workunit.client.0.smithi033.stdout:7/295: dread d0/f1c [0,4194304] 0 2024-02-15T18:31:03.256 INFO:tasks.workunit.client.0.smithi033.stdout:7/296: mknod d0/d56/c5c 0 2024-02-15T18:31:03.256 INFO:tasks.workunit.client.0.smithi033.stdout:7/297: chown d0/f1c 241 1 2024-02-15T18:31:03.257 INFO:tasks.workunit.client.0.smithi033.stdout:7/298: creat d0/dc/f5d x:0 0 0 2024-02-15T18:31:03.258 INFO:tasks.workunit.client.0.smithi033.stdout:7/299: creat d0/f5e x:0 0 0 2024-02-15T18:31:03.266 INFO:tasks.workunit.client.0.smithi033.stdout:2/337: dwrite d20/d3a/d4a/f74 [0,4194304] 0 2024-02-15T18:31:03.266 INFO:tasks.workunit.client.0.smithi033.stdout:6/317: dwrite d8/d28/d36/f4a [4194304,4194304] 0 2024-02-15T18:31:03.266 INFO:tasks.workunit.client.0.smithi033.stdout:4/347: dwrite d4/d20/d13/f6e [0,4194304] 0 2024-02-15T18:31:03.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/318: getdents d8/d1d/d37 0 2024-02-15T18:31:03.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/319: chown d8/d28/d36/f50 35513920 1 2024-02-15T18:31:03.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/320: write d8/d1d/d2a/d57/f5a [1346975,107055] 0 2024-02-15T18:31:03.271 INFO:tasks.workunit.client.0.smithi033.stdout:4/348: creat d4/d20/d13/d5c/f71 x:0 0 0 2024-02-15T18:31:03.272 INFO:tasks.workunit.client.0.smithi033.stdout:4/349: write d4/f7 [385440,77633] 0 2024-02-15T18:31:03.278 INFO:tasks.workunit.client.0.smithi033.stdout:0/253: dwrite d0/d8/fb [0,4194304] 0 2024-02-15T18:31:03.279 INFO:tasks.workunit.client.0.smithi033.stdout:1/289: dwrite d5/f19 [0,4194304] 0 2024-02-15T18:31:03.281 INFO:tasks.workunit.client.0.smithi033.stdout:0/254: rename d0/l2a to d0/d8/d15/d2d/l4f 0 2024-02-15T18:31:03.288 INFO:tasks.workunit.client.0.smithi033.stdout:1/290: read d5/dd/d12/d49/f44 [169701,59209] 0 2024-02-15T18:31:03.290 INFO:tasks.workunit.client.0.smithi033.stdout:0/255: dread d0/dc/d1d/f25 [0,4194304] 0 2024-02-15T18:31:03.291 INFO:tasks.workunit.client.0.smithi033.stdout:0/256: rename d0/f5 to d0/d2/d40/f50 0 2024-02-15T18:31:03.292 INFO:tasks.workunit.client.0.smithi033.stdout:0/257: dread d0/d8/f39 [0,4194304] 0 2024-02-15T18:31:03.292 INFO:tasks.workunit.client.0.smithi033.stdout:1/291: write d5/dd/f3f [774032,113301] 0 2024-02-15T18:31:03.293 INFO:tasks.workunit.client.0.smithi033.stdout:7/300: dwrite d0/f1b [0,4194304] 0 2024-02-15T18:31:03.293 INFO:tasks.workunit.client.0.smithi033.stdout:0/258: read d0/d2/f3 [2483404,42001] 0 2024-02-15T18:31:03.293 INFO:tasks.workunit.client.0.smithi033.stdout:0/259: write d0/d8/d15/d2d/f4a [1214800,51821] 0 2024-02-15T18:31:03.293 INFO:tasks.workunit.client.0.smithi033.stdout:0/260: fdatasync d0/d8/f42 0 2024-02-15T18:31:03.298 INFO:tasks.workunit.client.0.smithi033.stdout:7/301: mkdir d0/dc/d10/d1d/d2b/d5f 0 2024-02-15T18:31:03.299 INFO:tasks.workunit.client.0.smithi033.stdout:0/261: getdents d0/dc 0 2024-02-15T18:31:03.301 INFO:tasks.workunit.client.0.smithi033.stdout:7/302: creat d0/dc/d10/d1d/f60 x:0 0 0 2024-02-15T18:31:03.302 INFO:tasks.workunit.client.0.smithi033.stdout:0/262: creat d0/d8/d15/d2d/d2e/f51 x:0 0 0 2024-02-15T18:31:03.304 INFO:tasks.workunit.client.0.smithi033.stdout:7/303: rename d0/f1f to d0/dc/d10/d1d/d2b/f61 0 2024-02-15T18:31:03.305 INFO:tasks.workunit.client.0.smithi033.stdout:0/263: mknod d0/d8/d15/d2d/d41/c52 0 2024-02-15T18:31:03.306 INFO:tasks.workunit.client.0.smithi033.stdout:0/264: symlink d0/d8/d15/d2d/d3f/l53 0 2024-02-15T18:31:03.311 INFO:tasks.workunit.client.0.smithi033.stdout:7/304: dread d0/f1 [4194304,4194304] 0 2024-02-15T18:31:03.311 INFO:tasks.workunit.client.0.smithi033.stdout:7/305: fsync d0/dc/d10/f2c 0 2024-02-15T18:31:03.312 INFO:tasks.workunit.client.0.smithi033.stdout:7/306: creat d0/f62 x:0 0 0 2024-02-15T18:31:03.313 INFO:tasks.workunit.client.0.smithi033.stdout:7/307: mkdir d0/dc/d10/d1d/d2b/d5f/d63 0 2024-02-15T18:31:03.313 INFO:tasks.workunit.client.0.smithi033.stdout:7/308: rmdir d0/d56 39 2024-02-15T18:31:03.315 INFO:tasks.workunit.client.0.smithi033.stdout:7/309: symlink d0/dc/d10/d1d/d38/d3a/l64 0 2024-02-15T18:31:03.316 INFO:tasks.workunit.client.0.smithi033.stdout:4/350: dwrite d4/d5/f24 [0,4194304] 0 2024-02-15T18:31:03.316 INFO:tasks.workunit.client.0.smithi033.stdout:6/321: dwrite d8/d28/d14/d2c/f4b [0,4194304] 0 2024-02-15T18:31:03.316 INFO:tasks.workunit.client.0.smithi033.stdout:6/322: read - d8/f4e zero size 2024-02-15T18:31:03.317 INFO:tasks.workunit.client.0.smithi033.stdout:7/310: creat d0/dc/f65 x:0 0 0 2024-02-15T18:31:03.317 INFO:tasks.workunit.client.0.smithi033.stdout:2/338: dwrite d20/d3a/d4a/d5e/f61 [4194304,4194304] 0 2024-02-15T18:31:03.319 INFO:tasks.workunit.client.0.smithi033.stdout:4/351: creat d4/d5/f72 x:0 0 0 2024-02-15T18:31:03.319 INFO:tasks.workunit.client.0.smithi033.stdout:4/352: chown d4/d20/d13/d5c/f71 7522491 1 2024-02-15T18:31:03.319 INFO:tasks.workunit.client.0.smithi033.stdout:1/292: dwrite d5/d17/d27/f39 [4194304,4194304] 0 2024-02-15T18:31:03.321 INFO:tasks.workunit.client.0.smithi033.stdout:6/323: creat d8/f6e x:0 0 0 2024-02-15T18:31:03.322 INFO:tasks.workunit.client.0.smithi033.stdout:7/311: creat d0/dc/d10/d1d/d2b/d5f/d63/f66 x:0 0 0 2024-02-15T18:31:03.326 INFO:tasks.workunit.client.0.smithi033.stdout:0/265: dwrite d0/d8/d15/d2d/d2e/f51 [0,4194304] 0 2024-02-15T18:31:03.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/266: fdatasync d0/f4 0 2024-02-15T18:31:03.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/267: fdatasync d0/dc/d1d/f21 0 2024-02-15T18:31:03.328 INFO:tasks.workunit.client.0.smithi033.stdout:2/339: mknod d20/d3a/c84 0 2024-02-15T18:31:03.328 INFO:tasks.workunit.client.0.smithi033.stdout:2/340: write d20/d30/f44 [854148,14160] 0 2024-02-15T18:31:03.328 INFO:tasks.workunit.client.0.smithi033.stdout:2/341: write d20/d39/f5a [572820,96830] 0 2024-02-15T18:31:03.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/293: creat d5/dd/d12/d49/f4a x:0 0 0 2024-02-15T18:31:03.332 INFO:tasks.workunit.client.0.smithi033.stdout:4/353: dread d4/d20/d13/f6e [0,4194304] 0 2024-02-15T18:31:03.332 INFO:tasks.workunit.client.0.smithi033.stdout:4/354: write d4/f46 [95317,9638] 0 2024-02-15T18:31:03.332 INFO:tasks.workunit.client.0.smithi033.stdout:4/355: readlink d4/l3d 0 2024-02-15T18:31:03.333 INFO:tasks.workunit.client.0.smithi033.stdout:6/324: unlink d8/d28/d14/d2c/d31/d30/d29/d38/f6a 0 2024-02-15T18:31:03.335 INFO:tasks.workunit.client.0.smithi033.stdout:0/268: dread d0/d8/d15/d2d/f4a [0,4194304] 0 2024-02-15T18:31:03.335 INFO:tasks.workunit.client.0.smithi033.stdout:0/269: write d0/d8/d15/d2d/f4a [229874,124366] 0 2024-02-15T18:31:03.335 INFO:tasks.workunit.client.0.smithi033.stdout:7/312: stat d0/c11 0 2024-02-15T18:31:03.342 INFO:tasks.workunit.client.0.smithi033.stdout:1/294: mknod d5/d38/c4b 0 2024-02-15T18:31:03.342 INFO:tasks.workunit.client.0.smithi033.stdout:1/295: dread - d5/d9/d1e/d20/d2c/f46 zero size 2024-02-15T18:31:03.342 INFO:tasks.workunit.client.0.smithi033.stdout:1/296: fsync d5/dd/d12/d49/f4a 0 2024-02-15T18:31:03.342 INFO:tasks.workunit.client.0.smithi033.stdout:1/297: dread - d5/d9/d1e/d20/d2c/f46 zero size 2024-02-15T18:31:03.343 INFO:tasks.workunit.client.0.smithi033.stdout:4/356: unlink c1 0 2024-02-15T18:31:03.344 INFO:tasks.workunit.client.0.smithi033.stdout:6/325: creat d8/d1d/d37/d4f/f6f x:0 0 0 2024-02-15T18:31:03.345 INFO:tasks.workunit.client.0.smithi033.stdout:6/326: read d8/d28/d14/d2c/d31/d30/f2d [825978,12371] 0 2024-02-15T18:31:03.345 INFO:tasks.workunit.client.0.smithi033.stdout:6/327: write d8/f6e [433111,13091] 0 2024-02-15T18:31:03.345 INFO:tasks.workunit.client.0.smithi033.stdout:6/328: write d8/d28/f46 [1599584,2708] 0 2024-02-15T18:31:03.345 INFO:tasks.workunit.client.0.smithi033.stdout:6/329: chown d8/d28/d36/f69 208121025 1 2024-02-15T18:31:03.346 INFO:tasks.workunit.client.0.smithi033.stdout:6/330: readlink d8/d1d/d2a/d55/l5c 0 2024-02-15T18:31:03.346 INFO:tasks.workunit.client.0.smithi033.stdout:7/313: rename d0/d56/c5c to d0/dc/d10/d1d/d2b/d5f/c67 0 2024-02-15T18:31:03.347 INFO:tasks.workunit.client.0.smithi033.stdout:1/298: symlink d5/d9/d1e/d20/l4c 0 2024-02-15T18:31:03.347 INFO:tasks.workunit.client.0.smithi033.stdout:1/299: truncate d5/f8 1333168 0 2024-02-15T18:31:03.347 INFO:tasks.workunit.client.0.smithi033.stdout:1/300: truncate d5/d9/d1e/d20/d2c/f46 812623 0 2024-02-15T18:31:03.347 INFO:tasks.workunit.client.0.smithi033.stdout:0/270: mkdir d0/d8/d54 0 2024-02-15T18:31:03.349 INFO:tasks.workunit.client.0.smithi033.stdout:7/314: creat d0/dc/d10/d1d/d38/f68 x:0 0 0 2024-02-15T18:31:03.349 INFO:tasks.workunit.client.0.smithi033.stdout:7/315: chown d0/dc/d10/d48 23667272 1 2024-02-15T18:31:03.350 INFO:tasks.workunit.client.0.smithi033.stdout:0/271: creat d0/d8/d15/d2d/d3f/f55 x:0 0 0 2024-02-15T18:31:03.352 INFO:tasks.workunit.client.0.smithi033.stdout:7/316: symlink d0/dc/d10/d1d/d2b/l69 0 2024-02-15T18:31:03.354 INFO:tasks.workunit.client.0.smithi033.stdout:7/317: creat d0/f6a x:0 0 0 2024-02-15T18:31:03.354 INFO:tasks.workunit.client.0.smithi033.stdout:7/318: fsync d0/dc/d10/d1d/f25 0 2024-02-15T18:31:03.354 INFO:tasks.workunit.client.0.smithi033.stdout:7/319: stat d0/f5e 0 2024-02-15T18:31:03.357 INFO:tasks.workunit.client.0.smithi033.stdout:7/320: rename d0/dc/d10/d1d/c22 to d0/dc/d10/d1d/d38/c6b 0 2024-02-15T18:31:03.357 INFO:tasks.workunit.client.0.smithi033.stdout:7/321: write d0/dc/d10/d1d/d2b/d5f/d63/f66 [799154,7333] 0 2024-02-15T18:31:03.358 INFO:tasks.workunit.client.0.smithi033.stdout:7/322: truncate d0/dc/d10/f13 3401237 0 2024-02-15T18:31:03.374 INFO:tasks.workunit.client.0.smithi033.stdout:4/357: dwrite d4/d20/d13/f31 [0,4194304] 0 2024-02-15T18:31:03.376 INFO:tasks.workunit.client.0.smithi033.stdout:4/358: dread d4/f46 [0,4194304] 0 2024-02-15T18:31:03.377 INFO:tasks.workunit.client.0.smithi033.stdout:4/359: truncate d4/d5/f25 339397 0 2024-02-15T18:31:03.377 INFO:tasks.workunit.client.0.smithi033.stdout:4/360: chown d4/d3c 172989549 1 2024-02-15T18:31:03.382 INFO:tasks.workunit.client.0.smithi033.stdout:6/331: dwrite d8/d1d/f3c [0,4194304] 0 2024-02-15T18:31:03.384 INFO:tasks.workunit.client.0.smithi033.stdout:7/323: dwrite d0/dc/d10/d1d/d2b/f55 [0,4194304] 0 2024-02-15T18:31:03.392 INFO:tasks.workunit.client.0.smithi033.stdout:4/361: write d4/f15 [1343091,77465] 0 2024-02-15T18:31:03.393 INFO:tasks.workunit.client.0.smithi033.stdout:1/301: dwrite d5/dd/d12/d49/f1d [4194304,4194304] 0 2024-02-15T18:31:03.393 INFO:tasks.workunit.client.0.smithi033.stdout:6/332: dread d8/d28/f11 [0,4194304] 0 2024-02-15T18:31:03.394 INFO:tasks.workunit.client.0.smithi033.stdout:7/324: dread d0/dc/f41 [0,4194304] 0 2024-02-15T18:31:03.397 INFO:tasks.workunit.client.0.smithi033.stdout:6/333: mkdir d8/d70 0 2024-02-15T18:31:03.398 INFO:tasks.workunit.client.0.smithi033.stdout:1/302: creat d5/dd/d12/d49/d23/f4d x:0 0 0 2024-02-15T18:31:03.399 INFO:tasks.workunit.client.0.smithi033.stdout:1/303: write d5/dd/d12/d49/f1d [1528532,96069] 0 2024-02-15T18:31:03.399 INFO:tasks.workunit.client.0.smithi033.stdout:6/334: write d8/f1a [6666604,111012] 0 2024-02-15T18:31:03.401 INFO:tasks.workunit.client.0.smithi033.stdout:7/325: symlink d0/d56/l6c 0 2024-02-15T18:31:03.404 INFO:tasks.workunit.client.0.smithi033.stdout:6/335: creat d8/d28/d14/d2c/d31/d30/f71 x:0 0 0 2024-02-15T18:31:03.404 INFO:tasks.workunit.client.0.smithi033.stdout:7/326: rename d0/dc/d10/d1d/d38/c3d to d0/d56/c6d 0 2024-02-15T18:31:03.414 INFO:tasks.workunit.client.0.smithi033.stdout:4/362: dwrite d4/d20/d37/f42 [0,4194304] 0 2024-02-15T18:31:03.414 INFO:tasks.workunit.client.0.smithi033.stdout:4/363: chown d4/d5/d28/l35 19463 1 2024-02-15T18:31:03.414 INFO:tasks.workunit.client.0.smithi033.stdout:4/364: stat d4/d20/fb 0 2024-02-15T18:31:03.414 INFO:tasks.workunit.client.0.smithi033.stdout:4/365: write d4/f67 [63197,47440] 0 2024-02-15T18:31:03.416 INFO:tasks.workunit.client.0.smithi033.stdout:4/366: rename d4/d20/c49 to d4/d20/c73 0 2024-02-15T18:31:03.418 INFO:tasks.workunit.client.0.smithi033.stdout:6/336: dwrite d8/d28/f35 [0,4194304] 0 2024-02-15T18:31:03.419 INFO:tasks.workunit.client.0.smithi033.stdout:4/367: link d4/d20/c50 d4/d20/d13/c74 0 2024-02-15T18:31:03.419 INFO:tasks.workunit.client.0.smithi033.stdout:4/368: dread - d4/d5/d28/f36 zero size 2024-02-15T18:31:03.421 INFO:tasks.workunit.client.0.smithi033.stdout:6/337: mkdir d8/d1d/d37/d72 0 2024-02-15T18:31:03.421 INFO:tasks.workunit.client.0.smithi033.stdout:6/338: write d8/d1d/d2a/f56 [1017142,18723] 0 2024-02-15T18:31:03.422 INFO:tasks.workunit.client.0.smithi033.stdout:6/339: mknod d8/d1d/d2a/d57/c73 0 2024-02-15T18:31:03.422 INFO:tasks.workunit.client.0.smithi033.stdout:6/340: read d8/d1d/d2a/f56 [239994,47465] 0 2024-02-15T18:31:03.424 INFO:tasks.workunit.client.0.smithi033.stdout:5/344: sync 2024-02-15T18:31:03.424 INFO:tasks.workunit.client.0.smithi033.stdout:9/197: sync 2024-02-15T18:31:03.424 INFO:tasks.workunit.client.0.smithi033.stdout:9/198: chown d4/l44 9217 1 2024-02-15T18:31:03.424 INFO:tasks.workunit.client.0.smithi033.stdout:3/264: sync 2024-02-15T18:31:03.424 INFO:tasks.workunit.client.0.smithi033.stdout:3/265: chown d2/d3/d1e/d22/l47 1609 1 2024-02-15T18:31:03.424 INFO:tasks.workunit.client.0.smithi033.stdout:8/224: sync 2024-02-15T18:31:03.424 INFO:tasks.workunit.client.0.smithi033.stdout:8/225: fdatasync d0/fe 0 2024-02-15T18:31:03.425 INFO:tasks.workunit.client.0.smithi033.stdout:6/341: symlink d8/d1d/d2a/d55/d60/l74 0 2024-02-15T18:31:03.425 INFO:tasks.workunit.client.0.smithi033.stdout:8/226: write d0/d2/f16 [575023,39116] 0 2024-02-15T18:31:03.425 INFO:tasks.workunit.client.0.smithi033.stdout:5/345: mkdir d1/da/d11/d5e 0 2024-02-15T18:31:03.425 INFO:tasks.workunit.client.0.smithi033.stdout:6/342: write d8/d28/d14/d2c/d31/d30/f2d [1538144,88782] 0 2024-02-15T18:31:03.426 INFO:tasks.workunit.client.0.smithi033.stdout:9/199: creat d4/d8/d1b/f4b x:0 0 0 2024-02-15T18:31:03.427 INFO:tasks.workunit.client.0.smithi033.stdout:3/266: symlink d2/d14/d23/l48 0 2024-02-15T18:31:03.428 INFO:tasks.workunit.client.0.smithi033.stdout:5/346: rename d1/da/c4b to d1/da/d10/d2b/c5f 0 2024-02-15T18:31:03.430 INFO:tasks.workunit.client.0.smithi033.stdout:6/343: creat d8/d28/d36/f75 x:0 0 0 2024-02-15T18:31:03.431 INFO:tasks.workunit.client.0.smithi033.stdout:9/200: link d4/d8/dd/fe d4/d8/dd/d28/f4c 0 2024-02-15T18:31:03.431 INFO:tasks.workunit.client.0.smithi033.stdout:5/347: rmdir d1/da/d10/d2b 39 2024-02-15T18:31:03.431 INFO:tasks.workunit.client.0.smithi033.stdout:5/348: chown d1/da/d10/d2b/d33/f51 0 1 2024-02-15T18:31:03.432 INFO:tasks.workunit.client.0.smithi033.stdout:5/349: truncate d1/da/f37 1618455 0 2024-02-15T18:31:03.433 INFO:tasks.workunit.client.0.smithi033.stdout:6/344: unlink d8/f39 0 2024-02-15T18:31:03.434 INFO:tasks.workunit.client.0.smithi033.stdout:6/345: mknod d8/d28/d36/c76 0 2024-02-15T18:31:03.434 INFO:tasks.workunit.client.0.smithi033.stdout:4/369: dwrite d4/d5/d28/f36 [0,4194304] 0 2024-02-15T18:31:03.435 INFO:tasks.workunit.client.0.smithi033.stdout:8/227: dread d0/d2/f16 [4194304,4194304] 0 2024-02-15T18:31:03.435 INFO:tasks.workunit.client.0.smithi033.stdout:6/346: creat d8/d1d/d37/f77 x:0 0 0 2024-02-15T18:31:03.439 INFO:tasks.workunit.client.0.smithi033.stdout:8/228: mkdir d0/df/db/d1b/d4b 0 2024-02-15T18:31:03.439 INFO:tasks.workunit.client.0.smithi033.stdout:6/347: mknod d8/d28/d14/d2c/d3b/c78 0 2024-02-15T18:31:03.439 INFO:tasks.workunit.client.0.smithi033.stdout:6/348: write d8/d28/d14/f34 [2275124,47245] 0 2024-02-15T18:31:03.443 INFO:tasks.workunit.client.0.smithi033.stdout:5/350: dread d1/da/f37 [0,4194304] 0 2024-02-15T18:31:03.454 INFO:tasks.workunit.client.0.smithi033.stdout:8/229: creat d0/df/db/d1b/d4b/f4c x:0 0 0 2024-02-15T18:31:03.455 INFO:tasks.workunit.client.0.smithi033.stdout:6/349: creat d8/d1d/d37/f79 x:0 0 0 2024-02-15T18:31:03.455 INFO:tasks.workunit.client.0.smithi033.stdout:5/351: creat d1/da/d10/f60 x:0 0 0 2024-02-15T18:31:03.456 INFO:tasks.workunit.client.0.smithi033.stdout:5/352: dread - d1/f5d zero size 2024-02-15T18:31:03.456 INFO:tasks.workunit.client.0.smithi033.stdout:8/230: mknod d0/d2/d35/d29/c4d 0 2024-02-15T18:31:03.456 INFO:tasks.workunit.client.0.smithi033.stdout:8/231: fsync d0/fe 0 2024-02-15T18:31:03.456 INFO:tasks.workunit.client.0.smithi033.stdout:8/232: fsync d0/d2/d14/f32 0 2024-02-15T18:31:03.457 INFO:tasks.workunit.client.0.smithi033.stdout:8/233: chown d0/df/db/l15 472 1 2024-02-15T18:31:03.457 INFO:tasks.workunit.client.0.smithi033.stdout:9/201: dwrite d4/d8/dd/f39 [0,4194304] 0 2024-02-15T18:31:03.457 INFO:tasks.workunit.client.0.smithi033.stdout:9/202: readlink d4/d2c/l3a 0 2024-02-15T18:31:03.458 INFO:tasks.workunit.client.0.smithi033.stdout:9/203: dread - d4/d8/f46 zero size 2024-02-15T18:31:03.458 INFO:tasks.workunit.client.0.smithi033.stdout:6/350: link d8/d28/d36/f4a d8/d1d/d2a/d55/d63/f7a 0 2024-02-15T18:31:03.460 INFO:tasks.workunit.client.0.smithi033.stdout:5/353: mkdir d1/da/d19/d3c/d40/d46/d61 0 2024-02-15T18:31:03.466 INFO:tasks.workunit.client.0.smithi033.stdout:9/204: link d4/d8/d1b/d2f/c3e d4/d8/dd/c4d 0 2024-02-15T18:31:03.467 INFO:tasks.workunit.client.0.smithi033.stdout:9/205: stat d4/d8/dd/f23 0 2024-02-15T18:31:03.468 INFO:tasks.workunit.client.0.smithi033.stdout:9/206: creat d4/d8/dd/d41/f4e x:0 0 0 2024-02-15T18:31:03.468 INFO:tasks.workunit.client.0.smithi033.stdout:9/207: chown d4/d8/d1b/d2f/f30 5 1 2024-02-15T18:31:03.468 INFO:tasks.workunit.client.0.smithi033.stdout:9/208: truncate d4/f45 95022 0 2024-02-15T18:31:03.474 INFO:tasks.workunit.client.0.smithi033.stdout:9/209: dread d4/d8/fb [0,4194304] 0 2024-02-15T18:31:03.474 INFO:tasks.workunit.client.0.smithi033.stdout:9/210: read - d4/d8/dd/d41/f4e zero size 2024-02-15T18:31:03.475 INFO:tasks.workunit.client.0.smithi033.stdout:4/370: dwrite d4/f22 [0,4194304] 0 2024-02-15T18:31:03.475 INFO:tasks.workunit.client.0.smithi033.stdout:8/234: dread d0/d2/d35/f1a [0,4194304] 0 2024-02-15T18:31:03.475 INFO:tasks.workunit.client.0.smithi033.stdout:9/211: unlink d4/d8/d1b/f1e 0 2024-02-15T18:31:03.475 INFO:tasks.workunit.client.0.smithi033.stdout:9/212: dread - d4/d8/d1b/f4b zero size 2024-02-15T18:31:03.476 INFO:tasks.workunit.client.0.smithi033.stdout:8/235: rmdir d0/d1c/d30 39 2024-02-15T18:31:03.477 INFO:tasks.workunit.client.0.smithi033.stdout:9/213: link d4/d8/dd/f36 d4/f4f 0 2024-02-15T18:31:03.477 INFO:tasks.workunit.client.0.smithi033.stdout:9/214: fdatasync d4/d8/f46 0 2024-02-15T18:31:03.477 INFO:tasks.workunit.client.0.smithi033.stdout:8/236: getdents d0/d2/d35 0 2024-02-15T18:31:03.477 INFO:tasks.workunit.client.0.smithi033.stdout:8/237: write d0/df/f38 [4371659,60541] 0 2024-02-15T18:31:03.483 INFO:tasks.workunit.client.0.smithi033.stdout:6/351: dwrite d8/d1d/d2a/d55/d63/f7a [8388608,4194304] 0 2024-02-15T18:31:03.484 INFO:tasks.workunit.client.0.smithi033.stdout:5/354: dwrite d1/da/d52/f5b [4194304,4194304] 0 2024-02-15T18:31:03.485 INFO:tasks.workunit.client.0.smithi033.stdout:6/352: dread d8/d28/d14/d2c/d31/f27 [0,4194304] 0 2024-02-15T18:31:03.485 INFO:tasks.workunit.client.0.smithi033.stdout:6/353: read f0 [2050112,59829] 0 2024-02-15T18:31:03.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/355: creat d1/da/d10/d2b/d42/f62 x:0 0 0 2024-02-15T18:31:03.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/356: fdatasync d1/da/f41 0 2024-02-15T18:31:03.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/357: chown d1/da/d10/d2b/d33 2 1 2024-02-15T18:31:03.488 INFO:tasks.workunit.client.0.smithi033.stdout:9/215: dread d4/d8/dd/f13 [0,4194304] 0 2024-02-15T18:31:03.488 INFO:tasks.workunit.client.0.smithi033.stdout:6/354: creat d8/d28/d14/f7b x:0 0 0 2024-02-15T18:31:03.490 INFO:tasks.workunit.client.0.smithi033.stdout:9/216: link d4/d8/dd/d28/l35 d4/d8/dd/d41/l50 0 2024-02-15T18:31:03.490 INFO:tasks.workunit.client.0.smithi033.stdout:6/355: creat d8/d28/d14/f7c x:0 0 0 2024-02-15T18:31:03.491 INFO:tasks.workunit.client.0.smithi033.stdout:6/356: dread - d8/d28/d36/f75 zero size 2024-02-15T18:31:03.491 INFO:tasks.workunit.client.0.smithi033.stdout:5/358: dread d1/da/d10/f1d [0,4194304] 0 2024-02-15T18:31:03.492 INFO:tasks.workunit.client.0.smithi033.stdout:9/217: mkdir d4/d8/dd/d41/d51 0 2024-02-15T18:31:03.494 INFO:tasks.workunit.client.0.smithi033.stdout:5/359: rename d1/da/d19/d3c/d40/d46 to d1/da/d10/d2b/d33/d63 0 2024-02-15T18:31:03.495 INFO:tasks.workunit.client.0.smithi033.stdout:8/238: dwrite d0/df/db/d1b/d4b/f4c [0,4194304] 0 2024-02-15T18:31:03.495 INFO:tasks.workunit.client.0.smithi033.stdout:5/360: write d1/da/d19/f34 [1742816,75386] 0 2024-02-15T18:31:03.495 INFO:tasks.workunit.client.0.smithi033.stdout:5/361: dread - d1/da/d10/f60 zero size 2024-02-15T18:31:03.496 INFO:tasks.workunit.client.0.smithi033.stdout:5/362: write d1/da/d10/d2b/f48 [1878371,30449] 0 2024-02-15T18:31:03.497 INFO:tasks.workunit.client.0.smithi033.stdout:5/363: truncate d1/da/d11/f49 223850 0 2024-02-15T18:31:03.497 INFO:tasks.workunit.client.0.smithi033.stdout:9/218: rename d4/d8/d1b/f4b to d4/d8/dd/d41/d51/f52 0 2024-02-15T18:31:03.502 INFO:tasks.workunit.client.0.smithi033.stdout:9/219: rmdir d4/d32 39 2024-02-15T18:31:03.506 INFO:tasks.workunit.client.0.smithi033.stdout:5/364: dread d1/f2a [0,4194304] 0 2024-02-15T18:31:03.506 INFO:tasks.workunit.client.0.smithi033.stdout:5/365: fdatasync d1/da/f12 0 2024-02-15T18:31:03.507 INFO:tasks.workunit.client.0.smithi033.stdout:5/366: symlink d1/da/d19/d3c/l64 0 2024-02-15T18:31:03.508 INFO:tasks.workunit.client.0.smithi033.stdout:5/367: mkdir d1/da/d19/d3c/d40/d65 0 2024-02-15T18:31:03.508 INFO:tasks.workunit.client.0.smithi033.stdout:5/368: dread - d1/da/d10/d2b/d33/f36 zero size 2024-02-15T18:31:03.508 INFO:tasks.workunit.client.0.smithi033.stdout:5/369: dread d1/da/f1f [0,4194304] 0 2024-02-15T18:31:03.512 INFO:tasks.workunit.client.0.smithi033.stdout:8/239: dwrite d0/f3a [0,4194304] 0 2024-02-15T18:31:03.514 INFO:tasks.workunit.client.0.smithi033.stdout:6/357: dwrite d8/d28/d14/f34 [0,4194304] 0 2024-02-15T18:31:03.518 INFO:tasks.workunit.client.0.smithi033.stdout:9/220: dread d4/d8/dd/f39 [0,4194304] 0 2024-02-15T18:31:03.521 INFO:tasks.workunit.client.0.smithi033.stdout:9/221: truncate d4/d8/dd/f3d 1911361 0 2024-02-15T18:31:03.523 INFO:tasks.workunit.client.0.smithi033.stdout:5/370: dwrite d1/da/d10/f1d [0,4194304] 0 2024-02-15T18:31:03.525 INFO:tasks.workunit.client.0.smithi033.stdout:5/371: dread d1/f9 [0,4194304] 0 2024-02-15T18:31:03.525 INFO:tasks.workunit.client.0.smithi033.stdout:8/240: dread d0/d2/f6 [0,4194304] 0 2024-02-15T18:31:03.527 INFO:tasks.workunit.client.0.smithi033.stdout:8/241: mknod d0/df/db/c4e 0 2024-02-15T18:31:03.536 INFO:tasks.workunit.client.0.smithi033.stdout:6/358: dwrite d8/d28/d14/d2c/d31/d30/f71 [0,4194304] 0 2024-02-15T18:31:03.538 INFO:tasks.workunit.client.0.smithi033.stdout:9/222: dread d4/d8/dd/f3d [0,4194304] 0 2024-02-15T18:31:03.540 INFO:tasks.workunit.client.0.smithi033.stdout:9/223: symlink d4/d8/dd/d41/d51/l53 0 2024-02-15T18:31:03.540 INFO:tasks.workunit.client.0.smithi033.stdout:9/224: write d4/d8/d1b/f4a [886834,20912] 0 2024-02-15T18:31:03.541 INFO:tasks.workunit.client.0.smithi033.stdout:5/372: dread d1/da/d52/f5b [0,4194304] 0 2024-02-15T18:31:03.541 INFO:tasks.workunit.client.0.smithi033.stdout:9/225: creat d4/d32/f54 x:0 0 0 2024-02-15T18:31:03.542 INFO:tasks.workunit.client.0.smithi033.stdout:5/373: creat d1/da/d19/d3c/f66 x:0 0 0 2024-02-15T18:31:03.544 INFO:tasks.workunit.client.0.smithi033.stdout:5/374: link d1/c56 d1/da/d10/d2b/d33/c67 0 2024-02-15T18:31:03.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/375: rmdir d1/da/d10/d2b/d33 39 2024-02-15T18:31:03.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/376: dread - d1/da/f41 zero size 2024-02-15T18:31:03.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/377: rmdir d1/da/d10/d2b 39 2024-02-15T18:31:03.549 INFO:tasks.workunit.client.0.smithi033.stdout:5/378: write d1/f14 [7729,93596] 0 2024-02-15T18:31:03.549 INFO:tasks.workunit.client.0.smithi033.stdout:5/379: chown d1/da/d19/f57 2789 1 2024-02-15T18:31:03.549 INFO:tasks.workunit.client.0.smithi033.stdout:5/380: write d1/da/d19/f22 [300814,55560] 0 2024-02-15T18:31:03.549 INFO:tasks.workunit.client.0.smithi033.stdout:8/242: dwrite d0/d2/f39 [0,4194304] 0 2024-02-15T18:31:03.550 INFO:tasks.workunit.client.0.smithi033.stdout:5/381: mkdir d1/da/d19/d3f/d68 0 2024-02-15T18:31:03.553 INFO:tasks.workunit.client.0.smithi033.stdout:8/243: creat d0/d2/d35/f4f x:0 0 0 2024-02-15T18:31:03.553 INFO:tasks.workunit.client.0.smithi033.stdout:8/244: chown d0/df/db/d45/f4a 1714994 1 2024-02-15T18:31:03.553 INFO:tasks.workunit.client.0.smithi033.stdout:8/245: truncate d0/d2/f5 2907083 0 2024-02-15T18:31:03.553 INFO:tasks.workunit.client.0.smithi033.stdout:8/246: stat d0/df/f11 0 2024-02-15T18:31:03.553 INFO:tasks.workunit.client.0.smithi033.stdout:8/247: fsync d0/df/f49 0 2024-02-15T18:31:03.553 INFO:tasks.workunit.client.0.smithi033.stdout:5/382: link d1/da/d19/f22 d1/da/f69 0 2024-02-15T18:31:03.554 INFO:tasks.workunit.client.0.smithi033.stdout:5/383: mknod d1/da/d11/c6a 0 2024-02-15T18:31:03.565 INFO:tasks.workunit.client.0.smithi033.stdout:6/359: dwrite d8/d28/d36/f75 [0,4194304] 0 2024-02-15T18:31:03.565 INFO:tasks.workunit.client.0.smithi033.stdout:9/226: dwrite d4/d8/fb [0,4194304] 0 2024-02-15T18:31:03.565 INFO:tasks.workunit.client.0.smithi033.stdout:9/227: fsync d4/d8/fb 0 2024-02-15T18:31:03.565 INFO:tasks.workunit.client.0.smithi033.stdout:6/360: dread - d8/d1d/d37/f77 zero size 2024-02-15T18:31:03.566 INFO:tasks.workunit.client.0.smithi033.stdout:8/248: dread d0/d1c/f3e [4194304,4194304] 0 2024-02-15T18:31:03.569 INFO:tasks.workunit.client.0.smithi033.stdout:9/228: rmdir d4/d8/d1b/d2f 39 2024-02-15T18:31:03.570 INFO:tasks.workunit.client.0.smithi033.stdout:9/229: read d4/d8/dd/f23 [3510123,36521] 0 2024-02-15T18:31:03.570 INFO:tasks.workunit.client.0.smithi033.stdout:8/249: symlink d0/d2/d35/l50 0 2024-02-15T18:31:03.571 INFO:tasks.workunit.client.0.smithi033.stdout:8/250: symlink d0/l51 0 2024-02-15T18:31:03.572 INFO:tasks.workunit.client.0.smithi033.stdout:8/251: mknod d0/c52 0 2024-02-15T18:31:03.572 INFO:tasks.workunit.client.0.smithi033.stdout:9/230: dread d4/d8/dd/fe [0,4194304] 0 2024-02-15T18:31:03.575 INFO:tasks.workunit.client.0.smithi033.stdout:8/252: dread d0/d2/d14/f32 [0,4194304] 0 2024-02-15T18:31:03.575 INFO:tasks.workunit.client.0.smithi033.stdout:8/253: chown d0/df/db/d1b/l37 125264416 1 2024-02-15T18:31:03.575 INFO:tasks.workunit.client.0.smithi033.stdout:8/254: truncate d0/df/f38 5020835 0 2024-02-15T18:31:03.579 INFO:tasks.workunit.client.0.smithi033.stdout:5/384: dwrite d1/f9 [0,4194304] 0 2024-02-15T18:31:03.580 INFO:tasks.workunit.client.0.smithi033.stdout:5/385: symlink d1/da/d19/d3c/l6b 0 2024-02-15T18:31:03.581 INFO:tasks.workunit.client.0.smithi033.stdout:6/361: dwrite d8/d1d/d37/f79 [0,4194304] 0 2024-02-15T18:31:03.581 INFO:tasks.workunit.client.0.smithi033.stdout:6/362: fdatasync d8/d1d/d37/f77 0 2024-02-15T18:31:03.583 INFO:tasks.workunit.client.0.smithi033.stdout:6/363: getdents d8 0 2024-02-15T18:31:03.586 INFO:tasks.workunit.client.0.smithi033.stdout:6/364: mkdir d8/d28/d36/d7d 0 2024-02-15T18:31:03.587 INFO:tasks.workunit.client.0.smithi033.stdout:9/231: dwrite d4/d8/fb [4194304,4194304] 0 2024-02-15T18:31:03.587 INFO:tasks.workunit.client.0.smithi033.stdout:9/232: truncate d4/d8/dd/d41/f4e 36136 0 2024-02-15T18:31:03.589 INFO:tasks.workunit.client.0.smithi033.stdout:9/233: write d4/d8/f20 [2423432,63106] 0 2024-02-15T18:31:03.591 INFO:tasks.workunit.client.0.smithi033.stdout:5/386: getdents d1/da/d19/d3c 0 2024-02-15T18:31:03.591 INFO:tasks.workunit.client.0.smithi033.stdout:5/387: readlink d1/da/d19/l3b 0 2024-02-15T18:31:03.595 INFO:tasks.workunit.client.0.smithi033.stdout:9/234: unlink d4/d8/dd/l16 0 2024-02-15T18:31:03.598 INFO:tasks.workunit.client.0.smithi033.stdout:6/365: dread d8/d28/d14/d2c/f61 [0,4194304] 0 2024-02-15T18:31:03.602 INFO:tasks.workunit.client.0.smithi033.stdout:9/235: creat d4/d8/dd/d41/d51/f55 x:0 0 0 2024-02-15T18:31:03.603 INFO:tasks.workunit.client.0.smithi033.stdout:6/366: unlink d8/d28/d14/d2c/d31/d30/d29/f62 0 2024-02-15T18:31:03.605 INFO:tasks.workunit.client.0.smithi033.stdout:6/367: rmdir d8/d28/d36 39 2024-02-15T18:31:03.612 INFO:tasks.workunit.client.0.smithi033.stdout:5/388: dwrite d1/da/d10/d2b/f48 [0,4194304] 0 2024-02-15T18:31:03.614 INFO:tasks.workunit.client.0.smithi033.stdout:5/389: creat d1/da/d11/d5e/f6c x:0 0 0 2024-02-15T18:31:03.614 INFO:tasks.workunit.client.0.smithi033.stdout:6/368: dread d8/d28/d14/d2c/d3b/d3d/f48 [0,4194304] 0 2024-02-15T18:31:03.615 INFO:tasks.workunit.client.0.smithi033.stdout:6/369: chown f7 5 1 2024-02-15T18:31:03.615 INFO:tasks.workunit.client.0.smithi033.stdout:5/390: write d1/da/d19/f34 [346104,17327] 0 2024-02-15T18:31:03.615 INFO:tasks.workunit.client.0.smithi033.stdout:6/370: write d8/d28/d14/d2c/f61 [3400458,20997] 0 2024-02-15T18:31:03.615 INFO:tasks.workunit.client.0.smithi033.stdout:6/371: readlink d8/d1d/d37/d4f/l66 0 2024-02-15T18:31:03.616 INFO:tasks.workunit.client.0.smithi033.stdout:6/372: mknod d8/d28/c7e 0 2024-02-15T18:31:03.616 INFO:tasks.workunit.client.0.smithi033.stdout:6/373: fsync d8/d28/d14/d2c/d31/d30/f3e 0 2024-02-15T18:31:03.616 INFO:tasks.workunit.client.0.smithi033.stdout:6/374: stat d8/d28/d14/f13 0 2024-02-15T18:31:03.618 INFO:tasks.workunit.client.0.smithi033.stdout:6/375: write d8/d1d/d37/f79 [1376042,115747] 0 2024-02-15T18:31:03.619 INFO:tasks.workunit.client.0.smithi033.stdout:6/376: fdatasync d8/d28/d36/f75 0 2024-02-15T18:31:03.619 INFO:tasks.workunit.client.0.smithi033.stdout:6/377: stat d8/d28/d14/f13 0 2024-02-15T18:31:03.619 INFO:tasks.workunit.client.0.smithi033.stdout:5/391: dread d1/da/d52/f5b [0,4194304] 0 2024-02-15T18:31:03.620 INFO:tasks.workunit.client.0.smithi033.stdout:6/378: creat d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/f7f x:0 0 0 2024-02-15T18:31:03.620 INFO:tasks.workunit.client.0.smithi033.stdout:6/379: write d8/d1d/d37/d4f/f6f [436982,75997] 0 2024-02-15T18:31:03.621 INFO:tasks.workunit.client.0.smithi033.stdout:5/392: dread d1/da/d19/f22 [0,4194304] 0 2024-02-15T18:31:03.621 INFO:tasks.workunit.client.0.smithi033.stdout:6/380: symlink d8/d28/d14/d2c/d31/d30/d29/d38/l80 0 2024-02-15T18:31:03.622 INFO:tasks.workunit.client.0.smithi033.stdout:5/393: link d1/da/f55 d1/da/d19/f6d 0 2024-02-15T18:31:03.626 INFO:tasks.workunit.client.0.smithi033.stdout:5/394: creat d1/da/f6e x:0 0 0 2024-02-15T18:31:03.634 INFO:tasks.workunit.client.0.smithi033.stdout:6/381: dwrite d8/d28/d14/f7b [0,4194304] 0 2024-02-15T18:31:03.634 INFO:tasks.workunit.client.0.smithi033.stdout:6/382: write d8/f6e [1444383,125746] 0 2024-02-15T18:31:03.637 INFO:tasks.workunit.client.0.smithi033.stdout:6/383: mkdir d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/d81 0 2024-02-15T18:31:03.637 INFO:tasks.workunit.client.0.smithi033.stdout:6/384: truncate d8/d1d/d2a/f56 1768695 0 2024-02-15T18:31:03.637 INFO:tasks.workunit.client.0.smithi033.stdout:6/385: rmdir d8/d1d/d2a/d55/d63 39 2024-02-15T18:31:03.639 INFO:tasks.workunit.client.0.smithi033.stdout:6/386: write d8/d1d/f3c [147810,123111] 0 2024-02-15T18:31:03.639 INFO:tasks.workunit.client.0.smithi033.stdout:6/387: chown d8/d28/d36/f4a 519083 1 2024-02-15T18:31:03.639 INFO:tasks.workunit.client.0.smithi033.stdout:6/388: truncate d8/d28/d14/d2c/d31/d30/f3e 69033 0 2024-02-15T18:31:03.643 INFO:tasks.workunit.client.0.smithi033.stdout:6/389: mknod d8/d28/d14/d2c/d31/d5d/c82 0 2024-02-15T18:31:03.644 INFO:tasks.workunit.client.0.smithi033.stdout:6/390: write d8/f6e [707861,33507] 0 2024-02-15T18:31:03.645 INFO:tasks.workunit.client.0.smithi033.stdout:6/391: mkdir d8/d1d/d2a/d83 0 2024-02-15T18:31:03.650 INFO:tasks.workunit.client.0.smithi033.stdout:6/392: dread d8/d28/d14/d2c/f61 [0,4194304] 0 2024-02-15T18:31:03.650 INFO:tasks.workunit.client.0.smithi033.stdout:6/393: dread - d8/d28/d14/f7c zero size 2024-02-15T18:31:03.651 INFO:tasks.workunit.client.0.smithi033.stdout:6/394: creat d8/d28/d14/d2c/d31/d30/d29/d38/d54/f84 x:0 0 0 2024-02-15T18:31:03.652 INFO:tasks.workunit.client.0.smithi033.stdout:6/395: fdatasync d8/d28/d36/f50 0 2024-02-15T18:31:03.652 INFO:tasks.workunit.client.0.smithi033.stdout:6/396: fdatasync d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/f7f 0 2024-02-15T18:31:03.652 INFO:tasks.workunit.client.0.smithi033.stdout:6/397: readlink d8/l9 0 2024-02-15T18:31:03.653 INFO:tasks.workunit.client.0.smithi033.stdout:6/398: dread d8/d1d/d2a/f56 [0,4194304] 0 2024-02-15T18:31:03.655 INFO:tasks.workunit.client.0.smithi033.stdout:6/399: unlink d8/d28/d14/f7b 0 2024-02-15T18:31:03.656 INFO:tasks.workunit.client.0.smithi033.stdout:6/400: symlink d8/d28/d14/d2c/d31/d30/d29/d38/d54/l85 0 2024-02-15T18:31:03.672 INFO:tasks.workunit.client.0.smithi033.stdout:6/401: dwrite f7 [4194304,4194304] 0 2024-02-15T18:31:03.679 INFO:tasks.workunit.client.0.smithi033.stdout:6/402: rmdir d8/d1d/d2a 39 2024-02-15T18:31:03.696 INFO:tasks.workunit.client.0.smithi033.stdout:7/327: sync 2024-02-15T18:31:03.696 INFO:tasks.workunit.client.0.smithi033.stdout:2/342: sync 2024-02-15T18:31:03.697 INFO:tasks.workunit.client.0.smithi033.stdout:1/304: sync 2024-02-15T18:31:03.697 INFO:tasks.workunit.client.0.smithi033.stdout:0/272: sync 2024-02-15T18:31:03.697 INFO:tasks.workunit.client.0.smithi033.stdout:7/328: fdatasync d0/f33 0 2024-02-15T18:31:03.697 INFO:tasks.workunit.client.0.smithi033.stdout:2/343: write d20/d31/d6a/f24 [1565581,122734] 0 2024-02-15T18:31:03.697 INFO:tasks.workunit.client.0.smithi033.stdout:2/344: dread - d20/d31/f7c zero size 2024-02-15T18:31:03.697 INFO:tasks.workunit.client.0.smithi033.stdout:6/403: dwrite d8/d1d/d2a/d55/d63/f7a [0,4194304] 0 2024-02-15T18:31:03.697 INFO:tasks.workunit.client.0.smithi033.stdout:7/329: mknod d0/d56/c6e 0 2024-02-15T18:31:03.698 INFO:tasks.workunit.client.0.smithi033.stdout:1/305: write d5/f19 [607944,13235] 0 2024-02-15T18:31:03.698 INFO:tasks.workunit.client.0.smithi033.stdout:0/273: mkdir d0/d2/d40/d56 0 2024-02-15T18:31:03.704 INFO:tasks.workunit.client.0.smithi033.stdout:2/345: link d20/d3a/d4a/f52 d20/d31/d47/d4c/d6c/d80/f85 0 2024-02-15T18:31:03.704 INFO:tasks.workunit.client.0.smithi033.stdout:7/330: creat d0/dc/d10/d48/f6f x:0 0 0 2024-02-15T18:31:03.704 INFO:tasks.workunit.client.0.smithi033.stdout:1/306: creat d5/dd/d12/d49/f4e x:0 0 0 2024-02-15T18:31:03.705 INFO:tasks.workunit.client.0.smithi033.stdout:0/274: truncate d0/d8/f44 1670753 0 2024-02-15T18:31:03.705 INFO:tasks.workunit.client.0.smithi033.stdout:2/346: write d20/d39/f5a [1554681,122458] 0 2024-02-15T18:31:03.705 INFO:tasks.workunit.client.0.smithi033.stdout:7/331: rmdir d0/dc/d10/d1d/d38 39 2024-02-15T18:31:03.707 INFO:tasks.workunit.client.0.smithi033.stdout:1/307: symlink d5/l4f 0 2024-02-15T18:31:03.707 INFO:tasks.workunit.client.0.smithi033.stdout:1/308: readlink d5/d9/d1e/d20/d2c/l36 0 2024-02-15T18:31:03.710 INFO:tasks.workunit.client.0.smithi033.stdout:7/332: mkdir d0/d56/d70 0 2024-02-15T18:31:03.712 INFO:tasks.workunit.client.0.smithi033.stdout:7/333: creat d0/dc/d10/d1d/d2b/d5f/f71 x:0 0 0 2024-02-15T18:31:03.712 INFO:tasks.workunit.client.0.smithi033.stdout:7/334: truncate d0/dc/f5d 785342 0 2024-02-15T18:31:03.712 INFO:tasks.workunit.client.0.smithi033.stdout:6/404: dwrite d8/d28/d14/d2c/d31/d30/f2d [0,4194304] 0 2024-02-15T18:31:03.712 INFO:tasks.workunit.client.0.smithi033.stdout:6/405: dread - d8/d28/d14/d2c/d31/d30/d29/f59 zero size 2024-02-15T18:31:03.712 INFO:tasks.workunit.client.0.smithi033.stdout:6/406: write d8/d28/d14/f34 [4452563,93286] 0 2024-02-15T18:31:03.719 INFO:tasks.workunit.client.0.smithi033.stdout:1/309: rmdir d5/dd 39 2024-02-15T18:31:03.719 INFO:tasks.workunit.client.0.smithi033.stdout:1/310: fsync d5/dd/d12/d49/f4a 0 2024-02-15T18:31:03.720 INFO:tasks.workunit.client.0.smithi033.stdout:6/407: rename d8/d28/d36/f69 to d8/d28/d14/d2c/d3b/f86 0 2024-02-15T18:31:03.721 INFO:tasks.workunit.client.0.smithi033.stdout:1/311: creat d5/d9/d1e/d20/f50 x:0 0 0 2024-02-15T18:31:03.721 INFO:tasks.workunit.client.0.smithi033.stdout:1/312: fsync d5/f8 0 2024-02-15T18:31:03.721 INFO:tasks.workunit.client.0.smithi033.stdout:6/408: link d8/d28/l12 d8/l87 0 2024-02-15T18:31:03.722 INFO:tasks.workunit.client.0.smithi033.stdout:1/313: mkdir d5/d9/d1e/d20/d2c/d34/d51 0 2024-02-15T18:31:03.723 INFO:tasks.workunit.client.0.smithi033.stdout:1/314: chown d5/lc 1635 1 2024-02-15T18:31:03.723 INFO:tasks.workunit.client.0.smithi033.stdout:1/315: rename d5/d9/d1e/d20/d2c/d34 to d5/d9/d1e/d20/d2c/d34/d52 22 2024-02-15T18:31:03.723 INFO:tasks.workunit.client.0.smithi033.stdout:6/409: dread d8/d1d/d2a/f56 [0,4194304] 0 2024-02-15T18:31:03.723 INFO:tasks.workunit.client.0.smithi033.stdout:7/335: getdents d0/dc/d10/d1d/d2b/d5f 0 2024-02-15T18:31:03.724 INFO:tasks.workunit.client.0.smithi033.stdout:7/336: dread - d0/dc/d10/d1d/d2b/f5a zero size 2024-02-15T18:31:03.725 INFO:tasks.workunit.client.0.smithi033.stdout:6/410: truncate d8/f1a 5423360 0 2024-02-15T18:31:03.726 INFO:tasks.workunit.client.0.smithi033.stdout:0/275: dwrite d0/dc/d1d/f25 [0,4194304] 0 2024-02-15T18:31:03.726 INFO:tasks.workunit.client.0.smithi033.stdout:7/337: rename d0/dc/d10/d1d/c4d to d0/dc/d10/d48/c72 0 2024-02-15T18:31:03.726 INFO:tasks.workunit.client.0.smithi033.stdout:2/347: dwrite d20/d31/d6a/f26 [0,4194304] 0 2024-02-15T18:31:03.727 INFO:tasks.workunit.client.0.smithi033.stdout:6/411: creat d8/d28/d14/d2c/d31/d30/d29/d38/d54/f88 x:0 0 0 2024-02-15T18:31:03.728 INFO:tasks.workunit.client.0.smithi033.stdout:2/348: write d20/d31/d47/d4c/f56 [2902735,84660] 0 2024-02-15T18:31:03.731 INFO:tasks.workunit.client.0.smithi033.stdout:0/276: creat d0/d8/d15/d2d/f57 x:0 0 0 2024-02-15T18:31:03.731 INFO:tasks.workunit.client.0.smithi033.stdout:0/277: write d0/dc/d1d/f43 [954925,33125] 0 2024-02-15T18:31:03.731 INFO:tasks.workunit.client.0.smithi033.stdout:0/278: stat d0/d2/d40/l4c 0 2024-02-15T18:31:03.732 INFO:tasks.workunit.client.0.smithi033.stdout:1/316: getdents d5/d9/d1e/d20/d2c/d34 0 2024-02-15T18:31:03.732 INFO:tasks.workunit.client.0.smithi033.stdout:1/317: chown d5/d17/f35 429532800 1 2024-02-15T18:31:03.734 INFO:tasks.workunit.client.0.smithi033.stdout:7/338: creat d0/dc/d10/d1d/f73 x:0 0 0 2024-02-15T18:31:03.743 INFO:tasks.workunit.client.0.smithi033.stdout:2/349: creat d20/d31/d47/d64/f86 x:0 0 0 2024-02-15T18:31:03.744 INFO:tasks.workunit.client.0.smithi033.stdout:0/279: mkdir d0/d8/d15/d4b/d58 0 2024-02-15T18:31:03.745 INFO:tasks.workunit.client.0.smithi033.stdout:1/318: creat d5/dd/d12/d49/d23/f53 x:0 0 0 2024-02-15T18:31:03.747 INFO:tasks.workunit.client.0.smithi033.stdout:2/350: rename d20/d30/f4f to d20/d31/d47/d4c/d6c/f87 0 2024-02-15T18:31:03.748 INFO:tasks.workunit.client.0.smithi033.stdout:0/280: mkdir d0/d8/d15/d4b/d59 0 2024-02-15T18:31:03.749 INFO:tasks.workunit.client.0.smithi033.stdout:0/281: fdatasync d0/d8/f38 0 2024-02-15T18:31:03.749 INFO:tasks.workunit.client.0.smithi033.stdout:2/351: mkdir d20/d3a/d4a/d5e/d6b/d88 0 2024-02-15T18:31:03.749 INFO:tasks.workunit.client.0.smithi033.stdout:2/352: truncate d20/d31/d47/d4c/f60 425843 0 2024-02-15T18:31:03.750 INFO:tasks.workunit.client.0.smithi033.stdout:0/282: unlink d0/d8/d15/d2d/f3e 0 2024-02-15T18:31:03.753 INFO:tasks.workunit.client.0.smithi033.stdout:7/339: dwrite d0/f6a [0,4194304] 0 2024-02-15T18:31:03.754 INFO:tasks.workunit.client.0.smithi033.stdout:6/412: dwrite d8/d28/d14/d2c/f4b [0,4194304] 0 2024-02-15T18:31:03.754 INFO:tasks.workunit.client.0.smithi033.stdout:0/283: rename d0/l14 to d0/d8/l5a 0 2024-02-15T18:31:03.754 INFO:tasks.workunit.client.0.smithi033.stdout:0/284: truncate d0/d8/f26 274167 0 2024-02-15T18:31:03.758 INFO:tasks.workunit.client.0.smithi033.stdout:7/340: unlink d0/dc/d10/d1d/c3e 0 2024-02-15T18:31:03.763 INFO:tasks.workunit.client.0.smithi033.stdout:6/413: mknod d8/d70/c89 0 2024-02-15T18:31:03.763 INFO:tasks.workunit.client.0.smithi033.stdout:6/414: fsync d8/d28/d36/f50 0 2024-02-15T18:31:03.763 INFO:tasks.workunit.client.0.smithi033.stdout:0/285: mkdir d0/d8/d15/d5b 0 2024-02-15T18:31:03.763 INFO:tasks.workunit.client.0.smithi033.stdout:9/236: sync 2024-02-15T18:31:03.763 INFO:tasks.workunit.client.0.smithi033.stdout:3/267: sync 2024-02-15T18:31:03.764 INFO:tasks.workunit.client.0.smithi033.stdout:8/255: sync 2024-02-15T18:31:03.764 INFO:tasks.workunit.client.0.smithi033.stdout:4/371: sync 2024-02-15T18:31:03.764 INFO:tasks.workunit.client.0.smithi033.stdout:7/341: mkdir d0/dc/d10/d1d/d38/d74 0 2024-02-15T18:31:03.764 INFO:tasks.workunit.client.0.smithi033.stdout:7/342: write d0/f62 [5818,48698] 0 2024-02-15T18:31:03.766 INFO:tasks.workunit.client.0.smithi033.stdout:5/395: sync 2024-02-15T18:31:03.766 INFO:tasks.workunit.client.0.smithi033.stdout:5/396: truncate d1/f27 997612 0 2024-02-15T18:31:03.766 INFO:tasks.workunit.client.0.smithi033.stdout:5/397: chown d1/da/d10/d2b/d33 6 1 2024-02-15T18:31:03.766 INFO:tasks.workunit.client.0.smithi033.stdout:7/343: dread d0/dc/f29 [0,4194304] 0 2024-02-15T18:31:03.767 INFO:tasks.workunit.client.0.smithi033.stdout:5/398: write d1/da/f1b [767775,101937] 0 2024-02-15T18:31:03.767 INFO:tasks.workunit.client.0.smithi033.stdout:6/415: mknod d8/d28/d14/d2c/d31/d30/d29/d67/c8a 0 2024-02-15T18:31:03.768 INFO:tasks.workunit.client.0.smithi033.stdout:0/286: creat d0/d8/d15/d2d/d2e/f5c x:0 0 0 2024-02-15T18:31:03.769 INFO:tasks.workunit.client.0.smithi033.stdout:0/287: read d0/d8/f44 [1596883,48542] 0 2024-02-15T18:31:03.769 INFO:tasks.workunit.client.0.smithi033.stdout:3/268: creat d2/d3/df/f49 x:0 0 0 2024-02-15T18:31:03.769 INFO:tasks.workunit.client.0.smithi033.stdout:3/269: fsync d2/d14/d23/f3d 0 2024-02-15T18:31:03.771 INFO:tasks.workunit.client.0.smithi033.stdout:0/288: creat d0/d8/d15/d5b/f5d x:0 0 0 2024-02-15T18:31:03.772 INFO:tasks.workunit.client.0.smithi033.stdout:3/270: symlink d2/d3/df/l4a 0 2024-02-15T18:31:03.772 INFO:tasks.workunit.client.0.smithi033.stdout:3/271: chown d2/cd 691621 1 2024-02-15T18:31:03.774 INFO:tasks.workunit.client.0.smithi033.stdout:3/272: mknod d2/d3/d17/c4b 0 2024-02-15T18:31:03.774 INFO:tasks.workunit.client.0.smithi033.stdout:9/237: write d4/d8/d1b/f1f [2180023,70942] 0 2024-02-15T18:31:03.775 INFO:tasks.workunit.client.0.smithi033.stdout:3/273: truncate d2/d3/f39 2889645 0 2024-02-15T18:31:03.775 INFO:tasks.workunit.client.0.smithi033.stdout:3/274: dread - d2/d14/d23/f3e zero size 2024-02-15T18:31:03.776 INFO:tasks.workunit.client.0.smithi033.stdout:5/399: dread d1/da/d10/d2b/d42/d4c/f53 [0,4194304] 0 2024-02-15T18:31:03.776 INFO:tasks.workunit.client.0.smithi033.stdout:5/400: chown d1/da/d52/f5b 2477534 1 2024-02-15T18:31:03.779 INFO:tasks.workunit.client.0.smithi033.stdout:3/275: rename d2/d20/f41 to d2/d14/d23/f4c 0 2024-02-15T18:31:03.779 INFO:tasks.workunit.client.0.smithi033.stdout:3/276: stat d2/d3/df/l18 0 2024-02-15T18:31:03.779 INFO:tasks.workunit.client.0.smithi033.stdout:3/277: chown d2/d3 59655077 1 2024-02-15T18:31:03.779 INFO:tasks.workunit.client.0.smithi033.stdout:3/278: readlink d2/d14/d23/l3a 0 2024-02-15T18:31:03.779 INFO:tasks.workunit.client.0.smithi033.stdout:5/401: read d1/da/d11/f49 [182468,93470] 0 2024-02-15T18:31:03.780 INFO:tasks.workunit.client.0.smithi033.stdout:6/416: dread d8/d1d/d37/f79 [0,4194304] 0 2024-02-15T18:31:03.780 INFO:tasks.workunit.client.0.smithi033.stdout:6/417: fdatasync d8/d28/f11 0 2024-02-15T18:31:03.782 INFO:tasks.workunit.client.0.smithi033.stdout:6/418: dread d8/d28/f35 [0,4194304] 0 2024-02-15T18:31:03.785 INFO:tasks.workunit.client.0.smithi033.stdout:9/238: write d4/d8/fb [2976275,48674] 0 2024-02-15T18:31:03.786 INFO:tasks.workunit.client.0.smithi033.stdout:6/419: symlink d8/d1d/d2a/d55/d60/l8b 0 2024-02-15T18:31:03.786 INFO:tasks.workunit.client.0.smithi033.stdout:6/420: stat d8/d1d/d37/f77 0 2024-02-15T18:31:03.786 INFO:tasks.workunit.client.0.smithi033.stdout:9/239: write d4/d8/dd/d41/f4e [217536,44269] 0 2024-02-15T18:31:03.794 INFO:tasks.workunit.client.0.smithi033.stdout:0/289: dwrite d0/d8/d15/d2d/d2e/f51 [4194304,4194304] 0 2024-02-15T18:31:03.796 INFO:tasks.workunit.client.0.smithi033.stdout:0/290: symlink d0/d8/d15/l5e 0 2024-02-15T18:31:03.797 INFO:tasks.workunit.client.0.smithi033.stdout:0/291: write d0/d8/d15/d2d/d2e/f51 [1286972,63597] 0 2024-02-15T18:31:03.798 INFO:tasks.workunit.client.0.smithi033.stdout:0/292: write d0/f10 [3473146,77572] 0 2024-02-15T18:31:03.798 INFO:tasks.workunit.client.0.smithi033.stdout:0/293: dread - d0/d8/f35 zero size 2024-02-15T18:31:03.800 INFO:tasks.workunit.client.0.smithi033.stdout:0/294: rename d0/dc/d1d/f25 to d0/d8/f5f 0 2024-02-15T18:31:03.800 INFO:tasks.workunit.client.0.smithi033.stdout:0/295: chown d0/d8/d15/d2d/f4a 1 1 2024-02-15T18:31:03.806 INFO:tasks.workunit.client.0.smithi033.stdout:7/344: dwrite d0/f1b [4194304,4194304] 0 2024-02-15T18:31:03.806 INFO:tasks.workunit.client.0.smithi033.stdout:3/279: dwrite d2/fa [4194304,4194304] 0 2024-02-15T18:31:03.806 INFO:tasks.workunit.client.0.smithi033.stdout:8/256: dwrite d0/d2/d35/d29/f2e [0,4194304] 0 2024-02-15T18:31:03.810 INFO:tasks.workunit.client.0.smithi033.stdout:3/280: mkdir d2/d3/d1e/d22/d4d 0 2024-02-15T18:31:03.811 INFO:tasks.workunit.client.0.smithi033.stdout:3/281: write d2/fa [7667888,94976] 0 2024-02-15T18:31:03.812 INFO:tasks.workunit.client.0.smithi033.stdout:0/296: dread d0/d2/f23 [0,4194304] 0 2024-02-15T18:31:03.817 INFO:tasks.workunit.client.0.smithi033.stdout:8/257: getdents d0 0 2024-02-15T18:31:03.818 INFO:tasks.workunit.client.0.smithi033.stdout:3/282: rmdir d2/d14/d3f 0 2024-02-15T18:31:03.819 INFO:tasks.workunit.client.0.smithi033.stdout:8/258: write d0/df/db/d1b/d4b/f4c [1656824,66939] 0 2024-02-15T18:31:03.820 INFO:tasks.workunit.client.0.smithi033.stdout:3/283: link d2/d3/c46 d2/d3/d1e/c4e 0 2024-02-15T18:31:03.820 INFO:tasks.workunit.client.0.smithi033.stdout:8/259: write d0/d1c/f3e [1065576,79472] 0 2024-02-15T18:31:03.821 INFO:tasks.workunit.client.0.smithi033.stdout:7/345: dwrite d0/dc/d10/d1d/d2b/d5f/f71 [0,4194304] 0 2024-02-15T18:31:03.821 INFO:tasks.workunit.client.0.smithi033.stdout:7/346: readlink d0/dc/l3c 0 2024-02-15T18:31:03.822 INFO:tasks.workunit.client.0.smithi033.stdout:3/284: rename d2/f26 to d2/d3/d1e/f4f 0 2024-02-15T18:31:03.826 INFO:tasks.workunit.client.0.smithi033.stdout:8/260: unlink d0/df/f2c 0 2024-02-15T18:31:03.826 INFO:tasks.workunit.client.0.smithi033.stdout:8/261: write d0/df/db/f23 [881322,119500] 0 2024-02-15T18:31:03.828 INFO:tasks.workunit.client.0.smithi033.stdout:7/347: symlink d0/dc/d10/d1d/d2b/d5f/d63/l75 0 2024-02-15T18:31:03.829 INFO:tasks.workunit.client.0.smithi033.stdout:8/262: mkdir d0/df/d53 0 2024-02-15T18:31:03.845 INFO:tasks.workunit.client.0.smithi033.stdout:0/297: dwrite d0/d2/f3c [0,4194304] 0 2024-02-15T18:31:03.845 INFO:tasks.workunit.client.0.smithi033.stdout:0/298: write d0/f4 [4764487,127852] 0 2024-02-15T18:31:03.848 INFO:tasks.workunit.client.0.smithi033.stdout:0/299: mknod d0/d8/d15/d2d/d3f/c60 0 2024-02-15T18:31:03.850 INFO:tasks.workunit.client.0.smithi033.stdout:0/300: write d0/d8/f5f [2600422,88281] 0 2024-02-15T18:31:03.850 INFO:tasks.workunit.client.0.smithi033.stdout:0/301: dread - d0/d8/f45 zero size 2024-02-15T18:31:03.850 INFO:tasks.workunit.client.0.smithi033.stdout:0/302: chown d0/d8/d15 243 1 2024-02-15T18:31:03.851 INFO:tasks.workunit.client.0.smithi033.stdout:0/303: rename d0/d8/f38 to d0/d8/d15/d4b/d58/f61 0 2024-02-15T18:31:03.851 INFO:tasks.workunit.client.0.smithi033.stdout:0/304: write d0/dc/d1d/f1e [5261601,108894] 0 2024-02-15T18:31:03.852 INFO:tasks.workunit.client.0.smithi033.stdout:0/305: symlink d0/dc/d1d/l62 0 2024-02-15T18:31:03.853 INFO:tasks.workunit.client.0.smithi033.stdout:0/306: creat d0/d8/d15/d2d/d2e/f63 x:0 0 0 2024-02-15T18:31:03.864 INFO:tasks.workunit.client.0.smithi033.stdout:3/285: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:03.865 INFO:tasks.workunit.client.0.smithi033.stdout:7/348: dwrite d0/dc/d10/d1d/d2b/f4a [0,4194304] 0 2024-02-15T18:31:03.868 INFO:tasks.workunit.client.0.smithi033.stdout:7/349: link d0/c11 d0/dc/d10/d1d/d38/d74/c76 0 2024-02-15T18:31:03.869 INFO:tasks.workunit.client.0.smithi033.stdout:8/263: dwrite d0/d2/f6 [0,4194304] 0 2024-02-15T18:31:03.873 INFO:tasks.workunit.client.0.smithi033.stdout:0/307: dwrite d0/d2/f34 [0,4194304] 0 2024-02-15T18:31:03.875 INFO:tasks.workunit.client.0.smithi033.stdout:3/286: dread d2/d3/f39 [0,4194304] 0 2024-02-15T18:31:03.876 INFO:tasks.workunit.client.0.smithi033.stdout:7/350: creat d0/dc/d10/d1d/d38/d74/f77 x:0 0 0 2024-02-15T18:31:03.880 INFO:tasks.workunit.client.0.smithi033.stdout:0/308: unlink d0/d8/d15/f3a 0 2024-02-15T18:31:03.882 INFO:tasks.workunit.client.0.smithi033.stdout:3/287: creat d2/d3/f50 x:0 0 0 2024-02-15T18:31:03.882 INFO:tasks.workunit.client.0.smithi033.stdout:3/288: chown d2/d3/c46 1137518 1 2024-02-15T18:31:03.884 INFO:tasks.workunit.client.0.smithi033.stdout:3/289: creat d2/f51 x:0 0 0 2024-02-15T18:31:03.884 INFO:tasks.workunit.client.0.smithi033.stdout:3/290: chown d2/d3/d17/c4b 78592 1 2024-02-15T18:31:03.884 INFO:tasks.workunit.client.0.smithi033.stdout:3/291: dread - d2/f51 zero size 2024-02-15T18:31:03.885 INFO:tasks.workunit.client.0.smithi033.stdout:3/292: link d2/d3/d1e/d22/l47 d2/d3/df/l52 0 2024-02-15T18:31:03.887 INFO:tasks.workunit.client.0.smithi033.stdout:3/293: rename d2/d14/f37 to d2/d20/f53 0 2024-02-15T18:31:03.889 INFO:tasks.workunit.client.0.smithi033.stdout:0/309: getdents d0/d8/d15 0 2024-02-15T18:31:03.891 INFO:tasks.workunit.client.0.smithi033.stdout:3/294: truncate d2/d3/f39 1391957 0 2024-02-15T18:31:03.891 INFO:tasks.workunit.client.0.smithi033.stdout:3/295: write d2/f51 [247886,67223] 0 2024-02-15T18:31:03.891 INFO:tasks.workunit.client.0.smithi033.stdout:3/296: read - d2/d14/d23/f3e zero size 2024-02-15T18:31:03.892 INFO:tasks.workunit.client.0.smithi033.stdout:0/310: rename d0/dc to d0/d64 0 2024-02-15T18:31:03.893 INFO:tasks.workunit.client.0.smithi033.stdout:3/297: mkdir d2/d14/d54 0 2024-02-15T18:31:03.894 INFO:tasks.workunit.client.0.smithi033.stdout:0/311: rename d0/d8/d15/d2d/d2e/f5c to d0/d8/d15/d2d/d2e/f65 0 2024-02-15T18:31:03.895 INFO:tasks.workunit.client.0.smithi033.stdout:3/298: unlink d2/d3/d1e/c4e 0 2024-02-15T18:31:03.895 INFO:tasks.workunit.client.0.smithi033.stdout:0/312: getdents d0/d64/d1d 0 2024-02-15T18:31:03.897 INFO:tasks.workunit.client.0.smithi033.stdout:3/299: rename d2/d3/d17/f1f to d2/d14/f55 0 2024-02-15T18:31:03.897 INFO:tasks.workunit.client.0.smithi033.stdout:1/319: sync 2024-02-15T18:31:03.898 INFO:tasks.workunit.client.0.smithi033.stdout:7/351: dwrite d0/f9 [0,4194304] 0 2024-02-15T18:31:03.899 INFO:tasks.workunit.client.0.smithi033.stdout:0/313: rename d0/d8/f5f to d0/d8/d15/d2d/f66 0 2024-02-15T18:31:03.902 INFO:tasks.workunit.client.0.smithi033.stdout:3/300: creat d2/d3/d1e/d22/d4d/f56 x:0 0 0 2024-02-15T18:31:03.903 INFO:tasks.workunit.client.0.smithi033.stdout:1/320: unlink d5/dd/d12/l43 0 2024-02-15T18:31:03.904 INFO:tasks.workunit.client.0.smithi033.stdout:7/352: rmdir d0/dc/d10/d48/d4b 39 2024-02-15T18:31:03.906 INFO:tasks.workunit.client.0.smithi033.stdout:3/301: dread d2/d14/d23/f3d [0,4194304] 0 2024-02-15T18:31:03.906 INFO:tasks.workunit.client.0.smithi033.stdout:1/321: dread d5/d9/d1e/d20/d2c/f46 [0,4194304] 0 2024-02-15T18:31:03.906 INFO:tasks.workunit.client.0.smithi033.stdout:1/322: write d5/dd/d12/d49/d23/f4d [500347,76814] 0 2024-02-15T18:31:03.907 INFO:tasks.workunit.client.0.smithi033.stdout:3/302: rmdir d2/d14/d54 0 2024-02-15T18:31:03.908 INFO:tasks.workunit.client.0.smithi033.stdout:1/323: symlink d5/l54 0 2024-02-15T18:31:03.909 INFO:tasks.workunit.client.0.smithi033.stdout:3/303: getdents d2/d20 0 2024-02-15T18:31:03.909 INFO:tasks.workunit.client.0.smithi033.stdout:3/304: stat d2/cd 0 2024-02-15T18:31:03.909 INFO:tasks.workunit.client.0.smithi033.stdout:3/305: dread - d2/d3/df/f49 zero size 2024-02-15T18:31:03.911 INFO:tasks.workunit.client.0.smithi033.stdout:3/306: write d2/d20/f45 [4133342,66156] 0 2024-02-15T18:31:03.912 INFO:tasks.workunit.client.0.smithi033.stdout:1/324: write d5/d9/ff [1700355,101344] 0 2024-02-15T18:31:03.914 INFO:tasks.workunit.client.0.smithi033.stdout:0/314: dwrite d0/d8/d15/d4b/d58/f61 [0,4194304] 0 2024-02-15T18:31:03.914 INFO:tasks.workunit.client.0.smithi033.stdout:0/315: fsync d0/d64/d1d/f21 0 2024-02-15T18:31:03.914 INFO:tasks.workunit.client.0.smithi033.stdout:0/316: dread - d0/d8/d15/d2d/d2e/f63 zero size 2024-02-15T18:31:03.914 INFO:tasks.workunit.client.0.smithi033.stdout:1/325: mkdir d5/dd/d12/d47/d55 0 2024-02-15T18:31:03.927 INFO:tasks.workunit.client.0.smithi033.stdout:1/326: rename d5/dd/d12/l2d to d5/dd/d12/d47/l56 0 2024-02-15T18:31:03.927 INFO:tasks.workunit.client.0.smithi033.stdout:1/327: dread - d5/d9/d1e/d20/d2c/d34/f40 zero size 2024-02-15T18:31:03.927 INFO:tasks.workunit.client.0.smithi033.stdout:0/317: dread d0/d8/f26 [0,4194304] 0 2024-02-15T18:31:03.928 INFO:tasks.workunit.client.0.smithi033.stdout:1/328: mkdir d5/d17/d27/d57 0 2024-02-15T18:31:03.928 INFO:tasks.workunit.client.0.smithi033.stdout:0/318: symlink d0/d2/d40/d56/l67 0 2024-02-15T18:31:03.929 INFO:tasks.workunit.client.0.smithi033.stdout:1/329: creat d5/dd/d12/f58 x:0 0 0 2024-02-15T18:31:03.930 INFO:tasks.workunit.client.0.smithi033.stdout:0/319: creat d0/d2/d40/f68 x:0 0 0 2024-02-15T18:31:03.930 INFO:tasks.workunit.client.0.smithi033.stdout:1/330: mkdir d5/d17/d27/d57/d59 0 2024-02-15T18:31:03.932 INFO:tasks.workunit.client.0.smithi033.stdout:0/320: creat d0/d2/d40/d56/f69 x:0 0 0 2024-02-15T18:31:03.932 INFO:tasks.workunit.client.0.smithi033.stdout:0/321: read - d0/d8/f35 zero size 2024-02-15T18:31:03.932 INFO:tasks.workunit.client.0.smithi033.stdout:7/353: dwrite d0/f9 [0,4194304] 0 2024-02-15T18:31:03.933 INFO:tasks.workunit.client.0.smithi033.stdout:0/322: creat d0/d8/d15/d2d/f6a x:0 0 0 2024-02-15T18:31:03.934 INFO:tasks.workunit.client.0.smithi033.stdout:3/307: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:03.935 INFO:tasks.workunit.client.0.smithi033.stdout:7/354: rename d0/dc/d10/d48/f59 to d0/dc/d10/f78 0 2024-02-15T18:31:03.936 INFO:tasks.workunit.client.0.smithi033.stdout:0/323: creat d0/d2/d40/f6b x:0 0 0 2024-02-15T18:31:03.939 INFO:tasks.workunit.client.0.smithi033.stdout:3/308: getdents d2/d14/d23 0 2024-02-15T18:31:03.940 INFO:tasks.workunit.client.0.smithi033.stdout:7/355: creat d0/dc/d10/d1d/d2b/d5f/d63/f79 x:0 0 0 2024-02-15T18:31:03.941 INFO:tasks.workunit.client.0.smithi033.stdout:3/309: creat d2/d3/d1e/d22/f57 x:0 0 0 2024-02-15T18:31:03.941 INFO:tasks.workunit.client.0.smithi033.stdout:3/310: chown d2/d14/d23/f4c 4322 1 2024-02-15T18:31:03.943 INFO:tasks.workunit.client.0.smithi033.stdout:3/311: dread d2/d14/d23/f4c [0,4194304] 0 2024-02-15T18:31:03.947 INFO:tasks.workunit.client.0.smithi033.stdout:7/356: write d0/f1c [4819552,111297] 0 2024-02-15T18:31:03.955 INFO:tasks.workunit.client.0.smithi033.stdout:3/312: dread d2/d14/f16 [0,4194304] 0 2024-02-15T18:31:03.956 INFO:tasks.workunit.client.0.smithi033.stdout:0/324: dwrite d0/d2/d40/d56/f69 [0,4194304] 0 2024-02-15T18:31:03.956 INFO:tasks.workunit.client.0.smithi033.stdout:3/313: creat d2/d3/d1e/d22/f58 x:0 0 0 2024-02-15T18:31:03.965 INFO:tasks.workunit.client.0.smithi033.stdout:1/331: dwrite d5/dd/d12/d49/f4a [0,4194304] 0 2024-02-15T18:31:03.969 INFO:tasks.workunit.client.0.smithi033.stdout:7/357: dwrite d0/dc/d10/d1d/d38/f68 [0,4194304] 0 2024-02-15T18:31:03.970 INFO:tasks.workunit.client.0.smithi033.stdout:1/332: unlink d5/dd/d12/d49/d23/f53 0 2024-02-15T18:31:03.977 INFO:tasks.workunit.client.0.smithi033.stdout:0/325: rename d0/d2/d40 to d0/d64/d3b/d6c 0 2024-02-15T18:31:03.977 INFO:tasks.workunit.client.0.smithi033.stdout:3/314: dwrite d2/d14/d23/f3e [0,4194304] 0 2024-02-15T18:31:03.977 INFO:tasks.workunit.client.0.smithi033.stdout:3/315: chown d2/f11 1 1 2024-02-15T18:31:03.978 INFO:tasks.workunit.client.0.smithi033.stdout:7/358: symlink d0/dc/d10/d1d/d2b/d5f/l7a 0 2024-02-15T18:31:03.983 INFO:tasks.workunit.client.0.smithi033.stdout:3/316: mkdir d2/d3/d1e/d22/d59 0 2024-02-15T18:31:03.983 INFO:tasks.workunit.client.0.smithi033.stdout:7/359: symlink d0/dc/l7b 0 2024-02-15T18:31:03.983 INFO:tasks.workunit.client.0.smithi033.stdout:7/360: chown d0/d56/l6c 1223 1 2024-02-15T18:31:03.983 INFO:tasks.workunit.client.0.smithi033.stdout:7/361: stat d0/dc/d10/d1d/d38/d3a/f3f 0 2024-02-15T18:31:03.983 INFO:tasks.workunit.client.0.smithi033.stdout:7/362: dread - d0/dc/d10/d1d/d2b/f52 zero size 2024-02-15T18:31:03.986 INFO:tasks.workunit.client.0.smithi033.stdout:1/333: dread d5/d9/ff [0,4194304] 0 2024-02-15T18:31:03.986 INFO:tasks.workunit.client.0.smithi033.stdout:1/334: readlink d5/d9/d1e/d20/l4c 0 2024-02-15T18:31:03.990 INFO:tasks.workunit.client.0.smithi033.stdout:1/335: rename d5/d9/d1e/d20/d2c/l48 to d5/d9/d1e/l5a 0 2024-02-15T18:31:03.990 INFO:tasks.workunit.client.0.smithi033.stdout:1/336: chown d5/dd/d12/d49/c2a 1 1 2024-02-15T18:31:03.992 INFO:tasks.workunit.client.0.smithi033.stdout:1/337: creat d5/d9/d1e/d20/d2c/d34/d51/f5b x:0 0 0 2024-02-15T18:31:03.994 INFO:tasks.workunit.client.0.smithi033.stdout:1/338: rename d5/d17/d27 to d5/d9/d1e/d20/d5c 0 2024-02-15T18:31:03.998 INFO:tasks.workunit.client.0.smithi033.stdout:6/421: sync 2024-02-15T18:31:03.998 INFO:tasks.workunit.client.0.smithi033.stdout:5/402: sync 2024-02-15T18:31:03.998 INFO:tasks.workunit.client.0.smithi033.stdout:2/353: sync 2024-02-15T18:31:03.998 INFO:tasks.workunit.client.0.smithi033.stdout:9/240: sync 2024-02-15T18:31:03.998 INFO:tasks.workunit.client.0.smithi033.stdout:5/403: chown d1/da/f1b 25636361 1 2024-02-15T18:31:03.998 INFO:tasks.workunit.client.0.smithi033.stdout:6/422: write d8/d28/d14/d2c/d3b/f49 [456801,64085] 0 2024-02-15T18:31:03.998 INFO:tasks.workunit.client.0.smithi033.stdout:4/372: sync 2024-02-15T18:31:03.998 INFO:tasks.workunit.client.0.smithi033.stdout:1/339: dread d5/d9/ff [0,4194304] 0 2024-02-15T18:31:03.999 INFO:tasks.workunit.client.0.smithi033.stdout:1/340: chown d5/dd/d12/f58 457917019 1 2024-02-15T18:31:04.000 INFO:tasks.workunit.client.0.smithi033.stdout:2/354: link c1a d20/d3a/d4a/d5e/c89 0 2024-02-15T18:31:04.001 INFO:tasks.workunit.client.0.smithi033.stdout:9/241: rename d4/c22 to d4/d2c/c56 0 2024-02-15T18:31:04.001 INFO:tasks.workunit.client.0.smithi033.stdout:9/242: readlink d4/d8/dd/d41/d51/l53 0 2024-02-15T18:31:04.004 INFO:tasks.workunit.client.0.smithi033.stdout:6/423: mkdir d8/d28/d14/d2c/d31/d5d/d8c 0 2024-02-15T18:31:04.005 INFO:tasks.workunit.client.0.smithi033.stdout:4/373: mknod d4/d20/d53/c75 0 2024-02-15T18:31:04.005 INFO:tasks.workunit.client.0.smithi033.stdout:6/424: write d8/d1d/f1b [3952027,38245] 0 2024-02-15T18:31:04.006 INFO:tasks.workunit.client.0.smithi033.stdout:2/355: creat d20/d31/d47/d4c/d6c/d80/f8a x:0 0 0 2024-02-15T18:31:04.007 INFO:tasks.workunit.client.0.smithi033.stdout:9/243: symlink d4/d8/dd/d41/l57 0 2024-02-15T18:31:04.009 INFO:tasks.workunit.client.0.smithi033.stdout:5/404: dread d1/f27 [0,4194304] 0 2024-02-15T18:31:04.009 INFO:tasks.workunit.client.0.smithi033.stdout:4/374: symlink d4/d20/d13/d5c/l76 0 2024-02-15T18:31:04.012 INFO:tasks.workunit.client.0.smithi033.stdout:6/425: unlink d8/d1d/d2a/d55/l5c 0 2024-02-15T18:31:04.013 INFO:tasks.workunit.client.0.smithi033.stdout:2/356: symlink d20/d3a/d4a/d5e/d6b/l8b 0 2024-02-15T18:31:04.013 INFO:tasks.workunit.client.0.smithi033.stdout:6/426: write d8/d28/d14/d2c/d3b/d3d/f48 [2602600,60154] 0 2024-02-15T18:31:04.015 INFO:tasks.workunit.client.0.smithi033.stdout:5/405: link d1/da/d10/l21 d1/da/d19/l6f 0 2024-02-15T18:31:04.016 INFO:tasks.workunit.client.0.smithi033.stdout:0/326: dwrite d0/d64/d1d/f21 [0,4194304] 0 2024-02-15T18:31:04.016 INFO:tasks.workunit.client.0.smithi033.stdout:2/357: symlink d20/d30/l8c 0 2024-02-15T18:31:04.017 INFO:tasks.workunit.client.0.smithi033.stdout:2/358: dread - d20/d3a/d4a/f67 zero size 2024-02-15T18:31:04.017 INFO:tasks.workunit.client.0.smithi033.stdout:4/375: symlink d4/l77 0 2024-02-15T18:31:04.018 INFO:tasks.workunit.client.0.smithi033.stdout:5/406: creat d1/da/d19/d3c/f70 x:0 0 0 2024-02-15T18:31:04.018 INFO:tasks.workunit.client.0.smithi033.stdout:0/327: symlink d0/d64/d3b/d6c/d56/l6d 0 2024-02-15T18:31:04.021 INFO:tasks.workunit.client.0.smithi033.stdout:3/317: dwrite d2/d3/d1e/f24 [0,4194304] 0 2024-02-15T18:31:04.021 INFO:tasks.workunit.client.0.smithi033.stdout:3/318: truncate d2/d3/d1e/d22/d4d/f56 143733 0 2024-02-15T18:31:04.021 INFO:tasks.workunit.client.0.smithi033.stdout:2/359: link d20/d31/d47/f6d d20/d30/f8d 0 2024-02-15T18:31:04.021 INFO:tasks.workunit.client.0.smithi033.stdout:2/360: getdents d20/d3a/d4a/d5e/d6b/d83 0 2024-02-15T18:31:04.021 INFO:tasks.workunit.client.0.smithi033.stdout:2/361: truncate d20/d3a/d4a/d5e/f69 518511 0 2024-02-15T18:31:04.022 INFO:tasks.workunit.client.0.smithi033.stdout:2/362: stat d20/d31/d47/d4c 0 2024-02-15T18:31:04.022 INFO:tasks.workunit.client.0.smithi033.stdout:2/363: fdatasync d20/d31/d47/d4c/d6c/d80/f85 0 2024-02-15T18:31:04.023 INFO:tasks.workunit.client.0.smithi033.stdout:4/376: rename d4/d20/d13/f58 to d4/d20/d53/f78 0 2024-02-15T18:31:04.024 INFO:tasks.workunit.client.0.smithi033.stdout:5/407: dread d1/f27 [0,4194304] 0 2024-02-15T18:31:04.025 INFO:tasks.workunit.client.0.smithi033.stdout:0/328: mknod d0/d8/d15/d4b/d58/c6e 0 2024-02-15T18:31:04.026 INFO:tasks.workunit.client.0.smithi033.stdout:2/364: creat d20/d3a/d4a/f8e x:0 0 0 2024-02-15T18:31:04.026 INFO:tasks.workunit.client.0.smithi033.stdout:0/329: chown d0/d64/d3b/d6c/d56/l67 1415034 1 2024-02-15T18:31:04.026 INFO:tasks.workunit.client.0.smithi033.stdout:4/377: creat d4/d5/d28/d39/f79 x:0 0 0 2024-02-15T18:31:04.026 INFO:tasks.workunit.client.0.smithi033.stdout:4/378: write d4/f15 [2372522,88475] 0 2024-02-15T18:31:04.028 INFO:tasks.workunit.client.0.smithi033.stdout:0/330: unlink d0/d8/f35 0 2024-02-15T18:31:04.031 INFO:tasks.workunit.client.0.smithi033.stdout:0/331: rmdir d0/d8/d15/d2d/d2e 39 2024-02-15T18:31:04.031 INFO:tasks.workunit.client.0.smithi033.stdout:0/332: chown d0/d8/d15/d2d/d3f/c60 327 1 2024-02-15T18:31:04.031 INFO:tasks.workunit.client.0.smithi033.stdout:0/333: write d0/d8/d15/d2d/d2e/f51 [8805224,77435] 0 2024-02-15T18:31:04.031 INFO:tasks.workunit.client.0.smithi033.stdout:0/334: chown d0/d64/d1d/l62 145229661 1 2024-02-15T18:31:04.031 INFO:tasks.workunit.client.0.smithi033.stdout:4/379: write d4/d20/f9 [5288345,104404] 0 2024-02-15T18:31:04.034 INFO:tasks.workunit.client.0.smithi033.stdout:0/335: mkdir d0/d8/d15/d2d/d3f/d6f 0 2024-02-15T18:31:04.034 INFO:tasks.workunit.client.0.smithi033.stdout:0/336: fsync d0/d8/f45 0 2024-02-15T18:31:04.034 INFO:tasks.workunit.client.0.smithi033.stdout:1/341: dwrite d5/dd/d12/d49/f4a [0,4194304] 0 2024-02-15T18:31:04.039 INFO:tasks.workunit.client.0.smithi033.stdout:3/319: dread d2/d14/f42 [0,4194304] 0 2024-02-15T18:31:04.042 INFO:tasks.workunit.client.0.smithi033.stdout:6/427: dread d8/d28/f35 [0,4194304] 0 2024-02-15T18:31:04.043 INFO:tasks.workunit.client.0.smithi033.stdout:9/244: dwrite d4/d8/dd/d28/f4c [0,4194304] 0 2024-02-15T18:31:04.051 INFO:tasks.workunit.client.0.smithi033.stdout:6/428: dread d8/d28/d14/f13 [0,4194304] 0 2024-02-15T18:31:04.051 INFO:tasks.workunit.client.0.smithi033.stdout:9/245: mknod d4/d8/dd/d41/c58 0 2024-02-15T18:31:04.056 INFO:tasks.workunit.client.0.smithi033.stdout:9/246: dread f0 [0,4194304] 0 2024-02-15T18:31:04.058 INFO:tasks.workunit.client.0.smithi033.stdout:2/365: dwrite d20/d31/d6a/f41 [0,4194304] 0 2024-02-15T18:31:04.059 INFO:tasks.workunit.client.0.smithi033.stdout:9/247: rename d4/l44 to d4/d8/dd/d28/l59 0 2024-02-15T18:31:04.059 INFO:tasks.workunit.client.0.smithi033.stdout:5/408: dwrite d1/da/f2c [0,4194304] 0 2024-02-15T18:31:04.061 INFO:tasks.workunit.client.0.smithi033.stdout:2/366: link d20/d3a/f68 d20/d3a/d4a/d5e/d6b/f8f 0 2024-02-15T18:31:04.062 INFO:tasks.workunit.client.0.smithi033.stdout:2/367: write d20/d31/f51 [511885,28567] 0 2024-02-15T18:31:04.062 INFO:tasks.workunit.client.0.smithi033.stdout:2/368: chown d20/d3a/d4a 200 1 2024-02-15T18:31:04.063 INFO:tasks.workunit.client.0.smithi033.stdout:2/369: mknod d20/d31/d47/d4c/d6c/d80/c90 0 2024-02-15T18:31:04.065 INFO:tasks.workunit.client.0.smithi033.stdout:2/370: rename d20/d3a/d4a/d5e/d6b/l8b to d20/d31/d6a/l91 0 2024-02-15T18:31:04.065 INFO:tasks.workunit.client.0.smithi033.stdout:2/371: chown c1a 2351167 1 2024-02-15T18:31:04.072 INFO:tasks.workunit.client.0.smithi033.stdout:8/264: sync 2024-02-15T18:31:04.076 INFO:tasks.workunit.client.0.smithi033.stdout:5/409: dread d1/da/fb [0,4194304] 0 2024-02-15T18:31:04.080 INFO:tasks.workunit.client.0.smithi033.stdout:9/248: dread d4/d8/dd/fe [0,4194304] 0 2024-02-15T18:31:04.085 INFO:tasks.workunit.client.0.smithi033.stdout:4/380: rmdir d4/d20/d53 39 2024-02-15T18:31:04.088 INFO:tasks.workunit.client.0.smithi033.stdout:9/249: dread d4/d8/d1b/d2f/f30 [0,4194304] 0 2024-02-15T18:31:04.088 INFO:tasks.workunit.client.0.smithi033.stdout:9/250: write d4/f45 [509529,63591] 0 2024-02-15T18:31:04.089 INFO:tasks.workunit.client.0.smithi033.stdout:5/410: mkdir d1/da/d10/d2b/d42/d71 0 2024-02-15T18:31:04.090 INFO:tasks.workunit.client.0.smithi033.stdout:0/337: truncate d0/d8/d15/d2d/d2e/f51 7717806 0 2024-02-15T18:31:04.090 INFO:tasks.workunit.client.0.smithi033.stdout:0/338: stat d0/d8/d15/d2d/f4a 0 2024-02-15T18:31:04.092 INFO:tasks.workunit.client.0.smithi033.stdout:4/381: creat d4/d20/f7a x:0 0 0 2024-02-15T18:31:04.093 INFO:tasks.workunit.client.0.smithi033.stdout:4/382: stat d4/d20/l18 0 2024-02-15T18:31:04.093 INFO:tasks.workunit.client.0.smithi033.stdout:4/383: dread - d4/d20/d13/d34/f5a zero size 2024-02-15T18:31:04.093 INFO:tasks.workunit.client.0.smithi033.stdout:0/339: creat d0/d8/d15/f70 x:0 0 0 2024-02-15T18:31:04.094 INFO:tasks.workunit.client.0.smithi033.stdout:4/384: creat d4/d20/d13/d34/f7b x:0 0 0 2024-02-15T18:31:04.097 INFO:tasks.workunit.client.0.smithi033.stdout:2/372: dwrite d20/d31/d47/d4c/f63 [0,4194304] 0 2024-02-15T18:31:04.097 INFO:tasks.workunit.client.0.smithi033.stdout:2/373: chown d20/d39/l3d 1917146401 1 2024-02-15T18:31:04.097 INFO:tasks.workunit.client.0.smithi033.stdout:4/385: mkdir d4/d20/d13/d1b/d7c 0 2024-02-15T18:31:04.099 INFO:tasks.workunit.client.0.smithi033.stdout:2/374: creat d20/d31/d47/d4c/f92 x:0 0 0 2024-02-15T18:31:04.099 INFO:tasks.workunit.client.0.smithi033.stdout:2/375: fsync d20/d3a/d4a/f8e 0 2024-02-15T18:31:04.099 INFO:tasks.workunit.client.0.smithi033.stdout:8/265: dwrite d0/fe [4194304,4194304] 0 2024-02-15T18:31:04.100 INFO:tasks.workunit.client.0.smithi033.stdout:8/266: fsync d0/d2/f39 0 2024-02-15T18:31:04.100 INFO:tasks.workunit.client.0.smithi033.stdout:6/429: dwrite d8/d28/d14/d2c/d31/d30/d29/d38/d54/f88 [0,4194304] 0 2024-02-15T18:31:04.100 INFO:tasks.workunit.client.0.smithi033.stdout:2/376: truncate d20/d31/d6a/f26 1952712 0 2024-02-15T18:31:04.101 INFO:tasks.workunit.client.0.smithi033.stdout:4/386: symlink d4/d5/l7d 0 2024-02-15T18:31:04.101 INFO:tasks.workunit.client.0.smithi033.stdout:4/387: fdatasync d4/f67 0 2024-02-15T18:31:04.104 INFO:tasks.workunit.client.0.smithi033.stdout:6/430: link d8/f4e d8/d28/d14/d2c/d31/d30/d29/d38/d54/f8d 0 2024-02-15T18:31:04.104 INFO:tasks.workunit.client.0.smithi033.stdout:5/411: dread d1/da/d19/f34 [0,4194304] 0 2024-02-15T18:31:04.104 INFO:tasks.workunit.client.0.smithi033.stdout:5/412: chown d1/da/d10/l21 1 1 2024-02-15T18:31:04.105 INFO:tasks.workunit.client.0.smithi033.stdout:9/251: dwrite d4/d8/fb [4194304,4194304] 0 2024-02-15T18:31:04.105 INFO:tasks.workunit.client.0.smithi033.stdout:4/388: truncate d4/d20/f11 1923993 0 2024-02-15T18:31:04.108 INFO:tasks.workunit.client.0.smithi033.stdout:5/413: mkdir d1/da/d10/d2b/d42/d4c/d72 0 2024-02-15T18:31:04.108 INFO:tasks.workunit.client.0.smithi033.stdout:5/414: truncate d1/da/f24 698212 0 2024-02-15T18:31:04.116 INFO:tasks.workunit.client.0.smithi033.stdout:6/431: mknod d8/d28/d14/d2c/d31/d5d/d8c/c8e 0 2024-02-15T18:31:04.118 INFO:tasks.workunit.client.0.smithi033.stdout:9/252: creat d4/f5a x:0 0 0 2024-02-15T18:31:04.119 INFO:tasks.workunit.client.0.smithi033.stdout:5/415: symlink d1/da/d10/d2b/l73 0 2024-02-15T18:31:04.121 INFO:tasks.workunit.client.0.smithi033.stdout:0/340: rename d0/d8/d15/d2d/d2e/f51 to d0/d8/d15/d4b/f71 0 2024-02-15T18:31:04.123 INFO:tasks.workunit.client.0.smithi033.stdout:6/432: getdents d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e 0 2024-02-15T18:31:04.123 INFO:tasks.workunit.client.0.smithi033.stdout:8/267: dwrite d0/d2/f41 [0,4194304] 0 2024-02-15T18:31:04.123 INFO:tasks.workunit.client.0.smithi033.stdout:9/253: creat d4/d8/d1b/f5b x:0 0 0 2024-02-15T18:31:04.124 INFO:tasks.workunit.client.0.smithi033.stdout:9/254: fdatasync d4/d32/f3b 0 2024-02-15T18:31:04.124 INFO:tasks.workunit.client.0.smithi033.stdout:9/255: read d4/d8/dd/f13 [308453,107987] 0 2024-02-15T18:31:04.124 INFO:tasks.workunit.client.0.smithi033.stdout:5/416: mkdir d1/da/d19/d74 0 2024-02-15T18:31:04.124 INFO:tasks.workunit.client.0.smithi033.stdout:9/256: write d4/d8/d1b/f5b [176918,59310] 0 2024-02-15T18:31:04.126 INFO:tasks.workunit.client.0.smithi033.stdout:4/389: rename d4/d5/d28/l2e to d4/d20/d13/d1b/d7c/l7e 0 2024-02-15T18:31:04.127 INFO:tasks.workunit.client.0.smithi033.stdout:2/377: dwrite d20/d3a/d4a/d5e/f61 [0,4194304] 0 2024-02-15T18:31:04.135 INFO:tasks.workunit.client.0.smithi033.stdout:8/268: symlink d0/df/d48/l54 0 2024-02-15T18:31:04.136 INFO:tasks.workunit.client.0.smithi033.stdout:5/417: creat d1/da/d10/f75 x:0 0 0 2024-02-15T18:31:04.137 INFO:tasks.workunit.client.0.smithi033.stdout:4/390: write d4/d20/d13/d1b/f64 [405108,48537] 0 2024-02-15T18:31:04.140 INFO:tasks.workunit.client.0.smithi033.stdout:4/391: write d4/d20/d13/d1b/f64 [69486,59160] 0 2024-02-15T18:31:04.140 INFO:tasks.workunit.client.0.smithi033.stdout:2/378: dread d20/d31/f51 [0,4194304] 0 2024-02-15T18:31:04.145 INFO:tasks.workunit.client.0.smithi033.stdout:9/257: mkdir d4/d8/dd/d5c 0 2024-02-15T18:31:04.146 INFO:tasks.workunit.client.0.smithi033.stdout:9/258: write d4/d8/f46 [1380546,21620] 0 2024-02-15T18:31:04.146 INFO:tasks.workunit.client.0.smithi033.stdout:9/259: write d4/d32/f54 [106391,100209] 0 2024-02-15T18:31:04.147 INFO:tasks.workunit.client.0.smithi033.stdout:9/260: write d4/d8/dd/f13 [3545460,61438] 0 2024-02-15T18:31:04.147 INFO:tasks.workunit.client.0.smithi033.stdout:9/261: readlink d4/d8/dd/d41/l57 0 2024-02-15T18:31:04.151 INFO:tasks.workunit.client.0.smithi033.stdout:9/262: dread d4/d8/d1b/d2f/f30 [0,4194304] 0 2024-02-15T18:31:04.151 INFO:tasks.workunit.client.0.smithi033.stdout:9/263: truncate d4/d8/d1b/f5b 1039534 0 2024-02-15T18:31:04.151 INFO:tasks.workunit.client.0.smithi033.stdout:0/341: dwrite d0/d64/d1d/f1f [0,4194304] 0 2024-02-15T18:31:04.153 INFO:tasks.workunit.client.0.smithi033.stdout:0/342: symlink d0/d64/d3b/d6c/l72 0 2024-02-15T18:31:04.156 INFO:tasks.workunit.client.0.smithi033.stdout:5/418: rmdir d1 39 2024-02-15T18:31:04.157 INFO:tasks.workunit.client.0.smithi033.stdout:9/264: dread d4/d8/dd/d28/f4c [0,4194304] 0 2024-02-15T18:31:04.158 INFO:tasks.workunit.client.0.smithi033.stdout:5/419: rmdir d1/da/d10/d2b/d42/d4c/d72 0 2024-02-15T18:31:04.158 INFO:tasks.workunit.client.0.smithi033.stdout:9/265: creat d4/d8/dd/d41/f5d x:0 0 0 2024-02-15T18:31:04.158 INFO:tasks.workunit.client.0.smithi033.stdout:9/266: chown d4/d8 902 1 2024-02-15T18:31:04.159 INFO:tasks.workunit.client.0.smithi033.stdout:6/433: dwrite d8/d28/d36/f4a [4194304,4194304] 0 2024-02-15T18:31:04.160 INFO:tasks.workunit.client.0.smithi033.stdout:2/379: dwrite d20/d3a/d4a/d5e/d6b/f8f [0,4194304] 0 2024-02-15T18:31:04.160 INFO:tasks.workunit.client.0.smithi033.stdout:2/380: dread - d20/d31/f7c zero size 2024-02-15T18:31:04.160 INFO:tasks.workunit.client.0.smithi033.stdout:2/381: chown d20/d3a/d4a/d5e/f69 21798 1 2024-02-15T18:31:04.160 INFO:tasks.workunit.client.0.smithi033.stdout:2/382: write d20/d31/f7e [416452,43123] 0 2024-02-15T18:31:04.161 INFO:tasks.workunit.client.0.smithi033.stdout:5/420: rename d1/da/d10/d2b/f48 to d1/da/d19/d3f/d68/f76 0 2024-02-15T18:31:04.163 INFO:tasks.workunit.client.0.smithi033.stdout:6/434: truncate d8/d28/f35 2087048 0 2024-02-15T18:31:04.164 INFO:tasks.workunit.client.0.smithi033.stdout:8/269: dwrite d0/df/f49 [0,4194304] 0 2024-02-15T18:31:04.164 INFO:tasks.workunit.client.0.smithi033.stdout:8/270: write d0/d2/d35/d29/f46 [689262,89579] 0 2024-02-15T18:31:04.165 INFO:tasks.workunit.client.0.smithi033.stdout:2/383: symlink d20/d31/d47/d64/l93 0 2024-02-15T18:31:04.167 INFO:tasks.workunit.client.0.smithi033.stdout:5/421: unlink d1/da/d10/d2b/f3d 0 2024-02-15T18:31:04.167 INFO:tasks.workunit.client.0.smithi033.stdout:5/422: truncate d1/da/f69 547587 0 2024-02-15T18:31:04.167 INFO:tasks.workunit.client.0.smithi033.stdout:5/423: write d1/da/d11/d5e/f6c [208977,5944] 0 2024-02-15T18:31:04.167 INFO:tasks.workunit.client.0.smithi033.stdout:5/424: write d1/da/f69 [1514508,103358] 0 2024-02-15T18:31:04.167 INFO:tasks.workunit.client.0.smithi033.stdout:9/267: mknod d4/d8/c5e 0 2024-02-15T18:31:04.169 INFO:tasks.workunit.client.0.smithi033.stdout:8/271: symlink d0/df/db/d1b/l55 0 2024-02-15T18:31:04.171 INFO:tasks.workunit.client.0.smithi033.stdout:2/384: rmdir d20/d39 39 2024-02-15T18:31:04.172 INFO:tasks.workunit.client.0.smithi033.stdout:2/385: readlink d20/d31/d47/l53 0 2024-02-15T18:31:04.172 INFO:tasks.workunit.client.0.smithi033.stdout:0/343: dwrite d0/d64/d1d/f43 [0,4194304] 0 2024-02-15T18:31:04.172 INFO:tasks.workunit.client.0.smithi033.stdout:5/425: creat d1/da/d10/d2b/d33/f77 x:0 0 0 2024-02-15T18:31:04.172 INFO:tasks.workunit.client.0.smithi033.stdout:0/344: write d0/d64/d3b/d6c/d56/f69 [106054,19463] 0 2024-02-15T18:31:04.173 INFO:tasks.workunit.client.0.smithi033.stdout:9/268: symlink d4/d8/d1b/d2f/l5f 0 2024-02-15T18:31:04.173 INFO:tasks.workunit.client.0.smithi033.stdout:8/272: mkdir d0/d2/d14/d56 0 2024-02-15T18:31:04.174 INFO:tasks.workunit.client.0.smithi033.stdout:9/269: write d4/d8/dd/f13 [3290947,108128] 0 2024-02-15T18:31:04.174 INFO:tasks.workunit.client.0.smithi033.stdout:9/270: stat d4/d8/d1b/f4a 0 2024-02-15T18:31:04.174 INFO:tasks.workunit.client.0.smithi033.stdout:9/271: chown d4/d32/f3b 114820558 1 2024-02-15T18:31:04.177 INFO:tasks.workunit.client.0.smithi033.stdout:2/386: read d20/d31/d6a/f2e [4001470,90089] 0 2024-02-15T18:31:04.181 INFO:tasks.workunit.client.0.smithi033.stdout:5/426: mknod d1/da/d10/d2b/d33/d63/d61/c78 0 2024-02-15T18:31:04.181 INFO:tasks.workunit.client.0.smithi033.stdout:5/427: chown d1/da/d11/c6a 521529 1 2024-02-15T18:31:04.181 INFO:tasks.workunit.client.0.smithi033.stdout:0/345: mkdir d0/d8/d15/d2d/d41/d73 0 2024-02-15T18:31:04.181 INFO:tasks.workunit.client.0.smithi033.stdout:6/435: dwrite d8/d28/d14/d2c/f61 [0,4194304] 0 2024-02-15T18:31:04.181 INFO:tasks.workunit.client.0.smithi033.stdout:6/436: readlink d8/l1f 0 2024-02-15T18:31:04.182 INFO:tasks.workunit.client.0.smithi033.stdout:8/273: mknod d0/d2/d35/d29/c57 0 2024-02-15T18:31:04.184 INFO:tasks.workunit.client.0.smithi033.stdout:9/272: mkdir d4/d8/dd/d28/d60 0 2024-02-15T18:31:04.186 INFO:tasks.workunit.client.0.smithi033.stdout:5/428: creat d1/f79 x:0 0 0 2024-02-15T18:31:04.186 INFO:tasks.workunit.client.0.smithi033.stdout:5/429: write d1/f5d [943097,59287] 0 2024-02-15T18:31:04.186 INFO:tasks.workunit.client.0.smithi033.stdout:2/387: dread d20/f3c [0,4194304] 0 2024-02-15T18:31:04.188 INFO:tasks.workunit.client.0.smithi033.stdout:0/346: creat d0/d8/f74 x:0 0 0 2024-02-15T18:31:04.190 INFO:tasks.workunit.client.0.smithi033.stdout:6/437: unlink f7 0 2024-02-15T18:31:04.193 INFO:tasks.workunit.client.0.smithi033.stdout:8/274: mkdir d0/d2/d35/d58 0 2024-02-15T18:31:04.193 INFO:tasks.workunit.client.0.smithi033.stdout:8/275: chown d0/df/db/d45/f4a 677161 1 2024-02-15T18:31:04.195 INFO:tasks.workunit.client.0.smithi033.stdout:5/430: mknod d1/da/d11/d5e/c7a 0 2024-02-15T18:31:04.195 INFO:tasks.workunit.client.0.smithi033.stdout:5/431: chown d1/da/d10/d2b/d42/d4c/f53 2048924 1 2024-02-15T18:31:04.196 INFO:tasks.workunit.client.0.smithi033.stdout:5/432: read d1/da/f2c [2215470,125321] 0 2024-02-15T18:31:04.197 INFO:tasks.workunit.client.0.smithi033.stdout:2/388: symlink d20/d3a/d4a/d5e/d6b/d88/l94 0 2024-02-15T18:31:04.201 INFO:tasks.workunit.client.0.smithi033.stdout:6/438: mknod d8/d28/d14/d2c/d31/d5d/d8c/c8f 0 2024-02-15T18:31:04.201 INFO:tasks.workunit.client.0.smithi033.stdout:8/276: mkdir d0/d2/d14/d56/d59 0 2024-02-15T18:31:04.201 INFO:tasks.workunit.client.0.smithi033.stdout:8/277: chown d0/df/db/d1b/d4b/f4c 173796 1 2024-02-15T18:31:04.204 INFO:tasks.workunit.client.0.smithi033.stdout:2/389: symlink d20/d3a/d4a/d5e/d6b/l95 0 2024-02-15T18:31:04.205 INFO:tasks.workunit.client.0.smithi033.stdout:6/439: unlink d8/d1d/d2a/d55/d63/c6d 0 2024-02-15T18:31:04.205 INFO:tasks.workunit.client.0.smithi033.stdout:6/440: truncate d8/d28/d14/d2c/d3b/f86 473503 0 2024-02-15T18:31:04.206 INFO:tasks.workunit.client.0.smithi033.stdout:6/441: write d8/d28/d14/d2c/d3b/d3d/f48 [2789510,89] 0 2024-02-15T18:31:04.206 INFO:tasks.workunit.client.0.smithi033.stdout:6/442: fdatasync d8/f4e 0 2024-02-15T18:31:04.206 INFO:tasks.workunit.client.0.smithi033.stdout:6/443: write d8/d28/d14/d2c/d31/d30/d29/f59 [693994,35706] 0 2024-02-15T18:31:04.211 INFO:tasks.workunit.client.0.smithi033.stdout:2/390: rename d20/d3a/d4a/d5e/l79 to d20/d31/l96 0 2024-02-15T18:31:04.215 INFO:tasks.workunit.client.0.smithi033.stdout:2/391: rename c2 to d20/d3a/d4a/d5e/c97 0 2024-02-15T18:31:04.215 INFO:tasks.workunit.client.0.smithi033.stdout:2/392: dread - d20/d3a/d4a/f67 zero size 2024-02-15T18:31:04.223 INFO:tasks.workunit.client.0.smithi033.stdout:9/273: dwrite d4/f4f [0,4194304] 0 2024-02-15T18:31:04.223 INFO:tasks.workunit.client.0.smithi033.stdout:9/274: readlink d4/d2c/l33 0 2024-02-15T18:31:04.223 INFO:tasks.workunit.client.0.smithi033.stdout:9/275: write d4/d8/d1b/d2f/f30 [5156601,127677] 0 2024-02-15T18:31:04.224 INFO:tasks.workunit.client.0.smithi033.stdout:9/276: dread d4/d8/dd/f3d [0,4194304] 0 2024-02-15T18:31:04.225 INFO:tasks.workunit.client.0.smithi033.stdout:9/277: truncate d4/d8/dd/fe 3140360 0 2024-02-15T18:31:04.226 INFO:tasks.workunit.client.0.smithi033.stdout:9/278: mkdir d4/d8/d1b/d61 0 2024-02-15T18:31:04.227 INFO:tasks.workunit.client.0.smithi033.stdout:9/279: fdatasync d4/f4f 0 2024-02-15T18:31:04.234 INFO:tasks.workunit.client.0.smithi033.stdout:0/347: dwrite d0/f10 [0,4194304] 0 2024-02-15T18:31:04.234 INFO:tasks.workunit.client.0.smithi033.stdout:0/348: fsync d0/d8/f74 0 2024-02-15T18:31:04.235 INFO:tasks.workunit.client.0.smithi033.stdout:5/433: dwrite d1/da/d19/f57 [0,4194304] 0 2024-02-15T18:31:04.236 INFO:tasks.workunit.client.0.smithi033.stdout:6/444: dwrite d8/d1d/f1b [0,4194304] 0 2024-02-15T18:31:04.236 INFO:tasks.workunit.client.0.smithi033.stdout:8/278: dwrite d0/df/f11 [0,4194304] 0 2024-02-15T18:31:04.236 INFO:tasks.workunit.client.0.smithi033.stdout:0/349: creat d0/d2/f75 x:0 0 0 2024-02-15T18:31:04.236 INFO:tasks.workunit.client.0.smithi033.stdout:0/350: chown d0/d8/d15 11298615 1 2024-02-15T18:31:04.240 INFO:tasks.workunit.client.0.smithi033.stdout:0/351: read d0/d64/d1d/f43 [1007010,129179] 0 2024-02-15T18:31:04.240 INFO:tasks.workunit.client.0.smithi033.stdout:0/352: fsync d0/f10 0 2024-02-15T18:31:04.253 INFO:tasks.workunit.client.0.smithi033.stdout:5/434: creat d1/da/d10/d2b/d33/f7b x:0 0 0 2024-02-15T18:31:04.253 INFO:tasks.workunit.client.0.smithi033.stdout:5/435: dread - d1/da/d10/d2b/d33/f77 zero size 2024-02-15T18:31:04.254 INFO:tasks.workunit.client.0.smithi033.stdout:6/445: getdents d8/d28/d14/d2c/d31/d5d 0 2024-02-15T18:31:04.254 INFO:tasks.workunit.client.0.smithi033.stdout:6/446: write d8/d1d/d2a/f56 [549210,126473] 0 2024-02-15T18:31:04.256 INFO:tasks.workunit.client.0.smithi033.stdout:5/436: dread d1/da/d19/f22 [0,4194304] 0 2024-02-15T18:31:04.256 INFO:tasks.workunit.client.0.smithi033.stdout:0/353: creat d0/d8/d15/d2d/d2e/f76 x:0 0 0 2024-02-15T18:31:04.256 INFO:tasks.workunit.client.0.smithi033.stdout:0/354: chown d0/l1 2920534 1 2024-02-15T18:31:04.257 INFO:tasks.workunit.client.0.smithi033.stdout:5/437: creat d1/da/d11/f7c x:0 0 0 2024-02-15T18:31:04.258 INFO:tasks.workunit.client.0.smithi033.stdout:5/438: readlink d1/da/d10/d2b/d33/d63/l4a 0 2024-02-15T18:31:04.259 INFO:tasks.workunit.client.0.smithi033.stdout:5/439: mknod d1/da/d10/d2b/c7d 0 2024-02-15T18:31:04.261 INFO:tasks.workunit.client.0.smithi033.stdout:0/355: write d0/d2/f3c [468724,50846] 0 2024-02-15T18:31:04.263 INFO:tasks.workunit.client.0.smithi033.stdout:0/356: mkdir d0/d8/d15/d4b/d58/d77 0 2024-02-15T18:31:04.263 INFO:tasks.workunit.client.0.smithi033.stdout:0/357: readlink d0/d64/d3b/d6c/l4c 0 2024-02-15T18:31:04.265 INFO:tasks.workunit.client.0.smithi033.stdout:0/358: rename d0/d2/f23 to d0/f78 0 2024-02-15T18:31:04.267 INFO:tasks.workunit.client.0.smithi033.stdout:0/359: mkdir d0/d8/d15/d2d/d41/d79 0 2024-02-15T18:31:04.267 INFO:tasks.workunit.client.0.smithi033.stdout:0/360: readlink d0/d8/d15/d2d/d3f/l53 0 2024-02-15T18:31:04.267 INFO:tasks.workunit.client.0.smithi033.stdout:0/361: dread - d0/d8/d15/d2d/f57 zero size 2024-02-15T18:31:04.275 INFO:tasks.workunit.client.0.smithi033.stdout:8/279: dwrite d0/df/db/f23 [0,4194304] 0 2024-02-15T18:31:04.279 INFO:tasks.workunit.client.0.smithi033.stdout:8/280: unlink d0/df/f49 0 2024-02-15T18:31:04.282 INFO:tasks.workunit.client.0.smithi033.stdout:6/447: dwrite d8/d28/d36/f50 [0,4194304] 0 2024-02-15T18:31:04.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/280: dwrite d4/d8/dd/d28/f4c [0,4194304] 0 2024-02-15T18:31:04.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/281: read - d4/d8/dd/d41/d51/f52 zero size 2024-02-15T18:31:04.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/282: chown d4/d32/f54 710527655 1 2024-02-15T18:31:04.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/283: truncate d4/d8/dd/d41/f5d 574756 0 2024-02-15T18:31:04.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/284: fdatasync d4/d8/dd/d28/f4c 0 2024-02-15T18:31:04.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/285: write d4/f5a [735997,116334] 0 2024-02-15T18:31:04.285 INFO:tasks.workunit.client.0.smithi033.stdout:6/448: link d8/d1d/d37/f79 d8/f90 0 2024-02-15T18:31:04.286 INFO:tasks.workunit.client.0.smithi033.stdout:9/286: mknod d4/d8/dd/d28/d60/c62 0 2024-02-15T18:31:04.287 INFO:tasks.workunit.client.0.smithi033.stdout:9/287: chown d4/d8/dd/d41/l50 20573 1 2024-02-15T18:31:04.288 INFO:tasks.workunit.client.0.smithi033.stdout:9/288: creat d4/d8/dd/f63 x:0 0 0 2024-02-15T18:31:04.288 INFO:tasks.workunit.client.0.smithi033.stdout:6/449: write d8/d28/d14/f34 [1659669,337] 0 2024-02-15T18:31:04.289 INFO:tasks.workunit.client.0.smithi033.stdout:6/450: write d8/d28/f11 [5588925,78072] 0 2024-02-15T18:31:04.289 INFO:tasks.workunit.client.0.smithi033.stdout:9/289: rename d4/d8/dd/d41/c58 to d4/d32/c64 0 2024-02-15T18:31:04.289 INFO:tasks.workunit.client.0.smithi033.stdout:9/290: write d4/d8/dd/d41/d51/f52 [358551,129455] 0 2024-02-15T18:31:04.292 INFO:tasks.workunit.client.0.smithi033.stdout:9/291: mkdir d4/d8/d1b/d2f/d65 0 2024-02-15T18:31:04.292 INFO:tasks.workunit.client.0.smithi033.stdout:0/362: dwrite d0/d8/d15/d2d/d2e/f76 [0,4194304] 0 2024-02-15T18:31:04.293 INFO:tasks.workunit.client.0.smithi033.stdout:5/440: dwrite d1/da/d10/d2b/d42/d4c/f53 [0,4194304] 0 2024-02-15T18:31:04.296 INFO:tasks.workunit.client.0.smithi033.stdout:0/363: read d0/d64/d3b/d6c/d56/f69 [987181,49631] 0 2024-02-15T18:31:04.296 INFO:tasks.workunit.client.0.smithi033.stdout:0/364: chown d0/d8/l1b 352605429 1 2024-02-15T18:31:04.299 INFO:tasks.workunit.client.0.smithi033.stdout:5/441: mknod d1/da/d10/d2b/c7e 0 2024-02-15T18:31:04.300 INFO:tasks.workunit.client.0.smithi033.stdout:0/365: creat d0/f7a x:0 0 0 2024-02-15T18:31:04.301 INFO:tasks.workunit.client.0.smithi033.stdout:0/366: rmdir d0/d8/d15/d2d/d41 39 2024-02-15T18:31:04.302 INFO:tasks.workunit.client.0.smithi033.stdout:0/367: creat d0/d64/f7b x:0 0 0 2024-02-15T18:31:04.304 INFO:tasks.workunit.client.0.smithi033.stdout:8/281: dwrite d0/df/db/d1b/f22 [0,4194304] 0 2024-02-15T18:31:04.304 INFO:tasks.workunit.client.0.smithi033.stdout:6/451: dwrite d8/d28/d14/d2c/d31/d30/f2d [0,4194304] 0 2024-02-15T18:31:04.307 INFO:tasks.workunit.client.0.smithi033.stdout:6/452: dread d8/d28/d14/d2c/d31/f27 [0,4194304] 0 2024-02-15T18:31:04.309 INFO:tasks.workunit.client.0.smithi033.stdout:9/292: truncate d4/d8/dd/d41/d51/f52 406521 0 2024-02-15T18:31:04.309 INFO:tasks.workunit.client.0.smithi033.stdout:9/293: stat d4 0 2024-02-15T18:31:04.310 INFO:tasks.workunit.client.0.smithi033.stdout:8/282: symlink d0/df/d48/l5a 0 2024-02-15T18:31:04.313 INFO:tasks.workunit.client.0.smithi033.stdout:0/368: dread d0/d64/d1d/f43 [0,4194304] 0 2024-02-15T18:31:04.314 INFO:tasks.workunit.client.0.smithi033.stdout:5/442: dwrite d1/da/d19/d3c/f66 [0,4194304] 0 2024-02-15T18:31:04.315 INFO:tasks.workunit.client.0.smithi033.stdout:6/453: creat d8/d28/d36/f91 x:0 0 0 2024-02-15T18:31:04.317 INFO:tasks.workunit.client.0.smithi033.stdout:8/283: symlink d0/d1c/d30/l5b 0 2024-02-15T18:31:04.318 INFO:tasks.workunit.client.0.smithi033.stdout:8/284: write d0/d2/d35/d29/f2e [1543196,52562] 0 2024-02-15T18:31:04.318 INFO:tasks.workunit.client.0.smithi033.stdout:8/285: chown d0/d2/d35/d29/c57 134244 1 2024-02-15T18:31:04.321 INFO:tasks.workunit.client.0.smithi033.stdout:0/369: mkdir d0/d8/d15/d7c 0 2024-02-15T18:31:04.323 INFO:tasks.workunit.client.0.smithi033.stdout:5/443: symlink d1/da/d10/l7f 0 2024-02-15T18:31:04.324 INFO:tasks.workunit.client.0.smithi033.stdout:5/444: fsync d1/da/d11/f2d 0 2024-02-15T18:31:04.324 INFO:tasks.workunit.client.0.smithi033.stdout:5/445: write d1/da/d11/f49 [521825,43181] 0 2024-02-15T18:31:04.324 INFO:tasks.workunit.client.0.smithi033.stdout:5/446: stat d1/da/d10 0 2024-02-15T18:31:04.324 INFO:tasks.workunit.client.0.smithi033.stdout:5/447: truncate d1/da/d10/d2b/f4d 892859 0 2024-02-15T18:31:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:2/393: sync 2024-02-15T18:31:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:7/363: sync 2024-02-15T18:31:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:3/320: sync 2024-02-15T18:31:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:6/454: rmdir d8/d28/d14 39 2024-02-15T18:31:04.327 INFO:tasks.workunit.client.0.smithi033.stdout:6/455: rename d8/d1d/d2a to d8/d1d/d2a/d55/d92 22 2024-02-15T18:31:04.328 INFO:tasks.workunit.client.0.smithi033.stdout:1/342: sync 2024-02-15T18:31:04.328 INFO:tasks.workunit.client.0.smithi033.stdout:4/392: sync 2024-02-15T18:31:04.328 INFO:tasks.workunit.client.0.smithi033.stdout:4/393: fdatasync d4/d20/f26 0 2024-02-15T18:31:04.328 INFO:tasks.workunit.client.0.smithi033.stdout:4/394: chown d4/d20/f9 173332654 1 2024-02-15T18:31:04.330 INFO:tasks.workunit.client.0.smithi033.stdout:9/294: truncate d4/f5a 594032 0 2024-02-15T18:31:04.331 INFO:tasks.workunit.client.0.smithi033.stdout:5/448: mknod d1/da/c80 0 2024-02-15T18:31:04.332 INFO:tasks.workunit.client.0.smithi033.stdout:2/394: mknod d20/d3a/d4a/d5e/d6b/c98 0 2024-02-15T18:31:04.333 INFO:tasks.workunit.client.0.smithi033.stdout:2/395: write d20/d39/f5a [574068,62711] 0 2024-02-15T18:31:04.334 INFO:tasks.workunit.client.0.smithi033.stdout:1/343: mknod d5/dd/d12/c5d 0 2024-02-15T18:31:04.334 INFO:tasks.workunit.client.0.smithi033.stdout:9/295: chown d4/d8/dd/l18 63 1 2024-02-15T18:31:04.336 INFO:tasks.workunit.client.0.smithi033.stdout:5/449: rename d1/da/d10/d2b/l54 to d1/da/d10/d2b/d42/d4c/l81 0 2024-02-15T18:31:04.338 INFO:tasks.workunit.client.0.smithi033.stdout:9/296: creat d4/d8/dd/d5c/f66 x:0 0 0 2024-02-15T18:31:04.338 INFO:tasks.workunit.client.0.smithi033.stdout:1/344: read d5/dd/d12/d49/d23/f26 [1604714,129104] 0 2024-02-15T18:31:04.339 INFO:tasks.workunit.client.0.smithi033.stdout:1/345: chown d5/d9/f32 849 1 2024-02-15T18:31:04.339 INFO:tasks.workunit.client.0.smithi033.stdout:5/450: creat d1/da/d19/d74/f82 x:0 0 0 2024-02-15T18:31:04.341 INFO:tasks.workunit.client.0.smithi033.stdout:9/297: creat d4/d8/f67 x:0 0 0 2024-02-15T18:31:04.342 INFO:tasks.workunit.client.0.smithi033.stdout:0/370: dwrite d0/d64/ff [0,4194304] 0 2024-02-15T18:31:04.342 INFO:tasks.workunit.client.0.smithi033.stdout:1/346: unlink d5/dd/d12/c5d 0 2024-02-15T18:31:04.344 INFO:tasks.workunit.client.0.smithi033.stdout:3/321: dread d2/d20/f45 [0,4194304] 0 2024-02-15T18:31:04.345 INFO:tasks.workunit.client.0.smithi033.stdout:7/364: dread d0/f6a [0,4194304] 0 2024-02-15T18:31:04.345 INFO:tasks.workunit.client.0.smithi033.stdout:0/371: creat d0/d8/d15/d4b/d58/d77/f7d x:0 0 0 2024-02-15T18:31:04.346 INFO:tasks.workunit.client.0.smithi033.stdout:1/347: truncate d5/dd/f3f 3119734 0 2024-02-15T18:31:04.348 INFO:tasks.workunit.client.0.smithi033.stdout:3/322: symlink d2/d3/d17/l5a 0 2024-02-15T18:31:04.349 INFO:tasks.workunit.client.0.smithi033.stdout:0/372: write d0/f13 [2904079,18482] 0 2024-02-15T18:31:04.349 INFO:tasks.workunit.client.0.smithi033.stdout:4/395: dread d4/d5/f1e [0,4194304] 0 2024-02-15T18:31:04.349 INFO:tasks.workunit.client.0.smithi033.stdout:7/365: symlink d0/dc/l7c 0 2024-02-15T18:31:04.350 INFO:tasks.workunit.client.0.smithi033.stdout:1/348: creat d5/d17/f5e x:0 0 0 2024-02-15T18:31:04.351 INFO:tasks.workunit.client.0.smithi033.stdout:3/323: mkdir d2/d20/d5b 0 2024-02-15T18:31:04.353 INFO:tasks.workunit.client.0.smithi033.stdout:6/456: dwrite d8/d1d/f3c [4194304,4194304] 0 2024-02-15T18:31:04.353 INFO:tasks.workunit.client.0.smithi033.stdout:6/457: write d8/d28/d14/d2c/d3b/f86 [5110219,45830] 0 2024-02-15T18:31:04.354 INFO:tasks.workunit.client.0.smithi033.stdout:4/396: unlink d4/d5/l1a 0 2024-02-15T18:31:04.357 INFO:tasks.workunit.client.0.smithi033.stdout:1/349: symlink d5/d9/d1e/d20/d5c/d57/d59/l5f 0 2024-02-15T18:31:04.358 INFO:tasks.workunit.client.0.smithi033.stdout:6/458: rmdir d8/d1d 39 2024-02-15T18:31:04.362 INFO:tasks.workunit.client.0.smithi033.stdout:6/459: dread d8/d28/f35 [0,4194304] 0 2024-02-15T18:31:04.362 INFO:tasks.workunit.client.0.smithi033.stdout:0/373: dread d0/d8/f44 [0,4194304] 0 2024-02-15T18:31:04.363 INFO:tasks.workunit.client.0.smithi033.stdout:6/460: write d8/d28/d14/d2c/d31/d30/f2d [13742,37142] 0 2024-02-15T18:31:04.369 INFO:tasks.workunit.client.0.smithi033.stdout:4/397: symlink d4/d20/d53/l7f 0 2024-02-15T18:31:04.369 INFO:tasks.workunit.client.0.smithi033.stdout:4/398: fsync d4/d20/f9 0 2024-02-15T18:31:04.370 INFO:tasks.workunit.client.0.smithi033.stdout:0/374: mknod d0/c7e 0 2024-02-15T18:31:04.372 INFO:tasks.workunit.client.0.smithi033.stdout:0/375: creat d0/d8/d15/d2d/d3f/d6f/f7f x:0 0 0 2024-02-15T18:31:04.373 INFO:tasks.workunit.client.0.smithi033.stdout:4/399: symlink d4/d20/d13/d1b/l80 0 2024-02-15T18:31:04.374 INFO:tasks.workunit.client.0.smithi033.stdout:0/376: mkdir d0/d8/d15/d4b/d58/d80 0 2024-02-15T18:31:04.377 INFO:tasks.workunit.client.0.smithi033.stdout:4/400: read d4/d5/d28/f36 [1819348,59560] 0 2024-02-15T18:31:04.379 INFO:tasks.workunit.client.0.smithi033.stdout:4/401: mkdir d4/d20/d13/d1b/d81 0 2024-02-15T18:31:04.380 INFO:tasks.workunit.client.0.smithi033.stdout:4/402: mkdir d4/d20/d13/d34/d82 0 2024-02-15T18:31:04.382 INFO:tasks.workunit.client.0.smithi033.stdout:4/403: symlink d4/d20/d13/d1b/d7c/l83 0 2024-02-15T18:31:04.385 INFO:tasks.workunit.client.0.smithi033.stdout:2/396: dwrite d20/f43 [4194304,4194304] 0 2024-02-15T18:31:04.387 INFO:tasks.workunit.client.0.smithi033.stdout:2/397: link d20/d3a/d4a/f67 d20/d31/d47/d82/f99 0 2024-02-15T18:31:04.392 INFO:tasks.workunit.client.0.smithi033.stdout:2/398: write f5 [5055115,39096] 0 2024-02-15T18:31:04.392 INFO:tasks.workunit.client.0.smithi033.stdout:2/399: truncate d20/d31/d47/d64/f86 336040 0 2024-02-15T18:31:04.393 INFO:tasks.workunit.client.0.smithi033.stdout:2/400: symlink d20/d31/d47/d4c/l9a 0 2024-02-15T18:31:04.394 INFO:tasks.workunit.client.0.smithi033.stdout:2/401: write d20/d39/f5a [135713,127180] 0 2024-02-15T18:31:04.406 INFO:tasks.workunit.client.0.smithi033.stdout:9/298: dwrite d4/d2c/f40 [4194304,4194304] 0 2024-02-15T18:31:04.408 INFO:tasks.workunit.client.0.smithi033.stdout:9/299: getdents d4/d8/dd/d28/d60 0 2024-02-15T18:31:04.408 INFO:tasks.workunit.client.0.smithi033.stdout:9/300: chown d4/d8/dd/d28/l34 3696 1 2024-02-15T18:31:04.409 INFO:tasks.workunit.client.0.smithi033.stdout:5/451: dwrite d1/da/f37 [0,4194304] 0 2024-02-15T18:31:04.409 INFO:tasks.workunit.client.0.smithi033.stdout:9/301: creat d4/d8/dd/d5c/f68 x:0 0 0 2024-02-15T18:31:04.411 INFO:tasks.workunit.client.0.smithi033.stdout:9/302: unlink d4/d8/dd/l1a 0 2024-02-15T18:31:04.412 INFO:tasks.workunit.client.0.smithi033.stdout:5/452: link d1/da/d11/f7c d1/da/d19/d3c/d40/d65/f83 0 2024-02-15T18:31:04.412 INFO:tasks.workunit.client.0.smithi033.stdout:5/453: write d1/da/f12 [1106189,111331] 0 2024-02-15T18:31:04.413 INFO:tasks.workunit.client.0.smithi033.stdout:9/303: creat d4/d8/dd/d41/d51/f69 x:0 0 0 2024-02-15T18:31:04.413 INFO:tasks.workunit.client.0.smithi033.stdout:9/304: write d4/d32/f54 [887559,64492] 0 2024-02-15T18:31:04.413 INFO:tasks.workunit.client.0.smithi033.stdout:5/454: mknod d1/da/d10/d2b/d33/d63/c84 0 2024-02-15T18:31:04.413 INFO:tasks.workunit.client.0.smithi033.stdout:5/455: write d1/da/d19/d3c/d40/f58 [821929,16893] 0 2024-02-15T18:31:04.414 INFO:tasks.workunit.client.0.smithi033.stdout:9/305: stat d4/c7 0 2024-02-15T18:31:04.415 INFO:tasks.workunit.client.0.smithi033.stdout:1/350: dwrite d5/d9/d1e/d20/d5c/f39 [4194304,4194304] 0 2024-02-15T18:31:04.415 INFO:tasks.workunit.client.0.smithi033.stdout:9/306: creat d4/d8/dd/d5c/f6a x:0 0 0 2024-02-15T18:31:04.417 INFO:tasks.workunit.client.0.smithi033.stdout:3/324: dwrite d2/d14/d23/f2f [0,4194304] 0 2024-02-15T18:31:04.417 INFO:tasks.workunit.client.0.smithi033.stdout:0/377: dwrite d0/d64/d1d/f1e [0,4194304] 0 2024-02-15T18:31:04.417 INFO:tasks.workunit.client.0.smithi033.stdout:6/461: dwrite d8/d28/d36/f91 [0,4194304] 0 2024-02-15T18:31:04.417 INFO:tasks.workunit.client.0.smithi033.stdout:6/462: chown d8/d28/d14/d2c/d31/d30 1154625 1 2024-02-15T18:31:04.417 INFO:tasks.workunit.client.0.smithi033.stdout:1/351: getdents d5/d9/d1e/d20/d2c/d34/d51 0 2024-02-15T18:31:04.418 INFO:tasks.workunit.client.0.smithi033.stdout:2/402: dwrite d20/d31/d6a/f23 [0,4194304] 0 2024-02-15T18:31:04.419 INFO:tasks.workunit.client.0.smithi033.stdout:1/352: dread d5/dd/d12/d49/d23/f4d [0,4194304] 0 2024-02-15T18:31:04.420 INFO:tasks.workunit.client.0.smithi033.stdout:1/353: write d5/f8 [948331,126091] 0 2024-02-15T18:31:04.420 INFO:tasks.workunit.client.0.smithi033.stdout:1/354: getdents d5/d9/d1e/d20/d2c/d34/d51 0 2024-02-15T18:31:04.420 INFO:tasks.workunit.client.0.smithi033.stdout:1/355: write d5/d9/d1e/d20/f3d [470445,5230] 0 2024-02-15T18:31:04.427 INFO:tasks.workunit.client.0.smithi033.stdout:3/325: rename d2/d3/df/d29 to d2/d14/d23/d5c 0 2024-02-15T18:31:04.427 INFO:tasks.workunit.client.0.smithi033.stdout:2/403: rename d20/d31 to d20/d31/d47/d82/d9b 22 2024-02-15T18:31:04.432 INFO:tasks.workunit.client.0.smithi033.stdout:9/307: dread d4/d8/dd/f23 [0,4194304] 0 2024-02-15T18:31:04.434 INFO:tasks.workunit.client.0.smithi033.stdout:6/463: mknod d8/d28/d14/c93 0 2024-02-15T18:31:04.434 INFO:tasks.workunit.client.0.smithi033.stdout:6/464: chown d8/d28/d14/d2c/d31/d5d/d8c/c8e 0 1 2024-02-15T18:31:04.447 INFO:tasks.workunit.client.0.smithi033.stdout:1/356: creat d5/d38/f60 x:0 0 0 2024-02-15T18:31:04.448 INFO:tasks.workunit.client.0.smithi033.stdout:2/404: creat d20/d31/d6a/f9c x:0 0 0 2024-02-15T18:31:04.451 INFO:tasks.workunit.client.0.smithi033.stdout:1/357: rename d5/lc to d5/dd/d12/l61 0 2024-02-15T18:31:04.452 INFO:tasks.workunit.client.0.smithi033.stdout:2/405: rename d20/d31/d6a/f23 to d20/d73/f9d 0 2024-02-15T18:31:04.453 INFO:tasks.workunit.client.0.smithi033.stdout:1/358: mknod d5/dd/d12/d49/c62 0 2024-02-15T18:31:04.454 INFO:tasks.workunit.client.0.smithi033.stdout:0/378: dwrite d0/d8/f37 [0,4194304] 0 2024-02-15T18:31:04.454 INFO:tasks.workunit.client.0.smithi033.stdout:0/379: write d0/d8/d15/f70 [378441,8557] 0 2024-02-15T18:31:04.454 INFO:tasks.workunit.client.0.smithi033.stdout:9/308: dwrite d4/d8/dd/d5c/f68 [0,4194304] 0 2024-02-15T18:31:04.454 INFO:tasks.workunit.client.0.smithi033.stdout:5/456: dwrite d1/da/d11/f2d [0,4194304] 0 2024-02-15T18:31:04.455 INFO:tasks.workunit.client.0.smithi033.stdout:2/406: mkdir d20/d31/d47/d64/d9e 0 2024-02-15T18:31:04.455 INFO:tasks.workunit.client.0.smithi033.stdout:2/407: chown f19 55 1 2024-02-15T18:31:04.455 INFO:tasks.workunit.client.0.smithi033.stdout:2/408: chown d20/d31/f37 15 1 2024-02-15T18:31:04.458 INFO:tasks.workunit.client.0.smithi033.stdout:1/359: mkdir d5/d9/d1e/d20/d2c/d34/d51/d63 0 2024-02-15T18:31:04.460 INFO:tasks.workunit.client.0.smithi033.stdout:5/457: dread d1/da/d19/f34 [0,4194304] 0 2024-02-15T18:31:04.468 INFO:tasks.workunit.client.0.smithi033.stdout:5/458: rename d1/da/d19/l3b to d1/da/d19/d3c/d40/d65/l85 0 2024-02-15T18:31:04.468 INFO:tasks.workunit.client.0.smithi033.stdout:5/459: dread - d1/da/d19/f6d zero size 2024-02-15T18:31:04.468 INFO:tasks.workunit.client.0.smithi033.stdout:0/380: symlink d0/d8/l81 0 2024-02-15T18:31:04.470 INFO:tasks.workunit.client.0.smithi033.stdout:2/409: truncate d20/d31/d47/d64/f86 138784 0 2024-02-15T18:31:04.472 INFO:tasks.workunit.client.0.smithi033.stdout:5/460: unlink d1/f9 0 2024-02-15T18:31:04.475 INFO:tasks.workunit.client.0.smithi033.stdout:2/410: mknod d20/d3a/d4a/d5e/d6b/c9f 0 2024-02-15T18:31:04.475 INFO:tasks.workunit.client.0.smithi033.stdout:0/381: dread d0/d8/fb [0,4194304] 0 2024-02-15T18:31:04.476 INFO:tasks.workunit.client.0.smithi033.stdout:2/411: mkdir d20/d31/d47/d4c/d6c/d80/da0 0 2024-02-15T18:31:04.477 INFO:tasks.workunit.client.0.smithi033.stdout:2/412: rmdir d20/d30 39 2024-02-15T18:31:04.477 INFO:tasks.workunit.client.0.smithi033.stdout:2/413: mknod d20/ca1 0 2024-02-15T18:31:04.488 INFO:tasks.workunit.client.0.smithi033.stdout:1/360: dwrite d5/f8 [0,4194304] 0 2024-02-15T18:31:04.489 INFO:tasks.workunit.client.0.smithi033.stdout:0/382: dread d0/d2/f3 [0,4194304] 0 2024-02-15T18:31:04.490 INFO:tasks.workunit.client.0.smithi033.stdout:5/461: dwrite d1/da/d11/f30 [4194304,4194304] 0 2024-02-15T18:31:04.490 INFO:tasks.workunit.client.0.smithi033.stdout:5/462: stat d1/da/d10/d2b/d33/d63/d61/c78 0 2024-02-15T18:31:04.490 INFO:tasks.workunit.client.0.smithi033.stdout:5/463: truncate d1/f27 1624233 0 2024-02-15T18:31:04.491 INFO:tasks.workunit.client.0.smithi033.stdout:5/464: rmdir d1/da/d10/d2b/d33 39 2024-02-15T18:31:04.491 INFO:tasks.workunit.client.0.smithi033.stdout:1/361: dread d5/dd/d12/d49/f2b [0,4194304] 0 2024-02-15T18:31:04.495 INFO:tasks.workunit.client.0.smithi033.stdout:1/362: getdents d5/d38 0 2024-02-15T18:31:04.495 INFO:tasks.workunit.client.0.smithi033.stdout:1/363: fdatasync d5/dd/f2e 0 2024-02-15T18:31:04.495 INFO:tasks.workunit.client.0.smithi033.stdout:1/364: write d5/d9/f32 [171878,4868] 0 2024-02-15T18:31:04.496 INFO:tasks.workunit.client.0.smithi033.stdout:1/365: mknod d5/d9/d1e/d20/d2c/d34/d51/d63/c64 0 2024-02-15T18:31:04.496 INFO:tasks.workunit.client.0.smithi033.stdout:1/366: chown d5/d9/d1e/d20/d2c/f46 840 1 2024-02-15T18:31:04.496 INFO:tasks.workunit.client.0.smithi033.stdout:1/367: write d5/dd/d12/d49/f21 [419099,24949] 0 2024-02-15T18:31:04.512 INFO:tasks.workunit.client.0.smithi033.stdout:1/368: dwrite d5/d9/d1e/d20/d2c/f3c [0,4194304] 0 2024-02-15T18:31:04.512 INFO:tasks.workunit.client.0.smithi033.stdout:1/369: write d5/d9/d1e/d20/f50 [851060,108481] 0 2024-02-15T18:31:04.514 INFO:tasks.workunit.client.0.smithi033.stdout:1/370: unlink d5/f19 0 2024-02-15T18:31:04.515 INFO:tasks.workunit.client.0.smithi033.stdout:1/371: write d5/dd/d12/d49/f1d [1159126,55816] 0 2024-02-15T18:31:04.515 INFO:tasks.workunit.client.0.smithi033.stdout:1/372: getdents d5/d38 0 2024-02-15T18:31:04.555 INFO:tasks.workunit.client.0.smithi033.stdout:8/286: sync 2024-02-15T18:31:04.555 INFO:tasks.workunit.client.0.smithi033.stdout:7/366: sync 2024-02-15T18:31:04.555 INFO:tasks.workunit.client.0.smithi033.stdout:7/367: chown d0/dc/d10/d1d/d2b/f52 2 1 2024-02-15T18:31:04.555 INFO:tasks.workunit.client.0.smithi033.stdout:3/326: sync 2024-02-15T18:31:04.555 INFO:tasks.workunit.client.0.smithi033.stdout:4/404: sync 2024-02-15T18:31:04.555 INFO:tasks.workunit.client.0.smithi033.stdout:3/327: chown d2/d14/f44 16671 1 2024-02-15T18:31:04.556 INFO:tasks.workunit.client.0.smithi033.stdout:8/287: creat d0/f5c x:0 0 0 2024-02-15T18:31:04.556 INFO:tasks.workunit.client.0.smithi033.stdout:8/288: write d0/df/db/d45/f4a [807376,90272] 0 2024-02-15T18:31:04.559 INFO:tasks.workunit.client.0.smithi033.stdout:4/405: rmdir d4 39 2024-02-15T18:31:04.560 INFO:tasks.workunit.client.0.smithi033.stdout:4/406: chown d4/d20/d13/d1b/f64 27497322 1 2024-02-15T18:31:04.562 INFO:tasks.workunit.client.0.smithi033.stdout:7/368: rename d0/dc/d10/d1d/d38/d3a to d0/dc/d10/d7d 0 2024-02-15T18:31:04.563 INFO:tasks.workunit.client.0.smithi033.stdout:3/328: truncate d2/fa 6415209 0 2024-02-15T18:31:04.564 INFO:tasks.workunit.client.0.smithi033.stdout:8/289: getdents d0 0 2024-02-15T18:31:04.564 INFO:tasks.workunit.client.0.smithi033.stdout:8/290: dread - d0/df/db/f40 zero size 2024-02-15T18:31:04.564 INFO:tasks.workunit.client.0.smithi033.stdout:8/291: chown d0/df/f19 1342158 1 2024-02-15T18:31:04.565 INFO:tasks.workunit.client.0.smithi033.stdout:8/292: write d0/df/db/d1b/d4b/f4c [3913486,126244] 0 2024-02-15T18:31:04.565 INFO:tasks.workunit.client.0.smithi033.stdout:4/407: mknod d4/d20/d13/d5c/c84 0 2024-02-15T18:31:04.566 INFO:tasks.workunit.client.0.smithi033.stdout:4/408: chown d4/d5/d28/l35 95762010 1 2024-02-15T18:31:04.570 INFO:tasks.workunit.client.0.smithi033.stdout:3/329: rename d2/d14/f16 to d2/f5d 0 2024-02-15T18:31:04.571 INFO:tasks.workunit.client.0.smithi033.stdout:4/409: link d4/d20/c10 d4/d20/d13/d1b/d81/c85 0 2024-02-15T18:31:04.573 INFO:tasks.workunit.client.0.smithi033.stdout:3/330: rename d2/d14/d23/f2f to d2/d3/d1e/d22/d59/f5e 0 2024-02-15T18:31:04.574 INFO:tasks.workunit.client.0.smithi033.stdout:4/410: mknod d4/d20/d13/d34/c86 0 2024-02-15T18:31:04.574 INFO:tasks.workunit.client.0.smithi033.stdout:4/411: chown d4/d20/l18 11458399 1 2024-02-15T18:31:04.574 INFO:tasks.workunit.client.0.smithi033.stdout:4/412: read d4/d5/f1e [2908751,63077] 0 2024-02-15T18:31:04.575 INFO:tasks.workunit.client.0.smithi033.stdout:3/331: unlink d2/d14/d23/f4c 0 2024-02-15T18:31:04.577 INFO:tasks.workunit.client.0.smithi033.stdout:4/413: mkdir d4/d20/d13/d5c/d87 0 2024-02-15T18:31:04.577 INFO:tasks.workunit.client.0.smithi033.stdout:8/293: dread d0/df/db/d1b/d4b/f4c [0,4194304] 0 2024-02-15T18:31:04.577 INFO:tasks.workunit.client.0.smithi033.stdout:4/414: write d4/d20/f11 [2542407,101975] 0 2024-02-15T18:31:04.577 INFO:tasks.workunit.client.0.smithi033.stdout:4/415: chown d4/d20/d53/l7f 64 1 2024-02-15T18:31:04.577 INFO:tasks.workunit.client.0.smithi033.stdout:3/332: getdents d2/d3/d1e/d22 0 2024-02-15T18:31:04.579 INFO:tasks.workunit.client.0.smithi033.stdout:8/294: creat d0/df/d53/f5d x:0 0 0 2024-02-15T18:31:04.579 INFO:tasks.workunit.client.0.smithi033.stdout:7/369: dwrite d0/f62 [0,4194304] 0 2024-02-15T18:31:04.580 INFO:tasks.workunit.client.0.smithi033.stdout:8/295: write d0/df/db/d1b/f27 [3964610,17299] 0 2024-02-15T18:31:04.580 INFO:tasks.workunit.client.0.smithi033.stdout:8/296: write d0/d2/d35/d29/f46 [964180,97660] 0 2024-02-15T18:31:04.581 INFO:tasks.workunit.client.0.smithi033.stdout:8/297: write d0/df/db/f23 [116783,83845] 0 2024-02-15T18:31:04.581 INFO:tasks.workunit.client.0.smithi033.stdout:8/298: chown d0/d1c/f3e 298304082 1 2024-02-15T18:31:04.583 INFO:tasks.workunit.client.0.smithi033.stdout:4/416: stat d4/d5/l68 0 2024-02-15T18:31:04.584 INFO:tasks.workunit.client.0.smithi033.stdout:3/333: truncate d2/f5d 1018817 0 2024-02-15T18:31:04.587 INFO:tasks.workunit.client.0.smithi033.stdout:7/370: symlink d0/dc/l7e 0 2024-02-15T18:31:04.587 INFO:tasks.workunit.client.0.smithi033.stdout:7/371: dread - d0/dc/d10/d1d/d2b/f5a zero size 2024-02-15T18:31:04.587 INFO:tasks.workunit.client.0.smithi033.stdout:7/372: chown d0/dc/d10/d1d/d2b/l69 3 1 2024-02-15T18:31:04.587 INFO:tasks.workunit.client.0.smithi033.stdout:7/373: chown d0/dc/d10/d48 0 1 2024-02-15T18:31:04.587 INFO:tasks.workunit.client.0.smithi033.stdout:8/299: mknod d0/df/db/d1b/d4b/c5e 0 2024-02-15T18:31:04.591 INFO:tasks.workunit.client.0.smithi033.stdout:3/334: rmdir d2/d3/d1e/d22/d59 39 2024-02-15T18:31:04.591 INFO:tasks.workunit.client.0.smithi033.stdout:4/417: mknod d4/d20/d37/c88 0 2024-02-15T18:31:04.591 INFO:tasks.workunit.client.0.smithi033.stdout:4/418: fdatasync d4/d20/d37/f42 0 2024-02-15T18:31:04.592 INFO:tasks.workunit.client.0.smithi033.stdout:8/300: mkdir d0/d2/d35/d29/d5f 0 2024-02-15T18:31:04.593 INFO:tasks.workunit.client.0.smithi033.stdout:3/335: mkdir d2/d3/d17/d5f 0 2024-02-15T18:31:04.593 INFO:tasks.workunit.client.0.smithi033.stdout:3/336: read d2/f27 [501807,100319] 0 2024-02-15T18:31:04.593 INFO:tasks.workunit.client.0.smithi033.stdout:3/337: stat d2/d14/d23/f3d 0 2024-02-15T18:31:04.593 INFO:tasks.workunit.client.0.smithi033.stdout:3/338: fsync d2/d14/d23/f3e 0 2024-02-15T18:31:04.594 INFO:tasks.workunit.client.0.smithi033.stdout:4/419: write d4/d3c/f51 [3484299,52049] 0 2024-02-15T18:31:04.594 INFO:tasks.workunit.client.0.smithi033.stdout:4/420: fsync d4/d20/f26 0 2024-02-15T18:31:04.598 INFO:tasks.workunit.client.0.smithi033.stdout:3/339: rename d2/cd to d2/d20/c60 0 2024-02-15T18:31:04.601 INFO:tasks.workunit.client.0.smithi033.stdout:7/374: dwrite d0/dc/d10/d48/d4b/f54 [0,4194304] 0 2024-02-15T18:31:04.603 INFO:tasks.workunit.client.0.smithi033.stdout:8/301: dread d0/d2/d35/d29/f46 [0,4194304] 0 2024-02-15T18:31:04.607 INFO:tasks.workunit.client.0.smithi033.stdout:7/375: mkdir d0/dc/d10/d1d/d38/d74/d7f 0 2024-02-15T18:31:04.608 INFO:tasks.workunit.client.0.smithi033.stdout:8/302: mknod d0/d2/d35/d58/c60 0 2024-02-15T18:31:04.609 INFO:tasks.workunit.client.0.smithi033.stdout:8/303: read d0/df/db/d1b/f27 [2132537,10197] 0 2024-02-15T18:31:04.610 INFO:tasks.workunit.client.0.smithi033.stdout:7/376: dread d0/f6a [0,4194304] 0 2024-02-15T18:31:04.610 INFO:tasks.workunit.client.0.smithi033.stdout:7/377: fdatasync d0/f1b 0 2024-02-15T18:31:04.610 INFO:tasks.workunit.client.0.smithi033.stdout:7/378: getdents d0/d56/d70 0 2024-02-15T18:31:04.611 INFO:tasks.workunit.client.0.smithi033.stdout:7/379: chown d0/dc/d10/d7d/f50 2567778 1 2024-02-15T18:31:04.612 INFO:tasks.workunit.client.0.smithi033.stdout:7/380: getdents d0 0 2024-02-15T18:31:04.613 INFO:tasks.workunit.client.0.smithi033.stdout:7/381: creat d0/d56/d70/f80 x:0 0 0 2024-02-15T18:31:04.614 INFO:tasks.workunit.client.0.smithi033.stdout:7/382: creat d0/dc/d10/d48/f81 x:0 0 0 2024-02-15T18:31:04.614 INFO:tasks.workunit.client.0.smithi033.stdout:7/383: stat d0/f33 0 2024-02-15T18:31:04.615 INFO:tasks.workunit.client.0.smithi033.stdout:7/384: chown d0/dc/d10/d1d/d2b/c45 1699 1 2024-02-15T18:31:04.615 INFO:tasks.workunit.client.0.smithi033.stdout:7/385: chown d0/dc/d10/d48/f5b 1 1 2024-02-15T18:31:04.616 INFO:tasks.workunit.client.0.smithi033.stdout:8/304: dread d0/df/db/d45/f4a [0,4194304] 0 2024-02-15T18:31:04.616 INFO:tasks.workunit.client.0.smithi033.stdout:7/386: mkdir d0/dc/d10/d1d/d38/d82 0 2024-02-15T18:31:04.616 INFO:tasks.workunit.client.0.smithi033.stdout:7/387: stat d0/dc/d10/d1d/l57 0 2024-02-15T18:31:04.618 INFO:tasks.workunit.client.0.smithi033.stdout:4/421: dwrite d4/d20/d37/f5e [0,4194304] 0 2024-02-15T18:31:04.618 INFO:tasks.workunit.client.0.smithi033.stdout:3/340: dread d2/d3/d1e/f4f [0,4194304] 0 2024-02-15T18:31:04.618 INFO:tasks.workunit.client.0.smithi033.stdout:4/422: chown d4/d20/d13/d5c/c84 118766 1 2024-02-15T18:31:04.618 INFO:tasks.workunit.client.0.smithi033.stdout:7/388: mkdir d0/d56/d70/d83 0 2024-02-15T18:31:04.625 INFO:tasks.workunit.client.0.smithi033.stdout:4/423: rename d4/d20/d13/d34/f4b to d4/d5/f89 0 2024-02-15T18:31:04.626 INFO:tasks.workunit.client.0.smithi033.stdout:7/389: dread d0/f1c [0,4194304] 0 2024-02-15T18:31:04.626 INFO:tasks.workunit.client.0.smithi033.stdout:7/390: chown d0/dc/d10/d1d/l57 79871948 1 2024-02-15T18:31:04.626 INFO:tasks.workunit.client.0.smithi033.stdout:6/465: sync 2024-02-15T18:31:04.627 INFO:tasks.workunit.client.0.smithi033.stdout:2/414: sync 2024-02-15T18:31:04.627 INFO:tasks.workunit.client.0.smithi033.stdout:4/424: symlink d4/d20/d13/d5c/l8a 0 2024-02-15T18:31:04.627 INFO:tasks.workunit.client.0.smithi033.stdout:9/309: sync 2024-02-15T18:31:04.627 INFO:tasks.workunit.client.0.smithi033.stdout:4/425: readlink d4/d5/l68 0 2024-02-15T18:31:04.627 INFO:tasks.workunit.client.0.smithi033.stdout:2/415: chown d20/d3a/d4a/d5e/d6b/c9f 540951608 1 2024-02-15T18:31:04.627 INFO:tasks.workunit.client.0.smithi033.stdout:6/466: stat d8/d28/d14/d2c/d3b/d3d/f48 0 2024-02-15T18:31:04.627 INFO:tasks.workunit.client.0.smithi033.stdout:3/341: dread d2/d3/f39 [0,4194304] 0 2024-02-15T18:31:04.627 INFO:tasks.workunit.client.0.smithi033.stdout:3/342: chown d2 4033 1 2024-02-15T18:31:04.628 INFO:tasks.workunit.client.0.smithi033.stdout:4/426: dread d4/d20/d13/d1b/f64 [0,4194304] 0 2024-02-15T18:31:04.628 INFO:tasks.workunit.client.0.smithi033.stdout:7/391: mkdir d0/dc/d84 0 2024-02-15T18:31:04.628 INFO:tasks.workunit.client.0.smithi033.stdout:7/392: truncate d0/dc/d10/d1d/f73 155167 0 2024-02-15T18:31:04.629 INFO:tasks.workunit.client.0.smithi033.stdout:2/416: getdents d20/d31/d47 0 2024-02-15T18:31:04.629 INFO:tasks.workunit.client.0.smithi033.stdout:9/310: mkdir d4/d8/dd/d28/d6b 0 2024-02-15T18:31:04.630 INFO:tasks.workunit.client.0.smithi033.stdout:6/467: truncate d8/d28/f17 1539991 0 2024-02-15T18:31:04.630 INFO:tasks.workunit.client.0.smithi033.stdout:6/468: fsync d8/d1d/d37/d4f/f6f 0 2024-02-15T18:31:04.631 INFO:tasks.workunit.client.0.smithi033.stdout:3/343: mkdir d2/d14/d23/d5c/d61 0 2024-02-15T18:31:04.631 INFO:tasks.workunit.client.0.smithi033.stdout:3/344: read d2/f51 [276438,90843] 0 2024-02-15T18:31:04.631 INFO:tasks.workunit.client.0.smithi033.stdout:4/427: chown d4/d20/d13/d1b/f6a 3683693 1 2024-02-15T18:31:04.631 INFO:tasks.workunit.client.0.smithi033.stdout:4/428: chown d4/d3c/f51 19590 1 2024-02-15T18:31:04.632 INFO:tasks.workunit.client.0.smithi033.stdout:7/393: creat d0/dc/d84/f85 x:0 0 0 2024-02-15T18:31:04.633 INFO:tasks.workunit.client.0.smithi033.stdout:4/429: write d4/f15 [2018234,37656] 0 2024-02-15T18:31:04.633 INFO:tasks.workunit.client.0.smithi033.stdout:4/430: fsync d4/d20/d13/d1b/f64 0 2024-02-15T18:31:04.634 INFO:tasks.workunit.client.0.smithi033.stdout:2/417: getdents d20/d31 0 2024-02-15T18:31:04.635 INFO:tasks.workunit.client.0.smithi033.stdout:3/345: rename d2/d3/d17/d5f to d2/d14/d23/d5c/d62 0 2024-02-15T18:31:04.636 INFO:tasks.workunit.client.0.smithi033.stdout:7/394: symlink d0/dc/d10/d1d/d2b/l86 0 2024-02-15T18:31:04.637 INFO:tasks.workunit.client.0.smithi033.stdout:8/305: dwrite d0/d2/d35/d29/f2e [0,4194304] 0 2024-02-15T18:31:04.638 INFO:tasks.workunit.client.0.smithi033.stdout:4/431: mkdir d4/d20/d13/d1b/d81/d8b 0 2024-02-15T18:31:04.638 INFO:tasks.workunit.client.0.smithi033.stdout:2/418: rmdir d20/d39 39 2024-02-15T18:31:04.643 INFO:tasks.workunit.client.0.smithi033.stdout:3/346: creat d2/d14/d23/d5c/d61/f63 x:0 0 0 2024-02-15T18:31:04.645 INFO:tasks.workunit.client.0.smithi033.stdout:8/306: truncate d0/df/f38 2397836 0 2024-02-15T18:31:04.645 INFO:tasks.workunit.client.0.smithi033.stdout:2/419: truncate d20/d31/f51 17442 0 2024-02-15T18:31:04.647 INFO:tasks.workunit.client.0.smithi033.stdout:3/347: link d2/c19 d2/d14/d23/d5c/d62/c64 0 2024-02-15T18:31:04.648 INFO:tasks.workunit.client.0.smithi033.stdout:8/307: rename d0/d2/d35/d29/c57 to d0/d2/d35/d29/c61 0 2024-02-15T18:31:04.654 INFO:tasks.workunit.client.0.smithi033.stdout:9/311: dwrite d4/d8/f46 [0,4194304] 0 2024-02-15T18:31:04.657 INFO:tasks.workunit.client.0.smithi033.stdout:4/432: dwrite d4/d5/f55 [4194304,4194304] 0 2024-02-15T18:31:04.657 INFO:tasks.workunit.client.0.smithi033.stdout:4/433: truncate d4/d20/d13/d1b/f64 696336 0 2024-02-15T18:31:04.658 INFO:tasks.workunit.client.0.smithi033.stdout:1/373: sync 2024-02-15T18:31:04.658 INFO:tasks.workunit.client.0.smithi033.stdout:5/465: sync 2024-02-15T18:31:04.658 INFO:tasks.workunit.client.0.smithi033.stdout:0/383: sync 2024-02-15T18:31:04.658 INFO:tasks.workunit.client.0.smithi033.stdout:5/466: truncate d1/da/d10/d2b/d33/f77 220768 0 2024-02-15T18:31:04.662 INFO:tasks.workunit.client.0.smithi033.stdout:0/384: write d0/d2/f3c [2321809,29864] 0 2024-02-15T18:31:04.662 INFO:tasks.workunit.client.0.smithi033.stdout:0/385: write d0/d8/d15/f70 [371276,17783] 0 2024-02-15T18:31:04.662 INFO:tasks.workunit.client.0.smithi033.stdout:9/312: mkdir d4/d32/d6c 0 2024-02-15T18:31:04.664 INFO:tasks.workunit.client.0.smithi033.stdout:4/434: rename d4/d5/d28/l4f to d4/d20/d13/d34/l8c 0 2024-02-15T18:31:04.666 INFO:tasks.workunit.client.0.smithi033.stdout:5/467: creat d1/da/d10/d2b/f86 x:0 0 0 2024-02-15T18:31:04.666 INFO:tasks.workunit.client.0.smithi033.stdout:5/468: fsync d1/da/d11/f2d 0 2024-02-15T18:31:04.667 INFO:tasks.workunit.client.0.smithi033.stdout:3/348: dwrite d2/f1d [4194304,4194304] 0 2024-02-15T18:31:04.667 INFO:tasks.workunit.client.0.smithi033.stdout:3/349: stat d2/d3/c32 0 2024-02-15T18:31:04.667 INFO:tasks.workunit.client.0.smithi033.stdout:3/350: write d2/d3/d1e/d22/f58 [108564,129793] 0 2024-02-15T18:31:04.667 INFO:tasks.workunit.client.0.smithi033.stdout:3/351: dread - d2/d14/d23/d5c/d61/f63 zero size 2024-02-15T18:31:04.669 INFO:tasks.workunit.client.0.smithi033.stdout:0/386: creat d0/d2/f82 x:0 0 0 2024-02-15T18:31:04.671 INFO:tasks.workunit.client.0.smithi033.stdout:1/374: rename d5/dd/d12/d47 to d5/d9/d1e/d20/d2c/d65 0 2024-02-15T18:31:04.672 INFO:tasks.workunit.client.0.smithi033.stdout:4/435: creat d4/d20/d13/d5c/d87/f8d x:0 0 0 2024-02-15T18:31:04.672 INFO:tasks.workunit.client.0.smithi033.stdout:5/469: mknod d1/da/d19/d3c/d40/c87 0 2024-02-15T18:31:04.677 INFO:tasks.workunit.client.0.smithi033.stdout:8/308: dread d0/df/f38 [0,4194304] 0 2024-02-15T18:31:04.677 INFO:tasks.workunit.client.0.smithi033.stdout:8/309: stat d0/d1c/d30 0 2024-02-15T18:31:04.677 INFO:tasks.workunit.client.0.smithi033.stdout:8/310: chown d0/d2/d35/l1f 254 1 2024-02-15T18:31:04.678 INFO:tasks.workunit.client.0.smithi033.stdout:9/313: dread d4/d8/dd/d28/f4c [0,4194304] 0 2024-02-15T18:31:04.787 INFO:tasks.workunit.client.0.smithi033.stdout:3/352: dwrite d2/d3/f50 [0,4194304] 0 2024-02-15T18:31:04.790 INFO:tasks.workunit.client.0.smithi033.stdout:0/387: mkdir d0/d8/d15/d5b/d83 0 2024-02-15T18:31:04.791 INFO:tasks.workunit.client.0.smithi033.stdout:1/375: link d5/dd/d12/d49/f1d d5/dd/d12/d49/d23/f66 0 2024-02-15T18:31:04.797 INFO:tasks.workunit.client.0.smithi033.stdout:4/436: creat d4/d20/d37/f8e x:0 0 0 2024-02-15T18:31:04.797 INFO:tasks.workunit.client.0.smithi033.stdout:5/470: rmdir d1/da 39 2024-02-15T18:31:04.799 INFO:tasks.workunit.client.0.smithi033.stdout:8/311: rename d0/df/db/l2a to d0/df/db/d45/l62 0 2024-02-15T18:31:04.799 INFO:tasks.workunit.client.0.smithi033.stdout:9/314: mkdir d4/d8/dd/d5c/d6d 0 2024-02-15T18:31:04.801 INFO:tasks.workunit.client.0.smithi033.stdout:3/353: mknod d2/d20/c65 0 2024-02-15T18:31:04.802 INFO:tasks.workunit.client.0.smithi033.stdout:0/388: rmdir d0/d8/d15/d2d/d41 39 2024-02-15T18:31:04.803 INFO:tasks.workunit.client.0.smithi033.stdout:1/376: creat d5/d9/d1e/d20/d5c/d57/f67 x:0 0 0 2024-02-15T18:31:04.804 INFO:tasks.workunit.client.0.smithi033.stdout:1/377: write d5/d9/d1e/d20/d5c/d57/f67 [231461,11762] 0 2024-02-15T18:31:04.807 INFO:tasks.workunit.client.0.smithi033.stdout:8/312: mknod d0/d2/c63 0 2024-02-15T18:31:04.809 INFO:tasks.workunit.client.0.smithi033.stdout:9/315: rename d4/c7 to d4/d8/dd/d41/c6e 0 2024-02-15T18:31:04.811 INFO:tasks.workunit.client.0.smithi033.stdout:3/354: creat d2/d14/d23/f66 x:0 0 0 2024-02-15T18:31:04.813 INFO:tasks.workunit.client.0.smithi033.stdout:1/378: mknod d5/c68 0 2024-02-15T18:31:04.813 INFO:tasks.workunit.client.0.smithi033.stdout:1/379: write d5/d38/f60 [490676,88560] 0 2024-02-15T18:31:04.813 INFO:tasks.workunit.client.0.smithi033.stdout:1/380: fdatasync d5/d9/d1e/d20/d2c/f3c 0 2024-02-15T18:31:04.815 INFO:tasks.workunit.client.0.smithi033.stdout:8/313: dread d0/d2/d35/d29/f46 [0,4194304] 0 2024-02-15T18:31:04.817 INFO:tasks.workunit.client.0.smithi033.stdout:8/314: dread d0/d2/f16 [4194304,4194304] 0 2024-02-15T18:31:04.818 INFO:tasks.workunit.client.0.smithi033.stdout:9/316: mknod d4/d8/dd/d28/d60/c6f 0 2024-02-15T18:31:04.818 INFO:tasks.workunit.client.0.smithi033.stdout:3/355: creat d2/d14/f67 x:0 0 0 2024-02-15T18:31:04.819 INFO:tasks.workunit.client.0.smithi033.stdout:9/317: fdatasync d4/d8/dd/fe 0 2024-02-15T18:31:04.820 INFO:tasks.workunit.client.0.smithi033.stdout:1/381: link d5/dd/d12/f1b d5/dd/f69 0 2024-02-15T18:31:04.820 INFO:tasks.workunit.client.0.smithi033.stdout:9/318: creat d4/d8/dd/f70 x:0 0 0 2024-02-15T18:31:04.821 INFO:tasks.workunit.client.0.smithi033.stdout:8/315: write d0/d2/f41 [386026,126786] 0 2024-02-15T18:31:04.822 INFO:tasks.workunit.client.0.smithi033.stdout:3/356: rename d2/d20/d5b to d2/d14/d23/d68 0 2024-02-15T18:31:04.822 INFO:tasks.workunit.client.0.smithi033.stdout:3/357: truncate d2/f4 4306132 0 2024-02-15T18:31:04.822 INFO:tasks.workunit.client.0.smithi033.stdout:1/382: symlink d5/d9/d1e/d20/d2c/d34/d51/l6a 0 2024-02-15T18:31:04.825 INFO:tasks.workunit.client.0.smithi033.stdout:3/358: creat d2/d3/d17/f69 x:0 0 0 2024-02-15T18:31:04.825 INFO:tasks.workunit.client.0.smithi033.stdout:9/319: dread d4/d8/dd/f3d [0,4194304] 0 2024-02-15T18:31:04.826 INFO:tasks.workunit.client.0.smithi033.stdout:3/359: rename d2/d3/f39 to d2/d20/f6a 0 2024-02-15T18:31:04.828 INFO:tasks.workunit.client.0.smithi033.stdout:3/360: creat d2/d3/d1e/d22/d4d/f6b x:0 0 0 2024-02-15T18:31:04.836 INFO:tasks.workunit.client.0.smithi033.stdout:5/471: dwrite d1/da/d10/d2b/d33/f77 [0,4194304] 0 2024-02-15T18:31:04.836 INFO:tasks.workunit.client.0.smithi033.stdout:1/383: write d5/dd/f10 [4453257,80553] 0 2024-02-15T18:31:04.836 INFO:tasks.workunit.client.0.smithi033.stdout:1/384: readlink d5/d9/l45 0 2024-02-15T18:31:04.842 INFO:tasks.workunit.client.0.smithi033.stdout:0/389: dwrite d0/d8/d15/d2d/f6a [0,4194304] 0 2024-02-15T18:31:04.842 INFO:tasks.workunit.client.0.smithi033.stdout:0/390: fdatasync d0/d8/d15/d2d/f66 0 2024-02-15T18:31:04.843 INFO:tasks.workunit.client.0.smithi033.stdout:4/437: dwrite d4/d20/d37/f42 [0,4194304] 0 2024-02-15T18:31:04.843 INFO:tasks.workunit.client.0.smithi033.stdout:4/438: chown d4 1 1 2024-02-15T18:31:04.850 INFO:tasks.workunit.client.0.smithi033.stdout:4/439: rename d4/l3d to d4/d20/d13/d34/d82/l8f 0 2024-02-15T18:31:04.852 INFO:tasks.workunit.client.0.smithi033.stdout:4/440: mknod d4/d5/c90 0 2024-02-15T18:31:04.855 INFO:tasks.workunit.client.0.smithi033.stdout:8/316: dwrite d0/d1c/f3b [0,4194304] 0 2024-02-15T18:31:04.856 INFO:tasks.workunit.client.0.smithi033.stdout:8/317: read - d0/df/d53/f5d zero size 2024-02-15T18:31:04.870 INFO:tasks.workunit.client.0.smithi033.stdout:8/318: dread d0/d2/d35/d29/f2e [0,4194304] 0 2024-02-15T18:31:04.870 INFO:tasks.workunit.client.0.smithi033.stdout:8/319: truncate d0/f5c 743503 0 2024-02-15T18:31:04.870 INFO:tasks.workunit.client.0.smithi033.stdout:8/320: fsync d0/d1c/f3e 0 2024-02-15T18:31:04.874 INFO:tasks.workunit.client.0.smithi033.stdout:1/385: fsync d5/dd/f10 0 2024-02-15T18:31:04.874 INFO:tasks.workunit.client.0.smithi033.stdout:3/361: dwrite d2/d14/d23/f66 [0,4194304] 0 2024-02-15T18:31:04.877 INFO:tasks.workunit.client.0.smithi033.stdout:9/320: dwrite d4/d8/d1b/f4a [0,4194304] 0 2024-02-15T18:31:04.877 INFO:tasks.workunit.client.0.smithi033.stdout:5/472: dwrite d1/da/f2c [0,4194304] 0 2024-02-15T18:31:04.877 INFO:tasks.workunit.client.0.smithi033.stdout:0/391: dwrite d0/f13 [0,4194304] 0 2024-02-15T18:31:04.878 INFO:tasks.workunit.client.0.smithi033.stdout:5/473: write d1/da/d10/d2b/d33/f51 [1068334,125157] 0 2024-02-15T18:31:04.878 INFO:tasks.workunit.client.0.smithi033.stdout:4/441: dwrite d4/d20/d13/d1b/f64 [0,4194304] 0 2024-02-15T18:31:04.878 INFO:tasks.workunit.client.0.smithi033.stdout:4/442: write d4/d5/d28/d39/f79 [1044856,1121] 0 2024-02-15T18:31:04.878 INFO:tasks.workunit.client.0.smithi033.stdout:4/443: fsync d4/d5/f89 0 2024-02-15T18:31:04.881 INFO:tasks.workunit.client.0.smithi033.stdout:9/321: symlink d4/d8/dd/d5c/d6d/l71 0 2024-02-15T18:31:04.882 INFO:tasks.workunit.client.0.smithi033.stdout:9/322: dread d4/d8/d1b/f5b [0,4194304] 0 2024-02-15T18:31:04.883 INFO:tasks.workunit.client.0.smithi033.stdout:9/323: write d4/d8/f46 [4425208,78700] 0 2024-02-15T18:31:04.883 INFO:tasks.workunit.client.0.smithi033.stdout:1/386: write d5/dd/d12/d49/d23/f66 [319431,70123] 0 2024-02-15T18:31:04.889 INFO:tasks.workunit.client.0.smithi033.stdout:5/474: mkdir d1/da/d88 0 2024-02-15T18:31:04.893 INFO:tasks.workunit.client.0.smithi033.stdout:2/420: sync 2024-02-15T18:31:04.893 INFO:tasks.workunit.client.0.smithi033.stdout:6/469: sync 2024-02-15T18:31:04.893 INFO:tasks.workunit.client.0.smithi033.stdout:7/395: sync 2024-02-15T18:31:04.893 INFO:tasks.workunit.client.0.smithi033.stdout:6/470: chown d8/d28/c7e 5 1 2024-02-15T18:31:04.893 INFO:tasks.workunit.client.0.smithi033.stdout:3/362: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:04.893 INFO:tasks.workunit.client.0.smithi033.stdout:6/471: write d8/d28/f18 [1178414,71530] 0 2024-02-15T18:31:04.899 INFO:tasks.workunit.client.0.smithi033.stdout:6/472: dread d8/f1a [4194304,4194304] 0 2024-02-15T18:31:04.901 INFO:tasks.workunit.client.0.smithi033.stdout:1/387: mkdir d5/dd/d12/d6b 0 2024-02-15T18:31:04.901 INFO:tasks.workunit.client.0.smithi033.stdout:1/388: readlink d5/d9/d1e/d20/d2c/d34/d51/l6a 0 2024-02-15T18:31:04.902 INFO:tasks.workunit.client.0.smithi033.stdout:1/389: readlink d5/l4f 0 2024-02-15T18:31:04.902 INFO:tasks.workunit.client.0.smithi033.stdout:5/475: creat d1/da/d10/d2b/d42/d71/f89 x:0 0 0 2024-02-15T18:31:04.903 INFO:tasks.workunit.client.0.smithi033.stdout:2/421: unlink d20/d3a/d4a/f8e 0 2024-02-15T18:31:04.904 INFO:tasks.workunit.client.0.smithi033.stdout:3/363: rmdir d2/d3/d1e 39 2024-02-15T18:31:04.905 INFO:tasks.workunit.client.0.smithi033.stdout:9/324: rename d4/d8/d1b/f4a to d4/d8/dd/d5c/f72 0 2024-02-15T18:31:04.907 INFO:tasks.workunit.client.0.smithi033.stdout:1/390: rename d5/d9/d1e/d20/d2c/d65/l56 to d5/d9/d1e/d20/l6c 0 2024-02-15T18:31:04.907 INFO:tasks.workunit.client.0.smithi033.stdout:1/391: chown d5/dd/d12/d49/f2b 30252304 1 2024-02-15T18:31:04.909 INFO:tasks.workunit.client.0.smithi033.stdout:1/392: mknod d5/d9/d1e/d20/d2c/d34/d51/d63/c6d 0 2024-02-15T18:31:04.909 INFO:tasks.workunit.client.0.smithi033.stdout:1/393: fsync d5/dd/d12/d49/f4a 0 2024-02-15T18:31:04.910 INFO:tasks.workunit.client.0.smithi033.stdout:7/396: dwrite d0/fa [0,4194304] 0 2024-02-15T18:31:04.911 INFO:tasks.workunit.client.0.smithi033.stdout:1/394: rmdir d5/d9/d1e/d20/d2c/d65/d55 0 2024-02-15T18:31:04.911 INFO:tasks.workunit.client.0.smithi033.stdout:1/395: chown d5/dd/f10 2036 1 2024-02-15T18:31:04.913 INFO:tasks.workunit.client.0.smithi033.stdout:9/325: rmdir d4/d8/dd/d5c 39 2024-02-15T18:31:04.913 INFO:tasks.workunit.client.0.smithi033.stdout:2/422: dread d20/f43 [0,4194304] 0 2024-02-15T18:31:04.915 INFO:tasks.workunit.client.0.smithi033.stdout:1/396: creat d5/d38/f6e x:0 0 0 2024-02-15T18:31:04.918 INFO:tasks.workunit.client.0.smithi033.stdout:9/326: rename d4/d8/dd/d28/d60 to d4/d8/d1b/d73 0 2024-02-15T18:31:04.919 INFO:tasks.workunit.client.0.smithi033.stdout:2/423: creat d20/d3a/fa2 x:0 0 0 2024-02-15T18:31:04.919 INFO:tasks.workunit.client.0.smithi033.stdout:2/424: dread - d20/d3a/d4a/d5e/f7d zero size 2024-02-15T18:31:04.919 INFO:tasks.workunit.client.0.smithi033.stdout:2/425: chown d20/d31/l3f 511 1 2024-02-15T18:31:04.919 INFO:tasks.workunit.client.0.smithi033.stdout:7/397: dread d0/dc/d10/f78 [0,4194304] 0 2024-02-15T18:31:04.919 INFO:tasks.workunit.client.0.smithi033.stdout:7/398: fsync d0/dc/d10/d1d/f34 0 2024-02-15T18:31:04.924 INFO:tasks.workunit.client.0.smithi033.stdout:1/397: creat d5/d9/d1e/d20/d2c/d34/d51/f6f x:0 0 0 2024-02-15T18:31:04.924 INFO:tasks.workunit.client.0.smithi033.stdout:9/327: mknod d4/d8/d1b/c74 0 2024-02-15T18:31:04.926 INFO:tasks.workunit.client.0.smithi033.stdout:1/398: rename d5/l33 to d5/d9/d1e/d20/d5c/l70 0 2024-02-15T18:31:04.927 INFO:tasks.workunit.client.0.smithi033.stdout:9/328: creat d4/d8/d1b/d2f/d65/f75 x:0 0 0 2024-02-15T18:31:04.929 INFO:tasks.workunit.client.0.smithi033.stdout:1/399: symlink d5/dd/d12/d49/l71 0 2024-02-15T18:31:04.930 INFO:tasks.workunit.client.0.smithi033.stdout:9/329: dread d4/d8/dd/f15 [0,4194304] 0 2024-02-15T18:31:04.930 INFO:tasks.workunit.client.0.smithi033.stdout:9/330: stat d4/d2c/l3a 0 2024-02-15T18:31:04.930 INFO:tasks.workunit.client.0.smithi033.stdout:1/400: creat d5/dd/d12/d49/d23/f72 x:0 0 0 2024-02-15T18:31:04.932 INFO:tasks.workunit.client.0.smithi033.stdout:1/401: creat d5/d9/d1e/f73 x:0 0 0 2024-02-15T18:31:04.939 INFO:tasks.workunit.client.0.smithi033.stdout:2/426: dwrite d20/d31/d47/d4c/d6c/f87 [0,4194304] 0 2024-02-15T18:31:04.941 INFO:tasks.workunit.client.0.smithi033.stdout:1/402: fsync d5/d9/d1e/d20/d2c/d34/d51/f6f 0 2024-02-15T18:31:04.942 INFO:tasks.workunit.client.0.smithi033.stdout:2/427: creat d20/d73/fa3 x:0 0 0 2024-02-15T18:31:04.944 INFO:tasks.workunit.client.0.smithi033.stdout:9/331: rmdir d4/d8/d1b 39 2024-02-15T18:31:04.946 INFO:tasks.workunit.client.0.smithi033.stdout:1/403: creat d5/d9/d1e/d20/d5c/f74 x:0 0 0 2024-02-15T18:31:04.947 INFO:tasks.workunit.client.0.smithi033.stdout:1/404: write d5/dd/d12/d49/f1d [7233396,101912] 0 2024-02-15T18:31:04.947 INFO:tasks.workunit.client.0.smithi033.stdout:2/428: getdents d20/d31/d47/d4c 0 2024-02-15T18:31:04.948 INFO:tasks.workunit.client.0.smithi033.stdout:9/332: creat d4/d8/d1b/d2f/f76 x:0 0 0 2024-02-15T18:31:04.949 INFO:tasks.workunit.client.0.smithi033.stdout:1/405: creat d5/d9/d1e/d20/d2c/d65/f75 x:0 0 0 2024-02-15T18:31:04.950 INFO:tasks.workunit.client.0.smithi033.stdout:2/429: mkdir d20/d31/d47/da4 0 2024-02-15T18:31:04.950 INFO:tasks.workunit.client.0.smithi033.stdout:9/333: symlink d4/d8/dd/d5c/l77 0 2024-02-15T18:31:04.950 INFO:tasks.workunit.client.0.smithi033.stdout:9/334: stat d4/d8/dd/f15 0 2024-02-15T18:31:04.952 INFO:tasks.workunit.client.0.smithi033.stdout:2/430: mkdir d20/d31/d47/d4c/d6c/d80/da5 0 2024-02-15T18:31:04.953 INFO:tasks.workunit.client.0.smithi033.stdout:2/431: unlink d20/c36 0 2024-02-15T18:31:04.954 INFO:tasks.workunit.client.0.smithi033.stdout:2/432: dread d20/d3a/d4a/d5e/f69 [0,4194304] 0 2024-02-15T18:31:04.954 INFO:tasks.workunit.client.0.smithi033.stdout:2/433: chown f19 2914341 1 2024-02-15T18:31:04.957 INFO:tasks.workunit.client.0.smithi033.stdout:1/406: dread d5/dd/f3f [0,4194304] 0 2024-02-15T18:31:04.960 INFO:tasks.workunit.client.0.smithi033.stdout:2/434: dread d20/d31/d47/d4c/d6c/f87 [0,4194304] 0 2024-02-15T18:31:04.961 INFO:tasks.workunit.client.0.smithi033.stdout:2/435: write d20/d31/f51 [328517,60435] 0 2024-02-15T18:31:04.969 INFO:tasks.workunit.client.0.smithi033.stdout:9/335: dwrite d4/d8/dd/d5c/f6a [0,4194304] 0 2024-02-15T18:31:04.972 INFO:tasks.workunit.client.0.smithi033.stdout:9/336: link d4/d8/dd/f3d d4/d8/dd/d41/d51/f78 0 2024-02-15T18:31:04.974 INFO:tasks.workunit.client.0.smithi033.stdout:9/337: creat d4/d8/d1b/d2f/f79 x:0 0 0 2024-02-15T18:31:04.974 INFO:tasks.workunit.client.0.smithi033.stdout:9/338: fdatasync d4/d32/f54 0 2024-02-15T18:31:04.974 INFO:tasks.workunit.client.0.smithi033.stdout:9/339: chown d4/d8/d1b/d2f/c48 28 1 2024-02-15T18:31:04.974 INFO:tasks.workunit.client.0.smithi033.stdout:1/407: dread d5/d17/f35 [0,4194304] 0 2024-02-15T18:31:04.975 INFO:tasks.workunit.client.0.smithi033.stdout:9/340: rename d4/d8/dd/f36 to d4/d8/d1b/d61/f7a 0 2024-02-15T18:31:04.975 INFO:tasks.workunit.client.0.smithi033.stdout:9/341: dread - d4/d8/d1b/d2f/d65/f75 zero size 2024-02-15T18:31:04.975 INFO:tasks.workunit.client.0.smithi033.stdout:9/342: dread - d4/d8/dd/f70 zero size 2024-02-15T18:31:04.976 INFO:tasks.workunit.client.0.smithi033.stdout:1/408: mkdir d5/d9/d1e/d20/d2c/d34/d51/d63/d76 0 2024-02-15T18:31:04.976 INFO:tasks.workunit.client.0.smithi033.stdout:9/343: truncate d4/d8/dd/d41/d51/f78 233287 0 2024-02-15T18:31:04.977 INFO:tasks.workunit.client.0.smithi033.stdout:9/344: fdatasync d4/d8/dd/d5c/f6a 0 2024-02-15T18:31:04.979 INFO:tasks.workunit.client.0.smithi033.stdout:1/409: rename d5/d9/d1e/d20/d5c/d57/f67 to d5/d9/f77 0 2024-02-15T18:31:04.979 INFO:tasks.workunit.client.0.smithi033.stdout:2/436: dwrite d20/d31/d6a/f35 [0,4194304] 0 2024-02-15T18:31:04.979 INFO:tasks.workunit.client.0.smithi033.stdout:2/437: fsync d20/d31/d6a/f9c 0 2024-02-15T18:31:04.980 INFO:tasks.workunit.client.0.smithi033.stdout:1/410: creat d5/d9/d1e/f78 x:0 0 0 2024-02-15T18:31:04.989 INFO:tasks.workunit.client.0.smithi033.stdout:2/438: mkdir d20/d3a/d4a/d5e/d6b/d88/da6 0 2024-02-15T18:31:04.990 INFO:tasks.workunit.client.0.smithi033.stdout:1/411: creat d5/f79 x:0 0 0 2024-02-15T18:31:04.991 INFO:tasks.workunit.client.0.smithi033.stdout:1/412: creat d5/d9/d1e/d20/d5c/d57/f7a x:0 0 0 2024-02-15T18:31:04.996 INFO:tasks.workunit.client.0.smithi033.stdout:9/345: dwrite d4/d8/dd/d5c/f72 [0,4194304] 0 2024-02-15T18:31:05.002 INFO:tasks.workunit.client.0.smithi033.stdout:1/413: dread d5/d9/d1e/d20/f50 [0,4194304] 0 2024-02-15T18:31:05.002 INFO:tasks.workunit.client.0.smithi033.stdout:1/414: dread - d5/d9/d1e/f73 zero size 2024-02-15T18:31:05.003 INFO:tasks.workunit.client.0.smithi033.stdout:1/415: creat d5/d9/d1e/d20/d5c/d57/d59/f7b x:0 0 0 2024-02-15T18:31:05.005 INFO:tasks.workunit.client.0.smithi033.stdout:2/439: dwrite d20/d3a/fa2 [0,4194304] 0 2024-02-15T18:31:05.005 INFO:tasks.workunit.client.0.smithi033.stdout:2/440: truncate d20/d31/d47/d4c/d6c/d80/f8a 656767 0 2024-02-15T18:31:05.005 INFO:tasks.workunit.client.0.smithi033.stdout:8/321: sync 2024-02-15T18:31:05.005 INFO:tasks.workunit.client.0.smithi033.stdout:8/322: dread - d0/df/db/f3c zero size 2024-02-15T18:31:05.008 INFO:tasks.workunit.client.0.smithi033.stdout:2/441: dread d20/d31/d47/d64/f86 [0,4194304] 0 2024-02-15T18:31:05.008 INFO:tasks.workunit.client.0.smithi033.stdout:2/442: write d20/d31/d6a/f28 [1565560,66572] 0 2024-02-15T18:31:05.008 INFO:tasks.workunit.client.0.smithi033.stdout:2/443: symlink d20/d31/la7 0 2024-02-15T18:31:05.012 INFO:tasks.workunit.client.0.smithi033.stdout:1/416: dread d5/d9/d1e/d20/d5c/f39 [0,4194304] 0 2024-02-15T18:31:05.014 INFO:tasks.workunit.client.0.smithi033.stdout:1/417: symlink d5/dd/l7c 0 2024-02-15T18:31:05.017 INFO:tasks.workunit.client.0.smithi033.stdout:1/418: read d5/d17/f31 [2509538,6238] 0 2024-02-15T18:31:05.017 INFO:tasks.workunit.client.0.smithi033.stdout:1/419: write d5/dd/d12/d49/f2b [165589,27345] 0 2024-02-15T18:31:05.019 INFO:tasks.workunit.client.0.smithi033.stdout:1/420: rmdir d5/d9/d1e/d20/d2c/d34/d51 39 2024-02-15T18:31:05.019 INFO:tasks.workunit.client.0.smithi033.stdout:1/421: readlink d5/d9/d1e/d20/d2c/d34/l42 0 2024-02-15T18:31:05.020 INFO:tasks.workunit.client.0.smithi033.stdout:1/422: creat d5/dd/d12/d49/f7d x:0 0 0 2024-02-15T18:31:05.021 INFO:tasks.workunit.client.0.smithi033.stdout:8/323: dwrite d0/df/d53/f5d [0,4194304] 0 2024-02-15T18:31:05.022 INFO:tasks.workunit.client.0.smithi033.stdout:1/423: creat d5/dd/d12/d6b/f7e x:0 0 0 2024-02-15T18:31:05.022 INFO:tasks.workunit.client.0.smithi033.stdout:1/424: read - d5/d9/d1e/d20/d2c/d65/f75 zero size 2024-02-15T18:31:05.022 INFO:tasks.workunit.client.0.smithi033.stdout:1/425: fsync d5/dd/d12/f1b 0 2024-02-15T18:31:05.024 INFO:tasks.workunit.client.0.smithi033.stdout:8/324: creat d0/d2/d35/f64 x:0 0 0 2024-02-15T18:31:05.027 INFO:tasks.workunit.client.0.smithi033.stdout:8/325: write d0/df/db/fc [926232,95398] 0 2024-02-15T18:31:05.027 INFO:tasks.workunit.client.0.smithi033.stdout:8/326: chown d0/l10 1358694604 1 2024-02-15T18:31:05.030 INFO:tasks.workunit.client.0.smithi033.stdout:8/327: unlink d0/df/db/d1b/c43 0 2024-02-15T18:31:05.039 INFO:tasks.workunit.client.0.smithi033.stdout:1/426: dwrite d5/dd/d12/d49/f21 [0,4194304] 0 2024-02-15T18:31:05.043 INFO:tasks.workunit.client.0.smithi033.stdout:1/427: link d5/dd/d12/d49/f4e d5/dd/d12/d49/d23/f7f 0 2024-02-15T18:31:05.055 INFO:tasks.workunit.client.0.smithi033.stdout:1/428: dread d5/dd/d12/d49/f1d [0,4194304] 0 2024-02-15T18:31:05.055 INFO:tasks.workunit.client.0.smithi033.stdout:8/328: dwrite d0/d2/d35/f1a [0,4194304] 0 2024-02-15T18:31:05.056 INFO:tasks.workunit.client.0.smithi033.stdout:1/429: read d5/d9/d1e/d20/f50 [794762,102824] 0 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:1/430: write d5/dd/d12/d49/d23/f4d [139966,52974] 0 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:1/431: fsync d5/d9/d1e/f78 0 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:1/432: fdatasync d5/dd/f3f 0 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:1/433: truncate d5/dd/d12/d49/f4e 622371 0 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:0/392: sync 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:6/473: sync 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:7/399: sync 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:5/476: sync 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:3/364: sync 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:4/444: sync 2024-02-15T18:31:05.057 INFO:tasks.workunit.client.0.smithi033.stdout:7/400: readlink d0/d56/l6c 0 2024-02-15T18:31:05.058 INFO:tasks.workunit.client.0.smithi033.stdout:5/477: readlink d1/da/d19/d3f/l43 0 2024-02-15T18:31:05.058 INFO:tasks.workunit.client.0.smithi033.stdout:6/474: truncate d8/d28/d14/f7c 922883 0 2024-02-15T18:31:05.058 INFO:tasks.workunit.client.0.smithi033.stdout:0/393: fsync d0/d8/d15/d2d/d3f/d6f/f7f 0 2024-02-15T18:31:05.058 INFO:tasks.workunit.client.0.smithi033.stdout:7/401: dread - d0/f5e zero size 2024-02-15T18:31:05.058 INFO:tasks.workunit.client.0.smithi033.stdout:1/434: symlink d5/d9/d1e/d20/d5c/d57/d59/l80 0 2024-02-15T18:31:05.061 INFO:tasks.workunit.client.0.smithi033.stdout:3/365: mkdir d2/d3/df/d6c 0 2024-02-15T18:31:05.061 INFO:tasks.workunit.client.0.smithi033.stdout:4/445: mkdir d4/d20/d13/d1b/d7c/d91 0 2024-02-15T18:31:05.061 INFO:tasks.workunit.client.0.smithi033.stdout:4/446: chown d4/d20/d13/d34/l8c 9775 1 2024-02-15T18:31:05.061 INFO:tasks.workunit.client.0.smithi033.stdout:4/447: fsync d4/d5/d28/f47 0 2024-02-15T18:31:05.061 INFO:tasks.workunit.client.0.smithi033.stdout:4/448: stat d4/f54 0 2024-02-15T18:31:05.061 INFO:tasks.workunit.client.0.smithi033.stdout:3/366: write d2/f1d [8497981,37952] 0 2024-02-15T18:31:05.061 INFO:tasks.workunit.client.0.smithi033.stdout:4/449: fsync d4/d20/fb 0 2024-02-15T18:31:05.062 INFO:tasks.workunit.client.0.smithi033.stdout:5/478: creat d1/da/d10/f8a x:0 0 0 2024-02-15T18:31:05.062 INFO:tasks.workunit.client.0.smithi033.stdout:5/479: dread - d1/da/d10/d2b/f86 zero size 2024-02-15T18:31:05.062 INFO:tasks.workunit.client.0.smithi033.stdout:0/394: truncate d0/d64/d1d/f1e 2268037 0 2024-02-15T18:31:05.064 INFO:tasks.workunit.client.0.smithi033.stdout:6/475: symlink d8/d1d/d2a/d83/l94 0 2024-02-15T18:31:05.065 INFO:tasks.workunit.client.0.smithi033.stdout:3/367: rmdir d2/d3/d1e/d22/d4d 39 2024-02-15T18:31:05.065 INFO:tasks.workunit.client.0.smithi033.stdout:3/368: readlink d2/l1a 0 2024-02-15T18:31:05.066 INFO:tasks.workunit.client.0.smithi033.stdout:1/435: mknod d5/d9/d1e/d20/d5c/d57/c81 0 2024-02-15T18:31:05.066 INFO:tasks.workunit.client.0.smithi033.stdout:4/450: mknod d4/d20/d13/d1b/d7c/d91/c92 0 2024-02-15T18:31:05.066 INFO:tasks.workunit.client.0.smithi033.stdout:5/480: rmdir d1/da/d10/d2b/d33/d63 39 2024-02-15T18:31:05.069 INFO:tasks.workunit.client.0.smithi033.stdout:1/436: rename d5/dd/d12/d6b to d5/d9/d1e/d20/d5c/d57/d82 0 2024-02-15T18:31:05.070 INFO:tasks.workunit.client.0.smithi033.stdout:5/481: creat d1/da/d11/d5e/f8b x:0 0 0 2024-02-15T18:31:05.071 INFO:tasks.workunit.client.0.smithi033.stdout:0/395: truncate d0/d64/d1d/f1f 2375090 0 2024-02-15T18:31:05.071 INFO:tasks.workunit.client.0.smithi033.stdout:4/451: mknod d4/d20/c93 0 2024-02-15T18:31:05.073 INFO:tasks.workunit.client.0.smithi033.stdout:4/452: creat d4/d20/d13/f94 x:0 0 0 2024-02-15T18:31:05.074 INFO:tasks.workunit.client.0.smithi033.stdout:4/453: rmdir d4/d5/d28/d39/d62 39 2024-02-15T18:31:05.079 INFO:tasks.workunit.client.0.smithi033.stdout:1/437: write d5/d9/ff [2191718,75295] 0 2024-02-15T18:31:05.080 INFO:tasks.workunit.client.0.smithi033.stdout:1/438: chown d5/dd/d12/d49/d23/f66 353102020 1 2024-02-15T18:31:05.080 INFO:tasks.workunit.client.0.smithi033.stdout:4/454: link d4/d5/f72 d4/d20/d13/d1b/d7c/f95 0 2024-02-15T18:31:05.081 INFO:tasks.workunit.client.0.smithi033.stdout:4/455: write d4/d20/f11 [1366202,105935] 0 2024-02-15T18:31:05.082 INFO:tasks.workunit.client.0.smithi033.stdout:4/456: write d4/f7 [1394148,20067] 0 2024-02-15T18:31:05.083 INFO:tasks.workunit.client.0.smithi033.stdout:1/439: creat d5/d9/d1e/d20/d2c/d34/d51/f83 x:0 0 0 2024-02-15T18:31:05.084 INFO:tasks.workunit.client.0.smithi033.stdout:4/457: mknod d4/d20/d13/d1b/c96 0 2024-02-15T18:31:05.085 INFO:tasks.workunit.client.0.smithi033.stdout:1/440: symlink d5/d9/d1e/d20/d2c/l84 0 2024-02-15T18:31:05.086 INFO:tasks.workunit.client.0.smithi033.stdout:7/402: dwrite d0/dc/d10/d48/f81 [0,4194304] 0 2024-02-15T18:31:05.086 INFO:tasks.workunit.client.0.smithi033.stdout:7/403: readlink d0/l1e 0 2024-02-15T18:31:05.089 INFO:tasks.workunit.client.0.smithi033.stdout:7/404: link d0/dc/d84/f85 d0/dc/d10/d1d/d38/d74/f87 0 2024-02-15T18:31:05.106 INFO:tasks.workunit.client.0.smithi033.stdout:8/329: dwrite d0/df/d53/f5d [0,4194304] 0 2024-02-15T18:31:05.111 INFO:tasks.workunit.client.0.smithi033.stdout:8/330: symlink d0/l65 0 2024-02-15T18:31:05.112 INFO:tasks.workunit.client.0.smithi033.stdout:8/331: creat d0/d1c/d30/f66 x:0 0 0 2024-02-15T18:31:05.119 INFO:tasks.workunit.client.0.smithi033.stdout:5/482: dwrite d1/da/d11/d5e/f8b [0,4194304] 0 2024-02-15T18:31:05.119 INFO:tasks.workunit.client.0.smithi033.stdout:3/369: dwrite d2/d20/f6a [0,4194304] 0 2024-02-15T18:31:05.119 INFO:tasks.workunit.client.0.smithi033.stdout:3/370: write d2/d3/d17/f69 [616803,8701] 0 2024-02-15T18:31:05.120 INFO:tasks.workunit.client.0.smithi033.stdout:6/476: dwrite d8/d1d/d37/f79 [4194304,4194304] 0 2024-02-15T18:31:05.120 INFO:tasks.workunit.client.0.smithi033.stdout:6/477: chown d8/d28/d14/d2c/d31/d30/d29/d38/d54/f8d 15 1 2024-02-15T18:31:05.120 INFO:tasks.workunit.client.0.smithi033.stdout:6/478: readlink d8/le 0 2024-02-15T18:31:05.121 INFO:tasks.workunit.client.0.smithi033.stdout:1/441: dwrite d5/dd/d12/f58 [0,4194304] 0 2024-02-15T18:31:05.121 INFO:tasks.workunit.client.0.smithi033.stdout:8/332: dread d0/d2/f41 [0,4194304] 0 2024-02-15T18:31:05.121 INFO:tasks.workunit.client.0.smithi033.stdout:8/333: fdatasync d0/df/db/d1b/f22 0 2024-02-15T18:31:05.121 INFO:tasks.workunit.client.0.smithi033.stdout:8/334: stat d0/df/db/d1b 0 2024-02-15T18:31:05.121 INFO:tasks.workunit.client.0.smithi033.stdout:0/396: dwrite d0/d64/ff [0,4194304] 0 2024-02-15T18:31:05.122 INFO:tasks.workunit.client.0.smithi033.stdout:5/483: creat d1/da/d10/f8c x:0 0 0 2024-02-15T18:31:05.122 INFO:tasks.workunit.client.0.smithi033.stdout:4/458: dwrite d4/f67 [0,4194304] 0 2024-02-15T18:31:05.123 INFO:tasks.workunit.client.0.smithi033.stdout:3/371: creat d2/f6d x:0 0 0 2024-02-15T18:31:05.123 INFO:tasks.workunit.client.0.smithi033.stdout:3/372: fdatasync d2/d3/f50 0 2024-02-15T18:31:05.134 INFO:tasks.workunit.client.0.smithi033.stdout:1/442: getdents d5/d9/d1e 0 2024-02-15T18:31:05.134 INFO:tasks.workunit.client.0.smithi033.stdout:1/443: write d5/d9/d1e/d20/d5c/d57/d82/f7e [833555,103609] 0 2024-02-15T18:31:05.135 INFO:tasks.workunit.client.0.smithi033.stdout:8/335: rename d0/c52 to d0/d2/d35/d29/d5f/c67 0 2024-02-15T18:31:05.142 INFO:tasks.workunit.client.0.smithi033.stdout:0/397: mkdir d0/d8/d15/d2d/d41/d73/d84 0 2024-02-15T18:31:05.142 INFO:tasks.workunit.client.0.smithi033.stdout:0/398: write d0/d2/f7 [2704261,125817] 0 2024-02-15T18:31:05.142 INFO:tasks.workunit.client.0.smithi033.stdout:0/399: write d0/d8/d15/d2d/d2e/f63 [827850,125644] 0 2024-02-15T18:31:05.142 INFO:tasks.workunit.client.0.smithi033.stdout:5/484: dwrite d1/da/d11/f2d [4194304,4194304] 0 2024-02-15T18:31:05.142 INFO:tasks.workunit.client.0.smithi033.stdout:5/485: write d1/da/d19/f34 [87258,1907] 0 2024-02-15T18:31:05.143 INFO:tasks.workunit.client.0.smithi033.stdout:5/486: chown d1/da/d52 3 1 2024-02-15T18:31:05.143 INFO:tasks.workunit.client.0.smithi033.stdout:4/459: link d4/d5/d28/c5d d4/d20/d13/d1b/d81/c97 0 2024-02-15T18:31:05.143 INFO:tasks.workunit.client.0.smithi033.stdout:4/460: chown d4/d20/d13/d5c 5616576 1 2024-02-15T18:31:05.145 INFO:tasks.workunit.client.0.smithi033.stdout:3/373: creat d2/d3/d1e/f6e x:0 0 0 2024-02-15T18:31:05.147 INFO:tasks.workunit.client.0.smithi033.stdout:9/346: sync 2024-02-15T18:31:05.149 INFO:tasks.workunit.client.0.smithi033.stdout:1/444: creat d5/f85 x:0 0 0 2024-02-15T18:31:05.149 INFO:tasks.workunit.client.0.smithi033.stdout:1/445: readlink d5/d9/d1e/d20/d2c/l84 0 2024-02-15T18:31:05.149 INFO:tasks.workunit.client.0.smithi033.stdout:8/336: truncate d0/df/db/d1b/d4b/f4c 3123953 0 2024-02-15T18:31:05.152 INFO:tasks.workunit.client.0.smithi033.stdout:0/400: unlink d0/d64/c47 0 2024-02-15T18:31:05.152 INFO:tasks.workunit.client.0.smithi033.stdout:5/487: getdents d1/da/d19/d74 0 2024-02-15T18:31:05.155 INFO:tasks.workunit.client.0.smithi033.stdout:4/461: rename d4/d20/d13/f32 to d4/d5/d28/d39/d62/f98 0 2024-02-15T18:31:05.155 INFO:tasks.workunit.client.0.smithi033.stdout:4/462: chown d4/d20/d13/d34/f7b 6317 1 2024-02-15T18:31:05.155 INFO:tasks.workunit.client.0.smithi033.stdout:4/463: chown d4/d20/d13/d1b/l80 1 1 2024-02-15T18:31:05.155 INFO:tasks.workunit.client.0.smithi033.stdout:4/464: chown d4/d20/d13/d34/d82/l8f 23 1 2024-02-15T18:31:05.156 INFO:tasks.workunit.client.0.smithi033.stdout:9/347: creat d4/d8/dd/d5c/d6d/f7b x:0 0 0 2024-02-15T18:31:05.159 INFO:tasks.workunit.client.0.smithi033.stdout:9/348: dread d4/d8/dd/d41/f4e [0,4194304] 0 2024-02-15T18:31:05.161 INFO:tasks.workunit.client.0.smithi033.stdout:0/401: unlink d0/d64/d3b/d6c/f50 0 2024-02-15T18:31:05.161 INFO:tasks.workunit.client.0.smithi033.stdout:5/488: creat d1/da/d10/f8d x:0 0 0 2024-02-15T18:31:05.162 INFO:tasks.workunit.client.0.smithi033.stdout:5/489: fdatasync d1/da/d11/f49 0 2024-02-15T18:31:05.162 INFO:tasks.workunit.client.0.smithi033.stdout:5/490: stat d1/f14 0 2024-02-15T18:31:05.163 INFO:tasks.workunit.client.0.smithi033.stdout:8/337: rename d0/df/db/c4e to d0/d2/d35/d58/c68 0 2024-02-15T18:31:05.163 INFO:tasks.workunit.client.0.smithi033.stdout:8/338: read - d0/d1c/d30/f66 zero size 2024-02-15T18:31:05.163 INFO:tasks.workunit.client.0.smithi033.stdout:8/339: chown d0/df/db/d45/f4a 0 1 2024-02-15T18:31:05.164 INFO:tasks.workunit.client.0.smithi033.stdout:4/465: mknod d4/d20/d13/d1b/d81/c99 0 2024-02-15T18:31:05.166 INFO:tasks.workunit.client.0.smithi033.stdout:9/349: symlink d4/d8/d1b/l7c 0 2024-02-15T18:31:05.166 INFO:tasks.workunit.client.0.smithi033.stdout:9/350: write d4/d8/d1b/d2f/f79 [991484,44729] 0 2024-02-15T18:31:05.167 INFO:tasks.workunit.client.0.smithi033.stdout:5/491: rename d1/da/d19/d3c/d40/c38 to d1/da/d10/d2b/c8e 0 2024-02-15T18:31:05.168 INFO:tasks.workunit.client.0.smithi033.stdout:4/466: creat d4/d20/f9a x:0 0 0 2024-02-15T18:31:05.169 INFO:tasks.workunit.client.0.smithi033.stdout:9/351: mknod d4/d8/d1b/d61/c7d 0 2024-02-15T18:31:05.169 INFO:tasks.workunit.client.0.smithi033.stdout:3/374: dwrite d2/d3/d1e/d22/d59/f5e [0,4194304] 0 2024-02-15T18:31:05.169 INFO:tasks.workunit.client.0.smithi033.stdout:3/375: dread - d2/d3/df/f49 zero size 2024-02-15T18:31:05.170 INFO:tasks.workunit.client.0.smithi033.stdout:3/376: readlink d2/d14/d23/l38 0 2024-02-15T18:31:05.170 INFO:tasks.workunit.client.0.smithi033.stdout:3/377: fdatasync d2/d14/d23/f28 0 2024-02-15T18:31:05.170 INFO:tasks.workunit.client.0.smithi033.stdout:3/378: dread - d2/f6d zero size 2024-02-15T18:31:05.172 INFO:tasks.workunit.client.0.smithi033.stdout:1/446: dwrite d5/d9/d1e/d20/d2c/d34/d51/f6f [0,4194304] 0 2024-02-15T18:31:05.172 INFO:tasks.workunit.client.0.smithi033.stdout:5/492: rename d1/da/d19/d3c/d40/f4e to d1/da/d11/f8f 0 2024-02-15T18:31:05.172 INFO:tasks.workunit.client.0.smithi033.stdout:9/352: stat d4/d8/l21 0 2024-02-15T18:31:05.179 INFO:tasks.workunit.client.0.smithi033.stdout:3/379: getdents d2/d3/d1e/d22/d4d 0 2024-02-15T18:31:05.180 INFO:tasks.workunit.client.0.smithi033.stdout:1/447: rename d5/d9/d1e/d20/f3d to d5/d9/d1e/d20/d2c/d34/f86 0 2024-02-15T18:31:05.181 INFO:tasks.workunit.client.0.smithi033.stdout:1/448: write d5/f8 [4840614,80798] 0 2024-02-15T18:31:05.182 INFO:tasks.workunit.client.0.smithi033.stdout:5/493: mknod d1/da/d19/d3c/c90 0 2024-02-15T18:31:05.183 INFO:tasks.workunit.client.0.smithi033.stdout:3/380: mkdir d2/d14/d23/d6f 0 2024-02-15T18:31:05.183 INFO:tasks.workunit.client.0.smithi033.stdout:3/381: write d2/d14/d23/f66 [4782856,74237] 0 2024-02-15T18:31:05.183 INFO:tasks.workunit.client.0.smithi033.stdout:3/382: read - d2/d14/f67 zero size 2024-02-15T18:31:05.185 INFO:tasks.workunit.client.0.smithi033.stdout:5/494: creat d1/da/d19/d3c/d40/d65/f91 x:0 0 0 2024-02-15T18:31:05.185 INFO:tasks.workunit.client.0.smithi033.stdout:5/495: write d1/da/d11/f7c [697083,16844] 0 2024-02-15T18:31:05.187 INFO:tasks.workunit.client.0.smithi033.stdout:3/383: rename d2/d14/c40 to d2/d14/c70 0 2024-02-15T18:31:05.189 INFO:tasks.workunit.client.0.smithi033.stdout:3/384: symlink d2/d3/d1e/d22/d4d/l71 0 2024-02-15T18:31:05.189 INFO:tasks.workunit.client.0.smithi033.stdout:3/385: dread - d2/d3/d1e/f6e zero size 2024-02-15T18:31:05.189 INFO:tasks.workunit.client.0.smithi033.stdout:3/386: fdatasync d2/d14/d23/f28 0 2024-02-15T18:31:05.189 INFO:tasks.workunit.client.0.smithi033.stdout:3/387: chown d2/d3/d17/l31 17 1 2024-02-15T18:31:05.190 INFO:tasks.workunit.client.0.smithi033.stdout:3/388: creat d2/d3/df/d6c/f72 x:0 0 0 2024-02-15T18:31:05.190 INFO:tasks.workunit.client.0.smithi033.stdout:3/389: write d2/d14/d23/f3d [351135,110064] 0 2024-02-15T18:31:05.192 INFO:tasks.workunit.client.0.smithi033.stdout:3/390: mkdir d2/d14/d23/d68/d73 0 2024-02-15T18:31:05.192 INFO:tasks.workunit.client.0.smithi033.stdout:0/402: dwrite d0/fd [0,4194304] 0 2024-02-15T18:31:05.197 INFO:tasks.workunit.client.0.smithi033.stdout:0/403: symlink d0/d8/l85 0 2024-02-15T18:31:05.197 INFO:tasks.workunit.client.0.smithi033.stdout:0/404: chown d0/d2/f82 3 1 2024-02-15T18:31:05.201 INFO:tasks.workunit.client.0.smithi033.stdout:0/405: symlink d0/d8/d54/l86 0 2024-02-15T18:31:05.210 INFO:tasks.workunit.client.0.smithi033.stdout:0/406: write d0/d2/f3c [2514427,72724] 0 2024-02-15T18:31:05.210 INFO:tasks.workunit.client.0.smithi033.stdout:0/407: write d0/f4 [5928587,74201] 0 2024-02-15T18:31:05.211 INFO:tasks.workunit.client.0.smithi033.stdout:0/408: creat d0/d8/d15/d2d/d41/f87 x:0 0 0 2024-02-15T18:31:05.213 INFO:tasks.workunit.client.0.smithi033.stdout:0/409: write d0/d8/d15/f17 [791750,33253] 0 2024-02-15T18:31:05.213 INFO:tasks.workunit.client.0.smithi033.stdout:0/410: readlink d0/d8/d54/l86 0 2024-02-15T18:31:05.215 INFO:tasks.workunit.client.0.smithi033.stdout:8/340: dwrite d0/f3a [0,4194304] 0 2024-02-15T18:31:05.215 INFO:tasks.workunit.client.0.smithi033.stdout:0/411: mkdir d0/d64/d88 0 2024-02-15T18:31:05.215 INFO:tasks.workunit.client.0.smithi033.stdout:4/467: dwrite d4/f21 [0,4194304] 0 2024-02-15T18:31:05.216 INFO:tasks.workunit.client.0.smithi033.stdout:9/353: dwrite d4/d32/f3b [0,4194304] 0 2024-02-15T18:31:05.216 INFO:tasks.workunit.client.0.smithi033.stdout:5/496: dwrite d1/da/d10/f8d [0,4194304] 0 2024-02-15T18:31:05.217 INFO:tasks.workunit.client.0.smithi033.stdout:5/497: chown d1/da/d10/d2b 7067942 1 2024-02-15T18:31:05.217 INFO:tasks.workunit.client.0.smithi033.stdout:3/391: dwrite d2/d3/d1e/d22/d4d/f6b [0,4194304] 0 2024-02-15T18:31:05.217 INFO:tasks.workunit.client.0.smithi033.stdout:3/392: write d2/d14/d23/f28 [854896,66886] 0 2024-02-15T18:31:05.219 INFO:tasks.workunit.client.0.smithi033.stdout:2/444: sync 2024-02-15T18:31:05.219 INFO:tasks.workunit.client.0.smithi033.stdout:6/479: sync 2024-02-15T18:31:05.221 INFO:tasks.workunit.client.0.smithi033.stdout:0/412: creat d0/d8/d15/d7c/f89 x:0 0 0 2024-02-15T18:31:05.226 INFO:tasks.workunit.client.0.smithi033.stdout:9/354: symlink d4/d8/dd/d41/d51/l7e 0 2024-02-15T18:31:05.228 INFO:tasks.workunit.client.0.smithi033.stdout:5/498: creat d1/da/d19/d74/f92 x:0 0 0 2024-02-15T18:31:05.228 INFO:tasks.workunit.client.0.smithi033.stdout:7/405: sync 2024-02-15T18:31:05.228 INFO:tasks.workunit.client.0.smithi033.stdout:7/406: dread - d0/dc/d10/d48/f53 zero size 2024-02-15T18:31:05.229 INFO:tasks.workunit.client.0.smithi033.stdout:8/341: dread d0/df/f11 [0,4194304] 0 2024-02-15T18:31:05.229 INFO:tasks.workunit.client.0.smithi033.stdout:9/355: write d4/d8/d1b/d61/f7a [2824999,98104] 0 2024-02-15T18:31:05.229 INFO:tasks.workunit.client.0.smithi033.stdout:9/356: fsync d4/d8/dd/d5c/f68 0 2024-02-15T18:31:05.236 INFO:tasks.workunit.client.0.smithi033.stdout:3/393: mknod d2/d14/d23/d68/c74 0 2024-02-15T18:31:05.238 INFO:tasks.workunit.client.0.smithi033.stdout:2/445: creat d20/d31/d47/d4c/d6c/fa8 x:0 0 0 2024-02-15T18:31:05.238 INFO:tasks.workunit.client.0.smithi033.stdout:2/446: dread - d20/d31/d47/d4c/d6c/fa8 zero size 2024-02-15T18:31:05.238 INFO:tasks.workunit.client.0.smithi033.stdout:2/447: write d20/d3a/d4a/f52 [1313805,12478] 0 2024-02-15T18:31:05.239 INFO:tasks.workunit.client.0.smithi033.stdout:6/480: unlink d8/d28/d36/f50 0 2024-02-15T18:31:05.240 INFO:tasks.workunit.client.0.smithi033.stdout:0/413: rename d0/d8/f37 to d0/d64/d88/f8a 0 2024-02-15T18:31:05.242 INFO:tasks.workunit.client.0.smithi033.stdout:4/468: link d4/d20/d13/d1b/d81/c85 d4/d20/c9b 0 2024-02-15T18:31:05.242 INFO:tasks.workunit.client.0.smithi033.stdout:5/499: getdents d1/da/d10/d2b/d42 0 2024-02-15T18:31:05.243 INFO:tasks.workunit.client.0.smithi033.stdout:7/407: creat d0/dc/d10/d1d/d38/d74/d7f/f88 x:0 0 0 2024-02-15T18:31:05.245 INFO:tasks.workunit.client.0.smithi033.stdout:9/357: creat d4/d8/d1b/d73/f7f x:0 0 0 2024-02-15T18:31:05.246 INFO:tasks.workunit.client.0.smithi033.stdout:3/394: symlink d2/d3/d1e/d22/d59/l75 0 2024-02-15T18:31:05.247 INFO:tasks.workunit.client.0.smithi033.stdout:3/395: stat d2 0 2024-02-15T18:31:05.248 INFO:tasks.workunit.client.0.smithi033.stdout:2/448: creat d20/d31/d47/d82/fa9 x:0 0 0 2024-02-15T18:31:05.249 INFO:tasks.workunit.client.0.smithi033.stdout:6/481: creat d8/d28/d14/d2c/d31/d5d/d8c/f95 x:0 0 0 2024-02-15T18:31:05.251 INFO:tasks.workunit.client.0.smithi033.stdout:8/342: rename d0/df/d48/l5a to d0/df/db/d1b/d4b/l69 0 2024-02-15T18:31:05.251 INFO:tasks.workunit.client.0.smithi033.stdout:6/482: dread d8/d28/d14/d2c/d3b/d3d/f48 [0,4194304] 0 2024-02-15T18:31:05.253 INFO:tasks.workunit.client.0.smithi033.stdout:1/449: sync 2024-02-15T18:31:05.253 INFO:tasks.workunit.client.0.smithi033.stdout:1/450: fdatasync d5/d38/f60 0 2024-02-15T18:31:05.255 INFO:tasks.workunit.client.0.smithi033.stdout:4/469: mkdir d4/d5/d28/d39/d62/d9c 0 2024-02-15T18:31:05.255 INFO:tasks.workunit.client.0.smithi033.stdout:4/470: read - d4/d20/d37/f44 zero size 2024-02-15T18:31:05.255 INFO:tasks.workunit.client.0.smithi033.stdout:5/500: dread d1/f27 [0,4194304] 0 2024-02-15T18:31:05.256 INFO:tasks.workunit.client.0.smithi033.stdout:7/408: link d0/dc/l7c d0/dc/d10/d1d/d38/d74/d7f/l89 0 2024-02-15T18:31:05.256 INFO:tasks.workunit.client.0.smithi033.stdout:7/409: stat d0/dc/f65 0 2024-02-15T18:31:05.257 INFO:tasks.workunit.client.0.smithi033.stdout:9/358: creat d4/d8/dd/d41/d51/f80 x:0 0 0 2024-02-15T18:31:05.257 INFO:tasks.workunit.client.0.smithi033.stdout:3/396: mkdir d2/d14/d23/d68/d73/d76 0 2024-02-15T18:31:05.259 INFO:tasks.workunit.client.0.smithi033.stdout:2/449: creat d20/d3a/d4a/d5e/d6b/d83/faa x:0 0 0 2024-02-15T18:31:05.259 INFO:tasks.workunit.client.0.smithi033.stdout:9/359: write d4/d8/dd/d5c/f6a [2581573,30732] 0 2024-02-15T18:31:05.259 INFO:tasks.workunit.client.0.smithi033.stdout:9/360: chown d4/d8/dd/l12 1386179 1 2024-02-15T18:31:05.259 INFO:tasks.workunit.client.0.smithi033.stdout:9/361: write d4/d8/dd/d41/d51/f78 [528100,72088] 0 2024-02-15T18:31:05.259 INFO:tasks.workunit.client.0.smithi033.stdout:9/362: dread - d4/d8/dd/d41/d51/f69 zero size 2024-02-15T18:31:05.260 INFO:tasks.workunit.client.0.smithi033.stdout:8/343: creat d0/df/db/d1b/f6a x:0 0 0 2024-02-15T18:31:05.260 INFO:tasks.workunit.client.0.smithi033.stdout:8/344: truncate d0/d1c/d30/f66 962041 0 2024-02-15T18:31:05.260 INFO:tasks.workunit.client.0.smithi033.stdout:1/451: creat d5/d9/d1e/d20/d5c/d57/d82/f87 x:0 0 0 2024-02-15T18:31:05.261 INFO:tasks.workunit.client.0.smithi033.stdout:4/471: mknod d4/d20/d13/d1b/d7c/c9d 0 2024-02-15T18:31:05.261 INFO:tasks.workunit.client.0.smithi033.stdout:4/472: chown d4/d20/d13 32438450 1 2024-02-15T18:31:05.263 INFO:tasks.workunit.client.0.smithi033.stdout:5/501: getdents d1/da/d10 0 2024-02-15T18:31:05.264 INFO:tasks.workunit.client.0.smithi033.stdout:7/410: truncate d0/dc/d10/d1d/d2b/d5f/f71 3618185 0 2024-02-15T18:31:05.264 INFO:tasks.workunit.client.0.smithi033.stdout:7/411: chown d0/dc/d10/d1d/l57 1337291 1 2024-02-15T18:31:05.264 INFO:tasks.workunit.client.0.smithi033.stdout:7/412: truncate d0/dc/d10/d1d/d2b/f52 13525 0 2024-02-15T18:31:05.265 INFO:tasks.workunit.client.0.smithi033.stdout:2/450: symlink d20/d31/d47/d82/lab 0 2024-02-15T18:31:05.265 INFO:tasks.workunit.client.0.smithi033.stdout:2/451: chown d20/d31/d6a/f81 0 1 2024-02-15T18:31:05.265 INFO:tasks.workunit.client.0.smithi033.stdout:6/483: dwrite d8/d1d/d37/d4f/f6f [0,4194304] 0 2024-02-15T18:31:05.266 INFO:tasks.workunit.client.0.smithi033.stdout:9/363: symlink d4/d32/l81 0 2024-02-15T18:31:05.268 INFO:tasks.workunit.client.0.smithi033.stdout:1/452: getdents d5/d9 0 2024-02-15T18:31:05.269 INFO:tasks.workunit.client.0.smithi033.stdout:1/453: read - d5/dd/d12/d49/d23/f72 zero size 2024-02-15T18:31:05.269 INFO:tasks.workunit.client.0.smithi033.stdout:4/473: mkdir d4/d5/d28/d39/d62/d9c/d9e 0 2024-02-15T18:31:05.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/502: getdents d1/da/d11 0 2024-02-15T18:31:05.274 INFO:tasks.workunit.client.0.smithi033.stdout:7/413: creat d0/dc/f8a x:0 0 0 2024-02-15T18:31:05.274 INFO:tasks.workunit.client.0.smithi033.stdout:7/414: dread - d0/dc/d84/f85 zero size 2024-02-15T18:31:05.274 INFO:tasks.workunit.client.0.smithi033.stdout:5/503: dread d1/da/f12 [0,4194304] 0 2024-02-15T18:31:05.276 INFO:tasks.workunit.client.0.smithi033.stdout:2/452: rename d20/d73/fa3 to d20/d73/fac 0 2024-02-15T18:31:05.281 INFO:tasks.workunit.client.0.smithi033.stdout:9/364: mknod d4/d8/dd/d28/c82 0 2024-02-15T18:31:05.282 INFO:tasks.workunit.client.0.smithi033.stdout:1/454: symlink d5/d9/d1e/d20/d5c/d57/d82/l88 0 2024-02-15T18:31:05.282 INFO:tasks.workunit.client.0.smithi033.stdout:1/455: stat d5/dd/d12/d49 0 2024-02-15T18:31:05.282 INFO:tasks.workunit.client.0.smithi033.stdout:4/474: truncate d4/d5/f89 57616 0 2024-02-15T18:31:05.282 INFO:tasks.workunit.client.0.smithi033.stdout:4/475: chown d4/d5/d28 1216361997 1 2024-02-15T18:31:05.283 INFO:tasks.workunit.client.0.smithi033.stdout:4/476: write d4/d20/d13/d34/f5a [967740,90639] 0 2024-02-15T18:31:05.284 INFO:tasks.workunit.client.0.smithi033.stdout:7/415: truncate d0/dc/d10/f13 3114595 0 2024-02-15T18:31:05.284 INFO:tasks.workunit.client.0.smithi033.stdout:5/504: mknod d1/da/d10/c93 0 2024-02-15T18:31:05.284 INFO:tasks.workunit.client.0.smithi033.stdout:5/505: dread - d1/da/f6e zero size 2024-02-15T18:31:05.285 INFO:tasks.workunit.client.0.smithi033.stdout:1/456: unlink d5/dd/d12/c28 0 2024-02-15T18:31:05.286 INFO:tasks.workunit.client.0.smithi033.stdout:5/506: fsync d1/da/d52/f5b 0 2024-02-15T18:31:05.286 INFO:tasks.workunit.client.0.smithi033.stdout:5/507: stat d1/da/d19/d3f 0 2024-02-15T18:31:05.287 INFO:tasks.workunit.client.0.smithi033.stdout:1/457: symlink d5/d9/d1e/d20/d2c/d65/l89 0 2024-02-15T18:31:05.288 INFO:tasks.workunit.client.0.smithi033.stdout:8/345: dwrite d0/f5c [0,4194304] 0 2024-02-15T18:31:05.289 INFO:tasks.workunit.client.0.smithi033.stdout:2/453: dread d20/d3a/d4a/d5e/f66 [0,4194304] 0 2024-02-15T18:31:05.291 INFO:tasks.workunit.client.0.smithi033.stdout:2/454: dread - d20/d31/d47/d82/fa9 zero size 2024-02-15T18:31:05.291 INFO:tasks.workunit.client.0.smithi033.stdout:3/397: dwrite d2/d3/d1e/f6e [0,4194304] 0 2024-02-15T18:31:05.291 INFO:tasks.workunit.client.0.smithi033.stdout:5/508: creat d1/da/d11/d5e/f94 x:0 0 0 2024-02-15T18:31:05.291 INFO:tasks.workunit.client.0.smithi033.stdout:5/509: write d1/da/f69 [1445426,71487] 0 2024-02-15T18:31:05.294 INFO:tasks.workunit.client.0.smithi033.stdout:6/484: dwrite d8/d28/f18 [0,4194304] 0 2024-02-15T18:31:05.297 INFO:tasks.workunit.client.0.smithi033.stdout:2/455: mknod d20/d30/cad 0 2024-02-15T18:31:05.297 INFO:tasks.workunit.client.0.smithi033.stdout:2/456: read d20/d31/d6a/f28 [353391,6141] 0 2024-02-15T18:31:05.297 INFO:tasks.workunit.client.0.smithi033.stdout:2/457: chown c1a 185 1 2024-02-15T18:31:05.298 INFO:tasks.workunit.client.0.smithi033.stdout:7/416: dread d0/dc/d10/d48/f51 [0,4194304] 0 2024-02-15T18:31:05.305 INFO:tasks.workunit.client.0.smithi033.stdout:3/398: rename d2/d3/f50 to d2/d3/d1e/d22/d4d/f77 0 2024-02-15T18:31:05.306 INFO:tasks.workunit.client.0.smithi033.stdout:4/477: dwrite d4/f54 [0,4194304] 0 2024-02-15T18:31:05.306 INFO:tasks.workunit.client.0.smithi033.stdout:4/478: write d4/d20/d37/f8e [231592,58347] 0 2024-02-15T18:31:05.309 INFO:tasks.workunit.client.0.smithi033.stdout:5/510: symlink d1/da/d10/l95 0 2024-02-15T18:31:05.310 INFO:tasks.workunit.client.0.smithi033.stdout:6/485: truncate d8/d28/d14/f43 3686204 0 2024-02-15T18:31:05.310 INFO:tasks.workunit.client.0.smithi033.stdout:6/486: truncate d8/d28/d14/d2c/d31/d5d/d8c/f95 168646 0 2024-02-15T18:31:05.310 INFO:tasks.workunit.client.0.smithi033.stdout:2/458: mknod d20/d3a/cae 0 2024-02-15T18:31:05.312 INFO:tasks.workunit.client.0.smithi033.stdout:7/417: rename d0/dc/l3b to d0/dc/d10/d1d/l8b 0 2024-02-15T18:31:05.312 INFO:tasks.workunit.client.0.smithi033.stdout:7/418: write d0/dc/d10/d1d/f2d [932893,18879] 0 2024-02-15T18:31:05.312 INFO:tasks.workunit.client.0.smithi033.stdout:3/399: truncate d2/d14/f42 4076500 0 2024-02-15T18:31:05.314 INFO:tasks.workunit.client.0.smithi033.stdout:4/479: mkdir d4/d20/d13/d1b/d81/d9f 0 2024-02-15T18:31:05.315 INFO:tasks.workunit.client.0.smithi033.stdout:6/487: creat d8/d28/d14/d2c/d31/d30/d29/d38/f96 x:0 0 0 2024-02-15T18:31:05.316 INFO:tasks.workunit.client.0.smithi033.stdout:2/459: symlink d20/d3a/laf 0 2024-02-15T18:31:05.318 INFO:tasks.workunit.client.0.smithi033.stdout:5/511: rename d1/da/d10/d2b/d33/f36 to d1/da/d19/d3f/d68/f96 0 2024-02-15T18:31:05.319 INFO:tasks.workunit.client.0.smithi033.stdout:7/419: creat d0/f8c x:0 0 0 2024-02-15T18:31:05.321 INFO:tasks.workunit.client.0.smithi033.stdout:4/480: symlink d4/d20/d13/d1b/d81/d9f/la0 0 2024-02-15T18:31:05.322 INFO:tasks.workunit.client.0.smithi033.stdout:6/488: symlink d8/d70/l97 0 2024-02-15T18:31:05.323 INFO:tasks.workunit.client.0.smithi033.stdout:6/489: chown d8/d28/d14/d2c/d31/d30/d29/d38/d54/l85 5 1 2024-02-15T18:31:05.323 INFO:tasks.workunit.client.0.smithi033.stdout:5/512: creat d1/da/d88/f97 x:0 0 0 2024-02-15T18:31:05.325 INFO:tasks.workunit.client.0.smithi033.stdout:2/460: dread d20/d31/d6a/f24 [0,4194304] 0 2024-02-15T18:31:05.325 INFO:tasks.workunit.client.0.smithi033.stdout:2/461: chown d20/d3a/d4a/d5e/d6b 103830040 1 2024-02-15T18:31:05.325 INFO:tasks.workunit.client.0.smithi033.stdout:7/420: unlink d0/dc/d10/d1d/d2b/f55 0 2024-02-15T18:31:05.325 INFO:tasks.workunit.client.0.smithi033.stdout:7/421: fdatasync d0/dc/d10/d1d/d2b/d5f/d63/f66 0 2024-02-15T18:31:05.325 INFO:tasks.workunit.client.0.smithi033.stdout:7/422: read - d0/dc/d84/f85 zero size 2024-02-15T18:31:05.325 INFO:tasks.workunit.client.0.smithi033.stdout:7/423: fdatasync d0/dc/f31 0 2024-02-15T18:31:05.325 INFO:tasks.workunit.client.0.smithi033.stdout:4/481: link d4/d20/d37/f42 d4/d20/d53/fa1 0 2024-02-15T18:31:05.326 INFO:tasks.workunit.client.0.smithi033.stdout:4/482: chown d4/d20 111826 1 2024-02-15T18:31:05.326 INFO:tasks.workunit.client.0.smithi033.stdout:6/490: creat d8/d1d/d37/d72/f98 x:0 0 0 2024-02-15T18:31:05.327 INFO:tasks.workunit.client.0.smithi033.stdout:5/513: mknod d1/da/d10/d2b/d33/d63/d61/c98 0 2024-02-15T18:31:05.328 INFO:tasks.workunit.client.0.smithi033.stdout:2/462: rename d20/d31/d47/d82/lab to d20/d31/d47/d82/lb0 0 2024-02-15T18:31:05.329 INFO:tasks.workunit.client.0.smithi033.stdout:7/424: rename d0/dc/f29 to d0/dc/d10/d1d/d38/d82/f8d 0 2024-02-15T18:31:05.330 INFO:tasks.workunit.client.0.smithi033.stdout:7/425: fdatasync d0/dc/d10/d1d/d38/d74/f87 0 2024-02-15T18:31:05.330 INFO:tasks.workunit.client.0.smithi033.stdout:7/426: dread - d0/dc/d84/f85 zero size 2024-02-15T18:31:05.331 INFO:tasks.workunit.client.0.smithi033.stdout:6/491: symlink d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/l99 0 2024-02-15T18:31:05.331 INFO:tasks.workunit.client.0.smithi033.stdout:6/492: fdatasync d8/d28/d14/f43 0 2024-02-15T18:31:05.331 INFO:tasks.workunit.client.0.smithi033.stdout:5/514: rmdir d1/da/d10/d2b/d33/d63 39 2024-02-15T18:31:05.331 INFO:tasks.workunit.client.0.smithi033.stdout:5/515: dread - d1/da/d19/d74/f82 zero size 2024-02-15T18:31:05.333 INFO:tasks.workunit.client.0.smithi033.stdout:2/463: dread f1 [8388608,4194304] 0 2024-02-15T18:31:05.333 INFO:tasks.workunit.client.0.smithi033.stdout:4/483: symlink d4/d20/d13/d1b/la2 0 2024-02-15T18:31:05.333 INFO:tasks.workunit.client.0.smithi033.stdout:8/346: dwrite d0/d2/d35/d29/f2e [0,4194304] 0 2024-02-15T18:31:05.333 INFO:tasks.workunit.client.0.smithi033.stdout:1/458: dwrite d5/f85 [0,4194304] 0 2024-02-15T18:31:05.334 INFO:tasks.workunit.client.0.smithi033.stdout:3/400: dwrite d2/d14/d23/f43 [0,4194304] 0 2024-02-15T18:31:05.334 INFO:tasks.workunit.client.0.smithi033.stdout:9/365: dwrite d4/d8/d1b/f5b [0,4194304] 0 2024-02-15T18:31:05.334 INFO:tasks.workunit.client.0.smithi033.stdout:9/366: chown d4/d8/dd/fe 5471 1 2024-02-15T18:31:05.334 INFO:tasks.workunit.client.0.smithi033.stdout:6/493: creat d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/d81/f9a x:0 0 0 2024-02-15T18:31:05.335 INFO:tasks.workunit.client.0.smithi033.stdout:5/516: fdatasync d1/da/d10/d2b/d33/f51 0 2024-02-15T18:31:05.335 INFO:tasks.workunit.client.0.smithi033.stdout:5/517: truncate d1/da/d10/d2b/d42/f44 897120 0 2024-02-15T18:31:05.338 INFO:tasks.workunit.client.0.smithi033.stdout:2/464: getdents d20/d30 0 2024-02-15T18:31:05.338 INFO:tasks.workunit.client.0.smithi033.stdout:2/465: stat d20/d39/l3d 0 2024-02-15T18:31:05.339 INFO:tasks.workunit.client.0.smithi033.stdout:2/466: read d20/d31/d6a/f26 [773043,88166] 0 2024-02-15T18:31:05.340 INFO:tasks.workunit.client.0.smithi033.stdout:4/484: creat d4/d20/d13/fa3 x:0 0 0 2024-02-15T18:31:05.342 INFO:tasks.workunit.client.0.smithi033.stdout:1/459: mknod d5/d9/d1e/d20/d2c/d65/c8a 0 2024-02-15T18:31:05.343 INFO:tasks.workunit.client.0.smithi033.stdout:9/367: dread d4/d8/dd/d5c/f68 [0,4194304] 0 2024-02-15T18:31:05.343 INFO:tasks.workunit.client.0.smithi033.stdout:6/494: write d8/d1d/d2a/f56 [1375165,65714] 0 2024-02-15T18:31:05.347 INFO:tasks.workunit.client.0.smithi033.stdout:3/401: symlink d2/d3/d1e/d22/d59/l78 0 2024-02-15T18:31:05.349 INFO:tasks.workunit.client.0.smithi033.stdout:5/518: creat d1/da/d52/f99 x:0 0 0 2024-02-15T18:31:05.355 INFO:tasks.workunit.client.0.smithi033.stdout:4/485: mkdir d4/d5/d28/d39/d62/d9c/d9e/da4 0 2024-02-15T18:31:05.358 INFO:tasks.workunit.client.0.smithi033.stdout:1/460: rename d5/f79 to d5/d9/d1e/d20/d5c/d57/f8b 0 2024-02-15T18:31:05.358 INFO:tasks.workunit.client.0.smithi033.stdout:1/461: stat d5/d9/d1e/d20/d2c/d34/d51/f83 0 2024-02-15T18:31:05.360 INFO:tasks.workunit.client.0.smithi033.stdout:9/368: link d4/d8/dd/d41/f5d d4/d8/dd/d28/f83 0 2024-02-15T18:31:05.362 INFO:tasks.workunit.client.0.smithi033.stdout:7/427: dwrite d0/dc/d10/d1d/d2b/f4a [0,4194304] 0 2024-02-15T18:31:05.362 INFO:tasks.workunit.client.0.smithi033.stdout:8/347: dwrite d0/d2/f6 [0,4194304] 0 2024-02-15T18:31:05.362 INFO:tasks.workunit.client.0.smithi033.stdout:2/467: dwrite d20/d31/d6a/f81 [0,4194304] 0 2024-02-15T18:31:05.367 INFO:tasks.workunit.client.0.smithi033.stdout:6/495: mknod d8/d28/d36/c9b 0 2024-02-15T18:31:05.368 INFO:tasks.workunit.client.0.smithi033.stdout:3/402: truncate d2/d3/d1e/f4f 957787 0 2024-02-15T18:31:05.370 INFO:tasks.workunit.client.0.smithi033.stdout:5/519: mkdir d1/da/d19/d3c/d40/d9a 0 2024-02-15T18:31:05.370 INFO:tasks.workunit.client.0.smithi033.stdout:5/520: chown d1/da/d10/l21 856231912 1 2024-02-15T18:31:05.372 INFO:tasks.workunit.client.0.smithi033.stdout:4/486: mknod d4/d20/d13/d1b/d81/ca5 0 2024-02-15T18:31:05.373 INFO:tasks.workunit.client.0.smithi033.stdout:1/462: creat d5/d9/d1e/d20/d2c/f8c x:0 0 0 2024-02-15T18:31:05.373 INFO:tasks.workunit.client.0.smithi033.stdout:1/463: truncate d5/d9/d1e/d20/d2c/d34/d51/f83 747126 0 2024-02-15T18:31:05.377 INFO:tasks.workunit.client.0.smithi033.stdout:8/348: rmdir d0/d2/d35 39 2024-02-15T18:31:05.377 INFO:tasks.workunit.client.0.smithi033.stdout:6/496: stat d8/d28/d36/c51 0 2024-02-15T18:31:05.378 INFO:tasks.workunit.client.0.smithi033.stdout:7/428: mkdir d0/d56/d8e 0 2024-02-15T18:31:05.378 INFO:tasks.workunit.client.0.smithi033.stdout:7/429: chown d0/dc/d10/d1d/l57 0 1 2024-02-15T18:31:05.379 INFO:tasks.workunit.client.0.smithi033.stdout:4/487: mkdir d4/d3c/da6 0 2024-02-15T18:31:05.379 INFO:tasks.workunit.client.0.smithi033.stdout:8/349: creat d0/df/db/f6b x:0 0 0 2024-02-15T18:31:05.379 INFO:tasks.workunit.client.0.smithi033.stdout:8/350: fsync d0/df/db/f3c 0 2024-02-15T18:31:05.380 INFO:tasks.workunit.client.0.smithi033.stdout:7/430: creat d0/dc/d10/d1d/f8f x:0 0 0 2024-02-15T18:31:05.381 INFO:tasks.workunit.client.0.smithi033.stdout:8/351: creat d0/d2/d14/d56/d59/f6c x:0 0 0 2024-02-15T18:31:05.382 INFO:tasks.workunit.client.0.smithi033.stdout:7/431: creat d0/d56/d8e/f90 x:0 0 0 2024-02-15T18:31:05.382 INFO:tasks.workunit.client.0.smithi033.stdout:7/432: truncate d0/dc/d10/d48/f53 34678 0 2024-02-15T18:31:05.383 INFO:tasks.workunit.client.0.smithi033.stdout:4/488: mkdir d4/d20/d13/d1b/da7 0 2024-02-15T18:31:05.385 INFO:tasks.workunit.client.0.smithi033.stdout:7/433: mkdir d0/d56/d70/d91 0 2024-02-15T18:31:05.385 INFO:tasks.workunit.client.0.smithi033.stdout:7/434: truncate d0/dc/d10/d1d/d38/d74/f87 732534 0 2024-02-15T18:31:05.386 INFO:tasks.workunit.client.0.smithi033.stdout:4/489: symlink d4/d20/d13/d5c/d87/la8 0 2024-02-15T18:31:05.390 INFO:tasks.workunit.client.0.smithi033.stdout:4/490: rmdir d4/d3c/da6 0 2024-02-15T18:31:05.391 INFO:tasks.workunit.client.0.smithi033.stdout:7/435: read d0/dc/d10/d7d/f3f [3143839,4903] 0 2024-02-15T18:31:05.391 INFO:tasks.workunit.client.0.smithi033.stdout:7/436: write d0/f27 [9146048,94263] 0 2024-02-15T18:31:05.391 INFO:tasks.workunit.client.0.smithi033.stdout:7/437: stat d0/dc/f41 0 2024-02-15T18:31:05.392 INFO:tasks.workunit.client.0.smithi033.stdout:9/369: dwrite d4/d8/dd/d41/d51/f80 [0,4194304] 0 2024-02-15T18:31:05.393 INFO:tasks.workunit.client.0.smithi033.stdout:4/491: stat d4/d5/d28/d39/c63 0 2024-02-15T18:31:05.394 INFO:tasks.workunit.client.0.smithi033.stdout:7/438: symlink d0/dc/l92 0 2024-02-15T18:31:05.395 INFO:tasks.workunit.client.0.smithi033.stdout:7/439: fsync d0/f9 0 2024-02-15T18:31:05.395 INFO:tasks.workunit.client.0.smithi033.stdout:7/440: chown d0/dc/f8a 375463 1 2024-02-15T18:31:05.397 INFO:tasks.workunit.client.0.smithi033.stdout:9/370: rmdir d4/d8/dd/d41/d51 39 2024-02-15T18:31:05.398 INFO:tasks.workunit.client.0.smithi033.stdout:9/371: write d4/d8/f67 [869943,33733] 0 2024-02-15T18:31:05.399 INFO:tasks.workunit.client.0.smithi033.stdout:4/492: getdents d4/d20/d13/d1b/d81/d9f 0 2024-02-15T18:31:05.399 INFO:tasks.workunit.client.0.smithi033.stdout:7/441: getdents d0/dc/d10/d1d/d2b/d5f 0 2024-02-15T18:31:05.401 INFO:tasks.workunit.client.0.smithi033.stdout:4/493: mknod d4/d20/d13/d1b/d81/d8b/ca9 0 2024-02-15T18:31:05.401 INFO:tasks.workunit.client.0.smithi033.stdout:7/442: mkdir d0/dc/d10/d7d/d93 0 2024-02-15T18:31:05.402 INFO:tasks.workunit.client.0.smithi033.stdout:3/403: dwrite d2/d3/df/f49 [0,4194304] 0 2024-02-15T18:31:05.402 INFO:tasks.workunit.client.0.smithi033.stdout:2/468: dwrite d20/d31/d47/d4c/f92 [0,4194304] 0 2024-02-15T18:31:05.403 INFO:tasks.workunit.client.0.smithi033.stdout:1/464: dwrite d5/d17/f5e [0,4194304] 0 2024-02-15T18:31:05.404 INFO:tasks.workunit.client.0.smithi033.stdout:4/494: rename d4/d20/d53/fa1 to d4/d5/d28/d39/d62/d9c/faa 0 2024-02-15T18:31:05.405 INFO:tasks.workunit.client.0.smithi033.stdout:7/443: symlink d0/dc/d10/d1d/d38/d74/d7f/l94 0 2024-02-15T18:31:05.408 INFO:tasks.workunit.client.0.smithi033.stdout:2/469: dread d20/d39/f5a [0,4194304] 0 2024-02-15T18:31:05.412 INFO:tasks.workunit.client.0.smithi033.stdout:5/521: dwrite d1/da/f1b [0,4194304] 0 2024-02-15T18:31:05.413 INFO:tasks.workunit.client.0.smithi033.stdout:8/352: dwrite d0/df/db/f23 [0,4194304] 0 2024-02-15T18:31:05.413 INFO:tasks.workunit.client.0.smithi033.stdout:8/353: write d0/d1c/f3e [8536913,49697] 0 2024-02-15T18:31:05.414 INFO:tasks.workunit.client.0.smithi033.stdout:8/354: write d0/d2/d35/f4f [692071,57550] 0 2024-02-15T18:31:05.414 INFO:tasks.workunit.client.0.smithi033.stdout:8/355: fdatasync d0/f5c 0 2024-02-15T18:31:05.414 INFO:tasks.workunit.client.0.smithi033.stdout:6/497: dwrite d8/d28/d36/f91 [4194304,4194304] 0 2024-02-15T18:31:05.414 INFO:tasks.workunit.client.0.smithi033.stdout:6/498: write d8/d28/d14/f43 [4239552,65716] 0 2024-02-15T18:31:05.415 INFO:tasks.workunit.client.0.smithi033.stdout:6/499: write d8/d1d/d37/f79 [6775385,50828] 0 2024-02-15T18:31:05.422 INFO:tasks.workunit.client.0.smithi033.stdout:3/404: creat d2/d3/d17/f79 x:0 0 0 2024-02-15T18:31:05.423 INFO:tasks.workunit.client.0.smithi033.stdout:9/372: truncate d4/d8/dd/d41/d51/f78 435593 0 2024-02-15T18:31:05.424 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:03.524095+0000 mgr.smithi131.buibla (mgr.24387) 21 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 669 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 33 MiB/s rd, 74 MiB/s wr, 881 op/s 2024-02-15T18:31:05.427 INFO:tasks.workunit.client.0.smithi033.stdout:1/465: mkdir d5/d9/d1e/d20/d5c/d8d 0 2024-02-15T18:31:05.428 INFO:tasks.workunit.client.0.smithi033.stdout:4/495: rename d4/d5/f25 to d4/d20/d13/d1b/d81/d9f/fab 0 2024-02-15T18:31:05.428 INFO:tasks.workunit.client.0.smithi033.stdout:4/496: write d4/d20/d13/d1b/d81/d9f/fab [2037470,9289] 0 2024-02-15T18:31:05.429 INFO:tasks.workunit.client.0.smithi033.stdout:5/522: link d1/da/d19/d3c/f70 d1/da/d19/d3c/d40/f9b 0 2024-02-15T18:31:05.430 INFO:tasks.workunit.client.0.smithi033.stdout:8/356: symlink d0/d2/d35/d29/l6d 0 2024-02-15T18:31:05.433 INFO:tasks.workunit.client.0.smithi033.stdout:2/470: dwrite d20/d30/f8d [0,4194304] 0 2024-02-15T18:31:05.433 INFO:tasks.workunit.client.0.smithi033.stdout:2/471: chown c1f 11103341 1 2024-02-15T18:31:05.443 INFO:tasks.workunit.client.0.smithi033.stdout:8/357: dwrite d0/df/db/f40 [0,4194304] 0 2024-02-15T18:31:05.444 INFO:tasks.workunit.client.0.smithi033.stdout:6/500: creat d8/d28/f9c x:0 0 0 2024-02-15T18:31:05.451 INFO:tasks.workunit.client.0.smithi033.stdout:3/405: truncate d2/d14/d23/f3e 76714 0 2024-02-15T18:31:05.451 INFO:tasks.workunit.client.0.smithi033.stdout:1/466: truncate d5/d17/f31 1696422 0 2024-02-15T18:31:05.452 INFO:tasks.workunit.client.0.smithi033.stdout:3/406: read d2/f4 [643149,82508] 0 2024-02-15T18:31:05.452 INFO:tasks.workunit.client.0.smithi033.stdout:3/407: chown d2/d14/d23/l38 31 1 2024-02-15T18:31:05.453 INFO:tasks.workunit.client.0.smithi033.stdout:7/444: rename d0/dc/d84 to d0/dc/d10/d7d/d93/d95 0 2024-02-15T18:31:05.453 INFO:tasks.workunit.client.0.smithi033.stdout:7/445: write d0/dc/f65 [722370,81558] 0 2024-02-15T18:31:05.456 INFO:tasks.workunit.client.0.smithi033.stdout:4/497: creat d4/d20/d37/fac x:0 0 0 2024-02-15T18:31:05.457 INFO:tasks.workunit.client.0.smithi033.stdout:4/498: write d4/d20/d37/f8e [1200287,98209] 0 2024-02-15T18:31:05.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/523: symlink d1/da/d19/d3c/d40/l9c 0 2024-02-15T18:31:05.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/524: chown d1/da/d10/d2b/d42/d4c/f53 7292155 1 2024-02-15T18:31:05.459 INFO:tasks.workunit.client.0.smithi033.stdout:2/472: getdents d20/d39 0 2024-02-15T18:31:05.460 INFO:tasks.workunit.client.0.smithi033.stdout:2/473: write d20/d31/d6a/f81 [3559110,102351] 0 2024-02-15T18:31:05.460 INFO:tasks.workunit.client.0.smithi033.stdout:2/474: write d20/d3a/d4a/f67 [232253,67988] 0 2024-02-15T18:31:05.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/358: symlink d0/df/db/d1b/d4b/l6e 0 2024-02-15T18:31:05.462 INFO:tasks.workunit.client.0.smithi033.stdout:6/501: getdents d8/d28/d36 0 2024-02-15T18:31:05.464 INFO:tasks.workunit.client.0.smithi033.stdout:0/414: sync 2024-02-15T18:31:05.464 INFO:tasks.workunit.client.0.smithi033.stdout:0/415: write d0/d8/d15/d2d/d3f/d6f/f7f [368929,48155] 0 2024-02-15T18:31:05.465 INFO:tasks.workunit.client.0.smithi033.stdout:9/373: rename d4/d8/f67 to d4/d2c/f84 0 2024-02-15T18:31:05.465 INFO:tasks.workunit.client.0.smithi033.stdout:4/499: chown d4/d20/d13/d1b/c2a 12552139 1 2024-02-15T18:31:05.467 INFO:tasks.workunit.client.0.smithi033.stdout:3/408: dwrite d2/d14/f55 [4194304,4194304] 0 2024-02-15T18:31:05.467 INFO:tasks.workunit.client.0.smithi033.stdout:3/409: chown d2/f1d 2846 1 2024-02-15T18:31:05.471 INFO:tasks.workunit.client.0.smithi033.stdout:5/525: unlink d1/da/d10/f60 0 2024-02-15T18:31:05.471 INFO:tasks.workunit.client.0.smithi033.stdout:5/526: chown d1/da/d10/d2b/d33/d63/c84 0 1 2024-02-15T18:31:05.471 INFO:tasks.workunit.client.0.smithi033.stdout:5/527: chown d1/da/d10/d2b/c7d 46621248 1 2024-02-15T18:31:05.473 INFO:tasks.workunit.client.0.smithi033.stdout:2/475: dread d20/d3a/d4a/d5e/f69 [0,4194304] 0 2024-02-15T18:31:05.473 INFO:tasks.workunit.client.0.smithi033.stdout:2/476: truncate d20/d31/d47/d82/fa9 190841 0 2024-02-15T18:31:05.473 INFO:tasks.workunit.client.0.smithi033.stdout:2/477: dread - d20/d31/d47/d4c/d6c/f7b zero size 2024-02-15T18:31:05.474 INFO:tasks.workunit.client.0.smithi033.stdout:1/467: dread d5/dd/d12/d49/d23/f7f [0,4194304] 0 2024-02-15T18:31:05.475 INFO:tasks.workunit.client.0.smithi033.stdout:1/468: chown d5/d9/l11 1407507 1 2024-02-15T18:31:05.475 INFO:tasks.workunit.client.0.smithi033.stdout:1/469: write d5/d9/d1e/f73 [854498,101199] 0 2024-02-15T18:31:05.475 INFO:tasks.workunit.client.0.smithi033.stdout:1/470: chown d5/d9/d1e/d20/d2c/d34/d51/f6f 405359 1 2024-02-15T18:31:05.475 INFO:tasks.workunit.client.0.smithi033.stdout:0/416: mkdir d0/d8/d15/d8b 0 2024-02-15T18:31:05.475 INFO:tasks.workunit.client.0.smithi033.stdout:7/446: dread d0/dc/d10/d48/f53 [0,4194304] 0 2024-02-15T18:31:05.475 INFO:tasks.workunit.client.0.smithi033.stdout:7/447: chown d0/dc/d10/d1d/d2b/l2e 62982251 1 2024-02-15T18:31:05.475 INFO:tasks.workunit.client.0.smithi033.stdout:7/448: chown d0/dc/d10 7 1 2024-02-15T18:31:05.475 INFO:tasks.workunit.client.0.smithi033.stdout:4/500: rename d4/c52 to d4/d20/d13/d1b/d81/d9f/cad 0 2024-02-15T18:31:05.476 INFO:tasks.workunit.client.0.smithi033.stdout:4/501: fdatasync d4/d20/f9 0 2024-02-15T18:31:05.477 INFO:tasks.workunit.client.0.smithi033.stdout:4/502: read d4/f22 [2042556,66532] 0 2024-02-15T18:31:05.477 INFO:tasks.workunit.client.0.smithi033.stdout:3/410: getdents d2/d20 0 2024-02-15T18:31:05.477 INFO:tasks.workunit.client.0.smithi033.stdout:1/471: creat d5/d9/d1e/d20/d2c/f8e x:0 0 0 2024-02-15T18:31:05.477 INFO:tasks.workunit.client.0.smithi033.stdout:1/472: fdatasync d5/d9/d1e/d20/d5c/d57/d82/f87 0 2024-02-15T18:31:05.480 INFO:tasks.workunit.client.0.smithi033.stdout:5/528: rename d1/da/d10/f8d to d1/da/d19/d3c/d40/d9a/f9d 0 2024-02-15T18:31:05.480 INFO:tasks.workunit.client.0.smithi033.stdout:5/529: readlink d1/da/d10/l29 0 2024-02-15T18:31:05.481 INFO:tasks.workunit.client.0.smithi033.stdout:6/502: unlink d8/d28/d14/d2c/d3b/d3d/l44 0 2024-02-15T18:31:05.481 INFO:tasks.workunit.client.0.smithi033.stdout:6/503: stat d8/d1d/d2a/d55/c58 0 2024-02-15T18:31:05.481 INFO:tasks.workunit.client.0.smithi033.stdout:7/449: dread d0/dc/d10/f78 [0,4194304] 0 2024-02-15T18:31:05.481 INFO:tasks.workunit.client.0.smithi033.stdout:4/503: stat d4/d5/c29 0 2024-02-15T18:31:05.482 INFO:tasks.workunit.client.0.smithi033.stdout:4/504: readlink d4/d20/d13/d1b/d81/d9f/la0 0 2024-02-15T18:31:05.484 INFO:tasks.workunit.client.0.smithi033.stdout:6/504: mknod d8/d28/d14/d2c/d31/d30/c9d 0 2024-02-15T18:31:05.484 INFO:tasks.workunit.client.0.smithi033.stdout:7/450: symlink d0/dc/d10/d1d/l96 0 2024-02-15T18:31:05.484 INFO:tasks.workunit.client.0.smithi033.stdout:5/530: getdents d1/da/d19/d3c 0 2024-02-15T18:31:05.487 INFO:tasks.workunit.client.0.smithi033.stdout:1/473: write d5/dd/d12/d49/f21 [196938,18217] 0 2024-02-15T18:31:05.487 INFO:tasks.workunit.client.0.smithi033.stdout:4/505: link d4/l57 d4/d5/lae 0 2024-02-15T18:31:05.488 INFO:tasks.workunit.client.0.smithi033.stdout:4/506: stat d4/d20/d37/f44 0 2024-02-15T18:31:05.488 INFO:tasks.workunit.client.0.smithi033.stdout:4/507: truncate d4/d20/d13/d1b/d7c/f95 910307 0 2024-02-15T18:31:05.488 INFO:tasks.workunit.client.0.smithi033.stdout:4/508: dread - d4/d20/d13/f94 zero size 2024-02-15T18:31:05.489 INFO:tasks.workunit.client.0.smithi033.stdout:0/417: dread d0/d8/fb [0,4194304] 0 2024-02-15T18:31:05.490 INFO:tasks.workunit.client.0.smithi033.stdout:1/474: creat d5/dd/d12/f8f x:0 0 0 2024-02-15T18:31:05.490 INFO:tasks.workunit.client.0.smithi033.stdout:6/505: creat d8/d1d/d2a/d55/d63/f9e x:0 0 0 2024-02-15T18:31:05.490 INFO:tasks.workunit.client.0.smithi033.stdout:6/506: chown d8/d28/l12 29874 1 2024-02-15T18:31:05.491 INFO:tasks.workunit.client.0.smithi033.stdout:4/509: creat d4/d3c/faf x:0 0 0 2024-02-15T18:31:05.492 INFO:tasks.workunit.client.0.smithi033.stdout:0/418: creat d0/d8/d15/d2d/f8c x:0 0 0 2024-02-15T18:31:05.492 INFO:tasks.workunit.client.0.smithi033.stdout:0/419: chown d0/d8/d15/d2d/d3f 498 1 2024-02-15T18:31:05.494 INFO:tasks.workunit.client.0.smithi033.stdout:1/475: creat d5/dd/d12/d49/f90 x:0 0 0 2024-02-15T18:31:05.494 INFO:tasks.workunit.client.0.smithi033.stdout:6/507: mknod d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/c9f 0 2024-02-15T18:31:05.495 INFO:tasks.workunit.client.0.smithi033.stdout:9/374: dwrite d4/d8/dd/d5c/d6d/f7b [0,4194304] 0 2024-02-15T18:31:05.495 INFO:tasks.workunit.client.0.smithi033.stdout:9/375: fsync d4/d8/d1b/d73/f7f 0 2024-02-15T18:31:05.496 INFO:tasks.workunit.client.0.smithi033.stdout:8/359: dwrite d0/d1c/f3b [0,4194304] 0 2024-02-15T18:31:05.496 INFO:tasks.workunit.client.0.smithi033.stdout:4/510: symlink d4/d20/d13/d1b/d7c/d91/lb0 0 2024-02-15T18:31:05.498 INFO:tasks.workunit.client.0.smithi033.stdout:2/478: dwrite d20/d3a/f75 [0,4194304] 0 2024-02-15T18:31:05.498 INFO:tasks.workunit.client.0.smithi033.stdout:6/508: mknod d8/d1d/ca0 0 2024-02-15T18:31:05.503 INFO:tasks.workunit.client.0.smithi033.stdout:9/376: creat d4/d8/dd/d5c/f85 x:0 0 0 2024-02-15T18:31:05.508 INFO:tasks.workunit.client.0.smithi033.stdout:9/377: creat d4/d8/d1b/d73/f86 x:0 0 0 2024-02-15T18:31:05.508 INFO:tasks.workunit.client.0.smithi033.stdout:9/378: write d4/d8/dd/d41/f4e [541763,29141] 0 2024-02-15T18:31:05.512 INFO:tasks.workunit.client.0.smithi033.stdout:9/379: getdents d4/d8/d1b/d2f 0 2024-02-15T18:31:05.512 INFO:tasks.workunit.client.0.smithi033.stdout:3/411: dwrite d2/d14/d23/f43 [0,4194304] 0 2024-02-15T18:31:05.514 INFO:tasks.workunit.client.0.smithi033.stdout:9/380: mknod d4/d8/dd/d28/c87 0 2024-02-15T18:31:05.515 INFO:tasks.workunit.client.0.smithi033.stdout:3/412: unlink d2/f11 0 2024-02-15T18:31:05.516 INFO:tasks.workunit.client.0.smithi033.stdout:4/511: dread d4/d5/f1e [0,4194304] 0 2024-02-15T18:31:05.516 INFO:tasks.workunit.client.0.smithi033.stdout:9/381: write d4/d8/fb [1010681,31596] 0 2024-02-15T18:31:05.516 INFO:tasks.workunit.client.0.smithi033.stdout:9/382: write d4/d8/dd/f3d [606973,126248] 0 2024-02-15T18:31:05.516 INFO:tasks.workunit.client.0.smithi033.stdout:3/413: link d2/d14/d23/d5c/d61/f63 d2/d3/df/f7a 0 2024-02-15T18:31:05.519 INFO:tasks.workunit.client.0.smithi033.stdout:4/512: unlink d4/d5/d28/d39/d62/d9c/faa 0 2024-02-15T18:31:05.519 INFO:tasks.workunit.client.0.smithi033.stdout:4/513: readlink d4/d20/d13/l41 0 2024-02-15T18:31:05.519 INFO:tasks.workunit.client.0.smithi033.stdout:9/383: symlink d4/d8/dd/d41/d51/l88 0 2024-02-15T18:31:05.520 INFO:tasks.workunit.client.0.smithi033.stdout:6/509: write d8/d28/f18 [3039067,30333] 0 2024-02-15T18:31:05.520 INFO:tasks.workunit.client.0.smithi033.stdout:4/514: mkdir d4/d5/d28/d39/d62/d9c/d9e/da4/db1 0 2024-02-15T18:31:05.520 INFO:tasks.workunit.client.0.smithi033.stdout:4/515: fdatasync d4/d20/d13/d5c/f71 0 2024-02-15T18:31:05.520 INFO:tasks.workunit.client.0.smithi033.stdout:4/516: dread - d4/d20/d13/d1b/f6a zero size 2024-02-15T18:31:05.520 INFO:tasks.workunit.client.0.smithi033.stdout:4/517: chown d4/d20/c93 330170 1 2024-02-15T18:31:05.521 INFO:tasks.workunit.client.0.smithi033.stdout:4/518: stat d4/d5/d28/d39/d62/d9c 0 2024-02-15T18:31:05.521 INFO:tasks.workunit.client.0.smithi033.stdout:9/384: creat d4/d8/dd/d41/d51/f89 x:0 0 0 2024-02-15T18:31:05.523 INFO:tasks.workunit.client.0.smithi033.stdout:6/510: dread d8/d28/f35 [0,4194304] 0 2024-02-15T18:31:05.524 INFO:tasks.workunit.client.0.smithi033.stdout:9/385: unlink d4/f5a 0 2024-02-15T18:31:05.526 INFO:tasks.workunit.client.0.smithi033.stdout:6/511: mkdir d8/d1d/d37/d72/da1 0 2024-02-15T18:31:05.526 INFO:tasks.workunit.client.0.smithi033.stdout:9/386: symlink d4/d8/d1b/d2f/d65/l8a 0 2024-02-15T18:31:05.528 INFO:tasks.workunit.client.0.smithi033.stdout:6/512: creat d8/d28/d14/d2c/d31/d5d/fa2 x:0 0 0 2024-02-15T18:31:05.528 INFO:tasks.workunit.client.0.smithi033.stdout:9/387: read d4/d2c/f84 [24594,2912] 0 2024-02-15T18:31:05.528 INFO:tasks.workunit.client.0.smithi033.stdout:6/513: write d8/d28/d14/d2c/d31/d5d/d8c/f95 [1199361,31978] 0 2024-02-15T18:31:05.529 INFO:tasks.workunit.client.0.smithi033.stdout:9/388: mkdir d4/d8/d1b/d2f/d65/d8b 0 2024-02-15T18:31:05.530 INFO:tasks.workunit.client.0.smithi033.stdout:6/514: chown d8/d28/d14/d2c/d3b/c78 80289273 1 2024-02-15T18:31:05.533 INFO:tasks.workunit.client.0.smithi033.stdout:6/515: unlink d8/d28/d14/d2c/d31/d5d/c82 0 2024-02-15T18:31:05.533 INFO:tasks.workunit.client.0.smithi033.stdout:2/479: dwrite d20/f3c [0,4194304] 0 2024-02-15T18:31:05.539 INFO:tasks.workunit.client.0.smithi033.stdout:0/420: dwrite d0/d8/f74 [0,4194304] 0 2024-02-15T18:31:05.539 INFO:tasks.workunit.client.0.smithi033.stdout:8/360: dwrite d0/d2/d35/f4f [0,4194304] 0 2024-02-15T18:31:05.539 INFO:tasks.workunit.client.0.smithi033.stdout:8/361: stat d0/d2/d14/l36 0 2024-02-15T18:31:05.539 INFO:tasks.workunit.client.0.smithi033.stdout:8/362: fsync d0/d1c/f3e 0 2024-02-15T18:31:05.540 INFO:tasks.workunit.client.0.smithi033.stdout:7/451: dwrite d0/f1c [0,4194304] 0 2024-02-15T18:31:05.548 INFO:tasks.workunit.client.0.smithi033.stdout:8/363: dread d0/df/f11 [0,4194304] 0 2024-02-15T18:31:05.549 INFO:tasks.workunit.client.0.smithi033.stdout:3/414: dwrite d2/d3/d1e/f4f [0,4194304] 0 2024-02-15T18:31:05.553 INFO:tasks.workunit.client.0.smithi033.stdout:0/421: mkdir d0/d8/d15/d2d/d3f/d8d 0 2024-02-15T18:31:05.553 INFO:tasks.workunit.client.0.smithi033.stdout:0/422: chown d0/f10 1 1 2024-02-15T18:31:05.554 INFO:tasks.workunit.client.0.smithi033.stdout:7/452: mknod d0/d56/d70/c97 0 2024-02-15T18:31:05.562 INFO:tasks.workunit.client.0.smithi033.stdout:4/519: dwrite d4/d20/f4e [0,4194304] 0 2024-02-15T18:31:05.567 INFO:tasks.workunit.client.0.smithi033.stdout:3/415: dread d2/d3/d1e/d22/d4d/f6b [0,4194304] 0 2024-02-15T18:31:05.567 INFO:tasks.workunit.client.0.smithi033.stdout:7/453: link d0/dc/d10/d1d/d38/d74/f77 d0/dc/d10/d1d/d38/d74/d7f/f98 0 2024-02-15T18:31:05.567 INFO:tasks.workunit.client.0.smithi033.stdout:7/454: stat d0/f33 0 2024-02-15T18:31:05.568 INFO:tasks.workunit.client.0.smithi033.stdout:3/416: fsync d2/d3/df/f49 0 2024-02-15T18:31:05.568 INFO:tasks.workunit.client.0.smithi033.stdout:3/417: fdatasync d2/d20/f6a 0 2024-02-15T18:31:05.569 INFO:tasks.workunit.client.0.smithi033.stdout:3/418: rename d2/d3/d1e/d22/d4d/f56 to d2/d3/d1e/d22/d4d/f7b 0 2024-02-15T18:31:05.574 INFO:tasks.workunit.client.0.smithi033.stdout:9/389: dwrite d4/d8/d1b/d73/f86 [0,4194304] 0 2024-02-15T18:31:05.580 INFO:tasks.workunit.client.0.smithi033.stdout:8/364: dwrite d0/fe [4194304,4194304] 0 2024-02-15T18:31:05.580 INFO:tasks.workunit.client.0.smithi033.stdout:2/480: dwrite d20/d31/d47/d4c/d6c/f7b [0,4194304] 0 2024-02-15T18:31:05.581 INFO:tasks.workunit.client.0.smithi033.stdout:0/423: dwrite d0/d8/d15/d2d/d2e/f63 [0,4194304] 0 2024-02-15T18:31:05.582 INFO:tasks.workunit.client.0.smithi033.stdout:6/516: dwrite d8/f90 [0,4194304] 0 2024-02-15T18:31:05.593 INFO:tasks.workunit.client.0.smithi033.stdout:8/365: mknod d0/df/db/d1b/c6f 0 2024-02-15T18:31:05.595 INFO:tasks.workunit.client.0.smithi033.stdout:2/481: creat d20/d3a/d4a/d5e/fb1 x:0 0 0 2024-02-15T18:31:05.597 INFO:tasks.workunit.client.0.smithi033.stdout:6/517: symlink d8/d1d/la3 0 2024-02-15T18:31:05.597 INFO:tasks.workunit.client.0.smithi033.stdout:6/518: write d8/d1d/d2a/d55/d63/f9e [534165,76390] 0 2024-02-15T18:31:05.598 INFO:tasks.workunit.client.0.smithi033.stdout:8/366: mknod d0/d2/d35/d29/d5f/c70 0 2024-02-15T18:31:05.603 INFO:tasks.workunit.client.0.smithi033.stdout:8/367: symlink d0/df/d53/l71 0 2024-02-15T18:31:05.605 INFO:tasks.workunit.client.0.smithi033.stdout:7/455: dwrite d0/dc/d10/d48/f51 [4194304,4194304] 0 2024-02-15T18:31:05.607 INFO:tasks.workunit.client.0.smithi033.stdout:7/456: mkdir d0/dc/d10/d7d/d99 0 2024-02-15T18:31:05.610 INFO:tasks.workunit.client.0.smithi033.stdout:2/482: dread d20/d31/d6a/f35 [0,4194304] 0 2024-02-15T18:31:05.610 INFO:tasks.workunit.client.0.smithi033.stdout:2/483: truncate d20/d3a/d4a/d5e/f76 182203 0 2024-02-15T18:31:05.610 INFO:tasks.workunit.client.0.smithi033.stdout:2/484: fsync d20/d30/f8d 0 2024-02-15T18:31:05.611 INFO:tasks.workunit.client.0.smithi033.stdout:2/485: creat d20/d3a/d4a/d5e/d6b/d88/da6/fb2 x:0 0 0 2024-02-15T18:31:05.614 INFO:tasks.workunit.client.0.smithi033.stdout:2/486: read d20/d31/d47/d4c/f63 [314047,126130] 0 2024-02-15T18:31:05.616 INFO:tasks.workunit.client.0.smithi033.stdout:3/419: dwrite d2/d3/d17/f69 [0,4194304] 0 2024-02-15T18:31:05.616 INFO:tasks.workunit.client.0.smithi033.stdout:3/420: fsync d2/d14/f42 0 2024-02-15T18:31:05.616 INFO:tasks.workunit.client.0.smithi033.stdout:2/487: creat d20/d3a/d4a/d5e/d6b/d88/fb3 x:0 0 0 2024-02-15T18:31:05.616 INFO:tasks.workunit.client.0.smithi033.stdout:6/519: dwrite d8/d28/d14/f34 [0,4194304] 0 2024-02-15T18:31:05.618 INFO:tasks.workunit.client.0.smithi033.stdout:9/390: dwrite d4/d8/f46 [0,4194304] 0 2024-02-15T18:31:05.618 INFO:tasks.workunit.client.0.smithi033.stdout:0/424: dwrite d0/d64/d3b/d6c/f68 [0,4194304] 0 2024-02-15T18:31:05.618 INFO:tasks.workunit.client.0.smithi033.stdout:0/425: write d0/d8/d15/d2d/f8c [448828,114888] 0 2024-02-15T18:31:05.621 INFO:tasks.workunit.client.0.smithi033.stdout:0/426: read d0/d8/d15/d4b/f71 [5236554,69327] 0 2024-02-15T18:31:05.622 INFO:tasks.workunit.client.0.smithi033.stdout:3/421: creat d2/d3/df/f7c x:0 0 0 2024-02-15T18:31:05.622 INFO:tasks.workunit.client.0.smithi033.stdout:3/422: dread - d2/d14/f2b zero size 2024-02-15T18:31:05.623 INFO:tasks.workunit.client.0.smithi033.stdout:2/488: creat d20/d31/fb4 x:0 0 0 2024-02-15T18:31:05.623 INFO:tasks.workunit.client.0.smithi033.stdout:2/489: chown d20/d3a/d4a/f52 309335898 1 2024-02-15T18:31:05.625 INFO:tasks.workunit.client.0.smithi033.stdout:6/520: rmdir d8/d28/d14/d2c/d31/d30 39 2024-02-15T18:31:05.627 INFO:tasks.workunit.client.0.smithi033.stdout:9/391: rename d4/d8/d1b/f1f to d4/d32/d6c/f8c 0 2024-02-15T18:31:05.630 INFO:tasks.workunit.client.0.smithi033.stdout:0/427: creat d0/d64/d3b/f8e x:0 0 0 2024-02-15T18:31:05.630 INFO:tasks.workunit.client.0.smithi033.stdout:3/423: symlink d2/d14/d23/d5c/d61/l7d 0 2024-02-15T18:31:05.630 INFO:tasks.workunit.client.0.smithi033.stdout:3/424: chown d2/d3/d1e 43 1 2024-02-15T18:31:05.632 INFO:tasks.workunit.client.0.smithi033.stdout:7/457: dwrite d0/f62 [0,4194304] 0 2024-02-15T18:31:05.636 INFO:tasks.workunit.client.0.smithi033.stdout:2/490: symlink d20/d31/d47/d64/lb5 0 2024-02-15T18:31:05.637 INFO:tasks.workunit.client.0.smithi033.stdout:6/521: creat d8/d28/d14/d2c/d31/d30/fa4 x:0 0 0 2024-02-15T18:31:05.638 INFO:tasks.workunit.client.0.smithi033.stdout:6/522: write d8/d28/f17 [2333597,109959] 0 2024-02-15T18:31:05.638 INFO:tasks.workunit.client.0.smithi033.stdout:0/428: creat d0/d8/d15/d2d/d2e/f8f x:0 0 0 2024-02-15T18:31:05.640 INFO:tasks.workunit.client.0.smithi033.stdout:0/429: dread d0/d8/d15/d2d/f8c [0,4194304] 0 2024-02-15T18:31:05.641 INFO:tasks.workunit.client.0.smithi033.stdout:3/425: mknod d2/d3/d1e/d22/d59/c7e 0 2024-02-15T18:31:05.642 INFO:tasks.workunit.client.0.smithi033.stdout:2/491: truncate f1 4800635 0 2024-02-15T18:31:05.642 INFO:tasks.workunit.client.0.smithi033.stdout:2/492: chown d20/d31/d47 5005 1 2024-02-15T18:31:05.642 INFO:tasks.workunit.client.0.smithi033.stdout:0/430: creat d0/d8/d54/f90 x:0 0 0 2024-02-15T18:31:05.644 INFO:tasks.workunit.client.0.smithi033.stdout:3/426: mkdir d2/d14/d23/d5c/d7f 0 2024-02-15T18:31:05.645 INFO:tasks.workunit.client.0.smithi033.stdout:0/431: mkdir d0/d8/d15/d2d/d41/d91 0 2024-02-15T18:31:05.646 INFO:tasks.workunit.client.0.smithi033.stdout:9/392: dwrite d4/d8/d1b/f5b [4194304,4194304] 0 2024-02-15T18:31:05.646 INFO:tasks.workunit.client.0.smithi033.stdout:9/393: truncate d4/d8/dd/d5c/f6a 4446340 0 2024-02-15T18:31:05.646 INFO:tasks.workunit.client.0.smithi033.stdout:9/394: dread - d4/d8/dd/f63 zero size 2024-02-15T18:31:05.646 INFO:tasks.workunit.client.0.smithi033.stdout:3/427: creat d2/d14/d23/d5c/f80 x:0 0 0 2024-02-15T18:31:05.647 INFO:tasks.workunit.client.0.smithi033.stdout:9/395: write d4/d8/dd/f15 [141385,53415] 0 2024-02-15T18:31:05.647 INFO:tasks.workunit.client.0.smithi033.stdout:9/396: fsync d4/d8/dd/d5c/f66 0 2024-02-15T18:31:05.652 INFO:tasks.workunit.client.0.smithi033.stdout:0/432: mknod d0/d64/d1d/c92 0 2024-02-15T18:31:05.653 INFO:tasks.workunit.client.0.smithi033.stdout:3/428: truncate d2/d3/d1e/d22/d4d/f7b 67361 0 2024-02-15T18:31:05.655 INFO:tasks.workunit.client.0.smithi033.stdout:0/433: link d0/d64/ff d0/d8/d15/d2d/d41/d73/f93 0 2024-02-15T18:31:05.656 INFO:tasks.workunit.client.0.smithi033.stdout:9/397: dread d4/d8/d1b/d2f/f30 [0,4194304] 0 2024-02-15T18:31:05.656 INFO:tasks.workunit.client.0.smithi033.stdout:3/429: mknod d2/d14/d23/d5c/d61/c81 0 2024-02-15T18:31:05.658 INFO:tasks.workunit.client.0.smithi033.stdout:0/434: write d0/d8/d15/d4b/f71 [7010177,85433] 0 2024-02-15T18:31:05.659 INFO:tasks.workunit.client.0.smithi033.stdout:0/435: mkdir d0/d8/d15/d5b/d94 0 2024-02-15T18:31:05.660 INFO:tasks.workunit.client.0.smithi033.stdout:0/436: mknod d0/d64/d3b/d6c/c95 0 2024-02-15T18:31:05.660 INFO:tasks.workunit.client.0.smithi033.stdout:0/437: stat d0/d8/d15/d4b 0 2024-02-15T18:31:05.660 INFO:tasks.workunit.client.0.smithi033.stdout:0/438: stat d0/d8/d15/l22 0 2024-02-15T18:31:05.661 INFO:tasks.workunit.client.0.smithi033.stdout:0/439: mkdir d0/d8/d15/d2d/d41/d73/d96 0 2024-02-15T18:31:05.663 INFO:tasks.workunit.client.0.smithi033.stdout:0/440: getdents d0/d8/d15 0 2024-02-15T18:31:05.663 INFO:tasks.workunit.client.0.smithi033.stdout:0/441: truncate d0/d64/f7b 154342 0 2024-02-15T18:31:05.663 INFO:tasks.workunit.client.0.smithi033.stdout:0/442: readlink d0/d8/le 0 2024-02-15T18:31:05.663 INFO:tasks.workunit.client.0.smithi033.stdout:6/523: dwrite d8/f4e [0,4194304] 0 2024-02-15T18:31:05.665 INFO:tasks.workunit.client.0.smithi033.stdout:2/493: dwrite d20/d31/d47/d4c/d6c/f87 [4194304,4194304] 0 2024-02-15T18:31:05.668 INFO:tasks.workunit.client.0.smithi033.stdout:0/443: mkdir d0/d8/d15/d2d/d3f/d97 0 2024-02-15T18:31:05.668 INFO:tasks.workunit.client.0.smithi033.stdout:6/524: mkdir d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/da5 0 2024-02-15T18:31:05.670 INFO:tasks.workunit.client.0.smithi033.stdout:2/494: getdents d20/d31/d47/d4c/d6c/d80 0 2024-02-15T18:31:05.671 INFO:tasks.workunit.client.0.smithi033.stdout:0/444: link d0/d2/f7 d0/d8/d15/d2d/d3f/f98 0 2024-02-15T18:31:05.674 INFO:tasks.workunit.client.0.smithi033.stdout:0/445: rename d0/l1 to d0/d8/d15/l99 0 2024-02-15T18:31:05.680 INFO:tasks.workunit.client.0.smithi033.stdout:9/398: dwrite d4/d8/dd/d5c/f6a [4194304,4194304] 0 2024-02-15T18:31:05.680 INFO:tasks.workunit.client.0.smithi033.stdout:3/430: dread d2/d3/d1e/f6e [0,4194304] 0 2024-02-15T18:31:05.684 INFO:tasks.workunit.client.0.smithi033.stdout:2/495: dread d20/d30/f8d [0,4194304] 0 2024-02-15T18:31:05.687 INFO:tasks.workunit.client.0.smithi033.stdout:3/431: rename d2/d3/d1e/f24 to d2/d3/df/f82 0 2024-02-15T18:31:05.688 INFO:tasks.workunit.client.0.smithi033.stdout:6/525: dread d8/d28/d14/d2c/f61 [0,4194304] 0 2024-02-15T18:31:05.690 INFO:tasks.workunit.client.0.smithi033.stdout:6/526: creat d8/d1d/fa6 x:0 0 0 2024-02-15T18:31:05.690 INFO:tasks.workunit.client.0.smithi033.stdout:2/496: write d20/d39/f48 [197398,63167] 0 2024-02-15T18:31:05.691 INFO:tasks.workunit.client.0.smithi033.stdout:9/399: dread d4/d8/d1b/d73/f86 [0,4194304] 0 2024-02-15T18:31:05.693 INFO:tasks.workunit.client.0.smithi033.stdout:2/497: mknod d20/d30/cb6 0 2024-02-15T18:31:05.694 INFO:tasks.workunit.client.0.smithi033.stdout:9/400: creat d4/d8/d1b/f8d x:0 0 0 2024-02-15T18:31:05.694 INFO:tasks.workunit.client.0.smithi033.stdout:6/527: write d8/d28/d36/f75 [1820243,110158] 0 2024-02-15T18:31:05.695 INFO:tasks.workunit.client.0.smithi033.stdout:9/401: creat d4/d8/d1b/d73/f8e x:0 0 0 2024-02-15T18:31:05.695 INFO:tasks.workunit.client.0.smithi033.stdout:2/498: mknod d20/d3a/cb7 0 2024-02-15T18:31:05.696 INFO:tasks.workunit.client.0.smithi033.stdout:0/446: dwrite d0/d8/d15/d4b/f71 [4194304,4194304] 0 2024-02-15T18:31:05.697 INFO:tasks.workunit.client.0.smithi033.stdout:9/402: creat d4/d8/dd/d28/f8f x:0 0 0 2024-02-15T18:31:05.697 INFO:tasks.workunit.client.0.smithi033.stdout:2/499: creat d20/d31/d47/d4c/d6c/d80/fb8 x:0 0 0 2024-02-15T18:31:05.702 INFO:tasks.workunit.client.0.smithi033.stdout:0/447: unlink d0/d64/d3b/d6c/c95 0 2024-02-15T18:31:05.702 INFO:tasks.workunit.client.0.smithi033.stdout:0/448: getdents d0/d8/d15/d5b/d94 0 2024-02-15T18:31:05.704 INFO:tasks.workunit.client.0.smithi033.stdout:9/403: creat d4/d8/d1b/d2f/d65/f90 x:0 0 0 2024-02-15T18:31:05.704 INFO:tasks.workunit.client.0.smithi033.stdout:9/404: stat d4/d8/dd/d41/l57 0 2024-02-15T18:31:05.704 INFO:tasks.workunit.client.0.smithi033.stdout:9/405: fdatasync d4/d8/d1b/d2f/f79 0 2024-02-15T18:31:05.705 INFO:tasks.workunit.client.0.smithi033.stdout:2/500: unlink d20/d30/l8c 0 2024-02-15T18:31:05.706 INFO:tasks.workunit.client.0.smithi033.stdout:9/406: creat d4/d32/d6c/f91 x:0 0 0 2024-02-15T18:31:05.706 INFO:tasks.workunit.client.0.smithi033.stdout:9/407: chown d4/d8/d1b/d2f/d65 331934 1 2024-02-15T18:31:05.706 INFO:tasks.workunit.client.0.smithi033.stdout:2/501: symlink d20/d73/lb9 0 2024-02-15T18:31:05.707 INFO:tasks.workunit.client.0.smithi033.stdout:9/408: stat d4/d8/c26 0 2024-02-15T18:31:05.707 INFO:tasks.workunit.client.0.smithi033.stdout:9/409: write d4/d8/dd/d41/d51/f69 [775842,45135] 0 2024-02-15T18:31:05.709 INFO:tasks.workunit.client.0.smithi033.stdout:2/502: unlink d20/d31/d47/d4c/d6c/fa8 0 2024-02-15T18:31:05.709 INFO:tasks.workunit.client.0.smithi033.stdout:9/410: creat d4/d8/d1b/d2f/f92 x:0 0 0 2024-02-15T18:31:05.710 INFO:tasks.workunit.client.0.smithi033.stdout:9/411: read d4/d8/dd/d41/d51/f69 [51911,85006] 0 2024-02-15T18:31:05.721 INFO:tasks.workunit.client.0.smithi033.stdout:6/528: dwrite d8/d28/d14/d2c/d31/d5d/fa2 [0,4194304] 0 2024-02-15T18:31:05.721 INFO:tasks.workunit.client.0.smithi033.stdout:6/529: fdatasync d8/d28/d36/f91 0 2024-02-15T18:31:05.722 INFO:tasks.workunit.client.0.smithi033.stdout:6/530: symlink d8/d1d/d2a/d57/la7 0 2024-02-15T18:31:05.723 INFO:tasks.workunit.client.0.smithi033.stdout:6/531: fsync f0 0 2024-02-15T18:31:05.723 INFO:tasks.workunit.client.0.smithi033.stdout:1/476: sync 2024-02-15T18:31:05.723 INFO:tasks.workunit.client.0.smithi033.stdout:4/520: sync 2024-02-15T18:31:05.723 INFO:tasks.workunit.client.0.smithi033.stdout:4/521: chown d4/l77 10074025 1 2024-02-15T18:31:05.723 INFO:tasks.workunit.client.0.smithi033.stdout:4/522: write d4/d20/f7a [362279,62102] 0 2024-02-15T18:31:05.724 INFO:tasks.workunit.client.0.smithi033.stdout:6/532: unlink d8/d28/d36/f75 0 2024-02-15T18:31:05.725 INFO:tasks.workunit.client.0.smithi033.stdout:1/477: mknod d5/d9/d1e/d20/d2c/d34/d51/d63/c91 0 2024-02-15T18:31:05.726 INFO:tasks.workunit.client.0.smithi033.stdout:4/523: mkdir d4/d5/d28/d39/d62/db2 0 2024-02-15T18:31:05.729 INFO:tasks.workunit.client.0.smithi033.stdout:1/478: truncate d5/d9/d1e/d20/d2c/d34/d51/f83 131229 0 2024-02-15T18:31:05.729 INFO:tasks.workunit.client.0.smithi033.stdout:6/533: rename d8/d28/d14/d2c/d3b/f49 to d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/da5/fa8 0 2024-02-15T18:31:05.729 INFO:tasks.workunit.client.0.smithi033.stdout:1/479: readlink d5/d9/d1e/d20/d2c/d34/l42 0 2024-02-15T18:31:05.731 INFO:tasks.workunit.client.0.smithi033.stdout:1/480: link d5/d9/d1e/d20/f50 d5/d9/f92 0 2024-02-15T18:31:05.733 INFO:tasks.workunit.client.0.smithi033.stdout:1/481: mkdir d5/dd/d12/d49/d93 0 2024-02-15T18:31:05.733 INFO:tasks.workunit.client.0.smithi033.stdout:5/531: sync 2024-02-15T18:31:05.733 INFO:tasks.workunit.client.0.smithi033.stdout:5/532: fsync d1/da/d10/d2b/f86 0 2024-02-15T18:31:05.734 INFO:tasks.workunit.client.0.smithi033.stdout:6/534: dread d8/d1d/d2a/f56 [0,4194304] 0 2024-02-15T18:31:05.734 INFO:tasks.workunit.client.0.smithi033.stdout:1/482: unlink d5/d9/d1e/d20/d5c/d57/d59/l5f 0 2024-02-15T18:31:05.735 INFO:tasks.workunit.client.0.smithi033.stdout:5/533: creat d1/da/d52/f9e x:0 0 0 2024-02-15T18:31:05.735 INFO:tasks.workunit.client.0.smithi033.stdout:6/535: mknod d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/ca9 0 2024-02-15T18:31:05.737 INFO:tasks.workunit.client.0.smithi033.stdout:1/483: rename d5/dd/d12/d49/f4e to d5/d9/d1e/f94 0 2024-02-15T18:31:05.737 INFO:tasks.workunit.client.0.smithi033.stdout:1/484: chown d5/dd/d12/d49/f21 380129331 1 2024-02-15T18:31:05.738 INFO:tasks.workunit.client.0.smithi033.stdout:5/534: truncate d1/da/fb 4067266 0 2024-02-15T18:31:05.739 INFO:tasks.workunit.client.0.smithi033.stdout:6/536: link d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/l64 d8/d28/d14/d2c/d31/d30/d29/d38/d54/laa 0 2024-02-15T18:31:05.739 INFO:tasks.workunit.client.0.smithi033.stdout:6/537: fsync d8/f90 0 2024-02-15T18:31:05.740 INFO:tasks.workunit.client.0.smithi033.stdout:1/485: creat d5/d9/d1e/d20/d5c/d57/d82/f95 x:0 0 0 2024-02-15T18:31:05.740 INFO:tasks.workunit.client.0.smithi033.stdout:1/486: chown d5/dd/d12/d49/f4a 570360892 1 2024-02-15T18:31:05.741 INFO:tasks.workunit.client.0.smithi033.stdout:2/503: dwrite d20/d31/d6a/f35 [4194304,4194304] 0 2024-02-15T18:31:05.741 INFO:tasks.workunit.client.0.smithi033.stdout:2/504: readlink d20/l50 0 2024-02-15T18:31:05.741 INFO:tasks.workunit.client.0.smithi033.stdout:2/505: write d20/d73/fac [83741,86437] 0 2024-02-15T18:31:05.741 INFO:tasks.workunit.client.0.smithi033.stdout:5/535: rename d1/da/d11/f2d to d1/da/d19/d3c/d40/f9f 0 2024-02-15T18:31:05.742 INFO:tasks.workunit.client.0.smithi033.stdout:1/487: mkdir d5/d96 0 2024-02-15T18:31:05.743 INFO:tasks.workunit.client.0.smithi033.stdout:0/449: dwrite d0/d2/f7 [0,4194304] 0 2024-02-15T18:31:05.743 INFO:tasks.workunit.client.0.smithi033.stdout:0/450: fsync d0/d2/f82 0 2024-02-15T18:31:05.744 INFO:tasks.workunit.client.0.smithi033.stdout:9/412: dwrite d4/d8/dd/f13 [0,4194304] 0 2024-02-15T18:31:05.744 INFO:tasks.workunit.client.0.smithi033.stdout:2/506: write f1 [1830614,121775] 0 2024-02-15T18:31:05.744 INFO:tasks.workunit.client.0.smithi033.stdout:4/524: dwrite d4/d5/d28/f36 [0,4194304] 0 2024-02-15T18:31:05.744 INFO:tasks.workunit.client.0.smithi033.stdout:1/488: rmdir d5/d17 39 2024-02-15T18:31:05.745 INFO:tasks.workunit.client.0.smithi033.stdout:5/536: write d1/f14 [901764,7392] 0 2024-02-15T18:31:05.745 INFO:tasks.workunit.client.0.smithi033.stdout:5/537: fdatasync d1/da/d10/d2b/d33/f7b 0 2024-02-15T18:31:05.745 INFO:tasks.workunit.client.0.smithi033.stdout:5/538: chown d1/da/d11 56 1 2024-02-15T18:31:05.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:03.524095+0000 mgr.smithi131.buibla (mgr.24387) 21 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 669 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 33 MiB/s rd, 74 MiB/s wr, 881 op/s 2024-02-15T18:31:05.756 INFO:tasks.workunit.client.0.smithi033.stdout:5/539: dread d1/da/d19/f3e [0,4194304] 0 2024-02-15T18:31:05.756 INFO:tasks.workunit.client.0.smithi033.stdout:5/540: chown d1/da/d11/f49 1295418 1 2024-02-15T18:31:05.756 INFO:tasks.workunit.client.0.smithi033.stdout:5/541: read - d1/da/f41 zero size 2024-02-15T18:31:05.758 INFO:tasks.workunit.client.0.smithi033.stdout:6/538: dwrite d8/d28/d14/f34 [4194304,4194304] 0 2024-02-15T18:31:05.763 INFO:tasks.workunit.client.0.smithi033.stdout:0/451: mkdir d0/d8/d15/d9a 0 2024-02-15T18:31:05.764 INFO:tasks.workunit.client.0.smithi033.stdout:9/413: rmdir d4/d32/d6c 39 2024-02-15T18:31:05.765 INFO:tasks.workunit.client.0.smithi033.stdout:2/507: mknod d20/d3a/d4a/d5e/d6b/d88/cba 0 2024-02-15T18:31:05.766 INFO:tasks.workunit.client.0.smithi033.stdout:4/525: getdents d4 0 2024-02-15T18:31:05.768 INFO:tasks.workunit.client.0.smithi033.stdout:1/489: getdents d5/d9/d1e/d20/d2c/d65 0 2024-02-15T18:31:05.773 INFO:tasks.workunit.client.0.smithi033.stdout:0/452: unlink d0/d64/d3b/d6c/l4c 0 2024-02-15T18:31:05.774 INFO:tasks.workunit.client.0.smithi033.stdout:9/414: symlink d4/d8/d1b/d61/l93 0 2024-02-15T18:31:05.774 INFO:tasks.workunit.client.0.smithi033.stdout:9/415: fdatasync d4/d8/dd/d5c/d6d/f7b 0 2024-02-15T18:31:05.774 INFO:tasks.workunit.client.0.smithi033.stdout:2/508: read d20/d31/d47/d82/fa9 [111440,78438] 0 2024-02-15T18:31:05.776 INFO:tasks.workunit.client.0.smithi033.stdout:4/526: creat d4/fb3 x:0 0 0 2024-02-15T18:31:05.778 INFO:tasks.workunit.client.0.smithi033.stdout:6/539: dwrite d8/d1d/f1b [0,4194304] 0 2024-02-15T18:31:05.779 INFO:tasks.workunit.client.0.smithi033.stdout:4/527: fdatasync d4/d20/d53/f61 0 2024-02-15T18:31:05.780 INFO:tasks.workunit.client.0.smithi033.stdout:9/416: dread d4/d8/dd/f3d [0,4194304] 0 2024-02-15T18:31:05.781 INFO:tasks.workunit.client.0.smithi033.stdout:0/453: mkdir d0/d8/d15/d4b/d58/d80/d9b 0 2024-02-15T18:31:05.781 INFO:tasks.workunit.client.0.smithi033.stdout:0/454: truncate d0/d8/d15/d2d/d3f/f55 582444 0 2024-02-15T18:31:05.781 INFO:tasks.workunit.client.0.smithi033.stdout:4/528: fdatasync d4/f54 0 2024-02-15T18:31:05.782 INFO:tasks.workunit.client.0.smithi033.stdout:9/417: symlink d4/d2c/l94 0 2024-02-15T18:31:05.783 INFO:tasks.workunit.client.0.smithi033.stdout:0/455: creat d0/d8/d15/d4b/d59/f9c x:0 0 0 2024-02-15T18:31:05.784 INFO:tasks.workunit.client.0.smithi033.stdout:4/529: rmdir d4/d20/d13/d5c 39 2024-02-15T18:31:05.785 INFO:tasks.workunit.client.0.smithi033.stdout:9/418: mkdir d4/d8/d1b/d2f/d65/d8b/d95 0 2024-02-15T18:31:05.787 INFO:tasks.workunit.client.0.smithi033.stdout:0/456: rename d0/d8/d54/l86 to d0/d8/d15/d7c/l9d 0 2024-02-15T18:31:05.787 INFO:tasks.workunit.client.0.smithi033.stdout:0/457: write d0/d2/f75 [671127,50619] 0 2024-02-15T18:31:05.788 INFO:tasks.workunit.client.0.smithi033.stdout:0/458: dread - d0/d8/d54/f90 zero size 2024-02-15T18:31:05.789 INFO:tasks.workunit.client.0.smithi033.stdout:2/509: dwrite d20/d30/f44 [0,4194304] 0 2024-02-15T18:31:05.789 INFO:tasks.workunit.client.0.smithi033.stdout:2/510: chown d20/d73/fac 154902 1 2024-02-15T18:31:05.791 INFO:tasks.workunit.client.0.smithi033.stdout:1/490: dwrite d5/d9/d1e/d20/d5c/d57/d82/f87 [0,4194304] 0 2024-02-15T18:31:05.791 INFO:tasks.workunit.client.0.smithi033.stdout:1/491: write d5/d9/d1e/d20/d2c/d65/f75 [79053,71043] 0 2024-02-15T18:31:05.795 INFO:tasks.workunit.client.0.smithi033.stdout:8/368: sync 2024-02-15T18:31:05.798 INFO:tasks.workunit.client.0.smithi033.stdout:4/530: rename d4/d5/d28/c5d to d4/d5/d28/d39/d62/d9c/d9e/da4/db1/cb4 0 2024-02-15T18:31:05.802 INFO:tasks.workunit.client.0.smithi033.stdout:9/419: symlink d4/d8/dd/l96 0 2024-02-15T18:31:05.802 INFO:tasks.workunit.client.0.smithi033.stdout:9/420: dread - d4/d8/d1b/d2f/f92 zero size 2024-02-15T18:31:05.802 INFO:tasks.workunit.client.0.smithi033.stdout:0/459: rmdir d0 39 2024-02-15T18:31:05.804 INFO:tasks.workunit.client.0.smithi033.stdout:2/511: truncate d20/d3a/d4a/d5e/f61 4019722 0 2024-02-15T18:31:05.806 INFO:tasks.workunit.client.0.smithi033.stdout:8/369: mkdir d0/df/db/d1b/d4b/d72 0 2024-02-15T18:31:05.806 INFO:tasks.workunit.client.0.smithi033.stdout:8/370: write d0/d2/d14/d56/d59/f6c [346979,50276] 0 2024-02-15T18:31:05.807 INFO:tasks.workunit.client.0.smithi033.stdout:0/460: mkdir d0/d8/d15/d7c/d9e 0 2024-02-15T18:31:05.809 INFO:tasks.workunit.client.0.smithi033.stdout:2/512: creat d20/d31/d47/d4c/d6c/d80/da5/fbb x:0 0 0 2024-02-15T18:31:05.810 INFO:tasks.workunit.client.0.smithi033.stdout:1/492: dwrite d5/d9/d1e/d20/d5c/f39 [4194304,4194304] 0 2024-02-15T18:31:05.811 INFO:tasks.workunit.client.0.smithi033.stdout:8/371: creat d0/d2/d35/d29/f73 x:0 0 0 2024-02-15T18:31:05.811 INFO:tasks.workunit.client.0.smithi033.stdout:8/372: write d0/df/db/d1b/f6a [690436,108618] 0 2024-02-15T18:31:05.813 INFO:tasks.workunit.client.0.smithi033.stdout:0/461: mkdir d0/d8/d15/d9f 0 2024-02-15T18:31:05.817 INFO:tasks.workunit.client.0.smithi033.stdout:2/513: symlink d20/d31/d47/d4c/d6c/d80/lbc 0 2024-02-15T18:31:05.817 INFO:tasks.workunit.client.0.smithi033.stdout:1/493: getdents d5/d9/d1e/d20/d5c/d57 0 2024-02-15T18:31:05.821 INFO:tasks.workunit.client.0.smithi033.stdout:1/494: creat d5/d9/f97 x:0 0 0 2024-02-15T18:31:05.822 INFO:tasks.workunit.client.0.smithi033.stdout:4/531: dread d4/d5/f24 [0,4194304] 0 2024-02-15T18:31:05.836 INFO:tasks.workunit.client.0.smithi033.stdout:2/514: dread f5 [0,4194304] 0 2024-02-15T18:31:05.862 INFO:tasks.workunit.client.0.smithi033.stdout:8/373: dwrite d0/df/db/d1b/d4b/f4c [0,4194304] 0 2024-02-15T18:31:05.863 INFO:tasks.workunit.client.0.smithi033.stdout:8/374: write d0/df/f38 [372397,116478] 0 2024-02-15T18:31:05.864 INFO:tasks.workunit.client.0.smithi033.stdout:4/532: dwrite d4/f67 [0,4194304] 0 2024-02-15T18:31:05.864 INFO:tasks.workunit.client.0.smithi033.stdout:0/462: dwrite d0/f13 [0,4194304] 0 2024-02-15T18:31:05.864 INFO:tasks.workunit.client.0.smithi033.stdout:0/463: write d0/d8/d15/d4b/d58/d77/f7d [932661,65198] 0 2024-02-15T18:31:05.865 INFO:tasks.workunit.client.0.smithi033.stdout:9/421: dwrite d4/d32/f54 [0,4194304] 0 2024-02-15T18:31:05.866 INFO:tasks.workunit.client.0.smithi033.stdout:2/515: dwrite d20/d31/d47/f6d [0,4194304] 0 2024-02-15T18:31:05.866 INFO:tasks.workunit.client.0.smithi033.stdout:2/516: chown d20/d31/d6a/f72 10696 1 2024-02-15T18:31:05.866 INFO:tasks.workunit.client.0.smithi033.stdout:4/533: mkdir d4/d5/d28/d39/d62/db2/db5 0 2024-02-15T18:31:05.867 INFO:tasks.workunit.client.0.smithi033.stdout:2/517: write d20/d31/d47/d4c/f63 [2800872,61100] 0 2024-02-15T18:31:05.869 INFO:tasks.workunit.client.0.smithi033.stdout:0/464: creat d0/d8/d15/d7c/fa0 x:0 0 0 2024-02-15T18:31:05.869 INFO:tasks.workunit.client.0.smithi033.stdout:1/495: getdents d5/d9 0 2024-02-15T18:31:05.870 INFO:tasks.workunit.client.0.smithi033.stdout:0/465: write d0/f4 [495558,25971] 0 2024-02-15T18:31:05.874 INFO:tasks.workunit.client.0.smithi033.stdout:9/422: rmdir d4/d8/d1b/d2f/d65/d8b 39 2024-02-15T18:31:05.875 INFO:tasks.workunit.client.0.smithi033.stdout:9/423: read d4/d2c/f40 [7636044,87138] 0 2024-02-15T18:31:05.875 INFO:tasks.workunit.client.0.smithi033.stdout:9/424: write d4/f45 [5099236,25971] 0 2024-02-15T18:31:05.876 INFO:tasks.workunit.client.0.smithi033.stdout:4/534: unlink d4/d20/d13/d34/l8c 0 2024-02-15T18:31:05.877 INFO:tasks.workunit.client.0.smithi033.stdout:2/518: rmdir d20/d31/d47 39 2024-02-15T18:31:05.878 INFO:tasks.workunit.client.0.smithi033.stdout:2/519: write d20/d31/d47/d4c/d6c/d80/f85 [2341488,13178] 0 2024-02-15T18:31:05.881 INFO:tasks.workunit.client.0.smithi033.stdout:1/496: symlink d5/d9/d1e/d20/d5c/d57/d59/l98 0 2024-02-15T18:31:05.883 INFO:tasks.workunit.client.0.smithi033.stdout:9/425: mkdir d4/d8/dd/d5c/d6d/d97 0 2024-02-15T18:31:05.884 INFO:tasks.workunit.client.0.smithi033.stdout:4/535: creat d4/d20/d13/d34/d82/fb6 x:0 0 0 2024-02-15T18:31:05.885 INFO:tasks.workunit.client.0.smithi033.stdout:4/536: write d4/d20/f11 [810398,17594] 0 2024-02-15T18:31:05.888 INFO:tasks.workunit.client.0.smithi033.stdout:2/520: mknod d20/d31/d47/d4c/cbd 0 2024-02-15T18:31:05.888 INFO:tasks.workunit.client.0.smithi033.stdout:1/497: rmdir d5/d9/d1e/d20/d5c/d57 39 2024-02-15T18:31:05.888 INFO:tasks.workunit.client.0.smithi033.stdout:0/466: truncate d0/d64/d3b/d6c/f46 4374028 0 2024-02-15T18:31:05.888 INFO:tasks.workunit.client.0.smithi033.stdout:0/467: write d0/d8/d15/d2d/d2e/f65 [525577,116003] 0 2024-02-15T18:31:05.890 INFO:tasks.workunit.client.0.smithi033.stdout:1/498: unlink d5/d9/d1e/d20/d5c/d57/f7a 0 2024-02-15T18:31:05.890 INFO:tasks.workunit.client.0.smithi033.stdout:1/499: write d5/d9/f77 [262070,80033] 0 2024-02-15T18:31:05.890 INFO:tasks.workunit.client.0.smithi033.stdout:1/500: fsync d5/dd/f3b 0 2024-02-15T18:31:05.891 INFO:tasks.workunit.client.0.smithi033.stdout:2/521: creat d20/d31/d47/d4c/d6c/d80/da5/fbe x:0 0 0 2024-02-15T18:31:05.894 INFO:tasks.workunit.client.0.smithi033.stdout:0/468: mknod d0/d8/d15/d2d/d41/d79/ca1 0 2024-02-15T18:31:05.895 INFO:tasks.workunit.client.0.smithi033.stdout:0/469: stat d0/d8/d15/d4b/d59 0 2024-02-15T18:31:05.895 INFO:tasks.workunit.client.0.smithi033.stdout:2/522: dread d20/d3a/d4a/d5e/f76 [0,4194304] 0 2024-02-15T18:31:05.896 INFO:tasks.workunit.client.0.smithi033.stdout:2/523: chown d20/d31/d47/d4c/f60 1136 1 2024-02-15T18:31:05.896 INFO:tasks.workunit.client.0.smithi033.stdout:2/524: write d20/f77 [882507,122268] 0 2024-02-15T18:31:05.896 INFO:tasks.workunit.client.0.smithi033.stdout:0/470: symlink d0/d8/d15/d7c/d9e/la2 0 2024-02-15T18:31:05.897 INFO:tasks.workunit.client.0.smithi033.stdout:2/525: creat d20/d31/d47/d64/fbf x:0 0 0 2024-02-15T18:31:05.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/537: dread d4/d20/d13/f31 [0,4194304] 0 2024-02-15T18:31:05.898 INFO:tasks.workunit.client.0.smithi033.stdout:4/538: write d4/d20/f27 [4919040,65557] 0 2024-02-15T18:31:05.899 INFO:tasks.workunit.client.0.smithi033.stdout:2/526: rmdir d20/d3a/d4a/d5e/d6b/d83 39 2024-02-15T18:31:05.901 INFO:tasks.workunit.client.0.smithi033.stdout:4/539: rmdir d4/d5/d28/d39/d62/db2 39 2024-02-15T18:31:05.903 INFO:tasks.workunit.client.0.smithi033.stdout:2/527: creat d20/d3a/fc0 x:0 0 0 2024-02-15T18:31:05.903 INFO:tasks.workunit.client.0.smithi033.stdout:2/528: fdatasync d20/d31/d6a/f3e 0 2024-02-15T18:31:05.903 INFO:tasks.workunit.client.0.smithi033.stdout:9/426: dwrite d4/d8/dd/d41/d51/f78 [0,4194304] 0 2024-02-15T18:31:05.903 INFO:tasks.workunit.client.0.smithi033.stdout:3/432: sync 2024-02-15T18:31:05.903 INFO:tasks.workunit.client.0.smithi033.stdout:7/458: sync 2024-02-15T18:31:05.903 INFO:tasks.workunit.client.0.smithi033.stdout:5/542: sync 2024-02-15T18:31:05.904 INFO:tasks.workunit.client.0.smithi033.stdout:4/540: rename d4/d20/f4e to d4/d5/d28/d39/d62/d9c/fb7 0 2024-02-15T18:31:05.905 INFO:tasks.workunit.client.0.smithi033.stdout:4/541: write d4/d5/f1e [4220195,105929] 0 2024-02-15T18:31:05.905 INFO:tasks.workunit.client.0.smithi033.stdout:4/542: readlink d4/d20/d13/d5c/d87/la8 0 2024-02-15T18:31:05.905 INFO:tasks.workunit.client.0.smithi033.stdout:4/543: fsync d4/d5/d28/d39/d62/f98 0 2024-02-15T18:31:05.905 INFO:tasks.workunit.client.0.smithi033.stdout:9/427: symlink d4/d8/dd/d28/d6b/l98 0 2024-02-15T18:31:05.908 INFO:tasks.workunit.client.0.smithi033.stdout:3/433: mkdir d2/d14/d23/d68/d73/d83 0 2024-02-15T18:31:05.908 INFO:tasks.workunit.client.0.smithi033.stdout:3/434: stat d2/d3/df/l4a 0 2024-02-15T18:31:05.909 INFO:tasks.workunit.client.0.smithi033.stdout:7/459: dread d0/dc/d10/d1d/d2b/d5f/d63/f66 [0,4194304] 0 2024-02-15T18:31:05.909 INFO:tasks.workunit.client.0.smithi033.stdout:7/460: chown d0/dc/d10/d1d/d38/d74 1 1 2024-02-15T18:31:05.909 INFO:tasks.workunit.client.0.smithi033.stdout:9/428: mknod d4/d8/d1b/c99 0 2024-02-15T18:31:05.911 INFO:tasks.workunit.client.0.smithi033.stdout:5/543: dread d1/da/d10/f26 [0,4194304] 0 2024-02-15T18:31:05.912 INFO:tasks.workunit.client.0.smithi033.stdout:7/461: rename d0/dc/l7e to d0/dc/d10/d1d/d38/d74/d7f/l9a 0 2024-02-15T18:31:05.914 INFO:tasks.workunit.client.0.smithi033.stdout:9/429: symlink d4/d8/d1b/d2f/d65/d8b/l9a 0 2024-02-15T18:31:05.914 INFO:tasks.workunit.client.0.smithi033.stdout:7/462: creat d0/dc/d10/d1d/d38/d74/d7f/f9b x:0 0 0 2024-02-15T18:31:05.916 INFO:tasks.workunit.client.0.smithi033.stdout:5/544: rename d1/f14 to d1/da/d10/d2b/d42/d4c/fa0 0 2024-02-15T18:31:05.917 INFO:tasks.workunit.client.0.smithi033.stdout:9/430: unlink d4/d8/dd/c4d 0 2024-02-15T18:31:05.917 INFO:tasks.workunit.client.0.smithi033.stdout:7/463: creat d0/dc/d10/d48/d4b/f9c x:0 0 0 2024-02-15T18:31:05.919 INFO:tasks.workunit.client.0.smithi033.stdout:5/545: creat d1/da/d10/d2b/d33/fa1 x:0 0 0 2024-02-15T18:31:05.920 INFO:tasks.workunit.client.0.smithi033.stdout:9/431: creat d4/d8/dd/d5c/f9b x:0 0 0 2024-02-15T18:31:05.923 INFO:tasks.workunit.client.0.smithi033.stdout:9/432: rename d4/d8/dd/d41/d51/l88 to d4/d8/dd/d41/d51/l9c 0 2024-02-15T18:31:05.923 INFO:tasks.workunit.client.0.smithi033.stdout:9/433: fsync d4/d8/dd/d5c/f85 0 2024-02-15T18:31:05.923 INFO:tasks.workunit.client.0.smithi033.stdout:5/546: dread d1/da/d10/f26 [0,4194304] 0 2024-02-15T18:31:05.923 INFO:tasks.workunit.client.0.smithi033.stdout:7/464: write d0/dc/d10/d1d/d2b/d5f/f71 [3002218,76533] 0 2024-02-15T18:31:05.926 INFO:tasks.workunit.client.0.smithi033.stdout:9/434: link d4/d8/dd/d28/l35 d4/d32/d6c/l9d 0 2024-02-15T18:31:05.927 INFO:tasks.workunit.client.0.smithi033.stdout:5/547: creat d1/da/d11/fa2 x:0 0 0 2024-02-15T18:31:05.929 INFO:tasks.workunit.client.0.smithi033.stdout:5/548: mkdir d1/da/d10/d2b/d33/d63/d61/da3 0 2024-02-15T18:31:05.929 INFO:tasks.workunit.client.0.smithi033.stdout:5/549: readlink d1/da/d19/d3c/d40/l9c 0 2024-02-15T18:31:05.930 INFO:tasks.workunit.client.0.smithi033.stdout:5/550: creat d1/fa4 x:0 0 0 2024-02-15T18:31:05.930 INFO:tasks.workunit.client.0.smithi033.stdout:5/551: write d1/da/d11/d5e/f6c [1050801,68870] 0 2024-02-15T18:31:05.930 INFO:tasks.workunit.client.0.smithi033.stdout:5/552: dread - d1/da/d52/f99 zero size 2024-02-15T18:31:05.930 INFO:tasks.workunit.client.0.smithi033.stdout:1/501: dwrite d5/dd/d12/f1b [4194304,4194304] 0 2024-02-15T18:31:05.931 INFO:tasks.workunit.client.0.smithi033.stdout:5/553: symlink d1/da/la5 0 2024-02-15T18:31:05.931 INFO:tasks.workunit.client.0.smithi033.stdout:5/554: write d1/da/d19/d3f/d68/f96 [241155,25718] 0 2024-02-15T18:31:05.932 INFO:tasks.workunit.client.0.smithi033.stdout:5/555: write d1/da/f55 [986636,86974] 0 2024-02-15T18:31:05.932 INFO:tasks.workunit.client.0.smithi033.stdout:9/435: write d4/f45 [4577801,96238] 0 2024-02-15T18:31:05.932 INFO:tasks.workunit.client.0.smithi033.stdout:5/556: write d1/da/d11/f8f [938076,31938] 0 2024-02-15T18:31:05.933 INFO:tasks.workunit.client.0.smithi033.stdout:5/557: mkdir d1/da/d19/da6 0 2024-02-15T18:31:05.934 INFO:tasks.workunit.client.0.smithi033.stdout:9/436: dread d4/d8/d1b/d2f/f79 [0,4194304] 0 2024-02-15T18:31:05.934 INFO:tasks.workunit.client.0.smithi033.stdout:5/558: mknod d1/da/d19/d3c/ca7 0 2024-02-15T18:31:05.936 INFO:tasks.workunit.client.0.smithi033.stdout:9/437: unlink d4/d8/d1b/d2f/d65/d8b/l9a 0 2024-02-15T18:31:05.936 INFO:tasks.workunit.client.0.smithi033.stdout:9/438: write d4/d8/dd/d5c/f72 [4891456,48509] 0 2024-02-15T18:31:05.936 INFO:tasks.workunit.client.0.smithi033.stdout:9/439: creat d4/d8/d1b/d73/f9e x:0 0 0 2024-02-15T18:31:05.938 INFO:tasks.workunit.client.0.smithi033.stdout:4/544: dwrite d4/d5/d28/f36 [4194304,4194304] 0 2024-02-15T18:31:05.938 INFO:tasks.workunit.client.0.smithi033.stdout:9/440: mkdir d4/d9f 0 2024-02-15T18:31:05.941 INFO:tasks.workunit.client.0.smithi033.stdout:4/545: link d4/d20/d53/l7f d4/d20/d13/d1b/d81/lb8 0 2024-02-15T18:31:05.941 INFO:tasks.workunit.client.0.smithi033.stdout:2/529: dwrite f5 [0,4194304] 0 2024-02-15T18:31:05.942 INFO:tasks.workunit.client.0.smithi033.stdout:3/435: dwrite d2/d14/d23/f43 [0,4194304] 0 2024-02-15T18:31:05.942 INFO:tasks.workunit.client.0.smithi033.stdout:7/465: dwrite d0/dc/d10/d7d/d93/d95/f85 [0,4194304] 0 2024-02-15T18:31:05.942 INFO:tasks.workunit.client.0.smithi033.stdout:7/466: stat d0/dc/d10/d48/d4b/f54 0 2024-02-15T18:31:05.942 INFO:tasks.workunit.client.0.smithi033.stdout:3/436: write d2/d3/d17/f69 [4545509,37074] 0 2024-02-15T18:31:05.943 INFO:tasks.workunit.client.0.smithi033.stdout:9/441: link d4/d8/d1b/l2a d4/d9f/la0 0 2024-02-15T18:31:05.944 INFO:tasks.workunit.client.0.smithi033.stdout:1/502: dread d5/dd/d12/d49/f4a [0,4194304] 0 2024-02-15T18:31:05.959 INFO:tasks.workunit.client.0.smithi033.stdout:2/530: rmdir d20/d73 39 2024-02-15T18:31:05.961 INFO:tasks.workunit.client.0.smithi033.stdout:7/467: unlink d0/dc/d10/d1d/d2b/f5a 0 2024-02-15T18:31:05.963 INFO:tasks.workunit.client.0.smithi033.stdout:4/546: dwrite d4/d20/f9 [0,4194304] 0 2024-02-15T18:31:05.964 INFO:tasks.workunit.client.0.smithi033.stdout:3/437: unlink d2/f27 0 2024-02-15T18:31:05.964 INFO:tasks.workunit.client.0.smithi033.stdout:9/442: getdents d4/d8/d1b/d61 0 2024-02-15T18:31:05.964 INFO:tasks.workunit.client.0.smithi033.stdout:1/503: dread d5/d9/d1e/d20/d2c/f3c [0,4194304] 0 2024-02-15T18:31:05.964 INFO:tasks.workunit.client.0.smithi033.stdout:2/531: write d20/d31/d47/d4c/f63 [830460,25882] 0 2024-02-15T18:31:05.965 INFO:tasks.workunit.client.0.smithi033.stdout:7/468: stat d0/dc/d10/d7d/c47 0 2024-02-15T18:31:05.965 INFO:tasks.workunit.client.0.smithi033.stdout:3/438: getdents d2/d3/df/d6c 0 2024-02-15T18:31:05.970 INFO:tasks.workunit.client.0.smithi033.stdout:1/504: rmdir d5/dd/d12/d49 39 2024-02-15T18:31:05.970 INFO:tasks.workunit.client.0.smithi033.stdout:9/443: creat d4/d8/dd/d5c/fa1 x:0 0 0 2024-02-15T18:31:05.970 INFO:tasks.workunit.client.0.smithi033.stdout:1/505: chown d5/d9/d1e/d20/l4c 143 1 2024-02-15T18:31:05.970 INFO:tasks.workunit.client.0.smithi033.stdout:1/506: chown d5/d9/d1e/d20/d2c/d34/d51/d63/c6d 0 1 2024-02-15T18:31:05.971 INFO:tasks.workunit.client.0.smithi033.stdout:7/469: symlink d0/dc/d10/d7d/d93/d95/l9d 0 2024-02-15T18:31:05.971 INFO:tasks.workunit.client.0.smithi033.stdout:2/532: creat d20/d30/fc1 x:0 0 0 2024-02-15T18:31:05.971 INFO:tasks.workunit.client.0.smithi033.stdout:2/533: truncate d20/d3a/d4a/f67 1344323 0 2024-02-15T18:31:05.971 INFO:tasks.workunit.client.0.smithi033.stdout:5/559: dwrite d1/da/d19/f6d [0,4194304] 0 2024-02-15T18:31:05.971 INFO:tasks.workunit.client.0.smithi033.stdout:5/560: write d1/da/d19/d3c/f66 [4973193,69218] 0 2024-02-15T18:31:05.974 INFO:tasks.workunit.client.0.smithi033.stdout:1/507: creat d5/d38/f99 x:0 0 0 2024-02-15T18:31:05.974 INFO:tasks.workunit.client.0.smithi033.stdout:7/470: mkdir d0/d56/d70/d91/d9e 0 2024-02-15T18:31:05.974 INFO:tasks.workunit.client.0.smithi033.stdout:7/471: write d0/d56/d8e/f90 [248268,68074] 0 2024-02-15T18:31:05.975 INFO:tasks.workunit.client.0.smithi033.stdout:2/534: creat d20/d31/d47/d4c/d6c/d80/fc2 x:0 0 0 2024-02-15T18:31:05.979 INFO:tasks.workunit.client.0.smithi033.stdout:5/561: symlink d1/da/d88/la8 0 2024-02-15T18:31:05.979 INFO:tasks.workunit.client.0.smithi033.stdout:5/562: write d1/da/d10/f8c [612310,97952] 0 2024-02-15T18:31:05.979 INFO:tasks.workunit.client.0.smithi033.stdout:5/563: chown d1/da/d10 3243 1 2024-02-15T18:31:05.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/472: symlink d0/dc/d10/d1d/d38/l9f 0 2024-02-15T18:31:05.981 INFO:tasks.workunit.client.0.smithi033.stdout:5/564: creat d1/da/d19/d3f/fa9 x:0 0 0 2024-02-15T18:31:05.981 INFO:tasks.workunit.client.0.smithi033.stdout:5/565: fsync d1/da/d52/f9e 0 2024-02-15T18:31:05.984 INFO:tasks.workunit.client.0.smithi033.stdout:4/547: dwrite d4/d20/d37/fac [0,4194304] 0 2024-02-15T18:31:05.993 INFO:tasks.workunit.client.0.smithi033.stdout:9/444: dwrite d4/d8/d1b/d73/f7f [0,4194304] 0 2024-02-15T18:31:05.999 INFO:tasks.workunit.client.0.smithi033.stdout:3/439: dwrite d2/d3/df/d6c/f72 [0,4194304] 0 2024-02-15T18:31:06.011 INFO:tasks.workunit.client.0.smithi033.stdout:7/473: mknod d0/dc/d10/d7d/ca0 0 2024-02-15T18:31:06.011 INFO:tasks.workunit.client.0.smithi033.stdout:7/474: write d0/f1 [10449455,55593] 0 2024-02-15T18:31:06.012 INFO:tasks.workunit.client.0.smithi033.stdout:1/508: dwrite d5/d17/f31 [0,4194304] 0 2024-02-15T18:31:06.026 INFO:tasks.workunit.client.0.smithi033.stdout:9/445: dwrite d4/d8/dd/f39 [0,4194304] 0 2024-02-15T18:31:06.026 INFO:tasks.workunit.client.0.smithi033.stdout:2/535: dwrite d20/d31/d47/f6d [0,4194304] 0 2024-02-15T18:31:06.026 INFO:tasks.workunit.client.0.smithi033.stdout:2/536: write d20/f4b [4945479,8093] 0 2024-02-15T18:31:06.026 INFO:tasks.workunit.client.0.smithi033.stdout:5/566: creat d1/da/d19/da6/faa x:0 0 0 2024-02-15T18:31:06.026 INFO:tasks.workunit.client.0.smithi033.stdout:1/509: dread d5/dd/d12/f58 [0,4194304] 0 2024-02-15T18:31:06.035 INFO:tasks.workunit.client.0.smithi033.stdout:7/475: dwrite d0/dc/d10/d48/f51 [0,4194304] 0 2024-02-15T18:31:06.037 INFO:tasks.workunit.client.0.smithi033.stdout:1/510: dread d5/d9/ff [0,4194304] 0 2024-02-15T18:31:06.053 INFO:tasks.workunit.client.0.smithi033.stdout:7/476: dwrite d0/dc/d10/d1d/d38/d74/f87 [0,4194304] 0 2024-02-15T18:31:06.053 INFO:tasks.workunit.client.0.smithi033.stdout:7/477: fsync d0/fd 0 2024-02-15T18:31:06.063 INFO:tasks.workunit.client.0.smithi033.stdout:7/478: dread d0/dc/d10/d1d/d2b/f61 [0,4194304] 0 2024-02-15T18:31:06.063 INFO:tasks.workunit.client.0.smithi033.stdout:7/479: readlink d0/dc/d10/d1d/d38/d74/d7f/l94 0 2024-02-15T18:31:06.063 INFO:tasks.workunit.client.0.smithi033.stdout:7/480: chown d0/dc/d10/d1d/d2b/d5f/c67 4 1 2024-02-15T18:31:06.063 INFO:tasks.workunit.client.0.smithi033.stdout:7/481: write d0/dc/d10/d48/f6f [314304,28548] 0 2024-02-15T18:31:06.072 INFO:tasks.workunit.client.0.smithi033.stdout:4/548: write d4/d20/d37/fac [4956469,5542] 0 2024-02-15T18:31:06.090 INFO:tasks.workunit.client.0.smithi033.stdout:4/549: dwrite d4/d20/f27 [4194304,4194304] 0 2024-02-15T18:31:06.090 INFO:tasks.workunit.client.0.smithi033.stdout:4/550: chown d4/d20/d13/d34/f5a 207 1 2024-02-15T18:31:06.113 INFO:tasks.workunit.client.0.smithi033.stdout:3/440: getdents d2/d20 0 2024-02-15T18:31:06.115 INFO:tasks.workunit.client.0.smithi033.stdout:9/446: mknod d4/d8/d1b/d2f/d65/d8b/ca2 0 2024-02-15T18:31:06.115 INFO:tasks.workunit.client.0.smithi033.stdout:9/447: write d4/d8/dd/d28/f2b [5064134,20393] 0 2024-02-15T18:31:06.116 INFO:tasks.workunit.client.0.smithi033.stdout:9/448: write d4/d8/dd/d5c/d6d/f7b [230712,68363] 0 2024-02-15T18:31:06.117 INFO:tasks.workunit.client.0.smithi033.stdout:9/449: write d4/d8/dd/d28/f8f [91904,114052] 0 2024-02-15T18:31:06.117 INFO:tasks.workunit.client.0.smithi033.stdout:2/537: creat d20/d3a/d4a/d5e/d6b/fc3 x:0 0 0 2024-02-15T18:31:06.117 INFO:tasks.workunit.client.0.smithi033.stdout:2/538: stat d20/d3a/l45 0 2024-02-15T18:31:06.117 INFO:tasks.workunit.client.0.smithi033.stdout:2/539: write d20/d3a/f5d [387155,117271] 0 2024-02-15T18:31:06.117 INFO:tasks.workunit.client.0.smithi033.stdout:5/567: creat d1/da/d10/d2b/d33/d63/fab x:0 0 0 2024-02-15T18:31:06.118 INFO:tasks.workunit.client.0.smithi033.stdout:5/568: write d1/da/f37 [787967,65041] 0 2024-02-15T18:31:06.121 INFO:tasks.workunit.client.0.smithi033.stdout:7/482: mkdir d0/dc/d10/da1 0 2024-02-15T18:31:06.121 INFO:tasks.workunit.client.0.smithi033.stdout:7/483: write d0/dc/d10/d1d/d2b/d5f/d63/f79 [750562,128957] 0 2024-02-15T18:31:06.121 INFO:tasks.workunit.client.0.smithi033.stdout:7/484: readlink d0/dc/l7c 0 2024-02-15T18:31:06.121 INFO:tasks.workunit.client.0.smithi033.stdout:4/551: truncate d4/f46 228001 0 2024-02-15T18:31:06.122 INFO:tasks.workunit.client.0.smithi033.stdout:3/441: mknod d2/d14/d23/d68/d73/d76/c84 0 2024-02-15T18:31:06.126 INFO:tasks.workunit.client.0.smithi033.stdout:9/450: mknod d4/d8/d1b/d2f/d65/ca3 0 2024-02-15T18:31:06.127 INFO:tasks.workunit.client.0.smithi033.stdout:5/569: creat d1/da/d10/d2b/fac x:0 0 0 2024-02-15T18:31:06.127 INFO:tasks.workunit.client.0.smithi033.stdout:1/511: truncate d5/d17/f31 3208343 0 2024-02-15T18:31:06.128 INFO:tasks.workunit.client.0.smithi033.stdout:9/451: dread d4/d2c/f84 [0,4194304] 0 2024-02-15T18:31:06.128 INFO:tasks.workunit.client.0.smithi033.stdout:7/485: mkdir d0/dc/d10/d1d/d38/d74/d7f/da2 0 2024-02-15T18:31:06.129 INFO:tasks.workunit.client.0.smithi033.stdout:4/552: creat d4/d5/d28/d39/d62/db2/db5/fb9 x:0 0 0 2024-02-15T18:31:06.129 INFO:tasks.workunit.client.0.smithi033.stdout:4/553: read - d4/d20/d13/fa3 zero size 2024-02-15T18:31:06.130 INFO:tasks.workunit.client.0.smithi033.stdout:3/442: rename d2/d20/c60 to d2/d20/c85 0 2024-02-15T18:31:06.130 INFO:tasks.workunit.client.0.smithi033.stdout:3/443: read - d2/d14/d23/d5c/f80 zero size 2024-02-15T18:31:06.130 INFO:tasks.workunit.client.0.smithi033.stdout:2/540: dwrite d20/d31/d6a/f81 [4194304,4194304] 0 2024-02-15T18:31:06.131 INFO:tasks.workunit.client.0.smithi033.stdout:5/570: creat d1/da/d19/fad x:0 0 0 2024-02-15T18:31:06.131 INFO:tasks.workunit.client.0.smithi033.stdout:1/512: truncate d5/d9/ff 1067949 0 2024-02-15T18:31:06.132 INFO:tasks.workunit.client.0.smithi033.stdout:7/486: truncate d0/dc/d10/d1d/d2b/f61 1050878 0 2024-02-15T18:31:06.133 INFO:tasks.workunit.client.0.smithi033.stdout:4/554: rmdir d4/d5/d28/d39/d62/d9c/d9e/da4 39 2024-02-15T18:31:06.133 INFO:tasks.workunit.client.0.smithi033.stdout:4/555: dread - d4/d20/d13/fa3 zero size 2024-02-15T18:31:06.133 INFO:tasks.workunit.client.0.smithi033.stdout:4/556: write d4/d20/f3a [287019,15730] 0 2024-02-15T18:31:06.133 INFO:tasks.workunit.client.0.smithi033.stdout:4/557: write d4/d20/d13/f6e [5085516,82073] 0 2024-02-15T18:31:06.133 INFO:tasks.workunit.client.0.smithi033.stdout:4/558: readlink d4/d20/d53/l7f 0 2024-02-15T18:31:06.137 INFO:tasks.workunit.client.0.smithi033.stdout:3/444: link d2/d14/c70 d2/d14/d23/d5c/c86 0 2024-02-15T18:31:06.142 INFO:tasks.workunit.client.0.smithi033.stdout:8/375: sync 2024-02-15T18:31:06.142 INFO:tasks.workunit.client.0.smithi033.stdout:0/471: sync 2024-02-15T18:31:06.142 INFO:tasks.workunit.client.0.smithi033.stdout:0/472: write d0/d8/f42 [53200,87837] 0 2024-02-15T18:31:06.142 INFO:tasks.workunit.client.0.smithi033.stdout:2/541: mkdir d20/d31/d47/d4c/dc4 0 2024-02-15T18:31:06.142 INFO:tasks.workunit.client.0.smithi033.stdout:6/540: sync 2024-02-15T18:31:06.142 INFO:tasks.workunit.client.0.smithi033.stdout:6/541: truncate d8/d1d/f1b 5088343 0 2024-02-15T18:31:06.143 INFO:tasks.workunit.client.0.smithi033.stdout:4/559: dread d4/d20/d37/fac [0,4194304] 0 2024-02-15T18:31:06.143 INFO:tasks.workunit.client.0.smithi033.stdout:5/571: rename d1/da/d10/l29 to d1/da/d19/lae 0 2024-02-15T18:31:06.143 INFO:tasks.workunit.client.0.smithi033.stdout:5/572: stat d1/da/d11/c6a 0 2024-02-15T18:31:06.143 INFO:tasks.workunit.client.0.smithi033.stdout:5/573: dread - d1/da/d19/d3c/d40/f9b zero size 2024-02-15T18:31:06.144 INFO:tasks.workunit.client.0.smithi033.stdout:1/513: creat d5/d9/d1e/d20/d2c/f9a x:0 0 0 2024-02-15T18:31:06.144 INFO:tasks.workunit.client.0.smithi033.stdout:1/514: chown d5/l54 0 1 2024-02-15T18:31:06.145 INFO:tasks.workunit.client.0.smithi033.stdout:9/452: dwrite d4/d8/d1b/d2f/f76 [0,4194304] 0 2024-02-15T18:31:06.146 INFO:tasks.workunit.client.0.smithi033.stdout:7/487: mknod d0/dc/d10/da1/ca3 0 2024-02-15T18:31:06.146 INFO:tasks.workunit.client.0.smithi033.stdout:3/445: symlink d2/d14/d23/l87 0 2024-02-15T18:31:06.148 INFO:tasks.workunit.client.0.smithi033.stdout:8/376: unlink d0/d2/d35/d29/c4d 0 2024-02-15T18:31:06.148 INFO:tasks.workunit.client.0.smithi033.stdout:8/377: fsync d0/d2/d14/f32 0 2024-02-15T18:31:06.149 INFO:tasks.workunit.client.0.smithi033.stdout:2/542: link d20/d3a/d4a/d5e/c97 d20/d30/cc5 0 2024-02-15T18:31:06.150 INFO:tasks.workunit.client.0.smithi033.stdout:6/542: truncate d8/d28/d14/f13 167070 0 2024-02-15T18:31:06.153 INFO:tasks.workunit.client.0.smithi033.stdout:4/560: mknod d4/d5/d28/cba 0 2024-02-15T18:31:06.155 INFO:tasks.workunit.client.0.smithi033.stdout:0/473: rename d0/d64/d3b to d0/d8/d15/d8b/da3 0 2024-02-15T18:31:06.155 INFO:tasks.workunit.client.0.smithi033.stdout:0/474: read d0/d8/d15/d4b/d58/d77/f7d [861014,80905] 0 2024-02-15T18:31:06.159 INFO:tasks.workunit.client.0.smithi033.stdout:5/574: mkdir d1/da/d10/d2b/d33/d63/d61/daf 0 2024-02-15T18:31:06.159 INFO:tasks.workunit.client.0.smithi033.stdout:5/575: stat d1/da/d19/d3c/d40/d9a/f9d 0 2024-02-15T18:31:06.161 INFO:tasks.workunit.client.0.smithi033.stdout:1/515: dwrite d5/dd/d12/d49/f44 [0,4194304] 0 2024-02-15T18:31:06.161 INFO:tasks.workunit.client.0.smithi033.stdout:8/378: dread d0/df/d53/f5d [0,4194304] 0 2024-02-15T18:31:06.161 INFO:tasks.workunit.client.0.smithi033.stdout:1/516: getdents d5/d9/d1e/d20/d2c/d34/d51/d63/d76 0 2024-02-15T18:31:06.162 INFO:tasks.workunit.client.0.smithi033.stdout:9/453: truncate d4/d8/dd/f3d 1218412 0 2024-02-15T18:31:06.163 INFO:tasks.workunit.client.0.smithi033.stdout:7/488: getdents d0/dc/d10 0 2024-02-15T18:31:06.163 INFO:tasks.workunit.client.0.smithi033.stdout:7/489: chown d0/f62 1933 1 2024-02-15T18:31:06.163 INFO:tasks.workunit.client.0.smithi033.stdout:3/446: mkdir d2/d14/d23/d68/d88 0 2024-02-15T18:31:06.163 INFO:tasks.workunit.client.0.smithi033.stdout:6/543: dread f0 [0,4194304] 0 2024-02-15T18:31:06.163 INFO:tasks.workunit.client.0.smithi033.stdout:6/544: readlink d8/d1d/d2a/d57/la7 0 2024-02-15T18:31:06.164 INFO:tasks.workunit.client.0.smithi033.stdout:2/543: mknod d20/d31/d47/cc6 0 2024-02-15T18:31:06.165 INFO:tasks.workunit.client.0.smithi033.stdout:4/561: symlink d4/d5/d28/d39/d62/db2/db5/lbb 0 2024-02-15T18:31:06.171 INFO:tasks.workunit.client.0.smithi033.stdout:0/475: truncate d0/f13 547262 0 2024-02-15T18:31:06.173 INFO:tasks.workunit.client.0.smithi033.stdout:5/576: creat d1/da/d10/d2b/d33/d63/d61/da3/fb0 x:0 0 0 2024-02-15T18:31:06.174 INFO:tasks.workunit.client.0.smithi033.stdout:8/379: creat d0/d1c/d30/f74 x:0 0 0 2024-02-15T18:31:06.174 INFO:tasks.workunit.client.0.smithi033.stdout:8/380: chown d0/d1c 21942 1 2024-02-15T18:31:06.176 INFO:tasks.workunit.client.0.smithi033.stdout:7/490: rename d0/dc/l7b to d0/dc/d10/la4 0 2024-02-15T18:31:06.177 INFO:tasks.workunit.client.0.smithi033.stdout:3/447: creat d2/d14/d23/d68/d73/d83/f89 x:0 0 0 2024-02-15T18:31:06.177 INFO:tasks.workunit.client.0.smithi033.stdout:3/448: truncate d2/d20/f53 447947 0 2024-02-15T18:31:06.179 INFO:tasks.workunit.client.0.smithi033.stdout:6/545: link d8/d1d/d37/l65 d8/d1d/d37/d72/lab 0 2024-02-15T18:31:06.180 INFO:tasks.workunit.client.0.smithi033.stdout:2/544: symlink d20/d30/lc7 0 2024-02-15T18:31:06.181 INFO:tasks.workunit.client.0.smithi033.stdout:2/545: chown d20/d30/cad 112324710 1 2024-02-15T18:31:06.185 INFO:tasks.workunit.client.0.smithi033.stdout:2/546: write d20/f3c [3707049,94041] 0 2024-02-15T18:31:06.186 INFO:tasks.workunit.client.0.smithi033.stdout:0/476: rename d0/d8/d15/d8b/da3/d6c/d56 to d0/d8/d15/d7c/da4 0 2024-02-15T18:31:06.186 INFO:tasks.workunit.client.0.smithi033.stdout:7/491: mknod d0/d56/d70/d91/ca5 0 2024-02-15T18:31:06.187 INFO:tasks.workunit.client.0.smithi033.stdout:3/449: getdents d2/d3 0 2024-02-15T18:31:06.187 INFO:tasks.workunit.client.0.smithi033.stdout:3/450: stat d2/d14/d23/d5c 0 2024-02-15T18:31:06.188 INFO:tasks.workunit.client.0.smithi033.stdout:6/546: rmdir d8/d28 39 2024-02-15T18:31:06.188 INFO:tasks.workunit.client.0.smithi033.stdout:6/547: chown d8/d28/d36/c51 0 1 2024-02-15T18:31:06.188 INFO:tasks.workunit.client.0.smithi033.stdout:6/548: chown d8/d28/d14/d2c/d31/d30/d29/d38/c42 0 1 2024-02-15T18:31:06.189 INFO:tasks.workunit.client.0.smithi033.stdout:2/547: mkdir d20/d31/dc8 0 2024-02-15T18:31:06.191 INFO:tasks.workunit.client.0.smithi033.stdout:9/454: dread d4/d8/dd/d28/f2b [0,4194304] 0 2024-02-15T18:31:06.192 INFO:tasks.workunit.client.0.smithi033.stdout:5/577: rename d1/da/d10/d2b/d33 to d1/da/d11/d5e/db1 0 2024-02-15T18:31:06.193 INFO:tasks.workunit.client.0.smithi033.stdout:5/578: chown d1/da/d19/f22 0 1 2024-02-15T18:31:06.193 INFO:tasks.workunit.client.0.smithi033.stdout:6/549: write d8/f4e [1516236,69846] 0 2024-02-15T18:31:06.193 INFO:tasks.workunit.client.0.smithi033.stdout:0/477: rmdir d0/d8/d15 39 2024-02-15T18:31:06.194 INFO:tasks.workunit.client.0.smithi033.stdout:3/451: creat d2/d3/d1e/f8a x:0 0 0 2024-02-15T18:31:06.194 INFO:tasks.workunit.client.0.smithi033.stdout:3/452: write d2/d3/d1e/d22/d4d/f6b [3033571,116572] 0 2024-02-15T18:31:06.195 INFO:tasks.workunit.client.0.smithi033.stdout:2/548: creat d20/d31/d47/fc9 x:0 0 0 2024-02-15T18:31:06.196 INFO:tasks.workunit.client.0.smithi033.stdout:9/455: mknod d4/d8/d1b/d2f/d65/d8b/d95/ca4 0 2024-02-15T18:31:06.199 INFO:tasks.workunit.client.0.smithi033.stdout:5/579: rename d1/da/d19/f6d to d1/da/d11/d5e/db1/d63/d61/da3/fb2 0 2024-02-15T18:31:06.201 INFO:tasks.workunit.client.0.smithi033.stdout:1/517: dwrite d5/d17/f31 [0,4194304] 0 2024-02-15T18:31:06.202 INFO:tasks.workunit.client.0.smithi033.stdout:3/453: mknod d2/c8b 0 2024-02-15T18:31:06.203 INFO:tasks.workunit.client.0.smithi033.stdout:5/580: symlink d1/da/d11/d5e/db1/d63/d61/lb3 0 2024-02-15T18:31:06.203 INFO:tasks.workunit.client.0.smithi033.stdout:5/581: write d1/fa4 [437711,8158] 0 2024-02-15T18:31:06.204 INFO:tasks.workunit.client.0.smithi033.stdout:6/550: mknod d8/d28/d14/d2c/d31/cac 0 2024-02-15T18:31:06.205 INFO:tasks.workunit.client.0.smithi033.stdout:0/478: mknod d0/d8/d15/d4b/ca5 0 2024-02-15T18:31:06.207 INFO:tasks.workunit.client.0.smithi033.stdout:5/582: rename d1/da/d19/d3c/f66 to d1/da/d10/d2b/d42/d4c/fb4 0 2024-02-15T18:31:06.207 INFO:tasks.workunit.client.0.smithi033.stdout:6/551: creat d8/d28/d14/d2c/d31/d5d/d8c/fad x:0 0 0 2024-02-15T18:31:06.208 INFO:tasks.workunit.client.0.smithi033.stdout:6/552: read - d8/d28/d36/f41 zero size 2024-02-15T18:31:06.208 INFO:tasks.workunit.client.0.smithi033.stdout:2/549: dread d20/f21 [0,4194304] 0 2024-02-15T18:31:06.208 INFO:tasks.workunit.client.0.smithi033.stdout:4/562: dwrite d4/d20/d13/fa3 [0,4194304] 0 2024-02-15T18:31:06.209 INFO:tasks.workunit.client.0.smithi033.stdout:5/583: creat d1/fb5 x:0 0 0 2024-02-15T18:31:06.209 INFO:tasks.workunit.client.0.smithi033.stdout:5/584: chown d1/da/d19/d3f/d68/f96 24 1 2024-02-15T18:31:06.209 INFO:tasks.workunit.client.0.smithi033.stdout:6/553: mkdir d8/d28/d14/d2c/d31/d30/d29/d38/dae 0 2024-02-15T18:31:06.211 INFO:tasks.workunit.client.0.smithi033.stdout:2/550: rename d20/d31/d47/d4c/cbd to d20/d31/d47/d4c/d6c/d80/da0/cca 0 2024-02-15T18:31:06.212 INFO:tasks.workunit.client.0.smithi033.stdout:7/492: dwrite d0/dc/d10/d7d/f50 [0,4194304] 0 2024-02-15T18:31:06.212 INFO:tasks.workunit.client.0.smithi033.stdout:7/493: stat d0/dc/d10/d1d/d2b/d5f/l7a 0 2024-02-15T18:31:06.214 INFO:tasks.workunit.client.0.smithi033.stdout:5/585: creat d1/da/fb6 x:0 0 0 2024-02-15T18:31:06.215 INFO:tasks.workunit.client.0.smithi033.stdout:6/554: mknod d8/d28/d14/caf 0 2024-02-15T18:31:06.215 INFO:tasks.workunit.client.0.smithi033.stdout:6/555: stat d8/f6e 0 2024-02-15T18:31:06.218 INFO:tasks.workunit.client.0.smithi033.stdout:1/518: dread d5/d9/d1e/d20/d5c/f39 [4194304,4194304] 0 2024-02-15T18:31:06.219 INFO:tasks.workunit.client.0.smithi033.stdout:8/381: dwrite d0/df/db/f3c [0,4194304] 0 2024-02-15T18:31:06.219 INFO:tasks.workunit.client.0.smithi033.stdout:3/454: dread d2/d14/d23/f66 [0,4194304] 0 2024-02-15T18:31:06.219 INFO:tasks.workunit.client.0.smithi033.stdout:3/455: fsync d2/f1d 0 2024-02-15T18:31:06.220 INFO:tasks.workunit.client.0.smithi033.stdout:3/456: truncate d2/d3/d1e/d22/f57 1035260 0 2024-02-15T18:31:06.220 INFO:tasks.workunit.client.0.smithi033.stdout:3/457: stat d2/d3/d1e/d22/d4d/f6b 0 2024-02-15T18:31:06.220 INFO:tasks.workunit.client.0.smithi033.stdout:0/479: dwrite d0/d64/f7b [0,4194304] 0 2024-02-15T18:31:06.221 INFO:tasks.workunit.client.0.smithi033.stdout:2/551: creat d20/d73/fcb x:0 0 0 2024-02-15T18:31:06.228 INFO:tasks.workunit.client.0.smithi033.stdout:5/586: truncate d1/da/d52/f5b 2085708 0 2024-02-15T18:31:06.232 INFO:tasks.workunit.client.0.smithi033.stdout:6/556: getdents d8/d28/d14/d2c/d31/d30/d29/d38 0 2024-02-15T18:31:06.232 INFO:tasks.workunit.client.0.smithi033.stdout:7/494: dread d0/dc/d10/d1d/d38/d82/f8d [0,4194304] 0 2024-02-15T18:31:06.233 INFO:tasks.workunit.client.0.smithi033.stdout:0/480: dread d0/d8/d15/d2d/d41/d73/f93 [0,4194304] 0 2024-02-15T18:31:06.237 INFO:tasks.workunit.client.0.smithi033.stdout:1/519: rmdir d5/d9/d1e/d20/d2c/d65 39 2024-02-15T18:31:06.241 INFO:tasks.workunit.client.0.smithi033.stdout:8/382: creat d0/df/db/d45/f75 x:0 0 0 2024-02-15T18:31:06.241 INFO:tasks.workunit.client.0.smithi033.stdout:8/383: write d0/d1c/f3e [8823067,28317] 0 2024-02-15T18:31:06.242 INFO:tasks.workunit.client.0.smithi033.stdout:3/458: symlink d2/d14/d23/d68/l8c 0 2024-02-15T18:31:06.242 INFO:tasks.workunit.client.0.smithi033.stdout:3/459: write d2/d14/d23/d5c/f80 [50270,91514] 0 2024-02-15T18:31:06.245 INFO:tasks.workunit.client.0.smithi033.stdout:2/552: rename d20/d31/d47/d82/lb0 to d20/d73/lcc 0 2024-02-15T18:31:06.245 INFO:tasks.workunit.client.0.smithi033.stdout:2/553: write d20/d3a/d4a/d5e/f76 [834087,3806] 0 2024-02-15T18:31:06.245 INFO:tasks.workunit.client.0.smithi033.stdout:2/554: chown d20/l33 3276611 1 2024-02-15T18:31:06.245 INFO:tasks.workunit.client.0.smithi033.stdout:8/384: write d0/d2/d35/d29/f2e [2519596,114709] 0 2024-02-15T18:31:06.246 INFO:tasks.workunit.client.0.smithi033.stdout:5/587: creat d1/da/d11/d5e/db1/d63/d61/fb7 x:0 0 0 2024-02-15T18:31:06.246 INFO:tasks.workunit.client.0.smithi033.stdout:5/588: stat d1/da/d10/d2b/d42/f62 0 2024-02-15T18:31:06.247 INFO:tasks.workunit.client.0.smithi033.stdout:6/557: creat d8/fb0 x:0 0 0 2024-02-15T18:31:06.249 INFO:tasks.workunit.client.0.smithi033.stdout:0/481: creat d0/d8/d15/d4b/d58/d80/fa6 x:0 0 0 2024-02-15T18:31:06.250 INFO:tasks.workunit.client.0.smithi033.stdout:1/520: creat d5/d9/f9b x:0 0 0 2024-02-15T18:31:06.251 INFO:tasks.workunit.client.0.smithi033.stdout:3/460: creat d2/f8d x:0 0 0 2024-02-15T18:31:06.253 INFO:tasks.workunit.client.0.smithi033.stdout:6/558: write d8/f4e [3250596,128464] 0 2024-02-15T18:31:06.253 INFO:tasks.workunit.client.0.smithi033.stdout:2/555: link d20/d39/f5a d20/d31/d47/fcd 0 2024-02-15T18:31:06.253 INFO:tasks.workunit.client.0.smithi033.stdout:7/495: dwrite d0/dc/d10/d48/f5b [0,4194304] 0 2024-02-15T18:31:06.254 INFO:tasks.workunit.client.0.smithi033.stdout:7/496: write d0/dc/d10/d1d/d38/d74/f87 [1827004,72705] 0 2024-02-15T18:31:06.258 INFO:tasks.workunit.client.0.smithi033.stdout:5/589: unlink d1/da/d11/d5e/db1/d63/l4a 0 2024-02-15T18:31:06.259 INFO:tasks.workunit.client.0.smithi033.stdout:8/385: rmdir d0/df/db/d45 39 2024-02-15T18:31:06.259 INFO:tasks.workunit.client.0.smithi033.stdout:8/386: truncate d0/d1c/d30/f74 783972 0 2024-02-15T18:31:06.259 INFO:tasks.workunit.client.0.smithi033.stdout:2/556: write d20/d31/d6a/f2e [2842867,93098] 0 2024-02-15T18:31:06.263 INFO:tasks.workunit.client.0.smithi033.stdout:0/482: rename d0/d8/d15/d4b/d59/f9c to d0/d8/d54/fa7 0 2024-02-15T18:31:06.263 INFO:tasks.workunit.client.0.smithi033.stdout:3/461: getdents d2/d20 0 2024-02-15T18:31:06.266 INFO:tasks.workunit.client.0.smithi033.stdout:0/483: write d0/d64/d1d/f43 [2084923,106019] 0 2024-02-15T18:31:06.267 INFO:tasks.workunit.client.0.smithi033.stdout:1/521: dwrite d5/d9/d1e/d20/d5c/d57/d59/f7b [0,4194304] 0 2024-02-15T18:31:06.267 INFO:tasks.workunit.client.0.smithi033.stdout:1/522: fdatasync d5/d38/f99 0 2024-02-15T18:31:06.267 INFO:tasks.workunit.client.0.smithi033.stdout:1/523: readlink d5/d9/d1e/d20/d5c/d57/d82/l88 0 2024-02-15T18:31:06.267 INFO:tasks.workunit.client.0.smithi033.stdout:1/524: truncate d5/d9/d1e/d20/d5c/d57/d82/f7e 1932911 0 2024-02-15T18:31:06.267 INFO:tasks.workunit.client.0.smithi033.stdout:6/559: creat d8/d28/d14/d2c/d31/d30/d29/d67/fb1 x:0 0 0 2024-02-15T18:31:06.267 INFO:tasks.workunit.client.0.smithi033.stdout:1/525: write d5/d9/f92 [291958,5015] 0 2024-02-15T18:31:06.268 INFO:tasks.workunit.client.0.smithi033.stdout:6/560: write d8/d28/f11 [3118245,1854] 0 2024-02-15T18:31:06.268 INFO:tasks.workunit.client.0.smithi033.stdout:7/497: creat d0/dc/d10/d1d/d38/d74/d7f/fa6 x:0 0 0 2024-02-15T18:31:06.268 INFO:tasks.workunit.client.0.smithi033.stdout:7/498: write d0/dc/d10/d1d/d2b/d5f/d63/f79 [1357213,29758] 0 2024-02-15T18:31:06.269 INFO:tasks.workunit.client.0.smithi033.stdout:7/499: truncate d0/f6a 4286213 0 2024-02-15T18:31:06.269 INFO:tasks.workunit.client.0.smithi033.stdout:7/500: chown d0/d56/d70 292311 1 2024-02-15T18:31:06.269 INFO:tasks.workunit.client.0.smithi033.stdout:5/590: mknod d1/da/d11/d5e/db1/d63/d61/da3/cb8 0 2024-02-15T18:31:06.269 INFO:tasks.workunit.client.0.smithi033.stdout:5/591: truncate d1/da/d88/f97 68457 0 2024-02-15T18:31:06.269 INFO:tasks.workunit.client.0.smithi033.stdout:8/387: symlink d0/df/db/l76 0 2024-02-15T18:31:06.269 INFO:tasks.workunit.client.0.smithi033.stdout:2/557: getdents d20/d31/d47/d82 0 2024-02-15T18:31:06.271 INFO:tasks.workunit.client.0.smithi033.stdout:0/484: link d0/d8/d15/d4b/d58/f61 d0/d8/d15/d7c/da4/fa8 0 2024-02-15T18:31:06.275 INFO:tasks.workunit.client.0.smithi033.stdout:1/526: symlink d5/d9/d1e/d20/d2c/d34/l9c 0 2024-02-15T18:31:06.277 INFO:tasks.workunit.client.0.smithi033.stdout:6/561: symlink d8/d28/d14/d2c/d31/d30/lb2 0 2024-02-15T18:31:06.277 INFO:tasks.workunit.client.0.smithi033.stdout:7/501: creat d0/dc/d10/d1d/fa7 x:0 0 0 2024-02-15T18:31:06.278 INFO:tasks.workunit.client.0.smithi033.stdout:5/592: mknod d1/da/d10/d2b/cb9 0 2024-02-15T18:31:06.280 INFO:tasks.workunit.client.0.smithi033.stdout:8/388: creat d0/df/db/d1b/d4b/d72/f77 x:0 0 0 2024-02-15T18:31:06.280 INFO:tasks.workunit.client.0.smithi033.stdout:3/462: link d2/f8d d2/d14/d23/d5c/f8e 0 2024-02-15T18:31:06.281 INFO:tasks.workunit.client.0.smithi033.stdout:3/463: truncate d2/d3/df/f7c 654386 0 2024-02-15T18:31:06.281 INFO:tasks.workunit.client.0.smithi033.stdout:3/464: fdatasync d2/d14/d23/f3d 0 2024-02-15T18:31:06.281 INFO:tasks.workunit.client.0.smithi033.stdout:0/485: dread d0/f78 [0,4194304] 0 2024-02-15T18:31:06.282 INFO:tasks.workunit.client.0.smithi033.stdout:0/486: write d0/f7a [180440,40831] 0 2024-02-15T18:31:06.282 INFO:tasks.workunit.client.0.smithi033.stdout:1/527: truncate d5/d9/d1e/d20/d5c/d57/d82/f87 511703 0 2024-02-15T18:31:06.282 INFO:tasks.workunit.client.0.smithi033.stdout:7/502: getdents d0/dc/d10/da1 0 2024-02-15T18:31:06.283 INFO:tasks.workunit.client.0.smithi033.stdout:8/389: mknod d0/df/d53/c78 0 2024-02-15T18:31:06.287 INFO:tasks.workunit.client.0.smithi033.stdout:7/503: write d0/f62 [3955444,114232] 0 2024-02-15T18:31:06.289 INFO:tasks.workunit.client.0.smithi033.stdout:7/504: mknod d0/dc/d10/d1d/d38/d74/ca8 0 2024-02-15T18:31:06.291 INFO:tasks.workunit.client.0.smithi033.stdout:7/505: creat d0/dc/d10/d48/d4b/fa9 x:0 0 0 2024-02-15T18:31:06.291 INFO:tasks.workunit.client.0.smithi033.stdout:7/506: fsync d0/f1c 0 2024-02-15T18:31:06.293 INFO:tasks.workunit.client.0.smithi033.stdout:7/507: mkdir d0/dc/d10/d1d/d38/daa 0 2024-02-15T18:31:06.294 INFO:tasks.workunit.client.0.smithi033.stdout:0/487: dread d0/d8/d15/d4b/f71 [4194304,4194304] 0 2024-02-15T18:31:06.294 INFO:tasks.workunit.client.0.smithi033.stdout:0/488: read d0/d8/f39 [26706,61332] 0 2024-02-15T18:31:06.295 INFO:tasks.workunit.client.0.smithi033.stdout:7/508: creat d0/dc/d10/d7d/d99/fab x:0 0 0 2024-02-15T18:31:06.297 INFO:tasks.workunit.client.0.smithi033.stdout:7/509: creat d0/dc/d10/d1d/d38/d74/d7f/fac x:0 0 0 2024-02-15T18:31:06.299 INFO:tasks.workunit.client.0.smithi033.stdout:2/558: dwrite d20/d31/d47/d82/f99 [0,4194304] 0 2024-02-15T18:31:06.301 INFO:tasks.workunit.client.0.smithi033.stdout:8/390: write d0/d2/d35/f1a [6747002,96679] 0 2024-02-15T18:31:06.301 INFO:tasks.workunit.client.0.smithi033.stdout:7/510: mkdir d0/d56/dad 0 2024-02-15T18:31:06.310 INFO:tasks.workunit.client.0.smithi033.stdout:7/511: mknod d0/dc/d10/d1d/d38/d82/cae 0 2024-02-15T18:31:06.311 INFO:tasks.workunit.client.0.smithi033.stdout:8/391: creat d0/df/db/d1b/f79 x:0 0 0 2024-02-15T18:31:06.312 INFO:tasks.workunit.client.0.smithi033.stdout:6/562: dwrite d8/d28/d14/d2c/f61 [0,4194304] 0 2024-02-15T18:31:06.312 INFO:tasks.workunit.client.0.smithi033.stdout:7/512: rmdir d0/dc 39 2024-02-15T18:31:06.313 INFO:tasks.workunit.client.0.smithi033.stdout:8/392: rmdir d0/d1c/d30 39 2024-02-15T18:31:06.314 INFO:tasks.workunit.client.0.smithi033.stdout:6/563: getdents d8/d1d/d2a/d57 0 2024-02-15T18:31:06.314 INFO:tasks.workunit.client.0.smithi033.stdout:7/513: symlink d0/d56/d70/d83/laf 0 2024-02-15T18:31:06.314 INFO:tasks.workunit.client.0.smithi033.stdout:6/564: creat d8/d28/d14/d2c/d31/d30/fb3 x:0 0 0 2024-02-15T18:31:06.316 INFO:tasks.workunit.client.0.smithi033.stdout:6/565: rename d8/f1a to d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb4 0 2024-02-15T18:31:06.317 INFO:tasks.workunit.client.0.smithi033.stdout:6/566: truncate d8/d1d/f1b 5857978 0 2024-02-15T18:31:06.317 INFO:tasks.workunit.client.0.smithi033.stdout:6/567: readlink d8/d1d/d2a/d57/la7 0 2024-02-15T18:31:06.317 INFO:tasks.workunit.client.0.smithi033.stdout:6/568: truncate d8/d28/d36/f41 797356 0 2024-02-15T18:31:06.317 INFO:tasks.workunit.client.0.smithi033.stdout:6/569: mknod d8/d1d/d37/d72/cb5 0 2024-02-15T18:31:06.318 INFO:tasks.workunit.client.0.smithi033.stdout:6/570: creat d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb6 x:0 0 0 2024-02-15T18:31:06.320 INFO:tasks.workunit.client.0.smithi033.stdout:6/571: creat d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/fb7 x:0 0 0 2024-02-15T18:31:06.320 INFO:tasks.workunit.client.0.smithi033.stdout:6/572: readlink d8/d1d/d2a/d83/l94 0 2024-02-15T18:31:06.320 INFO:tasks.workunit.client.0.smithi033.stdout:6/573: fsync d8/d1d/d37/f77 0 2024-02-15T18:31:06.320 INFO:tasks.workunit.client.0.smithi033.stdout:6/574: write d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/fb7 [1003167,103439] 0 2024-02-15T18:31:06.320 INFO:tasks.workunit.client.0.smithi033.stdout:6/575: dread - d8/d28/d14/d2c/d31/d30/d29/d38/d54/f84 zero size 2024-02-15T18:31:06.321 INFO:tasks.workunit.client.0.smithi033.stdout:6/576: creat d8/d28/d14/d2c/d3b/fb8 x:0 0 0 2024-02-15T18:31:06.323 INFO:tasks.workunit.client.0.smithi033.stdout:6/577: rename d8/d1d/d2a/d55/d63/f9e to d8/d28/d14/d2c/d31/fb9 0 2024-02-15T18:31:06.323 INFO:tasks.workunit.client.0.smithi033.stdout:7/514: dread d0/dc/d10/d1d/d2b/d5f/f71 [0,4194304] 0 2024-02-15T18:31:06.325 INFO:tasks.workunit.client.0.smithi033.stdout:3/465: dwrite d2/d14/d23/f66 [0,4194304] 0 2024-02-15T18:31:06.325 INFO:tasks.workunit.client.0.smithi033.stdout:3/466: write d2/d3/d1e/d22/f57 [624216,129203] 0 2024-02-15T18:31:06.325 INFO:tasks.workunit.client.0.smithi033.stdout:3/467: dread - d2/f6d zero size 2024-02-15T18:31:06.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/489: dwrite d0/d8/d15/d2d/f6a [0,4194304] 0 2024-02-15T18:31:06.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/490: chown d0/d8/d15/d5b/f5d 625441 1 2024-02-15T18:31:06.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/491: fdatasync d0/d8/d15/d7c/da4/f69 0 2024-02-15T18:31:06.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/492: dread - d0/d8/d15/d2d/f57 zero size 2024-02-15T18:31:06.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/493: chown d0/d8/d15/d2d/d41/d73/d96 49237643 1 2024-02-15T18:31:06.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/494: chown d0/d8/d15/d7c/l9d 1034996 1 2024-02-15T18:31:06.327 INFO:tasks.workunit.client.0.smithi033.stdout:0/495: dread - d0/d8/d54/f90 zero size 2024-02-15T18:31:06.327 INFO:tasks.workunit.client.0.smithi033.stdout:2/559: dwrite d20/d3a/d4a/d5e/f76 [0,4194304] 0 2024-02-15T18:31:06.329 INFO:tasks.workunit.client.0.smithi033.stdout:3/468: creat d2/d3/df/f8f x:0 0 0 2024-02-15T18:31:06.329 INFO:tasks.workunit.client.0.smithi033.stdout:3/469: fdatasync d2/d3/d1e/f6e 0 2024-02-15T18:31:06.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/528: dwrite d5/d9/d1e/f73 [0,4194304] 0 2024-02-15T18:31:06.336 INFO:tasks.workunit.client.0.smithi033.stdout:8/393: dwrite d0/df/db/d1b/d4b/f4c [0,4194304] 0 2024-02-15T18:31:06.336 INFO:tasks.workunit.client.0.smithi033.stdout:8/394: truncate d0/d2/d35/f64 292533 0 2024-02-15T18:31:06.353 INFO:tasks.workunit.client.0.smithi033.stdout:3/470: creat d2/d14/d23/d68/d73/d76/f90 x:0 0 0 2024-02-15T18:31:06.353 INFO:tasks.workunit.client.0.smithi033.stdout:3/471: write d2/d3/d17/f79 [362912,112003] 0 2024-02-15T18:31:06.354 INFO:tasks.workunit.client.0.smithi033.stdout:1/529: creat d5/d9/d1e/d20/d2c/d34/f9d x:0 0 0 2024-02-15T18:31:06.357 INFO:tasks.workunit.client.0.smithi033.stdout:8/395: mkdir d0/d7a 0 2024-02-15T18:31:06.357 INFO:tasks.workunit.client.0.smithi033.stdout:6/578: dwrite d8/d28/d36/f91 [0,4194304] 0 2024-02-15T18:31:06.357 INFO:tasks.workunit.client.0.smithi033.stdout:6/579: truncate d8/d28/f35 3570744 0 2024-02-15T18:31:06.357 INFO:tasks.workunit.client.0.smithi033.stdout:0/496: dwrite d0/d64/d88/f8a [0,4194304] 0 2024-02-15T18:31:06.359 INFO:tasks.workunit.client.0.smithi033.stdout:6/580: dread d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb4 [4194304,4194304] 0 2024-02-15T18:31:06.363 INFO:tasks.workunit.client.0.smithi033.stdout:6/581: write d8/d1d/d2a/d55/d63/f7a [1852914,27476] 0 2024-02-15T18:31:06.363 INFO:tasks.workunit.client.0.smithi033.stdout:1/530: rename d5/d9/d1e/d20/d5c/l70 to d5/d9/d1e/d20/d2c/d65/l9e 0 2024-02-15T18:31:06.363 INFO:tasks.workunit.client.0.smithi033.stdout:1/531: chown d5/d9/f77 3 1 2024-02-15T18:31:06.366 INFO:tasks.workunit.client.0.smithi033.stdout:3/472: dwrite d2/d3/df/f49 [0,4194304] 0 2024-02-15T18:31:06.369 INFO:tasks.workunit.client.0.smithi033.stdout:8/396: creat d0/df/db/d45/f7b x:0 0 0 2024-02-15T18:31:06.371 INFO:tasks.workunit.client.0.smithi033.stdout:0/497: symlink d0/la9 0 2024-02-15T18:31:06.380 INFO:tasks.workunit.client.0.smithi033.stdout:1/532: unlink d5/dd/d12/d49/d23/f66 0 2024-02-15T18:31:06.380 INFO:tasks.workunit.client.0.smithi033.stdout:8/397: getdents d0/d2/d14/d56/d59 0 2024-02-15T18:31:06.380 INFO:tasks.workunit.client.0.smithi033.stdout:1/533: chown d5/dd/f3e 243 1 2024-02-15T18:31:06.380 INFO:tasks.workunit.client.0.smithi033.stdout:0/498: creat d0/d8/faa x:0 0 0 2024-02-15T18:31:06.380 INFO:tasks.workunit.client.0.smithi033.stdout:6/582: dread d8/d28/d14/f7c [0,4194304] 0 2024-02-15T18:31:06.381 INFO:tasks.workunit.client.0.smithi033.stdout:8/398: truncate d0/df/f38 1699492 0 2024-02-15T18:31:06.382 INFO:tasks.workunit.client.0.smithi033.stdout:1/534: creat d5/d9/d1e/d20/d2c/d34/d51/d63/d76/f9f x:0 0 0 2024-02-15T18:31:06.382 INFO:tasks.workunit.client.0.smithi033.stdout:0/499: getdents d0/d8/d15/d7c 0 2024-02-15T18:31:06.387 INFO:tasks.workunit.client.0.smithi033.stdout:8/399: rename d0/d2/f16 to d0/d2/d14/f7c 0 2024-02-15T18:31:06.388 INFO:tasks.workunit.client.0.smithi033.stdout:0/500: unlink d0/d8/f26 0 2024-02-15T18:31:06.391 INFO:tasks.workunit.client.0.smithi033.stdout:3/473: dwrite d2/d3/d1e/d22/d4d/f77 [0,4194304] 0 2024-02-15T18:31:06.391 INFO:tasks.workunit.client.0.smithi033.stdout:3/474: truncate d2/d14/d23/f66 5068166 0 2024-02-15T18:31:06.400 INFO:tasks.workunit.client.0.smithi033.stdout:0/501: dread d0/d8/d15/d2d/d2e/f65 [0,4194304] 0 2024-02-15T18:31:06.406 INFO:tasks.workunit.client.0.smithi033.stdout:1/535: rename d5/d9/d1e/d20/d2c/f46 to d5/fa0 0 2024-02-15T18:31:06.406 INFO:tasks.workunit.client.0.smithi033.stdout:1/536: readlink d5/d9/d1e/d20/d2c/l84 0 2024-02-15T18:31:06.407 INFO:tasks.workunit.client.0.smithi033.stdout:6/583: dwrite d8/d1d/d37/d72/f98 [0,4194304] 0 2024-02-15T18:31:06.411 INFO:tasks.workunit.client.0.smithi033.stdout:8/400: dwrite d0/df/db/f2f [0,4194304] 0 2024-02-15T18:31:06.412 INFO:tasks.workunit.client.0.smithi033.stdout:3/475: truncate d2/d14/d23/f43 2249734 0 2024-02-15T18:31:06.413 INFO:tasks.workunit.client.0.smithi033.stdout:1/537: symlink d5/dd/d12/d49/d23/la1 0 2024-02-15T18:31:06.416 INFO:tasks.workunit.client.0.smithi033.stdout:6/584: creat d8/d28/d36/fba x:0 0 0 2024-02-15T18:31:06.416 INFO:tasks.workunit.client.0.smithi033.stdout:6/585: truncate d8/d28/d14/d2c/d31/d30/d29/d38/f96 174823 0 2024-02-15T18:31:06.418 INFO:tasks.workunit.client.0.smithi033.stdout:8/401: creat d0/df/db/d1b/d4b/f7d x:0 0 0 2024-02-15T18:31:06.418 INFO:tasks.workunit.client.0.smithi033.stdout:8/402: stat d0/d1c/f3e 0 2024-02-15T18:31:06.418 INFO:tasks.workunit.client.0.smithi033.stdout:3/476: creat d2/d3/df/d6c/f91 x:0 0 0 2024-02-15T18:31:06.419 INFO:tasks.workunit.client.0.smithi033.stdout:3/477: getdents d2/d14/d23/d6f 0 2024-02-15T18:31:06.420 INFO:tasks.workunit.client.0.smithi033.stdout:1/538: symlink d5/d9/d1e/d20/d5c/la2 0 2024-02-15T18:31:06.420 INFO:tasks.workunit.client.0.smithi033.stdout:6/586: dread d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/fb7 [0,4194304] 0 2024-02-15T18:31:06.422 INFO:tasks.workunit.client.0.smithi033.stdout:0/502: dwrite d0/f10 [0,4194304] 0 2024-02-15T18:31:06.424 INFO:tasks.workunit.client.0.smithi033.stdout:3/478: symlink d2/d14/d23/d6f/l92 0 2024-02-15T18:31:06.425 INFO:tasks.workunit.client.0.smithi033.stdout:3/479: chown d2/d14/d23/d68/d73/d83 660720 1 2024-02-15T18:31:06.426 INFO:tasks.workunit.client.0.smithi033.stdout:1/539: truncate d5/d9/f92 612730 0 2024-02-15T18:31:06.429 INFO:tasks.workunit.client.0.smithi033.stdout:6/587: unlink d8/d28/d14/d2c/d31/d30/f3e 0 2024-02-15T18:31:06.429 INFO:tasks.workunit.client.0.smithi033.stdout:1/540: write d5/dd/f3f [2017708,69340] 0 2024-02-15T18:31:06.434 INFO:tasks.workunit.client.0.smithi033.stdout:3/480: mkdir d2/d14/d23/d6f/d93 0 2024-02-15T18:31:06.436 INFO:tasks.workunit.client.0.smithi033.stdout:6/588: rename d8/d1d/d2a to d8/d1d/d37/d4f/dbb 0 2024-02-15T18:31:06.441 INFO:tasks.workunit.client.0.smithi033.stdout:0/503: truncate d0/d2/f3 389439 0 2024-02-15T18:31:06.441 INFO:tasks.workunit.client.0.smithi033.stdout:3/481: symlink d2/d14/d23/d6f/l94 0 2024-02-15T18:31:06.441 INFO:tasks.workunit.client.0.smithi033.stdout:6/589: read d8/d1d/d37/d72/f98 [1585505,94407] 0 2024-02-15T18:31:06.442 INFO:tasks.workunit.client.0.smithi033.stdout:3/482: mknod d2/d14/d23/d68/c95 0 2024-02-15T18:31:06.443 INFO:tasks.workunit.client.0.smithi033.stdout:3/483: write d2/d3/df/d6c/f91 [328384,112305] 0 2024-02-15T18:31:06.443 INFO:tasks.workunit.client.0.smithi033.stdout:6/590: truncate d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/fb7 592897 0 2024-02-15T18:31:06.443 INFO:tasks.workunit.client.0.smithi033.stdout:6/591: write d8/d28/d14/d2c/d3b/fb8 [711480,27865] 0 2024-02-15T18:31:06.445 INFO:tasks.workunit.client.0.smithi033.stdout:3/484: unlink d2/d14/d23/d5c/c86 0 2024-02-15T18:31:06.445 INFO:tasks.workunit.client.0.smithi033.stdout:3/485: chown d2/d14/d23/d68/d73/d76/c84 684570 1 2024-02-15T18:31:06.445 INFO:tasks.workunit.client.0.smithi033.stdout:3/486: fdatasync d2/d14/d23/f66 0 2024-02-15T18:31:06.447 INFO:tasks.workunit.client.0.smithi033.stdout:6/592: truncate d8/d28/d14/d2c/d31/d30/f71 2681580 0 2024-02-15T18:31:06.447 INFO:tasks.workunit.client.0.smithi033.stdout:6/593: stat d8/d1d/d37/d4f/dbb/d55/d60/l74 0 2024-02-15T18:31:06.448 INFO:tasks.workunit.client.0.smithi033.stdout:6/594: readlink d8/d1d/d37/l65 0 2024-02-15T18:31:06.450 INFO:tasks.workunit.client.0.smithi033.stdout:8/403: dwrite d0/df/f11 [0,4194304] 0 2024-02-15T18:31:06.451 INFO:tasks.workunit.client.0.smithi033.stdout:4/563: sync 2024-02-15T18:31:06.451 INFO:tasks.workunit.client.0.smithi033.stdout:9/456: sync 2024-02-15T18:31:06.451 INFO:tasks.workunit.client.0.smithi033.stdout:5/593: sync 2024-02-15T18:31:06.452 INFO:tasks.workunit.client.0.smithi033.stdout:4/564: write d4/d20/d13/d1b/f6a [960865,75237] 0 2024-02-15T18:31:06.453 INFO:tasks.workunit.client.0.smithi033.stdout:3/487: symlink d2/d3/d17/l96 0 2024-02-15T18:31:06.455 INFO:tasks.workunit.client.0.smithi033.stdout:6/595: rename d8/d1d/d37/f79 to d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/d81/fbc 0 2024-02-15T18:31:06.456 INFO:tasks.workunit.client.0.smithi033.stdout:1/541: dwrite d5/d9/d1e/d20/d2c/d34/f86 [0,4194304] 0 2024-02-15T18:31:06.463 INFO:tasks.workunit.client.0.smithi033.stdout:8/404: symlink d0/df/db/d45/l7e 0 2024-02-15T18:31:06.464 INFO:tasks.workunit.client.0.smithi033.stdout:9/457: creat d4/d8/fa5 x:0 0 0 2024-02-15T18:31:06.467 INFO:tasks.workunit.client.0.smithi033.stdout:4/565: creat d4/d20/d37/fbc x:0 0 0 2024-02-15T18:31:06.467 INFO:tasks.workunit.client.0.smithi033.stdout:3/488: rename d2/d14/d23/d68/d73/d83/f89 to d2/d14/d23/d68/d73/d83/f97 0 2024-02-15T18:31:06.469 INFO:tasks.workunit.client.0.smithi033.stdout:6/596: dread d8/d1d/d37/d72/f98 [0,4194304] 0 2024-02-15T18:31:06.471 INFO:tasks.workunit.client.0.smithi033.stdout:4/566: dread d4/d20/f3a [0,4194304] 0 2024-02-15T18:31:06.473 INFO:tasks.workunit.client.0.smithi033.stdout:1/542: link d5/d9/d1e/d20/d2c/d65/l89 d5/d9/d1e/d20/la3 0 2024-02-15T18:31:06.473 INFO:tasks.workunit.client.0.smithi033.stdout:8/405: symlink d0/df/db/d1b/d4b/d72/l7f 0 2024-02-15T18:31:06.473 INFO:tasks.workunit.client.0.smithi033.stdout:8/406: readlink d0/d2/l21 0 2024-02-15T18:31:06.474 INFO:tasks.workunit.client.0.smithi033.stdout:0/504: dwrite d0/d8/d54/f90 [0,4194304] 0 2024-02-15T18:31:06.474 INFO:tasks.workunit.client.0.smithi033.stdout:0/505: fdatasync d0/d8/d15/f70 0 2024-02-15T18:31:06.474 INFO:tasks.workunit.client.0.smithi033.stdout:0/506: chown d0/d8/d15/d9f 215065 1 2024-02-15T18:31:06.474 INFO:tasks.workunit.client.0.smithi033.stdout:0/507: chown d0/d8/d15/d2d/l4f 1 1 2024-02-15T18:31:06.475 INFO:tasks.workunit.client.0.smithi033.stdout:5/594: dwrite d1/da/d19/d3c/d40/f9b [0,4194304] 0 2024-02-15T18:31:06.476 INFO:tasks.workunit.client.0.smithi033.stdout:1/543: dread d5/d9/d1e/d20/d2c/d65/f75 [0,4194304] 0 2024-02-15T18:31:06.476 INFO:tasks.workunit.client.0.smithi033.stdout:8/407: dread d0/d2/d14/d56/d59/f6c [0,4194304] 0 2024-02-15T18:31:06.479 INFO:tasks.workunit.client.0.smithi033.stdout:3/489: getdents d2/d3/df/d6c 0 2024-02-15T18:31:06.481 INFO:tasks.workunit.client.0.smithi033.stdout:6/597: link d8/le d8/d1d/d37/d4f/dbb/d55/d60/lbd 0 2024-02-15T18:31:06.481 INFO:tasks.workunit.client.0.smithi033.stdout:6/598: chown d8/d28/d14/d2c/d31/d30/d29/d67/c8a 0 1 2024-02-15T18:31:06.482 INFO:tasks.workunit.client.0.smithi033.stdout:7/515: sync 2024-02-15T18:31:06.482 INFO:tasks.workunit.client.0.smithi033.stdout:7/516: chown d0/dc/d10/d48/d4b/fa9 3 1 2024-02-15T18:31:06.485 INFO:tasks.workunit.client.0.smithi033.stdout:2/560: sync 2024-02-15T18:31:06.485 INFO:tasks.workunit.client.0.smithi033.stdout:0/508: rename d0/d64/d1d/f1f to d0/d8/d15/d2d/fab 0 2024-02-15T18:31:06.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/595: creat d1/da/d19/fba x:0 0 0 2024-02-15T18:31:06.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/596: fdatasync d1/da/d10/f8a 0 2024-02-15T18:31:06.487 INFO:tasks.workunit.client.0.smithi033.stdout:5/597: fdatasync d1/da/d19/f22 0 2024-02-15T18:31:06.488 INFO:tasks.workunit.client.0.smithi033.stdout:5/598: fdatasync d1/da/d10/d2b/d42/d4c/fb4 0 2024-02-15T18:31:06.489 INFO:tasks.workunit.client.0.smithi033.stdout:1/544: link d5/d9/c13 d5/d9/d1e/d20/d2c/ca4 0 2024-02-15T18:31:06.489 INFO:tasks.workunit.client.0.smithi033.stdout:9/458: dwrite d4/d8/fb [4194304,4194304] 0 2024-02-15T18:31:06.489 INFO:tasks.workunit.client.0.smithi033.stdout:8/408: dread d0/d2/d14/f7c [0,4194304] 0 2024-02-15T18:31:06.489 INFO:tasks.workunit.client.0.smithi033.stdout:8/409: write d0/df/db/f6b [967383,32711] 0 2024-02-15T18:31:06.489 INFO:tasks.workunit.client.0.smithi033.stdout:3/490: creat d2/d14/d23/d6f/d93/f98 x:0 0 0 2024-02-15T18:31:06.489 INFO:tasks.workunit.client.0.smithi033.stdout:3/491: write d2/d14/d23/d5c/f80 [896404,51949] 0 2024-02-15T18:31:06.491 INFO:tasks.workunit.client.0.smithi033.stdout:4/567: write d4/d20/d37/f42 [3407469,58596] 0 2024-02-15T18:31:06.492 INFO:tasks.workunit.client.0.smithi033.stdout:7/517: dread d0/dc/d10/d48/d4b/f54 [0,4194304] 0 2024-02-15T18:31:06.493 INFO:tasks.workunit.client.0.smithi033.stdout:1/545: dread d5/d9/ff [0,4194304] 0 2024-02-15T18:31:06.493 INFO:tasks.workunit.client.0.smithi033.stdout:1/546: truncate d5/d9/d1e/d20/d2c/f8c 653863 0 2024-02-15T18:31:06.493 INFO:tasks.workunit.client.0.smithi033.stdout:9/459: write d4/d8/dd/d41/d51/f52 [52479,46678] 0 2024-02-15T18:31:06.493 INFO:tasks.workunit.client.0.smithi033.stdout:5/599: dread d1/da/d11/f8f [0,4194304] 0 2024-02-15T18:31:06.496 INFO:tasks.workunit.client.0.smithi033.stdout:6/599: creat d8/d28/d14/d2c/d31/d5d/d8c/fbe x:0 0 0 2024-02-15T18:31:06.497 INFO:tasks.workunit.client.0.smithi033.stdout:8/410: symlink d0/d2/d35/d29/l80 0 2024-02-15T18:31:06.498 INFO:tasks.workunit.client.0.smithi033.stdout:0/509: fsync d0/d8/d15/d2d/fab 0 2024-02-15T18:31:06.501 INFO:tasks.workunit.client.0.smithi033.stdout:3/492: rename d2/f5d to d2/d14/d23/d5c/f99 0 2024-02-15T18:31:06.501 INFO:tasks.workunit.client.0.smithi033.stdout:4/568: mknod d4/d20/d13/d1b/d7c/d91/cbd 0 2024-02-15T18:31:06.502 INFO:tasks.workunit.client.0.smithi033.stdout:7/518: symlink d0/dc/d10/d48/d4b/lb0 0 2024-02-15T18:31:06.502 INFO:tasks.workunit.client.0.smithi033.stdout:7/519: write d0/dc/d10/d48/f53 [885383,47811] 0 2024-02-15T18:31:06.506 INFO:tasks.workunit.client.0.smithi033.stdout:1/547: mknod d5/d9/d1e/d20/d2c/d34/d51/d63/d76/ca5 0 2024-02-15T18:31:06.506 INFO:tasks.workunit.client.0.smithi033.stdout:9/460: creat d4/d8/d1b/d2f/d65/d8b/d95/fa6 x:0 0 0 2024-02-15T18:31:06.506 INFO:tasks.workunit.client.0.smithi033.stdout:5/600: symlink d1/da/d11/lbb 0 2024-02-15T18:31:06.506 INFO:tasks.workunit.client.0.smithi033.stdout:5/601: chown d1/da/d19/d74/f92 1980 1 2024-02-15T18:31:06.507 INFO:tasks.workunit.client.0.smithi033.stdout:8/411: truncate d0/df/f11 3414576 0 2024-02-15T18:31:06.507 INFO:tasks.workunit.client.0.smithi033.stdout:3/493: mknod d2/d3/d1e/c9a 0 2024-02-15T18:31:06.510 INFO:tasks.workunit.client.0.smithi033.stdout:0/510: dread d0/d64/f7b [0,4194304] 0 2024-02-15T18:31:06.510 INFO:tasks.workunit.client.0.smithi033.stdout:0/511: write d0/d8/d15/d8b/da3/d6c/f6b [79756,49086] 0 2024-02-15T18:31:06.511 INFO:tasks.workunit.client.0.smithi033.stdout:5/602: write d1/da/f2c [745408,21598] 0 2024-02-15T18:31:06.511 INFO:tasks.workunit.client.0.smithi033.stdout:4/569: mkdir d4/d20/d13/d1b/d7c/d91/dbe 0 2024-02-15T18:31:06.511 INFO:tasks.workunit.client.0.smithi033.stdout:1/548: creat d5/d17/fa6 x:0 0 0 2024-02-15T18:31:06.511 INFO:tasks.workunit.client.0.smithi033.stdout:4/570: write d4/d20/d13/d5c/d87/f8d [638054,17109] 0 2024-02-15T18:31:06.511 INFO:tasks.workunit.client.0.smithi033.stdout:9/461: creat d4/d8/dd/d28/d6b/fa7 x:0 0 0 2024-02-15T18:31:06.512 INFO:tasks.workunit.client.0.smithi033.stdout:6/600: dread d8/d28/d14/d2c/d31/d5d/fa2 [0,4194304] 0 2024-02-15T18:31:06.512 INFO:tasks.workunit.client.0.smithi033.stdout:2/561: dwrite d20/d3a/fc0 [0,4194304] 0 2024-02-15T18:31:06.514 INFO:tasks.workunit.client.0.smithi033.stdout:8/412: mknod d0/d2/d35/d29/d5f/c81 0 2024-02-15T18:31:06.518 INFO:tasks.workunit.client.0.smithi033.stdout:0/512: creat d0/d8/d15/d9a/fac x:0 0 0 2024-02-15T18:31:06.524 INFO:tasks.workunit.client.0.smithi033.stdout:9/462: dread d4/d8/dd/f13 [0,4194304] 0 2024-02-15T18:31:06.524 INFO:tasks.workunit.client.0.smithi033.stdout:9/463: fsync d4/d32/f54 0 2024-02-15T18:31:06.527 INFO:tasks.workunit.client.0.smithi033.stdout:5/603: creat d1/da/d11/d5e/db1/d63/d61/da3/fbc x:0 0 0 2024-02-15T18:31:06.527 INFO:tasks.workunit.client.0.smithi033.stdout:1/549: creat d5/d9/d1e/d20/d5c/d57/fa7 x:0 0 0 2024-02-15T18:31:06.527 INFO:tasks.workunit.client.0.smithi033.stdout:4/571: dread d4/f54 [0,4194304] 0 2024-02-15T18:31:06.529 INFO:tasks.workunit.client.0.smithi033.stdout:6/601: mkdir d8/d1d/d37/dbf 0 2024-02-15T18:31:06.535 INFO:tasks.workunit.client.0.smithi033.stdout:2/562: rmdir d20/d31/d6a 39 2024-02-15T18:31:06.538 INFO:tasks.workunit.client.0.smithi033.stdout:8/413: getdents d0/df/db/d1b/d4b/d72 0 2024-02-15T18:31:06.539 INFO:tasks.workunit.client.0.smithi033.stdout:3/494: dwrite d2/d14/d23/f66 [0,4194304] 0 2024-02-15T18:31:06.541 INFO:tasks.workunit.client.0.smithi033.stdout:5/604: rename d1/da/d11/d5e/db1/f51 to d1/da/d11/d5e/db1/d63/d61/daf/fbd 0 2024-02-15T18:31:06.543 INFO:tasks.workunit.client.0.smithi033.stdout:1/550: creat d5/d9/d1e/d20/d2c/d34/d51/fa8 x:0 0 0 2024-02-15T18:31:06.543 INFO:tasks.workunit.client.0.smithi033.stdout:2/563: creat d20/d31/d47/fce x:0 0 0 2024-02-15T18:31:06.546 INFO:tasks.workunit.client.0.smithi033.stdout:1/551: mknod d5/ca9 0 2024-02-15T18:31:06.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/605: mkdir d1/da/d11/d5e/db1/d63/d61/da3/dbe 0 2024-02-15T18:31:06.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/606: fdatasync d1/da/d11/d5e/db1/d63/d61/daf/fbd 0 2024-02-15T18:31:06.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/607: truncate d1/da/d19/d3c/f70 4660724 0 2024-02-15T18:31:06.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/608: chown d1/da/d11/d5e/db1/d63/d61/daf 0 1 2024-02-15T18:31:06.547 INFO:tasks.workunit.client.0.smithi033.stdout:5/609: fsync d1/da/d19/d3c/d40/d65/f83 0 2024-02-15T18:31:06.547 INFO:tasks.workunit.client.0.smithi033.stdout:2/564: creat d20/d30/fcf x:0 0 0 2024-02-15T18:31:06.547 INFO:tasks.workunit.client.0.smithi033.stdout:2/565: write d20/d31/d47/d64/f86 [229092,30657] 0 2024-02-15T18:31:06.547 INFO:tasks.workunit.client.0.smithi033.stdout:1/552: symlink d5/dd/d12/d49/d23/laa 0 2024-02-15T18:31:06.549 INFO:tasks.workunit.client.0.smithi033.stdout:5/610: write d1/da/d11/d5e/db1/d63/d61/da3/fb2 [906930,49706] 0 2024-02-15T18:31:06.550 INFO:tasks.workunit.client.0.smithi033.stdout:5/611: creat d1/da/d10/d2b/fbf x:0 0 0 2024-02-15T18:31:06.551 INFO:tasks.workunit.client.0.smithi033.stdout:5/612: creat d1/da/d19/d3f/fc0 x:0 0 0 2024-02-15T18:31:06.552 INFO:tasks.workunit.client.0.smithi033.stdout:5/613: symlink d1/da/d10/lc1 0 2024-02-15T18:31:06.553 INFO:tasks.workunit.client.0.smithi033.stdout:5/614: write d1/da/f24 [270367,16163] 0 2024-02-15T18:31:06.559 INFO:tasks.workunit.client.0.smithi033.stdout:1/553: dread d5/d17/f35 [0,4194304] 0 2024-02-15T18:31:06.560 INFO:tasks.workunit.client.0.smithi033.stdout:1/554: write d5/d9/d1e/d20/d2c/d34/f40 [790823,79582] 0 2024-02-15T18:31:06.561 INFO:tasks.workunit.client.0.smithi033.stdout:4/572: write d4/d3c/f51 [3000337,88531] 0 2024-02-15T18:31:06.561 INFO:tasks.workunit.client.0.smithi033.stdout:8/414: write d0/df/db/d1b/d4b/f4c [2239726,125657] 0 2024-02-15T18:31:06.561 INFO:tasks.workunit.client.0.smithi033.stdout:4/573: chown d4/d3c/faf 161741 1 2024-02-15T18:31:06.561 INFO:tasks.workunit.client.0.smithi033.stdout:2/566: dread d20/d3a/d4a/d5e/f7d [0,4194304] 0 2024-02-15T18:31:06.561 INFO:tasks.workunit.client.0.smithi033.stdout:8/415: dread - d0/df/db/d1b/d4b/f7d zero size 2024-02-15T18:31:06.561 INFO:tasks.workunit.client.0.smithi033.stdout:4/574: fdatasync d4/d5/d28/f36 0 2024-02-15T18:31:06.562 INFO:tasks.workunit.client.0.smithi033.stdout:8/416: rename d0/d2/d35/d58/c68 to d0/df/db/c82 0 2024-02-15T18:31:06.563 INFO:tasks.workunit.client.0.smithi033.stdout:2/567: creat d20/d3a/d4a/d5e/d6b/fd0 x:0 0 0 2024-02-15T18:31:06.564 INFO:tasks.workunit.client.0.smithi033.stdout:8/417: mknod d0/d2/d14/d56/d59/c83 0 2024-02-15T18:31:06.564 INFO:tasks.workunit.client.0.smithi033.stdout:2/568: symlink d20/d31/d47/d82/ld1 0 2024-02-15T18:31:06.566 INFO:tasks.workunit.client.0.smithi033.stdout:8/418: link d0/df/db/f23 d0/d2/d14/d56/f84 0 2024-02-15T18:31:06.567 INFO:tasks.workunit.client.0.smithi033.stdout:2/569: mknod d20/d31/d47/cd2 0 2024-02-15T18:31:06.567 INFO:tasks.workunit.client.0.smithi033.stdout:2/570: chown d20/d3a/d4a/d5e/d6b/d88/l94 1494 1 2024-02-15T18:31:06.572 INFO:tasks.workunit.client.0.smithi033.stdout:0/513: dwrite d0/d8/d54/f90 [0,4194304] 0 2024-02-15T18:31:06.572 INFO:tasks.workunit.client.0.smithi033.stdout:0/514: chown d0/d64/d1d/c92 42236 1 2024-02-15T18:31:06.573 INFO:tasks.workunit.client.0.smithi033.stdout:6/602: dwrite d8/f5b [0,4194304] 0 2024-02-15T18:31:06.573 INFO:tasks.workunit.client.0.smithi033.stdout:3/495: dwrite d2/f6d [0,4194304] 0 2024-02-15T18:31:06.577 INFO:tasks.workunit.client.0.smithi033.stdout:5/615: dwrite d1/da/d11/f30 [0,4194304] 0 2024-02-15T18:31:06.578 INFO:tasks.workunit.client.0.smithi033.stdout:5/616: dread - d1/f79 zero size 2024-02-15T18:31:06.579 INFO:tasks.workunit.client.0.smithi033.stdout:1/555: getdents d5/d9/d1e/d20/d5c/d57 0 2024-02-15T18:31:06.579 INFO:tasks.workunit.client.0.smithi033.stdout:9/464: dwrite d4/d8/dd/d5c/f6a [4194304,4194304] 0 2024-02-15T18:31:06.588 INFO:tasks.workunit.client.0.smithi033.stdout:3/496: rename d2/f1d to d2/d14/d23/d68/d73/f9b 0 2024-02-15T18:31:06.589 INFO:tasks.workunit.client.0.smithi033.stdout:5/617: creat d1/da/d11/d5e/db1/fc2 x:0 0 0 2024-02-15T18:31:06.590 INFO:tasks.workunit.client.0.smithi033.stdout:5/618: dread - d1/da/d11/d5e/db1/fc2 zero size 2024-02-15T18:31:06.590 INFO:tasks.workunit.client.0.smithi033.stdout:5/619: dread - d1/da/d11/d5e/db1/fc2 zero size 2024-02-15T18:31:06.590 INFO:tasks.workunit.client.0.smithi033.stdout:5/620: write d1/da/d11/d5e/db1/d63/d61/da3/fb0 [17539,34686] 0 2024-02-15T18:31:06.590 INFO:tasks.workunit.client.0.smithi033.stdout:5/621: dread - d1/f5c zero size 2024-02-15T18:31:06.590 INFO:tasks.workunit.client.0.smithi033.stdout:0/515: dread d0/d8/d54/f90 [0,4194304] 0 2024-02-15T18:31:06.590 INFO:tasks.workunit.client.0.smithi033.stdout:1/556: creat d5/d9/d1e/fab x:0 0 0 2024-02-15T18:31:06.590 INFO:tasks.workunit.client.0.smithi033.stdout:0/516: write d0/d64/d1d/f21 [4069147,11733] 0 2024-02-15T18:31:06.591 INFO:tasks.workunit.client.0.smithi033.stdout:5/622: mkdir d1/dc3 0 2024-02-15T18:31:06.592 INFO:tasks.workunit.client.0.smithi033.stdout:5/623: mknod d1/da/d19/d3f/d68/cc4 0 2024-02-15T18:31:06.593 INFO:tasks.workunit.client.0.smithi033.stdout:5/624: link d1/da/d10/c35 d1/da/d10/cc5 0 2024-02-15T18:31:06.593 INFO:tasks.workunit.client.0.smithi033.stdout:5/625: dread - d1/da/d10/f8a zero size 2024-02-15T18:31:06.595 INFO:tasks.workunit.client.0.smithi033.stdout:5/626: link d1/f5d d1/da/d52/fc6 0 2024-02-15T18:31:06.595 INFO:tasks.workunit.client.0.smithi033.stdout:1/557: write d5/dd/d12/d49/f44 [3460915,37788] 0 2024-02-15T18:31:06.595 INFO:tasks.workunit.client.0.smithi033.stdout:3/497: write d2/d14/d23/f66 [3762279,42570] 0 2024-02-15T18:31:06.596 INFO:tasks.workunit.client.0.smithi033.stdout:1/558: mknod d5/d9/d1e/d20/d2c/d34/cac 0 2024-02-15T18:31:06.596 INFO:tasks.workunit.client.0.smithi033.stdout:0/517: write d0/d8/d15/d2d/fab [500942,59786] 0 2024-02-15T18:31:06.596 INFO:tasks.workunit.client.0.smithi033.stdout:1/559: fsync d5/d9/f97 0 2024-02-15T18:31:06.596 INFO:tasks.workunit.client.0.smithi033.stdout:1/560: chown d5/dd/d12/d49/d23/f72 3651 1 2024-02-15T18:31:06.597 INFO:tasks.workunit.client.0.smithi033.stdout:5/627: symlink d1/da/d52/lc7 0 2024-02-15T18:31:06.599 INFO:tasks.workunit.client.0.smithi033.stdout:8/419: dwrite d0/df/db/f40 [0,4194304] 0 2024-02-15T18:31:06.599 INFO:tasks.workunit.client.0.smithi033.stdout:3/498: read d2/d3/d17/f69 [3352068,95828] 0 2024-02-15T18:31:06.599 INFO:tasks.workunit.client.0.smithi033.stdout:8/420: fsync d0/d2/f41 0 2024-02-15T18:31:06.599 INFO:tasks.workunit.client.0.smithi033.stdout:0/518: link d0/d2/f3 d0/fad 0 2024-02-15T18:31:06.600 INFO:tasks.workunit.client.0.smithi033.stdout:4/575: dwrite d4/d20/d13/f31 [0,4194304] 0 2024-02-15T18:31:06.600 INFO:tasks.workunit.client.0.smithi033.stdout:6/603: dwrite d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/d81/f9a [0,4194304] 0 2024-02-15T18:31:06.600 INFO:tasks.workunit.client.0.smithi033.stdout:9/465: dwrite d4/d8/dd/f15 [0,4194304] 0 2024-02-15T18:31:06.602 INFO:tasks.workunit.client.0.smithi033.stdout:2/571: getdents d20/d31/d47/d82 0 2024-02-15T18:31:06.603 INFO:tasks.workunit.client.0.smithi033.stdout:3/499: creat d2/d3/d1e/f9c x:0 0 0 2024-02-15T18:31:06.603 INFO:tasks.workunit.client.0.smithi033.stdout:3/500: readlink d2/d3/d1e/d22/d59/l78 0 2024-02-15T18:31:06.608 INFO:tasks.workunit.client.0.smithi033.stdout:0/519: rename d0/d8/d15/d4b to d0/d8/d15/d8b/da3/dae 0 2024-02-15T18:31:06.609 INFO:tasks.workunit.client.0.smithi033.stdout:4/576: truncate d4/d20/d13/f6e 1802804 0 2024-02-15T18:31:06.611 INFO:tasks.workunit.client.0.smithi033.stdout:6/604: unlink d8/d28/d36/l4d 0 2024-02-15T18:31:06.612 INFO:tasks.workunit.client.0.smithi033.stdout:9/466: dread d4/d8/d1b/d61/f7a [0,4194304] 0 2024-02-15T18:31:06.618 INFO:tasks.workunit.client.0.smithi033.stdout:2/572: dread d20/d31/d47/d4c/f63 [0,4194304] 0 2024-02-15T18:31:06.618 INFO:tasks.workunit.client.0.smithi033.stdout:5/628: write d1/da/d19/f57 [1480067,101803] 0 2024-02-15T18:31:06.618 INFO:tasks.workunit.client.0.smithi033.stdout:1/561: dwrite d5/dd/f3e [0,4194304] 0 2024-02-15T18:31:06.619 INFO:tasks.workunit.client.0.smithi033.stdout:2/573: write d20/d3a/d4a/d5e/d6b/d88/fb3 [144740,95433] 0 2024-02-15T18:31:06.619 INFO:tasks.workunit.client.0.smithi033.stdout:2/574: dread - d20/d3a/d4a/d5e/d6b/d88/da6/fb2 zero size 2024-02-15T18:31:06.619 INFO:tasks.workunit.client.0.smithi033.stdout:2/575: fdatasync d20/d73/fac 0 2024-02-15T18:31:06.627 INFO:tasks.workunit.client.0.smithi033.stdout:6/605: dread d8/d28/f18 [0,4194304] 0 2024-02-15T18:31:06.627 INFO:tasks.workunit.client.0.smithi033.stdout:3/501: dwrite d2/d3/df/f8f [0,4194304] 0 2024-02-15T18:31:06.627 INFO:tasks.workunit.client.0.smithi033.stdout:9/467: dread d4/d8/dd/d28/f8f [0,4194304] 0 2024-02-15T18:31:06.627 INFO:tasks.workunit.client.0.smithi033.stdout:9/468: chown d4/d8/dd/f63 58534 1 2024-02-15T18:31:06.630 INFO:tasks.workunit.client.0.smithi033.stdout:8/421: dread d0/d1c/d30/f74 [0,4194304] 0 2024-02-15T18:31:06.631 INFO:tasks.workunit.client.0.smithi033.stdout:0/520: creat d0/d8/d15/d2d/d41/d73/d96/faf x:0 0 0 2024-02-15T18:31:06.631 INFO:tasks.workunit.client.0.smithi033.stdout:4/577: creat d4/d20/fbf x:0 0 0 2024-02-15T18:31:06.633 INFO:tasks.workunit.client.0.smithi033.stdout:1/562: creat d5/d9/d1e/d20/d2c/d34/d51/fad x:0 0 0 2024-02-15T18:31:06.636 INFO:tasks.workunit.client.0.smithi033.stdout:9/469: dread d4/d32/d6c/f8c [0,4194304] 0 2024-02-15T18:31:06.637 INFO:tasks.workunit.client.0.smithi033.stdout:8/422: read d0/d2/d14/d56/d59/f6c [276466,95283] 0 2024-02-15T18:31:06.637 INFO:tasks.workunit.client.0.smithi033.stdout:9/470: write d4/d8/dd/d41/d51/f89 [763325,96646] 0 2024-02-15T18:31:06.637 INFO:tasks.workunit.client.0.smithi033.stdout:5/629: creat d1/da/d19/d3c/d40/fc8 x:0 0 0 2024-02-15T18:31:06.637 INFO:tasks.workunit.client.0.smithi033.stdout:5/630: dread - d1/da/d52/f99 zero size 2024-02-15T18:31:06.638 INFO:tasks.workunit.client.0.smithi033.stdout:6/606: symlink d8/d1d/d37/d72/lc0 0 2024-02-15T18:31:06.638 INFO:tasks.workunit.client.0.smithi033.stdout:6/607: chown d8/d1d/d37/d4f 8 1 2024-02-15T18:31:06.638 INFO:tasks.workunit.client.0.smithi033.stdout:3/502: dread d2/f6d [0,4194304] 0 2024-02-15T18:31:06.638 INFO:tasks.workunit.client.0.smithi033.stdout:9/471: read d4/d8/dd/d41/d51/f69 [598134,28517] 0 2024-02-15T18:31:06.641 INFO:tasks.workunit.client.0.smithi033.stdout:4/578: getdents d4/d5/d28/d39/d62/d9c 0 2024-02-15T18:31:06.641 INFO:tasks.workunit.client.0.smithi033.stdout:4/579: truncate d4/d20/f7a 963062 0 2024-02-15T18:31:06.641 INFO:tasks.workunit.client.0.smithi033.stdout:8/423: symlink d0/d2/l85 0 2024-02-15T18:31:06.641 INFO:tasks.workunit.client.0.smithi033.stdout:1/563: creat d5/d38/fae x:0 0 0 2024-02-15T18:31:06.641 INFO:tasks.workunit.client.0.smithi033.stdout:3/503: symlink d2/d20/l9d 0 2024-02-15T18:31:06.645 INFO:tasks.workunit.client.0.smithi033.stdout:9/472: write d4/d8/f46 [256684,89702] 0 2024-02-15T18:31:06.645 INFO:tasks.workunit.client.0.smithi033.stdout:9/473: dread - d4/d8/dd/d41/d51/f55 zero size 2024-02-15T18:31:06.645 INFO:tasks.workunit.client.0.smithi033.stdout:9/474: stat d4/d8/dd/d28 0 2024-02-15T18:31:06.647 INFO:tasks.workunit.client.0.smithi033.stdout:2/576: dwrite d20/d3a/d4a/d5e/d6b/d88/fb3 [0,4194304] 0 2024-02-15T18:31:06.648 INFO:tasks.workunit.client.0.smithi033.stdout:2/577: fdatasync d20/d3a/d4a/d5e/d6b/f8f 0 2024-02-15T18:31:06.649 INFO:tasks.workunit.client.0.smithi033.stdout:8/424: rename d0/d2/l24 to d0/df/l86 0 2024-02-15T18:31:06.649 INFO:tasks.workunit.client.0.smithi033.stdout:8/425: chown d0/d1c/d30/l5b 149370 1 2024-02-15T18:31:06.649 INFO:tasks.workunit.client.0.smithi033.stdout:3/504: creat d2/d14/f9e x:0 0 0 2024-02-15T18:31:06.650 INFO:tasks.workunit.client.0.smithi033.stdout:4/580: link d4/f7 d4/d20/d13/d34/d82/fc0 0 2024-02-15T18:31:06.650 INFO:tasks.workunit.client.0.smithi033.stdout:0/521: dread d0/d64/d1d/f1e [0,4194304] 0 2024-02-15T18:31:06.656 INFO:tasks.workunit.client.0.smithi033.stdout:9/475: mknod d4/d8/dd/d28/d6b/ca8 0 2024-02-15T18:31:06.657 INFO:tasks.workunit.client.0.smithi033.stdout:2/578: rmdir d20/d39 39 2024-02-15T18:31:06.658 INFO:tasks.workunit.client.0.smithi033.stdout:8/426: truncate d0/df/d53/f5d 1554886 0 2024-02-15T18:31:06.660 INFO:tasks.workunit.client.0.smithi033.stdout:3/505: creat d2/d3/f9f x:0 0 0 2024-02-15T18:31:06.660 INFO:tasks.workunit.client.0.smithi033.stdout:3/506: chown d2/d3/f9f 937 1 2024-02-15T18:31:06.661 INFO:tasks.workunit.client.0.smithi033.stdout:4/581: creat d4/d20/d13/d1b/d7c/fc1 x:0 0 0 2024-02-15T18:31:06.661 INFO:tasks.workunit.client.0.smithi033.stdout:1/564: rmdir d5/d9/d1e 39 2024-02-15T18:31:06.662 INFO:tasks.workunit.client.0.smithi033.stdout:1/565: read - d5/d9/f97 zero size 2024-02-15T18:31:06.668 INFO:tasks.workunit.client.0.smithi033.stdout:6/608: dwrite d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/f7f [0,4194304] 0 2024-02-15T18:31:06.668 INFO:tasks.workunit.client.0.smithi033.stdout:8/427: dread d0/df/db/d1b/d4b/f4c [0,4194304] 0 2024-02-15T18:31:06.669 INFO:tasks.workunit.client.0.smithi033.stdout:6/609: write d8/d28/d14/d2c/d3b/d3d/f48 [596472,75528] 0 2024-02-15T18:31:06.670 INFO:tasks.workunit.client.0.smithi033.stdout:0/522: rmdir d0/d8/d15/d8b/da3/dae 39 2024-02-15T18:31:06.670 INFO:tasks.workunit.client.0.smithi033.stdout:9/476: symlink d4/d8/d1b/d73/la9 0 2024-02-15T18:31:06.670 INFO:tasks.workunit.client.0.smithi033.stdout:2/579: link d20/d73/fac d20/d31/d47/d82/fd3 0 2024-02-15T18:31:06.670 INFO:tasks.workunit.client.0.smithi033.stdout:9/477: read d4/d8/d1b/d2f/f30 [5047602,70531] 0 2024-02-15T18:31:06.674 INFO:tasks.workunit.client.0.smithi033.stdout:3/507: unlink d2/d20/c85 0 2024-02-15T18:31:06.674 INFO:tasks.workunit.client.0.smithi033.stdout:1/566: dread d5/dd/d12/d49/f21 [0,4194304] 0 2024-02-15T18:31:06.676 INFO:tasks.workunit.client.0.smithi033.stdout:3/508: write d2/f6d [868340,124868] 0 2024-02-15T18:31:06.676 INFO:tasks.workunit.client.0.smithi033.stdout:8/428: creat d0/df/db/f87 x:0 0 0 2024-02-15T18:31:06.676 INFO:tasks.workunit.client.0.smithi033.stdout:6/610: symlink d8/d1d/d37/d4f/dbb/d83/lc1 0 2024-02-15T18:31:06.680 INFO:tasks.workunit.client.0.smithi033.stdout:6/611: write d8/f4e [847257,61159] 0 2024-02-15T18:31:06.680 INFO:tasks.workunit.client.0.smithi033.stdout:0/523: rename d0/d8/d15/d2d/f66 to d0/d8/d15/d8b/da3/dae/d58/fb0 0 2024-02-15T18:31:06.681 INFO:tasks.workunit.client.0.smithi033.stdout:4/582: dwrite d4/d5/d28/d39/d62/d9c/fb7 [0,4194304] 0 2024-02-15T18:31:06.681 INFO:tasks.workunit.client.0.smithi033.stdout:4/583: chown d4/d20/d13/d1b/la2 3096 1 2024-02-15T18:31:06.682 INFO:tasks.workunit.client.0.smithi033.stdout:2/580: mknod d20/d31/d47/d4c/d6c/cd4 0 2024-02-15T18:31:06.682 INFO:tasks.workunit.client.0.smithi033.stdout:9/478: truncate d4/d8/dd/d41/d51/f89 4598 0 2024-02-15T18:31:06.684 INFO:tasks.workunit.client.0.smithi033.stdout:1/567: truncate d5/d9/d1e/d20/d2c/d34/d51/f6f 2218510 0 2024-02-15T18:31:06.686 INFO:tasks.workunit.client.0.smithi033.stdout:3/509: unlink d2/d14/d23/d68/d73/d76/f90 0 2024-02-15T18:31:06.689 INFO:tasks.workunit.client.0.smithi033.stdout:9/479: write d4/d8/dd/d28/f4c [1619789,46132] 0 2024-02-15T18:31:06.689 INFO:tasks.workunit.client.0.smithi033.stdout:6/612: rmdir d8/d28/d36/d7d 0 2024-02-15T18:31:06.689 INFO:tasks.workunit.client.0.smithi033.stdout:8/429: dread d0/d1c/d30/f74 [0,4194304] 0 2024-02-15T18:31:06.690 INFO:tasks.workunit.client.0.smithi033.stdout:0/524: rename d0/d8/d15/d2d/d3f/d6f to d0/d8/d15/d2d/d3f/d97/db1 0 2024-02-15T18:31:06.691 INFO:tasks.workunit.client.0.smithi033.stdout:2/581: mknod d20/d3a/d4a/cd5 0 2024-02-15T18:31:06.693 INFO:tasks.workunit.client.0.smithi033.stdout:3/510: getdents d2 0 2024-02-15T18:31:06.694 INFO:tasks.workunit.client.0.smithi033.stdout:2/582: read d20/d3a/d4a/d5e/f61 [992205,27787] 0 2024-02-15T18:31:06.696 INFO:tasks.workunit.client.0.smithi033.stdout:6/613: creat d8/d70/fc2 x:0 0 0 2024-02-15T18:31:06.698 INFO:tasks.workunit.client.0.smithi033.stdout:3/511: write d2/d14/f55 [5140789,69579] 0 2024-02-15T18:31:06.698 INFO:tasks.workunit.client.0.smithi033.stdout:3/512: write d2/d14/d23/d68/d73/d83/f97 [261556,26476] 0 2024-02-15T18:31:06.699 INFO:tasks.workunit.client.0.smithi033.stdout:9/480: dread d4/f45 [0,4194304] 0 2024-02-15T18:31:06.701 INFO:tasks.workunit.client.0.smithi033.stdout:8/430: symlink d0/d1c/d30/l88 0 2024-02-15T18:31:06.703 INFO:tasks.workunit.client.0.smithi033.stdout:6/614: rename d8/d1d/d37/d4f/dbb/d83 to d8/d28/d14/d2c/d31/d30/d29/dc3 0 2024-02-15T18:31:06.704 INFO:tasks.workunit.client.0.smithi033.stdout:4/584: dwrite d4/d5/f55 [0,4194304] 0 2024-02-15T18:31:06.705 INFO:tasks.workunit.client.0.smithi033.stdout:6/615: creat d8/d1d/d37/d4f/dbb/d55/d63/fc4 x:0 0 0 2024-02-15T18:31:06.708 INFO:tasks.workunit.client.0.smithi033.stdout:4/585: mknod d4/d5/d28/d39/d62/d9c/d9e/da4/db1/cc2 0 2024-02-15T18:31:06.711 INFO:tasks.workunit.client.0.smithi033.stdout:8/431: dread d0/df/f38 [0,4194304] 0 2024-02-15T18:31:06.711 INFO:tasks.workunit.client.0.smithi033.stdout:9/481: dread d4/d8/fb [0,4194304] 0 2024-02-15T18:31:06.714 INFO:tasks.workunit.client.0.smithi033.stdout:4/586: write d4/d5/d28/d39/d62/d9c/fb7 [3131197,128080] 0 2024-02-15T18:31:06.714 INFO:tasks.workunit.client.0.smithi033.stdout:1/568: dwrite d5/d38/f6e [0,4194304] 0 2024-02-15T18:31:06.717 INFO:tasks.workunit.client.0.smithi033.stdout:8/432: mknod d0/df/db/d1b/d4b/d72/c89 0 2024-02-15T18:31:06.717 INFO:tasks.workunit.client.0.smithi033.stdout:8/433: stat d0/df/d53/f5d 0 2024-02-15T18:31:06.720 INFO:tasks.workunit.client.0.smithi033.stdout:8/434: getdents d0/d2/d35 0 2024-02-15T18:31:06.721 INFO:tasks.workunit.client.0.smithi033.stdout:8/435: creat d0/df/db/d45/f8a x:0 0 0 2024-02-15T18:31:06.721 INFO:tasks.workunit.client.0.smithi033.stdout:8/436: readlink d0/l47 0 2024-02-15T18:31:06.721 INFO:tasks.workunit.client.0.smithi033.stdout:9/482: write d4/d8/f20 [2507095,70334] 0 2024-02-15T18:31:06.726 INFO:tasks.workunit.client.0.smithi033.stdout:9/483: dread d4/d8/dd/d28/f2b [4194304,4194304] 0 2024-02-15T18:31:06.727 INFO:tasks.workunit.client.0.smithi033.stdout:4/587: dread d4/d20/f9 [0,4194304] 0 2024-02-15T18:31:06.727 INFO:tasks.workunit.client.0.smithi033.stdout:9/484: mknod d4/d8/dd/d28/d6b/caa 0 2024-02-15T18:31:06.729 INFO:tasks.workunit.client.0.smithi033.stdout:4/588: getdents d4 0 2024-02-15T18:31:06.729 INFO:tasks.workunit.client.0.smithi033.stdout:7/520: sync 2024-02-15T18:31:06.731 INFO:tasks.workunit.client.0.smithi033.stdout:9/485: creat d4/d32/fab x:0 0 0 2024-02-15T18:31:06.731 INFO:tasks.workunit.client.0.smithi033.stdout:9/486: stat d4/d8/d1b/d73/la9 0 2024-02-15T18:31:06.732 INFO:tasks.workunit.client.0.smithi033.stdout:3/513: dwrite d2/f5 [0,4194304] 0 2024-02-15T18:31:06.734 INFO:tasks.workunit.client.0.smithi033.stdout:6/616: dwrite d8/d28/d14/d2c/d31/d5d/fa2 [0,4194304] 0 2024-02-15T18:31:06.734 INFO:tasks.workunit.client.0.smithi033.stdout:6/617: write d8/d28/d14/d2c/d31/d30/fa4 [899681,121944] 0 2024-02-15T18:31:06.734 INFO:tasks.workunit.client.0.smithi033.stdout:6/618: truncate d8/d28/d14/d2c/d31/d5d/d8c/fbe 741892 0 2024-02-15T18:31:06.735 INFO:tasks.workunit.client.0.smithi033.stdout:0/525: dwrite d0/d8/d15/d8b/da3/f8e [0,4194304] 0 2024-02-15T18:31:06.735 INFO:tasks.workunit.client.0.smithi033.stdout:7/521: rmdir d0/dc/d10 39 2024-02-15T18:31:06.738 INFO:tasks.workunit.client.0.smithi033.stdout:4/589: stat d4/d20/c50 0 2024-02-15T18:31:06.741 INFO:tasks.workunit.client.0.smithi033.stdout:3/514: link d2/d14/d23/d5c/d61/c81 d2/d14/d23/d68/d73/ca0 0 2024-02-15T18:31:06.744 INFO:tasks.workunit.client.0.smithi033.stdout:0/526: truncate d0/d8/d15/d8b/da3/dae/f71 7150019 0 2024-02-15T18:31:06.744 INFO:tasks.workunit.client.0.smithi033.stdout:7/522: rmdir d0/d56/d70/d91 39 2024-02-15T18:31:06.745 INFO:tasks.workunit.client.0.smithi033.stdout:3/515: truncate d2/d3/d1e/f4f 2273196 0 2024-02-15T18:31:06.745 INFO:tasks.workunit.client.0.smithi033.stdout:4/590: write d4/d20/d13/fa3 [2301125,24369] 0 2024-02-15T18:31:06.746 INFO:tasks.workunit.client.0.smithi033.stdout:6/619: rename d8/d28/d14/d2c/d3b/f86 to d8/d1d/d37/d4f/dbb/d55/d63/fc5 0 2024-02-15T18:31:06.747 INFO:tasks.workunit.client.0.smithi033.stdout:6/620: read d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/d81/fbc [3273470,7251] 0 2024-02-15T18:31:06.747 INFO:tasks.workunit.client.0.smithi033.stdout:0/527: creat d0/d8/d15/d8b/da3/dae/d58/d80/d9b/fb2 x:0 0 0 2024-02-15T18:31:06.748 INFO:tasks.workunit.client.0.smithi033.stdout:8/437: dwrite d0/d2/d35/f4f [0,4194304] 0 2024-02-15T18:31:06.750 INFO:tasks.workunit.client.0.smithi033.stdout:7/523: rename d0/dc/f41 to d0/dc/d10/d1d/d2b/fb1 0 2024-02-15T18:31:06.750 INFO:tasks.workunit.client.0.smithi033.stdout:4/591: read d4/d20/d13/fa3 [3463569,69198] 0 2024-02-15T18:31:06.750 INFO:tasks.workunit.client.0.smithi033.stdout:4/592: write d4/f15 [3063365,121388] 0 2024-02-15T18:31:06.750 INFO:tasks.workunit.client.0.smithi033.stdout:4/593: readlink d4/d20/d13/d1b/l80 0 2024-02-15T18:31:06.750 INFO:tasks.workunit.client.0.smithi033.stdout:0/528: getdents d0/d8/d15/d8b/da3/dae 0 2024-02-15T18:31:06.750 INFO:tasks.workunit.client.0.smithi033.stdout:3/516: write d2/d3/d1e/d22/d59/f5e [2290221,72208] 0 2024-02-15T18:31:06.751 INFO:tasks.workunit.client.0.smithi033.stdout:3/517: write d2/d3/d17/f69 [4456466,130692] 0 2024-02-15T18:31:06.755 INFO:tasks.workunit.client.0.smithi033.stdout:8/438: mknod d0/df/d53/c8b 0 2024-02-15T18:31:06.755 INFO:tasks.workunit.client.0.smithi033.stdout:7/524: truncate d0/f1c 4600964 0 2024-02-15T18:31:06.755 INFO:tasks.workunit.client.0.smithi033.stdout:9/487: dwrite d4/d8/dd/d41/d51/f55 [0,4194304] 0 2024-02-15T18:31:06.756 INFO:tasks.workunit.client.0.smithi033.stdout:0/529: mknod d0/d8/d15/d5b/d94/cb3 0 2024-02-15T18:31:06.758 INFO:tasks.workunit.client.0.smithi033.stdout:7/525: creat d0/dc/d10/d7d/d99/fb2 x:0 0 0 2024-02-15T18:31:06.761 INFO:tasks.workunit.client.0.smithi033.stdout:8/439: write d0/df/db/d1b/f27 [375512,88718] 0 2024-02-15T18:31:06.762 INFO:tasks.workunit.client.0.smithi033.stdout:8/440: write d0/d1c/f3e [3996603,75997] 0 2024-02-15T18:31:06.769 INFO:tasks.workunit.client.0.smithi033.stdout:9/488: getdents d4/d8/d1b/d73 0 2024-02-15T18:31:06.774 INFO:tasks.workunit.client.0.smithi033.stdout:4/594: dwrite d4/d20/d37/fbc [0,4194304] 0 2024-02-15T18:31:06.774 INFO:tasks.workunit.client.0.smithi033.stdout:9/489: mknod d4/d9f/cac 0 2024-02-15T18:31:06.774 INFO:tasks.workunit.client.0.smithi033.stdout:0/530: truncate d0/d8/d15/d8b/da3/d6c/f46 284635 0 2024-02-15T18:31:06.777 INFO:tasks.workunit.client.0.smithi033.stdout:4/595: mknod d4/d20/d13/d1b/cc3 0 2024-02-15T18:31:06.778 INFO:tasks.workunit.client.0.smithi033.stdout:4/596: symlink d4/d20/d13/d1b/d81/lc4 0 2024-02-15T18:31:06.778 INFO:tasks.workunit.client.0.smithi033.stdout:4/597: write d4/f46 [985186,43436] 0 2024-02-15T18:31:06.779 INFO:tasks.workunit.client.0.smithi033.stdout:4/598: mkdir d4/d20/d13/d5c/d87/dc5 0 2024-02-15T18:31:06.779 INFO:tasks.workunit.client.0.smithi033.stdout:4/599: write d4/d20/ff [5063792,99537] 0 2024-02-15T18:31:06.780 INFO:tasks.workunit.client.0.smithi033.stdout:4/600: creat d4/d20/d13/d1b/d81/d9f/fc6 x:0 0 0 2024-02-15T18:31:06.780 INFO:tasks.workunit.client.0.smithi033.stdout:4/601: chown d4/d20/ff 163 1 2024-02-15T18:31:06.780 INFO:tasks.workunit.client.0.smithi033.stdout:4/602: stat d4/d20/d37/fbc 0 2024-02-15T18:31:06.781 INFO:tasks.workunit.client.0.smithi033.stdout:4/603: write d4/d3c/f51 [952238,19857] 0 2024-02-15T18:31:06.781 INFO:tasks.workunit.client.0.smithi033.stdout:4/604: getdents d4 0 2024-02-15T18:31:06.782 INFO:tasks.workunit.client.0.smithi033.stdout:4/605: chown d4/d5/d28/d39/d62/db2/db5/lbb 9405 1 2024-02-15T18:31:06.784 INFO:tasks.workunit.client.0.smithi033.stdout:4/606: unlink d4/d20/d13/d34/d82/l8f 0 2024-02-15T18:31:06.787 INFO:tasks.workunit.client.0.smithi033.stdout:9/490: truncate d4/d8/f20 4167092 0 2024-02-15T18:31:06.787 INFO:tasks.workunit.client.0.smithi033.stdout:9/491: write d4/d8/dd/f13 [4668297,52084] 0 2024-02-15T18:31:06.788 INFO:tasks.workunit.client.0.smithi033.stdout:0/531: dread d0/fd [0,4194304] 0 2024-02-15T18:31:06.788 INFO:tasks.workunit.client.0.smithi033.stdout:7/526: dwrite d0/dc/d10/d1d/d38/d74/d7f/fac [0,4194304] 0 2024-02-15T18:31:06.788 INFO:tasks.workunit.client.0.smithi033.stdout:7/527: write d0/dc/d10/d1d/d38/d74/d7f/fa6 [696063,69536] 0 2024-02-15T18:31:06.789 INFO:tasks.workunit.client.0.smithi033.stdout:9/492: creat d4/d8/dd/d41/fad x:0 0 0 2024-02-15T18:31:06.789 INFO:tasks.workunit.client.0.smithi033.stdout:9/493: chown d4/d8/d1b/d2f/d65/f75 1187657 1 2024-02-15T18:31:06.789 INFO:tasks.workunit.client.0.smithi033.stdout:9/494: fsync d4/d8/dd/f63 0 2024-02-15T18:31:06.789 INFO:tasks.workunit.client.0.smithi033.stdout:8/441: dwrite d0/d2/d35/d29/f2e [4194304,4194304] 0 2024-02-15T18:31:06.794 INFO:tasks.workunit.client.0.smithi033.stdout:0/532: creat d0/d2/fb4 x:0 0 0 2024-02-15T18:31:06.794 INFO:tasks.workunit.client.0.smithi033.stdout:0/533: fdatasync d0/d8/d15/d8b/da3/d6c/f68 0 2024-02-15T18:31:06.794 INFO:tasks.workunit.client.0.smithi033.stdout:0/534: write d0/d8/d15/d2d/f8c [1372500,5976] 0 2024-02-15T18:31:06.799 INFO:tasks.workunit.client.0.smithi033.stdout:7/528: unlink d0/c11 0 2024-02-15T18:31:06.799 INFO:tasks.workunit.client.0.smithi033.stdout:7/529: write d0/dc/d10/d1d/d2b/f52 [219686,110667] 0 2024-02-15T18:31:06.802 INFO:tasks.workunit.client.0.smithi033.stdout:8/442: creat d0/df/db/d45/f8c x:0 0 0 2024-02-15T18:31:06.802 INFO:tasks.workunit.client.0.smithi033.stdout:8/443: fdatasync d0/f3a 0 2024-02-15T18:31:06.802 INFO:tasks.workunit.client.0.smithi033.stdout:8/444: write d0/df/db/d1b/f6a [748532,102788] 0 2024-02-15T18:31:06.804 INFO:tasks.workunit.client.0.smithi033.stdout:0/535: mknod d0/d8/d15/d8b/cb5 0 2024-02-15T18:31:06.804 INFO:tasks.workunit.client.0.smithi033.stdout:0/536: fsync d0/d2/f82 0 2024-02-15T18:31:06.804 INFO:tasks.workunit.client.0.smithi033.stdout:0/537: write d0/d8/d15/d8b/da3/dae/f71 [8111482,37408] 0 2024-02-15T18:31:06.805 INFO:tasks.workunit.client.0.smithi033.stdout:7/530: mknod d0/d56/d70/d83/cb3 0 2024-02-15T18:31:06.805 INFO:tasks.workunit.client.0.smithi033.stdout:8/445: read d0/d2/d35/d29/f46 [122389,78710] 0 2024-02-15T18:31:06.806 INFO:tasks.workunit.client.0.smithi033.stdout:0/538: getdents d0/d8/d15/d2d/d2e 0 2024-02-15T18:31:06.807 INFO:tasks.workunit.client.0.smithi033.stdout:7/531: link d0/l1e d0/dc/d10/d1d/d38/daa/lb4 0 2024-02-15T18:31:06.808 INFO:tasks.workunit.client.0.smithi033.stdout:8/446: dread d0/d2/d14/f7c [0,4194304] 0 2024-02-15T18:31:06.808 INFO:tasks.workunit.client.0.smithi033.stdout:0/539: mkdir d0/d8/d15/d8b/da3/dae/d58/d80/db6 0 2024-02-15T18:31:06.808 INFO:tasks.workunit.client.0.smithi033.stdout:0/540: rename d0/d8/d15/d8b/da3/dae/d58/d80/db6 to d0/d8/d15/d8b/da3/dae/d58/d80/db6/db7 22 2024-02-15T18:31:06.809 INFO:tasks.workunit.client.0.smithi033.stdout:0/541: fsync d0/d2/fb4 0 2024-02-15T18:31:06.809 INFO:tasks.workunit.client.0.smithi033.stdout:8/447: write d0/d2/d35/d29/f46 [3946,70739] 0 2024-02-15T18:31:06.810 INFO:tasks.workunit.client.0.smithi033.stdout:7/532: creat d0/d56/d70/d91/d9e/fb5 x:0 0 0 2024-02-15T18:31:06.810 INFO:tasks.workunit.client.0.smithi033.stdout:7/533: write d0/dc/d10/d48/d4b/f54 [4081810,117835] 0 2024-02-15T18:31:06.812 INFO:tasks.workunit.client.0.smithi033.stdout:4/607: dwrite d4/d20/d13/d1b/d81/d9f/fc6 [0,4194304] 0 2024-02-15T18:31:06.812 INFO:tasks.workunit.client.0.smithi033.stdout:4/608: write d4/fb3 [593819,97874] 0 2024-02-15T18:31:06.812 INFO:tasks.workunit.client.0.smithi033.stdout:8/448: mknod d0/df/db/d45/c8d 0 2024-02-15T18:31:06.812 INFO:tasks.workunit.client.0.smithi033.stdout:9/495: dwrite d4/d8/dd/d28/f83 [0,4194304] 0 2024-02-15T18:31:06.813 INFO:tasks.workunit.client.0.smithi033.stdout:4/609: write d4/d20/ff [2658497,107772] 0 2024-02-15T18:31:06.815 INFO:tasks.workunit.client.0.smithi033.stdout:7/534: symlink d0/d56/d70/d91/d9e/lb6 0 2024-02-15T18:31:06.816 INFO:tasks.workunit.client.0.smithi033.stdout:8/449: read d0/f3a [1199947,65064] 0 2024-02-15T18:31:06.816 INFO:tasks.workunit.client.0.smithi033.stdout:8/450: fdatasync d0/df/db/f2f 0 2024-02-15T18:31:06.827 INFO:tasks.workunit.client.0.smithi033.stdout:9/496: getdents d4/d8/dd 0 2024-02-15T18:31:06.829 INFO:tasks.workunit.client.0.smithi033.stdout:9/497: write d4/d8/dd/fe [3493536,14990] 0 2024-02-15T18:31:06.835 INFO:tasks.workunit.client.0.smithi033.stdout:4/610: dwrite d4/d3c/f51 [0,4194304] 0 2024-02-15T18:31:06.835 INFO:tasks.workunit.client.0.smithi033.stdout:8/451: rename d0/d2 to d0/d1c/d30/d8e 0 2024-02-15T18:31:06.836 INFO:tasks.workunit.client.0.smithi033.stdout:0/542: dwrite d0/d8/d15/d8b/da3/dae/f71 [0,4194304] 0 2024-02-15T18:31:06.836 INFO:tasks.workunit.client.0.smithi033.stdout:7/535: symlink d0/lb7 0 2024-02-15T18:31:06.840 INFO:tasks.workunit.client.0.smithi033.stdout:4/611: creat d4/d20/d13/d34/d82/fc7 x:0 0 0 2024-02-15T18:31:06.842 INFO:tasks.workunit.client.0.smithi033.stdout:9/498: truncate d4/d8/dd/d41/f5d 4087911 0 2024-02-15T18:31:06.845 INFO:tasks.workunit.client.0.smithi033.stdout:8/452: rename d0/df/db/d1b to d0/d1c/d30/d8e/d8f 0 2024-02-15T18:31:06.845 INFO:tasks.workunit.client.0.smithi033.stdout:8/453: chown d0/df/l20 214 1 2024-02-15T18:31:06.847 INFO:tasks.workunit.client.0.smithi033.stdout:0/543: creat d0/d8/d15/d2d/d41/d73/d96/fb8 x:0 0 0 2024-02-15T18:31:06.848 INFO:tasks.workunit.client.0.smithi033.stdout:7/536: mknod d0/dc/d10/d7d/d93/d95/cb8 0 2024-02-15T18:31:06.850 INFO:tasks.workunit.client.0.smithi033.stdout:4/612: link d4/d5/ld d4/d20/d13/d34/d82/lc8 0 2024-02-15T18:31:06.851 INFO:tasks.workunit.client.0.smithi033.stdout:9/499: truncate d4/d8/f46 1648436 0 2024-02-15T18:31:06.851 INFO:tasks.workunit.client.0.smithi033.stdout:9/500: chown d4/d8/dd/f15 14 1 2024-02-15T18:31:06.851 INFO:tasks.workunit.client.0.smithi033.stdout:9/501: fsync d4/d8/dd/d41/fad 0 2024-02-15T18:31:06.853 INFO:tasks.workunit.client.0.smithi033.stdout:8/454: rename d0/d1c/d30/l5b to d0/df/l90 0 2024-02-15T18:31:06.854 INFO:tasks.workunit.client.0.smithi033.stdout:0/544: creat d0/d2/fb9 x:0 0 0 2024-02-15T18:31:06.854 INFO:tasks.workunit.client.0.smithi033.stdout:0/545: fdatasync d0/d8/fb 0 2024-02-15T18:31:06.855 INFO:tasks.workunit.client.0.smithi033.stdout:7/537: unlink d0/dc/d10/d7d/f44 0 2024-02-15T18:31:06.855 INFO:tasks.workunit.client.0.smithi033.stdout:7/538: getdents d0/dc/d10/da1 0 2024-02-15T18:31:06.857 INFO:tasks.workunit.client.0.smithi033.stdout:8/455: mknod d0/d1c/d30/d8e/d35/d29/d5f/c91 0 2024-02-15T18:31:06.857 INFO:tasks.workunit.client.0.smithi033.stdout:8/456: fdatasync d0/df/db/f3c 0 2024-02-15T18:31:06.860 INFO:tasks.workunit.client.0.smithi033.stdout:0/546: creat d0/d8/d15/d8b/da3/d6c/fba x:0 0 0 2024-02-15T18:31:06.860 INFO:tasks.workunit.client.0.smithi033.stdout:0/547: stat d0/d8/d15/d9a/fac 0 2024-02-15T18:31:06.861 INFO:tasks.workunit.client.0.smithi033.stdout:0/548: write d0/d8/d15/d2d/d3f/d97/db1/f7f [32996,60274] 0 2024-02-15T18:31:06.861 INFO:tasks.workunit.client.0.smithi033.stdout:4/613: mkdir d4/d5/dc9 0 2024-02-15T18:31:06.862 INFO:tasks.workunit.client.0.smithi033.stdout:4/614: chown d4/d20/d13/d1b/f64 3331922 1 2024-02-15T18:31:06.862 INFO:tasks.workunit.client.0.smithi033.stdout:8/457: mknod d0/d1c/d30/d8e/d14/c92 0 2024-02-15T18:31:06.862 INFO:tasks.workunit.client.0.smithi033.stdout:8/458: fdatasync d0/df/db/f2f 0 2024-02-15T18:31:06.864 INFO:tasks.workunit.client.0.smithi033.stdout:8/459: creat d0/d1c/d30/d8e/d35/f93 x:0 0 0 2024-02-15T18:31:06.864 INFO:tasks.workunit.client.0.smithi033.stdout:8/460: chown d0/d1c/d30/d8e/d14/d56/d59 553370 1 2024-02-15T18:31:06.867 INFO:tasks.workunit.client.0.smithi033.stdout:8/461: link d0/d1c/f3e d0/f94 0 2024-02-15T18:31:06.867 INFO:tasks.workunit.client.0.smithi033.stdout:7/539: write d0/f1c [2834710,15137] 0 2024-02-15T18:31:06.869 INFO:tasks.workunit.client.0.smithi033.stdout:7/540: creat d0/d56/d70/fb9 x:0 0 0 2024-02-15T18:31:06.870 INFO:tasks.workunit.client.0.smithi033.stdout:7/541: fsync d0/dc/f31 0 2024-02-15T18:31:06.870 INFO:tasks.workunit.client.0.smithi033.stdout:0/549: write d0/d64/d88/f8a [2976456,120800] 0 2024-02-15T18:31:06.871 INFO:tasks.workunit.client.0.smithi033.stdout:8/462: write d0/df/db/fc [2361222,98606] 0 2024-02-15T18:31:06.871 INFO:tasks.workunit.client.0.smithi033.stdout:8/463: truncate d0/df/db/d45/f7b 216703 0 2024-02-15T18:31:06.871 INFO:tasks.workunit.client.0.smithi033.stdout:7/542: write d0/dc/d10/d48/f5b [376038,76744] 0 2024-02-15T18:31:06.872 INFO:tasks.workunit.client.0.smithi033.stdout:0/550: creat d0/d8/d15/d5b/d94/fbb x:0 0 0 2024-02-15T18:31:06.872 INFO:tasks.workunit.client.0.smithi033.stdout:0/551: stat d0/d8/d15/d2d 0 2024-02-15T18:31:06.873 INFO:tasks.workunit.client.0.smithi033.stdout:8/464: getdents d0/d1c 0 2024-02-15T18:31:06.874 INFO:tasks.workunit.client.0.smithi033.stdout:8/465: mkdir d0/d1c/d95 0 2024-02-15T18:31:06.874 INFO:tasks.workunit.client.0.smithi033.stdout:7/543: dread d0/f27 [8388608,4194304] 0 2024-02-15T18:31:06.876 INFO:tasks.workunit.client.0.smithi033.stdout:7/544: rename d0/dc/f8a to d0/dc/d10/d1d/d2b/d5f/d63/fba 0 2024-02-15T18:31:06.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/466: symlink d0/d1c/d30/d8e/d14/d56/l96 0 2024-02-15T18:31:06.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/467: truncate d0/d1c/d30/d8e/d35/f1a 9224179 0 2024-02-15T18:31:06.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/468: chown d0/df/l20 1704237974 1 2024-02-15T18:31:06.878 INFO:tasks.workunit.client.0.smithi033.stdout:7/545: creat d0/fbb x:0 0 0 2024-02-15T18:31:06.879 INFO:tasks.workunit.client.0.smithi033.stdout:9/502: dwrite d4/d8/dd/d5c/f68 [4194304,4194304] 0 2024-02-15T18:31:06.880 INFO:tasks.workunit.client.0.smithi033.stdout:9/503: chown d4/d8/c5e 7608 1 2024-02-15T18:31:06.880 INFO:tasks.workunit.client.0.smithi033.stdout:8/469: mknod d0/d1c/d30/d8e/d14/d56/c97 0 2024-02-15T18:31:06.880 INFO:tasks.workunit.client.0.smithi033.stdout:4/615: dwrite d4/f15 [0,4194304] 0 2024-02-15T18:31:06.880 INFO:tasks.workunit.client.0.smithi033.stdout:7/546: mknod d0/dc/d10/da1/cbc 0 2024-02-15T18:31:06.887 INFO:tasks.workunit.client.0.smithi033.stdout:9/504: rmdir d4/d8/dd/d28 39 2024-02-15T18:31:06.888 INFO:tasks.workunit.client.0.smithi033.stdout:8/470: creat d0/df/db/d45/f98 x:0 0 0 2024-02-15T18:31:06.889 INFO:tasks.workunit.client.0.smithi033.stdout:5/631: sync 2024-02-15T18:31:06.892 INFO:tasks.workunit.client.0.smithi033.stdout:0/552: dwrite d0/d8/d15/d2d/d3f/f55 [0,4194304] 0 2024-02-15T18:31:06.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/616: mkdir d4/d20/d13/dca 0 2024-02-15T18:31:06.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/617: dread - d4/d20/d53/f78 zero size 2024-02-15T18:31:06.899 INFO:tasks.workunit.client.0.smithi033.stdout:7/547: creat d0/dc/d10/d7d/d93/d95/fbd x:0 0 0 2024-02-15T18:31:06.903 INFO:tasks.workunit.client.0.smithi033.stdout:0/553: link d0/d8/d15/d5b/d94/fbb d0/d8/d15/d8b/da3/dae/d58/d77/fbc 0 2024-02-15T18:31:06.905 INFO:tasks.workunit.client.0.smithi033.stdout:4/618: creat d4/d20/d13/d1b/d81/d9f/fcb x:0 0 0 2024-02-15T18:31:06.905 INFO:tasks.workunit.client.0.smithi033.stdout:1/569: sync 2024-02-15T18:31:06.905 INFO:tasks.workunit.client.0.smithi033.stdout:2/583: sync 2024-02-15T18:31:06.905 INFO:tasks.workunit.client.0.smithi033.stdout:1/570: fdatasync d5/d17/f35 0 2024-02-15T18:31:06.905 INFO:tasks.workunit.client.0.smithi033.stdout:3/518: sync 2024-02-15T18:31:06.906 INFO:tasks.workunit.client.0.smithi033.stdout:3/519: fsync d2/d20/f6a 0 2024-02-15T18:31:06.906 INFO:tasks.workunit.client.0.smithi033.stdout:8/471: dread d0/df/db/fc [0,4194304] 0 2024-02-15T18:31:06.906 INFO:tasks.workunit.client.0.smithi033.stdout:8/472: write d0/d1c/d30/d8e/d35/d29/f46 [1829959,86939] 0 2024-02-15T18:31:06.908 INFO:tasks.workunit.client.0.smithi033.stdout:2/584: symlink d20/d73/ld6 0 2024-02-15T18:31:06.909 INFO:tasks.workunit.client.0.smithi033.stdout:3/520: creat d2/d14/d23/d6f/fa1 x:0 0 0 2024-02-15T18:31:06.909 INFO:tasks.workunit.client.0.smithi033.stdout:3/521: readlink d2/d3/d17/l96 0 2024-02-15T18:31:06.910 INFO:tasks.workunit.client.0.smithi033.stdout:2/585: read d20/f3c [1112556,52718] 0 2024-02-15T18:31:06.910 INFO:tasks.workunit.client.0.smithi033.stdout:2/586: chown d20/d31/d47/l54 2645271 1 2024-02-15T18:31:06.910 INFO:tasks.workunit.client.0.smithi033.stdout:2/587: truncate d20/d3a/d4a/d5e/f69 1039845 0 2024-02-15T18:31:06.910 INFO:tasks.workunit.client.0.smithi033.stdout:8/473: read d0/df/db/f40 [3917670,117428] 0 2024-02-15T18:31:06.912 INFO:tasks.workunit.client.0.smithi033.stdout:3/522: creat d2/d14/d23/d68/fa2 x:0 0 0 2024-02-15T18:31:06.912 INFO:tasks.workunit.client.0.smithi033.stdout:3/523: chown d2/d14/f42 60867 1 2024-02-15T18:31:06.913 INFO:tasks.workunit.client.0.smithi033.stdout:3/524: getdents d2/d14/d23/d5c/d7f 0 2024-02-15T18:31:06.913 INFO:tasks.workunit.client.0.smithi033.stdout:2/588: mknod d20/d3a/d4a/d5e/d6b/d88/cd7 0 2024-02-15T18:31:06.914 INFO:tasks.workunit.client.0.smithi033.stdout:8/474: rmdir d0/d1c/d30/d8e/d14/d56/d59 39 2024-02-15T18:31:06.915 INFO:tasks.workunit.client.0.smithi033.stdout:3/525: mknod d2/d3/d1e/ca3 0 2024-02-15T18:31:06.918 INFO:tasks.workunit.client.0.smithi033.stdout:8/475: rename d0/d1c/d30/d8e/d35/d58/c60 to d0/d1c/d30/d8e/d14/d56/d59/c99 0 2024-02-15T18:31:06.918 INFO:tasks.workunit.client.0.smithi033.stdout:6/621: sync 2024-02-15T18:31:06.918 INFO:tasks.workunit.client.0.smithi033.stdout:1/571: dread d5/d9/d1e/d20/d5c/d57/d82/f87 [0,4194304] 0 2024-02-15T18:31:06.918 INFO:tasks.workunit.client.0.smithi033.stdout:3/526: creat d2/d3/fa4 x:0 0 0 2024-02-15T18:31:06.921 INFO:tasks.workunit.client.0.smithi033.stdout:8/476: mknod d0/d1c/d30/d8e/d35/d29/d5f/c9a 0 2024-02-15T18:31:06.921 INFO:tasks.workunit.client.0.smithi033.stdout:5/632: dwrite d1/da/d11/d5e/db1/d63/fab [0,4194304] 0 2024-02-15T18:31:06.921 INFO:tasks.workunit.client.0.smithi033.stdout:5/633: fsync d1/da/d19/d74/f92 0 2024-02-15T18:31:06.921 INFO:tasks.workunit.client.0.smithi033.stdout:5/634: readlink d1/da/d10/d2b/d42/d4c/l81 0 2024-02-15T18:31:06.921 INFO:tasks.workunit.client.0.smithi033.stdout:6/622: rmdir d8/d28/d14/d2c/d31 39 2024-02-15T18:31:06.922 INFO:tasks.workunit.client.0.smithi033.stdout:6/623: readlink d8/d1d/d37/d4f/dbb/d55/d60/l74 0 2024-02-15T18:31:06.922 INFO:tasks.workunit.client.0.smithi033.stdout:9/505: dwrite d4/d8/dd/f23 [0,4194304] 0 2024-02-15T18:31:06.922 INFO:tasks.workunit.client.0.smithi033.stdout:9/506: getdents d4/d8/d1b/d73 0 2024-02-15T18:31:06.923 INFO:tasks.workunit.client.0.smithi033.stdout:1/572: link d5/d9/d1e/d20/d2c/d34/cac d5/d38/caf 0 2024-02-15T18:31:06.923 INFO:tasks.workunit.client.0.smithi033.stdout:6/624: dread d8/d28/d14/d2c/d31/d30/d29/f59 [0,4194304] 0 2024-02-15T18:31:06.924 INFO:tasks.workunit.client.0.smithi033.stdout:3/527: creat d2/d14/d23/d68/d88/fa5 x:0 0 0 2024-02-15T18:31:06.927 INFO:tasks.workunit.client.0.smithi033.stdout:7/548: mkdir d0/dbe 0 2024-02-15T18:31:06.929 INFO:tasks.workunit.client.0.smithi033.stdout:8/477: getdents d0/d1c/d30/d8e/d8f 0 2024-02-15T18:31:06.930 INFO:tasks.workunit.client.0.smithi033.stdout:3/528: write d2/d14/f42 [1118273,21107] 0 2024-02-15T18:31:06.930 INFO:tasks.workunit.client.0.smithi033.stdout:3/529: write d2/d14/d23/f3e [725177,56704] 0 2024-02-15T18:31:06.930 INFO:tasks.workunit.client.0.smithi033.stdout:0/554: dwrite d0/d8/d15/d8b/da3/dae/f71 [0,4194304] 0 2024-02-15T18:31:06.930 INFO:tasks.workunit.client.0.smithi033.stdout:0/555: chown d0/d8/d15/d5b/f5d 11182928 1 2024-02-15T18:31:06.932 INFO:tasks.workunit.client.0.smithi033.stdout:5/635: unlink d1/fb5 0 2024-02-15T18:31:06.932 INFO:tasks.workunit.client.0.smithi033.stdout:5/636: chown d1/c32 1638 1 2024-02-15T18:31:06.932 INFO:tasks.workunit.client.0.smithi033.stdout:9/507: mknod d4/d8/dd/cae 0 2024-02-15T18:31:06.933 INFO:tasks.workunit.client.0.smithi033.stdout:5/637: read d1/da/fb [1575718,95244] 0 2024-02-15T18:31:06.933 INFO:tasks.workunit.client.0.smithi033.stdout:5/638: write d1/da/d19/d3c/d40/d65/f83 [1594276,17792] 0 2024-02-15T18:31:06.933 INFO:tasks.workunit.client.0.smithi033.stdout:1/573: creat d5/d9/d1e/d20/d5c/d57/fb0 x:0 0 0 2024-02-15T18:31:06.934 INFO:tasks.workunit.client.0.smithi033.stdout:1/574: write d5/d17/f35 [3376462,111147] 0 2024-02-15T18:31:06.934 INFO:tasks.workunit.client.0.smithi033.stdout:1/575: readlink d5/d9/d1e/d20/d2c/d34/l42 0 2024-02-15T18:31:06.934 INFO:tasks.workunit.client.0.smithi033.stdout:1/576: truncate d5/dd/f3e 4393431 0 2024-02-15T18:31:06.934 INFO:tasks.workunit.client.0.smithi033.stdout:6/625: creat d8/d1d/d37/d4f/dbb/fc6 x:0 0 0 2024-02-15T18:31:06.935 INFO:tasks.workunit.client.0.smithi033.stdout:8/478: getdents d0/d1c/d30/d8e/d14/d56 0 2024-02-15T18:31:06.936 INFO:tasks.workunit.client.0.smithi033.stdout:8/479: chown d0/d1c/d30/d8e/d35/d29/d5f/c9a 152 1 2024-02-15T18:31:06.938 INFO:tasks.workunit.client.0.smithi033.stdout:9/508: unlink d4/d8/c5e 0 2024-02-15T18:31:06.938 INFO:tasks.workunit.client.0.smithi033.stdout:9/509: truncate d4/d8/d1b/d2f/d65/d8b/d95/fa6 199287 0 2024-02-15T18:31:06.938 INFO:tasks.workunit.client.0.smithi033.stdout:9/510: fsync d4/d8/dd/f63 0 2024-02-15T18:31:06.938 INFO:tasks.workunit.client.0.smithi033.stdout:9/511: truncate d4/f4f 4430798 0 2024-02-15T18:31:06.939 INFO:tasks.workunit.client.0.smithi033.stdout:5/639: creat d1/da/fc9 x:0 0 0 2024-02-15T18:31:06.939 INFO:tasks.workunit.client.0.smithi033.stdout:5/640: readlink d1/da/d10/d2b/l73 0 2024-02-15T18:31:06.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/589: dwrite d20/d73/fcb [0,4194304] 0 2024-02-15T18:31:06.945 INFO:tasks.workunit.client.0.smithi033.stdout:5/641: getdents d1/da/d10/d2b/d42/d4c 0 2024-02-15T18:31:06.945 INFO:tasks.workunit.client.0.smithi033.stdout:0/556: dread d0/d64/d1d/f43 [0,4194304] 0 2024-02-15T18:31:06.949 INFO:tasks.workunit.client.0.smithi033.stdout:8/480: dread d0/d1c/d30/d8e/d8f/f6a [0,4194304] 0 2024-02-15T18:31:06.949 INFO:tasks.workunit.client.0.smithi033.stdout:8/481: readlink d0/df/db/l15 0 2024-02-15T18:31:06.950 INFO:tasks.workunit.client.0.smithi033.stdout:8/482: truncate d0/d1c/d30/f74 1446588 0 2024-02-15T18:31:06.951 INFO:tasks.workunit.client.0.smithi033.stdout:2/590: creat d20/d31/d47/d4c/fd8 x:0 0 0 2024-02-15T18:31:06.951 INFO:tasks.workunit.client.0.smithi033.stdout:2/591: truncate f1 5742138 0 2024-02-15T18:31:06.953 INFO:tasks.workunit.client.0.smithi033.stdout:9/512: dread d4/d8/d1b/d2f/f76 [0,4194304] 0 2024-02-15T18:31:06.953 INFO:tasks.workunit.client.0.smithi033.stdout:9/513: fdatasync f0 0 2024-02-15T18:31:06.953 INFO:tasks.workunit.client.0.smithi033.stdout:9/514: stat d4/d2c/f84 0 2024-02-15T18:31:06.953 INFO:tasks.workunit.client.0.smithi033.stdout:9/515: truncate d4/d8/dd/d5c/d6d/f7b 4636656 0 2024-02-15T18:31:06.954 INFO:tasks.workunit.client.0.smithi033.stdout:8/483: mkdir d0/df/d53/d9b 0 2024-02-15T18:31:06.954 INFO:tasks.workunit.client.0.smithi033.stdout:2/592: mknod d20/d31/d6a/cd9 0 2024-02-15T18:31:06.954 INFO:tasks.workunit.client.0.smithi033.stdout:2/593: chown d20/d3a/laf 2354 1 2024-02-15T18:31:06.954 INFO:tasks.workunit.client.0.smithi033.stdout:8/484: readlink d0/d1c/d30/d8e/l21 0 2024-02-15T18:31:06.954 INFO:tasks.workunit.client.0.smithi033.stdout:8/485: truncate d0/df/db/f87 795482 0 2024-02-15T18:31:06.955 INFO:tasks.workunit.client.0.smithi033.stdout:7/549: write d0/fbb [992811,80472] 0 2024-02-15T18:31:06.957 INFO:tasks.workunit.client.0.smithi033.stdout:9/516: rmdir d4/d8/d1b/d73 39 2024-02-15T18:31:06.957 INFO:tasks.workunit.client.0.smithi033.stdout:8/486: mknod d0/d1c/d30/d8e/d14/c9c 0 2024-02-15T18:31:06.957 INFO:tasks.workunit.client.0.smithi033.stdout:7/550: stat d0/dc/d10/d7d/d93/d95 0 2024-02-15T18:31:06.957 INFO:tasks.workunit.client.0.smithi033.stdout:7/551: readlink d0/dc/d10/d1d/l24 0 2024-02-15T18:31:06.957 INFO:tasks.workunit.client.0.smithi033.stdout:7/552: chown d0/dc/d10/d1d/d38/c6b 16251 1 2024-02-15T18:31:06.958 INFO:tasks.workunit.client.0.smithi033.stdout:9/517: mknod d4/d8/dd/caf 0 2024-02-15T18:31:06.958 INFO:tasks.workunit.client.0.smithi033.stdout:9/518: chown d4/d8/dd/d41/d51/f55 1 1 2024-02-15T18:31:06.960 INFO:tasks.workunit.client.0.smithi033.stdout:6/626: dwrite d8/d28/d14/d2c/d31/d30/f71 [0,4194304] 0 2024-02-15T18:31:06.961 INFO:tasks.workunit.client.0.smithi033.stdout:8/487: symlink d0/d1c/d30/d8e/d14/l9d 0 2024-02-15T18:31:06.968 INFO:tasks.workunit.client.0.smithi033.stdout:7/553: mknod d0/dc/d10/da1/cbf 0 2024-02-15T18:31:06.968 INFO:tasks.workunit.client.0.smithi033.stdout:9/519: rmdir d4/d8/dd/d5c/d6d 39 2024-02-15T18:31:06.968 INFO:tasks.workunit.client.0.smithi033.stdout:6/627: getdents d8/d1d/d37 0 2024-02-15T18:31:06.969 INFO:tasks.workunit.client.0.smithi033.stdout:8/488: creat d0/d1c/d30/d8e/d8f/f9e x:0 0 0 2024-02-15T18:31:06.970 INFO:tasks.workunit.client.0.smithi033.stdout:8/489: read d0/df/db/fc [3858552,85466] 0 2024-02-15T18:31:06.970 INFO:tasks.workunit.client.0.smithi033.stdout:6/628: truncate f0 756117 0 2024-02-15T18:31:06.971 INFO:tasks.workunit.client.0.smithi033.stdout:8/490: mknod d0/d1c/d30/d8e/d35/d29/c9f 0 2024-02-15T18:31:06.972 INFO:tasks.workunit.client.0.smithi033.stdout:6/629: getdents d8/d28/d14/d2c/d31/d30 0 2024-02-15T18:31:06.972 INFO:tasks.workunit.client.0.smithi033.stdout:7/554: write d0/dc/d10/d7d/f3f [1531213,35701] 0 2024-02-15T18:31:06.972 INFO:tasks.workunit.client.0.smithi033.stdout:8/491: write d0/d1c/d30/d8e/f5 [2494824,71268] 0 2024-02-15T18:31:06.972 INFO:tasks.workunit.client.0.smithi033.stdout:8/492: rename d0 to d0/d7a/da0 22 2024-02-15T18:31:06.973 INFO:tasks.workunit.client.0.smithi033.stdout:6/630: mknod d8/d1d/d37/cc7 0 2024-02-15T18:31:06.975 INFO:tasks.workunit.client.0.smithi033.stdout:6/631: write d8/d1d/d37/d4f/dbb/d57/f5a [388029,51773] 0 2024-02-15T18:31:06.975 INFO:tasks.workunit.client.0.smithi033.stdout:6/632: chown d8/d1d 6849 1 2024-02-15T18:31:06.975 INFO:tasks.workunit.client.0.smithi033.stdout:7/555: unlink d0/dc/d10/d1d/d38/f68 0 2024-02-15T18:31:06.977 INFO:tasks.workunit.client.0.smithi033.stdout:7/556: mknod d0/dc/d10/d48/cc0 0 2024-02-15T18:31:06.978 INFO:tasks.workunit.client.0.smithi033.stdout:7/557: fsync d0/dc/d10/d1d/d38/d74/d7f/fac 0 2024-02-15T18:31:06.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/558: dread d0/dc/d10/d1d/f73 [0,4194304] 0 2024-02-15T18:31:06.980 INFO:tasks.workunit.client.0.smithi033.stdout:7/559: write d0/dc/d10/d48/f81 [2192429,123573] 0 2024-02-15T18:31:06.982 INFO:tasks.workunit.client.0.smithi033.stdout:7/560: creat d0/d56/fc1 x:0 0 0 2024-02-15T18:31:06.983 INFO:tasks.workunit.client.0.smithi033.stdout:7/561: rename d0/dc/d10/d7d/d93/d95 to d0/dc/d10/d7d/d93/dc2 0 2024-02-15T18:31:06.989 INFO:tasks.workunit.client.0.smithi033.stdout:7/562: dread d0/dc/d10/d1d/d2b/d5f/d63/f79 [0,4194304] 0 2024-02-15T18:31:06.991 INFO:tasks.workunit.client.0.smithi033.stdout:7/563: creat d0/dc/d10/d1d/d38/daa/fc3 x:0 0 0 2024-02-15T18:31:06.991 INFO:tasks.workunit.client.0.smithi033.stdout:3/530: dwrite d2/d14/f42 [0,4194304] 0 2024-02-15T18:31:06.991 INFO:tasks.workunit.client.0.smithi033.stdout:8/493: dread d0/d1c/f3b [0,4194304] 0 2024-02-15T18:31:06.991 INFO:tasks.workunit.client.0.smithi033.stdout:3/531: dread - d2/d14/d23/d6f/d93/f98 zero size 2024-02-15T18:31:06.991 INFO:tasks.workunit.client.0.smithi033.stdout:0/557: dwrite d0/d8/d15/d2d/d41/d73/d96/fb8 [0,4194304] 0 2024-02-15T18:31:06.991 INFO:tasks.workunit.client.0.smithi033.stdout:0/558: chown d0/c27 0 1 2024-02-15T18:31:06.993 INFO:tasks.workunit.client.0.smithi033.stdout:8/494: mkdir d0/d1c/d30/d8e/d35/d58/da1 0 2024-02-15T18:31:06.995 INFO:tasks.workunit.client.0.smithi033.stdout:0/559: symlink d0/d8/d15/d7c/d9e/lbd 0 2024-02-15T18:31:06.995 INFO:tasks.workunit.client.0.smithi033.stdout:9/520: dwrite d4/d8/dd/d41/d51/f52 [0,4194304] 0 2024-02-15T18:31:06.996 INFO:tasks.workunit.client.0.smithi033.stdout:2/594: dwrite d20/d31/f7c [0,4194304] 0 2024-02-15T18:31:06.996 INFO:tasks.workunit.client.0.smithi033.stdout:2/595: fdatasync d20/d31/d47/d4c/d6c/f7b 0 2024-02-15T18:31:07.001 INFO:tasks.workunit.client.0.smithi033.stdout:8/495: creat d0/d1c/d30/d8e/d35/d58/da1/fa2 x:0 0 0 2024-02-15T18:31:07.002 INFO:tasks.workunit.client.0.smithi033.stdout:6/633: fsync f0 0 2024-02-15T18:31:07.005 INFO:tasks.workunit.client.0.smithi033.stdout:3/532: dread d2/d3/df/d6c/f72 [0,4194304] 0 2024-02-15T18:31:07.014 INFO:tasks.workunit.client.0.smithi033.stdout:8/496: unlink d0/d1c/d30/d8e/l2d 0 2024-02-15T18:31:07.014 INFO:tasks.workunit.client.0.smithi033.stdout:8/497: fsync d0/d1c/d30/d8e/d14/d56/d59/f6c 0 2024-02-15T18:31:07.022 INFO:tasks.workunit.client.0.smithi033.stdout:0/560: dread d0/d8/d15/d2d/d3f/f55 [0,4194304] 0 2024-02-15T18:31:07.022 INFO:tasks.workunit.client.0.smithi033.stdout:7/564: dwrite d0/d56/d70/f80 [0,4194304] 0 2024-02-15T18:31:07.026 INFO:tasks.workunit.client.0.smithi033.stdout:3/533: unlink d2/f51 0 2024-02-15T18:31:07.026 INFO:tasks.workunit.client.0.smithi033.stdout:3/534: fsync d2/d14/d23/f28 0 2024-02-15T18:31:07.026 INFO:tasks.workunit.client.0.smithi033.stdout:3/535: write d2/d3/d1e/f4f [3080024,5052] 0 2024-02-15T18:31:07.026 INFO:tasks.workunit.client.0.smithi033.stdout:8/498: rename d0/d1c/d30/d8e/d8f/f27 to d0/d1c/d30/d8e/fa3 0 2024-02-15T18:31:07.030 INFO:tasks.workunit.client.0.smithi033.stdout:8/499: write d0/df/f11 [328498,32950] 0 2024-02-15T18:31:07.030 INFO:tasks.workunit.client.0.smithi033.stdout:0/561: rename d0/d8/d15/d8b/da3/dae/d58/fb0 to d0/d8/d15/d2d/d3f/d97/fbe 0 2024-02-15T18:31:07.031 INFO:tasks.workunit.client.0.smithi033.stdout:3/536: rename d2/d3/d17/f79 to d2/d14/d23/d5c/d7f/fa6 0 2024-02-15T18:31:07.033 INFO:tasks.workunit.client.0.smithi033.stdout:0/562: symlink d0/d8/d15/d2d/d41/d73/d84/lbf 0 2024-02-15T18:31:07.033 INFO:tasks.workunit.client.0.smithi033.stdout:0/563: chown d0/d8/d15/d2d/d3f/f55 982 1 2024-02-15T18:31:07.035 INFO:tasks.workunit.client.0.smithi033.stdout:3/537: dread d2/d3/d1e/d22/f57 [0,4194304] 0 2024-02-15T18:31:07.037 INFO:tasks.workunit.client.0.smithi033.stdout:9/521: dwrite d4/d32/d6c/f91 [0,4194304] 0 2024-02-15T18:31:07.037 INFO:tasks.workunit.client.0.smithi033.stdout:9/522: fdatasync d4/d8/dd/d41/f5d 0 2024-02-15T18:31:07.037 INFO:tasks.workunit.client.0.smithi033.stdout:3/538: creat d2/d3/d1e/d22/fa7 x:0 0 0 2024-02-15T18:31:07.040 INFO:tasks.workunit.client.0.smithi033.stdout:2/596: dwrite d20/d31/d47/f6d [0,4194304] 0 2024-02-15T18:31:07.040 INFO:tasks.workunit.client.0.smithi033.stdout:2/597: fsync d20/d3a/d4a/d5e/d6b/fd0 0 2024-02-15T18:31:07.041 INFO:tasks.workunit.client.0.smithi033.stdout:9/523: symlink d4/d8/d1b/lb0 0 2024-02-15T18:31:07.041 INFO:tasks.workunit.client.0.smithi033.stdout:6/634: dwrite d8/d28/f11 [0,4194304] 0 2024-02-15T18:31:07.041 INFO:tasks.workunit.client.0.smithi033.stdout:3/539: rename d2/d14/d23/d68/l8c to d2/d3/df/d6c/la8 0 2024-02-15T18:31:07.043 INFO:tasks.workunit.client.0.smithi033.stdout:2/598: link d20/d3a/l45 d20/d31/d47/lda 0 2024-02-15T18:31:07.044 INFO:tasks.workunit.client.0.smithi033.stdout:9/524: mkdir d4/d2c/db1 0 2024-02-15T18:31:07.046 INFO:tasks.workunit.client.0.smithi033.stdout:2/599: write d20/d31/d6a/f81 [4465648,25710] 0 2024-02-15T18:31:07.050 INFO:tasks.workunit.client.0.smithi033.stdout:6/635: creat d8/d28/d14/d2c/d31/d30/d29/fc8 x:0 0 0 2024-02-15T18:31:07.051 INFO:tasks.workunit.client.0.smithi033.stdout:2/600: write d20/d3a/f75 [99267,2249] 0 2024-02-15T18:31:07.051 INFO:tasks.workunit.client.0.smithi033.stdout:2/601: chown d20/d31/d47/d82 29178 1 2024-02-15T18:31:07.053 INFO:tasks.workunit.client.0.smithi033.stdout:3/540: mknod d2/d14/d23/d6f/d93/ca9 0 2024-02-15T18:31:07.053 INFO:tasks.workunit.client.0.smithi033.stdout:6/636: symlink d8/d28/d14/d2c/d31/d30/d29/dc3/lc9 0 2024-02-15T18:31:07.054 INFO:tasks.workunit.client.0.smithi033.stdout:3/541: dread d2/d20/f53 [0,4194304] 0 2024-02-15T18:31:07.054 INFO:tasks.workunit.client.0.smithi033.stdout:6/637: write d8/d1d/d37/d4f/f6f [2680801,121082] 0 2024-02-15T18:31:07.054 INFO:tasks.workunit.client.0.smithi033.stdout:6/638: write d8/d1d/d37/d4f/dbb/f56 [2060352,46731] 0 2024-02-15T18:31:07.055 INFO:tasks.workunit.client.0.smithi033.stdout:6/639: write d8/d28/d14/d2c/d3b/d3d/f48 [821619,90743] 0 2024-02-15T18:31:07.058 INFO:tasks.workunit.client.0.smithi033.stdout:2/602: read d20/d31/f37 [121941,46019] 0 2024-02-15T18:31:07.058 INFO:tasks.workunit.client.0.smithi033.stdout:6/640: creat d8/d70/fca x:0 0 0 2024-02-15T18:31:07.058 INFO:tasks.workunit.client.0.smithi033.stdout:6/641: fsync d8/d28/d14/d2c/d31/d5d/d8c/f95 0 2024-02-15T18:31:07.059 INFO:tasks.workunit.client.0.smithi033.stdout:8/500: dwrite d0/df/db/d45/f4a [0,4194304] 0 2024-02-15T18:31:07.059 INFO:tasks.workunit.client.0.smithi033.stdout:8/501: truncate d0/df/db/d45/f7b 728219 0 2024-02-15T18:31:07.059 INFO:tasks.workunit.client.0.smithi033.stdout:2/603: mkdir d20/d3a/d4a/d5e/d6b/d88/da6/ddb 0 2024-02-15T18:31:07.061 INFO:tasks.workunit.client.0.smithi033.stdout:8/502: creat d0/df/d53/d9b/fa4 x:0 0 0 2024-02-15T18:31:07.062 INFO:tasks.workunit.client.0.smithi033.stdout:2/604: rename c1a to d20/d3a/d4a/d5e/d6b/d88/da6/cdc 0 2024-02-15T18:31:07.062 INFO:tasks.workunit.client.0.smithi033.stdout:2/605: fdatasync d20/d3a/f57 0 2024-02-15T18:31:07.063 INFO:tasks.workunit.client.0.smithi033.stdout:2/606: chown d20/d31/d47/d64/d9e 111 1 2024-02-15T18:31:07.064 INFO:tasks.workunit.client.0.smithi033.stdout:2/607: creat d20/d31/d47/d4c/d6c/d80/da0/fdd x:0 0 0 2024-02-15T18:31:07.064 INFO:tasks.workunit.client.0.smithi033.stdout:2/608: chown d20/ca1 1 1 2024-02-15T18:31:07.064 INFO:tasks.workunit.client.0.smithi033.stdout:2/609: chown d20/d3a/f5d 0 1 2024-02-15T18:31:07.064 INFO:tasks.workunit.client.0.smithi033.stdout:9/525: dwrite d4/d8/dd/d28/f2b [0,4194304] 0 2024-02-15T18:31:07.065 INFO:tasks.workunit.client.0.smithi033.stdout:8/503: truncate d0/d1c/f3e 8654862 0 2024-02-15T18:31:07.065 INFO:tasks.workunit.client.0.smithi033.stdout:8/504: chown d0/d1c/d30/d8e/l85 2709 1 2024-02-15T18:31:07.067 INFO:tasks.workunit.client.0.smithi033.stdout:8/505: rename d0/d7a to d0/d1c/d30/d8e/d35/d29/d5f/da5 0 2024-02-15T18:31:07.069 INFO:tasks.workunit.client.0.smithi033.stdout:8/506: symlink d0/d1c/d30/d8e/la6 0 2024-02-15T18:31:07.070 INFO:tasks.workunit.client.0.smithi033.stdout:8/507: mkdir d0/d1c/d30/d8e/da7 0 2024-02-15T18:31:07.072 INFO:tasks.workunit.client.0.smithi033.stdout:8/508: link d0/df/f38 d0/df/d53/fa8 0 2024-02-15T18:31:07.072 INFO:tasks.workunit.client.0.smithi033.stdout:8/509: chown d0/d1c/d30 66 1 2024-02-15T18:31:07.072 INFO:tasks.workunit.client.0.smithi033.stdout:0/564: dwrite d0/d8/d15/d8b/da3/d6c/f46 [0,4194304] 0 2024-02-15T18:31:07.075 INFO:tasks.workunit.client.0.smithi033.stdout:8/510: rename d0/f3a to d0/d1c/d30/d8e/d35/fa9 0 2024-02-15T18:31:07.075 INFO:tasks.workunit.client.0.smithi033.stdout:0/565: creat d0/d8/d15/d5b/d94/fc0 x:0 0 0 2024-02-15T18:31:07.077 INFO:tasks.workunit.client.0.smithi033.stdout:2/610: dread d20/d3a/d4a/d5e/d6b/d88/fb3 [0,4194304] 0 2024-02-15T18:31:07.077 INFO:tasks.workunit.client.0.smithi033.stdout:3/542: dwrite d2/f6d [0,4194304] 0 2024-02-15T18:31:07.084 INFO:tasks.workunit.client.0.smithi033.stdout:6/642: dwrite d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb4 [4194304,4194304] 0 2024-02-15T18:31:07.084 INFO:tasks.workunit.client.0.smithi033.stdout:6/643: readlink d8/d28/d14/d2c/d31/d30/d29/dc3/lc9 0 2024-02-15T18:31:07.085 INFO:tasks.workunit.client.0.smithi033.stdout:0/566: mkdir d0/d8/d15/d8b/da3/dae/d58/d80/dc1 0 2024-02-15T18:31:07.088 INFO:tasks.workunit.client.0.smithi033.stdout:3/543: rmdir d2/d14/d23/d68/d73/d76 39 2024-02-15T18:31:07.092 INFO:tasks.workunit.client.0.smithi033.stdout:6/644: rename d8/d28/d14/d2c/d31/d30/d29/dc3 to d8/d1d/d37/d4f/dcb 0 2024-02-15T18:31:07.100 INFO:tasks.workunit.client.0.smithi033.stdout:2/611: dread d20/d31/d47/d4c/d6c/d80/f8a [0,4194304] 0 2024-02-15T18:31:07.102 INFO:tasks.workunit.client.0.smithi033.stdout:0/567: dwrite d0/f4 [4194304,4194304] 0 2024-02-15T18:31:07.106 INFO:tasks.workunit.client.0.smithi033.stdout:3/544: mknod d2/d3/d1e/d22/caa 0 2024-02-15T18:31:07.106 INFO:tasks.workunit.client.0.smithi033.stdout:3/545: chown d2/d3/d1e 307 1 2024-02-15T18:31:07.107 INFO:tasks.workunit.client.0.smithi033.stdout:0/568: creat d0/d8/d15/d8b/da3/dae/d59/fc2 x:0 0 0 2024-02-15T18:31:07.108 INFO:tasks.workunit.client.0.smithi033.stdout:0/569: write d0/d8/fb [2253271,89778] 0 2024-02-15T18:31:07.109 INFO:tasks.workunit.client.0.smithi033.stdout:3/546: rmdir d2/d14/d23 39 2024-02-15T18:31:07.110 INFO:tasks.workunit.client.0.smithi033.stdout:6/645: dwrite f0 [0,4194304] 0 2024-02-15T18:31:07.112 INFO:tasks.workunit.client.0.smithi033.stdout:0/570: creat d0/d8/d15/d8b/da3/dae/d58/d80/dc1/fc3 x:0 0 0 2024-02-15T18:31:07.114 INFO:tasks.workunit.client.0.smithi033.stdout:3/547: link d2/d14/d23/d5c/f99 d2/d14/d23/d6f/d93/fab 0 2024-02-15T18:31:07.115 INFO:tasks.workunit.client.0.smithi033.stdout:6/646: symlink d8/d1d/d37/d4f/dbb/d57/lcc 0 2024-02-15T18:31:07.116 INFO:tasks.workunit.client.0.smithi033.stdout:3/548: symlink d2/d20/lac 0 2024-02-15T18:31:07.117 INFO:tasks.workunit.client.0.smithi033.stdout:6/647: creat d8/d1d/d37/d4f/fcd x:0 0 0 2024-02-15T18:31:07.118 INFO:tasks.workunit.client.0.smithi033.stdout:3/549: creat d2/d3/d1e/d22/d4d/fad x:0 0 0 2024-02-15T18:31:07.119 INFO:tasks.workunit.client.0.smithi033.stdout:6/648: mknod d8/d28/d14/d2c/d3b/d3d/cce 0 2024-02-15T18:31:07.120 INFO:tasks.workunit.client.0.smithi033.stdout:6/649: creat d8/d28/fcf x:0 0 0 2024-02-15T18:31:07.125 INFO:tasks.workunit.client.0.smithi033.stdout:3/550: dread d2/d3/df/f49 [0,4194304] 0 2024-02-15T18:31:07.145 INFO:tasks.workunit.client.0.smithi033.stdout:0/571: dwrite d0/d2/f3 [0,4194304] 0 2024-02-15T18:31:07.145 INFO:tasks.workunit.client.0.smithi033.stdout:6/650: dwrite d8/d1d/f1b [0,4194304] 0 2024-02-15T18:31:07.145 INFO:tasks.workunit.client.0.smithi033.stdout:6/651: chown d8/d28/d36/c51 0 1 2024-02-15T18:31:07.145 INFO:tasks.workunit.client.0.smithi033.stdout:3/551: dwrite d2/d3/df/f82 [0,4194304] 0 2024-02-15T18:31:07.147 INFO:tasks.workunit.client.0.smithi033.stdout:3/552: write d2/d14/f55 [5580755,79729] 0 2024-02-15T18:31:07.147 INFO:tasks.workunit.client.0.smithi033.stdout:3/553: fsync d2/d14/d23/d5c/f99 0 2024-02-15T18:31:07.150 INFO:tasks.workunit.client.0.smithi033.stdout:3/554: dread d2/d14/d23/d68/d73/d83/f97 [0,4194304] 0 2024-02-15T18:31:07.150 INFO:tasks.workunit.client.0.smithi033.stdout:6/652: getdents d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/d81 0 2024-02-15T18:31:07.150 INFO:tasks.workunit.client.0.smithi033.stdout:6/653: chown d8/d70/c89 313 1 2024-02-15T18:31:07.151 INFO:tasks.workunit.client.0.smithi033.stdout:0/572: truncate d0/d8/d15/d2d/d41/d73/f93 3490492 0 2024-02-15T18:31:07.151 INFO:tasks.workunit.client.0.smithi033.stdout:6/654: write d8/d28/f18 [1519967,100716] 0 2024-02-15T18:31:07.153 INFO:tasks.workunit.client.0.smithi033.stdout:6/655: mkdir d8/d1d/d37/dbf/dd0 0 2024-02-15T18:31:07.155 INFO:tasks.workunit.client.0.smithi033.stdout:6/656: link d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/c9f d8/d28/d14/d2c/d31/d30/d29/d38/d54/cd1 0 2024-02-15T18:31:07.156 INFO:tasks.workunit.client.0.smithi033.stdout:4/619: sync 2024-02-15T18:31:07.157 INFO:tasks.workunit.client.0.smithi033.stdout:4/620: write d4/fb3 [1606675,61209] 0 2024-02-15T18:31:07.157 INFO:tasks.workunit.client.0.smithi033.stdout:6/657: dread d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/da5/fa8 [0,4194304] 0 2024-02-15T18:31:07.158 INFO:tasks.workunit.client.0.smithi033.stdout:4/621: rmdir d4/d20/d13/d1b/d81 39 2024-02-15T18:31:07.158 INFO:tasks.workunit.client.0.smithi033.stdout:0/573: write d0/f10 [70700,55932] 0 2024-02-15T18:31:07.161 INFO:tasks.workunit.client.0.smithi033.stdout:4/622: rename d4/d5/c1d to d4/d5/d28/d39/d62/db2/ccc 0 2024-02-15T18:31:07.161 INFO:tasks.workunit.client.0.smithi033.stdout:4/623: write d4/f7 [3408217,6434] 0 2024-02-15T18:31:07.176 INFO:tasks.workunit.client.0.smithi033.stdout:3/555: dwrite d2/d3/df/f7c [0,4194304] 0 2024-02-15T18:31:07.176 INFO:tasks.workunit.client.0.smithi033.stdout:4/624: dread d4/d5/d28/d39/d62/d9c/fb7 [0,4194304] 0 2024-02-15T18:31:07.176 INFO:tasks.workunit.client.0.smithi033.stdout:4/625: fsync d4/d5/d28/d39/f79 0 2024-02-15T18:31:07.177 INFO:tasks.workunit.client.0.smithi033.stdout:3/556: read d2/d20/f45 [2000500,106652] 0 2024-02-15T18:31:07.177 INFO:tasks.workunit.client.0.smithi033.stdout:3/557: chown d2/d14/d23/d68/d73/ca0 165102 1 2024-02-15T18:31:07.177 INFO:tasks.workunit.client.0.smithi033.stdout:3/558: fdatasync d2/d3/d1e/f8a 0 2024-02-15T18:31:07.178 INFO:tasks.workunit.client.0.smithi033.stdout:4/626: mkdir d4/d5/d28/d39/d62/d9c/d9e/dcd 0 2024-02-15T18:31:07.179 INFO:tasks.workunit.client.0.smithi033.stdout:3/559: write d2/f5 [1560270,113501] 0 2024-02-15T18:31:07.179 INFO:tasks.workunit.client.0.smithi033.stdout:3/560: chown d2/d20/c2a 204 1 2024-02-15T18:31:07.179 INFO:tasks.workunit.client.0.smithi033.stdout:3/561: write d2/d3/d1e/d22/fa7 [736357,128820] 0 2024-02-15T18:31:07.179 INFO:tasks.workunit.client.0.smithi033.stdout:3/562: read - d2/d14/d23/d6f/d93/f98 zero size 2024-02-15T18:31:07.182 INFO:tasks.workunit.client.0.smithi033.stdout:4/627: symlink d4/d20/d13/d1b/d7c/d91/dbe/lce 0 2024-02-15T18:31:07.182 INFO:tasks.workunit.client.0.smithi033.stdout:4/628: readlink d4/l77 0 2024-02-15T18:31:07.184 INFO:tasks.workunit.client.0.smithi033.stdout:4/629: symlink d4/d20/d53/lcf 0 2024-02-15T18:31:07.187 INFO:tasks.workunit.client.0.smithi033.stdout:6/658: dwrite d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb4 [4194304,4194304] 0 2024-02-15T18:31:07.187 INFO:tasks.workunit.client.0.smithi033.stdout:6/659: chown d8/c26 74691198 1 2024-02-15T18:31:07.204 INFO:tasks.workunit.client.0.smithi033.stdout:3/563: dwrite d2/d14/d23/f66 [0,4194304] 0 2024-02-15T18:31:07.210 INFO:tasks.workunit.client.0.smithi033.stdout:4/630: dwrite d4/d20/f9a [0,4194304] 0 2024-02-15T18:31:07.210 INFO:tasks.workunit.client.0.smithi033.stdout:4/631: write d4/d20/d53/f61 [1009673,130695] 0 2024-02-15T18:31:07.210 INFO:tasks.workunit.client.0.smithi033.stdout:6/660: dwrite d8/d28/d14/d2c/f4b [0,4194304] 0 2024-02-15T18:31:07.210 INFO:tasks.workunit.client.0.smithi033.stdout:6/661: chown d8/d70/fc2 2591278 1 2024-02-15T18:31:07.211 INFO:tasks.workunit.client.0.smithi033.stdout:1/577: sync 2024-02-15T18:31:07.211 INFO:tasks.workunit.client.0.smithi033.stdout:5/642: sync 2024-02-15T18:31:07.211 INFO:tasks.workunit.client.0.smithi033.stdout:5/643: fsync d1/da/d52/f5b 0 2024-02-15T18:31:07.213 INFO:tasks.workunit.client.0.smithi033.stdout:6/662: symlink d8/d28/d14/d2c/ld2 0 2024-02-15T18:31:07.213 INFO:tasks.workunit.client.0.smithi033.stdout:6/663: chown d8/d1d/d37/d4f 306 1 2024-02-15T18:31:07.214 INFO:tasks.workunit.client.0.smithi033.stdout:6/664: dread - d8/d28/d14/d2c/d31/d30/d29/d38/d54/f84 zero size 2024-02-15T18:31:07.215 INFO:tasks.workunit.client.0.smithi033.stdout:1/578: creat d5/d9/d1e/d20/d5c/d57/d82/fb1 x:0 0 0 2024-02-15T18:31:07.216 INFO:tasks.workunit.client.0.smithi033.stdout:5/644: mknod d1/da/d88/cca 0 2024-02-15T18:31:07.224 INFO:tasks.workunit.client.0.smithi033.stdout:5/645: dread d1/da/d11/f8f [0,4194304] 0 2024-02-15T18:31:07.234 INFO:tasks.workunit.client.0.smithi033.stdout:3/564: dwrite d2/d14/f2b [0,4194304] 0 2024-02-15T18:31:07.236 INFO:tasks.workunit.client.0.smithi033.stdout:3/565: rename d2/d3/d1e/f8a to d2/d14/fae 0 2024-02-15T18:31:07.237 INFO:tasks.workunit.client.0.smithi033.stdout:3/566: chown d2/d20/l9d 154 1 2024-02-15T18:31:07.238 INFO:tasks.workunit.client.0.smithi033.stdout:6/665: dwrite d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/f7f [0,4194304] 0 2024-02-15T18:31:07.238 INFO:tasks.workunit.client.0.smithi033.stdout:3/567: link d2/d3/c6 d2/d3/d17/caf 0 2024-02-15T18:31:07.240 INFO:tasks.workunit.client.0.smithi033.stdout:3/568: link d2/c8b d2/d3/d1e/d22/cb0 0 2024-02-15T18:31:07.240 INFO:tasks.workunit.client.0.smithi033.stdout:3/569: readlink d2/d3/l3c 0 2024-02-15T18:31:07.243 INFO:tasks.workunit.client.0.smithi033.stdout:1/579: dwrite d5/d17/f35 [0,4194304] 0 2024-02-15T18:31:07.243 INFO:tasks.workunit.client.0.smithi033.stdout:3/570: write d2/d3/df/f8f [3801760,950] 0 2024-02-15T18:31:07.245 INFO:tasks.workunit.client.0.smithi033.stdout:4/632: dwrite d4/d5/d28/d39/f79 [0,4194304] 0 2024-02-15T18:31:07.246 INFO:tasks.workunit.client.0.smithi033.stdout:1/580: unlink d5/d9/d1e/d20/d5c/d57/d59/l98 0 2024-02-15T18:31:07.247 INFO:tasks.workunit.client.0.smithi033.stdout:5/646: dwrite d1/da/d11/f49 [0,4194304] 0 2024-02-15T18:31:07.249 INFO:tasks.workunit.client.0.smithi033.stdout:3/571: rename d2/d20/l9d to d2/d14/d23/d68/d73/lb1 0 2024-02-15T18:31:07.251 INFO:tasks.workunit.client.0.smithi033.stdout:1/581: dread d5/dd/d12/d49/f2b [0,4194304] 0 2024-02-15T18:31:07.251 INFO:tasks.workunit.client.0.smithi033.stdout:1/582: dread - d5/d9/d1e/d20/d5c/d57/f8b zero size 2024-02-15T18:31:07.256 INFO:tasks.workunit.client.0.smithi033.stdout:5/647: truncate d1/da/f24 471769 0 2024-02-15T18:31:07.256 INFO:tasks.workunit.client.0.smithi033.stdout:5/648: dread - d1/da/d19/fad zero size 2024-02-15T18:31:07.257 INFO:tasks.workunit.client.0.smithi033.stdout:1/583: mkdir d5/d9/d1e/d20/d2c/db2 0 2024-02-15T18:31:07.259 INFO:tasks.workunit.client.0.smithi033.stdout:6/666: dwrite d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb4 [8388608,4194304] 0 2024-02-15T18:31:07.260 INFO:tasks.workunit.client.0.smithi033.stdout:5/649: read d1/da/d11/f30 [6594686,22511] 0 2024-02-15T18:31:07.263 INFO:tasks.workunit.client.0.smithi033.stdout:6/667: creat d8/d1d/d37/d4f/dbb/d57/fd3 x:0 0 0 2024-02-15T18:31:07.268 INFO:tasks.workunit.client.0.smithi033.stdout:5/650: rename d1/f5c to d1/da/d11/d5e/fcb 0 2024-02-15T18:31:07.268 INFO:tasks.workunit.client.0.smithi033.stdout:5/651: truncate d1/da/d19/d3f/fc0 687139 0 2024-02-15T18:31:07.269 INFO:tasks.workunit.client.0.smithi033.stdout:3/572: dwrite d2/d14/d23/d68/d88/fa5 [0,4194304] 0 2024-02-15T18:31:07.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/668: creat d8/d28/d36/fd4 x:0 0 0 2024-02-15T18:31:07.270 INFO:tasks.workunit.client.0.smithi033.stdout:3/573: write d2/d3/df/f49 [1935973,97984] 0 2024-02-15T18:31:07.271 INFO:tasks.workunit.client.0.smithi033.stdout:5/652: mknod d1/da/d19/da6/ccc 0 2024-02-15T18:31:07.271 INFO:tasks.workunit.client.0.smithi033.stdout:6/669: read d8/d1d/f1b [394973,20923] 0 2024-02-15T18:31:07.271 INFO:tasks.workunit.client.0.smithi033.stdout:6/670: getdents d8/d28/d14/d2c/d31/d30/d29/d38 0 2024-02-15T18:31:07.271 INFO:tasks.workunit.client.0.smithi033.stdout:6/671: write d8/d1d/d37/f77 [865366,25840] 0 2024-02-15T18:31:07.272 INFO:tasks.workunit.client.0.smithi033.stdout:6/672: fdatasync d8/d70/fc2 0 2024-02-15T18:31:07.273 INFO:tasks.workunit.client.0.smithi033.stdout:3/574: creat d2/d14/d23/d5c/fb2 x:0 0 0 2024-02-15T18:31:07.273 INFO:tasks.workunit.client.0.smithi033.stdout:3/575: chown d2/d14/d23/l87 63107 1 2024-02-15T18:31:07.273 INFO:tasks.workunit.client.0.smithi033.stdout:5/653: creat d1/da/d52/fcd x:0 0 0 2024-02-15T18:31:07.273 INFO:tasks.workunit.client.0.smithi033.stdout:5/654: fsync d1/da/d19/f34 0 2024-02-15T18:31:07.274 INFO:tasks.workunit.client.0.smithi033.stdout:1/584: dwrite d5/d9/d1e/d20/d5c/f74 [0,4194304] 0 2024-02-15T18:31:07.274 INFO:tasks.workunit.client.0.smithi033.stdout:6/673: symlink d8/ld5 0 2024-02-15T18:31:07.274 INFO:tasks.workunit.client.0.smithi033.stdout:6/674: chown d8/d70/l97 275 1 2024-02-15T18:31:07.275 INFO:tasks.workunit.client.0.smithi033.stdout:3/576: mkdir d2/d14/db3 0 2024-02-15T18:31:07.277 INFO:tasks.workunit.client.0.smithi033.stdout:6/675: write d8/d28/d14/f43 [2319732,24756] 0 2024-02-15T18:31:07.277 INFO:tasks.workunit.client.0.smithi033.stdout:6/676: readlink d8/d28/d14/d2c/d31/d30/lb2 0 2024-02-15T18:31:07.278 INFO:tasks.workunit.client.0.smithi033.stdout:5/655: rename d1/da/d10/l7f to d1/da/d10/d2b/d42/lce 0 2024-02-15T18:31:07.282 INFO:tasks.workunit.client.0.smithi033.stdout:1/585: mknod d5/dd/d12/d49/cb3 0 2024-02-15T18:31:07.282 INFO:tasks.workunit.client.0.smithi033.stdout:3/577: rmdir d2/d3/d1e/d22 39 2024-02-15T18:31:07.282 INFO:tasks.workunit.client.0.smithi033.stdout:3/578: fsync d2/f2e 0 2024-02-15T18:31:07.284 INFO:tasks.workunit.client.0.smithi033.stdout:1/586: write d5/d17/f5e [462533,67098] 0 2024-02-15T18:31:07.284 INFO:tasks.workunit.client.0.smithi033.stdout:1/587: dread - d5/d9/d1e/d20/d2c/d34/d51/d63/d76/f9f zero size 2024-02-15T18:31:07.285 INFO:tasks.workunit.client.0.smithi033.stdout:6/677: mkdir d8/d1d/d37/d4f/dbb/d55/d60/dd6 0 2024-02-15T18:31:07.285 INFO:tasks.workunit.client.0.smithi033.stdout:3/579: truncate d2/d14/f42 1375133 0 2024-02-15T18:31:07.285 INFO:tasks.workunit.client.0.smithi033.stdout:6/678: dread - d8/d1d/d37/d4f/dbb/fc6 zero size 2024-02-15T18:31:07.285 INFO:tasks.workunit.client.0.smithi033.stdout:1/588: dread d5/d9/ff [0,4194304] 0 2024-02-15T18:31:07.286 INFO:tasks.workunit.client.0.smithi033.stdout:1/589: fdatasync d5/dd/f2e 0 2024-02-15T18:31:07.286 INFO:tasks.workunit.client.0.smithi033.stdout:3/580: write d2/d3/d1e/d22/d59/f5e [1192570,100728] 0 2024-02-15T18:31:07.286 INFO:tasks.workunit.client.0.smithi033.stdout:3/581: read - d2/d14/fae zero size 2024-02-15T18:31:07.288 INFO:tasks.workunit.client.0.smithi033.stdout:6/679: mkdir d8/d28/d14/d2c/dd7 0 2024-02-15T18:31:07.289 INFO:tasks.workunit.client.0.smithi033.stdout:1/590: rename d5/dd/c25 to d5/d9/d1e/d20/d2c/d34/d51/d63/d76/cb4 0 2024-02-15T18:31:07.289 INFO:tasks.workunit.client.0.smithi033.stdout:1/591: chown d5/dd/d12/d49/d23/f7f 1059525 1 2024-02-15T18:31:07.289 INFO:tasks.workunit.client.0.smithi033.stdout:1/592: write d5/d9/f32 [249774,91101] 0 2024-02-15T18:31:07.289 INFO:tasks.workunit.client.0.smithi033.stdout:3/582: rmdir d2/d3/d1e/d22/d4d 39 2024-02-15T18:31:07.291 INFO:tasks.workunit.client.0.smithi033.stdout:6/680: mknod d8/d1d/d37/d4f/dbb/d55/d63/cd8 0 2024-02-15T18:31:07.292 INFO:tasks.workunit.client.0.smithi033.stdout:5/656: dwrite d1/da/d11/fa2 [0,4194304] 0 2024-02-15T18:31:07.292 INFO:tasks.workunit.client.0.smithi033.stdout:3/583: truncate d2/d3/df/f7c 2672561 0 2024-02-15T18:31:07.292 INFO:tasks.workunit.client.0.smithi033.stdout:1/593: fsync d5/d17/f5e 0 2024-02-15T18:31:07.295 INFO:tasks.workunit.client.0.smithi033.stdout:7/565: sync 2024-02-15T18:31:07.296 INFO:tasks.workunit.client.0.smithi033.stdout:9/526: sync 2024-02-15T18:31:07.296 INFO:tasks.workunit.client.0.smithi033.stdout:0/574: sync 2024-02-15T18:31:07.296 INFO:tasks.workunit.client.0.smithi033.stdout:2/612: sync 2024-02-15T18:31:07.296 INFO:tasks.workunit.client.0.smithi033.stdout:8/511: sync 2024-02-15T18:31:07.296 INFO:tasks.workunit.client.0.smithi033.stdout:8/512: fdatasync d0/d1c/d30/d8e/d8f/f22 0 2024-02-15T18:31:07.296 INFO:tasks.workunit.client.0.smithi033.stdout:6/681: truncate d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/d81/fbc 2127124 0 2024-02-15T18:31:07.297 INFO:tasks.workunit.client.0.smithi033.stdout:5/657: creat d1/da/d11/d5e/db1/fcf x:0 0 0 2024-02-15T18:31:07.297 INFO:tasks.workunit.client.0.smithi033.stdout:3/584: stat d2/d3/df/d6c/la8 0 2024-02-15T18:31:07.297 INFO:tasks.workunit.client.0.smithi033.stdout:3/585: write d2/d3/df/f7a [474831,58462] 0 2024-02-15T18:31:07.297 INFO:tasks.workunit.client.0.smithi033.stdout:3/586: stat d2/d14/d23/d6f/d93 0 2024-02-15T18:31:07.299 INFO:tasks.workunit.client.0.smithi033.stdout:1/594: rmdir d5/dd/d12/d49/d93 0 2024-02-15T18:31:07.299 INFO:tasks.workunit.client.0.smithi033.stdout:7/566: chown d0/f8c 1416 1 2024-02-15T18:31:07.302 INFO:tasks.workunit.client.0.smithi033.stdout:9/527: mknod d4/d8/d1b/d61/cb2 0 2024-02-15T18:31:07.302 INFO:tasks.workunit.client.0.smithi033.stdout:2/613: dread d20/f3c [0,4194304] 0 2024-02-15T18:31:07.302 INFO:tasks.workunit.client.0.smithi033.stdout:2/614: fsync d20/d30/fc1 0 2024-02-15T18:31:07.303 INFO:tasks.workunit.client.0.smithi033.stdout:0/575: rename d0/d64/d1d/c4d to d0/cc4 0 2024-02-15T18:31:07.303 INFO:tasks.workunit.client.0.smithi033.stdout:0/576: chown d0/d8/d15/d8b/da3/d6c/f68 1606 1 2024-02-15T18:31:07.305 INFO:tasks.workunit.client.0.smithi033.stdout:8/513: mkdir d0/daa 0 2024-02-15T18:31:07.307 INFO:tasks.workunit.client.0.smithi033.stdout:6/682: symlink d8/d28/d14/d2c/d31/d5d/d8c/ld9 0 2024-02-15T18:31:07.308 INFO:tasks.workunit.client.0.smithi033.stdout:5/658: mkdir d1/da/d19/d3f/d68/dd0 0 2024-02-15T18:31:07.309 INFO:tasks.workunit.client.0.smithi033.stdout:8/514: dread d0/d1c/d30/d8e/d8f/f6a [0,4194304] 0 2024-02-15T18:31:07.310 INFO:tasks.workunit.client.0.smithi033.stdout:3/587: rmdir d2/d14/d23 39 2024-02-15T18:31:07.312 INFO:tasks.workunit.client.0.smithi033.stdout:8/515: write d0/f94 [554035,81367] 0 2024-02-15T18:31:07.313 INFO:tasks.workunit.client.0.smithi033.stdout:1/595: creat d5/d9/d1e/d20/d5c/d57/d82/fb5 x:0 0 0 2024-02-15T18:31:07.319 INFO:tasks.workunit.client.0.smithi033.stdout:9/528: creat d4/d8/d1b/d2f/d65/d8b/d95/fb3 x:0 0 0 2024-02-15T18:31:07.319 INFO:tasks.workunit.client.0.smithi033.stdout:9/529: fsync d4/d32/f3b 0 2024-02-15T18:31:07.319 INFO:tasks.workunit.client.0.smithi033.stdout:2/615: creat d20/d3a/d4a/d5e/fde x:0 0 0 2024-02-15T18:31:07.320 INFO:tasks.workunit.client.0.smithi033.stdout:6/683: creat d8/d28/d14/d2c/d31/d30/d29/d38/fda x:0 0 0 2024-02-15T18:31:07.320 INFO:tasks.workunit.client.0.smithi033.stdout:5/659: symlink d1/da/d11/d5e/ld1 0 2024-02-15T18:31:07.322 INFO:tasks.workunit.client.0.smithi033.stdout:3/588: link d2/d14/d23/f3d d2/d14/d23/d68/d73/d76/fb4 0 2024-02-15T18:31:07.322 INFO:tasks.workunit.client.0.smithi033.stdout:3/589: chown d2/d3/d17/l5a 2 1 2024-02-15T18:31:07.322 INFO:tasks.workunit.client.0.smithi033.stdout:8/516: rename d0/d1c/d30/d8e/d35/d29/d5f/c70 to d0/d1c/d30/d8e/d35/cab 0 2024-02-15T18:31:07.323 INFO:tasks.workunit.client.0.smithi033.stdout:1/596: creat d5/d9/d1e/d20/d2c/d34/d51/fb6 x:0 0 0 2024-02-15T18:31:07.324 INFO:tasks.workunit.client.0.smithi033.stdout:9/530: symlink d4/d8/d1b/d61/lb4 0 2024-02-15T18:31:07.326 INFO:tasks.workunit.client.0.smithi033.stdout:2/616: mkdir d20/d3a/d4a/d5e/d6b/d88/da6/ddb/ddf 0 2024-02-15T18:31:07.328 INFO:tasks.workunit.client.0.smithi033.stdout:3/590: creat d2/d3/df/d6c/fb5 x:0 0 0 2024-02-15T18:31:07.328 INFO:tasks.workunit.client.0.smithi033.stdout:3/591: chown d2/d3/d1e/d22/fa7 2 1 2024-02-15T18:31:07.328 INFO:tasks.workunit.client.0.smithi033.stdout:7/567: dwrite d0/dc/d10/d1d/d2b/d5f/f71 [4194304,4194304] 0 2024-02-15T18:31:07.328 INFO:tasks.workunit.client.0.smithi033.stdout:7/568: chown d0/dc/d10 10231609 1 2024-02-15T18:31:07.329 INFO:tasks.workunit.client.0.smithi033.stdout:8/517: unlink d0/d1c/d30/d8e/d35/d29/c9f 0 2024-02-15T18:31:07.331 INFO:tasks.workunit.client.0.smithi033.stdout:6/684: dread d8/f5b [0,4194304] 0 2024-02-15T18:31:07.331 INFO:tasks.workunit.client.0.smithi033.stdout:9/531: truncate d4/d8/dd/d28/f2b 124351 0 2024-02-15T18:31:07.331 INFO:tasks.workunit.client.0.smithi033.stdout:9/532: write d4/d8/dd/d41/d51/f78 [1667235,66333] 0 2024-02-15T18:31:07.333 INFO:tasks.workunit.client.0.smithi033.stdout:3/592: symlink d2/d14/d23/d5c/lb6 0 2024-02-15T18:31:07.334 INFO:tasks.workunit.client.0.smithi033.stdout:3/593: read d2/d3/df/f49 [273877,32055] 0 2024-02-15T18:31:07.338 INFO:tasks.workunit.client.0.smithi033.stdout:7/569: creat d0/dc/d10/d7d/fc4 x:0 0 0 2024-02-15T18:31:07.338 INFO:tasks.workunit.client.0.smithi033.stdout:7/570: readlink d0/d56/d70/d83/laf 0 2024-02-15T18:31:07.338 INFO:tasks.workunit.client.0.smithi033.stdout:7/571: stat d0/dc/l37 0 2024-02-15T18:31:07.338 INFO:tasks.workunit.client.0.smithi033.stdout:7/572: truncate d0/dc/d10/d7d/d99/fb2 494110 0 2024-02-15T18:31:07.339 INFO:tasks.workunit.client.0.smithi033.stdout:8/518: rename d0/d1c/d30/d8e/d14/l36 to d0/d1c/d30/d8e/d35/d29/d5f/da5/lac 0 2024-02-15T18:31:07.340 INFO:tasks.workunit.client.0.smithi033.stdout:6/685: creat d8/d70/fdb x:0 0 0 2024-02-15T18:31:07.341 INFO:tasks.workunit.client.0.smithi033.stdout:7/573: link d0/dc/d10/la4 d0/d56/d70/d91/lc5 0 2024-02-15T18:31:07.343 INFO:tasks.workunit.client.0.smithi033.stdout:8/519: rename d0/d1c/d30/d8e/l21 to d0/d1c/d30/d8e/d35/d58/lad 0 2024-02-15T18:31:07.344 INFO:tasks.workunit.client.0.smithi033.stdout:6/686: getdents d8/d28/d14/d2c/d31/d5d 0 2024-02-15T18:31:07.346 INFO:tasks.workunit.client.0.smithi033.stdout:7/574: rmdir d0/d56/dad 0 2024-02-15T18:31:07.346 INFO:tasks.workunit.client.0.smithi033.stdout:6/687: creat d8/d1d/d37/d4f/dbb/fdc x:0 0 0 2024-02-15T18:31:07.347 INFO:tasks.workunit.client.0.smithi033.stdout:7/575: mknod d0/d56/d70/cc6 0 2024-02-15T18:31:07.347 INFO:tasks.workunit.client.0.smithi033.stdout:7/576: write d0/dc/d10/d7d/d93/dc2/fbd [492689,69827] 0 2024-02-15T18:31:07.348 INFO:tasks.workunit.client.0.smithi033.stdout:8/520: write d0/df/db/f40 [693940,64567] 0 2024-02-15T18:31:07.348 INFO:tasks.workunit.client.0.smithi033.stdout:6/688: symlink d8/d1d/d37/ldd 0 2024-02-15T18:31:07.348 INFO:tasks.workunit.client.0.smithi033.stdout:6/689: write d8/d28/d14/d2c/d31/d30/fa4 [1669496,127499] 0 2024-02-15T18:31:07.350 INFO:tasks.workunit.client.0.smithi033.stdout:8/521: truncate d0/d1c/d30/d8e/d8f/f6a 829456 0 2024-02-15T18:31:07.350 INFO:tasks.workunit.client.0.smithi033.stdout:8/522: write d0/d1c/d30/f74 [1711592,111513] 0 2024-02-15T18:31:07.357 INFO:tasks.workunit.client.0.smithi033.stdout:6/690: unlink d8/d28/d14/d2c/d31/d30/d29/d38/c42 0 2024-02-15T18:31:07.357 INFO:tasks.workunit.client.0.smithi033.stdout:6/691: readlink d8/d28/d14/d2c/d31/d30/d29/l52 0 2024-02-15T18:31:07.357 INFO:tasks.workunit.client.0.smithi033.stdout:8/523: mknod d0/df/db/d45/cae 0 2024-02-15T18:31:07.358 INFO:tasks.workunit.client.0.smithi033.stdout:6/692: unlink f0 0 2024-02-15T18:31:07.358 INFO:tasks.workunit.client.0.smithi033.stdout:8/524: mknod d0/d1c/d30/d8e/d8f/d4b/caf 0 2024-02-15T18:31:07.359 INFO:tasks.workunit.client.0.smithi033.stdout:8/525: fsync d0/d1c/d30/d8e/d35/f1a 0 2024-02-15T18:31:07.359 INFO:tasks.workunit.client.0.smithi033.stdout:8/526: truncate d0/df/db/d45/f98 296138 0 2024-02-15T18:31:07.359 INFO:tasks.workunit.client.0.smithi033.stdout:8/527: mkdir d0/d1c/d30/d8e/d14/d56/db0 0 2024-02-15T18:31:07.369 INFO:tasks.workunit.client.0.smithi033.stdout:1/597: dwrite d5/dd/d12/d49/f44 [0,4194304] 0 2024-02-15T18:31:07.369 INFO:tasks.workunit.client.0.smithi033.stdout:2/617: dwrite d20/d3a/d4a/d5e/d6b/fc3 [0,4194304] 0 2024-02-15T18:31:07.369 INFO:tasks.workunit.client.0.smithi033.stdout:9/533: dwrite d4/d8/d1b/d73/f8e [0,4194304] 0 2024-02-15T18:31:07.370 INFO:tasks.workunit.client.0.smithi033.stdout:3/594: dwrite d2/d14/d23/d5c/d7f/fa6 [0,4194304] 0 2024-02-15T18:31:07.370 INFO:tasks.workunit.client.0.smithi033.stdout:7/577: dwrite d0/dc/d10/d48/f51 [4194304,4194304] 0 2024-02-15T18:31:07.372 INFO:tasks.workunit.client.0.smithi033.stdout:6/693: dread d8/d1d/f3c [4194304,4194304] 0 2024-02-15T18:31:07.385 INFO:tasks.workunit.client.0.smithi033.stdout:8/528: dwrite d0/d1c/d30/d8e/d8f/d4b/f7d [0,4194304] 0 2024-02-15T18:31:07.386 INFO:tasks.workunit.client.0.smithi033.stdout:9/534: dread d4/d8/dd/d28/f4c [0,4194304] 0 2024-02-15T18:31:07.386 INFO:tasks.workunit.client.0.smithi033.stdout:8/529: readlink d0/d1c/d30/d8e/la6 0 2024-02-15T18:31:07.386 INFO:tasks.workunit.client.0.smithi033.stdout:9/535: fsync d4/d8/d1b/d2f/f79 0 2024-02-15T18:31:07.386 INFO:tasks.workunit.client.0.smithi033.stdout:9/536: truncate d4/d8/dd/d5c/f9b 460262 0 2024-02-15T18:31:07.388 INFO:tasks.workunit.client.0.smithi033.stdout:2/618: truncate d20/d31/d47/d4c/f60 417479 0 2024-02-15T18:31:07.391 INFO:tasks.workunit.client.0.smithi033.stdout:3/595: creat d2/d3/d17/fb7 x:0 0 0 2024-02-15T18:31:07.392 INFO:tasks.workunit.client.0.smithi033.stdout:7/578: mknod d0/dc/cc7 0 2024-02-15T18:31:07.394 INFO:tasks.workunit.client.0.smithi033.stdout:8/530: mknod d0/df/d53/d9b/cb1 0 2024-02-15T18:31:07.395 INFO:tasks.workunit.client.0.smithi033.stdout:9/537: symlink d4/d8/d1b/d2f/d65/lb5 0 2024-02-15T18:31:07.396 INFO:tasks.workunit.client.0.smithi033.stdout:2/619: creat d20/d3a/fe0 x:0 0 0 2024-02-15T18:31:07.396 INFO:tasks.workunit.client.0.smithi033.stdout:2/620: chown d20/d3a/d4a/f74 53 1 2024-02-15T18:31:07.398 INFO:tasks.workunit.client.0.smithi033.stdout:8/531: unlink d0/d1c/d30/d8e/d8f/f6a 0 2024-02-15T18:31:07.398 INFO:tasks.workunit.client.0.smithi033.stdout:8/532: read - d0/df/db/d45/f8a zero size 2024-02-15T18:31:07.400 INFO:tasks.workunit.client.0.smithi033.stdout:2/621: mkdir d20/de1 0 2024-02-15T18:31:07.401 INFO:tasks.workunit.client.0.smithi033.stdout:9/538: mkdir d4/d8/db6 0 2024-02-15T18:31:07.401 INFO:tasks.workunit.client.0.smithi033.stdout:9/539: fdatasync d4/d8/dd/d5c/f68 0 2024-02-15T18:31:07.401 INFO:tasks.workunit.client.0.smithi033.stdout:9/540: stat d4/d32/d6c/f8c 0 2024-02-15T18:31:07.402 INFO:tasks.workunit.client.0.smithi033.stdout:2/622: creat d20/d3a/d4a/d5e/d6b/d88/da6/ddb/ddf/fe2 x:0 0 0 2024-02-15T18:31:07.402 INFO:tasks.workunit.client.0.smithi033.stdout:2/623: fsync d20/d3a/d4a/d5e/d6b/f8f 0 2024-02-15T18:31:07.403 INFO:tasks.workunit.client.0.smithi033.stdout:6/694: dwrite d8/d28/d14/d2c/f4b [0,4194304] 0 2024-02-15T18:31:07.405 INFO:tasks.workunit.client.0.smithi033.stdout:9/541: write d4/d8/d1b/d73/f7f [3213368,32982] 0 2024-02-15T18:31:07.405 INFO:tasks.workunit.client.0.smithi033.stdout:9/542: chown d4/d8/dd/d41 221024608 1 2024-02-15T18:31:07.406 INFO:tasks.workunit.client.0.smithi033.stdout:1/598: dwrite d5/f85 [0,4194304] 0 2024-02-15T18:31:07.417 INFO:tasks.workunit.client.0.smithi033.stdout:8/533: dread d0/fe [4194304,4194304] 0 2024-02-15T18:31:07.417 INFO:tasks.workunit.client.0.smithi033.stdout:6/695: creat d8/d28/d14/d2c/d31/d30/d29/d38/fde x:0 0 0 2024-02-15T18:31:07.417 INFO:tasks.workunit.client.0.smithi033.stdout:6/696: write d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/d81/f9a [4467895,8449] 0 2024-02-15T18:31:07.419 INFO:tasks.workunit.client.0.smithi033.stdout:3/596: dwrite d2/d14/d23/f43 [0,4194304] 0 2024-02-15T18:31:07.425 INFO:tasks.workunit.client.0.smithi033.stdout:6/697: link d8/d1d/f3c d8/d1d/d37/d4f/dbb/d57/fdf 0 2024-02-15T18:31:07.426 INFO:tasks.workunit.client.0.smithi033.stdout:6/698: getdents d8/d28/d14/d2c/d31/d30/d29 0 2024-02-15T18:31:07.429 INFO:tasks.workunit.client.0.smithi033.stdout:6/699: mkdir d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/da5/de0 0 2024-02-15T18:31:07.431 INFO:tasks.workunit.client.0.smithi033.stdout:6/700: mkdir d8/d28/d14/d2c/d31/d30/de1 0 2024-02-15T18:31:07.439 INFO:tasks.workunit.client.0.smithi033.stdout:2/624: dwrite d20/d3a/fe0 [0,4194304] 0 2024-02-15T18:31:07.445 INFO:tasks.workunit.client.0.smithi033.stdout:2/625: rename f1 to d20/d31/dc8/fe3 0 2024-02-15T18:31:07.446 INFO:tasks.workunit.client.0.smithi033.stdout:2/626: truncate d20/d31/d47/d4c/d6c/d80/da0/fdd 215650 0 2024-02-15T18:31:07.446 INFO:tasks.workunit.client.0.smithi033.stdout:2/627: chown d20/d3a/d4a/d5e/d6b 1236 1 2024-02-15T18:31:07.459 INFO:tasks.workunit.client.0.smithi033.stdout:3/597: dwrite d2/d14/d23/d5c/fb2 [0,4194304] 0 2024-02-15T18:31:07.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/534: dwrite d0/df/db/d45/f7b [0,4194304] 0 2024-02-15T18:31:07.460 INFO:tasks.workunit.client.0.smithi033.stdout:1/599: dwrite d5/dd/d12/d49/d23/f26 [0,4194304] 0 2024-02-15T18:31:07.462 INFO:tasks.workunit.client.0.smithi033.stdout:9/543: dwrite d4/d8/dd/d5c/f68 [4194304,4194304] 0 2024-02-15T18:31:07.462 INFO:tasks.workunit.client.0.smithi033.stdout:6/701: dwrite d8/d28/d14/d2c/d31/d30/d29/d38/d54/d5e/da5/fa8 [0,4194304] 0 2024-02-15T18:31:07.462 INFO:tasks.workunit.client.0.smithi033.stdout:6/702: chown d8/d28/d14/d2c/d31/d30/d29/d38/d54/f88 2094783 1 2024-02-15T18:31:07.462 INFO:tasks.workunit.client.0.smithi033.stdout:3/598: symlink d2/d14/d23/d68/d73/lb8 0 2024-02-15T18:31:07.463 INFO:tasks.workunit.client.0.smithi033.stdout:2/628: dwrite d20/d31/dc8/fe3 [4194304,4194304] 0 2024-02-15T18:31:07.465 INFO:tasks.workunit.client.0.smithi033.stdout:8/535: dread d0/d1c/d30/d8e/d35/d29/f46 [0,4194304] 0 2024-02-15T18:31:07.465 INFO:tasks.workunit.client.0.smithi033.stdout:8/536: fdatasync d0/df/db/d45/f8a 0 2024-02-15T18:31:07.465 INFO:tasks.workunit.client.0.smithi033.stdout:8/537: chown d0/d1c/d30/d8e/d8f/d4b/l69 38 1 2024-02-15T18:31:07.473 INFO:tasks.workunit.client.0.smithi033.stdout:9/544: creat d4/d8/d1b/d73/fb7 x:0 0 0 2024-02-15T18:31:07.477 INFO:tasks.workunit.client.0.smithi033.stdout:6/703: creat d8/d28/d36/fe2 x:0 0 0 2024-02-15T18:31:07.480 INFO:tasks.workunit.client.0.smithi033.stdout:3/599: mknod d2/d14/d23/d6f/cb9 0 2024-02-15T18:31:07.482 INFO:tasks.workunit.client.0.smithi033.stdout:8/538: unlink d0/d1c/d30/d8e/d35/d29/d5f/c67 0 2024-02-15T18:31:07.482 INFO:tasks.workunit.client.0.smithi033.stdout:8/539: chown d0/fe 576061 1 2024-02-15T18:31:07.483 INFO:tasks.workunit.client.0.smithi033.stdout:1/600: dread d5/d9/d1e/d20/d2c/f8c [0,4194304] 0 2024-02-15T18:31:07.483 INFO:tasks.workunit.client.0.smithi033.stdout:1/601: truncate d5/dd/d12/f8f 154575 0 2024-02-15T18:31:07.483 INFO:tasks.workunit.client.0.smithi033.stdout:1/602: read - d5/d9/f97 zero size 2024-02-15T18:31:07.484 INFO:tasks.workunit.client.0.smithi033.stdout:2/629: rename d20/d3a/fe0 to d20/d31/d47/d4c/d6c/d80/fe4 0 2024-02-15T18:31:07.484 INFO:tasks.workunit.client.0.smithi033.stdout:2/630: write d20/d3a/d4a/d5e/f69 [1248123,65287] 0 2024-02-15T18:31:07.486 INFO:tasks.workunit.client.0.smithi033.stdout:3/600: dread d2/d14/d23/f3d [0,4194304] 0 2024-02-15T18:31:07.486 INFO:tasks.workunit.client.0.smithi033.stdout:3/601: write d2/d3/d1e/d22/f58 [461857,61699] 0 2024-02-15T18:31:07.487 INFO:tasks.workunit.client.0.smithi033.stdout:1/603: rmdir d5/d9 39 2024-02-15T18:31:07.489 INFO:tasks.workunit.client.0.smithi033.stdout:2/631: mknod d20/d31/d47/d4c/d6c/d80/da5/ce5 0 2024-02-15T18:31:07.489 INFO:tasks.workunit.client.0.smithi033.stdout:3/602: stat d2/d14/d23/d5c/d62/c64 0 2024-02-15T18:31:07.489 INFO:tasks.workunit.client.0.smithi033.stdout:3/603: fdatasync d2/d3/df/f7a 0 2024-02-15T18:31:07.489 INFO:tasks.workunit.client.0.smithi033.stdout:1/604: write d5/d9/d1e/d20/d5c/d57/d59/f7b [3544944,88716] 0 2024-02-15T18:31:07.489 INFO:tasks.workunit.client.0.smithi033.stdout:1/605: dread - d5/d9/d1e/d20/d5c/d57/d82/fb1 zero size 2024-02-15T18:31:07.489 INFO:tasks.workunit.client.0.smithi033.stdout:1/606: write d5/d9/d1e/fab [1031259,122252] 0 2024-02-15T18:31:07.490 INFO:tasks.workunit.client.0.smithi033.stdout:1/607: dread - d5/d9/d1e/d20/d5c/d57/d82/fb1 zero size 2024-02-15T18:31:07.490 INFO:tasks.workunit.client.0.smithi033.stdout:2/632: mkdir d20/d31/d47/d82/de6 0 2024-02-15T18:31:07.490 INFO:tasks.workunit.client.0.smithi033.stdout:3/604: truncate d2/f5 276772 0 2024-02-15T18:31:07.492 INFO:tasks.workunit.client.0.smithi033.stdout:1/608: mknod d5/cb7 0 2024-02-15T18:31:07.493 INFO:tasks.workunit.client.0.smithi033.stdout:2/633: creat d20/d31/d47/d4c/d6c/d80/fe7 x:0 0 0 2024-02-15T18:31:07.496 INFO:tasks.workunit.client.0.smithi033.stdout:9/545: dwrite d4/d8/d1b/d2f/d65/f75 [0,4194304] 0 2024-02-15T18:31:07.500 INFO:tasks.workunit.client.0.smithi033.stdout:8/540: dwrite d0/f94 [8388608,4194304] 0 2024-02-15T18:31:07.512 INFO:tasks.workunit.client.0.smithi033.stdout:8/541: rename d0/df/d53/fa8 to d0/d1c/d30/d8e/fb2 0 2024-02-15T18:31:07.513 INFO:tasks.workunit.client.0.smithi033.stdout:3/605: dwrite d2/d3/d1e/f9c [0,4194304] 0 2024-02-15T18:31:07.516 INFO:tasks.workunit.client.0.smithi033.stdout:3/606: getdents d2/d14/d23/d6f/d93 0 2024-02-15T18:31:07.516 INFO:tasks.workunit.client.0.smithi033.stdout:3/607: chown d2/d14/f2b 7 1 2024-02-15T18:31:07.517 INFO:tasks.workunit.client.0.smithi033.stdout:3/608: mkdir d2/d14/db3/dba 0 2024-02-15T18:31:07.523 INFO:tasks.workunit.client.0.smithi033.stdout:1/609: dwrite d5/dd/f3e [0,4194304] 0 2024-02-15T18:31:07.523 INFO:tasks.workunit.client.0.smithi033.stdout:1/610: readlink d5/d9/d1e/d20/l4c 0 2024-02-15T18:31:07.524 INFO:tasks.workunit.client.0.smithi033.stdout:2/634: dwrite d20/d30/fc1 [0,4194304] 0 2024-02-15T18:31:07.526 INFO:tasks.workunit.client.0.smithi033.stdout:8/542: dread d0/df/db/f40 [0,4194304] 0 2024-02-15T18:31:07.526 INFO:tasks.workunit.client.0.smithi033.stdout:8/543: fsync d0/df/db/d45/f8a 0 2024-02-15T18:31:07.526 INFO:tasks.workunit.client.0.smithi033.stdout:1/611: mknod d5/d9/d1e/d20/d2c/d65/cb8 0 2024-02-15T18:31:07.527 INFO:tasks.workunit.client.0.smithi033.stdout:3/609: truncate d2/d3/d1e/f9c 1484826 0 2024-02-15T18:31:07.532 INFO:tasks.workunit.client.0.smithi033.stdout:8/544: rename d0/d1c to d0/df/d53/db3 0 2024-02-15T18:31:07.532 INFO:tasks.workunit.client.0.smithi033.stdout:8/545: readlink d0/df/l86 0 2024-02-15T18:31:07.532 INFO:tasks.workunit.client.0.smithi033.stdout:8/546: write d0/df/db/d45/f75 [1018513,13103] 0 2024-02-15T18:31:07.533 INFO:tasks.workunit.client.0.smithi033.stdout:8/547: chown d0/df/d53/db3/d30/d8e/d8f/l37 1425 1 2024-02-15T18:31:07.533 INFO:tasks.workunit.client.0.smithi033.stdout:3/610: getdents d2/d14 0 2024-02-15T18:31:07.534 INFO:tasks.workunit.client.0.smithi033.stdout:3/611: truncate d2/d3/d17/fb7 167080 0 2024-02-15T18:31:07.537 INFO:tasks.workunit.client.0.smithi033.stdout:1/612: rename d5/d9/d1e/f78 to d5/d9/d1e/d20/d5c/d57/d59/fb9 0 2024-02-15T18:31:07.538 INFO:tasks.workunit.client.0.smithi033.stdout:8/548: dread d0/df/d53/db3/d30/d8e/f41 [0,4194304] 0 2024-02-15T18:31:07.539 INFO:tasks.workunit.client.0.smithi033.stdout:8/549: creat d0/df/d53/db3/d30/d8e/d14/d56/db0/fb4 x:0 0 0 2024-02-15T18:31:07.544 INFO:tasks.workunit.client.0.smithi033.stdout:2/635: dwrite d20/d31/d47/d4c/d6c/d80/f85 [0,4194304] 0 2024-02-15T18:31:07.546 INFO:tasks.workunit.client.0.smithi033.stdout:3/612: dread d2/f4 [0,4194304] 0 2024-02-15T18:31:07.546 INFO:tasks.workunit.client.0.smithi033.stdout:4/633: sync 2024-02-15T18:31:07.546 INFO:tasks.workunit.client.0.smithi033.stdout:0/577: sync 2024-02-15T18:31:07.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/660: sync 2024-02-15T18:31:07.546 INFO:tasks.workunit.client.0.smithi033.stdout:7/579: sync 2024-02-15T18:31:07.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/661: chown d1/da/d19/d3f 787 1 2024-02-15T18:31:07.546 INFO:tasks.workunit.client.0.smithi033.stdout:5/662: chown d1/c32 0 1 2024-02-15T18:31:07.548 INFO:tasks.workunit.client.0.smithi033.stdout:3/613: mknod d2/cbb 0 2024-02-15T18:31:07.548 INFO:tasks.workunit.client.0.smithi033.stdout:3/614: readlink d2/d3/d1e/d22/d59/l78 0 2024-02-15T18:31:07.550 INFO:tasks.workunit.client.0.smithi033.stdout:4/634: mkdir d4/d20/d13/d5c/d87/dd0 0 2024-02-15T18:31:07.550 INFO:tasks.workunit.client.0.smithi033.stdout:4/635: write d4/d5/d28/d39/d62/db2/db5/fb9 [123654,51378] 0 2024-02-15T18:31:07.551 INFO:tasks.workunit.client.0.smithi033.stdout:3/615: mknod d2/d14/db3/cbc 0 2024-02-15T18:31:07.552 INFO:tasks.workunit.client.0.smithi033.stdout:0/578: dread d0/d64/f7b [0,4194304] 0 2024-02-15T18:31:07.561 INFO:tasks.workunit.client.0.smithi033.stdout:0/579: mknod d0/d8/d15/d2d/d41/d73/cc5 0 2024-02-15T18:31:07.561 INFO:tasks.workunit.client.0.smithi033.stdout:0/580: chown d0/d8/d15/d8b/da3/d6c 218497184 1 2024-02-15T18:31:07.562 INFO:tasks.workunit.client.0.smithi033.stdout:1/613: dwrite d5/dd/d12/d49/f1d [4194304,4194304] 0 2024-02-15T18:31:07.562 INFO:tasks.workunit.client.0.smithi033.stdout:1/614: fsync d5/d38/f99 0 2024-02-15T18:31:07.563 INFO:tasks.workunit.client.0.smithi033.stdout:8/550: dread d0/df/d53/db3/d30/d8e/d35/f4f [0,4194304] 0 2024-02-15T18:31:07.565 INFO:tasks.workunit.client.0.smithi033.stdout:0/581: rmdir d0/d8/d15/d8b/da3/dae/d58/d80 39 2024-02-15T18:31:07.566 INFO:tasks.workunit.client.0.smithi033.stdout:0/582: write d0/d64/d1d/f21 [4011129,99086] 0 2024-02-15T18:31:07.566 INFO:tasks.workunit.client.0.smithi033.stdout:1/615: creat d5/d9/d1e/d20/d5c/d57/d82/fba x:0 0 0 2024-02-15T18:31:07.566 INFO:tasks.workunit.client.0.smithi033.stdout:8/551: symlink d0/df/d53/db3/d30/d8e/d8f/d4b/d72/lb5 0 2024-02-15T18:31:07.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/636: write d4/d20/d13/d1b/f6a [444023,40978] 0 2024-02-15T18:31:07.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/637: truncate d4/d5/f55 8773122 0 2024-02-15T18:31:07.568 INFO:tasks.workunit.client.0.smithi033.stdout:2/636: dread d20/d30/f8d [0,4194304] 0 2024-02-15T18:31:07.568 INFO:tasks.workunit.client.0.smithi033.stdout:2/637: fdatasync d20/d31/d47/d4c/f56 0 2024-02-15T18:31:07.568 INFO:tasks.workunit.client.0.smithi033.stdout:2/638: write d20/d31/d47/d64/fbf [189637,21409] 0 2024-02-15T18:31:07.568 INFO:tasks.workunit.client.0.smithi033.stdout:8/552: write d0/df/d53/db3/f3b [679306,29209] 0 2024-02-15T18:31:07.568 INFO:tasks.workunit.client.0.smithi033.stdout:0/583: creat d0/d8/d15/d2d/d3f/d8d/fc6 x:0 0 0 2024-02-15T18:31:07.569 INFO:tasks.workunit.client.0.smithi033.stdout:1/616: creat d5/d9/d1e/d20/d2c/d34/d51/fbb x:0 0 0 2024-02-15T18:31:07.569 INFO:tasks.workunit.client.0.smithi033.stdout:2/639: creat d20/d31/d47/d4c/d6c/d80/da0/fe8 x:0 0 0 2024-02-15T18:31:07.569 INFO:tasks.workunit.client.0.smithi033.stdout:2/640: readlink d20/d73/lcc 0 2024-02-15T18:31:07.570 INFO:tasks.workunit.client.0.smithi033.stdout:8/553: creat d0/df/d53/db3/d30/d8e/d35/d58/da1/fb6 x:0 0 0 2024-02-15T18:31:07.570 INFO:tasks.workunit.client.0.smithi033.stdout:8/554: chown d0/df/d53/db3/d30/d8e/d8f/d4b/d72/c89 754616 1 2024-02-15T18:31:07.571 INFO:tasks.workunit.client.0.smithi033.stdout:2/641: creat d20/d31/d47/d4c/d6c/fe9 x:0 0 0 2024-02-15T18:31:07.572 INFO:tasks.workunit.client.0.smithi033.stdout:2/642: symlink d20/d3a/d4a/lea 0 2024-02-15T18:31:07.572 INFO:tasks.workunit.client.0.smithi033.stdout:2/643: chown d20/d31/d6a/f24 25494 1 2024-02-15T18:31:07.572 INFO:tasks.workunit.client.0.smithi033.stdout:2/644: chown d20/d31/d47/d4c/d6c/d80/da5/fbb 7959147 1 2024-02-15T18:31:07.573 INFO:tasks.workunit.client.0.smithi033.stdout:2/645: creat d20/d3a/d4a/d5e/d6b/feb x:0 0 0 2024-02-15T18:31:07.576 INFO:tasks.workunit.client.0.smithi033.stdout:2/646: symlink d20/d3a/d4a/d5e/d6b/d88/da6/ddb/ddf/lec 0 2024-02-15T18:31:07.576 INFO:tasks.workunit.client.0.smithi033.stdout:2/647: mknod d20/d31/d47/d4c/d6c/d80/da0/ced 0 2024-02-15T18:31:07.579 INFO:tasks.workunit.client.0.smithi033.stdout:2/648: mkdir d20/d3a/dee 0 2024-02-15T18:31:07.579 INFO:tasks.workunit.client.0.smithi033.stdout:2/649: dread - d20/d3a/d4a/d5e/d6b/d88/da6/ddb/ddf/fe2 zero size 2024-02-15T18:31:07.579 INFO:tasks.workunit.client.0.smithi033.stdout:3/616: dwrite d2/d14/d23/d68/d73/d76/fb4 [0,4194304] 0 2024-02-15T18:31:07.581 INFO:tasks.workunit.client.0.smithi033.stdout:1/617: write d5/d9/d1e/d20/d2c/d34/f86 [2682150,95751] 0 2024-02-15T18:31:07.587 INFO:tasks.workunit.client.0.smithi033.stdout:3/617: mknod d2/cbd 0 2024-02-15T18:31:07.588 INFO:tasks.workunit.client.0.smithi033.stdout:5/663: dwrite d1/da/f55 [4194304,4194304] 0 2024-02-15T18:31:07.588 INFO:tasks.workunit.client.0.smithi033.stdout:5/664: fsync d1/da/fb6 0 2024-02-15T18:31:07.590 INFO:tasks.workunit.client.0.smithi033.stdout:3/618: mknod d2/d14/d23/d6f/cbe 0 2024-02-15T18:31:07.590 INFO:tasks.workunit.client.0.smithi033.stdout:3/619: read - d2/d3/d1e/d22/d4d/fad zero size 2024-02-15T18:31:07.591 INFO:tasks.workunit.client.0.smithi033.stdout:5/665: mkdir d1/da/d19/d3c/dd2 0 2024-02-15T18:31:07.592 INFO:tasks.workunit.client.0.smithi033.stdout:7/580: dwrite d0/dc/d10/d1d/d38/daa/fc3 [0,4194304] 0 2024-02-15T18:31:07.603 INFO:tasks.workunit.client.0.smithi033.stdout:5/666: write d1/da/d11/f49 [1392269,58862] 0 2024-02-15T18:31:07.604 INFO:tasks.workunit.client.0.smithi033.stdout:5/667: creat d1/da/d10/d2b/d42/d4c/fd3 x:0 0 0 2024-02-15T18:31:07.606 INFO:tasks.workunit.client.0.smithi033.stdout:5/668: rename d1/da/d10/f8a to d1/da/d11/d5e/db1/d63/fd4 0 2024-02-15T18:31:07.607 INFO:tasks.workunit.client.0.smithi033.stdout:5/669: dread - d1/da/d11/d5e/db1/d63/d61/fb7 zero size 2024-02-15T18:31:07.607 INFO:tasks.workunit.client.0.smithi033.stdout:5/670: write d1/da/d11/d5e/db1/d63/d61/daf/fbd [2391660,111322] 0 2024-02-15T18:31:07.611 INFO:tasks.workunit.client.0.smithi033.stdout:8/555: dwrite d0/df/d53/db3/d30/d8e/d35/d29/f46 [0,4194304] 0 2024-02-15T18:31:07.612 INFO:tasks.workunit.client.0.smithi033.stdout:8/556: readlink d0/df/d53/db3/d30/d8e/d35/d29/l6d 0 2024-02-15T18:31:07.613 INFO:tasks.workunit.client.0.smithi033.stdout:8/557: mkdir d0/df/d53/db3/d30/d8e/da7/db7 0 2024-02-15T18:31:07.613 INFO:tasks.workunit.client.0.smithi033.stdout:8/558: chown d0/df/d53/db3/f3b 447152906 1 2024-02-15T18:31:07.614 INFO:tasks.workunit.client.0.smithi033.stdout:8/559: symlink d0/df/db/lb8 0 2024-02-15T18:31:07.619 INFO:tasks.workunit.client.0.smithi033.stdout:8/560: read d0/df/db/d45/f4a [3588320,123473] 0 2024-02-15T18:31:07.621 INFO:tasks.workunit.client.0.smithi033.stdout:0/584: dwrite d0/fd [4194304,4194304] 0 2024-02-15T18:31:07.622 INFO:tasks.workunit.client.0.smithi033.stdout:4/638: dwrite d4/d20/d13/f94 [0,4194304] 0 2024-02-15T18:31:07.622 INFO:tasks.workunit.client.0.smithi033.stdout:2/650: dwrite d20/d31/d47/d82/fd3 [0,4194304] 0 2024-02-15T18:31:07.622 INFO:tasks.workunit.client.0.smithi033.stdout:2/651: chown d20/d31/d47/d4c/d6c/d80 5 1 2024-02-15T18:31:07.623 INFO:tasks.workunit.client.0.smithi033.stdout:1/618: dwrite d5/d9/d1e/d20/d5c/f74 [4194304,4194304] 0 2024-02-15T18:31:07.623 INFO:tasks.workunit.client.0.smithi033.stdout:7/581: dwrite d0/dc/d10/d1d/d2b/d5f/d63/f79 [0,4194304] 0 2024-02-15T18:31:07.626 INFO:tasks.workunit.client.0.smithi033.stdout:3/620: dwrite d2/d3/df/f7c [0,4194304] 0 2024-02-15T18:31:07.626 INFO:tasks.workunit.client.0.smithi033.stdout:3/621: chown d2/d3/df/d6c/f72 2432 1 2024-02-15T18:31:07.626 INFO:tasks.workunit.client.0.smithi033.stdout:2/652: dread d20/d31/f51 [0,4194304] 0 2024-02-15T18:31:07.629 INFO:tasks.workunit.client.0.smithi033.stdout:0/585: creat d0/d8/d15/d2d/d41/d79/fc7 x:0 0 0 2024-02-15T18:31:07.637 INFO:tasks.workunit.client.0.smithi033.stdout:4/639: mkdir d4/d20/d13/d5c/dd1 0 2024-02-15T18:31:07.643 INFO:tasks.workunit.client.0.smithi033.stdout:4/640: write d4/d20/ff [2782482,64548] 0 2024-02-15T18:31:07.650 INFO:tasks.workunit.client.0.smithi033.stdout:7/582: rmdir d0/dc/d10/d1d/d38/d74/d7f 39 2024-02-15T18:31:07.650 INFO:tasks.workunit.client.0.smithi033.stdout:7/583: fdatasync d0/f33 0 2024-02-15T18:31:07.652 INFO:tasks.workunit.client.0.smithi033.stdout:3/622: truncate d2/d14/f55 2269435 0 2024-02-15T18:31:07.653 INFO:tasks.workunit.client.0.smithi033.stdout:0/586: mknod d0/d8/d15/d5b/cc8 0 2024-02-15T18:31:07.654 INFO:tasks.workunit.client.0.smithi033.stdout:4/641: unlink d4/d20/d13/l41 0 2024-02-15T18:31:07.655 INFO:tasks.workunit.client.0.smithi033.stdout:7/584: symlink d0/d56/d70/d91/lc8 0 2024-02-15T18:31:07.656 INFO:tasks.workunit.client.0.smithi033.stdout:0/587: creat d0/d8/d15/d8b/da3/dae/d58/d80/dc1/fc9 x:0 0 0 2024-02-15T18:31:07.656 INFO:tasks.workunit.client.0.smithi033.stdout:8/561: dwrite d0/df/db/d45/f75 [0,4194304] 0 2024-02-15T18:31:07.659 INFO:tasks.workunit.client.0.smithi033.stdout:4/642: rename d4/d5/d28/d39/d62/d9c/d9e/da4/db1/cc2 to d4/d20/d13/d5c/d87/dc5/cd2 0 2024-02-15T18:31:07.660 INFO:tasks.workunit.client.0.smithi033.stdout:1/619: dwrite d5/d9/f32 [0,4194304] 0 2024-02-15T18:31:07.660 INFO:tasks.workunit.client.0.smithi033.stdout:1/620: chown d5/d38 10 1 2024-02-15T18:31:07.660 INFO:tasks.workunit.client.0.smithi033.stdout:5/671: dwrite d1/da/f69 [0,4194304] 0 2024-02-15T18:31:07.662 INFO:tasks.workunit.client.0.smithi033.stdout:2/653: dwrite d20/d3a/d4a/d5e/d6b/feb [0,4194304] 0 2024-02-15T18:31:07.668 INFO:tasks.workunit.client.0.smithi033.stdout:1/621: dread d5/d9/d1e/d20/d5c/f39 [0,4194304] 0 2024-02-15T18:31:07.669 INFO:tasks.workunit.client.0.smithi033.stdout:3/623: dread d2/d14/f2b [0,4194304] 0 2024-02-15T18:31:07.670 INFO:tasks.workunit.client.0.smithi033.stdout:5/672: mknod d1/dc3/cd5 0 2024-02-15T18:31:07.673 INFO:tasks.workunit.client.0.smithi033.stdout:6/704: sync 2024-02-15T18:31:07.674 INFO:tasks.workunit.client.0.smithi033.stdout:6/705: dread - d8/d1d/fa6 zero size 2024-02-15T18:31:07.674 INFO:tasks.workunit.client.0.smithi033.stdout:8/562: dread d0/df/d53/db3/d30/d8e/f39 [0,4194304] 0 2024-02-15T18:31:07.674 INFO:tasks.workunit.client.0.smithi033.stdout:8/563: write d0/df/db/f6b [1696901,100731] 0 2024-02-15T18:31:07.677 INFO:tasks.workunit.client.0.smithi033.stdout:2/654: rename d20/d31/d47/d4c/d6c to d20/d31/d47/d4c/def 0 2024-02-15T18:31:07.678 INFO:tasks.workunit.client.0.smithi033.stdout:7/585: rmdir d0/d56/d70 39 2024-02-15T18:31:07.682 INFO:tasks.workunit.client.0.smithi033.stdout:1/622: creat d5/dd/fbc x:0 0 0 2024-02-15T18:31:07.682 INFO:tasks.workunit.client.0.smithi033.stdout:3/624: creat d2/d14/db3/dba/fbf x:0 0 0 2024-02-15T18:31:07.682 INFO:tasks.workunit.client.0.smithi033.stdout:5/673: link d1/da/d10/f8c d1/da/d10/d2b/d42/d71/fd6 0 2024-02-15T18:31:07.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/674: readlink d1/da/l16 0 2024-02-15T18:31:07.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/675: truncate d1/da/d10/d2b/fac 598709 0 2024-02-15T18:31:07.683 INFO:tasks.workunit.client.0.smithi033.stdout:5/676: fsync d1/da/d11/f7c 0 2024-02-15T18:31:07.686 INFO:tasks.workunit.client.0.smithi033.stdout:4/643: dwrite d4/d20/d13/d1b/f64 [0,4194304] 0 2024-02-15T18:31:07.686 INFO:tasks.workunit.client.0.smithi033.stdout:6/706: rmdir d8/d1d 39 2024-02-15T18:31:07.686 INFO:tasks.workunit.client.0.smithi033.stdout:6/707: truncate d8/d1d/d37/d4f/dbb/d57/fd3 653571 0 2024-02-15T18:31:07.686 INFO:tasks.workunit.client.0.smithi033.stdout:6/708: chown d8/d28/d14/d2c/d3b/fb8 38092 1 2024-02-15T18:31:07.687 INFO:tasks.workunit.client.0.smithi033.stdout:0/588: dwrite d0/d8/d54/f90 [0,4194304] 0 2024-02-15T18:31:07.687 INFO:tasks.workunit.client.0.smithi033.stdout:8/564: truncate d0/df/d53/db3/d30/d8e/fb2 1627576 0 2024-02-15T18:31:07.690 INFO:tasks.workunit.client.0.smithi033.stdout:2/655: creat d20/d3a/ff0 x:0 0 0 2024-02-15T18:31:07.692 INFO:tasks.workunit.client.0.smithi033.stdout:3/625: rename d2/d14/f55 to d2/d14/d23/d5c/fc0 0 2024-02-15T18:31:07.696 INFO:tasks.workunit.client.0.smithi033.stdout:5/677: mknod d1/da/d11/d5e/db1/d63/cd7 0 2024-02-15T18:31:07.697 INFO:tasks.workunit.client.0.smithi033.stdout:4/644: unlink d4/l57 0 2024-02-15T18:31:07.697 INFO:tasks.workunit.client.0.smithi033.stdout:4/645: truncate d4/f15 4813163 0 2024-02-15T18:31:07.697 INFO:tasks.workunit.client.0.smithi033.stdout:6/709: creat d8/d1d/d37/dbf/dd0/fe3 x:0 0 0 2024-02-15T18:31:07.697 INFO:tasks.workunit.client.0.smithi033.stdout:6/710: readlink d8/ld5 0 2024-02-15T18:31:07.697 INFO:tasks.workunit.client.0.smithi033.stdout:6/711: truncate d8/d28/d14/d2c/d3b/d3d/f48 3838869 0 2024-02-15T18:31:07.698 INFO:tasks.workunit.client.0.smithi033.stdout:6/712: read d8/f5b [327260,66936] 0 2024-02-15T18:31:07.698 INFO:tasks.workunit.client.0.smithi033.stdout:6/713: stat d8/d1d/d37/d4f/dbb/d55/d60/l8b 0 2024-02-15T18:31:07.698 INFO:tasks.workunit.client.0.smithi033.stdout:6/714: stat d8/d28/d14/d2c/d31/d5d/d8c/fbe 0 2024-02-15T18:31:07.700 INFO:tasks.workunit.client.0.smithi033.stdout:0/589: unlink d0/d64/d1d/c48 0 2024-02-15T18:31:07.704 INFO:tasks.workunit.client.0.smithi033.stdout:2/656: mkdir d20/d31/d47/d4c/def/df1 0 2024-02-15T18:31:07.705 INFO:tasks.workunit.client.0.smithi033.stdout:3/626: creat d2/d3/d1e/d22/d59/fc1 x:0 0 0 2024-02-15T18:31:07.707 INFO:tasks.workunit.client.0.smithi033.stdout:5/678: getdents d1 0 2024-02-15T18:31:07.707 INFO:tasks.workunit.client.0.smithi033.stdout:4/646: read d4/d20/d13/d1b/d7c/f95 [236124,27328] 0 2024-02-15T18:31:07.707 INFO:tasks.workunit.client.0.smithi033.stdout:4/647: chown d4/d20/d13/d5c/l76 740 1 2024-02-15T18:31:07.709 INFO:tasks.workunit.client.0.smithi033.stdout:2/657: rename d20/d31/d6a/f72 to d20/d3a/d4a/d5e/d6b/d88/da6/ddb/ff2 0 2024-02-15T18:31:07.709 INFO:tasks.workunit.client.0.smithi033.stdout:7/586: dwrite d0/dc/d10/d1d/d38/d82/f8d [0,4194304] 0 2024-02-15T18:31:07.709 INFO:tasks.workunit.client.0.smithi033.stdout:7/587: chown d0/dc/d10/d7d/d93 523 1 2024-02-15T18:31:07.709 INFO:tasks.workunit.client.0.smithi033.stdout:4/648: mkdir d4/d5/dc9/dd3 0 2024-02-15T18:31:07.712 INFO:tasks.workunit.client.0.smithi033.stdout:3/627: rename d2/d14/d23/d68/d73/ca0 to d2/d3/d1e/d22/d59/cc2 0 2024-02-15T18:31:07.712 INFO:tasks.workunit.client.0.smithi033.stdout:3/628: fsync d2/d3/df/d6c/f91 0 2024-02-15T18:31:07.713 INFO:tasks.workunit.client.0.smithi033.stdout:2/658: write d20/f43 [620908,68328] 0 2024-02-15T18:31:07.715 INFO:tasks.workunit.client.0.smithi033.stdout:3/629: creat d2/d3/d1e/fc3 x:0 0 0 2024-02-15T18:31:07.716 INFO:tasks.workunit.client.0.smithi033.stdout:2/659: creat d20/d31/dc8/ff3 x:0 0 0 2024-02-15T18:31:07.716 INFO:tasks.workunit.client.0.smithi033.stdout:0/590: dread d0/d64/d88/f8a [0,4194304] 0 2024-02-15T18:31:07.717 INFO:tasks.workunit.client.0.smithi033.stdout:0/591: write d0/d8/d15/d8b/da3/d6c/fba [184529,125916] 0 2024-02-15T18:31:07.717 INFO:tasks.workunit.client.0.smithi033.stdout:7/588: symlink d0/dc/d10/d1d/d38/d74/lc9 0 2024-02-15T18:31:07.717 INFO:tasks.workunit.client.0.smithi033.stdout:7/589: chown d0/fbb 0 1 2024-02-15T18:31:07.718 INFO:tasks.workunit.client.0.smithi033.stdout:1/623: dwrite d5/dd/f3e [0,4194304] 0 2024-02-15T18:31:07.719 INFO:tasks.workunit.client.0.smithi033.stdout:8/565: dwrite d0/df/db/d45/f4a [0,4194304] 0 2024-02-15T18:31:07.720 INFO:tasks.workunit.client.0.smithi033.stdout:9/546: sync 2024-02-15T18:31:07.720 INFO:tasks.workunit.client.0.smithi033.stdout:9/547: fsync d4/d32/f54 0 2024-02-15T18:31:07.720 INFO:tasks.workunit.client.0.smithi033.stdout:6/715: dwrite d8/d28/d14/d2c/d3b/d3d/f48 [0,4194304] 0 2024-02-15T18:31:07.720 INFO:tasks.workunit.client.0.smithi033.stdout:5/679: rename d1/da/d19/d3c to d1/da/d52/dd8 0 2024-02-15T18:31:07.723 INFO:tasks.workunit.client.0.smithi033.stdout:3/630: creat d2/d14/d23/d6f/d93/fc4 x:0 0 0 2024-02-15T18:31:07.731 INFO:tasks.workunit.client.0.smithi033.stdout:0/592: mkdir d0/d8/d15/d2d/d3f/d97/db1/dca 0 2024-02-15T18:31:07.732 INFO:tasks.workunit.client.0.smithi033.stdout:7/590: unlink d0/dc/d10/d1d/l57 0 2024-02-15T18:31:07.734 INFO:tasks.workunit.client.0.smithi033.stdout:1/624: creat d5/d9/d1e/d20/d5c/d57/fbd x:0 0 0 2024-02-15T18:31:07.741 INFO:tasks.workunit.client.0.smithi033.stdout:8/566: creat d0/df/d53/db3/d30/d8e/d35/d58/da1/fb9 x:0 0 0 2024-02-15T18:31:07.741 INFO:tasks.workunit.client.0.smithi033.stdout:8/567: stat d0/df/d53/db3/d30/d8e/la6 0 2024-02-15T18:31:07.741 INFO:tasks.workunit.client.0.smithi033.stdout:8/568: readlink d0/df/d53/db3/d30/l88 0 2024-02-15T18:31:07.742 INFO:tasks.workunit.client.0.smithi033.stdout:5/680: mkdir d1/da/d11/dd9 0 2024-02-15T18:31:07.746 INFO:tasks.workunit.client.0.smithi033.stdout:9/548: dwrite d4/d8/dd/f63 [0,4194304] 0 2024-02-15T18:31:07.749 INFO:tasks.workunit.client.0.smithi033.stdout:3/631: creat d2/d14/d23/d68/d73/d83/fc5 x:0 0 0 2024-02-15T18:31:07.749 INFO:tasks.workunit.client.0.smithi033.stdout:7/591: creat d0/dc/d10/fca x:0 0 0 2024-02-15T18:31:07.749 INFO:tasks.workunit.client.0.smithi033.stdout:1/625: rmdir d5/d9/d1e/d20/d2c/d34 39 2024-02-15T18:31:07.749 INFO:tasks.workunit.client.0.smithi033.stdout:0/593: rename d0/d8/d15/d2d/d41/d73/d96/fb8 to d0/d8/d15/d8b/da3/dae/d59/fcb 0 2024-02-15T18:31:07.749 INFO:tasks.workunit.client.0.smithi033.stdout:6/716: dwrite d8/d28/d14/d2c/d31/d30/d29/d38/d54/f88 [0,4194304] 0 2024-02-15T18:31:07.749 INFO:tasks.workunit.client.0.smithi033.stdout:6/717: chown d8/d1d/d37/d72/da1 11282135 1 2024-02-15T18:31:07.750 INFO:tasks.workunit.client.0.smithi033.stdout:2/660: dread d20/d31/d47/d4c/def/d80/da0/fdd [0,4194304] 0 2024-02-15T18:31:07.750 INFO:tasks.workunit.client.0.smithi033.stdout:2/661: chown d20/d31/d47/d4c/def/d80/fb8 262627 1 2024-02-15T18:31:07.750 INFO:tasks.workunit.client.0.smithi033.stdout:5/681: creat d1/da/d10/d2b/fda x:0 0 0 2024-02-15T18:31:07.750 INFO:tasks.workunit.client.0.smithi033.stdout:5/682: dread - d1/da/d11/d5e/db1/fcf zero size 2024-02-15T18:31:07.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:05.524438+0000 mgr.smithi131.buibla (mgr.24387) 22 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 669 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32 MiB/s rd, 65 MiB/s wr, 117 op/s 2024-02-15T18:31:07.751 INFO:tasks.workunit.client.0.smithi033.stdout:1/626: read d5/d17/f35 [617361,73311] 0 2024-02-15T18:31:07.752 INFO:tasks.workunit.client.0.smithi033.stdout:1/627: readlink d5/d9/d1e/d20/l4c 0 2024-02-15T18:31:07.755 INFO:tasks.workunit.client.0.smithi033.stdout:9/549: mknod d4/d8/dd/cb8 0 2024-02-15T18:31:07.756 INFO:tasks.workunit.client.0.smithi033.stdout:7/592: write d0/dc/d10/d1d/d38/d82/f8d [3458748,73829] 0 2024-02-15T18:31:07.756 INFO:tasks.workunit.client.0.smithi033.stdout:7/593: fdatasync d0/dc/d10/d1d/d2b/d5f/d63/f79 0 2024-02-15T18:31:07.756 INFO:tasks.workunit.client.0.smithi033.stdout:7/594: readlink d0/d56/d70/d91/d9e/lb6 0 2024-02-15T18:31:07.756 INFO:tasks.workunit.client.0.smithi033.stdout:6/718: symlink d8/le4 0 2024-02-15T18:31:07.757 INFO:tasks.workunit.client.0.smithi033.stdout:2/662: mknod d20/d3a/cf4 0 2024-02-15T18:31:07.757 INFO:tasks.workunit.client.0.smithi033.stdout:8/569: dwrite d0/fe [8388608,4194304] 0 2024-02-15T18:31:07.758 INFO:tasks.workunit.client.0.smithi033.stdout:5/683: rmdir d1/da/d88 39 2024-02-15T18:31:07.758 INFO:tasks.workunit.client.0.smithi033.stdout:5/684: readlink d1/da/d10/l50 0 2024-02-15T18:31:07.758 INFO:tasks.workunit.client.0.smithi033.stdout:8/570: write d0/df/d53/db3/f3e [3911181,75898] 0 2024-02-15T18:31:07.759 INFO:tasks.workunit.client.0.smithi033.stdout:1/628: link d5/d17/f29 d5/d9/d1e/d20/d2c/d34/d51/d63/fbe 0 2024-02-15T18:31:07.764 INFO:tasks.workunit.client.0.smithi033.stdout:2/663: write d20/f4b [421859,58168] 0 2024-02-15T18:31:07.764 INFO:tasks.workunit.client.0.smithi033.stdout:2/664: write d20/d31/dc8/ff3 [576195,106194] 0 2024-02-15T18:31:07.768 INFO:tasks.workunit.client.0.smithi033.stdout:7/595: mknod d0/dc/d10/d48/ccb 0 2024-02-15T18:31:07.768 INFO:tasks.workunit.client.0.smithi033.stdout:6/719: truncate d8/d28/d14/d2c/d31/d30/f71 1745799 0 2024-02-15T18:31:07.768 INFO:tasks.workunit.client.0.smithi033.stdout:6/720: write d8/fb0 [428178,36536] 0 2024-02-15T18:31:07.770 INFO:tasks.workunit.client.0.smithi033.stdout:5/685: creat d1/da/d19/d3f/d68/dd0/fdb x:0 0 0 2024-02-15T18:31:07.770 INFO:tasks.workunit.client.0.smithi033.stdout:5/686: write d1/da/d11/d5e/db1/d63/d61/da3/fb0 [143695,44347] 0 2024-02-15T18:31:07.770 INFO:tasks.workunit.client.0.smithi033.stdout:5/687: readlink d1/da/l16 0 2024-02-15T18:31:07.770 INFO:tasks.workunit.client.0.smithi033.stdout:5/688: chown d1/da/d52/dd8/d40/d65/f91 0 1 2024-02-15T18:31:07.770 INFO:tasks.workunit.client.0.smithi033.stdout:5/689: fdatasync d1/da/d11/d5e/f6c 0 2024-02-15T18:31:07.770 INFO:tasks.workunit.client.0.smithi033.stdout:5/690: chown d1/da/d19/lae 696 1 2024-02-15T18:31:07.770 INFO:tasks.workunit.client.0.smithi033.stdout:8/571: dread d0/df/db/d45/f4a [0,4194304] 0 2024-02-15T18:31:07.773 INFO:tasks.workunit.client.0.smithi033.stdout:7/596: mknod d0/d56/d70/d91/d9e/ccc 0 2024-02-15T18:31:07.774 INFO:tasks.workunit.client.0.smithi033.stdout:6/721: truncate d8/d1d/d37/d4f/dbb/d57/fdf 6590491 0 2024-02-15T18:31:07.778 INFO:tasks.workunit.client.0.smithi033.stdout:7/597: creat d0/d56/d70/d83/fcd x:0 0 0 2024-02-15T18:31:07.778 INFO:tasks.workunit.client.0.smithi033.stdout:6/722: creat d8/d1d/d37/dbf/dd0/fe5 x:0 0 0 2024-02-15T18:31:07.778 INFO:tasks.workunit.client.0.smithi033.stdout:3/632: dwrite d2/f5 [0,4194304] 0 2024-02-15T18:31:07.779 INFO:tasks.workunit.client.0.smithi033.stdout:7/598: fdatasync d0/f62 0 2024-02-15T18:31:07.781 INFO:tasks.workunit.client.0.smithi033.stdout:3/633: rename d2/d20/f45 to d2/d14/db3/dba/fc6 0 2024-02-15T18:31:07.781 INFO:tasks.workunit.client.0.smithi033.stdout:3/634: read - d2/d3/df/d6c/fb5 zero size 2024-02-15T18:31:07.783 INFO:tasks.workunit.client.0.smithi033.stdout:3/635: getdents d2/d14/d23/d68/d88 0 2024-02-15T18:31:07.784 INFO:tasks.workunit.client.0.smithi033.stdout:6/723: dread d8/d28/d14/d2c/d31/d30/fa4 [0,4194304] 0 2024-02-15T18:31:07.785 INFO:tasks.workunit.client.0.smithi033.stdout:6/724: dread - d8/d1d/d37/d4f/dbb/fdc zero size 2024-02-15T18:31:07.786 INFO:tasks.workunit.client.0.smithi033.stdout:3/636: symlink d2/d3/lc7 0 2024-02-15T18:31:07.787 INFO:tasks.workunit.client.0.smithi033.stdout:1/629: dwrite d5/dd/f3e [4194304,4194304] 0 2024-02-15T18:31:07.788 INFO:tasks.workunit.client.0.smithi033.stdout:3/637: getdents d2/d14/d23/d6f 0 2024-02-15T18:31:07.788 INFO:tasks.workunit.client.0.smithi033.stdout:1/630: read d5/dd/d12/d49/f2b [58479,93550] 0 2024-02-15T18:31:07.789 INFO:tasks.workunit.client.0.smithi033.stdout:9/550: dwrite d4/d8/dd/d41/d51/f52 [0,4194304] 0 2024-02-15T18:31:07.789 INFO:tasks.workunit.client.0.smithi033.stdout:6/725: write d8/d28/d14/d2c/d3b/d3d/f48 [2199160,71416] 0 2024-02-15T18:31:07.790 INFO:tasks.workunit.client.0.smithi033.stdout:3/638: getdents d2/d3/d1e 0 2024-02-15T18:31:07.792 INFO:tasks.workunit.client.0.smithi033.stdout:1/631: link d5/d9/d1e/d20/d5c/d57/fa7 d5/d9/d1e/d20/d2c/db2/fbf 0 2024-02-15T18:31:07.794 INFO:tasks.workunit.client.0.smithi033.stdout:1/632: mkdir d5/d9/d1e/d20/d2c/d34/dc0 0 2024-02-15T18:31:07.795 INFO:tasks.workunit.client.0.smithi033.stdout:6/726: mknod d8/d1d/d37/d4f/dbb/d55/d60/dd6/ce6 0 2024-02-15T18:31:07.795 INFO:tasks.workunit.client.0.smithi033.stdout:1/633: fsync d5/d9/d1e/d20/d2c/d34/d51/fa8 0 2024-02-15T18:31:07.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:05.524438+0000 mgr.smithi131.buibla (mgr.24387) 22 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 669 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 32 MiB/s rd, 65 MiB/s wr, 117 op/s 2024-02-15T18:31:07.799 INFO:tasks.workunit.client.0.smithi033.stdout:6/727: truncate d8/d1d/d37/d4f/dbb/d55/d63/fc5 1358099 0 2024-02-15T18:31:07.799 INFO:tasks.workunit.client.0.smithi033.stdout:6/728: write d8/d28/d36/f41 [1733690,73910] 0 2024-02-15T18:31:07.800 INFO:tasks.workunit.client.0.smithi033.stdout:1/634: symlink d5/d38/lc1 0 2024-02-15T18:31:07.802 INFO:tasks.workunit.client.0.smithi033.stdout:1/635: link d5/d9/d1e/d20/d5c/la2 d5/d9/d1e/d20/d2c/d34/lc2 0 2024-02-15T18:31:07.812 INFO:tasks.workunit.client.0.smithi033.stdout:2/665: dwrite d20/d31/d6a/f28 [0,4194304] 0 2024-02-15T18:31:07.825 INFO:tasks.workunit.client.0.smithi033.stdout:2/666: dread d20/d3a/d4a/d5e/d6b/feb [0,4194304] 0 2024-02-15T18:31:07.827 INFO:tasks.workunit.client.0.smithi033.stdout:2/667: creat d20/d31/d47/d82/ff5 x:0 0 0 2024-02-15T18:31:07.827 INFO:tasks.workunit.client.0.smithi033.stdout:5/691: dwrite d1/f4 [0,4194304] 0 2024-02-15T18:31:07.827 INFO:tasks.workunit.client.0.smithi033.stdout:7/599: dwrite d0/dc/d10/d1d/f2d [0,4194304] 0 2024-02-15T18:31:07.827 INFO:tasks.workunit.client.0.smithi033.stdout:7/600: write d0/d56/fc1 [998657,18121] 0 2024-02-15T18:31:07.827 INFO:tasks.workunit.client.0.smithi033.stdout:7/601: readlink d0/dc/d10/d1d/d38/d74/lc9 0 2024-02-15T18:31:07.827 INFO:tasks.workunit.client.0.smithi033.stdout:7/602: fsync d0/dc/d10/d48/f81 0 2024-02-15T18:31:07.828 INFO:tasks.workunit.client.0.smithi033.stdout:1/636: dwrite d5/d17/f35 [0,4194304] 0 2024-02-15T18:31:07.829 INFO:tasks.workunit.client.0.smithi033.stdout:3/639: dwrite d2/f2e [4194304,4194304] 0 2024-02-15T18:31:07.830 INFO:tasks.workunit.client.0.smithi033.stdout:8/572: dwrite d0/df/d53/db3/d30/d8e/d35/f93 [0,4194304] 0 2024-02-15T18:31:07.830 INFO:tasks.workunit.client.0.smithi033.stdout:3/640: truncate d2/d14/d23/d6f/d93/f98 172854 0 2024-02-15T18:31:07.841 INFO:tasks.workunit.client.0.smithi033.stdout:8/573: mknod d0/df/d48/cba 0 2024-02-15T18:31:07.842 INFO:tasks.workunit.client.0.smithi033.stdout:5/692: dread d1/da/f55 [4194304,4194304] 0 2024-02-15T18:31:07.842 INFO:tasks.workunit.client.0.smithi033.stdout:5/693: read - d1/da/fb6 zero size 2024-02-15T18:31:07.842 INFO:tasks.workunit.client.0.smithi033.stdout:5/694: fdatasync d1/da/d11/d5e/f94 0 2024-02-15T18:31:07.842 INFO:tasks.workunit.client.0.smithi033.stdout:3/641: write d2/d20/f6a [1299321,117299] 0 2024-02-15T18:31:07.843 INFO:tasks.workunit.client.0.smithi033.stdout:5/695: creat d1/da/d19/d3f/d68/fdc x:0 0 0 2024-02-15T18:31:07.844 INFO:tasks.workunit.client.0.smithi033.stdout:7/603: dread d0/dc/f31 [0,4194304] 0 2024-02-15T18:31:07.844 INFO:tasks.workunit.client.0.smithi033.stdout:3/642: symlink d2/d3/d1e/lc8 0 2024-02-15T18:31:07.845 INFO:tasks.workunit.client.0.smithi033.stdout:5/696: creat d1/da/d11/d5e/db1/d63/d61/da3/dbe/fdd x:0 0 0 2024-02-15T18:31:07.845 INFO:tasks.workunit.client.0.smithi033.stdout:5/697: fsync d1/da/d11/fa2 0 2024-02-15T18:31:07.847 INFO:tasks.workunit.client.0.smithi033.stdout:7/604: creat d0/dc/d10/d1d/d38/fce x:0 0 0 2024-02-15T18:31:07.848 INFO:tasks.workunit.client.0.smithi033.stdout:3/643: creat d2/d3/d1e/d22/fc9 x:0 0 0 2024-02-15T18:31:07.850 INFO:tasks.workunit.client.0.smithi033.stdout:5/698: rename d1/da/d11/d5e/fcb to d1/da/d19/d3f/d68/fde 0 2024-02-15T18:31:07.851 INFO:tasks.workunit.client.0.smithi033.stdout:5/699: dread - d1/da/d10/f75 zero size 2024-02-15T18:31:07.853 INFO:tasks.workunit.client.0.smithi033.stdout:7/605: rename d0/dc/d10/d1d/f73 to d0/dbe/fcf 0 2024-02-15T18:31:07.859 INFO:tasks.workunit.client.0.smithi033.stdout:3/644: dread d2/d14/d23/d68/d73/d76/fb4 [0,4194304] 0 2024-02-15T18:31:07.861 INFO:tasks.workunit.client.0.smithi033.stdout:3/645: mknod d2/d14/d23/d68/d73/d83/cca 0 2024-02-15T18:31:07.861 INFO:tasks.workunit.client.0.smithi033.stdout:3/646: fsync d2/f2e 0 2024-02-15T18:31:07.861 INFO:tasks.workunit.client.0.smithi033.stdout:3/647: chown d2/d3/c2c 200 1 2024-02-15T18:31:07.861 INFO:tasks.workunit.client.0.smithi033.stdout:3/648: write d2/d14/f9e [426581,118037] 0 2024-02-15T18:31:07.865 INFO:tasks.workunit.client.0.smithi033.stdout:7/606: dread d0/dc/d10/d1d/d38/d74/f87 [0,4194304] 0 2024-02-15T18:31:07.865 INFO:tasks.workunit.client.0.smithi033.stdout:3/649: dread d2/d3/df/f7a [0,4194304] 0 2024-02-15T18:31:07.867 INFO:tasks.workunit.client.0.smithi033.stdout:7/607: mkdir d0/dc/d10/d1d/d38/dd0 0 2024-02-15T18:31:07.867 INFO:tasks.workunit.client.0.smithi033.stdout:7/608: readlink d0/dc/l92 0 2024-02-15T18:31:07.867 INFO:tasks.workunit.client.0.smithi033.stdout:7/609: fdatasync d0/d56/d70/d91/d9e/fb5 0 2024-02-15T18:31:07.868 INFO:tasks.workunit.client.0.smithi033.stdout:6/729: dwrite d8/d1d/d37/d4f/dbb/d55/d63/fc5 [0,4194304] 0 2024-02-15T18:31:07.874 INFO:tasks.workunit.client.0.smithi033.stdout:6/730: mkdir d8/d28/d14/d2c/de7 0 2024-02-15T18:31:07.874 INFO:tasks.workunit.client.0.smithi033.stdout:5/700: dwrite d1/da/d11/d5e/db1/f7b [0,4194304] 0 2024-02-15T18:31:07.874 INFO:tasks.workunit.client.0.smithi033.stdout:8/574: dwrite d0/df/d53/db3/d30/d8e/f39 [4194304,4194304] 0 2024-02-15T18:31:07.878 INFO:tasks.workunit.client.0.smithi033.stdout:7/610: dread d0/dc/d10/d1d/d38/d82/f8d [0,4194304] 0 2024-02-15T18:31:07.881 INFO:tasks.workunit.client.0.smithi033.stdout:7/611: rename d0/d56/d8e/f90 to d0/d56/d70/d83/fd1 0 2024-02-15T18:31:07.882 INFO:tasks.workunit.client.0.smithi033.stdout:7/612: symlink d0/dc/d10/d1d/d38/daa/ld2 0 2024-02-15T18:31:07.882 INFO:tasks.workunit.client.0.smithi033.stdout:3/650: dwrite d2/f8d [0,4194304] 0 2024-02-15T18:31:07.888 INFO:tasks.workunit.client.0.smithi033.stdout:7/613: getdents d0/dc/d10/d1d/d38/d74 0 2024-02-15T18:31:07.890 INFO:tasks.workunit.client.0.smithi033.stdout:4/649: sync 2024-02-15T18:31:07.892 INFO:tasks.workunit.client.0.smithi033.stdout:3/651: mkdir d2/d3/d1e/d22/d4d/dcb 0 2024-02-15T18:31:07.894 INFO:tasks.workunit.client.0.smithi033.stdout:7/614: rename d0/d56/d70/fb9 to d0/d56/fd3 0 2024-02-15T18:31:07.895 INFO:tasks.workunit.client.0.smithi033.stdout:3/652: unlink d2/d14/d23/d68/d73/d83/fc5 0 2024-02-15T18:31:07.895 INFO:tasks.workunit.client.0.smithi033.stdout:3/653: fdatasync d2/d20/f6a 0 2024-02-15T18:31:07.895 INFO:tasks.workunit.client.0.smithi033.stdout:3/654: fsync d2/d3/d1e/f4f 0 2024-02-15T18:31:07.896 INFO:tasks.workunit.client.0.smithi033.stdout:4/650: rename d4/d20/d37/f5e to d4/d20/d13/d1b/da7/fd4 0 2024-02-15T18:31:07.897 INFO:tasks.workunit.client.0.smithi033.stdout:7/615: read d0/f1 [9649192,38649] 0 2024-02-15T18:31:07.898 INFO:tasks.workunit.client.0.smithi033.stdout:7/616: creat d0/d56/d70/fd4 x:0 0 0 2024-02-15T18:31:07.898 INFO:tasks.workunit.client.0.smithi033.stdout:7/617: truncate d0/dc/d10/d1d/f25 4724993 0 2024-02-15T18:31:07.898 INFO:tasks.workunit.client.0.smithi033.stdout:7/618: chown d0/dc/d10/d1d/d2b 1 1 2024-02-15T18:31:07.900 INFO:tasks.workunit.client.0.smithi033.stdout:5/701: dwrite d1/da/d19/d3f/d68/fde [0,4194304] 0 2024-02-15T18:31:07.900 INFO:tasks.workunit.client.0.smithi033.stdout:5/702: write d1/f79 [810827,105903] 0 2024-02-15T18:31:07.901 INFO:tasks.workunit.client.0.smithi033.stdout:4/651: dread d4/d20/d13/f6e [0,4194304] 0 2024-02-15T18:31:07.901 INFO:tasks.workunit.client.0.smithi033.stdout:8/575: dwrite d0/df/d53/db3/d30/d8e/d35/f4f [0,4194304] 0 2024-02-15T18:31:07.901 INFO:tasks.workunit.client.0.smithi033.stdout:7/619: write d0/f6a [4036517,114934] 0 2024-02-15T18:31:07.901 INFO:tasks.workunit.client.0.smithi033.stdout:7/620: write d0/dc/d10/d1d/d38/d82/f8d [1527351,94465] 0 2024-02-15T18:31:07.905 INFO:tasks.workunit.client.0.smithi033.stdout:5/703: mkdir d1/da/d11/d5e/db1/d63/d61/da3/dbe/ddf 0 2024-02-15T18:31:07.905 INFO:tasks.workunit.client.0.smithi033.stdout:3/655: dread d2/f2e [0,4194304] 0 2024-02-15T18:31:07.908 INFO:tasks.workunit.client.0.smithi033.stdout:4/652: creat d4/d3c/fd5 x:0 0 0 2024-02-15T18:31:07.910 INFO:tasks.workunit.client.0.smithi033.stdout:8/576: mknod d0/df/d53/db3/d30/d8e/da7/cbb 0 2024-02-15T18:31:07.911 INFO:tasks.workunit.client.0.smithi033.stdout:7/621: creat d0/dc/d10/d1d/d2b/d5f/d63/fd5 x:0 0 0 2024-02-15T18:31:07.912 INFO:tasks.workunit.client.0.smithi033.stdout:3/656: rmdir d2/d14/db3 39 2024-02-15T18:31:07.913 INFO:tasks.workunit.client.0.smithi033.stdout:8/577: getdents d0/df/d53/db3/d30/d8e/d14/d56 0 2024-02-15T18:31:07.914 INFO:tasks.workunit.client.0.smithi033.stdout:7/622: creat d0/d56/d70/fd6 x:0 0 0 2024-02-15T18:31:07.914 INFO:tasks.workunit.client.0.smithi033.stdout:7/623: chown d0/d56/d70/d83/fd1 805049 1 2024-02-15T18:31:07.915 INFO:tasks.workunit.client.0.smithi033.stdout:3/657: mkdir d2/d3/dcc 0 2024-02-15T18:31:07.916 INFO:tasks.workunit.client.0.smithi033.stdout:7/624: link d0/dc/d10/d7d/f3f d0/dc/fd7 0 2024-02-15T18:31:07.917 INFO:tasks.workunit.client.0.smithi033.stdout:3/658: link d2/d3/d1e/d22/fa7 d2/d14/db3/fcd 0 2024-02-15T18:31:07.918 INFO:tasks.workunit.client.0.smithi033.stdout:7/625: mknod d0/dc/d10/d1d/d38/d74/d7f/cd8 0 2024-02-15T18:31:07.920 INFO:tasks.workunit.client.0.smithi033.stdout:3/659: unlink d2/d14/d23/d68/d73/lb8 0 2024-02-15T18:31:07.920 INFO:tasks.workunit.client.0.smithi033.stdout:4/653: dread d4/f21 [0,4194304] 0 2024-02-15T18:31:07.921 INFO:tasks.workunit.client.0.smithi033.stdout:5/704: dwrite d1/da/f41 [0,4194304] 0 2024-02-15T18:31:07.922 INFO:tasks.workunit.client.0.smithi033.stdout:3/660: rename d2/d20/f53 to d2/d14/d23/d6f/d93/fce 0 2024-02-15T18:31:07.925 INFO:tasks.workunit.client.0.smithi033.stdout:5/705: link d1/f5d d1/da/d19/d3f/d68/fe0 0 2024-02-15T18:31:07.926 INFO:tasks.workunit.client.0.smithi033.stdout:5/706: write d1/da/d11/d5e/db1/d63/d61/da3/dbe/fdd [217120,90289] 0 2024-02-15T18:31:07.927 INFO:tasks.workunit.client.0.smithi033.stdout:3/661: unlink d2/d14/d23/d5c/f99 0 2024-02-15T18:31:07.927 INFO:tasks.workunit.client.0.smithi033.stdout:3/662: write d2/d14/d23/d6f/d93/f98 [506573,89228] 0 2024-02-15T18:31:07.927 INFO:tasks.workunit.client.0.smithi033.stdout:3/663: chown d2/d14/db3 1845573873 1 2024-02-15T18:31:07.927 INFO:tasks.workunit.client.0.smithi033.stdout:4/654: creat d4/d5/d28/d39/d62/d9c/d9e/da4/fd6 x:0 0 0 2024-02-15T18:31:07.929 INFO:tasks.workunit.client.0.smithi033.stdout:5/707: rename d1/da/d88/la8 to d1/da/d88/le1 0 2024-02-15T18:31:07.929 INFO:tasks.workunit.client.0.smithi033.stdout:5/708: chown d1/da/d52/dd8/d40/fc8 256 1 2024-02-15T18:31:07.929 INFO:tasks.workunit.client.0.smithi033.stdout:5/709: truncate d1/da/d19/fad 254707 0 2024-02-15T18:31:07.929 INFO:tasks.workunit.client.0.smithi033.stdout:5/710: fsync d1/da/d19/d74/f92 0 2024-02-15T18:31:07.929 INFO:tasks.workunit.client.0.smithi033.stdout:4/655: creat d4/d3c/fd7 x:0 0 0 2024-02-15T18:31:07.930 INFO:tasks.workunit.client.0.smithi033.stdout:5/711: creat d1/da/d10/d2b/d42/d71/fe2 x:0 0 0 2024-02-15T18:31:07.930 INFO:tasks.workunit.client.0.smithi033.stdout:4/656: truncate d4/f22 1281905 0 2024-02-15T18:31:07.931 INFO:tasks.workunit.client.0.smithi033.stdout:5/712: symlink d1/da/d19/d3f/d68/dd0/le3 0 2024-02-15T18:31:07.932 INFO:tasks.workunit.client.0.smithi033.stdout:5/713: creat d1/da/d52/fe4 x:0 0 0 2024-02-15T18:31:07.934 INFO:tasks.workunit.client.0.smithi033.stdout:5/714: mknod d1/da/d11/d5e/ce5 0 2024-02-15T18:31:07.936 INFO:tasks.workunit.client.0.smithi033.stdout:5/715: creat d1/da/d19/d74/fe6 x:0 0 0 2024-02-15T18:31:07.937 INFO:tasks.workunit.client.0.smithi033.stdout:4/657: write d4/d20/fb [3395660,15280] 0 2024-02-15T18:31:07.937 INFO:tasks.workunit.client.0.smithi033.stdout:5/716: mkdir d1/da/d52/dd8/de7 0 2024-02-15T18:31:07.938 INFO:tasks.workunit.client.0.smithi033.stdout:4/658: mknod d4/d5/d28/cd8 0 2024-02-15T18:31:07.940 INFO:tasks.workunit.client.0.smithi033.stdout:4/659: symlink d4/d20/d13/d5c/d87/dd0/ld9 0 2024-02-15T18:31:07.942 INFO:tasks.workunit.client.0.smithi033.stdout:5/717: rename d1/da/d11/d5e/db1/d63/fab to d1/da/d52/fe8 0 2024-02-15T18:31:07.942 INFO:tasks.workunit.client.0.smithi033.stdout:4/660: mknod d4/d20/d13/d5c/d87/cda 0 2024-02-15T18:31:07.944 INFO:tasks.workunit.client.0.smithi033.stdout:7/626: dwrite d0/dc/d10/d1d/d38/daa/fc3 [4194304,4194304] 0 2024-02-15T18:31:07.945 INFO:tasks.workunit.client.0.smithi033.stdout:8/578: dwrite d0/df/db/d45/f75 [0,4194304] 0 2024-02-15T18:31:07.948 INFO:tasks.workunit.client.0.smithi033.stdout:5/718: dread d1/da/f55 [4194304,4194304] 0 2024-02-15T18:31:07.948 INFO:tasks.workunit.client.0.smithi033.stdout:5/719: stat d1/da/d11/fa2 0 2024-02-15T18:31:07.948 INFO:tasks.workunit.client.0.smithi033.stdout:4/661: dread d4/fb3 [0,4194304] 0 2024-02-15T18:31:07.949 INFO:tasks.workunit.client.0.smithi033.stdout:3/664: dwrite d2/d14/d23/d68/d88/fa5 [0,4194304] 0 2024-02-15T18:31:07.949 INFO:tasks.workunit.client.0.smithi033.stdout:3/665: fsync d2/d3/df/d6c/fb5 0 2024-02-15T18:31:07.959 INFO:tasks.workunit.client.0.smithi033.stdout:7/627: creat d0/dc/d10/d7d/d99/fd9 x:0 0 0 2024-02-15T18:31:07.961 INFO:tasks.workunit.client.0.smithi033.stdout:8/579: creat d0/df/d53/db3/d30/d8e/d8f/d4b/d72/fbc x:0 0 0 2024-02-15T18:31:07.968 INFO:tasks.workunit.client.0.smithi033.stdout:5/720: getdents d1/da/d10 0 2024-02-15T18:31:07.968 INFO:tasks.workunit.client.0.smithi033.stdout:5/721: chown d1/da/d19/da6/ccc 51168 1 2024-02-15T18:31:07.968 INFO:tasks.workunit.client.0.smithi033.stdout:5/722: fdatasync d1/f7 0 2024-02-15T18:31:07.972 INFO:tasks.workunit.client.0.smithi033.stdout:4/662: mkdir d4/d5/d28/d39/d62/d9c/d9e/da4/ddb 0 2024-02-15T18:31:07.972 INFO:tasks.workunit.client.0.smithi033.stdout:4/663: dread - d4/d20/d53/f78 zero size 2024-02-15T18:31:07.973 INFO:tasks.workunit.client.0.smithi033.stdout:3/666: unlink d2/d3/c6 0 2024-02-15T18:31:07.975 INFO:tasks.workunit.client.0.smithi033.stdout:7/628: creat d0/dc/d10/d1d/d2b/fda x:0 0 0 2024-02-15T18:31:07.976 INFO:tasks.workunit.client.0.smithi033.stdout:7/629: chown d0/dc/f31 110782302 1 2024-02-15T18:31:07.976 INFO:tasks.workunit.client.0.smithi033.stdout:7/630: write d0/dc/d10/d7d/d93/dc2/fbd [191876,21106] 0 2024-02-15T18:31:07.977 INFO:tasks.workunit.client.0.smithi033.stdout:5/723: dread d1/da/d11/d5e/db1/f77 [0,4194304] 0 2024-02-15T18:31:07.978 INFO:tasks.workunit.client.0.smithi033.stdout:5/724: dread d1/da/d52/fc6 [0,4194304] 0 2024-02-15T18:31:07.979 INFO:tasks.workunit.client.0.smithi033.stdout:8/580: creat d0/df/d53/db3/d30/d8e/d14/d56/db0/fbd x:0 0 0 2024-02-15T18:31:07.980 INFO:tasks.workunit.client.0.smithi033.stdout:4/664: rmdir d4/d20/d13/d5c/d87 39 2024-02-15T18:31:07.980 INFO:tasks.workunit.client.0.smithi033.stdout:4/665: truncate d4/d20/d13/d34/d82/fb6 113874 0 2024-02-15T18:31:07.982 INFO:tasks.workunit.client.0.smithi033.stdout:3/667: symlink d2/lcf 0 2024-02-15T18:31:07.985 INFO:tasks.workunit.client.0.smithi033.stdout:7/631: creat d0/dc/d10/d48/d4b/fdb x:0 0 0 2024-02-15T18:31:07.985 INFO:tasks.workunit.client.0.smithi033.stdout:3/668: dread d2/d14/db3/fcd [0,4194304] 0 2024-02-15T18:31:07.987 INFO:tasks.workunit.client.0.smithi033.stdout:8/581: creat d0/df/d53/db3/d30/d8e/d14/d56/fbe x:0 0 0 2024-02-15T18:31:07.990 INFO:tasks.workunit.client.0.smithi033.stdout:7/632: symlink d0/d56/d70/d91/d9e/ldc 0 2024-02-15T18:31:07.991 INFO:tasks.workunit.client.0.smithi033.stdout:7/633: chown d0/dc/d10/d48/d4b/f9c 1945 1 2024-02-15T18:31:07.991 INFO:tasks.workunit.client.0.smithi033.stdout:3/669: creat d2/d14/d23/d5c/d7f/fd0 x:0 0 0 2024-02-15T18:31:07.993 INFO:tasks.workunit.client.0.smithi033.stdout:8/582: mkdir d0/df/d48/dbf 0 2024-02-15T18:31:07.997 INFO:tasks.workunit.client.0.smithi033.stdout:8/583: rename d0/df/d53/db3/d30/d8e/d35/f93 to d0/df/d53/db3/d30/fc0 0 2024-02-15T18:31:07.999 INFO:tasks.workunit.client.0.smithi033.stdout:8/584: mkdir d0/df/d53/db3/d30/d8e/d14/d56/d59/dc1 0 2024-02-15T18:31:07.999 INFO:tasks.workunit.client.0.smithi033.stdout:8/585: write d0/df/d53/db3/d30/d8e/d14/d56/db0/fbd [869906,60389] 0 2024-02-15T18:31:08.000 INFO:tasks.workunit.client.0.smithi033.stdout:8/586: creat d0/df/d53/db3/d30/d8e/d14/d56/d59/fc2 x:0 0 0 2024-02-15T18:31:08.001 INFO:tasks.workunit.client.0.smithi033.stdout:8/587: creat d0/df/d53/db3/d30/d8e/d8f/d4b/d72/fc3 x:0 0 0 2024-02-15T18:31:08.002 INFO:tasks.workunit.client.0.smithi033.stdout:8/588: getdents d0/df/d53/db3/d30/d8e/d35/d29/d5f 0 2024-02-15T18:31:08.005 INFO:tasks.workunit.client.0.smithi033.stdout:4/666: dwrite d4/d20/f7a [0,4194304] 0 2024-02-15T18:31:08.006 INFO:tasks.workunit.client.0.smithi033.stdout:5/725: dwrite d1/f27 [0,4194304] 0 2024-02-15T18:31:08.006 INFO:tasks.workunit.client.0.smithi033.stdout:5/726: chown d1/c39 314 1 2024-02-15T18:31:08.006 INFO:tasks.workunit.client.0.smithi033.stdout:3/670: dwrite d2/d3/d1e/d22/f58 [0,4194304] 0 2024-02-15T18:31:08.006 INFO:tasks.workunit.client.0.smithi033.stdout:8/589: write d0/df/d53/db3/d30/d8e/d14/d56/f84 [1411447,47695] 0 2024-02-15T18:31:08.006 INFO:tasks.workunit.client.0.smithi033.stdout:8/590: chown d0/df/db/d45/f4a 0 1 2024-02-15T18:31:08.014 INFO:tasks.workunit.client.0.smithi033.stdout:5/727: mknod d1/da/d11/d5e/db1/d63/d61/ce9 0 2024-02-15T18:31:08.015 INFO:tasks.workunit.client.0.smithi033.stdout:3/671: mkdir d2/d14/d23/d68/d88/dd1 0 2024-02-15T18:31:08.015 INFO:tasks.workunit.client.0.smithi033.stdout:3/672: fdatasync d2/d3/d1e/f9c 0 2024-02-15T18:31:08.015 INFO:tasks.workunit.client.0.smithi033.stdout:3/673: chown d2/d3/d1e/d22/d4d/dcb 141 1 2024-02-15T18:31:08.017 INFO:tasks.workunit.client.0.smithi033.stdout:8/591: creat d0/df/d48/dbf/fc4 x:0 0 0 2024-02-15T18:31:08.019 INFO:tasks.workunit.client.0.smithi033.stdout:4/667: link d4/d5/c3f d4/d20/d13/d1b/da7/cdc 0 2024-02-15T18:31:08.019 INFO:tasks.workunit.client.0.smithi033.stdout:4/668: chown d4/d20/d13/d5c/l76 3 1 2024-02-15T18:31:08.020 INFO:tasks.workunit.client.0.smithi033.stdout:4/669: creat d4/d20/d13/d1b/da7/fdd x:0 0 0 2024-02-15T18:31:08.021 INFO:tasks.workunit.client.0.smithi033.stdout:3/674: dread d2/d14/f42 [0,4194304] 0 2024-02-15T18:31:08.023 INFO:tasks.workunit.client.0.smithi033.stdout:4/670: creat d4/d5/d28/d39/d62/d9c/d9e/da4/ddb/fde x:0 0 0 2024-02-15T18:31:08.023 INFO:tasks.workunit.client.0.smithi033.stdout:5/728: dread d1/da/d19/f3a [0,4194304] 0 2024-02-15T18:31:08.023 INFO:tasks.workunit.client.0.smithi033.stdout:3/675: link d2/d3/df/f7c d2/d3/df/d6c/fd2 0 2024-02-15T18:31:08.023 INFO:tasks.workunit.client.0.smithi033.stdout:3/676: write d2/d14/d23/f28 [1026284,72959] 0 2024-02-15T18:31:08.024 INFO:tasks.workunit.client.0.smithi033.stdout:4/671: creat d4/d5/d28/d39/d62/d9c/d9e/da4/fdf x:0 0 0 2024-02-15T18:31:08.024 INFO:tasks.workunit.client.0.smithi033.stdout:5/729: symlink d1/da/d19/lea 0 2024-02-15T18:31:08.026 INFO:tasks.workunit.client.0.smithi033.stdout:3/677: creat d2/d14/d23/d5c/d61/fd3 x:0 0 0 2024-02-15T18:31:08.027 INFO:tasks.workunit.client.0.smithi033.stdout:5/730: creat d1/da/d11/d5e/db1/feb x:0 0 0 2024-02-15T18:31:08.027 INFO:tasks.workunit.client.0.smithi033.stdout:5/731: readlink d1/da/d52/dd8/l64 0 2024-02-15T18:31:08.027 INFO:tasks.workunit.client.0.smithi033.stdout:3/678: creat d2/d14/fd4 x:0 0 0 2024-02-15T18:31:08.027 INFO:tasks.workunit.client.0.smithi033.stdout:8/592: dread d0/df/db/f23 [0,4194304] 0 2024-02-15T18:31:08.027 INFO:tasks.workunit.client.0.smithi033.stdout:3/679: fsync d2/f5 0 2024-02-15T18:31:08.028 INFO:tasks.workunit.client.0.smithi033.stdout:3/680: readlink d2/d3/l3c 0 2024-02-15T18:31:08.028 INFO:tasks.workunit.client.0.smithi033.stdout:4/672: mknod d4/d20/ce0 0 2024-02-15T18:31:08.028 INFO:tasks.workunit.client.0.smithi033.stdout:5/732: rmdir d1/da/d11/d5e/db1/d63/d61/daf 39 2024-02-15T18:31:08.029 INFO:tasks.workunit.client.0.smithi033.stdout:3/681: mknod d2/d14/d23/d5c/d7f/cd5 0 2024-02-15T18:31:08.030 INFO:tasks.workunit.client.0.smithi033.stdout:8/593: creat d0/df/fc5 x:0 0 0 2024-02-15T18:31:08.031 INFO:tasks.workunit.client.0.smithi033.stdout:3/682: symlink d2/d3/d1e/d22/d4d/dcb/ld6 0 2024-02-15T18:31:08.031 INFO:tasks.workunit.client.0.smithi033.stdout:3/683: write d2/d3/d1e/d22/d4d/fad [707382,6624] 0 2024-02-15T18:31:08.032 INFO:tasks.workunit.client.0.smithi033.stdout:8/594: mkdir d0/df/db/d45/dc6 0 2024-02-15T18:31:08.032 INFO:tasks.workunit.client.0.smithi033.stdout:8/595: readlink d0/l65 0 2024-02-15T18:31:08.032 INFO:tasks.workunit.client.0.smithi033.stdout:4/673: symlink d4/d5/dc9/dd3/le1 0 2024-02-15T18:31:08.032 INFO:tasks.workunit.client.0.smithi033.stdout:3/684: truncate d2/d3/d1e/f6e 3711378 0 2024-02-15T18:31:08.035 INFO:tasks.workunit.client.0.smithi033.stdout:4/674: rename d4/d20/d13/d1b/d7c/d91/cbd to d4/d20/d13/d1b/d81/ce2 0 2024-02-15T18:31:08.035 INFO:tasks.workunit.client.0.smithi033.stdout:3/685: truncate d2/d14/d23/d6f/d93/fce 935288 0 2024-02-15T18:31:08.035 INFO:tasks.workunit.client.0.smithi033.stdout:3/686: readlink d2/d14/d23/d5c/d61/l7d 0 2024-02-15T18:31:08.037 INFO:tasks.workunit.client.0.smithi033.stdout:3/687: truncate d2/d3/df/f7c 2304800 0 2024-02-15T18:31:08.037 INFO:tasks.workunit.client.0.smithi033.stdout:3/688: truncate d2/d14/f9e 1442373 0 2024-02-15T18:31:08.038 INFO:tasks.workunit.client.0.smithi033.stdout:4/675: creat d4/d5/d28/d39/d62/d9c/d9e/dcd/fe3 x:0 0 0 2024-02-15T18:31:08.038 INFO:tasks.workunit.client.0.smithi033.stdout:4/676: chown d4/d20/d13/d1b/d81/d8b 6010506 1 2024-02-15T18:31:08.039 INFO:tasks.workunit.client.0.smithi033.stdout:3/689: creat d2/d3/d1e/fd7 x:0 0 0 2024-02-15T18:31:08.040 INFO:tasks.workunit.client.0.smithi033.stdout:4/677: mknod d4/d5/d28/d39/ce4 0 2024-02-15T18:31:08.040 INFO:tasks.workunit.client.0.smithi033.stdout:3/690: mknod d2/d14/cd8 0 2024-02-15T18:31:08.041 INFO:tasks.workunit.client.0.smithi033.stdout:3/691: chown d2/d3/d1e/lc8 0 1 2024-02-15T18:31:08.042 INFO:tasks.workunit.client.0.smithi033.stdout:3/692: write d2/d14/f42 [183386,117091] 0 2024-02-15T18:31:08.052 INFO:tasks.workunit.client.0.smithi033.stdout:4/678: dread d4/d20/fb [0,4194304] 0 2024-02-15T18:31:08.053 INFO:tasks.workunit.client.0.smithi033.stdout:8/596: dwrite d0/df/d53/db3/d30/d8e/f39 [4194304,4194304] 0 2024-02-15T18:31:08.053 INFO:tasks.workunit.client.0.smithi033.stdout:8/597: chown d0/df/d53/db3/d30/d8e/d35/cab 994177274 1 2024-02-15T18:31:08.056 INFO:tasks.workunit.client.0.smithi033.stdout:5/733: dwrite d1/da/d19/d74/fe6 [0,4194304] 0 2024-02-15T18:31:08.056 INFO:tasks.workunit.client.0.smithi033.stdout:3/693: dwrite d2/fa [0,4194304] 0 2024-02-15T18:31:08.059 INFO:tasks.workunit.client.0.smithi033.stdout:3/694: dread d2/d3/d1e/d22/f57 [0,4194304] 0 2024-02-15T18:31:08.059 INFO:tasks.workunit.client.0.smithi033.stdout:3/695: dread - d2/d14/d23/d5c/d61/fd3 zero size 2024-02-15T18:31:08.059 INFO:tasks.workunit.client.0.smithi033.stdout:4/679: mkdir d4/d20/d13/d5c/d87/dd0/de5 0 2024-02-15T18:31:08.065 INFO:tasks.workunit.client.0.smithi033.stdout:5/734: rename d1/da/d10/d2b/c5f to d1/da/d11/d5e/db1/d63/d61/daf/cec 0 2024-02-15T18:31:08.065 INFO:tasks.workunit.client.0.smithi033.stdout:5/735: fdatasync d1/da/d10/f26 0 2024-02-15T18:31:08.071 INFO:tasks.workunit.client.0.smithi033.stdout:3/696: rename d2/c10 to d2/d3/cd9 0 2024-02-15T18:31:08.073 INFO:tasks.workunit.client.0.smithi033.stdout:3/697: getdents d2/d14/d23/d5c 0 2024-02-15T18:31:08.074 INFO:tasks.workunit.client.0.smithi033.stdout:3/698: write d2/d14/d23/f3d [1745354,100551] 0 2024-02-15T18:31:08.076 INFO:tasks.workunit.client.0.smithi033.stdout:3/699: creat d2/d14/d23/d5c/fda x:0 0 0 2024-02-15T18:31:08.076 INFO:tasks.workunit.client.0.smithi033.stdout:3/700: dread - d2/d14/d23/d5c/d7f/fd0 zero size 2024-02-15T18:31:08.077 INFO:tasks.workunit.client.0.smithi033.stdout:3/701: creat d2/d3/fdb x:0 0 0 2024-02-15T18:31:08.077 INFO:tasks.workunit.client.0.smithi033.stdout:3/702: write d2/d14/d23/d68/d73/d83/f97 [747393,42233] 0 2024-02-15T18:31:08.079 INFO:tasks.workunit.client.0.smithi033.stdout:3/703: read d2/d14/d23/f66 [3852583,34833] 0 2024-02-15T18:31:08.080 INFO:tasks.workunit.client.0.smithi033.stdout:3/704: getdents d2/d14/d23/d5c/d61 0 2024-02-15T18:31:08.081 INFO:tasks.workunit.client.0.smithi033.stdout:3/705: mkdir d2/d14/d23/d68/d88/ddc 0 2024-02-15T18:31:08.082 INFO:tasks.workunit.client.0.smithi033.stdout:3/706: creat d2/d14/d23/d6f/fdd x:0 0 0 2024-02-15T18:31:08.083 INFO:tasks.workunit.client.0.smithi033.stdout:8/598: dwrite d0/df/d53/db3/d30/d8e/d14/d56/f84 [0,4194304] 0 2024-02-15T18:31:08.084 INFO:tasks.workunit.client.0.smithi033.stdout:3/707: creat d2/d14/d23/d68/fde x:0 0 0 2024-02-15T18:31:08.084 INFO:tasks.workunit.client.0.smithi033.stdout:4/680: dwrite d4/d20/d13/d1b/d7c/f95 [0,4194304] 0 2024-02-15T18:31:08.088 INFO:tasks.workunit.client.0.smithi033.stdout:8/599: getdents d0/df/d53/db3/d30/d8e/d14/d56/d59 0 2024-02-15T18:31:08.088 INFO:tasks.workunit.client.0.smithi033.stdout:8/600: fdatasync d0/df/d53/db3/f3e 0 2024-02-15T18:31:08.093 INFO:tasks.workunit.client.0.smithi033.stdout:4/681: mkdir d4/d20/d13/d1b/d81/de6 0 2024-02-15T18:31:08.094 INFO:tasks.workunit.client.0.smithi033.stdout:8/601: symlink d0/df/d53/db3/d30/d8e/d35/lc7 0 2024-02-15T18:31:08.095 INFO:tasks.workunit.client.0.smithi033.stdout:8/602: creat d0/daa/fc8 x:0 0 0 2024-02-15T18:31:08.095 INFO:tasks.workunit.client.0.smithi033.stdout:8/603: read d0/df/f19 [3372114,25730] 0 2024-02-15T18:31:08.095 INFO:tasks.workunit.client.0.smithi033.stdout:8/604: write d0/df/fc5 [979033,95201] 0 2024-02-15T18:31:08.104 INFO:tasks.workunit.client.0.smithi033.stdout:0/594: sync 2024-02-15T18:31:08.106 INFO:tasks.workunit.client.0.smithi033.stdout:9/551: sync 2024-02-15T18:31:08.106 INFO:tasks.workunit.client.0.smithi033.stdout:6/731: sync 2024-02-15T18:31:08.107 INFO:tasks.workunit.client.0.smithi033.stdout:2/668: sync 2024-02-15T18:31:08.107 INFO:tasks.workunit.client.0.smithi033.stdout:1/637: sync 2024-02-15T18:31:08.107 INFO:tasks.workunit.client.0.smithi033.stdout:2/669: truncate d20/d31/d6a/f24 2734856 0 2024-02-15T18:31:08.109 INFO:tasks.workunit.client.0.smithi033.stdout:6/732: mkdir d8/d28/d14/de8 0 2024-02-15T18:31:08.110 INFO:tasks.workunit.client.0.smithi033.stdout:9/552: creat d4/d8/d1b/d2f/d65/d8b/fb9 x:0 0 0 2024-02-15T18:31:08.112 INFO:tasks.workunit.client.0.smithi033.stdout:2/670: rename d20/d31/d47/d4c/def/d80/da5/fbe to d20/d3a/d4a/d5e/ff6 0 2024-02-15T18:31:08.112 INFO:tasks.workunit.client.0.smithi033.stdout:2/671: readlink d20/d39/l3d 0 2024-02-15T18:31:08.113 INFO:tasks.workunit.client.0.smithi033.stdout:6/733: creat d8/d28/d14/d2c/d31/fe9 x:0 0 0 2024-02-15T18:31:08.116 INFO:tasks.workunit.client.0.smithi033.stdout:9/553: unlink d4/d9f/cac 0 2024-02-15T18:31:08.116 INFO:tasks.workunit.client.0.smithi033.stdout:2/672: creat d20/d30/ff7 x:0 0 0 2024-02-15T18:31:08.118 INFO:tasks.workunit.client.0.smithi033.stdout:9/554: mknod d4/d2c/db1/cba 0 2024-02-15T18:31:08.118 INFO:tasks.workunit.client.0.smithi033.stdout:9/555: write d4/d8/d1b/d2f/f30 [5441711,56671] 0 2024-02-15T18:31:08.120 INFO:tasks.workunit.client.0.smithi033.stdout:9/556: rename d4/f45 to d4/d8/d1b/fbb 0 2024-02-15T18:31:08.121 INFO:tasks.workunit.client.0.smithi033.stdout:3/708: dwrite d2/d14/fae [0,4194304] 0 2024-02-15T18:31:08.121 INFO:tasks.workunit.client.0.smithi033.stdout:1/638: dread d5/d17/f5e [0,4194304] 0 2024-02-15T18:31:08.124 INFO:tasks.workunit.client.0.smithi033.stdout:3/709: creat d2/d3/d1e/d22/d4d/dcb/fdf x:0 0 0 2024-02-15T18:31:08.126 INFO:tasks.workunit.client.0.smithi033.stdout:3/710: getdents d2/d14/d23/d68/d73/d76 0 2024-02-15T18:31:08.131 INFO:tasks.workunit.client.0.smithi033.stdout:4/682: dwrite d4/d20/f9 [4194304,4194304] 0 2024-02-15T18:31:08.135 INFO:tasks.workunit.client.0.smithi033.stdout:9/557: dread d4/d8/d1b/d2f/f76 [0,4194304] 0 2024-02-15T18:31:08.135 INFO:tasks.workunit.client.0.smithi033.stdout:9/558: fsync d4/f4f 0 2024-02-15T18:31:08.136 INFO:tasks.workunit.client.0.smithi033.stdout:4/683: rename d4/d20/c3b to d4/d20/d13/ce7 0 2024-02-15T18:31:08.138 INFO:tasks.workunit.client.0.smithi033.stdout:4/684: write d4/d5/f89 [548059,34984] 0 2024-02-15T18:31:08.148 INFO:tasks.workunit.client.0.smithi033.stdout:8/605: dwrite d0/df/d53/db3/d30/d8e/d35/d29/f46 [4194304,4194304] 0 2024-02-15T18:31:08.148 INFO:tasks.workunit.client.0.smithi033.stdout:8/606: fsync d0/df/d53/db3/d30/d8e/f6 0 2024-02-15T18:31:08.149 INFO:tasks.workunit.client.0.smithi033.stdout:8/607: creat d0/df/fc9 x:0 0 0 2024-02-15T18:31:08.149 INFO:tasks.workunit.client.0.smithi033.stdout:8/608: rename d0/df to d0/df/d53/db3/d30/dca 22 2024-02-15T18:31:08.151 INFO:tasks.workunit.client.0.smithi033.stdout:8/609: creat d0/fcb x:0 0 0 2024-02-15T18:31:08.152 INFO:tasks.workunit.client.0.smithi033.stdout:8/610: creat d0/df/d53/db3/d95/fcc x:0 0 0 2024-02-15T18:31:08.153 INFO:tasks.workunit.client.0.smithi033.stdout:8/611: dread d0/df/d53/db3/d30/d8e/d14/d56/d59/f6c [0,4194304] 0 2024-02-15T18:31:08.160 INFO:tasks.workunit.client.0.smithi033.stdout:0/595: dwrite d0/d8/d15/d9a/fac [0,4194304] 0 2024-02-15T18:31:08.161 INFO:tasks.workunit.client.0.smithi033.stdout:1/639: dwrite d5/d9/d1e/d20/d2c/d34/d51/fbb [0,4194304] 0 2024-02-15T18:31:08.161 INFO:tasks.workunit.client.0.smithi033.stdout:4/685: dwrite d4/d20/d13/d34/d82/fc0 [0,4194304] 0 2024-02-15T18:31:08.162 INFO:tasks.workunit.client.0.smithi033.stdout:2/673: dwrite d20/d3a/d4a/d5e/d6b/d88/da6/ddb/ddf/fe2 [0,4194304] 0 2024-02-15T18:31:08.162 INFO:tasks.workunit.client.0.smithi033.stdout:9/559: dwrite d4/d8/f46 [0,4194304] 0 2024-02-15T18:31:08.168 INFO:tasks.workunit.client.0.smithi033.stdout:0/596: write d0/f4 [5225400,65340] 0 2024-02-15T18:31:08.171 INFO:tasks.workunit.client.0.smithi033.stdout:1/640: symlink d5/d9/d1e/d20/d5c/lc3 0 2024-02-15T18:31:08.171 INFO:tasks.workunit.client.0.smithi033.stdout:1/641: stat d5/dd/d12/d49/d23/f4d 0 2024-02-15T18:31:08.171 INFO:tasks.workunit.client.0.smithi033.stdout:1/642: chown d5/d9/d1e/d20/d2c/ca4 23 1 2024-02-15T18:31:08.174 INFO:tasks.workunit.client.0.smithi033.stdout:8/612: dwrite d0/df/d53/db3/f3e [0,4194304] 0 2024-02-15T18:31:08.175 INFO:tasks.workunit.client.0.smithi033.stdout:4/686: dread d4/d20/d13/fa3 [0,4194304] 0 2024-02-15T18:31:08.176 INFO:tasks.workunit.client.0.smithi033.stdout:2/674: mkdir d20/d31/df8 0 2024-02-15T18:31:08.176 INFO:tasks.workunit.client.0.smithi033.stdout:2/675: truncate d20/d31/d47/d4c/def/d80/fc2 1028942 0 2024-02-15T18:31:08.176 INFO:tasks.workunit.client.0.smithi033.stdout:9/560: getdents d4/d8/d1b/d61 0 2024-02-15T18:31:08.180 INFO:tasks.workunit.client.0.smithi033.stdout:0/597: rename d0/c27 to d0/d8/d15/d8b/da3/dae/d58/d80/d9b/ccc 0 2024-02-15T18:31:08.180 INFO:tasks.workunit.client.0.smithi033.stdout:1/643: mknod d5/dd/d12/d49/cc4 0 2024-02-15T18:31:08.181 INFO:tasks.workunit.client.0.smithi033.stdout:8/613: mknod d0/df/d53/db3/d30/d8e/d35/d29/d5f/da5/ccd 0 2024-02-15T18:31:08.183 INFO:tasks.workunit.client.0.smithi033.stdout:2/676: rename c15 to d20/d31/df8/cf9 0 2024-02-15T18:31:08.184 INFO:tasks.workunit.client.0.smithi033.stdout:0/598: rmdir d0/d8/d15/d8b/da3/d6c 39 2024-02-15T18:31:08.186 INFO:tasks.workunit.client.0.smithi033.stdout:4/687: dread d4/d5/f24 [0,4194304] 0 2024-02-15T18:31:08.186 INFO:tasks.workunit.client.0.smithi033.stdout:1/644: rename d5/d9/d1e/d20/d2c/d65/c8a to d5/d9/d1e/d20/d5c/d57/cc5 0 2024-02-15T18:31:08.186 INFO:tasks.workunit.client.0.smithi033.stdout:4/688: write d4/d20/d37/fac [479254,61447] 0 2024-02-15T18:31:08.187 INFO:tasks.workunit.client.0.smithi033.stdout:2/677: symlink d20/d3a/d4a/d5e/lfa 0 2024-02-15T18:31:08.189 INFO:tasks.workunit.client.0.smithi033.stdout:0/599: dread d0/d64/d1d/f1e [0,4194304] 0 2024-02-15T18:31:08.189 INFO:tasks.workunit.client.0.smithi033.stdout:0/600: dread - d0/d8/d15/d7c/f89 zero size 2024-02-15T18:31:08.192 INFO:tasks.workunit.client.0.smithi033.stdout:8/614: rename d0/df/d53/db3/d30/d8e/d35/l50 to d0/df/d53/db3/d30/d8e/da7/lce 0 2024-02-15T18:31:08.192 INFO:tasks.workunit.client.0.smithi033.stdout:8/615: chown d0/df/d53/db3/d30 3034444 1 2024-02-15T18:31:08.192 INFO:tasks.workunit.client.0.smithi033.stdout:8/616: chown d0/df/d53/db3/d30/d8e/l44 13563173 1 2024-02-15T18:31:08.193 INFO:tasks.workunit.client.0.smithi033.stdout:8/617: write d0/df/d53/db3/d30/d8e/d14/d56/db0/fb4 [520629,19868] 0 2024-02-15T18:31:08.193 INFO:tasks.workunit.client.0.smithi033.stdout:8/618: truncate d0/df/d48/dbf/fc4 615438 0 2024-02-15T18:31:08.193 INFO:tasks.workunit.client.0.smithi033.stdout:1/645: rmdir d5/d9 39 2024-02-15T18:31:08.193 INFO:tasks.workunit.client.0.smithi033.stdout:4/689: symlink d4/d20/d13/d1b/da7/le8 0 2024-02-15T18:31:08.194 INFO:tasks.workunit.client.0.smithi033.stdout:0/601: symlink d0/d8/d15/d8b/da3/dae/lcd 0 2024-02-15T18:31:08.195 INFO:tasks.workunit.client.0.smithi033.stdout:1/646: mkdir d5/dd/d12/dc6 0 2024-02-15T18:31:08.195 INFO:tasks.workunit.client.0.smithi033.stdout:1/647: truncate d5/d9/d1e/d20/d2c/d34/d51/fb6 942744 0 2024-02-15T18:31:08.195 INFO:tasks.workunit.client.0.smithi033.stdout:1/648: truncate d5/d9/d1e/d20/d2c/d34/d51/d63/d76/f9f 191628 0 2024-02-15T18:31:08.195 INFO:tasks.workunit.client.0.smithi033.stdout:1/649: chown d5/d9/d1e/d20/l6c 35 1 2024-02-15T18:31:08.196 INFO:tasks.workunit.client.0.smithi033.stdout:4/690: creat d4/d20/d13/dca/fe9 x:0 0 0 2024-02-15T18:31:08.196 INFO:tasks.workunit.client.0.smithi033.stdout:4/691: readlink d4/d20/d53/lcf 0 2024-02-15T18:31:08.196 INFO:tasks.workunit.client.0.smithi033.stdout:8/619: dread d0/df/db/d45/f4a [0,4194304] 0 2024-02-15T18:31:08.197 INFO:tasks.workunit.client.0.smithi033.stdout:0/602: rename d0/d8/d15/d8b/da3/d6c/f6b to d0/d8/d15/d8b/da3/dae/d58/d80/d9b/fce 0 2024-02-15T18:31:08.198 INFO:tasks.workunit.client.0.smithi033.stdout:4/692: creat d4/d5/d28/d39/d62/d9c/d9e/da4/fea x:0 0 0 2024-02-15T18:31:08.198 INFO:tasks.workunit.client.0.smithi033.stdout:2/678: dread d20/d31/d47/d4c/f60 [0,4194304] 0 2024-02-15T18:31:08.198 INFO:tasks.workunit.client.0.smithi033.stdout:8/620: stat d0/df/c2b 0 2024-02-15T18:31:08.199 INFO:tasks.workunit.client.0.smithi033.stdout:0/603: getdents d0/d8/d15/d2d/d3f 0 2024-02-15T18:31:08.200 INFO:tasks.workunit.client.0.smithi033.stdout:2/679: symlink d20/d31/lfb 0 2024-02-15T18:31:08.200 INFO:tasks.workunit.client.0.smithi033.stdout:8/621: getdents d0/df/d53/db3/d95 0 2024-02-15T18:31:08.202 INFO:tasks.workunit.client.0.smithi033.stdout:2/680: creat d20/d31/d47/d4c/ffc x:0 0 0 2024-02-15T18:31:08.203 INFO:tasks.workunit.client.0.smithi033.stdout:8/622: symlink d0/df/d53/lcf 0 2024-02-15T18:31:08.204 INFO:tasks.workunit.client.0.smithi033.stdout:2/681: creat d20/d31/ffd x:0 0 0 2024-02-15T18:31:08.206 INFO:tasks.workunit.client.0.smithi033.stdout:8/623: creat d0/df/d53/db3/d30/d8e/d14/d56/d59/dc1/fd0 x:0 0 0 2024-02-15T18:31:08.208 INFO:tasks.workunit.client.0.smithi033.stdout:0/604: dread d0/d2/f34 [0,4194304] 0 2024-02-15T18:31:08.208 INFO:tasks.workunit.client.0.smithi033.stdout:2/682: creat d20/de1/ffe x:0 0 0 2024-02-15T18:31:08.213 INFO:tasks.workunit.client.0.smithi033.stdout:8/624: creat d0/df/d53/db3/d30/d8e/d35/d29/d5f/fd1 x:0 0 0 2024-02-15T18:31:08.214 INFO:tasks.workunit.client.0.smithi033.stdout:0/605: rename d0/d8/d15/d8b/da3/d6c/fba to d0/d8/d15/d8b/da3/d6c/fcf 0 2024-02-15T18:31:08.216 INFO:tasks.workunit.client.0.smithi033.stdout:0/606: link d0/d8/d15/d8b/da3/dae/d58/f61 d0/d8/d15/d8b/da3/dae/d58/d77/fd0 0 2024-02-15T18:31:08.217 INFO:tasks.workunit.client.0.smithi033.stdout:0/607: creat d0/d8/d54/fd1 x:0 0 0 2024-02-15T18:31:08.218 INFO:tasks.workunit.client.0.smithi033.stdout:0/608: truncate d0/d8/d15/d2d/d3f/f98 5146990 0 2024-02-15T18:31:08.225 INFO:tasks.workunit.client.0.smithi033.stdout:1/650: dwrite d5/dd/d12/d49/f4a [0,4194304] 0 2024-02-15T18:31:08.225 INFO:tasks.workunit.client.0.smithi033.stdout:4/693: dwrite d4/d20/d13/d1b/da7/fd4 [4194304,4194304] 0 2024-02-15T18:31:08.226 INFO:tasks.workunit.client.0.smithi033.stdout:2/683: dwrite d20/d31/d47/d4c/def/d80/fc2 [0,4194304] 0 2024-02-15T18:31:08.226 INFO:tasks.workunit.client.0.smithi033.stdout:1/651: mknod d5/d9/d1e/d20/d2c/d34/cc7 0 2024-02-15T18:31:08.227 INFO:tasks.workunit.client.0.smithi033.stdout:4/694: write d4/f7 [683031,15544] 0 2024-02-15T18:31:08.227 INFO:tasks.workunit.client.0.smithi033.stdout:2/684: write d20/d3a/fa2 [913768,116728] 0 2024-02-15T18:31:08.234 INFO:tasks.workunit.client.0.smithi033.stdout:1/652: getdents d5/d9 0 2024-02-15T18:31:08.235 INFO:tasks.workunit.client.0.smithi033.stdout:1/653: fdatasync d5/d9/d1e/d20/d5c/d57/fa7 0 2024-02-15T18:31:08.236 INFO:tasks.workunit.client.0.smithi033.stdout:0/609: dwrite d0/d64/d1d/f1e [0,4194304] 0 2024-02-15T18:31:08.236 INFO:tasks.workunit.client.0.smithi033.stdout:4/695: unlink d4/d5/d28/d39/d62/d9c/d9e/da4/fea 0 2024-02-15T18:31:08.239 INFO:tasks.workunit.client.0.smithi033.stdout:2/685: mknod d20/d31/d47/d4c/def/d80/cff 0 2024-02-15T18:31:08.241 INFO:tasks.workunit.client.0.smithi033.stdout:1/654: rename d5/d9/d1e/d20/d2c/d34/d51/d63/fbe to d5/d9/d1e/d20/d5c/d8d/fc8 0 2024-02-15T18:31:08.242 INFO:tasks.workunit.client.0.smithi033.stdout:1/655: dread - d5/dd/d12/d49/f3a zero size 2024-02-15T18:31:08.243 INFO:tasks.workunit.client.0.smithi033.stdout:0/610: creat d0/d8/d15/fd2 x:0 0 0 2024-02-15T18:31:08.243 INFO:tasks.workunit.client.0.smithi033.stdout:0/611: truncate d0/d2/f82 205796 0 2024-02-15T18:31:08.244 INFO:tasks.workunit.client.0.smithi033.stdout:2/686: symlink d20/d31/d47/d4c/def/df1/l100 0 2024-02-15T18:31:08.245 INFO:tasks.workunit.client.0.smithi033.stdout:1/656: stat d5/d9/d1e/d20/la3 0 2024-02-15T18:31:08.249 INFO:tasks.workunit.client.0.smithi033.stdout:0/612: rename d0/d8/d15/d9a to d0/d64/d1d/dd3 0 2024-02-15T18:31:08.249 INFO:tasks.workunit.client.0.smithi033.stdout:2/687: symlink d20/d31/d47/da4/l101 0 2024-02-15T18:31:08.250 INFO:tasks.workunit.client.0.smithi033.stdout:1/657: mkdir d5/d96/dc9 0 2024-02-15T18:31:08.252 INFO:tasks.workunit.client.0.smithi033.stdout:1/658: mkdir d5/d9/d1e/d20/d5c/dca 0 2024-02-15T18:31:08.252 INFO:tasks.workunit.client.0.smithi033.stdout:1/659: fdatasync d5/d9/f77 0 2024-02-15T18:31:08.253 INFO:tasks.workunit.client.0.smithi033.stdout:1/660: mkdir d5/dcb 0 2024-02-15T18:31:08.254 INFO:tasks.workunit.client.0.smithi033.stdout:1/661: read d5/d9/f77 [248023,34435] 0 2024-02-15T18:31:08.257 INFO:tasks.workunit.client.0.smithi033.stdout:4/696: dwrite d4/d20/ff [0,4194304] 0 2024-02-15T18:31:08.258 INFO:tasks.workunit.client.0.smithi033.stdout:1/662: rename d5/dd/f3f to d5/d96/fcc 0 2024-02-15T18:31:08.260 INFO:tasks.workunit.client.0.smithi033.stdout:4/697: unlink d4/d20/c50 0 2024-02-15T18:31:08.263 INFO:tasks.workunit.client.0.smithi033.stdout:2/688: dwrite d20/d3a/d4a/d5e/f76 [0,4194304] 0 2024-02-15T18:31:08.266 INFO:tasks.workunit.client.0.smithi033.stdout:0/613: truncate d0/d2/f7 377404 0 2024-02-15T18:31:08.266 INFO:tasks.workunit.client.0.smithi033.stdout:0/614: fsync d0/d8/f45 0 2024-02-15T18:31:08.273 INFO:tasks.workunit.client.0.smithi033.stdout:1/663: creat d5/dd/fcd x:0 0 0 2024-02-15T18:31:08.274 INFO:tasks.workunit.client.0.smithi033.stdout:4/698: symlink d4/d20/d13/d5c/dd1/leb 0 2024-02-15T18:31:08.277 INFO:tasks.workunit.client.0.smithi033.stdout:0/615: symlink d0/d8/d15/d2d/d41/d73/d84/ld4 0 2024-02-15T18:31:08.278 INFO:tasks.workunit.client.0.smithi033.stdout:1/664: mknod d5/d9/d1e/d20/d2c/d34/cce 0 2024-02-15T18:31:08.278 INFO:tasks.workunit.client.0.smithi033.stdout:1/665: write d5/dd/d12/f8f [1135673,61319] 0 2024-02-15T18:31:08.278 INFO:tasks.workunit.client.0.smithi033.stdout:1/666: getdents d5/d9/d1e/d20/d5c/dca 0 2024-02-15T18:31:08.282 INFO:tasks.workunit.client.0.smithi033.stdout:2/689: write d20/d31/d47/d4c/f60 [782379,26733] 0 2024-02-15T18:31:08.282 INFO:tasks.workunit.client.0.smithi033.stdout:4/699: dread - d4/d20/d13/d1b/d81/d9f/fcb zero size 2024-02-15T18:31:08.285 INFO:tasks.workunit.client.0.smithi033.stdout:0/616: unlink d0/d8/d15/d2d/d2e/f63 0 2024-02-15T18:31:08.287 INFO:tasks.workunit.client.0.smithi033.stdout:1/667: dread d5/dd/f2e [0,4194304] 0 2024-02-15T18:31:08.289 INFO:tasks.workunit.client.0.smithi033.stdout:2/690: rename d20/d3a/f68 to d20/d31/d47/d4c/f102 0 2024-02-15T18:31:08.289 INFO:tasks.workunit.client.0.smithi033.stdout:2/691: chown d20/f43 828364776 1 2024-02-15T18:31:08.293 INFO:tasks.workunit.client.0.smithi033.stdout:0/617: unlink d0/d8/d15/d5b/d94/cb3 0 2024-02-15T18:31:08.293 INFO:tasks.workunit.client.0.smithi033.stdout:1/668: rename d5/d9/d1e/d20/d2c/f3c to d5/d9/d1e/d20/d2c/d34/dc0/fcf 0 2024-02-15T18:31:08.293 INFO:tasks.workunit.client.0.smithi033.stdout:1/669: chown d5/dd/l7c 29 1 2024-02-15T18:31:08.295 INFO:tasks.workunit.client.0.smithi033.stdout:4/700: link d4/d20/d13/d5c/d87/dc5/cd2 d4/d20/d13/d1b/d7c/d91/dbe/cec 0 2024-02-15T18:31:08.296 INFO:tasks.workunit.client.0.smithi033.stdout:0/618: symlink d0/d8/d15/d5b/ld5 0 2024-02-15T18:31:08.296 INFO:tasks.workunit.client.0.smithi033.stdout:0/619: readlink d0/d64/l28 0 2024-02-15T18:31:08.297 INFO:tasks.workunit.client.0.smithi033.stdout:0/620: read d0/d64/d88/f8a [989428,15443] 0 2024-02-15T18:31:08.297 INFO:tasks.workunit.client.0.smithi033.stdout:0/621: chown d0/d8/d15/d2d/d2e/f8f 827 1 2024-02-15T18:31:08.298 INFO:tasks.workunit.client.0.smithi033.stdout:1/670: unlink d5/d9/d1e/d20/d5c/d57/d82/f87 0 2024-02-15T18:31:08.298 INFO:tasks.workunit.client.0.smithi033.stdout:1/671: dread - d5/d9/d1e/d20/d5c/d57/fbd zero size 2024-02-15T18:31:08.301 INFO:tasks.workunit.client.0.smithi033.stdout:0/622: mknod d0/d8/d15/d8b/da3/dae/d58/d80/cd6 0 2024-02-15T18:31:08.301 INFO:tasks.workunit.client.0.smithi033.stdout:5/736: sync 2024-02-15T18:31:08.301 INFO:tasks.workunit.client.0.smithi033.stdout:6/734: sync 2024-02-15T18:31:08.301 INFO:tasks.workunit.client.0.smithi033.stdout:7/634: sync 2024-02-15T18:31:08.301 INFO:tasks.workunit.client.0.smithi033.stdout:5/737: chown d1/da/d52/f5b 226084674 1 2024-02-15T18:31:08.302 INFO:tasks.workunit.client.0.smithi033.stdout:1/672: creat d5/dd/fd0 x:0 0 0 2024-02-15T18:31:08.302 INFO:tasks.workunit.client.0.smithi033.stdout:2/692: dwrite d20/d31/d47/d4c/def/d80/fb8 [0,4194304] 0 2024-02-15T18:31:08.303 INFO:tasks.workunit.client.0.smithi033.stdout:0/623: rename d0/d8/d15/d8b/da3/d6c/l72 to d0/d64/d1d/ld7 0 2024-02-15T18:31:08.305 INFO:tasks.workunit.client.0.smithi033.stdout:0/624: write d0/d8/d15/d2d/d3f/f55 [1969396,85244] 0 2024-02-15T18:31:08.306 INFO:tasks.workunit.client.0.smithi033.stdout:5/738: unlink d1/da/d19/d3f/fc0 0 2024-02-15T18:31:08.306 INFO:tasks.workunit.client.0.smithi033.stdout:5/739: write d1/da/d10/d2b/d42/d71/fe2 [202818,102306] 0 2024-02-15T18:31:08.306 INFO:tasks.workunit.client.0.smithi033.stdout:0/625: write d0/d8/f74 [2934144,71437] 0 2024-02-15T18:31:08.306 INFO:tasks.workunit.client.0.smithi033.stdout:6/735: creat d8/d70/fea x:0 0 0 2024-02-15T18:31:08.307 INFO:tasks.workunit.client.0.smithi033.stdout:1/673: symlink d5/d9/ld1 0 2024-02-15T18:31:08.308 INFO:tasks.workunit.client.0.smithi033.stdout:1/674: dread - d5/d9/d1e/d20/d5c/d57/fbd zero size 2024-02-15T18:31:08.308 INFO:tasks.workunit.client.0.smithi033.stdout:1/675: chown d5 372188865 1 2024-02-15T18:31:08.309 INFO:tasks.workunit.client.0.smithi033.stdout:2/693: symlink d20/d31/df8/l103 0 2024-02-15T18:31:08.311 INFO:tasks.workunit.client.0.smithi033.stdout:5/740: mkdir d1/da/d11/ded 0 2024-02-15T18:31:08.318 INFO:tasks.workunit.client.0.smithi033.stdout:0/626: creat d0/d8/d15/d5b/fd8 x:0 0 0 2024-02-15T18:31:08.318 INFO:tasks.workunit.client.0.smithi033.stdout:0/627: fdatasync d0/d8/d15/d7c/da4/fa8 0 2024-02-15T18:31:08.318 INFO:tasks.workunit.client.0.smithi033.stdout:0/628: readlink d0/d8/d15/d2d/l49 0 2024-02-15T18:31:08.318 INFO:tasks.workunit.client.0.smithi033.stdout:6/736: creat d8/d28/d14/d2c/de7/feb x:0 0 0 2024-02-15T18:31:08.319 INFO:tasks.workunit.client.0.smithi033.stdout:1/676: mknod d5/dcb/cd2 0 2024-02-15T18:31:08.319 INFO:tasks.workunit.client.0.smithi033.stdout:1/677: truncate d5/d9/d1e/d20/d2c/d34/d51/f5b 704394 0 2024-02-15T18:31:08.319 INFO:tasks.workunit.client.0.smithi033.stdout:2/694: mknod d20/d31/d47/d4c/def/df1/c104 0 2024-02-15T18:31:08.320 INFO:tasks.workunit.client.0.smithi033.stdout:5/741: creat d1/da/d88/fee x:0 0 0 2024-02-15T18:31:08.321 INFO:tasks.workunit.client.0.smithi033.stdout:0/629: mkdir d0/d8/d15/d8b/da3/dae/d59/dd9 0 2024-02-15T18:31:08.322 INFO:tasks.workunit.client.0.smithi033.stdout:6/737: creat d8/d1d/d37/d4f/dbb/d57/fec x:0 0 0 2024-02-15T18:31:08.322 INFO:tasks.workunit.client.0.smithi033.stdout:2/695: symlink d20/d31/dc8/l105 0 2024-02-15T18:31:08.325 INFO:tasks.workunit.client.0.smithi033.stdout:6/738: dread d8/d28/d14/d2c/d31/d30/fa4 [0,4194304] 0 2024-02-15T18:31:08.325 INFO:tasks.workunit.client.0.smithi033.stdout:6/739: truncate d8/d70/fdb 1020197 0 2024-02-15T18:31:08.326 INFO:tasks.workunit.client.0.smithi033.stdout:2/696: mkdir d20/d31/d47/d82/de6/d106 0 2024-02-15T18:31:08.326 INFO:tasks.workunit.client.0.smithi033.stdout:2/697: write d20/d30/ff7 [417144,35413] 0 2024-02-15T18:31:08.326 INFO:tasks.workunit.client.0.smithi033.stdout:2/698: chown c1d 239281 1 2024-02-15T18:31:08.326 INFO:tasks.workunit.client.0.smithi033.stdout:2/699: dread - d20/d3a/d4a/d5e/ff6 zero size 2024-02-15T18:31:08.326 INFO:tasks.workunit.client.0.smithi033.stdout:2/700: truncate d20/d3a/d4a/d5e/ff6 237444 0 2024-02-15T18:31:08.326 INFO:tasks.workunit.client.0.smithi033.stdout:2/701: dread - d20/d30/fcf zero size 2024-02-15T18:31:08.326 INFO:tasks.workunit.client.0.smithi033.stdout:2/702: fdatasync d20/d31/d47/fcd 0 2024-02-15T18:31:08.338 INFO:tasks.workunit.client.0.smithi033.stdout:5/742: dread d1/da/d11/f49 [0,4194304] 0 2024-02-15T18:31:08.340 INFO:tasks.workunit.client.0.smithi033.stdout:5/743: creat d1/da/d52/dd8/d40/d9a/fef x:0 0 0 2024-02-15T18:31:08.344 INFO:tasks.workunit.client.0.smithi033.stdout:0/630: dwrite d0/d8/d15/d7c/f89 [0,4194304] 0 2024-02-15T18:31:08.346 INFO:tasks.workunit.client.0.smithi033.stdout:0/631: creat d0/d8/d15/d2d/d41/d73/d96/fda x:0 0 0 2024-02-15T18:31:08.355 INFO:tasks.workunit.client.0.smithi033.stdout:5/744: dwrite d1/da/d10/d2b/d42/d4c/fd3 [0,4194304] 0 2024-02-15T18:31:08.355 INFO:tasks.workunit.client.0.smithi033.stdout:5/745: read - d1/da/d19/d3f/fa9 zero size 2024-02-15T18:31:08.364 INFO:tasks.workunit.client.0.smithi033.stdout:2/703: dwrite d20/d3a/fc0 [4194304,4194304] 0 2024-02-15T18:31:08.364 INFO:tasks.workunit.client.0.smithi033.stdout:1/678: dwrite d5/d17/fa6 [0,4194304] 0 2024-02-15T18:31:08.367 INFO:tasks.workunit.client.0.smithi033.stdout:2/704: write d20/d31/d47/d4c/def/f87 [2836932,92174] 0 2024-02-15T18:31:08.367 INFO:tasks.workunit.client.0.smithi033.stdout:2/705: fsync d20/d3a/f75 0 2024-02-15T18:31:08.367 INFO:tasks.workunit.client.0.smithi033.stdout:2/706: readlink d20/d31/d47/d82/ld1 0 2024-02-15T18:31:08.367 INFO:tasks.workunit.client.0.smithi033.stdout:5/746: dwrite d1/da/d52/fc6 [0,4194304] 0 2024-02-15T18:31:08.369 INFO:tasks.workunit.client.0.smithi033.stdout:1/679: creat d5/d9/d1e/d20/d2c/d34/dc0/fd3 x:0 0 0 2024-02-15T18:31:08.372 INFO:tasks.workunit.client.0.smithi033.stdout:3/711: sync 2024-02-15T18:31:08.372 INFO:tasks.workunit.client.0.smithi033.stdout:9/561: sync 2024-02-15T18:31:08.372 INFO:tasks.workunit.client.0.smithi033.stdout:8/625: sync 2024-02-15T18:31:08.373 INFO:tasks.workunit.client.0.smithi033.stdout:5/747: mknod d1/da/d11/dd9/cf0 0 2024-02-15T18:31:08.373 INFO:tasks.workunit.client.0.smithi033.stdout:5/748: truncate d1/da/d11/d5e/f8b 4413246 0 2024-02-15T18:31:08.375 INFO:tasks.workunit.client.0.smithi033.stdout:1/680: mkdir d5/dd/d12/dc6/dd4 0 2024-02-15T18:31:08.375 INFO:tasks.workunit.client.0.smithi033.stdout:9/562: mkdir d4/d8/dd/d5c/d6d/dbc 0 2024-02-15T18:31:08.376 INFO:tasks.workunit.client.0.smithi033.stdout:3/712: link d2/d3/d1e/f9c d2/d14/d23/d6f/fe0 0 2024-02-15T18:31:08.377 INFO:tasks.workunit.client.0.smithi033.stdout:8/626: mkdir d0/df/dd2 0 2024-02-15T18:31:08.378 INFO:tasks.workunit.client.0.smithi033.stdout:5/749: symlink d1/da/d52/dd8/lf1 0 2024-02-15T18:31:08.379 INFO:tasks.workunit.client.0.smithi033.stdout:1/681: rename d5/dd/d12/d49/c2a to d5/d9/d1e/d20/d5c/dca/cd5 0 2024-02-15T18:31:08.381 INFO:tasks.workunit.client.0.smithi033.stdout:9/563: creat d4/d2c/db1/fbd x:0 0 0 2024-02-15T18:31:08.387 INFO:tasks.workunit.client.0.smithi033.stdout:8/627: rename d0/df/d53/db3/d30/d8e/d14/d56/d59/dc1 to d0/df/dd3 0 2024-02-15T18:31:08.387 INFO:tasks.workunit.client.0.smithi033.stdout:1/682: unlink d5/d38/lc1 0 2024-02-15T18:31:08.389 INFO:tasks.workunit.client.0.smithi033.stdout:2/707: dread d20/d3a/fc0 [4194304,4194304] 0 2024-02-15T18:31:08.395 INFO:tasks.workunit.client.0.smithi033.stdout:9/564: rename d4/d8/dd/d41/d51/f78 to d4/d8/d1b/d2f/d65/d8b/d95/fbe 0 2024-02-15T18:31:08.397 INFO:tasks.workunit.client.0.smithi033.stdout:1/683: mkdir d5/d38/dd6 0 2024-02-15T18:31:08.398 INFO:tasks.workunit.client.0.smithi033.stdout:2/708: symlink d20/d31/d47/d4c/def/df1/l107 0 2024-02-15T18:31:08.398 INFO:tasks.workunit.client.0.smithi033.stdout:1/684: creat d5/dd/d12/d49/fd7 x:0 0 0 2024-02-15T18:31:08.399 INFO:tasks.workunit.client.0.smithi033.stdout:2/709: mknod d20/d31/d6a/c108 0 2024-02-15T18:31:08.400 INFO:tasks.workunit.client.0.smithi033.stdout:1/685: creat d5/dd/fd8 x:0 0 0 2024-02-15T18:31:08.400 INFO:tasks.workunit.client.0.smithi033.stdout:1/686: readlink d5/d9/d1e/d20/d2c/d34/lc2 0 2024-02-15T18:31:08.405 INFO:tasks.workunit.client.0.smithi033.stdout:5/750: dwrite d1/da/f41 [0,4194304] 0 2024-02-15T18:31:08.405 INFO:tasks.workunit.client.0.smithi033.stdout:3/713: dwrite d2/d14/d23/d5c/d61/fd3 [0,4194304] 0 2024-02-15T18:31:08.405 INFO:tasks.workunit.client.0.smithi033.stdout:3/714: rename d2/d14 to d2/d14/d23/de1 22 2024-02-15T18:31:08.407 INFO:tasks.workunit.client.0.smithi033.stdout:8/628: getdents d0/df 0 2024-02-15T18:31:08.407 INFO:tasks.workunit.client.0.smithi033.stdout:8/629: chown d0/df/d53/db3/d30/d8e/d14/d56/d59/c83 815415 1 2024-02-15T18:31:08.413 INFO:tasks.workunit.client.0.smithi033.stdout:5/751: unlink d1/da/d19/f57 0 2024-02-15T18:31:08.416 INFO:tasks.workunit.client.0.smithi033.stdout:8/630: creat d0/df/d53/db3/d30/d8e/d35/d29/fd4 x:0 0 0 2024-02-15T18:31:08.417 INFO:tasks.workunit.client.0.smithi033.stdout:5/752: mkdir d1/da/d19/d3f/d68/df2 0 2024-02-15T18:31:08.417 INFO:tasks.workunit.client.0.smithi033.stdout:5/753: fsync d1/da/d19/da6/faa 0 2024-02-15T18:31:08.419 INFO:tasks.workunit.client.0.smithi033.stdout:8/631: link d0/df/db/f23 d0/df/db/fd5 0 2024-02-15T18:31:08.419 INFO:tasks.workunit.client.0.smithi033.stdout:8/632: fdatasync d0/df/d53/db3/d30/d8e/d35/d58/da1/fb9 0 2024-02-15T18:31:08.419 INFO:tasks.workunit.client.0.smithi033.stdout:8/633: chown d0/df/d53/db3/d30/l3d 1 1 2024-02-15T18:31:08.421 INFO:tasks.workunit.client.0.smithi033.stdout:5/754: symlink d1/da/d10/d2b/d42/d4c/lf3 0 2024-02-15T18:31:08.421 INFO:tasks.workunit.client.0.smithi033.stdout:5/755: dread - d1/da/d10/d2b/fda zero size 2024-02-15T18:31:08.421 INFO:tasks.workunit.client.0.smithi033.stdout:5/756: chown d1/da/d52/fcd 1745 1 2024-02-15T18:31:08.422 INFO:tasks.workunit.client.0.smithi033.stdout:9/565: dwrite d4/d8/dd/d28/d6b/fa7 [0,4194304] 0 2024-02-15T18:31:08.426 INFO:tasks.workunit.client.0.smithi033.stdout:2/710: dwrite d20/d31/d6a/f26 [0,4194304] 0 2024-02-15T18:31:08.428 INFO:tasks.workunit.client.0.smithi033.stdout:3/715: dread d2/d14/d23/d68/d88/fa5 [0,4194304] 0 2024-02-15T18:31:08.429 INFO:tasks.workunit.client.0.smithi033.stdout:1/687: dwrite d5/dd/d12/d49/d23/f7f [0,4194304] 0 2024-02-15T18:31:08.429 INFO:tasks.workunit.client.0.smithi033.stdout:9/566: mknod d4/d8/dd/d41/d51/cbf 0 2024-02-15T18:31:08.434 INFO:tasks.workunit.client.0.smithi033.stdout:3/716: rmdir d2/d14/d23/d6f/d93 39 2024-02-15T18:31:08.435 INFO:tasks.workunit.client.0.smithi033.stdout:1/688: mknod d5/d9/cd9 0 2024-02-15T18:31:08.436 INFO:tasks.workunit.client.0.smithi033.stdout:9/567: creat d4/d2c/db1/fc0 x:0 0 0 2024-02-15T18:31:08.436 INFO:tasks.workunit.client.0.smithi033.stdout:3/717: write d2/d14/d23/d5c/d7f/fa6 [3120332,22552] 0 2024-02-15T18:31:08.438 INFO:tasks.workunit.client.0.smithi033.stdout:1/689: rename d5/d9/cd9 to d5/d9/d1e/d20/d2c/db2/cda 0 2024-02-15T18:31:08.439 INFO:tasks.workunit.client.0.smithi033.stdout:1/690: chown d5/d9/d1e/d20/d2c/d34/d51/d63/c64 44 1 2024-02-15T18:31:08.440 INFO:tasks.workunit.client.0.smithi033.stdout:3/718: mkdir d2/d14/d23/d5c/d61/de2 0 2024-02-15T18:31:08.440 INFO:tasks.workunit.client.0.smithi033.stdout:3/719: dread - d2/d14/d23/d68/fde zero size 2024-02-15T18:31:08.441 INFO:tasks.workunit.client.0.smithi033.stdout:3/720: readlink d2/d3/d17/l31 0 2024-02-15T18:31:08.442 INFO:tasks.workunit.client.0.smithi033.stdout:3/721: unlink d2/d14/d23/d5c/d61/c81 0 2024-02-15T18:31:08.443 INFO:tasks.workunit.client.0.smithi033.stdout:3/722: symlink d2/le3 0 2024-02-15T18:31:08.443 INFO:tasks.workunit.client.0.smithi033.stdout:3/723: chown d2/d20/c65 5 1 2024-02-15T18:31:08.444 INFO:tasks.workunit.client.0.smithi033.stdout:3/724: creat d2/d14/d23/d68/d73/fe4 x:0 0 0 2024-02-15T18:31:08.445 INFO:tasks.workunit.client.0.smithi033.stdout:3/725: rename d2/d3/d1e/d22/d4d/dcb/fdf to d2/d3/d1e/d22/d4d/fe5 0 2024-02-15T18:31:08.445 INFO:tasks.workunit.client.0.smithi033.stdout:3/726: chown d2/d3/d1e/d22/d4d/f77 313426666 1 2024-02-15T18:31:08.456 INFO:tasks.workunit.client.0.smithi033.stdout:8/634: dwrite d0/df/d53/db3/d30/d8e/d8f/f9e [0,4194304] 0 2024-02-15T18:31:08.457 INFO:tasks.workunit.client.0.smithi033.stdout:9/568: dread d4/d32/d6c/f8c [0,4194304] 0 2024-02-15T18:31:08.457 INFO:tasks.workunit.client.0.smithi033.stdout:2/711: dwrite d20/d3a/d4a/d5e/d6b/f8f [0,4194304] 0 2024-02-15T18:31:08.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/757: dwrite d1/da/d19/d3f/fa9 [0,4194304] 0 2024-02-15T18:31:08.457 INFO:tasks.workunit.client.0.smithi033.stdout:2/712: write d20/d31/d47/d4c/def/f87 [2848567,21896] 0 2024-02-15T18:31:08.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/758: write d1/da/d11/d5e/db1/fc2 [624289,43887] 0 2024-02-15T18:31:08.462 INFO:tasks.workunit.client.0.smithi033.stdout:3/727: dwrite d2/d3/df/f49 [0,4194304] 0 2024-02-15T18:31:08.464 INFO:tasks.workunit.client.0.smithi033.stdout:8/635: unlink d0/df/db/f87 0 2024-02-15T18:31:08.466 INFO:tasks.workunit.client.0.smithi033.stdout:8/636: dread d0/df/d53/db3/d30/d8e/d14/f32 [0,4194304] 0 2024-02-15T18:31:08.470 INFO:tasks.workunit.client.0.smithi033.stdout:9/569: symlink d4/d32/lc1 0 2024-02-15T18:31:08.472 INFO:tasks.workunit.client.0.smithi033.stdout:9/570: write d4/d8/dd/d28/f83 [216287,71798] 0 2024-02-15T18:31:08.473 INFO:tasks.workunit.client.0.smithi033.stdout:8/637: creat d0/df/d53/db3/d30/fd6 x:0 0 0 2024-02-15T18:31:08.473 INFO:tasks.workunit.client.0.smithi033.stdout:8/638: readlink d0/df/d53/db3/d30/d8e/d8f/d4b/l69 0 2024-02-15T18:31:08.477 INFO:tasks.workunit.client.0.smithi033.stdout:3/728: rename d2/d14/d23/d68 to d2/d3/d17/de6 0 2024-02-15T18:31:08.477 INFO:tasks.workunit.client.0.smithi033.stdout:3/729: truncate d2/f2e 9093113 0 2024-02-15T18:31:08.481 INFO:tasks.workunit.client.0.smithi033.stdout:4/701: sync 2024-02-15T18:31:08.481 INFO:tasks.workunit.client.0.smithi033.stdout:7/635: sync 2024-02-15T18:31:08.481 INFO:tasks.workunit.client.0.smithi033.stdout:4/702: fdatasync d4/d20/f9 0 2024-02-15T18:31:08.482 INFO:tasks.workunit.client.0.smithi033.stdout:9/571: mknod d4/d32/cc2 0 2024-02-15T18:31:08.482 INFO:tasks.workunit.client.0.smithi033.stdout:9/572: dread - d4/d32/fab zero size 2024-02-15T18:31:08.482 INFO:tasks.workunit.client.0.smithi033.stdout:8/639: mknod d0/cd7 0 2024-02-15T18:31:08.482 INFO:tasks.workunit.client.0.smithi033.stdout:4/703: write d4/d20/d53/f78 [448120,71154] 0 2024-02-15T18:31:08.482 INFO:tasks.workunit.client.0.smithi033.stdout:3/730: mkdir d2/d14/d23/d5c/d7f/de7 0 2024-02-15T18:31:08.482 INFO:tasks.workunit.client.0.smithi033.stdout:3/731: chown d2/d3/d1e/f9c 3040123 1 2024-02-15T18:31:08.483 INFO:tasks.workunit.client.0.smithi033.stdout:7/636: creat d0/dc/d10/d7d/d99/fdd x:0 0 0 2024-02-15T18:31:08.483 INFO:tasks.workunit.client.0.smithi033.stdout:7/637: write d0/dc/d10/d1d/d2b/f61 [1343478,99739] 0 2024-02-15T18:31:08.483 INFO:tasks.workunit.client.0.smithi033.stdout:7/638: dread - d0/d56/d70/fd6 zero size 2024-02-15T18:31:08.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.489+0000 7f99159c2700 1 -- 172.21.15.33:0/2306503441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f5440 msgr2=0x7f99100f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:08.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.489+0000 7f99159c2700 1 --2- 172.21.15.33:0/2306503441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f5440 0x7f99100f5860 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f9904004660 tx=0x7f9904009b30).stop 2024-02-15T18:31:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.489+0000 7f99159c2700 1 -- 172.21.15.33:0/2306503441 shutdown_connections 2024-02-15T18:31:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.489+0000 7f99159c2700 1 --2- 172.21.15.33:0/2306503441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99100f66e0 0x7f99100f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.489+0000 7f99159c2700 1 --2- 172.21.15.33:0/2306503441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f5440 0x7f99100f5860 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.489+0000 7f99159c2700 1 -- 172.21.15.33:0/2306503441 >> 172.21.15.33:0/2306503441 conn(0x7f99100f0ba0 msgr2=0x7f99100f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.490+0000 7f99159c2700 1 -- 172.21.15.33:0/2306503441 shutdown_connections 2024-02-15T18:31:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.490+0000 7f99159c2700 1 -- 172.21.15.33:0/2306503441 wait complete. 2024-02-15T18:31:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.490+0000 7f99159c2700 1 Processor -- start 2024-02-15T18:31:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.490+0000 7f99159c2700 1 -- start start 2024-02-15T18:31:08.484 INFO:tasks.workunit.client.0.smithi033.stdout:9/573: getdents d4/d2c/db1 0 2024-02-15T18:31:08.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f99159c2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99100f5440 0x7f9910108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:08.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f99159c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f66e0 0x7f99101094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:08.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f99159c2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910109a60 con 0x7f99100f66e0 2024-02-15T18:31:08.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f99159c2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910109ba0 con 0x7f99100f5440 2024-02-15T18:31:08.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f990ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f66e0 0x7f99101094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:08.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f990ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f66e0 0x7f99101094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45102/0 (socket says 172.21.15.33:45102) 2024-02-15T18:31:08.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f990ffff700 1 -- 172.21.15.33:0/888933345 learned_addr learned my addr 172.21.15.33:0/888933345 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:08.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f99149c0700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99100f5440 0x7f9910108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:08.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f990ffff700 1 -- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99100f5440 msgr2=0x7f9910108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:08.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f990ffff700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99100f5440 0x7f9910108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:08.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f990ffff700 1 -- 172.21.15.33:0/888933345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904005040 con 0x7f99100f66e0 2024-02-15T18:31:08.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.491+0000 7f990ffff700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f66e0 0x7f99101094b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f98fc00e7f0 tx=0x7f98fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:08.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.492+0000 7f990d7fa700 1 -- 172.21.15.33:0/888933345 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc0092e0 con 0x7f99100f66e0 2024-02-15T18:31:08.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.492+0000 7f990d7fa700 1 -- 172.21.15.33:0/888933345 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f98fc00f040 con 0x7f99100f66e0 2024-02-15T18:31:08.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.492+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991010a540 con 0x7f99100f66e0 2024-02-15T18:31:08.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.492+0000 7f990d7fa700 1 -- 172.21.15.33:0/888933345 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc014850 con 0x7f99100f66e0 2024-02-15T18:31:08.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.492+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991010ab00 con 0x7f99100f66e0 2024-02-15T18:31:08.488 INFO:tasks.workunit.client.0.smithi033.stdout:4/704: creat d4/fed x:0 0 0 2024-02-15T18:31:08.488 INFO:tasks.workunit.client.0.smithi033.stdout:4/705: truncate d4/d20/d37/f4d 389079 0 2024-02-15T18:31:08.488 INFO:tasks.workunit.client.0.smithi033.stdout:8/640: read d0/df/d53/db3/d30/d8e/d14/d56/f84 [2624399,40193] 0 2024-02-15T18:31:08.488 INFO:tasks.workunit.client.0.smithi033.stdout:8/641: getdents d0/df/d53/db3/d30/d8e/da7/db7 0 2024-02-15T18:31:08.489 INFO:tasks.workunit.client.0.smithi033.stdout:8/642: stat d0/l33 0 2024-02-15T18:31:08.489 INFO:tasks.workunit.client.0.smithi033.stdout:8/643: getdents d0/df/dd2 0 2024-02-15T18:31:08.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.494+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9910045ad0 con 0x7f99100f66e0 2024-02-15T18:31:08.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.495+0000 7f990d7fa700 1 -- 172.21.15.33:0/888933345 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 74714+0+0 (secure 0 0 0) 0x7f98fc01b030 con 0x7f99100f66e0 2024-02-15T18:31:08.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.495+0000 7f990d7fa700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f990005e9c0 0x7f9900060e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:08.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.495+0000 7f990d7fa700 1 -- 172.21.15.33:0/888933345 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f98fc078db0 con 0x7f99100f66e0 2024-02-15T18:31:08.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.496+0000 7f99149c0700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f990005e9c0 0x7f9900060e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:08.490 INFO:tasks.workunit.client.0.smithi033.stdout:3/732: symlink d2/d3/d1e/le8 0 2024-02-15T18:31:08.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.496+0000 7f99149c0700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f990005e9c0 0x7f9900060e80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9904004630 tx=0x7f9904016040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:08.494 INFO:tasks.workunit.client.0.smithi033.stdout:5/759: dwrite d1/da/d19/d74/f92 [0,4194304] 0 2024-02-15T18:31:08.494 INFO:tasks.workunit.client.0.smithi033.stdout:3/733: link d2/d3/d17/de6/d88/fa5 d2/d14/d23/fe9 0 2024-02-15T18:31:08.495 INFO:tasks.workunit.client.0.smithi033.stdout:2/713: dwrite d20/d31/d47/f6d [0,4194304] 0 2024-02-15T18:31:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.501+0000 7f990d7fa700 1 -- 172.21.15.33:0/888933345 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f98fc04cde0 con 0x7f99100f66e0 2024-02-15T18:31:08.497 INFO:tasks.workunit.client.0.smithi033.stdout:3/734: creat d2/d14/db3/dba/fea x:0 0 0 2024-02-15T18:31:08.499 INFO:tasks.workunit.client.0.smithi033.stdout:3/735: creat d2/d3/d17/de6/feb x:0 0 0 2024-02-15T18:31:08.504 INFO:tasks.workunit.client.0.smithi033.stdout:3/736: link d2/d3/d1e/d22/fc9 d2/d14/fec 0 2024-02-15T18:31:08.520 INFO:tasks.workunit.client.0.smithi033.stdout:2/714: write d20/f49 [1070849,113324] 0 2024-02-15T18:31:08.521 INFO:tasks.workunit.client.0.smithi033.stdout:2/715: dread d20/d31/f51 [0,4194304] 0 2024-02-15T18:31:08.522 INFO:tasks.workunit.client.0.smithi033.stdout:2/716: mknod d20/d30/c109 0 2024-02-15T18:31:08.524 INFO:tasks.workunit.client.0.smithi033.stdout:2/717: unlink d20/d31/d47/d4c/def/df1/l107 0 2024-02-15T18:31:08.524 INFO:tasks.workunit.client.0.smithi033.stdout:2/718: dread - d20/d31/d47/d82/ff5 zero size 2024-02-15T18:31:08.527 INFO:tasks.workunit.client.0.smithi033.stdout:2/719: read d20/d31/d47/d4c/f102 [3360692,31054] 0 2024-02-15T18:31:08.527 INFO:tasks.workunit.client.0.smithi033.stdout:2/720: chown c1f 2012519 1 2024-02-15T18:31:08.529 INFO:tasks.workunit.client.0.smithi033.stdout:2/721: rmdir d20/d73 39 2024-02-15T18:31:08.529 INFO:tasks.workunit.client.0.smithi033.stdout:2/722: chown d20/d31/d47/d4c/def/d80/f85 6 1 2024-02-15T18:31:08.530 INFO:tasks.workunit.client.0.smithi033.stdout:2/723: rmdir d20/d31/d47/d64 39 2024-02-15T18:31:08.530 INFO:tasks.workunit.client.0.smithi033.stdout:2/724: getdents d20/d3a/dee 0 2024-02-15T18:31:08.530 INFO:tasks.workunit.client.0.smithi033.stdout:2/725: creat d20/d31/d47/d4c/dc4/f10a x:0 0 0 2024-02-15T18:31:08.531 INFO:tasks.workunit.client.0.smithi033.stdout:2/726: stat d20/d3a/d4a/cd5 0 2024-02-15T18:31:08.531 INFO:tasks.workunit.client.0.smithi033.stdout:9/574: dwrite d4/d8/dd/d41/d51/f55 [0,4194304] 0 2024-02-15T18:31:08.532 INFO:tasks.workunit.client.0.smithi033.stdout:9/575: mknod d4/d8/d1b/d2f/d65/d8b/cc3 0 2024-02-15T18:31:08.533 INFO:tasks.workunit.client.0.smithi033.stdout:9/576: write d4/d8/dd/d28/f83 [4756624,119007] 0 2024-02-15T18:31:08.533 INFO:tasks.workunit.client.0.smithi033.stdout:9/577: chown d4/d8/d1b/d2f/d65/d8b/d95/fa6 260 1 2024-02-15T18:31:08.534 INFO:tasks.workunit.client.0.smithi033.stdout:9/578: truncate d4/d8/dd/d41/d51/f52 4143484 0 2024-02-15T18:31:08.535 INFO:tasks.workunit.client.0.smithi033.stdout:8/644: dwrite d0/df/db/f2f [0,4194304] 0 2024-02-15T18:31:08.535 INFO:tasks.workunit.client.0.smithi033.stdout:8/645: truncate d0/df/d53/db3/d30/d8e/d14/f32 891437 0 2024-02-15T18:31:08.536 INFO:tasks.workunit.client.0.smithi033.stdout:4/706: dwrite d4/d5/d28/f36 [4194304,4194304] 0 2024-02-15T18:31:08.538 INFO:tasks.workunit.client.0.smithi033.stdout:7/639: dwrite d0/fd [0,4194304] 0 2024-02-15T18:31:08.538 INFO:tasks.workunit.client.0.smithi033.stdout:4/707: mkdir d4/d5/d28/d39/dee 0 2024-02-15T18:31:08.539 INFO:tasks.workunit.client.0.smithi033.stdout:5/760: dwrite d1/da/d19/d74/f92 [0,4194304] 0 2024-02-15T18:31:08.539 INFO:tasks.workunit.client.0.smithi033.stdout:8/646: write d0/df/d53/db3/d30/d8e/d35/d29/f2e [7163708,122506] 0 2024-02-15T18:31:08.542 INFO:tasks.workunit.client.0.smithi033.stdout:2/727: write d20/d31/dc8/fe3 [4609661,38765] 0 2024-02-15T18:31:08.542 INFO:tasks.workunit.client.0.smithi033.stdout:7/640: dread d0/dc/d10/d1d/d2b/fb1 [0,4194304] 0 2024-02-15T18:31:08.542 INFO:tasks.workunit.client.0.smithi033.stdout:7/641: chown d0/f1 7310382 1 2024-02-15T18:31:08.543 INFO:tasks.workunit.client.0.smithi033.stdout:5/761: write d1/f27 [937776,57530] 0 2024-02-15T18:31:08.543 INFO:tasks.workunit.client.0.smithi033.stdout:5/762: chown d1/da/l1c 1 1 2024-02-15T18:31:08.548 INFO:tasks.workunit.client.0.smithi033.stdout:8/647: link d0/df/db/f23 d0/daa/fd8 0 2024-02-15T18:31:08.548 INFO:tasks.workunit.client.0.smithi033.stdout:8/648: chown d0/df/d53/db3/d30/l3f 4 1 2024-02-15T18:31:08.549 INFO:tasks.workunit.client.0.smithi033.stdout:8/649: write d0/df/db/f2f [4998627,78707] 0 2024-02-15T18:31:08.554 INFO:tasks.workunit.client.0.smithi033.stdout:2/728: creat d20/d31/d47/d4c/f10b x:0 0 0 2024-02-15T18:31:08.556 INFO:tasks.workunit.client.0.smithi033.stdout:7/642: rename d0/d56/d70/f80 to d0/d56/d70/d83/fde 0 2024-02-15T18:31:08.556 INFO:tasks.workunit.client.0.smithi033.stdout:4/708: dwrite d4/f54 [0,4194304] 0 2024-02-15T18:31:08.557 INFO:tasks.workunit.client.0.smithi033.stdout:5/763: mknod d1/da/d11/ded/cf4 0 2024-02-15T18:31:08.557 INFO:tasks.workunit.client.0.smithi033.stdout:5/764: write d1/da/d52/dd8/d40/d65/f83 [1742638,31712] 0 2024-02-15T18:31:08.558 INFO:tasks.workunit.client.0.smithi033.stdout:8/650: creat d0/df/d53/db3/d30/d8e/d14/d56/d59/fd9 x:0 0 0 2024-02-15T18:31:08.563 INFO:tasks.workunit.client.0.smithi033.stdout:2/729: mkdir d20/d3a/d4a/d5e/d10c 0 2024-02-15T18:31:08.564 INFO:tasks.workunit.client.0.smithi033.stdout:7/643: unlink d0/d56/d70/d83/fcd 0 2024-02-15T18:31:08.565 INFO:tasks.workunit.client.0.smithi033.stdout:4/709: mknod d4/d20/d13/d1b/d81/d8b/cef 0 2024-02-15T18:31:08.565 INFO:tasks.workunit.client.0.smithi033.stdout:4/710: dread - d4/d5/d28/d39/d62/d9c/d9e/da4/ddb/fde zero size 2024-02-15T18:31:08.566 INFO:tasks.workunit.client.0.smithi033.stdout:4/711: write d4/d5/d28/d39/f79 [481441,114422] 0 2024-02-15T18:31:08.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/712: write d4/d20/d13/d1b/d7c/fc1 [231724,16416] 0 2024-02-15T18:31:08.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/713: write d4/d20/d13/d1b/d81/d9f/fcb [1010093,87874] 0 2024-02-15T18:31:08.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/714: truncate d4/d3c/fd5 813387 0 2024-02-15T18:31:08.567 INFO:tasks.workunit.client.0.smithi033.stdout:4/715: dread - d4/d5/d28/d39/d62/d9c/d9e/dcd/fe3 zero size 2024-02-15T18:31:08.567 INFO:tasks.workunit.client.0.smithi033.stdout:5/765: mknod d1/da/d19/d3f/d68/cf5 0 2024-02-15T18:31:08.570 INFO:tasks.workunit.client.0.smithi033.stdout:2/730: rmdir d20/d73 39 2024-02-15T18:31:08.570 INFO:tasks.workunit.client.0.smithi033.stdout:2/731: write d20/d3a/d4a/d5e/f76 [5096516,98684] 0 2024-02-15T18:31:08.570 INFO:tasks.workunit.client.0.smithi033.stdout:2/732: chown d20/d31/fb4 115326146 1 2024-02-15T18:31:08.571 INFO:tasks.workunit.client.0.smithi033.stdout:7/644: symlink d0/dc/d10/d1d/d38/d74/d7f/da2/ldf 0 2024-02-15T18:31:08.571 INFO:tasks.workunit.client.0.smithi033.stdout:7/645: write d0/dc/d10/d48/d4b/f54 [4680472,48259] 0 2024-02-15T18:31:08.571 INFO:tasks.workunit.client.0.smithi033.stdout:7/646: write d0/f62 [3686963,104599] 0 2024-02-15T18:31:08.572 INFO:tasks.workunit.client.0.smithi033.stdout:5/766: creat d1/da/d19/d3f/d68/dd0/ff6 x:0 0 0 2024-02-15T18:31:08.572 INFO:tasks.workunit.client.0.smithi033.stdout:5/767: readlink d1/da/d52/dd8/l64 0 2024-02-15T18:31:08.572 INFO:tasks.workunit.client.0.smithi033.stdout:5/768: fdatasync d1/da/d11/d5e/f8b 0 2024-02-15T18:31:08.573 INFO:tasks.workunit.client.0.smithi033.stdout:6/740: sync 2024-02-15T18:31:08.573 INFO:tasks.workunit.client.0.smithi033.stdout:0/632: sync 2024-02-15T18:31:08.574 INFO:tasks.workunit.client.0.smithi033.stdout:5/769: truncate d1/da/d52/dd8/d40/f31 465683 0 2024-02-15T18:31:08.579 INFO:tasks.workunit.client.0.smithi033.stdout:2/733: dread d20/d31/d6a/f28 [0,4194304] 0 2024-02-15T18:31:08.580 INFO:tasks.workunit.client.0.smithi033.stdout:2/734: truncate d20/d31/d47/fc9 297156 0 2024-02-15T18:31:08.580 INFO:tasks.workunit.client.0.smithi033.stdout:2/735: readlink d20/d31/d47/d4c/def/d80/lbc 0 2024-02-15T18:31:08.581 INFO:tasks.workunit.client.0.smithi033.stdout:6/741: unlink d8/d1d/d37/d4f/dbb/d55/d60/l8b 0 2024-02-15T18:31:08.585 INFO:tasks.workunit.client.0.smithi033.stdout:6/742: read d8/d28/d36/f41 [740972,111869] 0 2024-02-15T18:31:08.587 INFO:tasks.workunit.client.0.smithi033.stdout:2/736: write d20/d31/d47/d4c/def/f87 [5429276,71380] 0 2024-02-15T18:31:08.587 INFO:tasks.workunit.client.0.smithi033.stdout:2/737: truncate d20/d31/d47/d4c/def/d80/da0/fe8 501585 0 2024-02-15T18:31:08.587 INFO:tasks.workunit.client.0.smithi033.stdout:2/738: fsync d20/d31/d6a/f2e 0 2024-02-15T18:31:08.587 INFO:tasks.workunit.client.0.smithi033.stdout:2/739: write d20/d39/f5a [2174367,16412] 0 2024-02-15T18:31:08.596 INFO:tasks.workunit.client.0.smithi033.stdout:2/740: dread d20/d30/f44 [0,4194304] 0 2024-02-15T18:31:08.599 INFO:tasks.workunit.client.0.smithi033.stdout:6/743: rename d8/d28/d14/d2c/d31/d30/d29/d38/d54 to d8/d28/d14/d2c/d31/ded 0 2024-02-15T18:31:08.610 INFO:tasks.workunit.client.0.smithi033.stdout:6/744: symlink d8/d28/d14/d2c/d31/d30/d29/d38/dae/lee 0 2024-02-15T18:31:08.620 INFO:tasks.workunit.client.0.smithi033.stdout:4/716: dwrite d4/f22 [0,4194304] 0 2024-02-15T18:31:08.620 INFO:tasks.workunit.client.0.smithi033.stdout:0/633: dwrite d0/d8/d15/d2d/d41/d73/f93 [0,4194304] 0 2024-02-15T18:31:08.620 INFO:tasks.workunit.client.0.smithi033.stdout:0/634: truncate d0/d8/d15/d5b/d94/fbb 513156 0 2024-02-15T18:31:08.621 INFO:tasks.workunit.client.0.smithi033.stdout:7/647: dwrite d0/dc/d10/d48/f6f [0,4194304] 0 2024-02-15T18:31:08.621 INFO:tasks.workunit.client.0.smithi033.stdout:7/648: stat d0/dc/d10/d1d/d38/l9f 0 2024-02-15T18:31:08.621 INFO:tasks.workunit.client.0.smithi033.stdout:5/770: dwrite d1/da/d11/d5e/db1/fc2 [0,4194304] 0 2024-02-15T18:31:08.622 INFO:tasks.workunit.client.0.smithi033.stdout:5/771: dread - d1/da/d11/d5e/db1/d63/d61/fb7 zero size 2024-02-15T18:31:08.622 INFO:tasks.workunit.client.0.smithi033.stdout:2/741: dread d20/d3a/d4a/d5e/ff6 [0,4194304] 0 2024-02-15T18:31:08.622 INFO:tasks.workunit.client.0.smithi033.stdout:2/742: dread - d20/d3a/d4a/d5e/d6b/d83/faa zero size 2024-02-15T18:31:08.622 INFO:tasks.workunit.client.0.smithi033.stdout:6/745: dread d8/d28/f11 [0,4194304] 0 2024-02-15T18:31:08.623 INFO:tasks.workunit.client.0.smithi033.stdout:6/746: fsync d8/d28/d14/d2c/d3b/d3d/f48 0 2024-02-15T18:31:08.623 INFO:tasks.workunit.client.0.smithi033.stdout:4/717: creat d4/d20/d13/d1b/d7c/d91/dbe/ff0 x:0 0 0 2024-02-15T18:31:08.623 INFO:tasks.workunit.client.0.smithi033.stdout:4/718: fsync d4/d20/d13/d1b/d7c/fc1 0 2024-02-15T18:31:08.624 INFO:tasks.workunit.client.0.smithi033.stdout:0/635: unlink d0/d8/d15/d2d/d3f/f55 0 2024-02-15T18:31:08.625 INFO:tasks.workunit.client.0.smithi033.stdout:0/636: write d0/d8/d15/d2d/d2e/f65 [405567,48828] 0 2024-02-15T18:31:08.627 INFO:tasks.workunit.client.0.smithi033.stdout:6/747: write d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb4 [6055783,75340] 0 2024-02-15T18:31:08.632 INFO:tasks.workunit.client.0.smithi033.stdout:2/743: write d20/d3a/d4a/f74 [1742747,121581] 0 2024-02-15T18:31:08.634 INFO:tasks.workunit.client.0.smithi033.stdout:7/649: symlink d0/dc/d10/d1d/d38/d82/le0 0 2024-02-15T18:31:08.643 INFO:tasks.workunit.client.0.smithi033.stdout:0/637: rmdir d0/d64/d88 39 2024-02-15T18:31:08.648 INFO:tasks.workunit.client.0.smithi033.stdout:2/744: creat d20/d39/f10d x:0 0 0 2024-02-15T18:31:08.648 INFO:tasks.workunit.client.0.smithi033.stdout:4/719: mkdir d4/d20/df1 0 2024-02-15T18:31:08.648 INFO:tasks.workunit.client.0.smithi033.stdout:2/745: chown d20/d31/f7c 0 1 2024-02-15T18:31:08.648 INFO:tasks.workunit.client.0.smithi033.stdout:2/746: chown d20/d3a/d4a/d5e/d6b/d88/cd7 20 1 2024-02-15T18:31:08.650 INFO:tasks.workunit.client.0.smithi033.stdout:4/720: dread - d4/d20/d13/d34/d82/fc7 zero size 2024-02-15T18:31:08.650 INFO:tasks.workunit.client.0.smithi033.stdout:4/721: fsync d4/fb3 0 2024-02-15T18:31:08.650 INFO:tasks.workunit.client.0.smithi033.stdout:5/772: dwrite d1/da/d52/dd8/f70 [0,4194304] 0 2024-02-15T18:31:08.655 INFO:tasks.workunit.client.0.smithi033.stdout:4/722: creat d4/d20/d13/ff2 x:0 0 0 2024-02-15T18:31:08.656 INFO:tasks.workunit.client.0.smithi033.stdout:4/723: write d4/d20/f3a [306429,24027] 0 2024-02-15T18:31:08.656 INFO:tasks.workunit.client.0.smithi033.stdout:4/724: fdatasync d4/d20/f9a 0 2024-02-15T18:31:08.656 INFO:tasks.workunit.client.0.smithi033.stdout:4/725: fsync d4/d20/d13/d1b/d7c/d91/dbe/ff0 0 2024-02-15T18:31:08.656 INFO:tasks.workunit.client.0.smithi033.stdout:4/726: readlink d4/d20/d13/d1b/d81/d9f/la0 0 2024-02-15T18:31:08.656 INFO:tasks.workunit.client.0.smithi033.stdout:5/773: creat d1/da/d52/dd8/dd2/ff7 x:0 0 0 2024-02-15T18:31:08.656 INFO:tasks.workunit.client.0.smithi033.stdout:0/638: dread d0/d8/d15/d2d/d2e/f76 [0,4194304] 0 2024-02-15T18:31:08.657 INFO:tasks.workunit.client.0.smithi033.stdout:0/639: truncate d0/d8/d15/d2d/d41/d73/d96/faf 926609 0 2024-02-15T18:31:08.658 INFO:tasks.workunit.client.0.smithi033.stdout:4/727: truncate d4/d5/f24 4107383 0 2024-02-15T18:31:08.659 INFO:tasks.workunit.client.0.smithi033.stdout:4/728: truncate d4/d20/d37/f44 545324 0 2024-02-15T18:31:08.661 INFO:tasks.workunit.client.0.smithi033.stdout:6/748: dwrite d8/fb0 [0,4194304] 0 2024-02-15T18:31:08.661 INFO:tasks.workunit.client.0.smithi033.stdout:6/749: truncate d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb6 59883 0 2024-02-15T18:31:08.663 INFO:tasks.workunit.client.0.smithi033.stdout:7/650: dwrite d0/dc/d10/d7d/d93/dc2/fbd [0,4194304] 0 2024-02-15T18:31:08.668 INFO:tasks.workunit.client.0.smithi033.stdout:1/691: sync 2024-02-15T18:31:08.668 INFO:tasks.workunit.client.0.smithi033.stdout:1/692: chown d5/ca9 9 1 2024-02-15T18:31:08.669 INFO:tasks.workunit.client.0.smithi033.stdout:2/747: dwrite d20/d3a/d4a/d5e/d6b/d88/da6/ddb/ff2 [0,4194304] 0 2024-02-15T18:31:08.669 INFO:tasks.workunit.client.0.smithi033.stdout:2/748: write d20/d39/f10d [598513,104581] 0 2024-02-15T18:31:08.669 INFO:tasks.workunit.client.0.smithi033.stdout:2/749: chown d20/d31/d47/l54 18975784 1 2024-02-15T18:31:08.669 INFO:tasks.workunit.client.0.smithi033.stdout:6/750: creat d8/d1d/d37/d4f/dbb/d57/fef x:0 0 0 2024-02-15T18:31:08.670 INFO:tasks.workunit.client.0.smithi033.stdout:6/751: truncate d8/d28/f46 1717081 0 2024-02-15T18:31:08.676 INFO:tasks.workunit.client.0.smithi033.stdout:0/640: dread d0/d8/d15/d8b/da3/d6c/fcf [0,4194304] 0 2024-02-15T18:31:08.676 INFO:tasks.workunit.client.0.smithi033.stdout:4/729: write d4/d20/d37/f4d [90976,4381] 0 2024-02-15T18:31:08.676 INFO:tasks.workunit.client.0.smithi033.stdout:3/737: sync 2024-02-15T18:31:08.677 INFO:tasks.workunit.client.0.smithi033.stdout:0/641: write d0/d8/d15/d2d/f8c [510181,65869] 0 2024-02-15T18:31:08.677 INFO:tasks.workunit.client.0.smithi033.stdout:0/642: chown d0/d8/d15/d2d/d3f/d97 1488 1 2024-02-15T18:31:08.677 INFO:tasks.workunit.client.0.smithi033.stdout:7/651: read d0/dc/d10/d1d/d2b/f4a [812478,85635] 0 2024-02-15T18:31:08.677 INFO:tasks.workunit.client.0.smithi033.stdout:7/652: readlink d0/d56/l6c 0 2024-02-15T18:31:08.682 INFO:tasks.workunit.client.0.smithi033.stdout:5/774: dwrite d1/da/d19/d3f/d68/fde [0,4194304] 0 2024-02-15T18:31:08.682 INFO:tasks.workunit.client.0.smithi033.stdout:3/738: dread - d2/d3/d1e/d22/d59/fc1 zero size 2024-02-15T18:31:08.683 INFO:tasks.workunit.client.0.smithi033.stdout:3/739: write d2/d3/d17/de6/fa2 [20151,80560] 0 2024-02-15T18:31:08.683 INFO:tasks.workunit.client.0.smithi033.stdout:3/740: write d2/d3/df/f7a [425017,432] 0 2024-02-15T18:31:08.683 INFO:tasks.workunit.client.0.smithi033.stdout:3/741: write d2/d14/d23/d5c/f80 [1016517,91940] 0 2024-02-15T18:31:08.683 INFO:tasks.workunit.client.0.smithi033.stdout:4/730: creat d4/d5/d28/d39/d62/d9c/d9e/da4/db1/ff3 x:0 0 0 2024-02-15T18:31:08.684 INFO:tasks.workunit.client.0.smithi033.stdout:4/731: fsync d4/d20/d13/d5c/f71 0 2024-02-15T18:31:08.686 INFO:tasks.workunit.client.0.smithi033.stdout:0/643: link d0/d8/d15/d7c/da4/f69 d0/d64/d1d/dd3/fdb 0 2024-02-15T18:31:08.686 INFO:tasks.workunit.client.0.smithi033.stdout:4/732: write d4/d5/d28/f36 [6849366,93914] 0 2024-02-15T18:31:08.686 INFO:tasks.workunit.client.0.smithi033.stdout:4/733: write d4/d3c/fd7 [792362,77932] 0 2024-02-15T18:31:08.687 INFO:tasks.workunit.client.0.smithi033.stdout:7/653: mknod d0/dc/d10/da1/ce1 0 2024-02-15T18:31:08.696 INFO:tasks.workunit.client.0.smithi033.stdout:6/752: dwrite d8/d1d/d37/d4f/fcd [0,4194304] 0 2024-02-15T18:31:08.696 INFO:tasks.workunit.client.0.smithi033.stdout:2/750: dwrite d20/d31/d47/d4c/def/f87 [4194304,4194304] 0 2024-02-15T18:31:08.699 INFO:tasks.workunit.client.0.smithi033.stdout:3/742: creat d2/d14/d23/d6f/fed x:0 0 0 2024-02-15T18:31:08.699 INFO:tasks.workunit.client.0.smithi033.stdout:0/644: symlink d0/d8/d15/d2d/d41/d73/ldc 0 2024-02-15T18:31:08.699 INFO:tasks.workunit.client.0.smithi033.stdout:9/579: sync 2024-02-15T18:31:08.699 INFO:tasks.workunit.client.0.smithi033.stdout:8/651: sync 2024-02-15T18:31:08.699 INFO:tasks.workunit.client.0.smithi033.stdout:8/652: fdatasync d0/df/d53/db3/d30/fd6 0 2024-02-15T18:31:08.699 INFO:tasks.workunit.client.0.smithi033.stdout:8/653: fsync d0/df/d53/db3/d30/d8e/d35/d58/da1/fb9 0 2024-02-15T18:31:08.703 INFO:tasks.workunit.client.0.smithi033.stdout:0/645: getdents d0/d8/d15 0 2024-02-15T18:31:08.703 INFO:tasks.workunit.client.0.smithi033.stdout:2/751: mkdir d20/d3a/d4a/d5e/d6b/d10e 0 2024-02-15T18:31:08.704 INFO:tasks.workunit.client.0.smithi033.stdout:2/752: fsync d20/d31/d47/d82/fd3 0 2024-02-15T18:31:08.705 INFO:tasks.workunit.client.0.smithi033.stdout:4/734: dread d4/d20/fb [0,4194304] 0 2024-02-15T18:31:08.706 INFO:tasks.workunit.client.0.smithi033.stdout:7/654: dread d0/d56/d70/d83/fde [0,4194304] 0 2024-02-15T18:31:08.706 INFO:tasks.workunit.client.0.smithi033.stdout:3/743: creat d2/d14/d23/d5c/fee x:0 0 0 2024-02-15T18:31:08.706 INFO:tasks.workunit.client.0.smithi033.stdout:3/744: fsync d2/d14/db3/dba/fbf 0 2024-02-15T18:31:08.707 INFO:tasks.workunit.client.0.smithi033.stdout:8/654: link d0/df/f11 d0/df/d53/db3/d30/d8e/d14/fda 0 2024-02-15T18:31:08.709 INFO:tasks.workunit.client.0.smithi033.stdout:8/655: write d0/df/db/d45/f7b [2780739,71570] 0 2024-02-15T18:31:08.717 INFO:tasks.workunit.client.0.smithi033.stdout:2/753: rename d20/f2b to d20/d31/d47/da4/f10f 0 2024-02-15T18:31:08.719 INFO:tasks.workunit.client.0.smithi033.stdout:3/745: creat d2/d3/d1e/d22/d59/fef x:0 0 0 2024-02-15T18:31:08.719 INFO:tasks.workunit.client.0.smithi033.stdout:8/656: rmdir d0/df/dd3 39 2024-02-15T18:31:08.719 INFO:tasks.workunit.client.0.smithi033.stdout:8/657: truncate d0/df/d53/d9b/fa4 957892 0 2024-02-15T18:31:08.720 INFO:tasks.workunit.client.0.smithi033.stdout:7/655: symlink d0/dc/d10/d1d/d38/d74/d7f/da2/le2 0 2024-02-15T18:31:08.720 INFO:tasks.workunit.client.0.smithi033.stdout:7/656: dread - d0/dc/d10/d1d/d38/d74/f77 zero size 2024-02-15T18:31:08.721 INFO:tasks.workunit.client.0.smithi033.stdout:3/746: symlink d2/d14/d23/d5c/d62/lf0 0 2024-02-15T18:31:08.722 INFO:tasks.workunit.client.0.smithi033.stdout:9/580: dread d4/d8/d1b/d73/f86 [0,4194304] 0 2024-02-15T18:31:08.722 INFO:tasks.workunit.client.0.smithi033.stdout:2/754: write d20/d31/d47/d4c/def/f7b [1731931,126417] 0 2024-02-15T18:31:08.722 INFO:tasks.workunit.client.0.smithi033.stdout:7/657: rename d0/dc/d10/d1d/d38/fce to d0/dc/fe3 0 2024-02-15T18:31:08.723 INFO:tasks.workunit.client.0.smithi033.stdout:7/658: chown d0/f62 191492 1 2024-02-15T18:31:08.724 INFO:tasks.workunit.client.0.smithi033.stdout:3/747: getdents d2/d14/d23/d6f 0 2024-02-15T18:31:08.724 INFO:tasks.workunit.client.0.smithi033.stdout:8/658: write d0/f5c [1882263,55374] 0 2024-02-15T18:31:08.725 INFO:tasks.workunit.client.0.smithi033.stdout:9/581: getdents d4/d2c 0 2024-02-15T18:31:08.728 INFO:tasks.workunit.client.0.smithi033.stdout:2/755: rename d20/d31/df8 to d20/d31/d47/d64/d110 0 2024-02-15T18:31:08.728 INFO:tasks.workunit.client.0.smithi033.stdout:2/756: chown d20/d31/d47/d64/d110/l103 8324654 1 2024-02-15T18:31:08.728 INFO:tasks.workunit.client.0.smithi033.stdout:7/659: rmdir d0/dc/d10/d1d/d38/d74/d7f 39 2024-02-15T18:31:08.728 INFO:tasks.workunit.client.0.smithi033.stdout:7/660: truncate d0/d56/fc1 2033015 0 2024-02-15T18:31:08.730 INFO:tasks.workunit.client.0.smithi033.stdout:9/582: rename d4/d2c/l94 to d4/d8/dd/d5c/d6d/dbc/lc4 0 2024-02-15T18:31:08.731 INFO:tasks.workunit.client.0.smithi033.stdout:4/735: dwrite d4/d20/d37/f8e [0,4194304] 0 2024-02-15T18:31:08.731 INFO:tasks.workunit.client.0.smithi033.stdout:3/748: dread d2/d3/d17/de6/d73/d76/fb4 [0,4194304] 0 2024-02-15T18:31:08.731 INFO:tasks.workunit.client.0.smithi033.stdout:3/749: getdents d2/d3/dcc 0 2024-02-15T18:31:08.731 INFO:tasks.workunit.client.0.smithi033.stdout:2/757: mkdir d20/d3a/d4a/d5e/d6b/d83/d111 0 2024-02-15T18:31:08.732 INFO:tasks.workunit.client.0.smithi033.stdout:2/758: truncate d20/d31/d47/d4c/def/d80/fe7 972740 0 2024-02-15T18:31:08.732 INFO:tasks.workunit.client.0.smithi033.stdout:8/659: fdatasync d0/f5c 0 2024-02-15T18:31:08.733 INFO:tasks.workunit.client.0.smithi033.stdout:0/646: dwrite d0/d8/d15/d8b/da3/dae/d58/d80/fa6 [0,4194304] 0 2024-02-15T18:31:08.733 INFO:tasks.workunit.client.0.smithi033.stdout:6/753: dwrite d8/d1d/d37/d72/f98 [0,4194304] 0 2024-02-15T18:31:08.733 INFO:tasks.workunit.client.0.smithi033.stdout:6/754: chown d8/d1d/d37/d4f/dbb/d55 31948036 1 2024-02-15T18:31:08.733 INFO:tasks.workunit.client.0.smithi033.stdout:7/661: creat d0/dc/d10/d1d/d38/d82/fe4 x:0 0 0 2024-02-15T18:31:08.733 INFO:tasks.workunit.client.0.smithi033.stdout:6/755: write d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb4 [7995876,41087] 0 2024-02-15T18:31:08.733 INFO:tasks.workunit.client.0.smithi033.stdout:6/756: write d8/f90 [2460503,14715] 0 2024-02-15T18:31:08.734 INFO:tasks.workunit.client.0.smithi033.stdout:2/759: read d20/d3a/d4a/d5e/d6b/d88/fb3 [1073447,6519] 0 2024-02-15T18:31:08.737 INFO:tasks.workunit.client.0.smithi033.stdout:7/662: dread d0/dc/d10/d7d/d93/dc2/f85 [0,4194304] 0 2024-02-15T18:31:08.737 INFO:tasks.workunit.client.0.smithi033.stdout:7/663: write d0/dc/d10/d7d/d99/fb2 [1093022,111678] 0 2024-02-15T18:31:08.738 INFO:tasks.workunit.client.0.smithi033.stdout:9/583: link d4/d8/f20 d4/d8/dd/fc5 0 2024-02-15T18:31:08.738 INFO:tasks.workunit.client.0.smithi033.stdout:7/664: read d0/dc/d10/d1d/d2b/d5f/d63/f66 [513660,42902] 0 2024-02-15T18:31:08.740 INFO:tasks.workunit.client.0.smithi033.stdout:4/736: symlink d4/d20/d13/d5c/d87/dd0/de5/lf4 0 2024-02-15T18:31:08.741 INFO:tasks.workunit.client.0.smithi033.stdout:3/750: rename d2/d14/d23/d5c/fda to d2/d14/d23/d5c/d7f/ff1 0 2024-02-15T18:31:08.743 INFO:tasks.workunit.client.0.smithi033.stdout:0/647: creat d0/d64/d1d/dd3/fdd x:0 0 0 2024-02-15T18:31:08.743 INFO:tasks.workunit.client.0.smithi033.stdout:0/648: write d0/d8/d15/d2d/d41/d73/f93 [5135771,3129] 0 2024-02-15T18:31:08.745 INFO:tasks.workunit.client.0.smithi033.stdout:8/660: unlink d0/df/d53/db3/d30/d8e/d14/d56/d59/c99 0 2024-02-15T18:31:08.745 INFO:tasks.workunit.client.0.smithi033.stdout:6/757: creat d8/d1d/ff0 x:0 0 0 2024-02-15T18:31:08.747 INFO:tasks.workunit.client.0.smithi033.stdout:7/665: getdents d0 0 2024-02-15T18:31:08.747 INFO:tasks.workunit.client.0.smithi033.stdout:2/760: symlink d20/d31/d47/d82/de6/d106/l112 0 2024-02-15T18:31:08.747 INFO:tasks.workunit.client.0.smithi033.stdout:3/751: dread d2/d3/d17/de6/d73/d76/fb4 [0,4194304] 0 2024-02-15T18:31:08.748 INFO:tasks.workunit.client.0.smithi033.stdout:4/737: mkdir d4/d20/d13/d34/d82/df5 0 2024-02-15T18:31:08.752 INFO:tasks.workunit.client.0.smithi033.stdout:0/649: mknod d0/d8/d15/d5b/d83/cde 0 2024-02-15T18:31:08.752 INFO:tasks.workunit.client.0.smithi033.stdout:8/661: unlink d0/df/d53/db3/d30/d8e/d14/d56/c97 0 2024-02-15T18:31:08.753 INFO:tasks.workunit.client.0.smithi033.stdout:8/662: truncate d0/df/d53/db3/d30/d8e/d8f/d4b/d72/fbc 310475 0 2024-02-15T18:31:08.753 INFO:tasks.workunit.client.0.smithi033.stdout:6/758: creat d8/d1d/d37/d4f/dbb/ff1 x:0 0 0 2024-02-15T18:31:08.754 INFO:tasks.workunit.client.0.smithi033.stdout:6/759: write d8/d28/d14/d2c/de7/feb [552558,51274] 0 2024-02-15T18:31:08.754 INFO:tasks.workunit.client.0.smithi033.stdout:6/760: write d8/d70/fdb [5121,53458] 0 2024-02-15T18:31:08.755 INFO:tasks.workunit.client.0.smithi033.stdout:7/666: unlink d0/dc/d10/d1d/d38/d74/d7f/da2/le2 0 2024-02-15T18:31:08.755 INFO:tasks.workunit.client.0.smithi033.stdout:7/667: read - d0/dc/d10/d1d/d2b/fda zero size 2024-02-15T18:31:08.755 INFO:tasks.workunit.client.0.smithi033.stdout:7/668: fdatasync d0/dc/f65 0 2024-02-15T18:31:08.755 INFO:tasks.workunit.client.0.smithi033.stdout:7/669: readlink d0/d56/d70/d91/lc8 0 2024-02-15T18:31:08.756 INFO:tasks.workunit.client.0.smithi033.stdout:2/761: unlink d20/d31/d47/d4c/def/fe9 0 2024-02-15T18:31:08.757 INFO:tasks.workunit.client.0.smithi033.stdout:4/738: creat d4/d5/d28/d39/d62/d9c/d9e/dcd/ff6 x:0 0 0 2024-02-15T18:31:08.758 INFO:tasks.workunit.client.0.smithi033.stdout:9/584: dwrite d4/d8/dd/d5c/d6d/f7b [0,4194304] 0 2024-02-15T18:31:08.758 INFO:tasks.workunit.client.0.smithi033.stdout:8/663: read d0/df/d53/db3/f3b [803258,85326] 0 2024-02-15T18:31:08.759 INFO:tasks.workunit.client.0.smithi033.stdout:2/762: symlink d20/d31/d47/d64/l113 0 2024-02-15T18:31:08.767 INFO:tasks.workunit.client.0.smithi033.stdout:3/752: mknod d2/d14/d23/d6f/d93/cf2 0 2024-02-15T18:31:08.767 INFO:tasks.workunit.client.0.smithi033.stdout:4/739: symlink d4/d5/dc9/lf7 0 2024-02-15T18:31:08.767 INFO:tasks.workunit.client.0.smithi033.stdout:3/753: chown d2/d3/df/f49 511 1 2024-02-15T18:31:08.767 INFO:tasks.workunit.client.0.smithi033.stdout:3/754: chown d2/d14/d23/d6f/l94 115670 1 2024-02-15T18:31:08.767 INFO:tasks.workunit.client.0.smithi033.stdout:8/664: symlink d0/df/d53/db3/d30/d8e/d14/d56/db0/ldb 0 2024-02-15T18:31:08.767 INFO:tasks.workunit.client.0.smithi033.stdout:8/665: fsync d0/df/fc9 0 2024-02-15T18:31:08.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.777+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 --> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f991010ad20 con 0x7f990005e9c0 2024-02-15T18:31:08.772 INFO:tasks.workunit.client.0.smithi033.stdout:0/650: rmdir d0/d64/d1d 39 2024-02-15T18:31:08.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.781+0000 7f990d7fa700 1 -- 172.21.15.33:0/888933345 <== mgr.24387 v2:172.21.15.131:6828/3968122283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f991010ad20 con 0x7f990005e9c0 2024-02-15T18:31:08.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f990005e9c0 msgr2=0x7f9900060e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:08.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f990005e9c0 0x7f9900060e80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9904004630 tx=0x7f9904016040).stop 2024-02-15T18:31:08.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f66e0 msgr2=0x7f99101094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:08.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f66e0 0x7f99101094b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f98fc00e7f0 tx=0x7f98fc00b040).stop 2024-02-15T18:31:08.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 shutdown_connections 2024-02-15T18:31:08.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f990005e9c0 0x7f9900060e80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:08.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99100f5440 0x7f9910108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:08.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 --2- 172.21.15.33:0/888933345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99100f66e0 0x7f99101094b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:08.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 >> 172.21.15.33:0/888933345 conn(0x7f99100f0ba0 msgr2=0x7f99100fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:08.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 shutdown_connections 2024-02-15T18:31:08.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.783+0000 7f99159c2700 1 -- 172.21.15.33:0/888933345 wait complete. 2024-02-15T18:31:08.786 INFO:tasks.workunit.client.0.smithi033.stdout:0/651: rmdir d0/d8/d15/d8b 39 2024-02-15T18:31:08.793 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:31:08.794 INFO:tasks.workunit.client.0.smithi033.stdout:4/740: dread d4/d5/d28/d39/d62/d9c/fb7 [0,4194304] 0 2024-02-15T18:31:08.796 INFO:tasks.workunit.client.0.smithi033.stdout:8/666: dread d0/df/db/f3c [0,4194304] 0 2024-02-15T18:31:08.803 INFO:tasks.workunit.client.0.smithi033.stdout:6/761: dwrite d8/d28/d14/d2c/d31/d5d/d8c/f95 [0,4194304] 0 2024-02-15T18:31:08.807 INFO:tasks.workunit.client.0.smithi033.stdout:6/762: read d8/d28/f11 [1050380,128496] 0 2024-02-15T18:31:08.810 INFO:tasks.workunit.client.0.smithi033.stdout:6/763: read d8/fb0 [149808,48227] 0 2024-02-15T18:31:08.815 INFO:tasks.workunit.client.0.smithi033.stdout:6/764: dread d8/d1d/d37/d4f/dbb/f56 [0,4194304] 0 2024-02-15T18:31:08.816 INFO:tasks.workunit.client.0.smithi033.stdout:6/765: rename d8/d28/d14/d2c/ld2 to d8/d28/d14/de8/lf2 0 2024-02-15T18:31:08.818 INFO:tasks.workunit.client.0.smithi033.stdout:8/667: dread d0/df/d53/db3/d30/d8e/f6 [0,4194304] 0 2024-02-15T18:31:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:7/670: dwrite d0/dc/d10/d1d/f2d [0,4194304] 0 2024-02-15T18:31:08.819 INFO:tasks.workunit.client.0.smithi033.stdout:8/668: mknod d0/df/d53/db3/d30/d8e/d8f/d4b/d72/cdc 0 2024-02-15T18:31:08.820 INFO:tasks.workunit.client.0.smithi033.stdout:3/755: dwrite d2/d3/df/d6c/f72 [0,4194304] 0 2024-02-15T18:31:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:7/671: dread d0/d56/d70/d83/fd1 [0,4194304] 0 2024-02-15T18:31:08.821 INFO:tasks.workunit.client.0.smithi033.stdout:0/652: dwrite d0/d8/faa [0,4194304] 0 2024-02-15T18:31:08.822 INFO:tasks.workunit.client.0.smithi033.stdout:6/766: dread d8/f6e [0,4194304] 0 2024-02-15T18:31:08.822 INFO:tasks.workunit.client.0.smithi033.stdout:9/585: dwrite d4/d8/d1b/d2f/f30 [0,4194304] 0 2024-02-15T18:31:08.822 INFO:tasks.workunit.client.0.smithi033.stdout:8/669: truncate d0/df/db/d45/f75 3932067 0 2024-02-15T18:31:08.822 INFO:tasks.workunit.client.0.smithi033.stdout:4/741: dwrite d4/d5/f24 [0,4194304] 0 2024-02-15T18:31:08.822 INFO:tasks.workunit.client.0.smithi033.stdout:2/763: dwrite d20/d31/d47/d4c/f60 [0,4194304] 0 2024-02-15T18:31:08.824 INFO:tasks.workunit.client.0.smithi033.stdout:6/767: dread d8/d28/d14/f13 [0,4194304] 0 2024-02-15T18:31:08.828 INFO:tasks.workunit.client.0.smithi033.stdout:7/672: creat d0/dc/d10/d1d/d38/dd0/fe5 x:0 0 0 2024-02-15T18:31:08.828 INFO:tasks.workunit.client.0.smithi033.stdout:0/653: symlink d0/d8/d15/d7c/d9e/ldf 0 2024-02-15T18:31:08.828 INFO:tasks.workunit.client.0.smithi033.stdout:0/654: dread - d0/d8/d54/fa7 zero size 2024-02-15T18:31:08.828 INFO:tasks.workunit.client.0.smithi033.stdout:0/655: stat d0/d64/l28 0 2024-02-15T18:31:08.831 INFO:tasks.workunit.client.0.smithi033.stdout:4/742: dread d4/d20/f9a [0,4194304] 0 2024-02-15T18:31:08.831 INFO:tasks.workunit.client.0.smithi033.stdout:4/743: chown d4/d20/ce0 78581 1 2024-02-15T18:31:08.835 INFO:tasks.workunit.client.0.smithi033.stdout:4/744: read d4/f22 [778549,114166] 0 2024-02-15T18:31:08.842 INFO:tasks.workunit.client.0.smithi033.stdout:2/764: rename d20/d3a/d4a/d5e/d6b/d88/da6/cdc to d20/d31/c114 0 2024-02-15T18:31:08.843 INFO:tasks.workunit.client.0.smithi033.stdout:6/768: rmdir d8/d1d/d37/d4f/dbb/d55/d60 39 2024-02-15T18:31:08.843 INFO:tasks.workunit.client.0.smithi033.stdout:6/769: write d8/d28/d14/d2c/d31/ded/d5e/fb7 [1148480,64155] 0 2024-02-15T18:31:08.844 INFO:tasks.workunit.client.0.smithi033.stdout:7/673: link d0/dc/d10/d48/f6f d0/dc/d10/da1/fe6 0 2024-02-15T18:31:08.845 INFO:tasks.workunit.client.0.smithi033.stdout:9/586: mknod d4/d8/cc6 0 2024-02-15T18:31:08.847 INFO:tasks.workunit.client.0.smithi033.stdout:4/745: mkdir d4/d5/d28/d39/d62/db2/db5/df8 0 2024-02-15T18:31:08.849 INFO:tasks.workunit.client.0.smithi033.stdout:0/656: rename d0/d8/d15/d8b/da3/dae/d58/d80/db6 to d0/d8/d15/d2d/d3f/d97/db1/dca/de0 0 2024-02-15T18:31:08.849 INFO:tasks.workunit.client.0.smithi033.stdout:3/756: dwrite d2/d3/df/d6c/f91 [0,4194304] 0 2024-02-15T18:31:08.850 INFO:tasks.workunit.client.0.smithi033.stdout:7/674: mkdir d0/dc/d10/d1d/d38/d74/de7 0 2024-02-15T18:31:08.850 INFO:tasks.workunit.client.0.smithi033.stdout:7/675: stat d0/dc/d10/d1d/d38/d74/d7f/f88 0 2024-02-15T18:31:08.850 INFO:tasks.workunit.client.0.smithi033.stdout:7/676: write d0/dc/d10/d48/d4b/f9c [178525,5413] 0 2024-02-15T18:31:08.850 INFO:tasks.workunit.client.0.smithi033.stdout:7/677: stat d0/d56/d70/d83/laf 0 2024-02-15T18:31:08.852 INFO:tasks.workunit.client.0.smithi033.stdout:9/587: mkdir d4/d8/d1b/d61/dc7 0 2024-02-15T18:31:08.855 INFO:tasks.workunit.client.0.smithi033.stdout:2/765: rename d20/d31/d47/l54 to d20/d31/d47/d4c/def/l115 0 2024-02-15T18:31:08.855 INFO:tasks.workunit.client.0.smithi033.stdout:2/766: truncate d20/d31/d47/d82/fd3 5113217 0 2024-02-15T18:31:08.857 INFO:tasks.workunit.client.0.smithi033.stdout:2/767: write d20/d31/d6a/f41 [1558896,16293] 0 2024-02-15T18:31:08.862 INFO:tasks.workunit.client.0.smithi033.stdout:0/657: unlink d0/d64/d1d/l36 0 2024-02-15T18:31:08.862 INFO:tasks.workunit.client.0.smithi033.stdout:6/770: dwrite d8/d1d/d37/dbf/dd0/fe5 [0,4194304] 0 2024-02-15T18:31:08.868 INFO:tasks.workunit.client.0.smithi033.stdout:7/678: mknod d0/dc/d10/d1d/ce8 0 2024-02-15T18:31:08.868 INFO:tasks.workunit.client.0.smithi033.stdout:9/588: unlink d4/d8/dd/d41/d51/l7e 0 2024-02-15T18:31:08.868 INFO:tasks.workunit.client.0.smithi033.stdout:9/589: dread - d4/d8/dd/d41/fad zero size 2024-02-15T18:31:08.870 INFO:tasks.workunit.client.0.smithi033.stdout:2/768: creat d20/d31/d47/d4c/dc4/f116 x:0 0 0 2024-02-15T18:31:08.874 INFO:tasks.workunit.client.0.smithi033.stdout:4/746: dwrite d4/d5/d28/d39/d62/d9c/d9e/da4/fd6 [0,4194304] 0 2024-02-15T18:31:08.874 INFO:tasks.workunit.client.0.smithi033.stdout:4/747: fdatasync d4/d20/d13/d34/d82/fb6 0 2024-02-15T18:31:08.875 INFO:tasks.workunit.client.0.smithi033.stdout:0/658: mknod d0/d8/d15/d5b/ce1 0 2024-02-15T18:31:08.877 INFO:tasks.workunit.client.0.smithi033.stdout:0/659: mkdir d0/d8/d15/d8b/da3/dae/d58/de2 0 2024-02-15T18:31:08.878 INFO:tasks.workunit.client.0.smithi033.stdout:0/660: stat d0/d2/c19 0 2024-02-15T18:31:08.882 INFO:tasks.workunit.client.0.smithi033.stdout:4/748: dread d4/d5/d28/d39/d62/f98 [0,4194304] 0 2024-02-15T18:31:08.883 INFO:tasks.workunit.client.0.smithi033.stdout:3/757: dwrite d2/d14/d23/f43 [0,4194304] 0 2024-02-15T18:31:08.886 INFO:tasks.workunit.client.0.smithi033.stdout:9/590: dread d4/d8/dd/d41/f5d [0,4194304] 0 2024-02-15T18:31:08.887 INFO:tasks.workunit.client.0.smithi033.stdout:9/591: fdatasync d4/d32/fab 0 2024-02-15T18:31:08.887 INFO:tasks.workunit.client.0.smithi033.stdout:9/592: write d4/d8/dd/d5c/f85 [405829,84107] 0 2024-02-15T18:31:08.900 INFO:tasks.workunit.client.0.smithi033.stdout:6/771: dwrite d8/d28/f9c [0,4194304] 0 2024-02-15T18:31:08.904 INFO:tasks.workunit.client.0.smithi033.stdout:7/679: dwrite d0/dc/d10/d48/f51 [8388608,4194304] 0 2024-02-15T18:31:08.905 INFO:tasks.workunit.client.0.smithi033.stdout:3/758: dread d2/d14/f2b [0,4194304] 0 2024-02-15T18:31:08.905 INFO:tasks.workunit.client.0.smithi033.stdout:3/759: write d2/d3/d17/de6/fa2 [829518,39676] 0 2024-02-15T18:31:08.905 INFO:tasks.workunit.client.0.smithi033.stdout:7/680: symlink d0/dbe/le9 0 2024-02-15T18:31:08.906 INFO:tasks.workunit.client.0.smithi033.stdout:3/760: creat d2/d3/dcc/ff3 x:0 0 0 2024-02-15T18:31:08.906 INFO:tasks.workunit.client.0.smithi033.stdout:3/761: readlink d2/d3/d1e/lc8 0 2024-02-15T18:31:08.906 INFO:tasks.workunit.client.0.smithi033.stdout:7/681: rename d0/dc/d10/d48/c49 to d0/dc/d10/d48/cea 0 2024-02-15T18:31:08.908 INFO:tasks.workunit.client.0.smithi033.stdout:7/682: mknod d0/d56/d70/d83/ceb 0 2024-02-15T18:31:08.910 INFO:tasks.workunit.client.0.smithi033.stdout:3/762: write d2/d3/d1e/d22/d59/f5e [890005,93231] 0 2024-02-15T18:31:08.912 INFO:tasks.workunit.client.0.smithi033.stdout:0/661: dwrite d0/d8/d15/d2d/d2e/f65 [0,4194304] 0 2024-02-15T18:31:08.913 INFO:tasks.workunit.client.0.smithi033.stdout:3/763: rename d2/d14/d23/l48 to d2/d3/df/lf4 0 2024-02-15T18:31:08.913 INFO:tasks.workunit.client.0.smithi033.stdout:4/749: dwrite d4/d20/d13/f31 [0,4194304] 0 2024-02-15T18:31:08.915 INFO:tasks.workunit.client.0.smithi033.stdout:2/769: dwrite d20/d31/d47/d4c/f10b [0,4194304] 0 2024-02-15T18:31:08.915 INFO:tasks.workunit.client.0.smithi033.stdout:3/764: dread d2/d3/d17/de6/d73/d83/f97 [0,4194304] 0 2024-02-15T18:31:08.915 INFO:tasks.workunit.client.0.smithi033.stdout:3/765: chown d2/d3/d17/de6/d73/d76/c84 0 1 2024-02-15T18:31:08.915 INFO:tasks.workunit.client.0.smithi033.stdout:4/750: write d4/f15 [4513638,7908] 0 2024-02-15T18:31:08.916 INFO:tasks.workunit.client.0.smithi033.stdout:3/766: write d2/d14/f2b [1066836,32456] 0 2024-02-15T18:31:08.919 INFO:tasks.workunit.client.0.smithi033.stdout:9/593: rmdir d4/d8/dd/d41/d51 39 2024-02-15T18:31:08.919 INFO:tasks.workunit.client.0.smithi033.stdout:9/594: readlink d4/d8/dd/d28/l38 0 2024-02-15T18:31:08.921 INFO:tasks.workunit.client.0.smithi033.stdout:0/662: rename d0/d8/d15/d7c/l9d to d0/d8/d15/d8b/da3/dae/d58/d80/dc1/le3 0 2024-02-15T18:31:08.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.927+0000 7fa6a1549700 1 -- 172.21.15.33:0/2763890429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa69c0f74a0 msgr2=0x7fa69c0f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:08.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.927+0000 7fa6a1549700 1 --2- 172.21.15.33:0/2763890429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa69c0f74a0 0x7fa69c0f5930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa684004660 tx=0x7fa684009b30).stop 2024-02-15T18:31:08.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.927+0000 7fa6a1549700 1 -- 172.21.15.33:0/2763890429 shutdown_connections 2024-02-15T18:31:08.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.927+0000 7fa6a1549700 1 --2- 172.21.15.33:0/2763890429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa69c0f74a0 0x7fa69c0f5930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:08.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.927+0000 7fa6a1549700 1 --2- 172.21.15.33:0/2763890429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa69c0f6b90 0x7fa69c0f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:08.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.927+0000 7fa6a1549700 1 -- 172.21.15.33:0/2763890429 >> 172.21.15.33:0/2763890429 conn(0x7fa69c0f0540 msgr2=0x7fa69c0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:08.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.928+0000 7fa6a1549700 1 -- 172.21.15.33:0/2763890429 shutdown_connections 2024-02-15T18:31:08.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.928+0000 7fa6a1549700 1 -- 172.21.15.33:0/2763890429 wait complete. 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.928+0000 7fa6a1549700 1 Processor -- start 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.928+0000 7fa6a1549700 1 -- start start 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa6a1549700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa69c0f6b90 0x7fa69c107060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa6a1549700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa69c0f74a0 0x7fa69c107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa6a1549700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c107b90 con 0x7fa69c0f74a0 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa6a1549700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c108440 con 0x7fa69c0f6b90 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa693fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa69c0f74a0 0x7fa69c107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa693fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa69c0f74a0 0x7fa69c107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45124/0 (socket says 172.21.15.33:45124) 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa693fff700 1 -- 172.21.15.33:0/3971765946 learned_addr learned my addr 172.21.15.33:0/3971765946 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa69affd700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa69c0f6b90 0x7fa69c107060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa693fff700 1 -- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa69c0f6b90 msgr2=0x7fa69c107060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa693fff700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa69c0f6b90 0x7fa69c107060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:08.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa693fff700 1 -- 172.21.15.33:0/3971765946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684005040 con 0x7fa69c0f74a0 2024-02-15T18:31:08.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa69affd700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa69c0f6b90 0x7fa69c107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:31:08.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa693fff700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa69c0f74a0 0x7fa69c107550 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fa684009f50 tx=0x7fa684009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:08.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa6937fe700 1 -- 172.21.15.33:0/3971765946 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa684018070 con 0x7fa69c0f74a0 2024-02-15T18:31:08.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa6937fe700 1 -- 172.21.15.33:0/3971765946 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa684007d70 con 0x7fa69c0f74a0 2024-02-15T18:31:08.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69c1086c0 con 0x7fa69c0f74a0 2024-02-15T18:31:08.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa6937fe700 1 -- 172.21.15.33:0/3971765946 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa68401c620 con 0x7fa69c0f74a0 2024-02-15T18:31:08.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.929+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69c108ba0 con 0x7fa69c0f74a0 2024-02-15T18:31:08.925 INFO:tasks.workunit.client.0.smithi033.stdout:1/693: sync 2024-02-15T18:31:08.926 INFO:tasks.workunit.client.0.smithi033.stdout:5/775: sync 2024-02-15T18:31:08.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.931+0000 7fa6937fe700 1 -- 172.21.15.33:0/3971765946 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 74714+0+0 (secure 0 0 0) 0x7fa68401c8e0 con 0x7fa69c0f74a0 2024-02-15T18:31:08.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.931+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69c0f41d0 con 0x7fa69c0f74a0 2024-02-15T18:31:08.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.932+0000 7fa6937fe700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fa68805e9c0 0x7fa688060e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:08.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.932+0000 7fa6937fe700 1 -- 172.21.15.33:0/3971765946 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa68407b080 con 0x7fa69c0f74a0 2024-02-15T18:31:08.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.933+0000 7fa69affd700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fa68805e9c0 0x7fa688060e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:08.927 INFO:tasks.workunit.client.0.smithi033.stdout:7/683: dwrite d0/dc/f2a [4194304,4194304] 0 2024-02-15T18:31:08.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.935+0000 7fa69affd700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fa68805e9c0 0x7fa688060e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa69c05f250 tx=0x7fa68c008040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:08.930 INFO:tasks.workunit.client.0.smithi033.stdout:2/770: getdents d20/d31/d47/d82/de6/d106 0 2024-02-15T18:31:08.930 INFO:tasks.workunit.client.0.smithi033.stdout:2/771: dread - d20/d3a/d4a/d5e/d6b/fd0 zero size 2024-02-15T18:31:08.931 INFO:tasks.workunit.client.0.smithi033.stdout:4/751: stat d4/d20/d13/d1b/c6f 0 2024-02-15T18:31:08.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:08.938+0000 7fa6937fe700 1 -- 172.21.15.33:0/3971765946 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7fa68404ef40 con 0x7fa69c0f74a0 2024-02-15T18:31:08.932 INFO:tasks.workunit.client.0.smithi033.stdout:9/595: creat d4/d8/dd/d41/fc8 x:0 0 0 2024-02-15T18:31:08.932 INFO:tasks.workunit.client.0.smithi033.stdout:9/596: dread - d4/d8/d1b/d2f/d65/d8b/d95/fb3 zero size 2024-02-15T18:31:08.933 INFO:tasks.workunit.client.0.smithi033.stdout:0/663: rmdir d0/d8/d15/d2d/d41/d91 0 2024-02-15T18:31:08.934 INFO:tasks.workunit.client.0.smithi033.stdout:0/664: stat d0/d8/d15/fd2 0 2024-02-15T18:31:08.934 INFO:tasks.workunit.client.0.smithi033.stdout:1/694: mkdir d5/d9/d1e/d20/d2c/d34/d51/ddb 0 2024-02-15T18:31:08.935 INFO:tasks.workunit.client.0.smithi033.stdout:1/695: fsync d5/d9/d1e/d20/d5c/f39 0 2024-02-15T18:31:08.937 INFO:tasks.workunit.client.0.smithi033.stdout:7/684: creat d0/dc/d10/d1d/d38/d74/d7f/fec x:0 0 0 2024-02-15T18:31:08.937 INFO:tasks.workunit.client.0.smithi033.stdout:7/685: write d0/d56/d70/d83/fd1 [874829,32421] 0 2024-02-15T18:31:08.937 INFO:tasks.workunit.client.0.smithi033.stdout:2/772: dread d20/d31/d47/d4c/def/d80/f8a [0,4194304] 0 2024-02-15T18:31:08.937 INFO:tasks.workunit.client.0.smithi033.stdout:4/752: stat d4/d20/d13/dca 0 2024-02-15T18:31:08.943 INFO:tasks.workunit.client.0.smithi033.stdout:1/696: mknod d5/dd/d12/d49/cdc 0 2024-02-15T18:31:08.943 INFO:tasks.workunit.client.0.smithi033.stdout:1/697: stat d5/d9/d1e/d20/d2c/d34/d51/fbb 0 2024-02-15T18:31:08.943 INFO:tasks.workunit.client.0.smithi033.stdout:7/686: getdents d0/dc 0 2024-02-15T18:31:08.943 INFO:tasks.workunit.client.0.smithi033.stdout:7/687: chown d0/d56/d70/d91 32078 1 2024-02-15T18:31:08.944 INFO:tasks.workunit.client.0.smithi033.stdout:2/773: rmdir d20/d3a/d4a/d5e/d6b/d88/da6/ddb/ddf 39 2024-02-15T18:31:08.944 INFO:tasks.workunit.client.0.smithi033.stdout:4/753: truncate d4/d3c/f51 3056031 0 2024-02-15T18:31:08.944 INFO:tasks.workunit.client.0.smithi033.stdout:4/754: getdents d4/d20/df1 0 2024-02-15T18:31:08.944 INFO:tasks.workunit.client.0.smithi033.stdout:4/755: stat d4/d20/d13/d1b/c96 0 2024-02-15T18:31:08.944 INFO:tasks.workunit.client.0.smithi033.stdout:4/756: chown d4/d20/c10 32406 1 2024-02-15T18:31:08.944 INFO:tasks.workunit.client.0.smithi033.stdout:3/767: dwrite d2/d14/f42 [0,4194304] 0 2024-02-15T18:31:08.945 INFO:tasks.workunit.client.0.smithi033.stdout:1/698: creat d5/d9/d1e/d20/d2c/db2/fdd x:0 0 0 2024-02-15T18:31:08.945 INFO:tasks.workunit.client.0.smithi033.stdout:7/688: creat d0/dc/d10/d1d/d38/fed x:0 0 0 2024-02-15T18:31:08.951 INFO:tasks.workunit.client.0.smithi033.stdout:4/757: rmdir d4/d20/d13/d5c/d87/dd0/de5 39 2024-02-15T18:31:08.952 INFO:tasks.workunit.client.0.smithi033.stdout:4/758: readlink d4/d20/d13/d5c/d87/dd0/de5/lf4 0 2024-02-15T18:31:08.952 INFO:tasks.workunit.client.0.smithi033.stdout:5/776: dwrite d1/da/f41 [4194304,4194304] 0 2024-02-15T18:31:08.952 INFO:tasks.workunit.client.0.smithi033.stdout:5/777: readlink d1/da/d10/d2b/d42/lce 0 2024-02-15T18:31:08.952 INFO:tasks.workunit.client.0.smithi033.stdout:5/778: write d1/da/d11/d5e/db1/d63/d61/da3/fb0 [715613,124765] 0 2024-02-15T18:31:08.960 INFO:tasks.workunit.client.0.smithi033.stdout:1/699: creat d5/d9/d1e/d20/d2c/d34/d51/ddb/fde x:0 0 0 2024-02-15T18:31:08.960 INFO:tasks.workunit.client.0.smithi033.stdout:7/689: creat d0/d56/d8e/fee x:0 0 0 2024-02-15T18:31:08.960 INFO:tasks.workunit.client.0.smithi033.stdout:4/759: creat d4/d20/d13/dca/ff9 x:0 0 0 2024-02-15T18:31:08.960 INFO:tasks.workunit.client.0.smithi033.stdout:4/760: chown d4/d20/d53/c75 7 1 2024-02-15T18:31:08.966 INFO:tasks.workunit.client.0.smithi033.stdout:5/779: rename d1/da/d52/dd8/lf1 to d1/lf8 0 2024-02-15T18:31:08.966 INFO:tasks.workunit.client.0.smithi033.stdout:7/690: mkdir d0/dc/d10/d1d/d38/d82/def 0 2024-02-15T18:31:08.966 INFO:tasks.workunit.client.0.smithi033.stdout:7/691: chown d0/d56/d70/d91/ca5 1 1 2024-02-15T18:31:08.968 INFO:tasks.workunit.client.0.smithi033.stdout:0/665: dread d0/d64/d88/f8a [0,4194304] 0 2024-02-15T18:31:08.968 INFO:tasks.workunit.client.0.smithi033.stdout:9/597: dwrite d4/d2c/db1/fc0 [0,4194304] 0 2024-02-15T18:31:08.968 INFO:tasks.workunit.client.0.smithi033.stdout:5/780: rename d1/da/d10/f75 to d1/da/d52/ff9 0 2024-02-15T18:31:08.972 INFO:tasks.workunit.client.0.smithi033.stdout:7/692: rename d0/dc/f31 to d0/dc/d10/d1d/d38/ff0 0 2024-02-15T18:31:08.976 INFO:tasks.workunit.client.0.smithi033.stdout:0/666: write d0/d64/f7b [3452887,39633] 0 2024-02-15T18:31:08.977 INFO:tasks.workunit.client.0.smithi033.stdout:3/768: dwrite d2/d14/d23/d6f/fe0 [0,4194304] 0 2024-02-15T18:31:08.977 INFO:tasks.workunit.client.0.smithi033.stdout:5/781: rename d1/da/d11/ded to d1/da/d11/d5e/db1/dfa 0 2024-02-15T18:31:08.977 INFO:tasks.workunit.client.0.smithi033.stdout:3/769: creat d2/d3/d1e/d22/ff5 x:0 0 0 2024-02-15T18:31:08.979 INFO:tasks.workunit.client.0.smithi033.stdout:5/782: dread d1/da/d10/d2b/d42/d71/fd6 [0,4194304] 0 2024-02-15T18:31:08.980 INFO:tasks.workunit.client.0.smithi033.stdout:1/700: dwrite d5/fa0 [0,4194304] 0 2024-02-15T18:31:08.983 INFO:tasks.workunit.client.0.smithi033.stdout:2/774: dwrite d20/d31/d6a/f2e [0,4194304] 0 2024-02-15T18:31:08.983 INFO:tasks.workunit.client.0.smithi033.stdout:2/775: stat d20/f4b 0 2024-02-15T18:31:08.984 INFO:tasks.workunit.client.0.smithi033.stdout:7/693: rename d0/dc/l7c to d0/dc/d10/d7d/d99/lf1 0 2024-02-15T18:31:08.984 INFO:tasks.workunit.client.0.smithi033.stdout:3/770: creat d2/d3/d17/de6/d88/dd1/ff6 x:0 0 0 2024-02-15T18:31:08.984 INFO:tasks.workunit.client.0.smithi033.stdout:3/771: fdatasync d2/d14/d23/f28 0 2024-02-15T18:31:08.986 INFO:tasks.workunit.client.0.smithi033.stdout:1/701: stat d5/d9/c13 0 2024-02-15T18:31:08.987 INFO:tasks.workunit.client.0.smithi033.stdout:2/776: creat d20/d73/f117 x:0 0 0 2024-02-15T18:31:08.988 INFO:tasks.workunit.client.0.smithi033.stdout:7/694: creat d0/dc/d10/d7d/ff2 x:0 0 0 2024-02-15T18:31:08.989 INFO:tasks.workunit.client.0.smithi033.stdout:3/772: unlink d2/d14/d23/d5c/d62/lf0 0 2024-02-15T18:31:08.989 INFO:tasks.workunit.client.0.smithi033.stdout:1/702: mknod d5/dd/d12/cdf 0 2024-02-15T18:31:08.990 INFO:tasks.workunit.client.0.smithi033.stdout:1/703: chown d5/dd/d12/d49/f1d 403302 1 2024-02-15T18:31:08.991 INFO:tasks.workunit.client.0.smithi033.stdout:2/777: symlink d20/d31/d47/d82/de6/l118 0 2024-02-15T18:31:08.993 INFO:tasks.workunit.client.0.smithi033.stdout:1/704: read d5/d96/fcc [2387238,45658] 0 2024-02-15T18:31:08.993 INFO:tasks.workunit.client.0.smithi033.stdout:7/695: rename d0/f1b to d0/dc/d10/d7d/d99/ff3 0 2024-02-15T18:31:08.996 INFO:tasks.workunit.client.0.smithi033.stdout:7/696: rename d0/dc/d10/d1d/f34 to d0/dc/d10/d7d/d93/dc2/ff4 0 2024-02-15T18:31:08.996 INFO:tasks.workunit.client.0.smithi033.stdout:7/697: write d0/dc/d10/d1d/d2b/d5f/d63/fd5 [507819,2454] 0 2024-02-15T18:31:08.996 INFO:tasks.workunit.client.0.smithi033.stdout:7/698: fdatasync d0/dc/d10/d7d/f50 0 2024-02-15T18:31:08.996 INFO:tasks.workunit.client.0.smithi033.stdout:7/699: truncate d0/d56/d70/d83/fd1 1229218 0 2024-02-15T18:31:08.998 INFO:tasks.workunit.client.0.smithi033.stdout:7/700: mkdir d0/dc/d10/d1d/d2b/d5f/d63/df5 0 2024-02-15T18:31:08.998 INFO:tasks.workunit.client.0.smithi033.stdout:7/701: truncate d0/dc/d10/d7d/d99/fab 486781 0 2024-02-15T18:31:09.000 INFO:tasks.workunit.client.0.smithi033.stdout:4/761: dwrite d4/d20/d13/f94 [4194304,4194304] 0 2024-02-15T18:31:09.000 INFO:tasks.workunit.client.0.smithi033.stdout:4/762: chown d4/d5/c3f 25698633 1 2024-02-15T18:31:09.001 INFO:tasks.workunit.client.0.smithi033.stdout:9/598: dwrite d4/d8/dd/d5c/fa1 [0,4194304] 0 2024-02-15T18:31:09.002 INFO:tasks.workunit.client.0.smithi033.stdout:5/783: fdatasync d1/da/d11/d5e/db1/d63/d61/da3/fb0 0 2024-02-15T18:31:09.005 INFO:tasks.workunit.client.0.smithi033.stdout:0/667: dwrite d0/d8/d15/d8b/da3/dae/d58/d77/fd0 [0,4194304] 0 2024-02-15T18:31:09.006 INFO:tasks.workunit.client.0.smithi033.stdout:9/599: getdents d4/d8/dd/d28/d6b 0 2024-02-15T18:31:09.010 INFO:tasks.workunit.client.0.smithi033.stdout:3/773: dread d2/d14/fae [0,4194304] 0 2024-02-15T18:31:09.014 INFO:tasks.workunit.client.0.smithi033.stdout:0/668: write d0/d64/f7b [2507903,119603] 0 2024-02-15T18:31:09.017 INFO:tasks.workunit.client.0.smithi033.stdout:3/774: dread d2/d3/d1e/d22/d4d/f7b [0,4194304] 0 2024-02-15T18:31:09.024 INFO:tasks.workunit.client.0.smithi033.stdout:2/778: dwrite d20/d31/d6a/f81 [4194304,4194304] 0 2024-02-15T18:31:09.026 INFO:tasks.workunit.client.0.smithi033.stdout:2/779: link d20/f77 d20/d31/d6a/f119 0 2024-02-15T18:31:09.026 INFO:tasks.workunit.client.0.smithi033.stdout:2/780: write d20/d31/d47/d4c/f10b [4462923,16882] 0 2024-02-15T18:31:09.049 INFO:tasks.workunit.client.0.smithi033.stdout:1/705: dwrite d5/d9/d1e/d20/d2c/d34/dc0/fcf [4194304,4194304] 0 2024-02-15T18:31:09.050 INFO:tasks.workunit.client.0.smithi033.stdout:3/775: dread d2/d14/d23/d5c/d61/fd3 [0,4194304] 0 2024-02-15T18:31:09.050 INFO:tasks.workunit.client.0.smithi033.stdout:3/776: chown d2/d14/d23/d5c/d62/c64 1897 1 2024-02-15T18:31:09.050 INFO:tasks.workunit.client.0.smithi033.stdout:3/777: readlink d2/d14/d23/l38 0 2024-02-15T18:31:09.051 INFO:tasks.workunit.client.0.smithi033.stdout:7/702: dwrite d0/dc/f65 [0,4194304] 0 2024-02-15T18:31:09.051 INFO:tasks.workunit.client.0.smithi033.stdout:1/706: creat d5/dd/d12/dc6/dd4/fe0 x:0 0 0 2024-02-15T18:31:09.053 INFO:tasks.workunit.client.0.smithi033.stdout:3/778: creat d2/d3/d1e/d22/d4d/dcb/ff7 x:0 0 0 2024-02-15T18:31:09.056 INFO:tasks.workunit.client.0.smithi033.stdout:7/703: getdents d0/dc/d10/da1 0 2024-02-15T18:31:09.057 INFO:tasks.workunit.client.0.smithi033.stdout:9/600: dwrite d4/d8/dd/d28/d6b/fa7 [4194304,4194304] 0 2024-02-15T18:31:09.058 INFO:tasks.workunit.client.0.smithi033.stdout:9/601: read - d4/d2c/db1/fbd zero size 2024-02-15T18:31:09.058 INFO:tasks.workunit.client.0.smithi033.stdout:4/763: dwrite d4/d20/d13/d34/d82/fb6 [0,4194304] 0 2024-02-15T18:31:09.058 INFO:tasks.workunit.client.0.smithi033.stdout:1/707: creat d5/dd/d12/d49/fe1 x:0 0 0 2024-02-15T18:31:09.060 INFO:tasks.workunit.client.0.smithi033.stdout:5/784: dwrite d1/da/d11/d5e/db1/fc2 [0,4194304] 0 2024-02-15T18:31:09.061 INFO:tasks.workunit.client.0.smithi033.stdout:5/785: truncate d1/da/d19/d3f/d68/f96 500689 0 2024-02-15T18:31:09.061 INFO:tasks.workunit.client.0.smithi033.stdout:2/781: dwrite d20/d31/dc8/fe3 [8388608,4194304] 0 2024-02-15T18:31:09.061 INFO:tasks.workunit.client.0.smithi033.stdout:2/782: chown d20/d3a/d4a/d5e/d6b/c6f 0 1 2024-02-15T18:31:09.061 INFO:tasks.workunit.client.0.smithi033.stdout:2/783: fdatasync f5 0 2024-02-15T18:31:09.063 INFO:tasks.workunit.client.0.smithi033.stdout:2/784: write d20/d3a/d4a/f74 [1647602,58601] 0 2024-02-15T18:31:09.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/764: mkdir d4/d5/d28/d39/d62/dfa 0 2024-02-15T18:31:09.064 INFO:tasks.workunit.client.0.smithi033.stdout:4/765: chown d4/d3c/f51 64065313 1 2024-02-15T18:31:09.067 INFO:tasks.workunit.client.0.smithi033.stdout:5/786: creat d1/ffb x:0 0 0 2024-02-15T18:31:09.067 INFO:tasks.workunit.client.0.smithi033.stdout:5/787: truncate d1/da/d11/f7c 2303850 0 2024-02-15T18:31:09.076 INFO:tasks.workunit.client.0.smithi033.stdout:5/788: write d1/da/d19/d3f/d68/fde [546879,104906] 0 2024-02-15T18:31:09.076 INFO:tasks.workunit.client.0.smithi033.stdout:5/789: write d1/da/d88/fee [50392,78204] 0 2024-02-15T18:31:09.077 INFO:tasks.workunit.client.0.smithi033.stdout:2/785: creat d20/de1/f11a x:0 0 0 2024-02-15T18:31:09.077 INFO:tasks.workunit.client.0.smithi033.stdout:2/786: chown d20/d31/d47/d64/f86 330043 1 2024-02-15T18:31:09.077 INFO:tasks.workunit.client.0.smithi033.stdout:2/787: chown d20/d31/c114 400589133 1 2024-02-15T18:31:09.077 INFO:tasks.workunit.client.0.smithi033.stdout:2/788: chown d20/d39/c59 545 1 2024-02-15T18:31:09.078 INFO:tasks.workunit.client.0.smithi033.stdout:2/789: write d20/d31/d47/fcd [1437290,13116] 0 2024-02-15T18:31:09.078 INFO:tasks.workunit.client.0.smithi033.stdout:5/790: mknod d1/da/d10/d2b/d42/cfc 0 2024-02-15T18:31:09.079 INFO:tasks.workunit.client.0.smithi033.stdout:4/766: mknod d4/d20/d13/d1b/cfb 0 2024-02-15T18:31:09.080 INFO:tasks.workunit.client.0.smithi033.stdout:5/791: mkdir d1/da/d52/dd8/d40/d9a/dfd 0 2024-02-15T18:31:09.082 INFO:tasks.workunit.client.0.smithi033.stdout:4/767: link d4/d20/d13/d5c/d87/la8 d4/d20/d13/d1b/d7c/d91/dbe/lfc 0 2024-02-15T18:31:09.083 INFO:tasks.workunit.client.0.smithi033.stdout:2/790: write d20/d3a/d4a/d5e/f66 [1444125,98992] 0 2024-02-15T18:31:09.083 INFO:tasks.workunit.client.0.smithi033.stdout:5/792: link d1/da/d19/f22 d1/da/d52/dd8/de7/ffe 0 2024-02-15T18:31:09.084 INFO:tasks.workunit.client.0.smithi033.stdout:5/793: creat d1/da/d52/dd8/d40/d9a/dfd/fff x:0 0 0 2024-02-15T18:31:09.086 INFO:tasks.workunit.client.0.smithi033.stdout:5/794: rename d1/da/d19/d3f/l43 to d1/da/d19/d74/l100 0 2024-02-15T18:31:09.088 INFO:tasks.workunit.client.0.smithi033.stdout:5/795: link d1/da/d19/d3f/d68/fde d1/da/d52/dd8/d40/d9a/f101 0 2024-02-15T18:31:09.089 INFO:tasks.workunit.client.0.smithi033.stdout:5/796: mknod d1/da/d52/dd8/dd2/c102 0 2024-02-15T18:31:09.089 INFO:tasks.workunit.client.0.smithi033.stdout:5/797: chown d1/da/d11/d5e/db1/d63/d61/c98 19 1 2024-02-15T18:31:09.090 INFO:tasks.workunit.client.0.smithi033.stdout:1/708: dread d5/d17/f35 [0,4194304] 0 2024-02-15T18:31:09.090 INFO:tasks.workunit.client.0.smithi033.stdout:1/709: write d5/dd/d12/d49/d23/f4d [1038425,118373] 0 2024-02-15T18:31:09.090 INFO:tasks.workunit.client.0.smithi033.stdout:5/798: mknod d1/da/d10/d2b/d42/d71/c103 0 2024-02-15T18:31:09.091 INFO:tasks.workunit.client.0.smithi033.stdout:3/779: dwrite d2/d3/d17/f69 [0,4194304] 0 2024-02-15T18:31:09.092 INFO:tasks.workunit.client.0.smithi033.stdout:1/710: creat d5/dd/d12/d49/d23/fe2 x:0 0 0 2024-02-15T18:31:09.092 INFO:tasks.workunit.client.0.smithi033.stdout:2/791: dread f19 [0,4194304] 0 2024-02-15T18:31:09.094 INFO:tasks.workunit.client.0.smithi033.stdout:3/780: creat d2/d3/d17/de6/d73/d83/ff8 x:0 0 0 2024-02-15T18:31:09.094 INFO:tasks.workunit.client.0.smithi033.stdout:3/781: read - d2/d3/d17/de6/d73/fe4 zero size 2024-02-15T18:31:09.095 INFO:tasks.workunit.client.0.smithi033.stdout:2/792: mknod d20/d31/dc8/c11b 0 2024-02-15T18:31:09.095 INFO:tasks.workunit.client.0.smithi033.stdout:2/793: chown d20/d73/lcc 0 1 2024-02-15T18:31:09.100 INFO:tasks.workunit.client.0.smithi033.stdout:9/602: dwrite d4/d8/dd/d5c/f9b [0,4194304] 0 2024-02-15T18:31:09.100 INFO:tasks.workunit.client.0.smithi033.stdout:7/704: dwrite d0/dc/d10/d1d/d2b/f4a [4194304,4194304] 0 2024-02-15T18:31:09.100 INFO:tasks.workunit.client.0.smithi033.stdout:7/705: chown d0/dc/d10/d1d/d2b/d5f/d63/df5 327 1 2024-02-15T18:31:09.100 INFO:tasks.workunit.client.0.smithi033.stdout:3/782: unlink d2/f5 0 2024-02-15T18:31:09.101 INFO:tasks.workunit.client.0.smithi033.stdout:1/711: read d5/dd/d12/d49/f21 [3185419,118270] 0 2024-02-15T18:31:09.104 INFO:tasks.workunit.client.0.smithi033.stdout:3/783: read d2/d3/d1e/d22/d4d/f6b [3980479,65347] 0 2024-02-15T18:31:09.108 INFO:tasks.workunit.client.0.smithi033.stdout:7/706: mknod d0/dc/d10/d1d/d2b/cf6 0 2024-02-15T18:31:09.109 INFO:tasks.workunit.client.0.smithi033.stdout:1/712: write d5/d17/fa6 [1023245,10112] 0 2024-02-15T18:31:09.110 INFO:tasks.workunit.client.0.smithi033.stdout:7/707: rmdir d0/dc/d10/d1d/d38/d74/d7f/da2 39 2024-02-15T18:31:09.110 INFO:tasks.workunit.client.0.smithi033.stdout:7/708: truncate d0/dc/d10/d48/d4b/fa9 199050 0 2024-02-15T18:31:09.110 INFO:tasks.workunit.client.0.smithi033.stdout:7/709: fsync d0/f8c 0 2024-02-15T18:31:09.111 INFO:tasks.workunit.client.0.smithi033.stdout:1/713: creat d5/dd/d12/fe3 x:0 0 0 2024-02-15T18:31:09.111 INFO:tasks.workunit.client.0.smithi033.stdout:9/603: dread d4/d32/f3b [0,4194304] 0 2024-02-15T18:31:09.112 INFO:tasks.workunit.client.0.smithi033.stdout:7/710: write d0/f1 [3270150,34959] 0 2024-02-15T18:31:09.113 INFO:tasks.workunit.client.0.smithi033.stdout:4/768: dwrite d4/d5/d28/d39/d62/d9c/d9e/da4/ddb/fde [0,4194304] 0 2024-02-15T18:31:09.114 INFO:tasks.workunit.client.0.smithi033.stdout:9/604: truncate d4/d32/f54 2971305 0 2024-02-15T18:31:09.116 INFO:tasks.workunit.client.0.smithi033.stdout:5/799: dwrite d1/da/d19/d3f/fa9 [0,4194304] 0 2024-02-15T18:31:09.116 INFO:tasks.workunit.client.0.smithi033.stdout:5/800: truncate d1/da/d11/f8f 1537864 0 2024-02-15T18:31:09.116 INFO:tasks.workunit.client.0.smithi033.stdout:5/801: chown d1/da/d11/d5e/db1/d63/fd4 39 1 2024-02-15T18:31:09.118 INFO:tasks.workunit.client.0.smithi033.stdout:5/802: mknod d1/da/d11/d5e/db1/d63/d61/da3/dbe/ddf/c104 0 2024-02-15T18:31:09.118 INFO:tasks.workunit.client.0.smithi033.stdout:9/605: symlink d4/d8/dd/d41/d51/lc9 0 2024-02-15T18:31:09.127 INFO:tasks.workunit.client.0.smithi033.stdout:7/711: dread d0/f1 [4194304,4194304] 0 2024-02-15T18:31:09.128 INFO:tasks.workunit.client.0.smithi033.stdout:7/712: read d0/dc/d10/d1d/d38/d82/f8d [2915479,59818] 0 2024-02-15T18:31:09.128 INFO:tasks.workunit.client.0.smithi033.stdout:5/803: mknod d1/da/d11/d5e/db1/c105 0 2024-02-15T18:31:09.133 INFO:tasks.workunit.client.0.smithi033.stdout:7/713: rename d0/d56/l6c to d0/dc/d10/lf7 0 2024-02-15T18:31:09.133 INFO:tasks.workunit.client.0.smithi033.stdout:7/714: write d0/dc/d10/d1d/fa7 [846744,23385] 0 2024-02-15T18:31:09.134 INFO:tasks.workunit.client.0.smithi033.stdout:7/715: read d0/dc/d10/d7d/d99/fb2 [184555,19633] 0 2024-02-15T18:31:09.136 INFO:tasks.workunit.client.0.smithi033.stdout:5/804: creat d1/da/d52/dd8/de7/f106 x:0 0 0 2024-02-15T18:31:09.137 INFO:tasks.workunit.client.0.smithi033.stdout:9/606: symlink d4/d8/lca 0 2024-02-15T18:31:09.137 INFO:tasks.workunit.client.0.smithi033.stdout:9/607: stat d4/d8/dd/d28/f8f 0 2024-02-15T18:31:09.139 INFO:tasks.workunit.client.0.smithi033.stdout:3/784: dwrite d2/d14/d23/d5c/d7f/ff1 [0,4194304] 0 2024-02-15T18:31:09.140 INFO:tasks.workunit.client.0.smithi033.stdout:7/716: link d0/dc/cc7 d0/dc/d10/d1d/d2b/d5f/cf8 0 2024-02-15T18:31:09.140 INFO:tasks.workunit.client.0.smithi033.stdout:5/805: mkdir d1/da/d11/d5e/db1/d63/d61/da3/dbe/d107 0 2024-02-15T18:31:09.141 INFO:tasks.workunit.client.0.smithi033.stdout:5/806: write d1/da/d52/fc6 [4371889,107757] 0 2024-02-15T18:31:09.141 INFO:tasks.workunit.client.0.smithi033.stdout:1/714: dwrite d5/dd/d12/f1b [0,4194304] 0 2024-02-15T18:31:09.142 INFO:tasks.workunit.client.0.smithi033.stdout:1/715: readlink d5/d9/d1e/d20/d2c/d34/lc2 0 2024-02-15T18:31:09.142 INFO:tasks.workunit.client.0.smithi033.stdout:3/785: rmdir d2/d14/d23/d5c/d61 39 2024-02-15T18:31:09.143 INFO:tasks.workunit.client.0.smithi033.stdout:4/769: dwrite d4/d20/d13/d1b/da7/fdd [0,4194304] 0 2024-02-15T18:31:09.144 INFO:tasks.workunit.client.0.smithi033.stdout:3/786: write d2/d14/d23/d5c/d7f/fa6 [3640331,60859] 0 2024-02-15T18:31:09.150 INFO:tasks.workunit.client.0.smithi033.stdout:5/807: link d1/da/d11/c6a d1/da/d19/d3f/d68/df2/c108 0 2024-02-15T18:31:09.150 INFO:tasks.workunit.client.0.smithi033.stdout:5/808: stat d1/da/d19/fba 0 2024-02-15T18:31:09.150 INFO:tasks.workunit.client.0.smithi033.stdout:5/809: chown d1/da/d11/d5e/db1/d63/d61/da3/fb0 79148699 1 2024-02-15T18:31:09.150 INFO:tasks.workunit.client.0.smithi033.stdout:5/810: fsync d1/da/d52/dd8/d40/d9a/fef 0 2024-02-15T18:31:09.151 INFO:tasks.workunit.client.0.smithi033.stdout:7/717: dread d0/f6a [0,4194304] 0 2024-02-15T18:31:09.151 INFO:tasks.workunit.client.0.smithi033.stdout:1/716: unlink d5/d9/d1e/d20/d5c/f39 0 2024-02-15T18:31:09.151 INFO:tasks.workunit.client.0.smithi033.stdout:1/717: chown d5/d9/d1e/d20/d2c/d34/d51/fa8 40 1 2024-02-15T18:31:09.155 INFO:tasks.workunit.client.0.smithi033.stdout:4/770: mkdir d4/d20/d13/d1b/d7c/d91/dbe/dfd 0 2024-02-15T18:31:09.158 INFO:tasks.workunit.client.0.smithi033.stdout:5/811: rename d1/ffb to d1/da/d52/dd8/d40/d9a/f109 0 2024-02-15T18:31:09.163 INFO:tasks.workunit.client.0.smithi033.stdout:1/718: rmdir d5/d9 39 2024-02-15T18:31:09.163 INFO:tasks.workunit.client.0.smithi033.stdout:1/719: write d5/dd/d12/d49/f90 [332755,45888] 0 2024-02-15T18:31:09.165 INFO:tasks.workunit.client.0.smithi033.stdout:4/771: link d4/d5/d28/d39/d62/d9c/d9e/da4/fdf d4/d20/d13/d1b/d81/ffe 0 2024-02-15T18:31:09.166 INFO:tasks.workunit.client.0.smithi033.stdout:1/720: creat d5/dd/d12/fe4 x:0 0 0 2024-02-15T18:31:09.167 INFO:tasks.workunit.client.0.smithi033.stdout:4/772: mknod d4/d5/d28/d39/cff 0 2024-02-15T18:31:09.169 INFO:tasks.workunit.client.0.smithi033.stdout:8/670: sync 2024-02-15T18:31:09.170 INFO:tasks.workunit.client.0.smithi033.stdout:5/812: rename d1/da/d19/d74/f82 to d1/da/d52/f10a 0 2024-02-15T18:31:09.170 INFO:tasks.workunit.client.0.smithi033.stdout:5/813: truncate d1/da/d11/d5e/db1/feb 188837 0 2024-02-15T18:31:09.170 INFO:tasks.workunit.client.0.smithi033.stdout:1/721: rmdir d5 39 2024-02-15T18:31:09.171 INFO:tasks.workunit.client.0.smithi033.stdout:8/671: write d0/f94 [11703267,4666] 0 2024-02-15T18:31:09.172 INFO:tasks.workunit.client.0.smithi033.stdout:5/814: mknod d1/da/d52/dd8/de7/c10b 0 2024-02-15T18:31:09.172 INFO:tasks.workunit.client.0.smithi033.stdout:1/722: creat d5/dcb/fe5 x:0 0 0 2024-02-15T18:31:09.173 INFO:tasks.workunit.client.0.smithi033.stdout:5/815: write d1/da/d11/d5e/db1/f7b [529019,27128] 0 2024-02-15T18:31:09.173 INFO:tasks.workunit.client.0.smithi033.stdout:5/816: stat d1/da/d19/f3e 0 2024-02-15T18:31:09.175 INFO:tasks.workunit.client.0.smithi033.stdout:8/672: unlink d0/df/d53/db3/d30/d8e/d35/fa9 0 2024-02-15T18:31:09.175 INFO:tasks.workunit.client.0.smithi033.stdout:8/673: truncate d0/df/db/f40 4931316 0 2024-02-15T18:31:09.176 INFO:tasks.workunit.client.0.smithi033.stdout:1/723: rename d5/d9/d1e/d20/d2c/d34/cac to d5/dd/d12/ce6 0 2024-02-15T18:31:09.176 INFO:tasks.workunit.client.0.smithi033.stdout:1/724: stat d5/dd/d12/d49/c62 0 2024-02-15T18:31:09.177 INFO:tasks.workunit.client.0.smithi033.stdout:5/817: mknod d1/da/d19/d3f/d68/df2/c10c 0 2024-02-15T18:31:09.177 INFO:tasks.workunit.client.0.smithi033.stdout:5/818: fsync d1/da/d52/dd8/d40/f58 0 2024-02-15T18:31:09.178 INFO:tasks.workunit.client.0.smithi033.stdout:8/674: creat d0/df/d53/db3/d30/d8e/d14/d56/d59/fdd x:0 0 0 2024-02-15T18:31:09.178 INFO:tasks.workunit.client.0.smithi033.stdout:8/675: fsync d0/df/d53/db3/d30/d8e/fb2 0 2024-02-15T18:31:09.180 INFO:tasks.workunit.client.0.smithi033.stdout:7/718: dread d0/f1c [0,4194304] 0 2024-02-15T18:31:09.181 INFO:tasks.workunit.client.0.smithi033.stdout:1/725: getdents d5/d9/d1e/d20/d2c/d34/d51/d63/d76 0 2024-02-15T18:31:09.181 INFO:tasks.workunit.client.0.smithi033.stdout:8/676: creat d0/df/db/fde x:0 0 0 2024-02-15T18:31:09.183 INFO:tasks.workunit.client.0.smithi033.stdout:1/726: write d5/d9/d1e/d20/d5c/d57/d59/f7b [506899,95577] 0 2024-02-15T18:31:09.183 INFO:tasks.workunit.client.0.smithi033.stdout:7/719: mknod d0/dc/d10/d1d/d38/cf9 0 2024-02-15T18:31:09.184 INFO:tasks.workunit.client.0.smithi033.stdout:4/773: dwrite d4/d20/f3a [0,4194304] 0 2024-02-15T18:31:09.185 INFO:tasks.workunit.client.0.smithi033.stdout:7/720: mkdir d0/dc/d10/d1d/d38/d74/de7/dfa 0 2024-02-15T18:31:09.188 INFO:tasks.workunit.client.0.smithi033.stdout:4/774: creat d4/d20/d13/d1b/d7c/d91/dbe/f100 x:0 0 0 2024-02-15T18:31:09.190 INFO:tasks.workunit.client.0.smithi033.stdout:4/775: creat d4/d20/d13/d1b/d7c/d91/dbe/f101 x:0 0 0 2024-02-15T18:31:09.191 INFO:tasks.workunit.client.0.smithi033.stdout:1/727: read d5/dd/d12/d49/d23/f26 [3980417,56496] 0 2024-02-15T18:31:09.191 INFO:tasks.workunit.client.0.smithi033.stdout:1/728: fsync d5/d9/d1e/d20/d5c/d57/d82/fb1 0 2024-02-15T18:31:09.192 INFO:tasks.workunit.client.0.smithi033.stdout:4/776: rename d4/d20/d13/d1b/d81/d8b/ca9 to d4/d5/d28/d39/d62/c102 0 2024-02-15T18:31:09.193 INFO:tasks.workunit.client.0.smithi033.stdout:1/729: symlink d5/d9/d1e/d20/d2c/d34/d51/le7 0 2024-02-15T18:31:09.193 INFO:tasks.workunit.client.0.smithi033.stdout:1/730: stat d5/d9/d1e/d20/d5c/d57/d82/fb5 0 2024-02-15T18:31:09.194 INFO:tasks.workunit.client.0.smithi033.stdout:4/777: mknod d4/d20/d13/d5c/d87/c103 0 2024-02-15T18:31:09.195 INFO:tasks.workunit.client.0.smithi033.stdout:4/778: rmdir d4/d20/d13/d5c/d87/dd0 39 2024-02-15T18:31:09.195 INFO:tasks.workunit.client.0.smithi033.stdout:4/779: write d4/d20/d13/d1b/d7c/fc1 [216080,84105] 0 2024-02-15T18:31:09.196 INFO:tasks.workunit.client.0.smithi033.stdout:4/780: creat d4/d3c/f104 x:0 0 0 2024-02-15T18:31:09.199 INFO:tasks.workunit.client.0.smithi033.stdout:5/819: dwrite d1/f4 [0,4194304] 0 2024-02-15T18:31:09.199 INFO:tasks.workunit.client.0.smithi033.stdout:5/820: fdatasync d1/da/d10/f26 0 2024-02-15T18:31:09.202 INFO:tasks.workunit.client.0.smithi033.stdout:4/781: read d4/d5/d28/d39/d62/f98 [63547,27854] 0 2024-02-15T18:31:09.202 INFO:tasks.workunit.client.0.smithi033.stdout:4/782: fdatasync d4/d5/d28/d39/d62/d9c/d9e/dcd/fe3 0 2024-02-15T18:31:09.202 INFO:tasks.workunit.client.0.smithi033.stdout:4/783: stat d4/d20/d37 0 2024-02-15T18:31:09.209 INFO:tasks.workunit.client.0.smithi033.stdout:8/677: dwrite d0/df/fc5 [0,4194304] 0 2024-02-15T18:31:09.209 INFO:tasks.workunit.client.0.smithi033.stdout:7/721: dwrite d0/dc/d10/d48/f51 [12582912,4194304] 0 2024-02-15T18:31:09.209 INFO:tasks.workunit.client.0.smithi033.stdout:7/722: readlink d0/dc/d10/d1d/d2b/d5f/d63/l75 0 2024-02-15T18:31:09.210 INFO:tasks.workunit.client.0.smithi033.stdout:4/784: rename d4/d20/d13/f31 to d4/d20/d13/d5c/d87/f105 0 2024-02-15T18:31:09.210 INFO:tasks.workunit.client.0.smithi033.stdout:5/821: link d1/da/d10/d2b/d42/d4c/fd3 d1/da/d11/d5e/db1/f10d 0 2024-02-15T18:31:09.212 INFO:tasks.workunit.client.0.smithi033.stdout:8/678: getdents d0/df/d53/d9b 0 2024-02-15T18:31:09.213 INFO:tasks.workunit.client.0.smithi033.stdout:8/679: read d0/df/d53/db3/d30/f74 [1011687,76782] 0 2024-02-15T18:31:09.213 INFO:tasks.workunit.client.0.smithi033.stdout:4/785: truncate d4/d5/d28/d39/d62/d9c/fb7 798584 0 2024-02-15T18:31:09.215 INFO:tasks.workunit.client.0.smithi033.stdout:8/680: read d0/f94 [381126,98638] 0 2024-02-15T18:31:09.215 INFO:tasks.workunit.client.0.smithi033.stdout:4/786: rename d4/d5/d28/d39/d62/db2 to d4/d20/d13/d34/d82/df5/d106 0 2024-02-15T18:31:09.217 INFO:tasks.workunit.client.0.smithi033.stdout:5/822: mkdir d1/da/d52/d10e 0 2024-02-15T18:31:09.218 INFO:tasks.workunit.client.0.smithi033.stdout:4/787: symlink d4/d5/dc9/l107 0 2024-02-15T18:31:09.219 INFO:tasks.workunit.client.0.smithi033.stdout:5/823: symlink d1/dc3/l10f 0 2024-02-15T18:31:09.222 INFO:tasks.workunit.client.0.smithi033.stdout:5/824: mknod d1/da/d52/dd8/dd2/c110 0 2024-02-15T18:31:09.222 INFO:tasks.workunit.client.0.smithi033.stdout:5/825: fsync d1/da/d19/da6/faa 0 2024-02-15T18:31:09.222 INFO:tasks.workunit.client.0.smithi033.stdout:5/826: truncate d1/da/d52/fcd 53438 0 2024-02-15T18:31:09.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.229+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 --> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa69c0ff080 con 0x7fa68805e9c0 2024-02-15T18:31:09.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.230+0000 7fa6937fe700 1 -- 172.21.15.33:0/3971765946 <== mgr.24387 v2:172.21.15.131:6828/3968122283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa69c0ff080 con 0x7fa68805e9c0 2024-02-15T18:31:09.224 INFO:tasks.workunit.client.0.smithi033.stdout:5/827: rename d1/da/d52/dd8/d40/f9b to d1/da/d52/dd8/d40/d9a/f111 0 2024-02-15T18:31:09.224 INFO:tasks.workunit.client.0.smithi033.stdout:1/731: dwrite d5/d9/d1e/d20/d5c/d57/d82/fba [0,4194304] 0 2024-02-15T18:31:09.224 INFO:tasks.workunit.client.0.smithi033.stdout:1/732: truncate d5/d9/d1e/d20/d2c/f8e 714494 0 2024-02-15T18:31:09.226 INFO:tasks.workunit.client.0.smithi033.stdout:5/828: read d1/da/d10/d2b/d42/d4c/fa0 [172003,106466] 0 2024-02-15T18:31:09.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fa68805e9c0 msgr2=0x7fa688060e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:09.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fa68805e9c0 0x7fa688060e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa69c05f250 tx=0x7fa68c008040).stop 2024-02-15T18:31:09.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa69c0f74a0 msgr2=0x7fa69c107550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:09.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa69c0f74a0 0x7fa69c107550 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fa684009f50 tx=0x7fa684009b30).stop 2024-02-15T18:31:09.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 shutdown_connections 2024-02-15T18:31:09.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fa68805e9c0 0x7fa688060e80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:09.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa69c0f6b90 0x7fa69c107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:09.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 --2- 172.21.15.33:0/3971765946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa69c0f74a0 0x7fa69c107550 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:09.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 >> 172.21.15.33:0/3971765946 conn(0x7fa69c0f0540 msgr2=0x7fa69c0fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:09.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 shutdown_connections 2024-02-15T18:31:09.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.233+0000 7fa6a1549700 1 -- 172.21.15.33:0/3971765946 wait complete. 2024-02-15T18:31:09.227 INFO:tasks.workunit.client.0.smithi033.stdout:1/733: creat d5/d9/d1e/d20/d5c/d57/fe8 x:0 0 0 2024-02-15T18:31:09.228 INFO:tasks.workunit.client.0.smithi033.stdout:1/734: creat d5/dd/d12/d49/fe9 x:0 0 0 2024-02-15T18:31:09.229 INFO:tasks.workunit.client.0.smithi033.stdout:4/788: dread d4/d20/d13/d34/d82/fb6 [0,4194304] 0 2024-02-15T18:31:09.230 INFO:tasks.workunit.client.0.smithi033.stdout:1/735: unlink d5/d9/d1e/d20/d2c/d34/d51/f6f 0 2024-02-15T18:31:09.231 INFO:tasks.workunit.client.0.smithi033.stdout:4/789: rmdir d4/d20/d13/d5c/d87/dc5 39 2024-02-15T18:31:09.231 INFO:tasks.workunit.client.0.smithi033.stdout:4/790: fsync d4/d5/d28/d39/d62/d9c/d9e/dcd/ff6 0 2024-02-15T18:31:09.231 INFO:tasks.workunit.client.0.smithi033.stdout:4/791: mknod d4/d5/d28/d39/d62/c108 0 2024-02-15T18:31:09.233 INFO:tasks.workunit.client.0.smithi033.stdout:7/723: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:31:09.233 INFO:tasks.workunit.client.0.smithi033.stdout:7/724: readlink d0/dc/d10/d7d/l64 0 2024-02-15T18:31:09.233 INFO:tasks.workunit.client.0.smithi033.stdout:7/725: write d0/dc/d10/d48/d4b/fa9 [718424,1231] 0 2024-02-15T18:31:09.233 INFO:tasks.workunit.client.0.smithi033.stdout:4/792: creat d4/d20/d13/d1b/f109 x:0 0 0 2024-02-15T18:31:09.236 INFO:tasks.workunit.client.0.smithi033.stdout:8/681: dwrite d0/df/d53/db3/d95/fcc [0,4194304] 0 2024-02-15T18:31:09.237 INFO:tasks.workunit.client.0.smithi033.stdout:4/793: dread d4/d20/d13/d1b/d81/d9f/fcb [0,4194304] 0 2024-02-15T18:31:09.241 INFO:tasks.workunit.client.0.smithi033.stdout:1/736: dread d5/dd/f69 [0,4194304] 0 2024-02-15T18:31:09.255 INFO:tasks.workunit.client.0.smithi033.stdout:7/726: creat d0/dc/d10/d1d/d2b/d5f/ffb x:0 0 0 2024-02-15T18:31:09.255 INFO:tasks.workunit.client.0.smithi033.stdout:7/727: fdatasync d0/dc/d10/fca 0 2024-02-15T18:31:09.255 INFO:tasks.workunit.client.0.smithi033.stdout:8/682: mknod d0/df/d53/db3/d30/d8e/d14/cdf 0 2024-02-15T18:31:09.255 INFO:tasks.workunit.client.0.smithi033.stdout:7/728: write d0/dc/d10/d1d/f8f [802637,121150] 0 2024-02-15T18:31:09.257 INFO:tasks.workunit.client.0.smithi033.stdout:4/794: creat d4/d20/d13/d5c/dd1/f10a x:0 0 0 2024-02-15T18:31:09.258 INFO:tasks.workunit.client.0.smithi033.stdout:1/737: rmdir d5/d9/d1e/d20/d5c/dca 39 2024-02-15T18:31:09.261 INFO:tasks.workunit.client.0.smithi033.stdout:8/683: mkdir d0/df/d53/db3/d30/d8e/de0 0 2024-02-15T18:31:09.261 INFO:tasks.workunit.client.0.smithi033.stdout:6/772: sync 2024-02-15T18:31:09.261 INFO:tasks.workunit.client.0.smithi033.stdout:0/669: sync 2024-02-15T18:31:09.261 INFO:tasks.workunit.client.0.smithi033.stdout:6/773: fsync d8/d1d/d37/d4f/dbb/d57/fef 0 2024-02-15T18:31:09.263 INFO:tasks.workunit.client.0.smithi033.stdout:4/795: mknod d4/d20/d13/d34/d82/df5/c10b 0 2024-02-15T18:31:09.263 INFO:tasks.workunit.client.0.smithi033.stdout:7/729: creat d0/dc/d10/d48/ffc x:0 0 0 2024-02-15T18:31:09.263 INFO:tasks.workunit.client.0.smithi033.stdout:1/738: getdents d5/d96 0 2024-02-15T18:31:09.265 INFO:tasks.workunit.client.0.smithi033.stdout:0/670: creat d0/d8/d15/d2d/d3f/d97/db1/fe4 x:0 0 0 2024-02-15T18:31:09.267 INFO:tasks.workunit.client.0.smithi033.stdout:4/796: mknod d4/d20/df1/c10c 0 2024-02-15T18:31:09.267 INFO:tasks.workunit.client.0.smithi033.stdout:7/730: mknod d0/cfd 0 2024-02-15T18:31:09.267 INFO:tasks.workunit.client.0.smithi033.stdout:4/797: chown d4/d5/d28/l35 6066074 1 2024-02-15T18:31:09.267 INFO:tasks.workunit.client.0.smithi033.stdout:1/739: link d5/d9/ld1 d5/d9/d1e/d20/d2c/db2/lea 0 2024-02-15T18:31:09.269 INFO:tasks.workunit.client.0.smithi033.stdout:0/671: creat d0/d8/d15/d2d/d3f/d97/db1/dca/de0/fe5 x:0 0 0 2024-02-15T18:31:09.269 INFO:tasks.workunit.client.0.smithi033.stdout:0/672: dread - d0/d2/fb9 zero size 2024-02-15T18:31:09.270 INFO:tasks.workunit.client.0.smithi033.stdout:6/774: write d8/d28/d14/d2c/d31/ded/d5e/da5/fa8 [1841349,48052] 0 2024-02-15T18:31:09.270 INFO:tasks.workunit.client.0.smithi033.stdout:7/731: unlink d0/dc/d10/d1d/d2b/d5f/d63/fd5 0 2024-02-15T18:31:09.270 INFO:tasks.workunit.client.0.smithi033.stdout:7/732: write d0/dc/d10/d7d/ff2 [829288,44380] 0 2024-02-15T18:31:09.271 INFO:tasks.workunit.client.0.smithi033.stdout:4/798: write d4/d20/d13/d1b/da7/fd4 [3111459,77321] 0 2024-02-15T18:31:09.271 INFO:tasks.workunit.client.0.smithi033.stdout:1/740: mknod d5/dd/d12/d49/ceb 0 2024-02-15T18:31:09.272 INFO:tasks.workunit.client.0.smithi033.stdout:0/673: getdents d0/d2 0 2024-02-15T18:31:09.274 INFO:tasks.workunit.client.0.smithi033.stdout:7/733: creat d0/dc/d10/d1d/d38/d74/de7/dfa/ffe x:0 0 0 2024-02-15T18:31:09.276 INFO:tasks.workunit.client.0.smithi033.stdout:0/674: rename d0/d8/d15/d2d/d41/d73/d84 to d0/d8/d15/d2d/d41/de6 0 2024-02-15T18:31:09.278 INFO:tasks.workunit.client.0.smithi033.stdout:7/734: mknod d0/dbe/cff 0 2024-02-15T18:31:09.279 INFO:tasks.workunit.client.0.smithi033.stdout:0/675: creat d0/d8/d15/d8b/fe7 x:0 0 0 2024-02-15T18:31:09.279 INFO:tasks.workunit.client.0.smithi033.stdout:0/676: write d0/d8/d15/d2d/f57 [507343,65816] 0 2024-02-15T18:31:09.280 INFO:tasks.workunit.client.0.smithi033.stdout:7/735: symlink d0/d56/d70/d91/d9e/l100 0 2024-02-15T18:31:09.281 INFO:tasks.workunit.client.0.smithi033.stdout:7/736: creat d0/dc/d10/d1d/d38/d74/d7f/f101 x:0 0 0 2024-02-15T18:31:09.298 INFO:tasks.workunit.client.0.smithi033.stdout:5/829: dwrite d1/da/d52/dd8/d40/f31 [0,4194304] 0 2024-02-15T18:31:09.300 INFO:tasks.workunit.client.0.smithi033.stdout:5/830: symlink d1/da/d11/d5e/l112 0 2024-02-15T18:31:09.301 INFO:tasks.workunit.client.0.smithi033.stdout:5/831: truncate d1/da/d19/d74/fe6 4825618 0 2024-02-15T18:31:09.301 INFO:tasks.workunit.client.0.smithi033.stdout:5/832: chown d1/da/d11/d5e/db1/d63/d61/ce9 44 1 2024-02-15T18:31:09.301 INFO:tasks.workunit.client.0.smithi033.stdout:2/794: sync 2024-02-15T18:31:09.301 INFO:tasks.workunit.client.0.smithi033.stdout:2/795: fdatasync d20/d3a/ff0 0 2024-02-15T18:31:09.305 INFO:tasks.workunit.client.0.smithi033.stdout:1/741: dwrite d5/dd/d12/d49/fd7 [0,4194304] 0 2024-02-15T18:31:09.308 INFO:tasks.workunit.client.0.smithi033.stdout:0/677: rename d0/d8/d15/d2d/d3f to d0/de8 0 2024-02-15T18:31:09.310 INFO:tasks.workunit.client.0.smithi033.stdout:2/796: dread d20/d31/dc8/fe3 [4194304,4194304] 0 2024-02-15T18:31:09.310 INFO:tasks.workunit.client.0.smithi033.stdout:2/797: getdents d20/d31/d47/d82/de6/d106 0 2024-02-15T18:31:09.313 INFO:tasks.workunit.client.0.smithi033.stdout:5/833: mknod d1/da/d52/dd8/d40/d65/c113 0 2024-02-15T18:31:09.313 INFO:tasks.workunit.client.0.smithi033.stdout:5/834: dread - d1/da/d19/d3f/d68/fdc zero size 2024-02-15T18:31:09.313 INFO:tasks.workunit.client.0.smithi033.stdout:7/737: rmdir d0/dc/d10/d1d/d2b/d5f 39 2024-02-15T18:31:09.314 INFO:tasks.workunit.client.0.smithi033.stdout:7/738: dread d0/d56/fc1 [0,4194304] 0 2024-02-15T18:31:09.315 INFO:tasks.workunit.client.0.smithi033.stdout:7/739: truncate d0/f5e 559972 0 2024-02-15T18:31:09.315 INFO:tasks.workunit.client.0.smithi033.stdout:7/740: chown d0/dc/d10/d7d/l58 6 1 2024-02-15T18:31:09.316 INFO:tasks.workunit.client.0.smithi033.stdout:1/742: getdents d5/d9/d1e 0 2024-02-15T18:31:09.316 INFO:tasks.workunit.client.0.smithi033.stdout:0/678: creat d0/d8/d15/d2d/fe9 x:0 0 0 2024-02-15T18:31:09.318 INFO:tasks.workunit.client.0.smithi033.stdout:2/798: mknod d20/d3a/d4a/d5e/d6b/d88/da6/ddb/c11c 0 2024-02-15T18:31:09.318 INFO:tasks.workunit.client.0.smithi033.stdout:0/679: write d0/d8/d15/d8b/da3/d6c/f46 [350913,91241] 0 2024-02-15T18:31:09.318 INFO:tasks.workunit.client.0.smithi033.stdout:0/680: truncate d0/d8/d15/d7c/fa0 597674 0 2024-02-15T18:31:09.318 INFO:tasks.workunit.client.0.smithi033.stdout:0/681: dread - d0/d8/d15/d8b/da3/dae/d58/d80/dc1/fc3 zero size 2024-02-15T18:31:09.318 INFO:tasks.workunit.client.0.smithi033.stdout:0/682: read - d0/de8/d8d/fc6 zero size 2024-02-15T18:31:09.318 INFO:tasks.workunit.client.0.smithi033.stdout:9/608: sync 2024-02-15T18:31:09.318 INFO:tasks.workunit.client.0.smithi033.stdout:3/787: sync 2024-02-15T18:31:09.319 INFO:tasks.workunit.client.0.smithi033.stdout:5/835: symlink d1/da/d11/d5e/db1/dfa/l114 0 2024-02-15T18:31:09.319 INFO:tasks.workunit.client.0.smithi033.stdout:5/836: fsync d1/da/fb 0 2024-02-15T18:31:09.320 INFO:tasks.workunit.client.0.smithi033.stdout:5/837: write d1/da/d10/d2b/d42/f62 [149024,20597] 0 2024-02-15T18:31:09.320 INFO:tasks.workunit.client.0.smithi033.stdout:1/743: symlink d5/dd/d12/dc6/lec 0 2024-02-15T18:31:09.321 INFO:tasks.workunit.client.0.smithi033.stdout:2/799: rename d20/d31/d6a/f24 to d20/d31/d47/d4c/f11d 0 2024-02-15T18:31:09.321 INFO:tasks.workunit.client.0.smithi033.stdout:2/800: write d20/d31/fb4 [427576,7673] 0 2024-02-15T18:31:09.321 INFO:tasks.workunit.client.0.smithi033.stdout:2/801: truncate d20/d3a/f75 4536275 0 2024-02-15T18:31:09.323 INFO:tasks.workunit.client.0.smithi033.stdout:9/609: creat d4/d8/dd/fcb x:0 0 0 2024-02-15T18:31:09.323 INFO:tasks.workunit.client.0.smithi033.stdout:9/610: getdents d4/d2c/db1 0 2024-02-15T18:31:09.323 INFO:tasks.workunit.client.0.smithi033.stdout:5/838: mkdir d1/da/d10/d2b/d115 0 2024-02-15T18:31:09.327 INFO:tasks.workunit.client.0.smithi033.stdout:2/802: dread d20/d31/fb4 [0,4194304] 0 2024-02-15T18:31:09.327 INFO:tasks.workunit.client.0.smithi033.stdout:2/803: chown d20/d3a/dee 229 1 2024-02-15T18:31:09.329 INFO:tasks.workunit.client.0.smithi033.stdout:3/788: rename d2/d20/f6a to d2/d3/d17/de6/d88/ddc/ff9 0 2024-02-15T18:31:09.329 INFO:tasks.workunit.client.0.smithi033.stdout:1/744: mkdir d5/d96/ded 0 2024-02-15T18:31:09.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/745: fsync d5/d9/d1e/d20/d5c/d57/d82/fb1 0 2024-02-15T18:31:09.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/746: write d5/dd/d12/d49/d23/fe2 [625534,108334] 0 2024-02-15T18:31:09.330 INFO:tasks.workunit.client.0.smithi033.stdout:0/683: dread d0/d2/f82 [0,4194304] 0 2024-02-15T18:31:09.338 INFO:tasks.workunit.client.0.smithi033.stdout:2/804: mkdir d20/d3a/d4a/d5e/d11e 0 2024-02-15T18:31:09.338 INFO:tasks.workunit.client.0.smithi033.stdout:9/611: symlink d4/d8/lcc 0 2024-02-15T18:31:09.338 INFO:tasks.workunit.client.0.smithi033.stdout:3/789: mkdir d2/dfa 0 2024-02-15T18:31:09.338 INFO:tasks.workunit.client.0.smithi033.stdout:2/805: dread - d20/de1/f11a zero size 2024-02-15T18:31:09.338 INFO:tasks.workunit.client.0.smithi033.stdout:1/747: symlink d5/d9/d1e/d20/d2c/db2/lee 0 2024-02-15T18:31:09.338 INFO:tasks.workunit.client.0.smithi033.stdout:2/806: readlink d20/d31/d47/d64/l113 0 2024-02-15T18:31:09.338 INFO:tasks.workunit.client.0.smithi033.stdout:0/684: mkdir d0/d8/d15/d7c/dea 0 2024-02-15T18:31:09.339 INFO:tasks.workunit.client.0.smithi033.stdout:9/612: creat d4/d2c/db1/fcd x:0 0 0 2024-02-15T18:31:09.341 INFO:tasks.workunit.client.0.smithi033.stdout:5/839: dwrite d1/da/d11/f49 [0,4194304] 0 2024-02-15T18:31:09.341 INFO:tasks.workunit.client.0.smithi033.stdout:2/807: creat d20/d3a/d4a/d5e/d11e/f11f x:0 0 0 2024-02-15T18:31:09.342 INFO:tasks.workunit.client.0.smithi033.stdout:2/808: write d20/d31/d47/d4c/f60 [3936746,98530] 0 2024-02-15T18:31:09.344 INFO:tasks.workunit.client.0.smithi033.stdout:1/748: link d5/d9/d1e/d20/d2c/d34/lc2 d5/lef 0 2024-02-15T18:31:09.344 INFO:tasks.workunit.client.0.smithi033.stdout:0/685: unlink d0/d8/d15/fd2 0 2024-02-15T18:31:09.344 INFO:tasks.workunit.client.0.smithi033.stdout:0/686: dread - d0/d8/d15/d5b/fd8 zero size 2024-02-15T18:31:09.346 INFO:tasks.workunit.client.0.smithi033.stdout:9/613: symlink d4/d8/dd/lce 0 2024-02-15T18:31:09.346 INFO:tasks.workunit.client.0.smithi033.stdout:9/614: chown d4/d8/dd/d41/d51/l9c 11969 1 2024-02-15T18:31:09.346 INFO:tasks.workunit.client.0.smithi033.stdout:9/615: chown d4/d8/dd/d5c/f66 139518858 1 2024-02-15T18:31:09.347 INFO:tasks.workunit.client.0.smithi033.stdout:3/790: link d2/d3/f9f d2/d3/df/d6c/ffb 0 2024-02-15T18:31:09.347 INFO:tasks.workunit.client.0.smithi033.stdout:2/809: creat d20/d31/d47/d64/d9e/f120 x:0 0 0 2024-02-15T18:31:09.348 INFO:tasks.workunit.client.0.smithi033.stdout:2/810: stat d20/d3a/d4a/d5e/d6b/d88 0 2024-02-15T18:31:09.348 INFO:tasks.workunit.client.0.smithi033.stdout:1/749: mknod d5/d38/dd6/cf0 0 2024-02-15T18:31:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.359+0000 7f56fcd48700 1 -- 172.21.15.33:0/3586261973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 msgr2=0x7f56f80f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.359+0000 7f56fcd48700 1 --2- 172.21.15.33:0/3586261973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 0x7f56f80f4dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f56e8004660 tx=0x7f56e8009b30).stop 2024-02-15T18:31:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.359+0000 7f56fcd48700 1 -- 172.21.15.33:0/3586261973 shutdown_connections 2024-02-15T18:31:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.359+0000 7f56fcd48700 1 --2- 172.21.15.33:0/3586261973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56f80f5340 0x7f56f80f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.359+0000 7f56fcd48700 1 --2- 172.21.15.33:0/3586261973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 0x7f56f80f4dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.359+0000 7f56fcd48700 1 -- 172.21.15.33:0/3586261973 >> 172.21.15.33:0/3586261973 conn(0x7f56f80f04c0 msgr2=0x7f56f80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.359+0000 7f56fcd48700 1 -- 172.21.15.33:0/3586261973 shutdown_connections 2024-02-15T18:31:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.359+0000 7f56fcd48700 1 -- 172.21.15.33:0/3586261973 wait complete. 2024-02-15T18:31:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.360+0000 7f56fcd48700 1 Processor -- start 2024-02-15T18:31:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.360+0000 7f56fcd48700 1 -- start start 2024-02-15T18:31:09.354 INFO:tasks.workunit.client.0.smithi033.stdout:3/791: symlink d2/d3/dcc/lfc 0 2024-02-15T18:31:09.354 INFO:tasks.workunit.client.0.smithi033.stdout:1/750: symlink d5/dd/d12/d49/d23/lf1 0 2024-02-15T18:31:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.360+0000 7f56fcd48700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 0x7f56f8107150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.360+0000 7f56fcd48700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56f80f5340 0x7f56f8107640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.360+0000 7f56fcd48700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8107c80 con 0x7f56f80f49a0 2024-02-15T18:31:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.360+0000 7f56fcd48700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8108530 con 0x7f56f80f5340 2024-02-15T18:31:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.361+0000 7f56f659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 0x7f56f8107150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.361+0000 7f56f659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 0x7f56f8107150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45138/0 (socket says 172.21.15.33:45138) 2024-02-15T18:31:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.361+0000 7f56f659c700 1 -- 172.21.15.33:0/3354453782 learned_addr learned my addr 172.21.15.33:0/3354453782 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.361+0000 7f56f5d9b700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56f80f5340 0x7f56f8107640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:09.356 INFO:tasks.workunit.client.0.smithi033.stdout:1/751: symlink d5/d9/d1e/d20/d2c/d34/d51/d63/d76/lf2 0 2024-02-15T18:31:09.356 INFO:tasks.workunit.client.0.smithi033.stdout:1/752: truncate d5/dd/d12/d49/f3a 278811 0 2024-02-15T18:31:09.356 INFO:tasks.workunit.client.0.smithi033.stdout:1/753: chown d5/dd/fd8 41444473 1 2024-02-15T18:31:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.362+0000 7f56f659c700 1 -- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56f80f5340 msgr2=0x7f56f8107640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.362+0000 7f56f659c700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56f80f5340 0x7f56f8107640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.362+0000 7f56f659c700 1 -- 172.21.15.33:0/3354453782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e8005040 con 0x7f56f80f49a0 2024-02-15T18:31:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.362+0000 7f56f659c700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 0x7f56f8107150 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f56e8013e80 tx=0x7f56e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.362+0000 7f56e6ffd700 1 -- 172.21.15.33:0/3354453782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56e8018070 con 0x7f56f80f49a0 2024-02-15T18:31:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.362+0000 7f56e6ffd700 1 -- 172.21.15.33:0/3354453782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f56e8007d70 con 0x7f56f80f49a0 2024-02-15T18:31:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.362+0000 7f56e6ffd700 1 -- 172.21.15.33:0/3354453782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56e801c720 con 0x7f56f80f49a0 2024-02-15T18:31:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.362+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f81087b0 con 0x7f56f80f49a0 2024-02-15T18:31:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.362+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f8108c40 con 0x7f56f80f49a0 2024-02-15T18:31:09.357 INFO:tasks.workunit.client.0.smithi033.stdout:1/754: rename d5/d9/d1e/d20 to d5/d9/d1e/d20/d2c/d34/dc0/df3 22 2024-02-15T18:31:09.357 INFO:tasks.workunit.client.0.smithi033.stdout:1/755: chown d5/dd/fbc 4286059 1 2024-02-15T18:31:09.357 INFO:tasks.workunit.client.0.smithi033.stdout:1/756: dread - d5/d9/d1e/d20/d2c/d34/d51/ddb/fde zero size 2024-02-15T18:31:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.363+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f80f4150 con 0x7f56f80f49a0 2024-02-15T18:31:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.364+0000 7f56e6ffd700 1 -- 172.21.15.33:0/3354453782 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 74714+0+0 (secure 0 0 0) 0x7f56e801c990 con 0x7f56f80f49a0 2024-02-15T18:31:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.364+0000 7f56e6ffd700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f56e0067170 0x7f56e0069630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.365+0000 7f56e6ffd700 1 -- 172.21.15.33:0/3354453782 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f56e807b110 con 0x7f56f80f49a0 2024-02-15T18:31:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.365+0000 7f56f5d9b700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f56e0067170 0x7f56e0069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.366+0000 7f56f5d9b700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f56e0067170 0x7f56e0069630 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f56f80f5780 tx=0x7f56ec008040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:09.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.370+0000 7f56e6ffd700 1 -- 172.21.15.33:0/3354453782 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f56e804ef70 con 0x7f56f80f49a0 2024-02-15T18:31:09.432 INFO:tasks.workunit.client.0.smithi033.stdout:9/616: dwrite d4/d8/dd/d41/d51/f80 [4194304,4194304] 0 2024-02-15T18:31:09.432 INFO:tasks.workunit.client.0.smithi033.stdout:9/617: write d4/d8/dd/d5c/f85 [1062700,108698] 0 2024-02-15T18:31:09.432 INFO:tasks.workunit.client.0.smithi033.stdout:9/618: truncate d4/d8/d1b/d73/fb7 900430 0 2024-02-15T18:31:09.434 INFO:tasks.workunit.client.0.smithi033.stdout:9/619: dread d4/d8/dd/d28/f8f [0,4194304] 0 2024-02-15T18:31:09.436 INFO:tasks.workunit.client.0.smithi033.stdout:2/811: dwrite d20/d31/d47/fcd [0,4194304] 0 2024-02-15T18:31:09.437 INFO:tasks.workunit.client.0.smithi033.stdout:2/812: write d20/d31/d47/d4c/f63 [3402821,58274] 0 2024-02-15T18:31:09.437 INFO:tasks.workunit.client.0.smithi033.stdout:2/813: chown d20/d31/d47/cc6 40070 1 2024-02-15T18:31:09.440 INFO:tasks.workunit.client.0.smithi033.stdout:3/792: dwrite d2/d3/d1e/d22/f57 [0,4194304] 0 2024-02-15T18:31:09.440 INFO:tasks.workunit.client.0.smithi033.stdout:1/757: dwrite d5/dd/f2e [4194304,4194304] 0 2024-02-15T18:31:09.448 INFO:tasks.workunit.client.0.smithi033.stdout:9/620: dwrite d4/d8/d1b/d2f/f79 [0,4194304] 0 2024-02-15T18:31:09.449 INFO:tasks.workunit.client.0.smithi033.stdout:9/621: write d4/d8/dd/fc5 [2389096,88203] 0 2024-02-15T18:31:09.453 INFO:tasks.workunit.client.0.smithi033.stdout:3/793: unlink d2/d3/d1e/f4f 0 2024-02-15T18:31:09.454 INFO:tasks.workunit.client.0.smithi033.stdout:1/758: mkdir d5/d9/d1e/df4 0 2024-02-15T18:31:09.459 INFO:tasks.workunit.client.0.smithi033.stdout:9/622: creat d4/d8/dd/d28/d6b/fcf x:0 0 0 2024-02-15T18:31:09.460 INFO:tasks.workunit.client.0.smithi033.stdout:1/759: truncate d5/d17/f29 2592516 0 2024-02-15T18:31:09.461 INFO:tasks.workunit.client.0.smithi033.stdout:3/794: unlink d2/d3/df/f49 0 2024-02-15T18:31:09.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/760: link d5/d9/d1e/d20/d5c/d57/d82/l88 d5/d9/d1e/d20/d5c/d57/lf5 0 2024-02-15T18:31:09.463 INFO:tasks.workunit.client.0.smithi033.stdout:3/795: creat d2/d14/db3/dba/ffd x:0 0 0 2024-02-15T18:31:09.463 INFO:tasks.workunit.client.0.smithi033.stdout:3/796: dread - d2/d14/d23/d6f/fdd zero size 2024-02-15T18:31:09.463 INFO:tasks.workunit.client.0.smithi033.stdout:3/797: getdents d2/d14/d23/d5c/d61 0 2024-02-15T18:31:09.464 INFO:tasks.workunit.client.0.smithi033.stdout:3/798: fsync d2/d14/f44 0 2024-02-15T18:31:09.464 INFO:tasks.workunit.client.0.smithi033.stdout:3/799: readlink d2/d14/d23/d6f/l94 0 2024-02-15T18:31:09.467 INFO:tasks.workunit.client.0.smithi033.stdout:3/800: dread d2/d14/d23/d5c/d61/f63 [0,4194304] 0 2024-02-15T18:31:09.469 INFO:tasks.workunit.client.0.smithi033.stdout:3/801: unlink d2/d3/d1e/fc3 0 2024-02-15T18:31:09.483 INFO:tasks.workunit.client.0.smithi033.stdout:1/761: dwrite d5/dd/d12/d49/f7d [0,4194304] 0 2024-02-15T18:31:09.496 INFO:tasks.workunit.client.0.smithi033.stdout:9/623: dwrite d4/d8/d1b/d2f/f76 [4194304,4194304] 0 2024-02-15T18:31:09.496 INFO:tasks.workunit.client.0.smithi033.stdout:9/624: stat d4/d2c/db1/cba 0 2024-02-15T18:31:09.497 INFO:tasks.workunit.client.0.smithi033.stdout:9/625: creat d4/d8/d1b/d73/fd0 x:0 0 0 2024-02-15T18:31:09.498 INFO:tasks.workunit.client.0.smithi033.stdout:9/626: mkdir d4/d2c/db1/dd1 0 2024-02-15T18:31:09.498 INFO:tasks.workunit.client.0.smithi033.stdout:9/627: write d4/d8/d1b/d73/fd0 [755106,124206] 0 2024-02-15T18:31:09.498 INFO:tasks.workunit.client.0.smithi033.stdout:9/628: write d4/d8/dd/f70 [697916,61090] 0 2024-02-15T18:31:09.498 INFO:tasks.workunit.client.0.smithi033.stdout:9/629: write d4/d8/d1b/d73/fb7 [1165997,107105] 0 2024-02-15T18:31:09.498 INFO:tasks.workunit.client.0.smithi033.stdout:9/630: write d4/d32/fab [183740,27935] 0 2024-02-15T18:31:09.499 INFO:tasks.workunit.client.0.smithi033.stdout:9/631: creat d4/d8/dd/d28/fd2 x:0 0 0 2024-02-15T18:31:09.509 INFO:tasks.workunit.client.0.smithi033.stdout:1/762: dread d5/d9/d1e/f94 [0,4194304] 0 2024-02-15T18:31:09.510 INFO:tasks.workunit.client.0.smithi033.stdout:9/632: dread d4/d8/dd/d41/f4e [0,4194304] 0 2024-02-15T18:31:09.510 INFO:tasks.workunit.client.0.smithi033.stdout:9/633: chown d4/d8/cc6 4629017 1 2024-02-15T18:31:09.510 INFO:tasks.workunit.client.0.smithi033.stdout:1/763: creat d5/d9/d1e/d20/d5c/d8d/ff6 x:0 0 0 2024-02-15T18:31:09.511 INFO:tasks.workunit.client.0.smithi033.stdout:9/634: chown d4/d8/l25 9078 1 2024-02-15T18:31:09.513 INFO:tasks.workunit.client.0.smithi033.stdout:9/635: unlink d4/d2c/db1/fc0 0 2024-02-15T18:31:09.536 INFO:tasks.workunit.client.0.smithi033.stdout:1/764: dwrite d5/d9/d1e/d20/d5c/d57/d82/f95 [0,4194304] 0 2024-02-15T18:31:09.536 INFO:tasks.workunit.client.0.smithi033.stdout:1/765: dread - d5/d9/d1e/d20/d5c/d57/d59/fb9 zero size 2024-02-15T18:31:09.536 INFO:tasks.workunit.client.0.smithi033.stdout:9/636: dwrite d4/d8/d1b/fbb [0,4194304] 0 2024-02-15T18:31:09.539 INFO:tasks.workunit.client.0.smithi033.stdout:1/766: rename d5/d9/c13 to d5/cf7 0 2024-02-15T18:31:09.539 INFO:tasks.workunit.client.0.smithi033.stdout:1/767: write d5/dd/d12/d49/d23/fe2 [1324548,90382] 0 2024-02-15T18:31:09.547 INFO:tasks.workunit.client.0.smithi033.stdout:4/799: sync 2024-02-15T18:31:09.547 INFO:tasks.workunit.client.0.smithi033.stdout:8/684: sync 2024-02-15T18:31:09.547 INFO:tasks.workunit.client.0.smithi033.stdout:6/775: sync 2024-02-15T18:31:09.547 INFO:tasks.workunit.client.0.smithi033.stdout:8/685: dread - d0/df/d53/db3/d30/d8e/d14/d56/d59/fc2 zero size 2024-02-15T18:31:09.550 INFO:tasks.workunit.client.0.smithi033.stdout:4/800: rename d4/d20/d13/d1b/d81/de6 to d4/d5/d28/d39/d62/d9c/d9e/dcd/d10d 0 2024-02-15T18:31:09.550 INFO:tasks.workunit.client.0.smithi033.stdout:4/801: chown d4/d20/d13/d34/d82/df5/c10b 1698518 1 2024-02-15T18:31:09.553 INFO:tasks.workunit.client.0.smithi033.stdout:4/802: rename d4/d20/df1 to d4/d5/d28/d39/d62/d9c/d9e/da4/d10e 0 2024-02-15T18:31:09.554 INFO:tasks.workunit.client.0.smithi033.stdout:4/803: truncate d4/d20/f11 660899 0 2024-02-15T18:31:09.555 INFO:tasks.workunit.client.0.smithi033.stdout:4/804: write d4/d20/f9 [3541424,2069] 0 2024-02-15T18:31:09.556 INFO:tasks.workunit.client.0.smithi033.stdout:4/805: rmdir d4/d5/dc9 39 2024-02-15T18:31:09.557 INFO:tasks.workunit.client.0.smithi033.stdout:6/776: dread d8/d28/d14/d2c/d31/d30/f71 [0,4194304] 0 2024-02-15T18:31:09.557 INFO:tasks.workunit.client.0.smithi033.stdout:6/777: chown d8/d1d/c40 2710420 1 2024-02-15T18:31:09.557 INFO:tasks.workunit.client.0.smithi033.stdout:6/778: write d8/d1d/d37/dbf/dd0/fe3 [485110,44363] 0 2024-02-15T18:31:09.557 INFO:tasks.workunit.client.0.smithi033.stdout:6/779: fdatasync d8/d28/d14/d2c/d31/d30/fa4 0 2024-02-15T18:31:09.558 INFO:tasks.workunit.client.0.smithi033.stdout:6/780: mkdir d8/d28/d14/d2c/d31/d5d/df3 0 2024-02-15T18:31:09.560 INFO:tasks.workunit.client.0.smithi033.stdout:4/806: mkdir d4/d20/d13/d1b/d10f 0 2024-02-15T18:31:09.560 INFO:tasks.workunit.client.0.smithi033.stdout:8/686: dread d0/df/f38 [0,4194304] 0 2024-02-15T18:31:09.560 INFO:tasks.workunit.client.0.smithi033.stdout:6/781: dread d8/d28/d14/d2c/d31/ded/d5e/fb7 [0,4194304] 0 2024-02-15T18:31:09.562 INFO:tasks.workunit.client.0.smithi033.stdout:9/637: dwrite d4/d8/d1b/f8d [0,4194304] 0 2024-02-15T18:31:09.562 INFO:tasks.workunit.client.0.smithi033.stdout:4/807: rename d4/d20/f3a to d4/d5/d28/d39/d62/d9c/d9e/f110 0 2024-02-15T18:31:09.562 INFO:tasks.workunit.client.0.smithi033.stdout:8/687: mknod d0/df/d53/db3/d30/d8e/da7/ce1 0 2024-02-15T18:31:09.563 INFO:tasks.workunit.client.0.smithi033.stdout:8/688: write d0/df/f38 [1206497,64312] 0 2024-02-15T18:31:09.564 INFO:tasks.workunit.client.0.smithi033.stdout:6/782: unlink d8/l1f 0 2024-02-15T18:31:09.564 INFO:tasks.workunit.client.0.smithi033.stdout:6/783: truncate d8/d1d/ff0 29081 0 2024-02-15T18:31:09.564 INFO:tasks.workunit.client.0.smithi033.stdout:6/784: write d8/d28/fcf [428990,82305] 0 2024-02-15T18:31:09.565 INFO:tasks.workunit.client.0.smithi033.stdout:1/768: dwrite d5/d38/f60 [0,4194304] 0 2024-02-15T18:31:09.565 INFO:tasks.workunit.client.0.smithi033.stdout:1/769: fdatasync d5/dd/f69 0 2024-02-15T18:31:09.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.579+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 --> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f56f80ff160 con 0x7f56e0067170 2024-02-15T18:31:09.573 INFO:tasks.workunit.client.0.smithi033.stdout:8/689: dread d0/df/d53/db3/d30/d8e/d35/f4f [0,4194304] 0 2024-02-15T18:31:09.573 INFO:tasks.workunit.client.0.smithi033.stdout:8/690: dread - d0/fcb zero size 2024-02-15T18:31:09.573 INFO:tasks.workunit.client.0.smithi033.stdout:9/638: creat d4/fd3 x:0 0 0 2024-02-15T18:31:09.573 INFO:tasks.workunit.client.0.smithi033.stdout:9/639: write d4/d8/dd/d28/f8f [977685,126283] 0 2024-02-15T18:31:09.574 INFO:tasks.workunit.client.0.smithi033.stdout:4/808: link d4/d5/dc9/l107 d4/d5/d28/d39/d62/d9c/d9e/dcd/l111 0 2024-02-15T18:31:09.575 INFO:tasks.workunit.client.0.smithi033.stdout:4/809: write d4/d20/d13/d1b/da7/fdd [1618766,18777] 0 2024-02-15T18:31:09.575 INFO:tasks.workunit.client.0.smithi033.stdout:4/810: truncate d4/d20/d13/ff2 1024098 0 2024-02-15T18:31:09.575 INFO:tasks.workunit.client.0.smithi033.stdout:4/811: fdatasync d4/d20/d13/d1b/d7c/f95 0 2024-02-15T18:31:09.575 INFO:tasks.workunit.client.0.smithi033.stdout:6/785: rename d8/d28/d14/d2c/d31/d5d/d8c/fad to d8/d1d/d37/d4f/dbb/d57/ff4 0 2024-02-15T18:31:09.575 INFO:tasks.workunit.client.0.smithi033.stdout:6/786: write d8/d28/d14/d2c/d31/d30/d29/d38/fda [728613,37994] 0 2024-02-15T18:31:09.577 INFO:tasks.workunit.client.0.smithi033.stdout:1/770: creat d5/d9/d1e/d20/d5c/d57/ff8 x:0 0 0 2024-02-15T18:31:09.577 INFO:tasks.workunit.client.0.smithi033.stdout:1/771: chown d5/dd/d12/d49/ceb 1087 1 2024-02-15T18:31:09.579 INFO:tasks.workunit.client.0.smithi033.stdout:8/691: rmdir d0/df/d53/db3/d30/d8e/d14 39 2024-02-15T18:31:09.580 INFO:tasks.workunit.client.0.smithi033.stdout:9/640: rmdir d4/d2c/db1/dd1 0 2024-02-15T18:31:09.584 INFO:tasks.workunit.client.0.smithi033.stdout:4/812: mknod d4/d5/d28/d39/d62/d9c/d9e/c112 0 2024-02-15T18:31:09.584 INFO:tasks.workunit.client.0.smithi033.stdout:4/813: dread - d4/d5/d28/d39/d62/d9c/d9e/da4/db1/ff3 zero size 2024-02-15T18:31:09.585 INFO:tasks.workunit.client.0.smithi033.stdout:4/814: write d4/d20/d13/d1b/d7c/d91/dbe/f101 [314858,69867] 0 2024-02-15T18:31:09.585 INFO:tasks.workunit.client.0.smithi033.stdout:6/787: mkdir d8/d28/d14/d2c/d31/d30/de1/df5 0 2024-02-15T18:31:09.586 INFO:tasks.workunit.client.0.smithi033.stdout:8/692: symlink d0/df/d53/le2 0 2024-02-15T18:31:09.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.594+0000 7f56e6ffd700 1 -- 172.21.15.33:0/3354453782 <== mgr.24387 v2:172.21.15.131:6828/3968122283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f56f80ff160 con 0x7f56e0067170 2024-02-15T18:31:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:31:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (6m) 27s ago 7m 15.8M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:31:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (7m) 27s ago 7m 6391k - 16.2.4 8d91d370c2b8 6deae8bbd6c5 2024-02-15T18:31:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (6m) 29s ago 6m 6395k - 16.2.4 8d91d370c2b8 e45b11308af7 2024-02-15T18:31:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (5m) 27s ago 7m 33.9M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:31:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (2m) 27s ago 2m 15.5M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:31:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (2m) 27s ago 2m 11.1M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (2m) 29s ago 2m 46.7M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (2m) 29s ago 2m 120M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:9283 running (9m) 27s ago 9m 200M - 16.2.4 8d91d370c2b8 c319170b238f 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (41s) 29s ago 6m 413M - 16.2.14-521-g0e714d9a 1fbc92c859dc 220e23710038 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (9m) 27s ago 9m 47.1M 2048M 16.2.4 8d91d370c2b8 04c43c0cba21 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (6m) 29s ago 6m 42.3M 2048M 16.2.4 8d91d370c2b8 710ae4544ec3 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (7m) 27s ago 7m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (6m) 29s ago 6m 17.0M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (6m) 27s ago 6m 79.6M 4096M 16.2.4 8d91d370c2b8 8fd8ca242c54 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (5m) 27s ago 5m 80.1M 4096M 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:31:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (5m) 27s ago 5m 74.1M 4096M 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:31:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (4m) 29s ago 4m 77.5M 4096M 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:31:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (4m) 29s ago 4m 73.6M 4096M 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:31:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (4m) 29s ago 4m 83.2M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:31:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (5m) 27s ago 6m 38.5M - 2.18.1 de242295e225 0b5ba62c4d4c 2024-02-15T18:31:09.589 INFO:tasks.workunit.client.0.smithi033.stdout:4/815: creat d4/d5/d28/d39/d62/d9c/d9e/da4/f113 x:0 0 0 2024-02-15T18:31:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f56e0067170 msgr2=0x7f56e0069630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f56e0067170 0x7f56e0069630 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f56f80f5780 tx=0x7f56ec008040).stop 2024-02-15T18:31:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 msgr2=0x7f56f8107150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 0x7f56f8107150 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f56e8013e80 tx=0x7f56e8009b30).stop 2024-02-15T18:31:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 shutdown_connections 2024-02-15T18:31:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f56e0067170 0x7f56e0069630 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f80f49a0 0x7f56f8107150 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 --2- 172.21.15.33:0/3354453782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56f80f5340 0x7f56f8107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:09.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 >> 172.21.15.33:0/3354453782 conn(0x7f56f80f04c0 msgr2=0x7f56f80fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 shutdown_connections 2024-02-15T18:31:09.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.596+0000 7f56fcd48700 1 -- 172.21.15.33:0/3354453782 wait complete. 2024-02-15T18:31:09.591 INFO:tasks.workunit.client.0.smithi033.stdout:8/693: link d0/df/f38 d0/df/dd2/fe3 0 2024-02-15T18:31:09.591 INFO:tasks.workunit.client.0.smithi033.stdout:8/694: write d0/daa/fc8 [845437,99069] 0 2024-02-15T18:31:09.591 INFO:tasks.workunit.client.0.smithi033.stdout:9/641: symlink d4/d8/ld4 0 2024-02-15T18:31:09.593 INFO:tasks.workunit.client.0.smithi033.stdout:8/695: mknod d0/df/d53/db3/d30/d8e/d35/d29/d5f/ce4 0 2024-02-15T18:31:09.593 INFO:tasks.workunit.client.0.smithi033.stdout:8/696: dread - d0/df/d53/db3/d30/d8e/d14/d56/d59/fdd zero size 2024-02-15T18:31:09.593 INFO:tasks.workunit.client.0.smithi033.stdout:9/642: truncate d4/d8/dd/d28/f83 80520 0 2024-02-15T18:31:09.593 INFO:tasks.workunit.client.0.smithi033.stdout:9/643: chown d4/d8/d1b/d2f/c48 16 1 2024-02-15T18:31:09.594 INFO:tasks.workunit.client.0.smithi033.stdout:8/697: write d0/df/fc5 [3842690,127337] 0 2024-02-15T18:31:09.596 INFO:tasks.workunit.client.0.smithi033.stdout:4/816: dread d4/d20/f27 [4194304,4194304] 0 2024-02-15T18:31:09.601 INFO:tasks.workunit.client.0.smithi033.stdout:8/698: dread d0/df/db/fd5 [0,4194304] 0 2024-02-15T18:31:09.609 INFO:tasks.workunit.client.0.smithi033.stdout:8/699: rename d0/df/d53/db3/d30/d8e/fa3 to d0/df/dd3/fe5 0 2024-02-15T18:31:09.609 INFO:tasks.workunit.client.0.smithi033.stdout:8/700: chown d0/df/d53/db3/d30/d8e/d14/d56/db0 35 1 2024-02-15T18:31:09.610 INFO:tasks.workunit.client.0.smithi033.stdout:8/701: read d0/df/db/f6b [700933,64686] 0 2024-02-15T18:31:09.610 INFO:tasks.workunit.client.0.smithi033.stdout:8/702: write d0/df/d53/db3/d30/d8e/d35/d58/da1/fb9 [455150,119891] 0 2024-02-15T18:31:09.610 INFO:tasks.workunit.client.0.smithi033.stdout:8/703: chown d0/df/d53/db3/d30/d8e/d14/f32 1858 1 2024-02-15T18:31:09.611 INFO:tasks.workunit.client.0.smithi033.stdout:8/704: mkdir d0/df/d53/db3/d30/d8e/d35/de6 0 2024-02-15T18:31:09.612 INFO:tasks.workunit.client.0.smithi033.stdout:8/705: creat d0/df/d53/db3/d30/d8e/d35/d29/fe7 x:0 0 0 2024-02-15T18:31:09.613 INFO:tasks.workunit.client.0.smithi033.stdout:8/706: truncate d0/df/d53/db3/d30/d8e/d35/d29/f2e 1357671 0 2024-02-15T18:31:09.614 INFO:tasks.workunit.client.0.smithi033.stdout:8/707: dread d0/df/d53/db3/d30/f66 [0,4194304] 0 2024-02-15T18:31:09.616 INFO:tasks.workunit.client.0.smithi033.stdout:8/708: unlink d0/l51 0 2024-02-15T18:31:09.620 INFO:tasks.workunit.client.0.smithi033.stdout:9/644: dwrite d4/d8/d1b/d2f/d65/f90 [0,4194304] 0 2024-02-15T18:31:09.625 INFO:tasks.workunit.client.0.smithi033.stdout:4/817: dwrite d4/d20/d13/d1b/d81/d9f/fab [0,4194304] 0 2024-02-15T18:31:09.636 INFO:tasks.workunit.client.0.smithi033.stdout:4/818: dread d4/d20/d37/f42 [0,4194304] 0 2024-02-15T18:31:09.636 INFO:tasks.workunit.client.0.smithi033.stdout:4/819: chown d4/d20/f9 578 1 2024-02-15T18:31:09.636 INFO:tasks.workunit.client.0.smithi033.stdout:4/820: chown d4/d20/c8 7763 1 2024-02-15T18:31:09.637 INFO:tasks.workunit.client.0.smithi033.stdout:4/821: creat d4/d5/d28/d39/d62/f114 x:0 0 0 2024-02-15T18:31:09.637 INFO:tasks.workunit.client.0.smithi033.stdout:4/822: readlink d4/d20/d13/d5c/dd1/leb 0 2024-02-15T18:31:09.642 INFO:tasks.workunit.client.0.smithi033.stdout:9/645: dwrite d4/d8/d1b/d2f/d65/d8b/d95/fbe [0,4194304] 0 2024-02-15T18:31:09.643 INFO:tasks.workunit.client.0.smithi033.stdout:8/709: dwrite d0/df/d53/db3/d30/d8e/d14/d56/fbe [0,4194304] 0 2024-02-15T18:31:09.648 INFO:tasks.workunit.client.0.smithi033.stdout:4/823: symlink d4/d5/dc9/l115 0 2024-02-15T18:31:09.650 INFO:tasks.workunit.client.0.smithi033.stdout:9/646: link d4/d32/d6c/f8c d4/d8/d1b/d73/fd5 0 2024-02-15T18:31:09.656 INFO:tasks.workunit.client.0.smithi033.stdout:8/710: symlink d0/df/d48/le8 0 2024-02-15T18:31:09.657 INFO:tasks.workunit.client.0.smithi033.stdout:4/824: creat d4/d20/d13/dca/f116 x:0 0 0 2024-02-15T18:31:09.660 INFO:tasks.workunit.client.0.smithi033.stdout:7/741: sync 2024-02-15T18:31:09.660 INFO:tasks.workunit.client.0.smithi033.stdout:0/687: sync 2024-02-15T18:31:09.660 INFO:tasks.workunit.client.0.smithi033.stdout:5/840: sync 2024-02-15T18:31:09.662 INFO:tasks.workunit.client.0.smithi033.stdout:7/742: unlink d0/dc/d10/d1d/d2b/d5f/d63/l75 0 2024-02-15T18:31:09.662 INFO:tasks.workunit.client.0.smithi033.stdout:7/743: chown d0/dc/d10/f78 65 1 2024-02-15T18:31:09.662 INFO:tasks.workunit.client.0.smithi033.stdout:7/744: fsync d0/dc/d10/d48/f6f 0 2024-02-15T18:31:09.662 INFO:tasks.workunit.client.0.smithi033.stdout:5/841: unlink d1/da/d19/d3f/d68/df2/c108 0 2024-02-15T18:31:09.663 INFO:tasks.workunit.client.0.smithi033.stdout:0/688: creat d0/d8/d15/d5b/feb x:0 0 0 2024-02-15T18:31:09.665 INFO:tasks.workunit.client.0.smithi033.stdout:7/745: symlink d0/dc/d10/d1d/d38/d74/de7/dfa/l102 0 2024-02-15T18:31:09.667 INFO:tasks.workunit.client.0.smithi033.stdout:0/689: read d0/fad [2536324,40765] 0 2024-02-15T18:31:09.673 INFO:tasks.workunit.client.0.smithi033.stdout:9/647: dwrite d4/d8/dd/d41/f4e [0,4194304] 0 2024-02-15T18:31:09.676 INFO:tasks.workunit.client.0.smithi033.stdout:8/711: truncate d0/df/d53/db3/d30/d8e/d14/d56/fbe 4022799 0 2024-02-15T18:31:09.677 INFO:tasks.workunit.client.0.smithi033.stdout:4/825: dread d4/d5/d28/d39/f79 [0,4194304] 0 2024-02-15T18:31:09.678 INFO:tasks.workunit.client.0.smithi033.stdout:9/648: mknod d4/d8/dd/d41/cd6 0 2024-02-15T18:31:09.679 INFO:tasks.workunit.client.0.smithi033.stdout:9/649: readlink d4/d8/d1b/lb0 0 2024-02-15T18:31:09.679 INFO:tasks.workunit.client.0.smithi033.stdout:9/650: truncate d4/d8/dd/d5c/fa1 4503667 0 2024-02-15T18:31:09.679 INFO:tasks.workunit.client.0.smithi033.stdout:9/651: stat d4/d8/c26 0 2024-02-15T18:31:09.679 INFO:tasks.workunit.client.0.smithi033.stdout:9/652: chown d4/d2c/db1 34810 1 2024-02-15T18:31:09.679 INFO:tasks.workunit.client.0.smithi033.stdout:9/653: chown d4/d8/dd/f15 4136 1 2024-02-15T18:31:09.679 INFO:tasks.workunit.client.0.smithi033.stdout:8/712: mknod d0/df/d53/db3/d30/d8e/d35/d29/ce9 0 2024-02-15T18:31:09.680 INFO:tasks.workunit.client.0.smithi033.stdout:9/654: unlink d4/d32/lc1 0 2024-02-15T18:31:09.681 INFO:tasks.workunit.client.0.smithi033.stdout:8/713: getdents d0/df/d53/db3/d30/d8e/d14/d56/db0 0 2024-02-15T18:31:09.683 INFO:tasks.workunit.client.0.smithi033.stdout:8/714: getdents d0/df/d53/db3/d30/d8e/d8f 0 2024-02-15T18:31:09.689 INFO:tasks.workunit.client.0.smithi033.stdout:7/746: dwrite d0/d56/d70/fd4 [0,4194304] 0 2024-02-15T18:31:09.691 INFO:tasks.workunit.client.0.smithi033.stdout:5/842: dread d1/da/d11/d5e/db1/f77 [0,4194304] 0 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:0/690: dwrite d0/d8/d15/d8b/da3/dae/d58/f61 [0,4194304] 0 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:0/691: fdatasync d0/d8/d15/f70 0 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:0/692: chown d0/d8/le 5 1 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:0/693: chown d0/d8/d15/d8b/da3/dae/d58/d77 35752 1 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:0/694: stat d0/d8/d15/d8b/da3/dae/d58/d80/d9b/fce 0 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:8/715: dread d0/df/db/d45/f4a [0,4194304] 0 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:5/843: unlink d1/da/c80 0 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:8/716: write d0/df/db/fde [466058,130134] 0 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:4/826: dread d4/f22 [0,4194304] 0 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:4/827: chown d4/d20/fbf 9623359 1 2024-02-15T18:31:09.694 INFO:tasks.workunit.client.0.smithi033.stdout:4/828: dread - d4/d3c/f104 zero size 2024-02-15T18:31:09.695 INFO:tasks.workunit.client.0.smithi033.stdout:5/844: truncate d1/da/d19/d3f/fa9 3110571 0 2024-02-15T18:31:09.696 INFO:tasks.workunit.client.0.smithi033.stdout:8/717: creat d0/df/d48/fea x:0 0 0 2024-02-15T18:31:09.696 INFO:tasks.workunit.client.0.smithi033.stdout:8/718: truncate d0/df/db/d45/f8a 1020600 0 2024-02-15T18:31:09.696 INFO:tasks.workunit.client.0.smithi033.stdout:0/695: write d0/d2/f3c [1978672,83555] 0 2024-02-15T18:31:09.699 INFO:tasks.workunit.client.0.smithi033.stdout:9/655: dwrite d4/d8/d1b/d73/f8e [0,4194304] 0 2024-02-15T18:31:09.699 INFO:tasks.workunit.client.0.smithi033.stdout:5/845: rename d1/da/d52/dd8 to d1/da/d10/d2b/d42/d4c/d116 0 2024-02-15T18:31:09.707 INFO:tasks.workunit.client.0.smithi033.stdout:7/747: dread d0/dc/d10/d1d/d2b/d5f/f71 [4194304,4194304] 0 2024-02-15T18:31:09.707 INFO:tasks.workunit.client.0.smithi033.stdout:9/656: write d4/d8/dd/f23 [2955110,28431] 0 2024-02-15T18:31:09.711 INFO:tasks.workunit.client.0.smithi033.stdout:8/719: mkdir d0/df/d53/db3/d30/d8e/d35/d58/deb 0 2024-02-15T18:31:09.711 INFO:tasks.workunit.client.0.smithi033.stdout:8/720: chown d0/df/db/fd5 97306181 1 2024-02-15T18:31:09.711 INFO:tasks.workunit.client.0.smithi033.stdout:0/696: rename d0/d8/d15/d7c to d0/de8/d8d/dec 0 2024-02-15T18:31:09.711 INFO:tasks.workunit.client.0.smithi033.stdout:5/846: symlink d1/da/d10/d2b/d42/d4c/d116/l117 0 2024-02-15T18:31:09.711 INFO:tasks.workunit.client.0.smithi033.stdout:0/697: write d0/d2/f75 [577905,65829] 0 2024-02-15T18:31:09.712 INFO:tasks.workunit.client.0.smithi033.stdout:7/748: link d0/dc/d10/da1/fe6 d0/dc/d10/da1/f103 0 2024-02-15T18:31:09.713 INFO:tasks.workunit.client.0.smithi033.stdout:9/657: rmdir d4/d8/d1b/d2f/d65/d8b/d95 39 2024-02-15T18:31:09.713 INFO:tasks.workunit.client.0.smithi033.stdout:9/658: chown d4 694 1 2024-02-15T18:31:09.714 INFO:tasks.workunit.client.0.smithi033.stdout:7/749: write d0/f1 [303646,23169] 0 2024-02-15T18:31:09.715 INFO:tasks.workunit.client.0.smithi033.stdout:7/750: chown d0/dc/d10/d7d/d99/lf1 26 1 2024-02-15T18:31:09.715 INFO:tasks.workunit.client.0.smithi033.stdout:0/698: write d0/d8/d15/d8b/da3/d6c/f46 [211367,111395] 0 2024-02-15T18:31:09.716 INFO:tasks.workunit.client.0.smithi033.stdout:5/847: mknod d1/da/d19/d3f/c118 0 2024-02-15T18:31:09.716 INFO:tasks.workunit.client.0.smithi033.stdout:5/848: dread - d1/da/d10/d2b/d42/d4c/d116/d40/d9a/fef zero size 2024-02-15T18:31:09.716 INFO:tasks.workunit.client.0.smithi033.stdout:4/829: dwrite d4/d20/d13/d34/d82/fb6 [0,4194304] 0 2024-02-15T18:31:09.717 INFO:tasks.workunit.client.0.smithi033.stdout:4/830: fdatasync d4/d5/d28/d39/d62/d9c/d9e/da4/fd6 0 2024-02-15T18:31:09.718 INFO:tasks.workunit.client.0.smithi033.stdout:9/659: mkdir d4/d8/d1b/d2f/dd7 0 2024-02-15T18:31:09.718 INFO:tasks.workunit.client.0.smithi033.stdout:7/751: mknod d0/dc/d10/d1d/d38/d74/de7/c104 0 2024-02-15T18:31:09.718 INFO:tasks.workunit.client.0.smithi033.stdout:7/752: truncate d0/d56/d8e/fee 1018809 0 2024-02-15T18:31:09.721 INFO:tasks.workunit.client.0.smithi033.stdout:5/849: creat d1/da/d19/d3f/d68/df2/f119 x:0 0 0 2024-02-15T18:31:09.721 INFO:tasks.workunit.client.0.smithi033.stdout:5/850: fdatasync d1/da/d10/d2b/d42/d4c/fa0 0 2024-02-15T18:31:09.721 INFO:tasks.workunit.client.0.smithi033.stdout:5/851: fsync d1/da/d19/fad 0 2024-02-15T18:31:09.724 INFO:tasks.workunit.client.0.smithi033.stdout:4/831: truncate d4/d20/d13/d1b/f6a 775104 0 2024-02-15T18:31:09.726 INFO:tasks.workunit.client.0.smithi033.stdout:7/753: unlink d0/dc/d10/d1d/d38/d74/lc9 0 2024-02-15T18:31:09.727 INFO:tasks.workunit.client.0.smithi033.stdout:5/852: getdents d1/da/d52 0 2024-02-15T18:31:09.727 INFO:tasks.workunit.client.0.smithi033.stdout:5/853: chown d1/da/d10/d2b/d42/d4c/d116/d40/d65 1960291780 1 2024-02-15T18:31:09.728 INFO:tasks.workunit.client.0.smithi033.stdout:4/832: dread d4/d20/d53/f61 [0,4194304] 0 2024-02-15T18:31:09.731 INFO:tasks.workunit.client.0.smithi033.stdout:7/754: mknod d0/dc/d10/d1d/d38/daa/c105 0 2024-02-15T18:31:09.732 INFO:tasks.workunit.client.0.smithi033.stdout:0/699: dwrite d0/d8/d15/d2d/fe9 [0,4194304] 0 2024-02-15T18:31:09.732 INFO:tasks.workunit.client.0.smithi033.stdout:5/854: symlink d1/da/d52/d10e/l11a 0 2024-02-15T18:31:09.733 INFO:tasks.workunit.client.0.smithi033.stdout:7/755: mknod d0/dc/d10/d1d/d38/d74/d7f/da2/c106 0 2024-02-15T18:31:09.735 INFO:tasks.workunit.client.0.smithi033.stdout:7/756: read d0/d56/d70/d83/fde [1524550,24827] 0 2024-02-15T18:31:09.736 INFO:tasks.workunit.client.0.smithi033.stdout:7/757: fdatasync d0/dc/d10/d7d/d93/dc2/f85 0 2024-02-15T18:31:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.743+0000 7fd709f8f700 1 -- 172.21.15.33:0/994521964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406a3b0 msgr2=0x7fd70406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.743+0000 7fd709f8f700 1 --2- 172.21.15.33:0/994521964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406a3b0 0x7fd70406a830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fd6f8004660 tx=0x7fd6f8009b30).stop 2024-02-15T18:31:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.744+0000 7fd709f8f700 1 -- 172.21.15.33:0/994521964 shutdown_connections 2024-02-15T18:31:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.744+0000 7fd709f8f700 1 --2- 172.21.15.33:0/994521964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406a3b0 0x7fd70406a830 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.744+0000 7fd709f8f700 1 --2- 172.21.15.33:0/994521964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70406b9c0 0x7fd704069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.744+0000 7fd709f8f700 1 -- 172.21.15.33:0/994521964 >> 172.21.15.33:0/994521964 conn(0x7fd7040f1e40 msgr2=0x7fd7040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.744+0000 7fd709f8f700 1 -- 172.21.15.33:0/994521964 shutdown_connections 2024-02-15T18:31:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.744+0000 7fd709f8f700 1 -- 172.21.15.33:0/994521964 wait complete. 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.744+0000 7fd709f8f700 1 Processor -- start 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd709f8f700 1 -- start start 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd709f8f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70406a3b0 0x7fd7040f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd709f8f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406b9c0 0x7fd7040f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd709f8f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7040f7110 con 0x7fd70406b9c0 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd709f8f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7040f79c0 con 0x7fd70406a3b0 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd702ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406b9c0 0x7fd7040f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd702ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406b9c0 0x7fd7040f6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45152/0 (socket says 172.21.15.33:45152) 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd702ffd700 1 -- 172.21.15.33:0/1083674591 learned_addr learned my addr 172.21.15.33:0/1083674591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd702ffd700 1 -- 172.21.15.33:0/1083674591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70406a3b0 msgr2=0x7fd7040f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd702ffd700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70406a3b0 0x7fd7040f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.745+0000 7fd702ffd700 1 -- 172.21.15.33:0/1083674591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8005040 con 0x7fd70406b9c0 2024-02-15T18:31:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.746+0000 7fd702ffd700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406b9c0 0x7fd7040f6a80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd6f8009830 tx=0x7fd6f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.746+0000 7fd6ebfff700 1 -- 172.21.15.33:0/1083674591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6f8018070 con 0x7fd70406b9c0 2024-02-15T18:31:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.746+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7040f7c10 con 0x7fd70406b9c0 2024-02-15T18:31:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.746+0000 7fd6ebfff700 1 -- 172.21.15.33:0/1083674591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd6f8007ca0 con 0x7fd70406b9c0 2024-02-15T18:31:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.746+0000 7fd6ebfff700 1 -- 172.21.15.33:0/1083674591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6f801c620 con 0x7fd70406b9c0 2024-02-15T18:31:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.746+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7040f8170 con 0x7fd70406b9c0 2024-02-15T18:31:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.747+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7040f5ad0 con 0x7fd70406b9c0 2024-02-15T18:31:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.748+0000 7fd6ebfff700 1 -- 172.21.15.33:0/1083674591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 74714+0+0 (secure 0 0 0) 0x7fd6f801d9a0 con 0x7fd70406b9c0 2024-02-15T18:31:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.748+0000 7fd6ebfff700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fd6ec05e960 0x7fd6ec060e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.748+0000 7fd6ebfff700 1 -- 172.21.15.33:0/1083674591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd6f807ae90 con 0x7fd70406b9c0 2024-02-15T18:31:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.749+0000 7fd7037fe700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fd6ec05e960 0x7fd6ec060e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.749+0000 7fd7037fe700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fd6ec05e960 0x7fd6ec060e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd7040f6320 tx=0x7fd6f40069d0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:09.744 INFO:tasks.workunit.client.0.smithi033.stdout:0/700: truncate d0/d8/d15/d2d/f4a 949000 0 2024-02-15T18:31:09.744 INFO:tasks.workunit.client.0.smithi033.stdout:7/758: getdents d0/dc/d10/d7d/d99 0 2024-02-15T18:31:09.744 INFO:tasks.workunit.client.0.smithi033.stdout:0/701: stat d0/d8/d15/d2d/d41/de6/ld4 0 2024-02-15T18:31:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:09.755+0000 7fd6ebfff700 1 -- 172.21.15.33:0/1083674591 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7fd6f804b380 con 0x7fd70406b9c0 2024-02-15T18:31:09.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:07.524860+0000 mgr.smithi131.buibla (mgr.24387) 23 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 93 MiB/s rd, 198 MiB/s wr, 309 op/s 2024-02-15T18:31:09.749 INFO:tasks.workunit.client.0.smithi033.stdout:0/702: unlink d0/de8/d8d/dec/da4/fa8 0 2024-02-15T18:31:09.750 INFO:tasks.workunit.client.0.smithi033.stdout:7/759: rename d0/d56/c6d to d0/dc/d10/d1d/d38/d82/c107 0 2024-02-15T18:31:09.751 INFO:tasks.workunit.client.0.smithi033.stdout:0/703: symlink d0/d8/d15/d2d/d41/led 0 2024-02-15T18:31:09.752 INFO:tasks.workunit.client.0.smithi033.stdout:0/704: readlink d0/d8/d15/d8b/da3/dae/d58/d80/dc1/le3 0 2024-02-15T18:31:09.752 INFO:tasks.workunit.client.0.smithi033.stdout:0/705: write d0/d8/d15/d8b/da3/dae/d58/d80/dc1/fc9 [653287,93246] 0 2024-02-15T18:31:09.752 INFO:tasks.workunit.client.0.smithi033.stdout:0/706: chown d0/d8/d15/d5b 1 1 2024-02-15T18:31:09.752 INFO:tasks.workunit.client.0.smithi033.stdout:0/707: truncate d0/f78 4622749 0 2024-02-15T18:31:09.752 INFO:tasks.workunit.client.0.smithi033.stdout:7/760: read d0/f1 [203994,44013] 0 2024-02-15T18:31:09.753 INFO:tasks.workunit.client.0.smithi033.stdout:7/761: mkdir d0/dc/d10/d1d/d38/d74/d7f/da2/d108 0 2024-02-15T18:31:09.754 INFO:tasks.workunit.client.0.smithi033.stdout:7/762: dread d0/f5e [0,4194304] 0 2024-02-15T18:31:09.755 INFO:tasks.workunit.client.0.smithi033.stdout:4/833: dwrite d4/d20/d13/d1b/f109 [0,4194304] 0 2024-02-15T18:31:09.756 INFO:tasks.workunit.client.0.smithi033.stdout:5/855: dwrite d1/da/d10/f26 [0,4194304] 0 2024-02-15T18:31:09.756 INFO:tasks.workunit.client.0.smithi033.stdout:7/763: rename d0/dc/d10/d1d/d38/d82/def to d0/dc/d10/d48/d109 0 2024-02-15T18:31:09.757 INFO:tasks.workunit.client.0.smithi033.stdout:7/764: write d0/dc/f65 [3672019,125922] 0 2024-02-15T18:31:09.757 INFO:tasks.workunit.client.0.smithi033.stdout:0/708: dread d0/d8/fb [0,4194304] 0 2024-02-15T18:31:09.765 INFO:tasks.workunit.client.0.smithi033.stdout:4/834: mkdir d4/d5/d28/d39/dee/d117 0 2024-02-15T18:31:09.767 INFO:tasks.workunit.client.0.smithi033.stdout:4/835: dread d4/d3c/fd7 [0,4194304] 0 2024-02-15T18:31:09.768 INFO:tasks.workunit.client.0.smithi033.stdout:5/856: mknod d1/da/d10/d2b/d42/d4c/d116/d40/d9a/dfd/c11b 0 2024-02-15T18:31:09.773 INFO:tasks.workunit.client.0.smithi033.stdout:7/765: link d0/cfd d0/d56/d70/c10a 0 2024-02-15T18:31:09.774 INFO:tasks.workunit.client.0.smithi033.stdout:5/857: write d1/da/f41 [7690966,50931] 0 2024-02-15T18:31:09.774 INFO:tasks.workunit.client.0.smithi033.stdout:2/814: sync 2024-02-15T18:31:09.775 INFO:tasks.workunit.client.0.smithi033.stdout:3/802: sync 2024-02-15T18:31:09.779 INFO:tasks.workunit.client.0.smithi033.stdout:7/766: getdents d0/dc/d10/d1d/d2b/d5f/d63 0 2024-02-15T18:31:09.779 INFO:tasks.workunit.client.0.smithi033.stdout:7/767: readlink d0/dc/d10/d7d/l58 0 2024-02-15T18:31:09.779 INFO:tasks.workunit.client.0.smithi033.stdout:7/768: chown d0/dc/d10/da1/fe6 213 1 2024-02-15T18:31:09.781 INFO:tasks.workunit.client.0.smithi033.stdout:5/858: unlink d1/dc3/l10f 0 2024-02-15T18:31:09.784 INFO:tasks.workunit.client.0.smithi033.stdout:3/803: rename d2/d3/d1e/d22/fc9 to d2/d14/d23/d5c/d61/de2/ffe 0 2024-02-15T18:31:09.786 INFO:tasks.workunit.client.0.smithi033.stdout:5/859: link d1/da/d10/f8c d1/da/d10/d2b/d42/d4c/f11c 0 2024-02-15T18:31:09.786 INFO:tasks.workunit.client.0.smithi033.stdout:3/804: chown d2/d3/d17/l96 490770 1 2024-02-15T18:31:09.787 INFO:tasks.workunit.client.0.smithi033.stdout:5/860: symlink d1/da/d11/d5e/db1/d63/d61/daf/l11d 0 2024-02-15T18:31:09.788 INFO:tasks.workunit.client.0.smithi033.stdout:3/805: getdents d2/d14/db3/dba 0 2024-02-15T18:31:09.788 INFO:tasks.workunit.client.0.smithi033.stdout:3/806: chown d2/d14/db3/fcd 0 1 2024-02-15T18:31:09.789 INFO:tasks.workunit.client.0.smithi033.stdout:5/861: unlink d1/dc3/cd5 0 2024-02-15T18:31:09.789 INFO:tasks.workunit.client.0.smithi033.stdout:5/862: fdatasync d1/da/d10/d2b/d42/f44 0 2024-02-15T18:31:09.789 INFO:tasks.workunit.client.0.smithi033.stdout:5/863: chown d1/da/d10/d2b/d42/d4c/d116/d40/c87 580896744 1 2024-02-15T18:31:09.790 INFO:tasks.workunit.client.0.smithi033.stdout:3/807: mknod d2/dfa/cff 0 2024-02-15T18:31:09.790 INFO:tasks.workunit.client.0.smithi033.stdout:4/836: dwrite d4/f21 [0,4194304] 0 2024-02-15T18:31:09.796 INFO:tasks.workunit.client.0.smithi033.stdout:5/864: truncate d1/da/d10/d2b/d42/d4c/d116/d40/f31 2311921 0 2024-02-15T18:31:09.797 INFO:tasks.workunit.client.0.smithi033.stdout:4/837: getdents d4/d5/d28/d39/dee 0 2024-02-15T18:31:09.797 INFO:tasks.workunit.client.0.smithi033.stdout:7/769: dwrite d0/dc/f5d [0,4194304] 0 2024-02-15T18:31:09.798 INFO:tasks.workunit.client.0.smithi033.stdout:2/815: dwrite d20/d3a/f5d [0,4194304] 0 2024-02-15T18:31:09.798 INFO:tasks.workunit.client.0.smithi033.stdout:5/865: rename d1/da/d11/fa2 to d1/da/d52/f11e 0 2024-02-15T18:31:09.798 INFO:tasks.workunit.client.0.smithi033.stdout:5/866: truncate d1/da/d10/d2b/f4d 1115602 0 2024-02-15T18:31:09.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:07.524860+0000 mgr.smithi131.buibla (mgr.24387) 23 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 93 MiB/s rd, 198 MiB/s wr, 309 op/s 2024-02-15T18:31:09.799 INFO:tasks.workunit.client.0.smithi033.stdout:3/808: symlink d2/d3/d1e/d22/d59/l100 0 2024-02-15T18:31:09.828 INFO:tasks.workunit.client.0.smithi033.stdout:7/770: mknod d0/dc/d10/d7d/c10b 0 2024-02-15T18:31:09.829 INFO:tasks.workunit.client.0.smithi033.stdout:4/838: creat d4/d20/d13/d5c/d87/dd0/de5/f118 x:0 0 0 2024-02-15T18:31:09.829 INFO:tasks.workunit.client.0.smithi033.stdout:4/839: dread - d4/d3c/f104 zero size 2024-02-15T18:31:09.832 INFO:tasks.workunit.client.0.smithi033.stdout:2/816: mknod d20/d31/d47/d4c/def/d80/da5/c121 0 2024-02-15T18:31:09.832 INFO:tasks.workunit.client.0.smithi033.stdout:5/867: symlink d1/da/d19/d3f/l11f 0 2024-02-15T18:31:09.833 INFO:tasks.workunit.client.0.smithi033.stdout:3/809: creat d2/d3/df/d6c/f101 x:0 0 0 2024-02-15T18:31:09.836 INFO:tasks.workunit.client.0.smithi033.stdout:7/771: mkdir d0/dc/d10/d48/d109/d10c 0 2024-02-15T18:31:09.836 INFO:tasks.workunit.client.0.smithi033.stdout:4/840: mknod d4/d20/d13/d5c/d87/dd0/c119 0 2024-02-15T18:31:09.838 INFO:tasks.workunit.client.0.smithi033.stdout:4/841: write d4/d5/d28/f36 [6698285,61750] 0 2024-02-15T18:31:09.840 INFO:tasks.workunit.client.0.smithi033.stdout:4/842: link d4/d20/d13/d1b/d81/ca5 d4/d5/d28/d39/dee/d117/c11a 0 2024-02-15T18:31:09.841 INFO:tasks.workunit.client.0.smithi033.stdout:4/843: unlink d4/d20/d37/f44 0 2024-02-15T18:31:09.859 INFO:tasks.workunit.client.0.smithi033.stdout:6/788: sync 2024-02-15T18:31:09.859 INFO:tasks.workunit.client.0.smithi033.stdout:6/789: write d8/d70/fea [616690,103777] 0 2024-02-15T18:31:09.860 INFO:tasks.workunit.client.0.smithi033.stdout:1/772: sync 2024-02-15T18:31:09.860 INFO:tasks.workunit.client.0.smithi033.stdout:1/773: chown d5/l4f 431 1 2024-02-15T18:31:09.860 INFO:tasks.workunit.client.0.smithi033.stdout:5/868: dwrite d1/da/d11/f30 [0,4194304] 0 2024-02-15T18:31:09.860 INFO:tasks.workunit.client.0.smithi033.stdout:6/790: symlink d8/d28/d14/d2c/d31/d30/d29/d38/dae/lf6 0 2024-02-15T18:31:09.861 INFO:tasks.workunit.client.0.smithi033.stdout:1/774: creat d5/d9/d1e/d20/d5c/d57/d82/ff9 x:0 0 0 2024-02-15T18:31:09.862 INFO:tasks.workunit.client.0.smithi033.stdout:5/869: creat d1/da/d11/d5e/db1/f120 x:0 0 0 2024-02-15T18:31:09.863 INFO:tasks.workunit.client.0.smithi033.stdout:6/791: rename d8/d1d/d37/d4f/f6f to d8/ff7 0 2024-02-15T18:31:09.866 INFO:tasks.workunit.client.0.smithi033.stdout:1/775: unlink d5/d9/d1e/d20/f50 0 2024-02-15T18:31:09.866 INFO:tasks.workunit.client.0.smithi033.stdout:6/792: creat d8/d28/d14/d2c/d31/d30/d29/d67/ff8 x:0 0 0 2024-02-15T18:31:09.867 INFO:tasks.workunit.client.0.smithi033.stdout:1/776: creat d5/dd/d12/dc6/dd4/ffa x:0 0 0 2024-02-15T18:31:09.867 INFO:tasks.workunit.client.0.smithi033.stdout:1/777: dread - d5/d9/d1e/d20/d5c/d57/d82/ff9 zero size 2024-02-15T18:31:09.867 INFO:tasks.workunit.client.0.smithi033.stdout:1/778: chown d5/dd/d12/fe3 0 1 2024-02-15T18:31:09.867 INFO:tasks.workunit.client.0.smithi033.stdout:1/779: read d5/d9/d1e/d20/d2c/d65/f75 [46792,36719] 0 2024-02-15T18:31:09.868 INFO:tasks.workunit.client.0.smithi033.stdout:1/780: chown d5/d9/d1e/d20/d5c/d8d/fc8 5 1 2024-02-15T18:31:09.869 INFO:tasks.workunit.client.0.smithi033.stdout:3/810: dwrite d2/d14/db3/dba/fbf [0,4194304] 0 2024-02-15T18:31:09.869 INFO:tasks.workunit.client.0.smithi033.stdout:7/772: dwrite d0/d56/d70/fd4 [0,4194304] 0 2024-02-15T18:31:09.869 INFO:tasks.workunit.client.0.smithi033.stdout:7/773: write d0/dc/d10/d1d/d38/d74/d7f/f98 [62699,43588] 0 2024-02-15T18:31:09.869 INFO:tasks.workunit.client.0.smithi033.stdout:4/844: dwrite d4/f54 [0,4194304] 0 2024-02-15T18:31:09.869 INFO:tasks.workunit.client.0.smithi033.stdout:4/845: write d4/d20/fb [4801573,26725] 0 2024-02-15T18:31:09.870 INFO:tasks.workunit.client.0.smithi033.stdout:4/846: truncate d4/d5/d28/f47 4229904 0 2024-02-15T18:31:09.872 INFO:tasks.workunit.client.0.smithi033.stdout:6/793: write d8/d28/d14/d2c/d31/d30/d29/d38/dae/fb4 [1353783,62425] 0 2024-02-15T18:31:09.872 INFO:tasks.workunit.client.0.smithi033.stdout:1/781: write d5/dd/d12/d49/d23/f26 [3589648,101523] 0 2024-02-15T18:31:09.873 INFO:tasks.workunit.client.0.smithi033.stdout:4/847: link d4/d20/d13/d1b/d81/d9f/fab d4/d20/d13/d34/d82/df5/d106/db5/f11b 0 2024-02-15T18:31:09.873 INFO:tasks.workunit.client.0.smithi033.stdout:4/848: fdatasync d4/d20/d13/d5c/d87/dd0/de5/f118 0 2024-02-15T18:31:09.873 INFO:tasks.workunit.client.0.smithi033.stdout:3/811: mknod d2/d3/df/c102 0 2024-02-15T18:31:09.875 INFO:tasks.workunit.client.0.smithi033.stdout:6/794: rename d8/d28/d14/d2c/d31/d30/d29/l52 to d8/d28/d14/d2c/lf9 0 2024-02-15T18:31:09.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/795: write d8/d28/d14/d2c/d31/ded/d5e/fb7 [124577,36243] 0 2024-02-15T18:31:09.878 INFO:tasks.workunit.client.0.smithi033.stdout:6/796: readlink d8/d28/d14/d2c/d31/d30/lb2 0 2024-02-15T18:31:09.878 INFO:tasks.workunit.client.0.smithi033.stdout:6/797: readlink d8/d28/d14/d2c/d31/d5d/d8c/ld9 0 2024-02-15T18:31:09.878 INFO:tasks.workunit.client.0.smithi033.stdout:6/798: fsync d8/f6e 0 2024-02-15T18:31:09.878 INFO:tasks.workunit.client.0.smithi033.stdout:4/849: creat d4/d20/d13/d1b/d81/d8b/f11c x:0 0 0 2024-02-15T18:31:09.879 INFO:tasks.workunit.client.0.smithi033.stdout:6/799: getdents d8/d1d/d37/d4f/dbb/d55/d60/dd6 0 2024-02-15T18:31:09.880 INFO:tasks.workunit.client.0.smithi033.stdout:4/850: mkdir d4/d5/d28/d39/d62/dfa/d11d 0 2024-02-15T18:31:09.881 INFO:tasks.workunit.client.0.smithi033.stdout:4/851: rmdir d4/d20/d53 39 2024-02-15T18:31:09.882 INFO:tasks.workunit.client.0.smithi033.stdout:5/870: dwrite d1/da/f1b [4194304,4194304] 0 2024-02-15T18:31:09.888 INFO:tasks.workunit.client.0.smithi033.stdout:5/871: dread d1/da/d11/f7c [0,4194304] 0 2024-02-15T18:31:09.891 INFO:tasks.workunit.client.0.smithi033.stdout:5/872: rename d1/da/d11/d5e/db1/d63/d61/daf/cec to d1/da/d10/d2b/c121 0 2024-02-15T18:31:09.891 INFO:tasks.workunit.client.0.smithi033.stdout:6/800: dread d8/d1d/d37/d4f/dbb/d55/d63/f7a [8388608,4194304] 0 2024-02-15T18:31:09.891 INFO:tasks.workunit.client.0.smithi033.stdout:6/801: fdatasync d8/d1d/d37/d4f/dbb/d55/d63/f7a 0 2024-02-15T18:31:09.891 INFO:tasks.workunit.client.0.smithi033.stdout:6/802: chown d8/d1d/d37/d4f/dbb/d55/d63 57945300 1 2024-02-15T18:31:09.891 INFO:tasks.workunit.client.0.smithi033.stdout:6/803: chown d8/c26 51 1 2024-02-15T18:31:09.892 INFO:tasks.workunit.client.0.smithi033.stdout:5/873: mknod d1/da/d19/d3f/d68/c122 0 2024-02-15T18:31:09.895 INFO:tasks.workunit.client.0.smithi033.stdout:7/774: dwrite d0/d56/fc1 [0,4194304] 0 2024-02-15T18:31:09.899 INFO:tasks.workunit.client.0.smithi033.stdout:6/804: dread d8/f90 [0,4194304] 0 2024-02-15T18:31:09.899 INFO:tasks.workunit.client.0.smithi033.stdout:1/782: dwrite d5/d9/d1e/d20/d2c/d34/dc0/fd3 [0,4194304] 0 2024-02-15T18:31:09.904 INFO:tasks.workunit.client.0.smithi033.stdout:7/775: dread d0/dc/d10/d1d/d2b/d5f/d63/f79 [0,4194304] 0 2024-02-15T18:31:09.907 INFO:tasks.workunit.client.0.smithi033.stdout:5/874: dwrite d1/da/d19/da6/faa [0,4194304] 0 2024-02-15T18:31:09.918 INFO:tasks.workunit.client.0.smithi033.stdout:1/783: mkdir d5/d9/d1e/d20/dfb 0 2024-02-15T18:31:09.920 INFO:tasks.workunit.client.0.smithi033.stdout:6/805: creat d8/d1d/d37/d4f/dbb/d55/ffa x:0 0 0 2024-02-15T18:31:09.920 INFO:tasks.workunit.client.0.smithi033.stdout:6/806: write d8/d1d/f3c [6907544,54511] 0 2024-02-15T18:31:09.920 INFO:tasks.workunit.client.0.smithi033.stdout:6/807: chown d8/d28/d14/d2c/de7 60894 1 2024-02-15T18:31:09.920 INFO:tasks.workunit.client.0.smithi033.stdout:6/808: chown d8/d28/d14/d2c/d31/d5d/d8c/ld9 89 1 2024-02-15T18:31:09.921 INFO:tasks.workunit.client.0.smithi033.stdout:7/776: rename d0/lb7 to d0/dc/d10/d1d/d38/d74/de7/dfa/l10d 0 2024-02-15T18:31:09.925 INFO:tasks.workunit.client.0.smithi033.stdout:1/784: mknod d5/d96/dc9/cfc 0 2024-02-15T18:31:09.926 INFO:tasks.workunit.client.0.smithi033.stdout:5/875: dwrite d1/da/fb6 [0,4194304] 0 2024-02-15T18:31:09.927 INFO:tasks.workunit.client.0.smithi033.stdout:7/777: symlink d0/dc/l10e 0 2024-02-15T18:31:09.927 INFO:tasks.workunit.client.0.smithi033.stdout:7/778: chown d0/dc/d10/d1d/d2b/d5f/d63/fba 552 1 2024-02-15T18:31:09.927 INFO:tasks.workunit.client.0.smithi033.stdout:9/660: sync 2024-02-15T18:31:09.927 INFO:tasks.workunit.client.0.smithi033.stdout:0/709: sync 2024-02-15T18:31:09.927 INFO:tasks.workunit.client.0.smithi033.stdout:9/661: stat d4/d8/dd/d28/d6b/l98 0 2024-02-15T18:31:09.927 INFO:tasks.workunit.client.0.smithi033.stdout:9/662: truncate d4/d8/d1b/d73/f8e 5063959 0 2024-02-15T18:31:09.929 INFO:tasks.workunit.client.0.smithi033.stdout:8/721: sync 2024-02-15T18:31:09.929 INFO:tasks.workunit.client.0.smithi033.stdout:1/785: truncate d5/d17/f5e 2050890 0 2024-02-15T18:31:09.931 INFO:tasks.workunit.client.0.smithi033.stdout:6/809: dread d8/d28/d14/d2c/d31/d5d/d8c/fbe [0,4194304] 0 2024-02-15T18:31:09.934 INFO:tasks.workunit.client.0.smithi033.stdout:5/876: link d1/da/d19/d74/l100 d1/da/d11/d5e/l123 0 2024-02-15T18:31:09.935 INFO:tasks.workunit.client.0.smithi033.stdout:5/877: write d1/da/d10/d2b/d42/d4c/d116/d40/d9a/f9d [1805619,58502] 0 2024-02-15T18:31:09.936 INFO:tasks.workunit.client.0.smithi033.stdout:7/779: mkdir d0/dc/d10/da1/d10f 0 2024-02-15T18:31:09.936 INFO:tasks.workunit.client.0.smithi033.stdout:7/780: chown d0/dc/d10/d1d/d38/daa/lb4 152 1 2024-02-15T18:31:09.936 INFO:tasks.workunit.client.0.smithi033.stdout:5/878: write d1/fa4 [322153,122959] 0 2024-02-15T18:31:09.937 INFO:tasks.workunit.client.0.smithi033.stdout:5/879: stat d1/da/d10/d2b/cb9 0 2024-02-15T18:31:09.937 INFO:tasks.workunit.client.0.smithi033.stdout:0/710: rename d0/c7e to d0/de8/d97/db1/cee 0 2024-02-15T18:31:09.940 INFO:tasks.workunit.client.0.smithi033.stdout:8/722: link d0/l33 d0/df/d48/lec 0 2024-02-15T18:31:09.940 INFO:tasks.workunit.client.0.smithi033.stdout:8/723: rename d0 to d0/df/d48/ded 22 2024-02-15T18:31:09.940 INFO:tasks.workunit.client.0.smithi033.stdout:8/724: read - d0/df/d53/db3/d30/d8e/d35/d58/da1/fb6 zero size 2024-02-15T18:31:09.940 INFO:tasks.workunit.client.0.smithi033.stdout:8/725: write d0/df/d53/db3/d30/d8e/d35/f64 [279166,63192] 0 2024-02-15T18:31:09.944 INFO:tasks.workunit.client.0.smithi033.stdout:6/810: getdents d8/d28/d14/d2c/d31/d30/d29/d38 0 2024-02-15T18:31:09.947 INFO:tasks.workunit.client.0.smithi033.stdout:7/781: mkdir d0/d56/d70/d91/d9e/d110 0 2024-02-15T18:31:09.947 INFO:tasks.workunit.client.0.smithi033.stdout:1/786: creat d5/d9/d1e/d20/d5c/d57/ffd x:0 0 0 2024-02-15T18:31:09.947 INFO:tasks.workunit.client.0.smithi033.stdout:1/787: dread - d5/dd/fcd zero size 2024-02-15T18:31:09.947 INFO:tasks.workunit.client.0.smithi033.stdout:1/788: dread - d5/d9/d1e/d20/d2c/db2/fbf zero size 2024-02-15T18:31:09.947 INFO:tasks.workunit.client.0.smithi033.stdout:6/811: creat d8/d28/d14/d2c/d31/d5d/ffb x:0 0 0 2024-02-15T18:31:09.948 INFO:tasks.workunit.client.0.smithi033.stdout:0/711: dread d0/d8/d54/f90 [0,4194304] 0 2024-02-15T18:31:09.948 INFO:tasks.workunit.client.0.smithi033.stdout:0/712: write d0/d8/d15/d2d/f8c [1406941,110337] 0 2024-02-15T18:31:09.950 INFO:tasks.workunit.client.0.smithi033.stdout:7/782: rmdir d0/dc/d10/d1d/d2b/d5f/d63/df5 0 2024-02-15T18:31:09.950 INFO:tasks.workunit.client.0.smithi033.stdout:1/789: unlink d5/d9/d1e/d20/l2f 0 2024-02-15T18:31:09.951 INFO:tasks.workunit.client.0.smithi033.stdout:5/880: dwrite d1/da/d19/d3f/d68/f96 [0,4194304] 0 2024-02-15T18:31:09.951 INFO:tasks.workunit.client.0.smithi033.stdout:5/881: fdatasync d1/da/d10/d2b/d42/d4c/d116/d40/f9f 0 2024-02-15T18:31:09.951 INFO:tasks.workunit.client.0.smithi033.stdout:7/783: write d0/fa [2388242,58729] 0 2024-02-15T18:31:09.952 INFO:tasks.workunit.client.0.smithi033.stdout:5/882: write d1/da/d10/d2b/d42/d4c/d116/f70 [1272893,74954] 0 2024-02-15T18:31:09.955 INFO:tasks.workunit.client.0.smithi033.stdout:0/713: link d0/d2/f34 d0/d8/d15/d8b/da3/dae/d58/fef 0 2024-02-15T18:31:09.958 INFO:tasks.workunit.client.0.smithi033.stdout:1/790: creat d5/dd/d12/dc6/dd4/ffe x:0 0 0 2024-02-15T18:31:09.960 INFO:tasks.workunit.client.0.smithi033.stdout:7/784: mknod d0/dc/d10/d7d/c111 0 2024-02-15T18:31:09.961 INFO:tasks.workunit.client.0.smithi033.stdout:5/883: link d1/da/d11/f8f d1/da/d19/d3f/d68/dd0/f124 0 2024-02-15T18:31:09.962 INFO:tasks.workunit.client.0.smithi033.stdout:0/714: mkdir d0/d8/d15/d8b/da3/dae/d58/de2/df0 0 2024-02-15T18:31:09.964 INFO:tasks.workunit.client.0.smithi033.stdout:7/785: creat d0/d56/d70/d83/f112 x:0 0 0 2024-02-15T18:31:09.964 INFO:tasks.workunit.client.0.smithi033.stdout:7/786: truncate d0/d56/d70/d91/d9e/fb5 917424 0 2024-02-15T18:31:09.966 INFO:tasks.workunit.client.0.smithi033.stdout:8/726: dwrite d0/df/d53/db3/d30/d8e/d35/f64 [0,4194304] 0 2024-02-15T18:31:09.967 INFO:tasks.workunit.client.0.smithi033.stdout:7/787: mkdir d0/d56/d70/d91/d9e/d110/d113 0 2024-02-15T18:31:09.970 INFO:tasks.workunit.client.0.smithi033.stdout:7/788: mknod d0/d56/d70/d91/d9e/c114 0 2024-02-15T18:31:09.972 INFO:tasks.workunit.client.0.smithi033.stdout:8/727: write d0/df/d53/db3/d30/d8e/d14/f7c [1032017,105469] 0 2024-02-15T18:31:09.972 INFO:tasks.workunit.client.0.smithi033.stdout:7/789: creat d0/d56/d8e/f115 x:0 0 0 2024-02-15T18:31:09.973 INFO:tasks.workunit.client.0.smithi033.stdout:7/790: creat d0/dc/d10/d48/d109/f116 x:0 0 0 2024-02-15T18:31:09.976 INFO:tasks.workunit.client.0.smithi033.stdout:8/728: dread d0/df/db/d45/f8a [0,4194304] 0 2024-02-15T18:31:09.976 INFO:tasks.workunit.client.0.smithi033.stdout:8/729: truncate d0/df/d53/db3/d30/fd6 820961 0 2024-02-15T18:31:09.977 INFO:tasks.workunit.client.0.smithi033.stdout:7/791: write d0/dc/d10/d48/f51 [937236,85303] 0 2024-02-15T18:31:09.978 INFO:tasks.workunit.client.0.smithi033.stdout:7/792: rmdir d0/dc/d10/d1d/d2b/d5f/d63 39 2024-02-15T18:31:09.978 INFO:tasks.workunit.client.0.smithi033.stdout:7/793: fdatasync d0/dc/d10/d7d/fc4 0 2024-02-15T18:31:09.978 INFO:tasks.workunit.client.0.smithi033.stdout:7/794: chown d0/dc/d10/d1d/d2b 83225711 1 2024-02-15T18:31:09.978 INFO:tasks.workunit.client.0.smithi033.stdout:7/795: chown d0/dc 24559666 1 2024-02-15T18:31:09.982 INFO:tasks.workunit.client.0.smithi033.stdout:6/812: dwrite d8/d28/f46 [0,4194304] 0 2024-02-15T18:31:09.982 INFO:tasks.workunit.client.0.smithi033.stdout:6/813: stat d8/d70/fea 0 2024-02-15T18:31:09.982 INFO:tasks.workunit.client.0.smithi033.stdout:6/814: write d8/d28/d14/d2c/d31/d30/d29/d67/fb1 [161643,10431] 0 2024-02-15T18:31:09.982 INFO:tasks.workunit.client.0.smithi033.stdout:7/796: rename d0/dc/d10/d7d/d99/fab to d0/dc/d10/d1d/d38/d82/f117 0 2024-02-15T18:31:09.983 INFO:tasks.workunit.client.0.smithi033.stdout:7/797: truncate d0/dc/d10/d1d/d38/d74/d7f/f101 28187 0 2024-02-15T18:31:09.984 INFO:tasks.workunit.client.0.smithi033.stdout:1/791: dwrite d5/dd/d12/d49/f1d [8388608,4194304] 0 2024-02-15T18:31:09.984 INFO:tasks.workunit.client.0.smithi033.stdout:1/792: dread - d5/d9/d1e/d20/d5c/d8d/ff6 zero size 2024-02-15T18:31:09.985 INFO:tasks.workunit.client.0.smithi033.stdout:6/815: mknod d8/d28/d36/cfc 0 2024-02-15T18:31:09.985 INFO:tasks.workunit.client.0.smithi033.stdout:6/816: truncate d8/d1d/d37/d4f/dbb/d55/d63/fc4 203631 0 2024-02-15T18:31:09.985 INFO:tasks.workunit.client.0.smithi033.stdout:6/817: write d8/d70/fdb [39767,109055] 0 2024-02-15T18:31:09.985 INFO:tasks.workunit.client.0.smithi033.stdout:6/818: chown d8/d1d/d37/c6c 650966009 1 2024-02-15T18:31:09.988 INFO:tasks.workunit.client.0.smithi033.stdout:6/819: truncate d8/d28/fcf 432845 0 2024-02-15T18:31:09.988 INFO:tasks.workunit.client.0.smithi033.stdout:6/820: dread - d8/d70/fca zero size 2024-02-15T18:31:09.988 INFO:tasks.workunit.client.0.smithi033.stdout:6/821: fdatasync d8/d28/d14/d2c/d31/d30/d29/d38/fda 0 2024-02-15T18:31:09.989 INFO:tasks.workunit.client.0.smithi033.stdout:5/884: dwrite d1/da/d11/d5e/db1/feb [0,4194304] 0 2024-02-15T18:31:09.989 INFO:tasks.workunit.client.0.smithi033.stdout:6/822: mkdir d8/d1d/d37/d72/dfd 0 2024-02-15T18:31:09.991 INFO:tasks.workunit.client.0.smithi033.stdout:6/823: write d8/d1d/d37/d4f/dbb/d55/d63/f7a [2810807,95755] 0 2024-02-15T18:31:09.993 INFO:tasks.workunit.client.0.smithi033.stdout:5/885: symlink d1/da/d10/d2b/d42/d4c/d116/dd2/l125 0 2024-02-15T18:31:09.994 INFO:tasks.workunit.client.0.smithi033.stdout:1/793: dread d5/d38/f60 [0,4194304] 0 2024-02-15T18:31:09.996 INFO:tasks.workunit.client.0.smithi033.stdout:7/798: rmdir d0/dc/d10/d48 39 2024-02-15T18:31:09.997 INFO:tasks.workunit.client.0.smithi033.stdout:6/824: mkdir d8/d28/d14/d2c/de7/dfe 0 2024-02-15T18:31:10.000 INFO:tasks.workunit.client.0.smithi033.stdout:7/799: write d0/dc/d10/d1d/d38/d74/d7f/fac [2374887,122894] 0 2024-02-15T18:31:10.001 INFO:tasks.workunit.client.0.smithi033.stdout:5/886: link d1/da/d10/d2b/d42/d4c/d116/d40/d9a/f111 d1/da/d52/d10e/f126 0 2024-02-15T18:31:10.001 INFO:tasks.workunit.client.0.smithi033.stdout:8/730: dwrite d0/daa/fd8 [0,4194304] 0 2024-02-15T18:31:10.001 INFO:tasks.workunit.client.0.smithi033.stdout:5/887: fdatasync d1/da/d11/d5e/db1/f10d 0 2024-02-15T18:31:10.001 INFO:tasks.workunit.client.0.smithi033.stdout:8/731: chown d0 7116221 1 2024-02-15T18:31:10.007 INFO:tasks.workunit.client.0.smithi033.stdout:7/800: rename d0/dc/d10/d1d/d38/d82/fe4 to d0/dc/d10/da1/d10f/f118 0 2024-02-15T18:31:10.007 INFO:tasks.workunit.client.0.smithi033.stdout:1/794: dread d5/d9/d1e/d20/d2c/d34/d51/fb6 [0,4194304] 0 2024-02-15T18:31:10.014 INFO:tasks.workunit.client.0.smithi033.stdout:6/825: mkdir d8/d28/d14/d2c/d3b/dff 0 2024-02-15T18:31:10.014 INFO:tasks.workunit.client.0.smithi033.stdout:6/826: chown d8/d28/f17 2 1 2024-02-15T18:31:10.014 INFO:tasks.workunit.client.0.smithi033.stdout:6/827: dread - d8/d70/fc2 zero size 2024-02-15T18:31:10.015 INFO:tasks.workunit.client.0.smithi033.stdout:8/732: rename d0/df/d53/db3/f3e to d0/df/d53/db3/d30/d8e/d35/d58/fee 0 2024-02-15T18:31:10.016 INFO:tasks.workunit.client.0.smithi033.stdout:5/888: dwrite d1/da/d10/d2b/d42/d4c/fd3 [0,4194304] 0 2024-02-15T18:31:10.016 INFO:tasks.workunit.client.0.smithi033.stdout:1/795: unlink d5/d9/d1e/d20/d2c/db2/fbf 0 2024-02-15T18:31:10.017 INFO:tasks.workunit.client.0.smithi033.stdout:1/796: dread - d5/dd/f3b zero size 2024-02-15T18:31:10.017 INFO:tasks.workunit.client.0.smithi033.stdout:7/801: dread d0/f9 [0,4194304] 0 2024-02-15T18:31:10.020 INFO:tasks.workunit.client.0.smithi033.stdout:6/828: creat d8/d28/d14/d2c/d31/ded/d5e/d81/f100 x:0 0 0 2024-02-15T18:31:10.020 INFO:tasks.workunit.client.0.smithi033.stdout:6/829: write d8/d28/fcf [1002657,32027] 0 2024-02-15T18:31:10.021 INFO:tasks.workunit.client.0.smithi033.stdout:6/830: chown d8/d1d/d37/d4f/dbb/d57/la7 14 1 2024-02-15T18:31:10.021 INFO:tasks.workunit.client.0.smithi033.stdout:8/733: rename d0/df/db/d45/f4a to d0/df/db/d45/fef 0 2024-02-15T18:31:10.023 INFO:tasks.workunit.client.0.smithi033.stdout:5/889: creat d1/da/d11/d5e/db1/d63/d61/da3/f127 x:0 0 0 2024-02-15T18:31:10.023 INFO:tasks.workunit.client.0.smithi033.stdout:5/890: write d1/da/d10/d2b/d42/d4c/d116/d40/d65/f91 [414941,103454] 0 2024-02-15T18:31:10.023 INFO:tasks.workunit.client.0.smithi033.stdout:1/797: symlink d5/d9/d1e/d20/d2c/d34/d51/lff 0 2024-02-15T18:31:10.025 INFO:tasks.workunit.client.0.smithi033.stdout:8/734: rmdir d0/df/d53/db3/d30/d8e/d8f 39 2024-02-15T18:31:10.025 INFO:tasks.workunit.client.0.smithi033.stdout:5/891: symlink d1/da/d11/d5e/db1/l128 0 2024-02-15T18:31:10.026 INFO:tasks.workunit.client.0.smithi033.stdout:1/798: chown d5/d9/l45 5618 1 2024-02-15T18:31:10.028 INFO:tasks.workunit.client.0.smithi033.stdout:5/892: write d1/da/d19/d3f/fa9 [1393516,118085] 0 2024-02-15T18:31:10.028 INFO:tasks.workunit.client.0.smithi033.stdout:8/735: mkdir d0/df/df0 0 2024-02-15T18:31:10.028 INFO:tasks.workunit.client.0.smithi033.stdout:8/736: chown d0/df/d53/db3/d30/d8e/d14 59183693 1 2024-02-15T18:31:10.028 INFO:tasks.workunit.client.0.smithi033.stdout:8/737: read - d0/df/fc9 zero size 2024-02-15T18:31:10.028 INFO:tasks.workunit.client.0.smithi033.stdout:8/738: fdatasync d0/df/d53/db3/d30/d8e/d14/d56/d59/fd9 0 2024-02-15T18:31:10.029 INFO:tasks.workunit.client.0.smithi033.stdout:1/799: rename d5/d9/d1e/d20/la3 to d5/d9/d1e/d20/d5c/d8d/l100 0 2024-02-15T18:31:10.036 INFO:tasks.workunit.client.0.smithi033.stdout:5/893: rmdir d1/da/d10 39 2024-02-15T18:31:10.036 INFO:tasks.workunit.client.0.smithi033.stdout:5/894: chown d1/da/d11/d5e/db1/d63/d61/daf/fbd 454176976 1 2024-02-15T18:31:10.036 INFO:tasks.workunit.client.0.smithi033.stdout:5/895: fdatasync d1/da/d10/d2b/d42/d4c/d116/d40/d9a/f9d 0 2024-02-15T18:31:10.038 INFO:tasks.workunit.client.0.smithi033.stdout:8/739: symlink d0/df/d53/db3/d30/d8e/d14/d56/d59/lf1 0 2024-02-15T18:31:10.039 INFO:tasks.workunit.client.0.smithi033.stdout:1/800: rename d5/dd/d12/d49/f7d to d5/d9/d1e/d20/d5c/d57/f101 0 2024-02-15T18:31:10.042 INFO:tasks.workunit.client.0.smithi033.stdout:7/802: dwrite d0/f6a [0,4194304] 0 2024-02-15T18:31:10.043 INFO:tasks.workunit.client.0.smithi033.stdout:7/803: mkdir d0/dc/d10/d1d/d38/d82/d119 0 2024-02-15T18:31:10.043 INFO:tasks.workunit.client.0.smithi033.stdout:7/804: read - d0/dc/d10/d1d/d2b/d5f/d63/fba zero size 2024-02-15T18:31:10.044 INFO:tasks.workunit.client.0.smithi033.stdout:1/801: read d5/dd/d12/d49/d23/f26 [2108796,87319] 0 2024-02-15T18:31:10.044 INFO:tasks.workunit.client.0.smithi033.stdout:1/802: fsync d5/fa0 0 2024-02-15T18:31:10.044 INFO:tasks.workunit.client.0.smithi033.stdout:6/831: dwrite d8/d1d/d37/dbf/dd0/fe3 [0,4194304] 0 2024-02-15T18:31:10.044 INFO:tasks.workunit.client.0.smithi033.stdout:7/805: symlink d0/d56/d70/d91/l11a 0 2024-02-15T18:31:10.044 INFO:tasks.workunit.client.0.smithi033.stdout:7/806: read d0/dc/d10/d1d/d38/d74/f87 [3855431,101322] 0 2024-02-15T18:31:10.045 INFO:tasks.workunit.client.0.smithi033.stdout:7/807: getdents d0/dc/d10/d48/d109/d10c 0 2024-02-15T18:31:10.051 INFO:tasks.workunit.client.0.smithi033.stdout:5/896: dwrite d1/da/d10/d2b/d42/d4c/d116/d40/d65/f83 [0,4194304] 0 2024-02-15T18:31:10.053 INFO:tasks.workunit.client.0.smithi033.stdout:1/803: symlink d5/d9/d1e/d20/l102 0 2024-02-15T18:31:10.055 INFO:tasks.workunit.client.0.smithi033.stdout:6/832: link d8/d28/d14/d2c/d31/ded/f84 d8/d1d/d37/d4f/dbb/d55/f101 0 2024-02-15T18:31:10.055 INFO:tasks.workunit.client.0.smithi033.stdout:6/833: chown d8/d28/d14/d2c/d31/d30/d29/d38/fda 17033 1 2024-02-15T18:31:10.055 INFO:tasks.workunit.client.0.smithi033.stdout:6/834: fdatasync d8/d28/d14/d2c/d31/d30/fb3 0 2024-02-15T18:31:10.055 INFO:tasks.workunit.client.0.smithi033.stdout:6/835: chown d8/d28/d14/d2c/d31/ded/laa 30 1 2024-02-15T18:31:10.055 INFO:tasks.workunit.client.0.smithi033.stdout:6/836: fsync d8/d28/f17 0 2024-02-15T18:31:10.057 INFO:tasks.workunit.client.0.smithi033.stdout:1/804: read d5/d9/ff [64620,12874] 0 2024-02-15T18:31:10.059 INFO:tasks.workunit.client.0.smithi033.stdout:6/837: unlink d8/d1d/d37/d4f/dbb/d57/c73 0 2024-02-15T18:31:10.059 INFO:tasks.workunit.client.0.smithi033.stdout:6/838: write d8/d28/d14/d2c/d31/ded/d5e/d81/fbc [2909697,57165] 0 2024-02-15T18:31:10.059 INFO:tasks.workunit.client.0.smithi033.stdout:1/805: getdents d5/d96 0 2024-02-15T18:31:10.060 INFO:tasks.workunit.client.0.smithi033.stdout:1/806: mknod d5/d9/d1e/d20/d2c/db2/c103 0 2024-02-15T18:31:10.061 INFO:tasks.workunit.client.0.smithi033.stdout:1/807: truncate d5/dd/d12/dc6/dd4/ffa 497873 0 2024-02-15T18:31:10.066 INFO:tasks.workunit.client.0.smithi033.stdout:7/808: dwrite d0/dc/d10/d1d/d38/d74/f87 [0,4194304] 0 2024-02-15T18:31:10.066 INFO:tasks.workunit.client.0.smithi033.stdout:7/809: fsync d0/dc/d10/d7d/ff2 0 2024-02-15T18:31:10.066 INFO:tasks.workunit.client.0.smithi033.stdout:5/897: dwrite d1/da/d19/d3f/d68/dd0/f124 [0,4194304] 0 2024-02-15T18:31:10.067 INFO:tasks.workunit.client.0.smithi033.stdout:6/839: fdatasync d8/f90 0 2024-02-15T18:31:10.067 INFO:tasks.workunit.client.0.smithi033.stdout:6/840: write d8/d1d/d37/d4f/dbb/d57/f5a [1777099,42543] 0 2024-02-15T18:31:10.075 INFO:tasks.workunit.client.0.smithi033.stdout:7/810: symlink d0/dc/d10/d1d/d38/d74/de7/dfa/l11b 0 2024-02-15T18:31:10.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.084+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd704101330 con 0x7fd70406b9c0 2024-02-15T18:31:10.078 INFO:tasks.workunit.client.0.smithi033.stdout:1/808: dwrite d5/dd/d12/f1b [8388608,4194304] 0 2024-02-15T18:31:10.078 INFO:tasks.workunit.client.0.smithi033.stdout:1/809: fsync d5/dd/d12/d49/f21 0 2024-02-15T18:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.085+0000 7fd6ebfff700 1 -- 172.21.15.33:0/1083674591 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fd6f804e9a0 con 0x7fd70406b9c0 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:31:10.079 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:31:10.080 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:31:10.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:31:10.080 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:31:10.080 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:31:10.080 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 13 2024-02-15T18:31:10.080 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:31:10.080 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:31:10.080 INFO:tasks.workunit.client.0.smithi033.stdout:5/898: rename d1/da/d10/d2b to d1/da/d52/d129 0 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.087+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fd6ec05e960 msgr2=0x7fd6ec060e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.087+0000 7fd709f8f700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fd6ec05e960 0x7fd6ec060e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd7040f6320 tx=0x7fd6f40069d0).stop 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.087+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406b9c0 msgr2=0x7fd7040f6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.087+0000 7fd709f8f700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406b9c0 0x7fd7040f6a80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fd6f8009830 tx=0x7fd6f8009b30).stop 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.087+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 shutdown_connections 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.087+0000 7fd709f8f700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7fd6ec05e960 0x7fd6ec060e20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.087+0000 7fd709f8f700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70406a3b0 0x7fd7040f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.087+0000 7fd709f8f700 1 --2- 172.21.15.33:0/1083674591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd70406b9c0 0x7fd7040f6a80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.087+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 >> 172.21.15.33:0/1083674591 conn(0x7fd7040f1e40 msgr2=0x7fd7040fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.088+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 shutdown_connections 2024-02-15T18:31:10.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.088+0000 7fd709f8f700 1 -- 172.21.15.33:0/1083674591 wait complete. 2024-02-15T18:31:10.083 INFO:tasks.workunit.client.0.smithi033.stdout:6/841: symlink d8/d28/d14/d2c/dd7/l102 0 2024-02-15T18:31:10.085 INFO:tasks.workunit.client.0.smithi033.stdout:7/811: symlink d0/dc/d10/d1d/d38/daa/l11c 0 2024-02-15T18:31:10.087 INFO:tasks.workunit.client.0.smithi033.stdout:6/842: mknod d8/d28/d14/d2c/d31/ded/d5e/d81/c103 0 2024-02-15T18:31:10.088 INFO:tasks.workunit.client.0.smithi033.stdout:7/812: symlink d0/dc/d10/d1d/d38/d74/l11d 0 2024-02-15T18:31:10.088 INFO:tasks.workunit.client.0.smithi033.stdout:7/813: readlink d0/dc/d10/d1d/d38/d82/le0 0 2024-02-15T18:31:10.089 INFO:tasks.workunit.client.0.smithi033.stdout:6/843: creat d8/d1d/d37/d4f/dbb/d55/f104 x:0 0 0 2024-02-15T18:31:10.089 INFO:tasks.workunit.client.0.smithi033.stdout:6/844: stat d8/d28/d36/c51 0 2024-02-15T18:31:10.089 INFO:tasks.workunit.client.0.smithi033.stdout:7/814: mknod d0/d56/c11e 0 2024-02-15T18:31:10.090 INFO:tasks.workunit.client.0.smithi033.stdout:7/815: dread - d0/dc/d10/d7d/d99/fdd zero size 2024-02-15T18:31:10.090 INFO:tasks.workunit.client.0.smithi033.stdout:7/816: dread - d0/dc/fe3 zero size 2024-02-15T18:31:10.090 INFO:tasks.workunit.client.0.smithi033.stdout:1/810: dread d5/dd/d12/d49/d23/f26 [0,4194304] 0 2024-02-15T18:31:10.091 INFO:tasks.workunit.client.0.smithi033.stdout:7/817: rename d0/dc/d10/da1/f103 to d0/dc/d10/d1d/d38/d74/d7f/f11f 0 2024-02-15T18:31:10.092 INFO:tasks.workunit.client.0.smithi033.stdout:7/818: chown d0/dc/d10/d1d/d2b/cf6 2 1 2024-02-15T18:31:10.092 INFO:tasks.workunit.client.0.smithi033.stdout:1/811: symlink d5/d9/d1e/d20/dfb/l104 0 2024-02-15T18:31:10.092 INFO:tasks.workunit.client.0.smithi033.stdout:7/819: symlink d0/dc/d10/da1/l120 0 2024-02-15T18:31:10.093 INFO:tasks.workunit.client.0.smithi033.stdout:7/820: fdatasync d0/dc/f65 0 2024-02-15T18:31:10.095 INFO:tasks.workunit.client.0.smithi033.stdout:1/812: dread d5/d9/f92 [0,4194304] 0 2024-02-15T18:31:10.095 INFO:tasks.workunit.client.0.smithi033.stdout:1/813: chown d5/d9/d1e/d20/d5c/d57/d82/fb1 633541419 1 2024-02-15T18:31:10.096 INFO:tasks.workunit.client.0.smithi033.stdout:1/814: mkdir d5/d17/d105 0 2024-02-15T18:31:10.096 INFO:tasks.workunit.client.0.smithi033.stdout:7/821: dread d0/dc/d10/d1d/d2b/d5f/f71 [0,4194304] 0 2024-02-15T18:31:10.097 INFO:tasks.workunit.client.0.smithi033.stdout:2/817: sync 2024-02-15T18:31:10.097 INFO:tasks.workunit.client.0.smithi033.stdout:3/812: sync 2024-02-15T18:31:10.097 INFO:tasks.workunit.client.0.smithi033.stdout:3/813: readlink d2/d3/lc7 0 2024-02-15T18:31:10.097 INFO:tasks.workunit.client.0.smithi033.stdout:1/815: creat d5/f106 x:0 0 0 2024-02-15T18:31:10.097 INFO:tasks.workunit.client.0.smithi033.stdout:1/816: fdatasync d5/dd/f3e 0 2024-02-15T18:31:10.100 INFO:tasks.workunit.client.0.smithi033.stdout:1/817: rmdir d5/d9/d1e/d20/d2c/d34/d51/ddb 39 2024-02-15T18:31:10.101 INFO:tasks.workunit.client.0.smithi033.stdout:5/899: dwrite d1/da/d52/d129/d42/d4c/d116/de7/ffe [0,4194304] 0 2024-02-15T18:31:10.101 INFO:tasks.workunit.client.0.smithi033.stdout:5/900: chown d1/da/d19 1 1 2024-02-15T18:31:10.101 INFO:tasks.workunit.client.0.smithi033.stdout:7/822: rmdir d0/dc/d10/d48/d109/d10c 0 2024-02-15T18:31:10.102 INFO:tasks.workunit.client.0.smithi033.stdout:1/818: rmdir d5/d96/ded 0 2024-02-15T18:31:10.102 INFO:tasks.workunit.client.0.smithi033.stdout:1/819: stat d5/dd 0 2024-02-15T18:31:10.103 INFO:tasks.workunit.client.0.smithi033.stdout:5/901: mkdir d1/da/d11/d5e/db1/dfa/d12a 0 2024-02-15T18:31:10.103 INFO:tasks.workunit.client.0.smithi033.stdout:7/823: creat d0/d56/d70/f121 x:0 0 0 2024-02-15T18:31:10.105 INFO:tasks.workunit.client.0.smithi033.stdout:1/820: unlink d5/d9/d1e/d20/d5c/d57/fbd 0 2024-02-15T18:31:10.105 INFO:tasks.workunit.client.0.smithi033.stdout:5/902: rmdir d1/da/d52/d129/d42/d4c/d116/d40/d9a 39 2024-02-15T18:31:10.106 INFO:tasks.workunit.client.0.smithi033.stdout:7/824: creat d0/dc/d10/d1d/d38/d74/de7/f122 x:0 0 0 2024-02-15T18:31:10.107 INFO:tasks.workunit.client.0.smithi033.stdout:1/821: creat d5/dd/d12/dc6/f107 x:0 0 0 2024-02-15T18:31:10.107 INFO:tasks.workunit.client.0.smithi033.stdout:1/822: dread - d5/d9/d1e/d20/d5c/d57/fe8 zero size 2024-02-15T18:31:10.113 INFO:tasks.workunit.client.0.smithi033.stdout:5/903: rename d1/da/d52 to d1/da/d11/d5e/db1/d12b 0 2024-02-15T18:31:10.116 INFO:tasks.workunit.client.0.smithi033.stdout:7/825: symlink d0/d56/d70/d91/d9e/d110/l123 0 2024-02-15T18:31:10.116 INFO:tasks.workunit.client.0.smithi033.stdout:7/826: stat d0/dc/d10/d1d/d38/d74/f87 0 2024-02-15T18:31:10.117 INFO:tasks.workunit.client.0.smithi033.stdout:2/818: dwrite d20/d3a/d4a/d5e/f69 [0,4194304] 0 2024-02-15T18:31:10.117 INFO:tasks.workunit.client.0.smithi033.stdout:2/819: chown d20/d3a/d4a/d5e/d6b/d83/faa 377602 1 2024-02-15T18:31:10.118 INFO:tasks.workunit.client.0.smithi033.stdout:5/904: symlink d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/dd2/l12c 0 2024-02-15T18:31:10.119 INFO:tasks.workunit.client.0.smithi033.stdout:7/827: rename d0/dc/d10/d48/f51 to d0/dc/d10/d48/d4b/f124 0 2024-02-15T18:31:10.119 INFO:tasks.workunit.client.0.smithi033.stdout:7/828: chown d0/dc/d10/d1d/d38/d74/d7f/f9b 63963 1 2024-02-15T18:31:10.122 INFO:tasks.workunit.client.0.smithi033.stdout:2/820: unlink d20/d73/lcc 0 2024-02-15T18:31:10.123 INFO:tasks.workunit.client.0.smithi033.stdout:7/829: link d0/dc/d10/d1d/d38/d74/de7/dfa/l10d d0/d56/l125 0 2024-02-15T18:31:10.124 INFO:tasks.workunit.client.0.smithi033.stdout:2/821: symlink d20/d3a/dee/l122 0 2024-02-15T18:31:10.126 INFO:tasks.workunit.client.0.smithi033.stdout:5/905: dread d1/f7 [0,4194304] 0 2024-02-15T18:31:10.128 INFO:tasks.workunit.client.0.smithi033.stdout:1/823: dwrite d5/f8 [4194304,4194304] 0 2024-02-15T18:31:10.132 INFO:tasks.workunit.client.0.smithi033.stdout:7/830: dread d0/dc/f1a [0,4194304] 0 2024-02-15T18:31:10.132 INFO:tasks.workunit.client.0.smithi033.stdout:7/831: dread - d0/dc/d10/d48/ffc zero size 2024-02-15T18:31:10.133 INFO:tasks.workunit.client.0.smithi033.stdout:5/906: creat d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/f12d x:0 0 0 2024-02-15T18:31:10.133 INFO:tasks.workunit.client.0.smithi033.stdout:5/907: mknod d1/da/d11/c12e 0 2024-02-15T18:31:10.133 INFO:tasks.workunit.client.0.smithi033.stdout:5/908: readlink d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/l117 0 2024-02-15T18:31:10.135 INFO:tasks.workunit.client.0.smithi033.stdout:5/909: read d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/f31 [2198650,95244] 0 2024-02-15T18:31:10.138 INFO:tasks.workunit.client.0.smithi033.stdout:1/824: dread d5/d17/fa6 [0,4194304] 0 2024-02-15T18:31:10.139 INFO:tasks.workunit.client.0.smithi033.stdout:1/825: rename d5/lef to d5/dd/d12/l108 0 2024-02-15T18:31:10.142 INFO:tasks.workunit.client.0.smithi033.stdout:1/826: creat d5/d9/d1e/df4/f109 x:0 0 0 2024-02-15T18:31:10.144 INFO:tasks.workunit.client.0.smithi033.stdout:5/910: dread d1/f5d [0,4194304] 0 2024-02-15T18:31:10.145 INFO:tasks.workunit.client.0.smithi033.stdout:5/911: getdents d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/dd2 0 2024-02-15T18:31:10.145 INFO:tasks.workunit.client.0.smithi033.stdout:5/912: chown d1/da/d11/f7c 3 1 2024-02-15T18:31:10.145 INFO:tasks.workunit.client.0.smithi033.stdout:5/913: readlink d1/da/d10/l50 0 2024-02-15T18:31:10.148 INFO:tasks.workunit.client.0.smithi033.stdout:7/832: dwrite d0/f9 [4194304,4194304] 0 2024-02-15T18:31:10.150 INFO:tasks.workunit.client.0.smithi033.stdout:7/833: mknod d0/dc/d10/d1d/d38/d74/d7f/da2/c126 0 2024-02-15T18:31:10.152 INFO:tasks.workunit.client.0.smithi033.stdout:7/834: dread d0/dc/d10/d1d/d38/d82/f117 [0,4194304] 0 2024-02-15T18:31:10.156 INFO:tasks.workunit.client.0.smithi033.stdout:5/914: dread d1/da/d11/d5e/db1/fc2 [0,4194304] 0 2024-02-15T18:31:10.156 INFO:tasks.workunit.client.0.smithi033.stdout:5/915: truncate d1/da/d19/d3f/d68/dd0/fdb 950893 0 2024-02-15T18:31:10.156 INFO:tasks.workunit.client.0.smithi033.stdout:1/827: dwrite d5/d9/d1e/d20/d2c/d34/dc0/fd3 [4194304,4194304] 0 2024-02-15T18:31:10.157 INFO:tasks.workunit.client.0.smithi033.stdout:5/916: creat d1/da/d11/d5e/db1/f12f x:0 0 0 2024-02-15T18:31:10.161 INFO:tasks.workunit.client.0.smithi033.stdout:5/917: getdents d1/da/d11/d5e/db1/d63/d61/da3/dbe/ddf 0 2024-02-15T18:31:10.162 INFO:tasks.workunit.client.0.smithi033.stdout:5/918: write d1/da/f1f [1486003,12134] 0 2024-02-15T18:31:10.163 INFO:tasks.workunit.client.0.smithi033.stdout:5/919: mknod d1/da/d11/d5e/db1/d12b/d10e/c130 0 2024-02-15T18:31:10.163 INFO:tasks.workunit.client.0.smithi033.stdout:5/920: dread - d1/da/d11/d5e/db1/fcf zero size 2024-02-15T18:31:10.164 INFO:tasks.workunit.client.0.smithi033.stdout:9/663: sync 2024-02-15T18:31:10.164 INFO:tasks.workunit.client.0.smithi033.stdout:0/715: sync 2024-02-15T18:31:10.165 INFO:tasks.workunit.client.0.smithi033.stdout:4/852: sync 2024-02-15T18:31:10.165 INFO:tasks.workunit.client.0.smithi033.stdout:9/664: truncate d4/d8/dd/d5c/f9b 212661 0 2024-02-15T18:31:10.168 INFO:tasks.workunit.client.0.smithi033.stdout:4/853: creat d4/d5/f11e x:0 0 0 2024-02-15T18:31:10.168 INFO:tasks.workunit.client.0.smithi033.stdout:9/665: mkdir d4/d8/dd/d28/d6b/dd8 0 2024-02-15T18:31:10.170 INFO:tasks.workunit.client.0.smithi033.stdout:4/854: symlink d4/d20/d13/dca/l11f 0 2024-02-15T18:31:10.170 INFO:tasks.workunit.client.0.smithi033.stdout:9/666: read d4/d8/dd/fe [1487491,71841] 0 2024-02-15T18:31:10.172 INFO:tasks.workunit.client.0.smithi033.stdout:9/667: creat d4/d2c/fd9 x:0 0 0 2024-02-15T18:31:10.172 INFO:tasks.workunit.client.0.smithi033.stdout:9/668: fdatasync d4/d8/dd/f23 0 2024-02-15T18:31:10.173 INFO:tasks.workunit.client.0.smithi033.stdout:9/669: creat d4/d8/db6/fda x:0 0 0 2024-02-15T18:31:10.174 INFO:tasks.workunit.client.0.smithi033.stdout:4/855: write d4/d20/d13/f94 [1406567,90537] 0 2024-02-15T18:31:10.174 INFO:tasks.workunit.client.0.smithi033.stdout:9/670: mkdir d4/d2c/db1/ddb 0 2024-02-15T18:31:10.174 INFO:tasks.workunit.client.0.smithi033.stdout:9/671: readlink d4/d8/dd/d41/d51/l9c 0 2024-02-15T18:31:10.174 INFO:tasks.workunit.client.0.smithi033.stdout:9/672: stat d4/d8/dd/d41/d51/f69 0 2024-02-15T18:31:10.175 INFO:tasks.workunit.client.0.smithi033.stdout:4/856: link d4/d5/d28/d39/cff d4/d20/d13/d34/c120 0 2024-02-15T18:31:10.175 INFO:tasks.workunit.client.0.smithi033.stdout:4/857: chown d4/d5/c3f 3113204 1 2024-02-15T18:31:10.175 INFO:tasks.workunit.client.0.smithi033.stdout:4/858: write d4/d20/d13/d1b/da7/fdd [4539209,1169] 0 2024-02-15T18:31:10.175 INFO:tasks.workunit.client.0.smithi033.stdout:9/673: symlink d4/d8/dd/ldc 0 2024-02-15T18:31:10.177 INFO:tasks.workunit.client.0.smithi033.stdout:9/674: symlink d4/d32/d6c/ldd 0 2024-02-15T18:31:10.178 INFO:tasks.workunit.client.0.smithi033.stdout:0/716: dread d0/fd [4194304,4194304] 0 2024-02-15T18:31:10.178 INFO:tasks.workunit.client.0.smithi033.stdout:0/717: chown d0/d8/d15/d5b/f5d 822058514 1 2024-02-15T18:31:10.178 INFO:tasks.workunit.client.0.smithi033.stdout:9/675: mknod d4/d8/dd/d5c/d6d/cde 0 2024-02-15T18:31:10.180 INFO:tasks.workunit.client.0.smithi033.stdout:9/676: mknod d4/d8/cdf 0 2024-02-15T18:31:10.180 INFO:tasks.workunit.client.0.smithi033.stdout:9/677: write d4/d8/dd/d41/f5d [1081544,104639] 0 2024-02-15T18:31:10.181 INFO:tasks.workunit.client.0.smithi033.stdout:9/678: mknod d4/d8/dd/d28/d6b/ce0 0 2024-02-15T18:31:10.181 INFO:tasks.workunit.client.0.smithi033.stdout:9/679: fdatasync d4/d8/dd/d5c/fa1 0 2024-02-15T18:31:10.181 INFO:tasks.workunit.client.0.smithi033.stdout:9/680: truncate d4/d8/d1b/d2f/d65/d8b/d95/fb3 559948 0 2024-02-15T18:31:10.187 INFO:tasks.workunit.client.0.smithi033.stdout:1/828: dwrite d5/d9/d1e/d20/d5c/d57/f8b [0,4194304] 0 2024-02-15T18:31:10.188 INFO:tasks.workunit.client.0.smithi033.stdout:1/829: write d5/d9/d1e/d20/d2c/d34/d51/fb6 [1567317,120647] 0 2024-02-15T18:31:10.193 INFO:tasks.workunit.client.0.smithi033.stdout:0/718: dread d0/d8/d15/d2d/d2e/f65 [0,4194304] 0 2024-02-15T18:31:10.193 INFO:tasks.workunit.client.0.smithi033.stdout:7/835: dwrite d0/dc/d10/d1d/d38/d82/f117 [0,4194304] 0 2024-02-15T18:31:10.193 INFO:tasks.workunit.client.0.smithi033.stdout:7/836: fdatasync d0/dc/d10/d1d/d2b/fb1 0 2024-02-15T18:31:10.193 INFO:tasks.workunit.client.0.smithi033.stdout:9/681: mknod d4/d8/ce1 0 2024-02-15T18:31:10.194 INFO:tasks.workunit.client.0.smithi033.stdout:5/921: dwrite d1/da/f12 [0,4194304] 0 2024-02-15T18:31:10.194 INFO:tasks.workunit.client.0.smithi033.stdout:9/682: chown d4/d8/f46 0 1 2024-02-15T18:31:10.194 INFO:tasks.workunit.client.0.smithi033.stdout:4/859: dwrite d4/d20/d37/fbc [4194304,4194304] 0 2024-02-15T18:31:10.199 INFO:tasks.workunit.client.0.smithi033.stdout:7/837: creat d0/dc/d10/d1d/d2b/f127 x:0 0 0 2024-02-15T18:31:10.202 INFO:tasks.workunit.client.0.smithi033.stdout:7/838: write d0/f27 [5485192,93221] 0 2024-02-15T18:31:10.202 INFO:tasks.workunit.client.0.smithi033.stdout:7/839: write d0/d56/fd3 [944203,82684] 0 2024-02-15T18:31:10.204 INFO:tasks.workunit.client.0.smithi033.stdout:5/922: symlink d1/l131 0 2024-02-15T18:31:10.205 INFO:tasks.workunit.client.0.smithi033.stdout:1/830: dwrite d5/d9/d1e/d20/d5c/d57/d59/fb9 [0,4194304] 0 2024-02-15T18:31:10.206 INFO:tasks.workunit.client.0.smithi033.stdout:9/683: rename d4/d8/d1b/d61/l93 to d4/d8/dd/d5c/d6d/dbc/le2 0 2024-02-15T18:31:10.207 INFO:tasks.workunit.client.0.smithi033.stdout:4/860: creat d4/d5/d28/d39/d62/d9c/d9e/da4/ddb/f121 x:0 0 0 2024-02-15T18:31:10.209 INFO:tasks.workunit.client.0.smithi033.stdout:0/719: truncate d0/d8/d15/d8b/da3/dae/d58/f61 370860 0 2024-02-15T18:31:10.212 INFO:tasks.workunit.client.0.smithi033.stdout:7/840: dread d0/dc/d10/d48/f5b [0,4194304] 0 2024-02-15T18:31:10.212 INFO:tasks.workunit.client.0.smithi033.stdout:0/720: dread d0/d8/d15/d8b/da3/d6c/fcf [0,4194304] 0 2024-02-15T18:31:10.215 INFO:tasks.workunit.client.0.smithi033.stdout:5/923: creat d1/da/d11/d5e/db1/d63/d61/daf/f132 x:0 0 0 2024-02-15T18:31:10.215 INFO:tasks.workunit.client.0.smithi033.stdout:5/924: chown d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/c45 2901388 1 2024-02-15T18:31:10.215 INFO:tasks.workunit.client.0.smithi033.stdout:7/841: dread d0/f1 [4194304,4194304] 0 2024-02-15T18:31:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.226+0000 7f930edcb700 1 -- 172.21.15.33:0/4062803748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f7980 msgr2=0x7f93080f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.226+0000 7f930edcb700 1 --2- 172.21.15.33:0/4062803748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f7980 0x7f93080f7de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f92f4004660 tx=0x7f92f4009b30).stop 2024-02-15T18:31:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.226+0000 7f930edcb700 1 -- 172.21.15.33:0/4062803748 shutdown_connections 2024-02-15T18:31:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.226+0000 7f930edcb700 1 --2- 172.21.15.33:0/4062803748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f7980 0x7f93080f7de0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.226+0000 7f930edcb700 1 --2- 172.21.15.33:0/4062803748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080f66e0 0x7f93080f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.226+0000 7f930edcb700 1 -- 172.21.15.33:0/4062803748 >> 172.21.15.33:0/4062803748 conn(0x7f93080f1e40 msgr2=0x7f93080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.226+0000 7f930edcb700 1 -- 172.21.15.33:0/4062803748 shutdown_connections 2024-02-15T18:31:10.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.227+0000 7f930edcb700 1 -- 172.21.15.33:0/4062803748 wait complete. 2024-02-15T18:31:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.227+0000 7f930edcb700 1 Processor -- start 2024-02-15T18:31:10.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.227+0000 7f930edcb700 1 -- start start 2024-02-15T18:31:10.221 INFO:tasks.workunit.client.0.smithi033.stdout:5/925: dread d1/da/d11/d5e/db1/d12b/f5b [0,4194304] 0 2024-02-15T18:31:10.221 INFO:tasks.workunit.client.0.smithi033.stdout:5/926: dread - d1/da/d11/d5e/db1/d12b/ff9 zero size 2024-02-15T18:31:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930edcb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f66e0 0x7f9308107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930edcb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080f7980 0x7f93081074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930edcb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308107aa0 con 0x7f93080f66e0 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930edcb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9308107be0 con 0x7f93080f7980 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930cb67700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f66e0 0x7f9308107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930cb67700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f66e0 0x7f9308107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45172/0 (socket says 172.21.15.33:45172) 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930cb67700 1 -- 172.21.15.33:0/1623309991 learned_addr learned my addr 172.21.15.33:0/1623309991 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f9307fff700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080f7980 0x7f93081074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930cb67700 1 -- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080f7980 msgr2=0x7f93081074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930cb67700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080f7980 0x7f93081074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930cb67700 1 -- 172.21.15.33:0/1623309991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4005040 con 0x7f93080f66e0 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f9307fff700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080f7980 0x7f93081074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:31:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.228+0000 7f930cb67700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f66e0 0x7f9308107000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f92fc004fb0 tx=0x7f92fc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.229+0000 7f93057fa700 1 -- 172.21.15.33:0/1623309991 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92fc007ba0 con 0x7f93080f66e0 2024-02-15T18:31:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.229+0000 7f93057fa700 1 -- 172.21.15.33:0/1623309991 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f92fc0095c0 con 0x7f93080f66e0 2024-02-15T18:31:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.229+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9308108580 con 0x7f93080f66e0 2024-02-15T18:31:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.229+0000 7f93057fa700 1 -- 172.21.15.33:0/1623309991 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92fc025d10 con 0x7f93080f66e0 2024-02-15T18:31:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.229+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9308108b40 con 0x7f93080f66e0 2024-02-15T18:31:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.230+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9308045ad0 con 0x7f93080f66e0 2024-02-15T18:31:10.227 INFO:tasks.workunit.client.0.smithi033.stdout:4/861: creat d4/d20/d13/d1b/d10f/f122 x:0 0 0 2024-02-15T18:31:10.228 INFO:tasks.workunit.client.0.smithi033.stdout:7/842: unlink d0/dc/d10/d48/d4b/f54 0 2024-02-15T18:31:10.229 INFO:tasks.workunit.client.0.smithi033.stdout:7/843: dread - d0/dc/d10/d1d/d38/d74/de7/dfa/ffe zero size 2024-02-15T18:31:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.233+0000 7f93057fa700 1 -- 172.21.15.33:0/1623309991 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 74714+0+0 (secure 0 0 0) 0x7f92fc02c060 con 0x7f93080f66e0 2024-02-15T18:31:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.234+0000 7f93057fa700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f92f805e9c0 0x7f92f8060e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.234+0000 7f93057fa700 1 -- 172.21.15.33:0/1623309991 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f92fc08a630 con 0x7f93080f66e0 2024-02-15T18:31:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.234+0000 7f9307fff700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f92f805e9c0 0x7f92f8060e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.235+0000 7f9307fff700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f92f805e9c0 0x7f92f8060e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f92f4004630 tx=0x7f92f4009b30).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:10.230 INFO:tasks.workunit.client.0.smithi033.stdout:0/721: mkdir d0/d8/df1 0 2024-02-15T18:31:10.230 INFO:tasks.workunit.client.0.smithi033.stdout:7/844: truncate d0/dc/f2a 498064 0 2024-02-15T18:31:10.230 INFO:tasks.workunit.client.0.smithi033.stdout:1/831: rename d5/d17/f31 to d5/d9/d1e/d20/d2c/d34/d51/ddb/f10a 0 2024-02-15T18:31:10.231 INFO:tasks.workunit.client.0.smithi033.stdout:7/845: mkdir d0/d56/d128 0 2024-02-15T18:31:10.231 INFO:tasks.workunit.client.0.smithi033.stdout:7/846: stat d0/d56/d70 0 2024-02-15T18:31:10.231 INFO:tasks.workunit.client.0.smithi033.stdout:7/847: truncate d0/f8c 862385 0 2024-02-15T18:31:10.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.238+0000 7f93057fa700 1 -- 172.21.15.33:0/1623309991 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f92fc05e5e0 con 0x7f93080f66e0 2024-02-15T18:31:10.234 INFO:tasks.workunit.client.0.smithi033.stdout:9/684: rename d4/d32/f54 to d4/fe3 0 2024-02-15T18:31:10.235 INFO:tasks.workunit.client.0.smithi033.stdout:1/832: creat d5/d9/d1e/d20/d2c/d34/d51/f10b x:0 0 0 2024-02-15T18:31:10.236 INFO:tasks.workunit.client.0.smithi033.stdout:7/848: creat d0/dc/d10/d1d/d38/f129 x:0 0 0 2024-02-15T18:31:10.237 INFO:tasks.workunit.client.0.smithi033.stdout:9/685: link d4/d8/d1b/c74 d4/d8/dd/d28/ce4 0 2024-02-15T18:31:10.238 INFO:tasks.workunit.client.0.smithi033.stdout:5/927: dwrite d1/da/d11/d5e/db1/d12b/d129/fbf [0,4194304] 0 2024-02-15T18:31:10.238 INFO:tasks.workunit.client.0.smithi033.stdout:5/928: chown d1/da/d11/d5e/db1/d12b/d129/d42/d4c/fb4 261603261 1 2024-02-15T18:31:10.238 INFO:tasks.workunit.client.0.smithi033.stdout:5/929: stat d1/f4 0 2024-02-15T18:31:10.238 INFO:tasks.workunit.client.0.smithi033.stdout:5/930: fsync d1/da/d19/f3e 0 2024-02-15T18:31:10.239 INFO:tasks.workunit.client.0.smithi033.stdout:7/849: rename d0/dc/d10/d1d/d2b/d5f/cf8 to d0/dc/d10/d1d/d38/d74/d7f/c12a 0 2024-02-15T18:31:10.239 INFO:tasks.workunit.client.0.smithi033.stdout:7/850: write d0/dc/d10/d48/f6f [5213819,107358] 0 2024-02-15T18:31:10.248 INFO:tasks.workunit.client.0.smithi033.stdout:5/931: creat d1/da/d88/f133 x:0 0 0 2024-02-15T18:31:10.249 INFO:tasks.workunit.client.0.smithi033.stdout:7/851: creat d0/dc/d10/d1d/d38/d74/de7/f12b x:0 0 0 2024-02-15T18:31:10.249 INFO:tasks.workunit.client.0.smithi033.stdout:7/852: getdents d0/d56/d128 0 2024-02-15T18:31:10.251 INFO:tasks.workunit.client.0.smithi033.stdout:5/932: rmdir d1/da/d11/d5e/db1/d63/d61/daf 39 2024-02-15T18:31:10.251 INFO:tasks.workunit.client.0.smithi033.stdout:5/933: dread - d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d9a/f109 zero size 2024-02-15T18:31:10.251 INFO:tasks.workunit.client.0.smithi033.stdout:8/740: sync 2024-02-15T18:31:10.252 INFO:tasks.workunit.client.0.smithi033.stdout:5/934: creat d1/da/d11/d5e/db1/d63/d61/f134 x:0 0 0 2024-02-15T18:31:10.252 INFO:tasks.workunit.client.0.smithi033.stdout:5/935: dread - d1/da/d11/d5e/db1/fcf zero size 2024-02-15T18:31:10.253 INFO:tasks.workunit.client.0.smithi033.stdout:8/741: mkdir d0/df/d53/db3/d30/d8e/d14/d56/d59/df2 0 2024-02-15T18:31:10.253 INFO:tasks.workunit.client.0.smithi033.stdout:8/742: fdatasync d0/df/d53/db3/d30/d8e/f41 0 2024-02-15T18:31:10.253 INFO:tasks.workunit.client.0.smithi033.stdout:8/743: write d0/df/d53/db3/d30/d8e/d35/d29/f73 [917864,63711] 0 2024-02-15T18:31:10.253 INFO:tasks.workunit.client.0.smithi033.stdout:5/936: symlink d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/dd2/l135 0 2024-02-15T18:31:10.254 INFO:tasks.workunit.client.0.smithi033.stdout:8/744: creat d0/df/d53/db3/d30/d8e/de0/ff3 x:0 0 0 2024-02-15T18:31:10.259 INFO:tasks.workunit.client.0.smithi033.stdout:7/853: dread d0/d56/d70/d83/fde [0,4194304] 0 2024-02-15T18:31:10.259 INFO:tasks.workunit.client.0.smithi033.stdout:7/854: chown d0/dc/d10/d1d/d38/fed 2821347 1 2024-02-15T18:31:10.259 INFO:tasks.workunit.client.0.smithi033.stdout:7/855: stat d0/dc/d10/d1d/d38/d74/de7 0 2024-02-15T18:31:10.259 INFO:tasks.workunit.client.0.smithi033.stdout:4/862: dwrite d4/f21 [0,4194304] 0 2024-02-15T18:31:10.260 INFO:tasks.workunit.client.0.smithi033.stdout:8/745: dread d0/df/d53/db3/d30/d8e/d14/f32 [0,4194304] 0 2024-02-15T18:31:10.262 INFO:tasks.workunit.client.0.smithi033.stdout:9/686: dwrite d4/d8/dd/d28/f2b [0,4194304] 0 2024-02-15T18:31:10.266 INFO:tasks.workunit.client.0.smithi033.stdout:1/833: dwrite d5/dd/fd8 [0,4194304] 0 2024-02-15T18:31:10.271 INFO:tasks.workunit.client.0.smithi033.stdout:1/834: write d5/d9/d1e/d20/d5c/d57/d59/fb9 [238650,97238] 0 2024-02-15T18:31:10.272 INFO:tasks.workunit.client.0.smithi033.stdout:7/856: symlink d0/d56/d70/d91/d9e/d110/d113/l12c 0 2024-02-15T18:31:10.272 INFO:tasks.workunit.client.0.smithi033.stdout:7/857: truncate d0/dc/d10/f78 5062556 0 2024-02-15T18:31:10.272 INFO:tasks.workunit.client.0.smithi033.stdout:8/746: creat d0/df/d53/db3/d30/d8e/d14/d56/ff4 x:0 0 0 2024-02-15T18:31:10.272 INFO:tasks.workunit.client.0.smithi033.stdout:8/747: fdatasync d0/df/db/d45/f98 0 2024-02-15T18:31:10.272 INFO:tasks.workunit.client.0.smithi033.stdout:8/748: write d0/df/db/d45/fef [1929235,101189] 0 2024-02-15T18:31:10.272 INFO:tasks.workunit.client.0.smithi033.stdout:8/749: chown d0/df/d53/db3/d30/d8e/d8f/l37 223456493 1 2024-02-15T18:31:10.274 INFO:tasks.workunit.client.0.smithi033.stdout:1/835: mknod d5/d9/d1e/d20/d2c/c10c 0 2024-02-15T18:31:10.274 INFO:tasks.workunit.client.0.smithi033.stdout:1/836: write d5/dd/d12/dc6/dd4/ffa [493463,59897] 0 2024-02-15T18:31:10.274 INFO:tasks.workunit.client.0.smithi033.stdout:7/858: creat d0/dc/d10/d1d/d38/f12d x:0 0 0 2024-02-15T18:31:10.275 INFO:tasks.workunit.client.0.smithi033.stdout:7/859: write d0/dc/d10/d48/ffc [415881,49997] 0 2024-02-15T18:31:10.276 INFO:tasks.workunit.client.0.smithi033.stdout:8/750: creat d0/df/d53/db3/d30/d8e/d14/d56/db0/ff5 x:0 0 0 2024-02-15T18:31:10.277 INFO:tasks.workunit.client.0.smithi033.stdout:1/837: creat d5/d9/d1e/d20/dfb/f10d x:0 0 0 2024-02-15T18:31:10.278 INFO:tasks.workunit.client.0.smithi033.stdout:8/751: creat d0/df/db/d45/dc6/ff6 x:0 0 0 2024-02-15T18:31:10.282 INFO:tasks.workunit.client.0.smithi033.stdout:8/752: write d0/df/d53/db3/d30/d8e/f6 [1380699,119585] 0 2024-02-15T18:31:10.283 INFO:tasks.workunit.client.0.smithi033.stdout:8/753: mkdir d0/df/db/d45/dc6/df7 0 2024-02-15T18:31:10.284 INFO:tasks.workunit.client.0.smithi033.stdout:4/863: dread d4/d5/f55 [0,4194304] 0 2024-02-15T18:31:10.284 INFO:tasks.workunit.client.0.smithi033.stdout:8/754: mkdir d0/df/d53/db3/d30/d8e/da7/df8 0 2024-02-15T18:31:10.284 INFO:tasks.workunit.client.0.smithi033.stdout:8/755: truncate d0/df/d53/db3/d30/d8e/d14/f7c 4985640 0 2024-02-15T18:31:10.285 INFO:tasks.workunit.client.0.smithi033.stdout:9/687: dwrite d4/d8/d1b/d73/f7f [0,4194304] 0 2024-02-15T18:31:10.285 INFO:tasks.workunit.client.0.smithi033.stdout:4/864: creat d4/d20/d13/d34/d82/f123 x:0 0 0 2024-02-15T18:31:10.287 INFO:tasks.workunit.client.0.smithi033.stdout:5/937: dwrite d1/da/d11/d5e/db1/d63/d61/daf/f132 [0,4194304] 0 2024-02-15T18:31:10.287 INFO:tasks.workunit.client.0.smithi033.stdout:8/756: mknod d0/df/cf9 0 2024-02-15T18:31:10.287 INFO:tasks.workunit.client.0.smithi033.stdout:4/865: creat d4/d3c/f124 x:0 0 0 2024-02-15T18:31:10.289 INFO:tasks.workunit.client.0.smithi033.stdout:9/688: dread d4/d32/f3b [0,4194304] 0 2024-02-15T18:31:10.290 INFO:tasks.workunit.client.0.smithi033.stdout:8/757: dread d0/df/d53/db3/d30/d8e/d14/d56/db0/fb4 [0,4194304] 0 2024-02-15T18:31:10.293 INFO:tasks.workunit.client.0.smithi033.stdout:9/689: symlink d4/d8/d1b/d61/dc7/le5 0 2024-02-15T18:31:10.293 INFO:tasks.workunit.client.0.smithi033.stdout:5/938: truncate d1/da/d11/d5e/db1/d12b/d129/f4d 1238707 0 2024-02-15T18:31:10.294 INFO:tasks.workunit.client.0.smithi033.stdout:9/690: mkdir d4/d8/d1b/d61/dc7/de6 0 2024-02-15T18:31:10.294 INFO:tasks.workunit.client.0.smithi033.stdout:9/691: chown d4/d8/d1b/d2f/d65/f75 548988 1 2024-02-15T18:31:10.295 INFO:tasks.workunit.client.0.smithi033.stdout:5/939: rmdir d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d65 39 2024-02-15T18:31:10.298 INFO:tasks.workunit.client.0.smithi033.stdout:9/692: mknod d4/d2c/db1/ce7 0 2024-02-15T18:31:10.299 INFO:tasks.workunit.client.0.smithi033.stdout:5/940: creat d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/de7/f136 x:0 0 0 2024-02-15T18:31:10.300 INFO:tasks.workunit.client.0.smithi033.stdout:5/941: getdents d1/da/d19/da6 0 2024-02-15T18:31:10.301 INFO:tasks.workunit.client.0.smithi033.stdout:5/942: write d1/da/d11/d5e/db1/d12b/d129/d42/f62 [246483,49427] 0 2024-02-15T18:31:10.301 INFO:tasks.workunit.client.0.smithi033.stdout:9/693: write d4/d8/dd/f15 [2461665,35649] 0 2024-02-15T18:31:10.301 INFO:tasks.workunit.client.0.smithi033.stdout:5/943: write d1/da/d19/d3f/d68/dd0/f124 [1380837,6003] 0 2024-02-15T18:31:10.304 INFO:tasks.workunit.client.0.smithi033.stdout:7/860: dwrite d0/f27 [4194304,4194304] 0 2024-02-15T18:31:10.304 INFO:tasks.workunit.client.0.smithi033.stdout:7/861: readlink d0/dc/d10/d1d/d38/d74/de7/dfa/l11b 0 2024-02-15T18:31:10.304 INFO:tasks.workunit.client.0.smithi033.stdout:7/862: dread - d0/dc/d10/d1d/d38/f12d zero size 2024-02-15T18:31:10.306 INFO:tasks.workunit.client.0.smithi033.stdout:7/863: truncate d0/dc/d10/d48/f53 825615 0 2024-02-15T18:31:10.309 INFO:tasks.workunit.client.0.smithi033.stdout:1/838: dwrite d5/dd/fbc [0,4194304] 0 2024-02-15T18:31:10.309 INFO:tasks.workunit.client.0.smithi033.stdout:4/866: dwrite d4/d20/d13/d34/d82/f123 [0,4194304] 0 2024-02-15T18:31:10.315 INFO:tasks.workunit.client.0.smithi033.stdout:1/839: unlink d5/d9/f77 0 2024-02-15T18:31:10.324 INFO:tasks.workunit.client.0.smithi033.stdout:9/694: rmdir d4/d2c/db1 39 2024-02-15T18:31:10.324 INFO:tasks.workunit.client.0.smithi033.stdout:9/695: stat d4/d2c/f84 0 2024-02-15T18:31:10.327 INFO:tasks.workunit.client.0.smithi033.stdout:1/840: truncate d5/dd/d12/f1b 4659930 0 2024-02-15T18:31:10.327 INFO:tasks.workunit.client.0.smithi033.stdout:9/696: rmdir d4/d8/d1b/d61/dc7 39 2024-02-15T18:31:10.327 INFO:tasks.workunit.client.0.smithi033.stdout:9/697: fsync d4/d8/dd/d41/d51/f52 0 2024-02-15T18:31:10.328 INFO:tasks.workunit.client.0.smithi033.stdout:1/841: mknod d5/d17/c10e 0 2024-02-15T18:31:10.328 INFO:tasks.workunit.client.0.smithi033.stdout:1/842: dread - d5/dcb/fe5 zero size 2024-02-15T18:31:10.329 INFO:tasks.workunit.client.0.smithi033.stdout:9/698: mknod d4/d8/dd/d5c/d6d/dbc/ce8 0 2024-02-15T18:31:10.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/843: creat d5/dd/d12/dc6/f10f x:0 0 0 2024-02-15T18:31:10.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/844: write d5/dd/d12/d49/fe1 [230063,37993] 0 2024-02-15T18:31:10.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/845: stat d5/d9/d1e/d20/d2c/d34/d51/f83 0 2024-02-15T18:31:10.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/846: truncate d5/dd/d12/d49/fe1 917833 0 2024-02-15T18:31:10.330 INFO:tasks.workunit.client.0.smithi033.stdout:1/847: fdatasync d5/d9/d1e/d20/d5c/d57/d82/fb5 0 2024-02-15T18:31:10.331 INFO:tasks.workunit.client.0.smithi033.stdout:9/699: rmdir d4/d8/d1b/d61/dc7/de6 0 2024-02-15T18:31:10.331 INFO:tasks.workunit.client.0.smithi033.stdout:9/700: truncate d4/d8/d1b/d61/f7a 4847340 0 2024-02-15T18:31:10.331 INFO:tasks.workunit.client.0.smithi033.stdout:9/701: chown d4/d8/dd/d5c/f9b 28702 1 2024-02-15T18:31:10.331 INFO:tasks.workunit.client.0.smithi033.stdout:9/702: dread - d4/d2c/db1/fcd zero size 2024-02-15T18:31:10.332 INFO:tasks.workunit.client.0.smithi033.stdout:1/848: symlink d5/d9/d1e/d20/d5c/dca/l110 0 2024-02-15T18:31:10.332 INFO:tasks.workunit.client.0.smithi033.stdout:1/849: write d5/d9/d1e/d20/d5c/d57/d82/fb1 [523500,44514] 0 2024-02-15T18:31:10.332 INFO:tasks.workunit.client.0.smithi033.stdout:9/703: mkdir d4/d2c/db1/ddb/de9 0 2024-02-15T18:31:10.332 INFO:tasks.workunit.client.0.smithi033.stdout:9/704: truncate d4/d8/d1b/d61/f7a 5670272 0 2024-02-15T18:31:10.334 INFO:tasks.workunit.client.0.smithi033.stdout:1/850: creat d5/d9/d1e/f111 x:0 0 0 2024-02-15T18:31:10.334 INFO:tasks.workunit.client.0.smithi033.stdout:9/705: symlink d4/d8/dd/lea 0 2024-02-15T18:31:10.335 INFO:tasks.workunit.client.0.smithi033.stdout:5/944: dwrite d1/da/d11/d5e/db1/d12b/f99 [0,4194304] 0 2024-02-15T18:31:10.335 INFO:tasks.workunit.client.0.smithi033.stdout:5/945: readlink d1/da/la5 0 2024-02-15T18:31:10.335 INFO:tasks.workunit.client.0.smithi033.stdout:5/946: write d1/da/d11/d5e/db1/d12b/d129/d42/d4c/fa0 [5290157,61975] 0 2024-02-15T18:31:10.336 INFO:tasks.workunit.client.0.smithi033.stdout:5/947: fsync d1/f4 0 2024-02-15T18:31:10.336 INFO:tasks.workunit.client.0.smithi033.stdout:1/851: symlink d5/d9/d1e/df4/l112 0 2024-02-15T18:31:10.336 INFO:tasks.workunit.client.0.smithi033.stdout:7/864: dwrite d0/dc/fd7 [0,4194304] 0 2024-02-15T18:31:10.336 INFO:tasks.workunit.client.0.smithi033.stdout:4/867: dwrite d4/d5/d28/d39/d62/d9c/d9e/dcd/ff6 [0,4194304] 0 2024-02-15T18:31:10.341 INFO:tasks.workunit.client.0.smithi033.stdout:3/814: sync 2024-02-15T18:31:10.341 INFO:tasks.workunit.client.0.smithi033.stdout:6/845: sync 2024-02-15T18:31:10.341 INFO:tasks.workunit.client.0.smithi033.stdout:3/815: write d2/d14/d23/d6f/fdd [732345,33425] 0 2024-02-15T18:31:10.342 INFO:tasks.workunit.client.0.smithi033.stdout:2/822: sync 2024-02-15T18:31:10.342 INFO:tasks.workunit.client.0.smithi033.stdout:2/823: read d20/d3a/d4a/d5e/f76 [2453917,25775] 0 2024-02-15T18:31:10.347 INFO:tasks.workunit.client.0.smithi033.stdout:5/948: rename d1/da/f69 to d1/da/d11/d5e/db1/d12b/d129/d115/f137 0 2024-02-15T18:31:10.348 INFO:tasks.workunit.client.0.smithi033.stdout:1/852: getdents d5/d9/d1e/d20/d2c 0 2024-02-15T18:31:10.348 INFO:tasks.workunit.client.0.smithi033.stdout:1/853: chown d5/d9/d1e/d20/d2c/f8c 2212 1 2024-02-15T18:31:10.352 INFO:tasks.workunit.client.0.smithi033.stdout:9/706: getdents d4/d8/dd/d5c/d6d/dbc 0 2024-02-15T18:31:10.355 INFO:tasks.workunit.client.0.smithi033.stdout:3/816: rmdir d2/d3/d17/de6/d73 39 2024-02-15T18:31:10.356 INFO:tasks.workunit.client.0.smithi033.stdout:2/824: unlink d20/f21 0 2024-02-15T18:31:10.357 INFO:tasks.workunit.client.0.smithi033.stdout:5/949: mkdir d1/da/d11/d5e/d138 0 2024-02-15T18:31:10.359 INFO:tasks.workunit.client.0.smithi033.stdout:3/817: mkdir d2/d14/d23/d5c/d62/d103 0 2024-02-15T18:31:10.359 INFO:tasks.workunit.client.0.smithi033.stdout:3/818: fdatasync d2/d3/d17/de6/fde 0 2024-02-15T18:31:10.359 INFO:tasks.workunit.client.0.smithi033.stdout:3/819: dread - d2/d3/d17/de6/d73/d83/ff8 zero size 2024-02-15T18:31:10.360 INFO:tasks.workunit.client.0.smithi033.stdout:7/865: dwrite d0/dc/d10/da1/d10f/f118 [0,4194304] 0 2024-02-15T18:31:10.361 INFO:tasks.workunit.client.0.smithi033.stdout:1/854: write d5/d9/d1e/d20/d5c/d57/d59/fb9 [1658796,57369] 0 2024-02-15T18:31:10.361 INFO:tasks.workunit.client.0.smithi033.stdout:1/855: readlink d5/d9/d1e/d20/d2c/db2/lea 0 2024-02-15T18:31:10.361 INFO:tasks.workunit.client.0.smithi033.stdout:4/868: dwrite d4/d20/f7a [0,4194304] 0 2024-02-15T18:31:10.363 INFO:tasks.workunit.client.0.smithi033.stdout:5/950: unlink d1/da/d11/d5e/db1/d12b/d129/d42/d4c/fb4 0 2024-02-15T18:31:10.368 INFO:tasks.workunit.client.0.smithi033.stdout:3/820: unlink d2/d3/d17/de6/c95 0 2024-02-15T18:31:10.368 INFO:tasks.workunit.client.0.smithi033.stdout:3/821: write d2/d3/d1e/d22/d4d/fad [1369981,116158] 0 2024-02-15T18:31:10.371 INFO:tasks.workunit.client.0.smithi033.stdout:7/866: mknod d0/dc/d10/d1d/d38/daa/c12e 0 2024-02-15T18:31:10.372 INFO:tasks.workunit.client.0.smithi033.stdout:7/867: write d0/f9 [3786353,29598] 0 2024-02-15T18:31:10.372 INFO:tasks.workunit.client.0.smithi033.stdout:7/868: stat d0/dc/d10/d1d/d38/f12d 0 2024-02-15T18:31:10.381 INFO:tasks.workunit.client.0.smithi033.stdout:4/869: creat d4/d5/d28/d39/d62/dfa/f125 x:0 0 0 2024-02-15T18:31:10.381 INFO:tasks.workunit.client.0.smithi033.stdout:3/822: symlink d2/dfa/l104 0 2024-02-15T18:31:10.381 INFO:tasks.workunit.client.0.smithi033.stdout:3/823: chown d2/d14/d23/f3d 7 1 2024-02-15T18:31:10.383 INFO:tasks.workunit.client.0.smithi033.stdout:4/870: mkdir d4/d126 0 2024-02-15T18:31:10.383 INFO:tasks.workunit.client.0.smithi033.stdout:3/824: getdents d2/d3/d1e/d22/d4d/dcb 0 2024-02-15T18:31:10.388 INFO:tasks.workunit.client.0.smithi033.stdout:3/825: rmdir d2/d3/d1e/d22/d4d 39 2024-02-15T18:31:10.392 INFO:tasks.workunit.client.0.smithi033.stdout:1/856: dwrite d5/d9/d1e/d20/d5c/d57/d82/f7e [0,4194304] 0 2024-02-15T18:31:10.392 INFO:tasks.workunit.client.0.smithi033.stdout:5/951: dwrite d1/da/d11/d5e/db1/d12b/fe4 [0,4194304] 0 2024-02-15T18:31:10.392 INFO:tasks.workunit.client.0.smithi033.stdout:2/825: dwrite d20/d3a/f57 [0,4194304] 0 2024-02-15T18:31:10.392 INFO:tasks.workunit.client.0.smithi033.stdout:5/952: dread - d1/da/fc9 zero size 2024-02-15T18:31:10.405 INFO:tasks.workunit.client.0.smithi033.stdout:5/953: mknod d1/da/d11/d5e/db1/d12b/c139 0 2024-02-15T18:31:10.409 INFO:tasks.workunit.client.0.smithi033.stdout:5/954: unlink d1/da/d11/d5e/db1/d12b/d129/c7d 0 2024-02-15T18:31:10.409 INFO:tasks.workunit.client.0.smithi033.stdout:2/826: dread d20/d31/d47/d82/fd3 [0,4194304] 0 2024-02-15T18:31:10.410 INFO:tasks.workunit.client.0.smithi033.stdout:3/826: dwrite d2/d14/d23/d6f/d93/f98 [0,4194304] 0 2024-02-15T18:31:10.411 INFO:tasks.workunit.client.0.smithi033.stdout:5/955: creat d1/da/d19/d3f/d68/dd0/f13a x:0 0 0 2024-02-15T18:31:10.411 INFO:tasks.workunit.client.0.smithi033.stdout:7/869: dwrite d0/f1c [0,4194304] 0 2024-02-15T18:31:10.411 INFO:tasks.workunit.client.0.smithi033.stdout:4/871: dwrite d4/d5/d28/d39/d62/d9c/d9e/da4/fdf [0,4194304] 0 2024-02-15T18:31:10.411 INFO:tasks.workunit.client.0.smithi033.stdout:1/857: dread d5/f8 [4194304,4194304] 0 2024-02-15T18:31:10.411 INFO:tasks.workunit.client.0.smithi033.stdout:4/872: dread - d4/d3c/faf zero size 2024-02-15T18:31:10.411 INFO:tasks.workunit.client.0.smithi033.stdout:1/858: chown d5/dd/d12/d49/d23/laa 523571 1 2024-02-15T18:31:10.411 INFO:tasks.workunit.client.0.smithi033.stdout:2/827: mkdir d20/d31/d47/d4c/def/d80/da5/d123 0 2024-02-15T18:31:10.430 INFO:tasks.workunit.client.0.smithi033.stdout:2/828: dread d20/d31/d47/d4c/def/d80/f85 [0,4194304] 0 2024-02-15T18:31:10.430 INFO:tasks.workunit.client.0.smithi033.stdout:2/829: truncate d20/d31/d47/fc9 1191892 0 2024-02-15T18:31:10.430 INFO:tasks.workunit.client.0.smithi033.stdout:2/830: write d20/d31/d47/fc9 [1365398,28375] 0 2024-02-15T18:31:10.431 INFO:tasks.workunit.client.0.smithi033.stdout:2/831: truncate d20/d3a/d4a/d5e/f7d 3527604 0 2024-02-15T18:31:10.450 INFO:tasks.workunit.client.0.smithi033.stdout:7/870: dwrite d0/dc/d10/f13 [4194304,4194304] 0 2024-02-15T18:31:10.450 INFO:tasks.workunit.client.0.smithi033.stdout:7/871: fdatasync d0/dc/d10/d7d/f50 0 2024-02-15T18:31:10.450 INFO:tasks.workunit.client.0.smithi033.stdout:7/872: truncate d0/d56/d70/d83/f112 319036 0 2024-02-15T18:31:10.451 INFO:tasks.workunit.client.0.smithi033.stdout:7/873: mkdir d0/dc/d10/d1d/d38/d74/d7f/da2/d12f 0 2024-02-15T18:31:10.453 INFO:tasks.workunit.client.0.smithi033.stdout:3/827: dwrite d2/d14/f42 [4194304,4194304] 0 2024-02-15T18:31:10.453 INFO:tasks.workunit.client.0.smithi033.stdout:1/859: dwrite d5/d9/d1e/d20/d2c/d34/d51/ddb/f10a [0,4194304] 0 2024-02-15T18:31:10.454 INFO:tasks.workunit.client.0.smithi033.stdout:5/956: dwrite d1/da/d11/d5e/db1/d12b/fe8 [4194304,4194304] 0 2024-02-15T18:31:10.454 INFO:tasks.workunit.client.0.smithi033.stdout:5/957: chown d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d9a/fef 12749 1 2024-02-15T18:31:10.454 INFO:tasks.workunit.client.0.smithi033.stdout:5/958: read d1/da/d11/d5e/db1/d12b/f99 [879266,38069] 0 2024-02-15T18:31:10.457 INFO:tasks.workunit.client.0.smithi033.stdout:3/828: chown d2/d3/df/l52 322 1 2024-02-15T18:31:10.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/959: mknod d1/da/d11/d5e/db1/d12b/d10e/c13b 0 2024-02-15T18:31:10.457 INFO:tasks.workunit.client.0.smithi033.stdout:5/960: write d1/da/d11/d5e/db1/d63/d61/fb7 [42883,21837] 0 2024-02-15T18:31:10.459 INFO:tasks.workunit.client.0.smithi033.stdout:3/829: symlink d2/d3/d17/de6/d73/l105 0 2024-02-15T18:31:10.459 INFO:tasks.workunit.client.0.smithi033.stdout:3/830: fsync d2/d3/d1e/d22/d59/fef 0 2024-02-15T18:31:10.459 INFO:tasks.workunit.client.0.smithi033.stdout:5/961: unlink d1/c5a 0 2024-02-15T18:31:10.463 INFO:tasks.workunit.client.0.smithi033.stdout:3/831: rename d2/d3/d1e/d22/d59/fef to d2/d14/d23/f106 0 2024-02-15T18:31:10.463 INFO:tasks.workunit.client.0.smithi033.stdout:3/832: write d2/d14/d23/d5c/d61/fd3 [4679018,77482] 0 2024-02-15T18:31:10.464 INFO:tasks.workunit.client.0.smithi033.stdout:5/962: rmdir d1/da/d11/d5e/db1/d12b/d129/d42/d71 39 2024-02-15T18:31:10.466 INFO:tasks.workunit.client.0.smithi033.stdout:3/833: rmdir d2/d14/d23/d5c/d62/d103 0 2024-02-15T18:31:10.468 INFO:tasks.workunit.client.0.smithi033.stdout:5/963: unlink d1/da/d19/d3f/d68/cc4 0 2024-02-15T18:31:10.469 INFO:tasks.workunit.client.0.smithi033.stdout:5/964: mknod d1/da/d11/d5e/db1/dfa/d12a/c13c 0 2024-02-15T18:31:10.469 INFO:tasks.workunit.client.0.smithi033.stdout:5/965: chown d1/da/d11/dd9 252823 1 2024-02-15T18:31:10.470 INFO:tasks.workunit.client.0.smithi033.stdout:3/834: dread d2/d14/f9e [0,4194304] 0 2024-02-15T18:31:10.484 INFO:tasks.workunit.client.0.smithi033.stdout:7/874: dwrite d0/d56/d70/d83/f112 [0,4194304] 0 2024-02-15T18:31:10.484 INFO:tasks.workunit.client.0.smithi033.stdout:7/875: fsync d0/d56/d70/fd6 0 2024-02-15T18:31:10.484 INFO:tasks.workunit.client.0.smithi033.stdout:7/876: write d0/dbe/fcf [1176898,24970] 0 2024-02-15T18:31:10.484 INFO:tasks.workunit.client.0.smithi033.stdout:2/832: dwrite d20/d3a/d4a/d5e/f7d [0,4194304] 0 2024-02-15T18:31:10.484 INFO:tasks.workunit.client.0.smithi033.stdout:2/833: chown d20/d31/d47/d64/d9e 4834 1 2024-02-15T18:31:10.486 INFO:tasks.workunit.client.0.smithi033.stdout:3/835: dread d2/f2e [4194304,4194304] 0 2024-02-15T18:31:10.486 INFO:tasks.workunit.client.0.smithi033.stdout:1/860: dwrite d5/d17/f35 [0,4194304] 0 2024-02-15T18:31:10.488 INFO:tasks.workunit.client.0.smithi033.stdout:7/877: rename d0/dc/d10/da1/ca3 to d0/dbe/c130 0 2024-02-15T18:31:10.488 INFO:tasks.workunit.client.0.smithi033.stdout:7/878: readlink d0/d56/d70/d83/laf 0 2024-02-15T18:31:10.488 INFO:tasks.workunit.client.0.smithi033.stdout:2/834: mkdir d20/d31/d47/d4c/dc4/d124 0 2024-02-15T18:31:10.495 INFO:tasks.workunit.client.0.smithi033.stdout:7/879: creat d0/d56/f131 x:0 0 0 2024-02-15T18:31:10.498 INFO:tasks.workunit.client.0.smithi033.stdout:2/835: mkdir d20/de1/d125 0 2024-02-15T18:31:10.498 INFO:tasks.workunit.client.0.smithi033.stdout:2/836: truncate d20/d3a/ff0 310720 0 2024-02-15T18:31:10.507 INFO:tasks.workunit.client.0.smithi033.stdout:8/758: sync 2024-02-15T18:31:10.507 INFO:tasks.workunit.client.0.smithi033.stdout:6/846: sync 2024-02-15T18:31:10.507 INFO:tasks.workunit.client.0.smithi033.stdout:6/847: chown d8/d28/d14/d2c/lf9 896 1 2024-02-15T18:31:10.507 INFO:tasks.workunit.client.0.smithi033.stdout:6/848: getdents d8/d28/d14/d2c/d3b/dff 0 2024-02-15T18:31:10.507 INFO:tasks.workunit.client.0.smithi033.stdout:0/722: sync 2024-02-15T18:31:10.507 INFO:tasks.workunit.client.0.smithi033.stdout:4/873: sync 2024-02-15T18:31:10.507 INFO:tasks.workunit.client.0.smithi033.stdout:9/707: sync 2024-02-15T18:31:10.508 INFO:tasks.workunit.client.0.smithi033.stdout:8/759: rmdir d0/df/d53/db3/d30/d8e/d14 39 2024-02-15T18:31:10.509 INFO:tasks.workunit.client.0.smithi033.stdout:6/849: creat d8/d1d/d37/d4f/dcb/f105 x:0 0 0 2024-02-15T18:31:10.510 INFO:tasks.workunit.client.0.smithi033.stdout:9/708: creat d4/d8/dd/d28/feb x:0 0 0 2024-02-15T18:31:10.512 INFO:tasks.workunit.client.0.smithi033.stdout:0/723: rename d0/d8/d15/d8b/da3/dae/d58/fef to d0/d8/d15/d8b/da3/d6c/ff2 0 2024-02-15T18:31:10.512 INFO:tasks.workunit.client.0.smithi033.stdout:0/724: readlink d0/d8/d15/l99 0 2024-02-15T18:31:10.513 INFO:tasks.workunit.client.0.smithi033.stdout:8/760: getdents d0/df/d53/db3/d30/d8e/d14/d56/db0 0 2024-02-15T18:31:10.514 INFO:tasks.workunit.client.0.smithi033.stdout:6/850: mknod d8/d28/d36/c106 0 2024-02-15T18:31:10.516 INFO:tasks.workunit.client.0.smithi033.stdout:3/836: dwrite d2/d14/d23/d5c/fee [0,4194304] 0 2024-02-15T18:31:10.516 INFO:tasks.workunit.client.0.smithi033.stdout:0/725: creat d0/d8/d15/ff3 x:0 0 0 2024-02-15T18:31:10.517 INFO:tasks.workunit.client.0.smithi033.stdout:6/851: creat d8/d28/d14/d2c/d31/ded/d5e/d81/f107 x:0 0 0 2024-02-15T18:31:10.518 INFO:tasks.workunit.client.0.smithi033.stdout:1/861: dwrite d5/dd/d12/fe4 [0,4194304] 0 2024-02-15T18:31:10.519 INFO:tasks.workunit.client.0.smithi033.stdout:3/837: truncate d2/d3/df/f7c 2650303 0 2024-02-15T18:31:10.519 INFO:tasks.workunit.client.0.smithi033.stdout:3/838: chown d2/d14/d23/d6f/l94 474162871 1 2024-02-15T18:31:10.522 INFO:tasks.workunit.client.0.smithi033.stdout:6/852: rename d8/d28/d14/d2c/d31/ded/cd1 to d8/d28/d14/d2c/d3b/dff/c108 0 2024-02-15T18:31:10.523 INFO:tasks.workunit.client.0.smithi033.stdout:3/839: creat d2/d3/dcc/f107 x:0 0 0 2024-02-15T18:31:10.526 INFO:tasks.workunit.client.0.smithi033.stdout:6/853: unlink d8/d1d/d37/d4f/dbb/f56 0 2024-02-15T18:31:10.526 INFO:tasks.workunit.client.0.smithi033.stdout:3/840: read d2/d14/db3/dba/fbf [2032076,5388] 0 2024-02-15T18:31:10.528 INFO:tasks.workunit.client.0.smithi033.stdout:1/862: rename d5/d9/f97 to d5/d9/d1e/d20/d5c/d8d/f113 0 2024-02-15T18:31:10.528 INFO:tasks.workunit.client.0.smithi033.stdout:1/863: chown d5/d9/d1e/d20/d2c/d34/d51/ddb/fde 4618 1 2024-02-15T18:31:10.530 INFO:tasks.workunit.client.0.smithi033.stdout:6/854: mkdir d8/d1d/d37/d72/d109 0 2024-02-15T18:31:10.531 INFO:tasks.workunit.client.0.smithi033.stdout:8/761: dread d0/df/f19 [0,4194304] 0 2024-02-15T18:31:10.531 INFO:tasks.workunit.client.0.smithi033.stdout:3/841: truncate d2/d3/d17/de6/d88/fa5 2625954 0 2024-02-15T18:31:10.532 INFO:tasks.workunit.client.0.smithi033.stdout:3/842: truncate d2/d3/d17/de6/feb 146054 0 2024-02-15T18:31:10.532 INFO:tasks.workunit.client.0.smithi033.stdout:1/864: creat d5/dd/f114 x:0 0 0 2024-02-15T18:31:10.532 INFO:tasks.workunit.client.0.smithi033.stdout:1/865: chown d5/l4f 2 1 2024-02-15T18:31:10.533 INFO:tasks.workunit.client.0.smithi033.stdout:8/762: creat d0/df/d53/db3/d30/d8e/d35/d58/deb/ffa x:0 0 0 2024-02-15T18:31:10.534 INFO:tasks.workunit.client.0.smithi033.stdout:3/843: mkdir d2/d14/d23/d5c/d7f/de7/d108 0 2024-02-15T18:31:10.535 INFO:tasks.workunit.client.0.smithi033.stdout:4/874: dwrite d4/d20/f26 [0,4194304] 0 2024-02-15T18:31:10.535 INFO:tasks.workunit.client.0.smithi033.stdout:1/866: rename d5/d9/d1e/d20/d5c/d57/fe8 to d5/d9/d1e/d20/d5c/dca/f115 0 2024-02-15T18:31:10.536 INFO:tasks.workunit.client.0.smithi033.stdout:8/763: getdents d0/df/db 0 2024-02-15T18:31:10.538 INFO:tasks.workunit.client.0.smithi033.stdout:8/764: write d0/df/f19 [946505,43732] 0 2024-02-15T18:31:10.538 INFO:tasks.workunit.client.0.smithi033.stdout:0/726: dwrite d0/d8/d15/d2d/d41/d73/f93 [0,4194304] 0 2024-02-15T18:31:10.538 INFO:tasks.workunit.client.0.smithi033.stdout:0/727: stat d0/d8/d15/d2d/d41/de6/ld4 0 2024-02-15T18:31:10.538 INFO:tasks.workunit.client.0.smithi033.stdout:0/728: stat d0/d8/d15/l22 0 2024-02-15T18:31:10.538 INFO:tasks.workunit.client.0.smithi033.stdout:9/709: dwrite d4/d8/d1b/f5b [4194304,4194304] 0 2024-02-15T18:31:10.539 INFO:tasks.workunit.client.0.smithi033.stdout:4/875: symlink d4/d20/d13/d34/d82/l127 0 2024-02-15T18:31:10.542 INFO:tasks.workunit.client.0.smithi033.stdout:1/867: symlink d5/d17/l116 0 2024-02-15T18:31:10.542 INFO:tasks.workunit.client.0.smithi033.stdout:1/868: dread - d5/d9/d1e/d20/d5c/d57/fb0 zero size 2024-02-15T18:31:10.542 INFO:tasks.workunit.client.0.smithi033.stdout:1/869: chown d5/d9/d1e/d20/d5c/d57/fb0 106526887 1 2024-02-15T18:31:10.543 INFO:tasks.workunit.client.0.smithi033.stdout:8/765: symlink d0/daa/lfb 0 2024-02-15T18:31:10.543 INFO:tasks.workunit.client.0.smithi033.stdout:8/766: write d0/df/d53/db3/d30/d8e/d14/d56/db0/fbd [969248,28067] 0 2024-02-15T18:31:10.543 INFO:tasks.workunit.client.0.smithi033.stdout:8/767: write d0/df/d53/d9b/fa4 [1080573,87428] 0 2024-02-15T18:31:10.543 INFO:tasks.workunit.client.0.smithi033.stdout:8/768: dread - d0/df/d53/db3/d30/d8e/d35/d58/da1/fb6 zero size 2024-02-15T18:31:10.543 INFO:tasks.workunit.client.0.smithi033.stdout:8/769: dread - d0/df/d53/db3/d30/d8e/d35/d29/fe7 zero size 2024-02-15T18:31:10.549 INFO:tasks.workunit.client.0.smithi033.stdout:3/844: dread d2/d14/d23/d5c/d7f/ff1 [0,4194304] 0 2024-02-15T18:31:10.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.558+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9308108dc0 con 0x7f93080f66e0 2024-02-15T18:31:10.551 INFO:tasks.workunit.client.0.smithi033.stdout:1/870: write d5/dd/d12/fe4 [663032,62213] 0 2024-02-15T18:31:10.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.559+0000 7f93057fa700 1 -- 172.21.15.33:0/1623309991 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1690 (secure 0 0 0) 0x7f92fc05e1d0 con 0x7f93080f66e0 2024-02-15T18:31:10.552 INFO:tasks.workunit.client.0.smithi033.stdout:9/710: symlink d4/d8/dd/d5c/d6d/dbc/lec 0 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:e18 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 18 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:31:10.553 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:30:34.499671+0000 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:31:10.554 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707]] 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411]] 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:31:10.555 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:31:10.556 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:31:10.556 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:31:10.556 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613]] 2024-02-15T18:31:10.556 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278]] 2024-02-15T18:31:10.556 INFO:tasks.workunit.client.0.smithi033.stdout:4/876: creat d4/d20/d13/d1b/d81/d9f/f128 x:0 0 0 2024-02-15T18:31:10.556 INFO:tasks.workunit.client.0.smithi033.stdout:1/871: read d5/dd/d12/d49/f44 [786537,68322] 0 2024-02-15T18:31:10.557 INFO:tasks.workunit.client.0.smithi033.stdout:0/729: dwrite d0/d8/d15/d8b/da3/dae/d58/d77/fbc [0,4194304] 0 2024-02-15T18:31:10.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f92f805e9c0 msgr2=0x7f92f8060e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f92f805e9c0 0x7f92f8060e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f92f4004630 tx=0x7f92f4009b30).stop 2024-02-15T18:31:10.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f66e0 msgr2=0x7f9308107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f66e0 0x7f9308107000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f92fc004fb0 tx=0x7f92fc009d80).stop 2024-02-15T18:31:10.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 shutdown_connections 2024-02-15T18:31:10.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f92f805e9c0 0x7f92f8060e80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93080f66e0 0x7f9308107000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 --2- 172.21.15.33:0/1623309991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93080f7980 0x7f93081074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 >> 172.21.15.33:0/1623309991 conn(0x7f93080f1e40 msgr2=0x7f93080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:10.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 shutdown_connections 2024-02-15T18:31:10.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.562+0000 7f930edcb700 1 -- 172.21.15.33:0/1623309991 wait complete. 2024-02-15T18:31:10.558 INFO:tasks.workunit.client.0.smithi033.stdout:4/877: creat d4/d20/d13/d5c/d87/dd0/f129 x:0 0 0 2024-02-15T18:31:10.558 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 18 2024-02-15T18:31:10.559 INFO:tasks.workunit.client.0.smithi033.stdout:1/872: rename d5/d9/d1e/d20/d2c/d65/f75 to d5/d38/f117 0 2024-02-15T18:31:10.561 INFO:tasks.workunit.client.0.smithi033.stdout:0/730: link d0/d8/d15/d8b/da3/dae/d58/d80/dc1/fc3 d0/d8/d15/d5b/ff4 0 2024-02-15T18:31:10.563 INFO:tasks.workunit.client.0.smithi033.stdout:4/878: rmdir d4/d5/d28/d39/d62/d9c/d9e/da4/d10e 39 2024-02-15T18:31:10.564 INFO:tasks.workunit.client.0.smithi033.stdout:0/731: unlink d0/de8/c60 0 2024-02-15T18:31:10.566 INFO:tasks.workunit.client.0.smithi033.stdout:4/879: mkdir d4/d20/d13/d34/d82/df5/d12a 0 2024-02-15T18:31:10.566 INFO:tasks.workunit.client.0.smithi033.stdout:0/732: stat d0/d64/d1d/ld7 0 2024-02-15T18:31:10.570 INFO:tasks.workunit.client.0.smithi033.stdout:4/880: creat d4/d5/dc9/f12b x:0 0 0 2024-02-15T18:31:10.570 INFO:tasks.workunit.client.0.smithi033.stdout:4/881: chown d4/d20/d13/d34/d82/df5/d106/db5 5724301 1 2024-02-15T18:31:10.570 INFO:tasks.workunit.client.0.smithi033.stdout:4/882: fsync d4/d20/d13/d1b/da7/fdd 0 2024-02-15T18:31:10.571 INFO:tasks.workunit.client.0.smithi033.stdout:4/883: creat d4/d20/d13/d1b/d10f/f12c x:0 0 0 2024-02-15T18:31:10.571 INFO:tasks.workunit.client.0.smithi033.stdout:4/884: write d4/d20/d37/f42 [4714010,57562] 0 2024-02-15T18:31:10.571 INFO:tasks.workunit.client.0.smithi033.stdout:0/733: symlink d0/d8/lf5 0 2024-02-15T18:31:10.572 INFO:tasks.workunit.client.0.smithi033.stdout:4/885: write d4/d5/d28/d39/d62/d9c/d9e/da4/fdf [3009357,127077] 0 2024-02-15T18:31:10.572 INFO:tasks.workunit.client.0.smithi033.stdout:4/886: fsync d4/d5/d28/d39/d62/f98 0 2024-02-15T18:31:10.572 INFO:tasks.workunit.client.0.smithi033.stdout:0/734: creat d0/d64/d88/ff6 x:0 0 0 2024-02-15T18:31:10.574 INFO:tasks.workunit.client.0.smithi033.stdout:4/887: rmdir d4/d5/d28/d39/d62/d9c/d9e/dcd 39 2024-02-15T18:31:10.574 INFO:tasks.workunit.client.0.smithi033.stdout:8/770: dwrite d0/df/d53/f5d [0,4194304] 0 2024-02-15T18:31:10.574 INFO:tasks.workunit.client.0.smithi033.stdout:3/845: dread d2/d3/d1e/d22/d4d/f6b [0,4194304] 0 2024-02-15T18:31:10.574 INFO:tasks.workunit.client.0.smithi033.stdout:3/846: dread - d2/d14/f67 zero size 2024-02-15T18:31:10.576 INFO:tasks.workunit.client.0.smithi033.stdout:3/847: write d2/d3/d1e/f6e [1839472,92153] 0 2024-02-15T18:31:10.576 INFO:tasks.workunit.client.0.smithi033.stdout:3/848: write d2/d14/db3/fcd [1438194,128809] 0 2024-02-15T18:31:10.576 INFO:tasks.workunit.client.0.smithi033.stdout:0/735: rename d0/d8/d15/d8b/da3/dae/d58/c6e to d0/de8/d8d/cf7 0 2024-02-15T18:31:10.585 INFO:tasks.workunit.client.0.smithi033.stdout:9/711: dwrite d4/d8/dd/d28/d6b/fa7 [0,4194304] 0 2024-02-15T18:31:10.585 INFO:tasks.workunit.client.0.smithi033.stdout:8/771: link d0/fcb d0/df/d48/ffc 0 2024-02-15T18:31:10.587 INFO:tasks.workunit.client.0.smithi033.stdout:3/849: rename d2/d14/d23/f3d to d2/d14/db3/dba/f109 0 2024-02-15T18:31:10.589 INFO:tasks.workunit.client.0.smithi033.stdout:4/888: dread d4/d20/d13/d34/d82/df5/d106/db5/f11b [0,4194304] 0 2024-02-15T18:31:10.590 INFO:tasks.workunit.client.0.smithi033.stdout:4/889: write d4/d20/d13/d1b/d81/ffe [2659989,20783] 0 2024-02-15T18:31:10.590 INFO:tasks.workunit.client.0.smithi033.stdout:4/890: stat d4/d20/d13/d5c/d87/dd0/de5/f118 0 2024-02-15T18:31:10.590 INFO:tasks.workunit.client.0.smithi033.stdout:4/891: write d4/d20/f9a [5181121,125918] 0 2024-02-15T18:31:10.590 INFO:tasks.workunit.client.0.smithi033.stdout:4/892: write d4/d5/d28/d39/d62/d9c/d9e/da4/db1/ff3 [756996,10864] 0 2024-02-15T18:31:10.590 INFO:tasks.workunit.client.0.smithi033.stdout:4/893: dread - d4/d5/d28/d39/d62/d9c/d9e/dcd/fe3 zero size 2024-02-15T18:31:10.590 INFO:tasks.workunit.client.0.smithi033.stdout:9/712: link d4/d8/dd/d41/d51/f80 d4/d2c/db1/ddb/fed 0 2024-02-15T18:31:10.591 INFO:tasks.workunit.client.0.smithi033.stdout:8/772: mknod d0/df/d53/db3/d30/d8e/de0/cfd 0 2024-02-15T18:31:10.594 INFO:tasks.workunit.client.0.smithi033.stdout:4/894: creat d4/d20/d13/d34/d82/df5/d12a/f12d x:0 0 0 2024-02-15T18:31:10.595 INFO:tasks.workunit.client.0.smithi033.stdout:9/713: rename d4/d8/d1b/lb0 to d4/d9f/lee 0 2024-02-15T18:31:10.595 INFO:tasks.workunit.client.0.smithi033.stdout:9/714: chown d4/d8/dd/d28/d6b/caa 590817 1 2024-02-15T18:31:10.595 INFO:tasks.workunit.client.0.smithi033.stdout:4/895: readlink d4/d20/d13/d1b/l33 0 2024-02-15T18:31:10.595 INFO:tasks.workunit.client.0.smithi033.stdout:4/896: readlink d4/d5/dc9/l107 0 2024-02-15T18:31:10.596 INFO:tasks.workunit.client.0.smithi033.stdout:9/715: mknod d4/d32/d6c/cef 0 2024-02-15T18:31:10.597 INFO:tasks.workunit.client.0.smithi033.stdout:4/897: mkdir d4/d5/d28/d39/d62/d9c/d9e/da4/ddb/d12e 0 2024-02-15T18:31:10.600 INFO:tasks.workunit.client.0.smithi033.stdout:9/716: rename d4/d2c/db1/fbd to d4/d8/d1b/d61/dc7/ff0 0 2024-02-15T18:31:10.601 INFO:tasks.workunit.client.0.smithi033.stdout:3/850: dread d2/d14/f44 [0,4194304] 0 2024-02-15T18:31:10.601 INFO:tasks.workunit.client.0.smithi033.stdout:4/898: mknod d4/d5/d28/d39/d62/d9c/d9e/dcd/d10d/c12f 0 2024-02-15T18:31:10.601 INFO:tasks.workunit.client.0.smithi033.stdout:4/899: fsync d4/d20/f11 0 2024-02-15T18:31:10.601 INFO:tasks.workunit.client.0.smithi033.stdout:4/900: getdents d4/d20/d13/d1b/d7c/d91/dbe/dfd 0 2024-02-15T18:31:10.603 INFO:tasks.workunit.client.0.smithi033.stdout:9/717: mknod d4/d8/d1b/cf1 0 2024-02-15T18:31:10.603 INFO:tasks.workunit.client.0.smithi033.stdout:3/851: dread d2/d14/d23/d5c/d61/f63 [0,4194304] 0 2024-02-15T18:31:10.603 INFO:tasks.workunit.client.0.smithi033.stdout:3/852: truncate d2/d3/d17/de6/d88/dd1/ff6 699101 0 2024-02-15T18:31:10.603 INFO:tasks.workunit.client.0.smithi033.stdout:4/901: write d4/d5/d28/d39/d62/d9c/d9e/f110 [664305,40482] 0 2024-02-15T18:31:10.603 INFO:tasks.workunit.client.0.smithi033.stdout:3/853: readlink d2/d3/l3c 0 2024-02-15T18:31:10.603 INFO:tasks.workunit.client.0.smithi033.stdout:3/854: write d2/d14/db3/dba/fea [847019,61840] 0 2024-02-15T18:31:10.604 INFO:tasks.workunit.client.0.smithi033.stdout:9/718: rmdir d4/d8/dd/d5c/d6d 39 2024-02-15T18:31:10.604 INFO:tasks.workunit.client.0.smithi033.stdout:3/855: write d2/d14/f9e [1063646,48745] 0 2024-02-15T18:31:10.604 INFO:tasks.workunit.client.0.smithi033.stdout:9/719: mkdir d4/df2 0 2024-02-15T18:31:10.605 INFO:tasks.workunit.client.0.smithi033.stdout:3/856: mknod d2/d3/d17/de6/c10a 0 2024-02-15T18:31:10.606 INFO:tasks.workunit.client.0.smithi033.stdout:9/720: mkdir d4/d8/d1b/d2f/df3 0 2024-02-15T18:31:10.607 INFO:tasks.workunit.client.0.smithi033.stdout:3/857: mkdir d2/d3/d17/de6/d73/d76/d10b 0 2024-02-15T18:31:10.607 INFO:tasks.workunit.client.0.smithi033.stdout:3/858: write d2/d3/df/d6c/fb5 [849048,12952] 0 2024-02-15T18:31:10.607 INFO:tasks.workunit.client.0.smithi033.stdout:3/859: write d2/d14/d23/f28 [1902520,70490] 0 2024-02-15T18:31:10.608 INFO:tasks.workunit.client.0.smithi033.stdout:4/902: dread d4/d20/d13/d34/d82/df5/d106/db5/f11b [0,4194304] 0 2024-02-15T18:31:10.610 INFO:tasks.workunit.client.0.smithi033.stdout:8/773: dwrite d0/df/d53/db3/d30/d8e/d35/d58/da1/fa2 [0,4194304] 0 2024-02-15T18:31:10.610 INFO:tasks.workunit.client.0.smithi033.stdout:4/903: creat d4/d20/d13/d5c/f130 x:0 0 0 2024-02-15T18:31:10.612 INFO:tasks.workunit.client.0.smithi033.stdout:4/904: dread d4/d20/f11 [0,4194304] 0 2024-02-15T18:31:10.613 INFO:tasks.workunit.client.0.smithi033.stdout:8/774: mknod d0/df/d53/db3/d30/d8e/d8f/d4b/cfe 0 2024-02-15T18:31:10.615 INFO:tasks.workunit.client.0.smithi033.stdout:4/905: creat d4/d20/f131 x:0 0 0 2024-02-15T18:31:10.616 INFO:tasks.workunit.client.0.smithi033.stdout:8/775: write d0/df/d53/db3/d30/f74 [51049,12729] 0 2024-02-15T18:31:10.616 INFO:tasks.workunit.client.0.smithi033.stdout:8/776: write d0/df/d53/db3/d30/fd6 [410921,81179] 0 2024-02-15T18:31:10.628 INFO:tasks.workunit.client.0.smithi033.stdout:4/906: symlink d4/d20/d13/d1b/d10f/l132 0 2024-02-15T18:31:10.628 INFO:tasks.workunit.client.0.smithi033.stdout:8/777: unlink d0/df/d53/db3/d30/d8e/l85 0 2024-02-15T18:31:10.632 INFO:tasks.workunit.client.0.smithi033.stdout:9/721: dwrite d4/d2c/f84 [0,4194304] 0 2024-02-15T18:31:10.632 INFO:tasks.workunit.client.0.smithi033.stdout:9/722: dread - d4/d2c/fd9 zero size 2024-02-15T18:31:10.633 INFO:tasks.workunit.client.0.smithi033.stdout:9/723: write d4/d8/d1b/d73/f86 [1474590,10798] 0 2024-02-15T18:31:10.633 INFO:tasks.workunit.client.0.smithi033.stdout:9/724: fsync d4/d8/dd/d41/d51/f80 0 2024-02-15T18:31:10.638 INFO:tasks.workunit.client.0.smithi033.stdout:8/778: symlink d0/df/d53/db3/d30/d8e/da7/lff 0 2024-02-15T18:31:10.643 INFO:tasks.workunit.client.0.smithi033.stdout:9/725: creat d4/d8/d1b/d2f/df3/ff4 x:0 0 0 2024-02-15T18:31:10.647 INFO:tasks.workunit.client.0.smithi033.stdout:8/779: dread d0/df/d53/f5d [0,4194304] 0 2024-02-15T18:31:10.647 INFO:tasks.workunit.client.0.smithi033.stdout:9/726: getdents d4/d8/d1b/d2f/d65/d8b/d95 0 2024-02-15T18:31:10.672 INFO:tasks.workunit.client.0.smithi033.stdout:8/780: dwrite d0/df/d53/db3/d95/fcc [0,4194304] 0 2024-02-15T18:31:10.672 INFO:tasks.workunit.client.0.smithi033.stdout:8/781: write d0/df/d53/d9b/fa4 [1973362,128256] 0 2024-02-15T18:31:10.674 INFO:tasks.workunit.client.0.smithi033.stdout:9/727: dwrite d4/d8/d1b/d2f/d65/d8b/d95/fbe [0,4194304] 0 2024-02-15T18:31:10.674 INFO:tasks.workunit.client.0.smithi033.stdout:9/728: readlink d4/d8/d1b/l2a 0 2024-02-15T18:31:10.674 INFO:tasks.workunit.client.0.smithi033.stdout:9/729: fdatasync d4/d2c/f84 0 2024-02-15T18:31:10.674 INFO:tasks.workunit.client.0.smithi033.stdout:9/730: fdatasync d4/d32/d6c/f8c 0 2024-02-15T18:31:10.677 INFO:tasks.workunit.client.0.smithi033.stdout:9/731: getdents d4/d9f 0 2024-02-15T18:31:10.687 INFO:tasks.workunit.client.0.smithi033.stdout:8/782: dwrite d0/df/d53/db3/d30/d8e/d14/d56/d59/fd9 [0,4194304] 0 2024-02-15T18:31:10.687 INFO:tasks.workunit.client.0.smithi033.stdout:8/783: truncate d0/f5c 4879071 0 2024-02-15T18:31:10.687 INFO:tasks.workunit.client.0.smithi033.stdout:8/784: chown d0/df/dd3/fe5 1361217 1 2024-02-15T18:31:10.687 INFO:tasks.workunit.client.0.smithi033.stdout:8/785: rename d0/df to d0/df/df0/d100 22 2024-02-15T18:31:10.687 INFO:tasks.workunit.client.0.smithi033.stdout:8/786: write d0/df/d53/db3/d30/d8e/d35/d29/fe7 [446824,68626] 0 2024-02-15T18:31:10.688 INFO:tasks.workunit.client.0.smithi033.stdout:9/732: dread d4/d8/d1b/d61/f7a [0,4194304] 0 2024-02-15T18:31:10.688 INFO:tasks.workunit.client.0.smithi033.stdout:8/787: read d0/df/d53/db3/d30/d8e/d35/d58/fee [4148821,121515] 0 2024-02-15T18:31:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.701+0000 7f654300e700 1 -- 172.21.15.33:0/2095462362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 msgr2=0x7f653c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.701+0000 7f654300e700 1 --2- 172.21.15.33:0/2095462362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 0x7f653c0f6cc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f6528004660 tx=0x7f6528009b30).stop 2024-02-15T18:31:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.701+0000 7f654300e700 1 -- 172.21.15.33:0/2095462362 shutdown_connections 2024-02-15T18:31:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.701+0000 7f654300e700 1 --2- 172.21.15.33:0/2095462362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 0x7f653c0f6cc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.701+0000 7f654300e700 1 --2- 172.21.15.33:0/2095462362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c0f55c0 0x7f653c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.701+0000 7f654300e700 1 -- 172.21.15.33:0/2095462362 >> 172.21.15.33:0/2095462362 conn(0x7f653c0f0d40 msgr2=0x7f653c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.701+0000 7f654300e700 1 -- 172.21.15.33:0/2095462362 shutdown_connections 2024-02-15T18:31:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.702+0000 7f654300e700 1 -- 172.21.15.33:0/2095462362 wait complete. 2024-02-15T18:31:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.702+0000 7f654300e700 1 Processor -- start 2024-02-15T18:31:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.702+0000 7f654300e700 1 -- start start 2024-02-15T18:31:10.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.702+0000 7f654300e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c0f55c0 0x7f653c109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:10.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.702+0000 7f654300e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 0x7f653c10c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:10.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.702+0000 7f654300e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0603e0 con 0x7f653c0f6860 2024-02-15T18:31:10.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.702+0000 7f654300e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c060520 con 0x7f653c0f55c0 2024-02-15T18:31:10.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f653bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 0x7f653c10c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:10.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f653bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 0x7f653c10c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45190/0 (socket says 172.21.15.33:45190) 2024-02-15T18:31:10.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f653bfff700 1 -- 172.21.15.33:0/1811357944 learned_addr learned my addr 172.21.15.33:0/1811357944 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:10.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f6540daa700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c0f55c0 0x7f653c109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:10.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f653bfff700 1 -- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c0f55c0 msgr2=0x7f653c109cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f653bfff700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c0f55c0 0x7f653c109cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f653bfff700 1 -- 172.21.15.33:0/1811357944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528005040 con 0x7f653c0f6860 2024-02-15T18:31:10.698 INFO:tasks.workunit.client.0.smithi033.stdout:9/733: unlink d4/d8/dd/d41/l57 0 2024-02-15T18:31:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f653bfff700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 0x7f653c10c1c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f6528009f50 tx=0x7f6528009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f65397fa700 1 -- 172.21.15.33:0/1811357944 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6528018070 con 0x7f653c0f6860 2024-02-15T18:31:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c10c710 con 0x7f653c0f6860 2024-02-15T18:31:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f65397fa700 1 -- 172.21.15.33:0/1811357944 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f6528007ba0 con 0x7f653c0f6860 2024-02-15T18:31:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f65397fa700 1 -- 172.21.15.33:0/1811357944 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652801c420 con 0x7f653c0f6860 2024-02-15T18:31:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.703+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c10cc70 con 0x7f653c0f6860 2024-02-15T18:31:10.700 INFO:tasks.workunit.client.0.smithi033.stdout:8/788: getdents d0/df/dd3 0 2024-02-15T18:31:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.704+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c045ad0 con 0x7f653c0f6860 2024-02-15T18:31:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.705+0000 7f65397fa700 1 -- 172.21.15.33:0/1811357944 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 74714+0+0 (secure 0 0 0) 0x7f652801d420 con 0x7f653c0f6860 2024-02-15T18:31:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.705+0000 7f65397fa700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f652c05e960 0x7f652c060e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.706+0000 7f65397fa700 1 -- 172.21.15.33:0/1811357944 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f652807ac20 con 0x7f653c0f6860 2024-02-15T18:31:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.706+0000 7f6540daa700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f652c05e960 0x7f652c060e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.706+0000 7f6540daa700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f652c05e960 0x7f652c060e20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f653c060060 tx=0x7f653000b040).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:10.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.711+0000 7f65397fa700 1 -- 172.21.15.33:0/1811357944 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f652804b190 con 0x7f653c0f6860 2024-02-15T18:31:10.705 INFO:tasks.workunit.client.0.smithi033.stdout:9/734: dread d4/d8/dd/d5c/f72 [0,4194304] 0 2024-02-15T18:31:10.713 INFO:tasks.workunit.client.0.smithi033.stdout:8/789: dwrite d0/df/d53/db3/d30/d8e/d8f/f79 [0,4194304] 0 2024-02-15T18:31:10.714 INFO:tasks.workunit.client.0.smithi033.stdout:8/790: fsync d0/df/d53/db3/d30/d8e/de0/ff3 0 2024-02-15T18:31:10.716 INFO:tasks.workunit.client.0.smithi033.stdout:5/966: sync 2024-02-15T18:31:10.718 INFO:tasks.workunit.client.0.smithi033.stdout:8/791: write d0/df/d53/db3/d30/d8e/d14/d56/d59/fd9 [2216184,65144] 0 2024-02-15T18:31:10.718 INFO:tasks.workunit.client.0.smithi033.stdout:9/735: dwrite d4/d8/d1b/d2f/f92 [0,4194304] 0 2024-02-15T18:31:10.721 INFO:tasks.workunit.client.0.smithi033.stdout:8/792: rename d0/df/d53/db3/d30/d8e/d14/d56/d59/lf1 to d0/df/d53/db3/d95/l101 0 2024-02-15T18:31:10.721 INFO:tasks.workunit.client.0.smithi033.stdout:8/793: readlink d0/df/d53/le2 0 2024-02-15T18:31:10.723 INFO:tasks.workunit.client.0.smithi033.stdout:9/736: mknod d4/d8/d1b/d73/cf5 0 2024-02-15T18:31:10.724 INFO:tasks.workunit.client.0.smithi033.stdout:8/794: mkdir d0/daa/d102 0 2024-02-15T18:31:10.727 INFO:tasks.workunit.client.0.smithi033.stdout:8/795: unlink d0/df/d53/db3/d30/d8e/d35/d29/d5f/da5/lac 0 2024-02-15T18:31:10.727 INFO:tasks.workunit.client.0.smithi033.stdout:8/796: stat d0/df/d53/db3/d30/d8e/d8f/d4b/d72/fbc 0 2024-02-15T18:31:10.727 INFO:tasks.workunit.client.0.smithi033.stdout:8/797: truncate d0/df/d53/db3/d30/d8e/d14/d56/ff4 1023140 0 2024-02-15T18:31:10.731 INFO:tasks.workunit.client.0.smithi033.stdout:8/798: rename d0/df/d53/db3/d30/d8e/d8f/l37 to d0/df/d53/db3/d30/d8e/d35/d29/l103 0 2024-02-15T18:31:10.733 INFO:tasks.workunit.client.0.smithi033.stdout:8/799: unlink d0/df/f11 0 2024-02-15T18:31:10.742 INFO:tasks.workunit.client.0.smithi033.stdout:5/967: dwrite d1/da/d19/d3f/fa9 [0,4194304] 0 2024-02-15T18:31:10.743 INFO:tasks.workunit.client.0.smithi033.stdout:9/737: dwrite d4/d8/d1b/d2f/df3/ff4 [0,4194304] 0 2024-02-15T18:31:10.746 INFO:tasks.workunit.client.0.smithi033.stdout:9/738: unlink d4/d8/d1b/d73/f86 0 2024-02-15T18:31:10.746 INFO:tasks.workunit.client.0.smithi033.stdout:9/739: write d4/d8/dd/d28/fd2 [767455,39850] 0 2024-02-15T18:31:10.748 INFO:tasks.workunit.client.0.smithi033.stdout:9/740: creat d4/d9f/ff6 x:0 0 0 2024-02-15T18:31:10.748 INFO:tasks.workunit.client.0.smithi033.stdout:9/741: chown d4/d8/d1b/d2f/f79 13 1 2024-02-15T18:31:10.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:08.780734+0000 mgr.smithi131.buibla (mgr.24387) 24 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:10.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:09.231023+0000 mgr.smithi131.buibla (mgr.24387) 25 : audit [DBG] from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:10.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:10.085820+0000 mon.smithi033 (mon.0) 617 : audit [DBG] from='client.? 172.21.15.33:0/1083674591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:10.753 INFO:tasks.workunit.client.0.smithi033.stdout:9/742: symlink d4/d8/d1b/d73/lf7 0 2024-02-15T18:31:10.755 INFO:tasks.workunit.client.0.smithi033.stdout:9/743: rename d4/d8/dd/d28/l59 to d4/d2c/db1/lf8 0 2024-02-15T18:31:10.755 INFO:tasks.workunit.client.0.smithi033.stdout:9/744: stat d4/d32/l81 0 2024-02-15T18:31:10.765 INFO:tasks.workunit.client.0.smithi033.stdout:8/800: dwrite d0/df/db/d45/fef [0,4194304] 0 2024-02-15T18:31:10.771 INFO:tasks.workunit.client.0.smithi033.stdout:9/745: dread d4/d8/dd/f39 [0,4194304] 0 2024-02-15T18:31:10.771 INFO:tasks.workunit.client.0.smithi033.stdout:9/746: fdatasync d4/d8/dd/d28/f2b 0 2024-02-15T18:31:10.771 INFO:tasks.workunit.client.0.smithi033.stdout:5/968: dwrite d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d9a/f111 [0,4194304] 0 2024-02-15T18:31:10.771 INFO:tasks.workunit.client.0.smithi033.stdout:5/969: fdatasync d1/da/fb 0 2024-02-15T18:31:10.772 INFO:tasks.workunit.client.0.smithi033.stdout:5/970: fsync d1/da/d88/f97 0 2024-02-15T18:31:10.772 INFO:tasks.workunit.client.0.smithi033.stdout:5/971: chown d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d65/f91 15128993 1 2024-02-15T18:31:10.773 INFO:tasks.workunit.client.0.smithi033.stdout:9/747: mkdir d4/d8/dd/df9 0 2024-02-15T18:31:10.775 INFO:tasks.workunit.client.0.smithi033.stdout:5/972: mkdir d1/da/d11/d5e/d13d 0 2024-02-15T18:31:10.775 INFO:tasks.workunit.client.0.smithi033.stdout:9/748: mkdir d4/d8/d1b/d2f/df3/dfa 0 2024-02-15T18:31:10.777 INFO:tasks.workunit.client.0.smithi033.stdout:9/749: creat d4/ffb x:0 0 0 2024-02-15T18:31:10.777 INFO:tasks.workunit.client.0.smithi033.stdout:9/750: chown d4/d8/dd/d28/l34 6734 1 2024-02-15T18:31:10.786 INFO:tasks.workunit.client.0.smithi033.stdout:8/801: dwrite d0/df/db/d45/f98 [0,4194304] 0 2024-02-15T18:31:10.786 INFO:tasks.workunit.client.0.smithi033.stdout:6/855: sync 2024-02-15T18:31:10.786 INFO:tasks.workunit.client.0.smithi033.stdout:7/880: sync 2024-02-15T18:31:10.786 INFO:tasks.workunit.client.0.smithi033.stdout:2/837: sync 2024-02-15T18:31:10.788 INFO:tasks.workunit.client.0.smithi033.stdout:8/802: chown d0/df/d53/db3/d30/d8e/d14/d56/d59/fd9 121877903 1 2024-02-15T18:31:10.788 INFO:tasks.workunit.client.0.smithi033.stdout:6/856: write d8/d28/f11 [657794,128516] 0 2024-02-15T18:31:10.788 INFO:tasks.workunit.client.0.smithi033.stdout:8/803: chown d0/df/d53/db3/d30/d8e/d8f/d4b/c5e 5979537 1 2024-02-15T18:31:10.788 INFO:tasks.workunit.client.0.smithi033.stdout:8/804: readlink d0/df/d53/db3/d30/d8e/d35/d29/l80 0 2024-02-15T18:31:10.788 INFO:tasks.workunit.client.0.smithi033.stdout:6/857: getdents d8/d1d/d37/d72/da1 0 2024-02-15T18:31:10.789 INFO:tasks.workunit.client.0.smithi033.stdout:8/805: write d0/df/d53/db3/d30/fd6 [631510,9748] 0 2024-02-15T18:31:10.789 INFO:tasks.workunit.client.0.smithi033.stdout:7/881: mkdir d0/dc/d10/d1d/d38/d74/d7f/da2/d108/d132 0 2024-02-15T18:31:10.789 INFO:tasks.workunit.client.0.smithi033.stdout:7/882: write d0/dc/d10/d48/ffc [586801,80856] 0 2024-02-15T18:31:10.789 INFO:tasks.workunit.client.0.smithi033.stdout:7/883: dread - d0/dc/d10/d7d/d99/fdd zero size 2024-02-15T18:31:10.790 INFO:tasks.workunit.client.0.smithi033.stdout:2/838: link d20/d3a/ff0 d20/d31/d47/d64/d110/f126 0 2024-02-15T18:31:10.792 INFO:tasks.workunit.client.0.smithi033.stdout:6/858: mkdir d8/d1d/d37/dbf/dd0/d10a 0 2024-02-15T18:31:10.793 INFO:tasks.workunit.client.0.smithi033.stdout:2/839: creat d20/d31/f127 x:0 0 0 2024-02-15T18:31:10.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:08.780734+0000 mgr.smithi131.buibla (mgr.24387) 24 : audit [DBG] from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:10.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:09.231023+0000 mgr.smithi131.buibla (mgr.24387) 25 : audit [DBG] from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:10.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:10.085820+0000 mon.smithi033 (mon.0) 617 : audit [DBG] from='client.? 172.21.15.33:0/1083674591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:10.799 INFO:tasks.workunit.client.0.smithi033.stdout:2/840: dread d20/d31/d47/d82/fd3 [0,4194304] 0 2024-02-15T18:31:10.800 INFO:tasks.workunit.client.0.smithi033.stdout:7/884: dread d0/d56/d70/fd4 [0,4194304] 0 2024-02-15T18:31:10.801 INFO:tasks.workunit.client.0.smithi033.stdout:9/751: dwrite d4/d8/dd/f70 [0,4194304] 0 2024-02-15T18:31:10.802 INFO:tasks.workunit.client.0.smithi033.stdout:5/973: dwrite d1/f27 [0,4194304] 0 2024-02-15T18:31:10.802 INFO:tasks.workunit.client.0.smithi033.stdout:5/974: dread - d1/da/d11/d5e/db1/fa1 zero size 2024-02-15T18:31:10.806 INFO:tasks.workunit.client.0.smithi033.stdout:6/859: creat d8/d1d/d37/f10b x:0 0 0 2024-02-15T18:31:10.808 INFO:tasks.workunit.client.0.smithi033.stdout:7/885: creat d0/dc/d10/d1d/d38/f133 x:0 0 0 2024-02-15T18:31:10.811 INFO:tasks.workunit.client.0.smithi033.stdout:5/975: mknod d1/da/d11/d5e/db1/d12b/d129/c13e 0 2024-02-15T18:31:10.812 INFO:tasks.workunit.client.0.smithi033.stdout:5/976: dread - d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d9a/dfd/fff zero size 2024-02-15T18:31:10.813 INFO:tasks.workunit.client.0.smithi033.stdout:6/860: mkdir d8/d28/d14/d2c/dd7/d10c 0 2024-02-15T18:31:10.814 INFO:tasks.workunit.client.0.smithi033.stdout:7/886: creat d0/dc/d10/d48/d109/f134 x:0 0 0 2024-02-15T18:31:10.815 INFO:tasks.workunit.client.0.smithi033.stdout:5/977: creat d1/da/d11/d5e/d13d/f13f x:0 0 0 2024-02-15T18:31:10.816 INFO:tasks.workunit.client.0.smithi033.stdout:7/887: unlink d0/dc/d10/d48/c72 0 2024-02-15T18:31:10.816 INFO:tasks.workunit.client.0.smithi033.stdout:7/888: chown d0/dc/d10/d1d/d38/d74/de7/f122 13405 1 2024-02-15T18:31:10.816 INFO:tasks.workunit.client.0.smithi033.stdout:7/889: write d0/dc/d10/d1d/d38/d74/f87 [5148620,35628] 0 2024-02-15T18:31:10.817 INFO:tasks.workunit.client.0.smithi033.stdout:5/978: link d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d9a/fef d1/da/d11/d5e/db1/d12b/d129/d42/f140 0 2024-02-15T18:31:10.819 INFO:tasks.workunit.client.0.smithi033.stdout:5/979: symlink d1/da/d11/d5e/db1/d63/d61/da3/l141 0 2024-02-15T18:31:10.819 INFO:tasks.workunit.client.0.smithi033.stdout:8/806: dwrite d0/df/d53/db3/d30/d8e/d35/d58/da1/fa2 [4194304,4194304] 0 2024-02-15T18:31:10.820 INFO:tasks.workunit.client.0.smithi033.stdout:9/752: dwrite d4/d8/dd/f39 [4194304,4194304] 0 2024-02-15T18:31:10.822 INFO:tasks.workunit.client.0.smithi033.stdout:8/807: unlink d0/df/d53/db3/d30/d8e/d14/d56/f84 0 2024-02-15T18:31:10.824 INFO:tasks.workunit.client.0.smithi033.stdout:9/753: write d4/d8/d1b/d2f/df3/ff4 [2273371,54723] 0 2024-02-15T18:31:10.824 INFO:tasks.workunit.client.0.smithi033.stdout:9/754: truncate d4/d8/dd/d28/fd2 1361354 0 2024-02-15T18:31:10.824 INFO:tasks.workunit.client.0.smithi033.stdout:8/808: mknod d0/df/d53/db3/d30/d8e/d14/d56/d59/df2/c104 0 2024-02-15T18:31:10.824 INFO:tasks.workunit.client.0.smithi033.stdout:8/809: chown d0/df/d53/db3/f3b 65515 1 2024-02-15T18:31:10.828 INFO:tasks.workunit.client.0.smithi033.stdout:8/810: link d0/df/d53/db3/d30/d8e/d8f/d4b/c5e d0/df/d53/db3/d30/d8e/d35/c105 0 2024-02-15T18:31:10.830 INFO:tasks.workunit.client.0.smithi033.stdout:5/980: dread d1/f27 [0,4194304] 0 2024-02-15T18:31:10.832 INFO:tasks.workunit.client.0.smithi033.stdout:6/861: dwrite d8/d28/d14/d2c/d31/ded/d5e/da5/fa8 [0,4194304] 0 2024-02-15T18:31:10.832 INFO:tasks.workunit.client.0.smithi033.stdout:8/811: dread d0/df/db/fde [0,4194304] 0 2024-02-15T18:31:10.832 INFO:tasks.workunit.client.0.smithi033.stdout:6/862: chown d8/d28/d14/d2c/d31/d30/d29/d38/fde 2339 1 2024-02-15T18:31:10.832 INFO:tasks.workunit.client.0.smithi033.stdout:8/812: chown d0/df/d53/db3/d30/d8e/d35/d58/deb 247586 1 2024-02-15T18:31:10.832 INFO:tasks.workunit.client.0.smithi033.stdout:8/813: write d0/df/d53/db3/d30/d8e/d14/d56/db0/fb4 [835050,92067] 0 2024-02-15T18:31:10.833 INFO:tasks.workunit.client.0.smithi033.stdout:8/814: write d0/df/d53/db3/d30/d8e/d35/d58/da1/fa2 [8190774,1489] 0 2024-02-15T18:31:10.833 INFO:tasks.workunit.client.0.smithi033.stdout:5/981: getdents d1/da/d19/d3f/d68/df2 0 2024-02-15T18:31:10.834 INFO:tasks.workunit.client.0.smithi033.stdout:5/982: chown d1/da/d19/f3e 398 1 2024-02-15T18:31:10.835 INFO:tasks.workunit.client.0.smithi033.stdout:4/907: sync 2024-02-15T18:31:10.835 INFO:tasks.workunit.client.0.smithi033.stdout:1/873: sync 2024-02-15T18:31:10.835 INFO:tasks.workunit.client.0.smithi033.stdout:3/860: sync 2024-02-15T18:31:10.836 INFO:tasks.workunit.client.0.smithi033.stdout:0/736: sync 2024-02-15T18:31:10.837 INFO:tasks.workunit.client.0.smithi033.stdout:6/863: rename d8/d28/d14/d2c/d31/d30/d29/d38/f96 to d8/d1d/d37/dbf/dd0/d10a/f10d 0 2024-02-15T18:31:10.837 INFO:tasks.workunit.client.0.smithi033.stdout:6/864: dread - d8/d28/d14/d2c/d31/d30/d29/fc8 zero size 2024-02-15T18:31:10.837 INFO:tasks.workunit.client.0.smithi033.stdout:6/865: fsync d8/d1d/fa6 0 2024-02-15T18:31:10.839 INFO:tasks.workunit.client.0.smithi033.stdout:8/815: creat d0/df/db/d45/dc6/f106 x:0 0 0 2024-02-15T18:31:10.841 INFO:tasks.workunit.client.0.smithi033.stdout:4/908: dread d4/d5/d28/d39/d62/d9c/d9e/da4/db1/ff3 [0,4194304] 0 2024-02-15T18:31:10.844 INFO:tasks.workunit.client.0.smithi033.stdout:3/861: creat d2/d14/d23/d6f/d93/f10c x:0 0 0 2024-02-15T18:31:10.844 INFO:tasks.workunit.client.0.smithi033.stdout:0/737: mknod d0/d8/d15/d8b/da3/dae/d59/cf8 0 2024-02-15T18:31:10.844 INFO:tasks.workunit.client.0.smithi033.stdout:1/874: rename d5/dd/f114 to d5/dd/d12/dc6/f118 0 2024-02-15T18:31:10.845 INFO:tasks.workunit.client.0.smithi033.stdout:4/909: mknod d4/d20/d13/d34/d82/df5/d106/db5/c133 0 2024-02-15T18:31:10.845 INFO:tasks.workunit.client.0.smithi033.stdout:4/910: chown d4/f46 30310 1 2024-02-15T18:31:10.849 INFO:tasks.workunit.client.0.smithi033.stdout:0/738: mkdir d0/d8/d15/df9 0 2024-02-15T18:31:10.849 INFO:tasks.workunit.client.0.smithi033.stdout:3/862: link d2/d3/f9f d2/d3/df/f10d 0 2024-02-15T18:31:10.849 INFO:tasks.workunit.client.0.smithi033.stdout:4/911: mkdir d4/d126/d134 0 2024-02-15T18:31:10.850 INFO:tasks.workunit.client.0.smithi033.stdout:4/912: unlink d4/d20/c10 0 2024-02-15T18:31:10.851 INFO:tasks.workunit.client.0.smithi033.stdout:3/863: link d2/d3/d17/f69 d2/d3/d17/de6/d73/d83/f10e 0 2024-02-15T18:31:10.851 INFO:tasks.workunit.client.0.smithi033.stdout:3/864: chown d2/d14/f67 3140 1 2024-02-15T18:31:10.853 INFO:tasks.workunit.client.0.smithi033.stdout:4/913: link d4/d5/d28/d39/d62/d9c/d9e/dcd/d10d/c12f d4/d20/d13/d1b/da7/c135 0 2024-02-15T18:31:10.853 INFO:tasks.workunit.client.0.smithi033.stdout:4/914: write d4/d20/d13/d1b/d7c/d91/dbe/ff0 [347162,2813] 0 2024-02-15T18:31:10.862 INFO:tasks.workunit.client.0.smithi033.stdout:0/739: dread d0/d64/d1d/f43 [0,4194304] 0 2024-02-15T18:31:10.863 INFO:tasks.workunit.client.0.smithi033.stdout:4/915: dread d4/d5/d28/d39/d62/d9c/d9e/dcd/ff6 [0,4194304] 0 2024-02-15T18:31:10.866 INFO:tasks.workunit.client.0.smithi033.stdout:5/983: dwrite d1/da/fb6 [0,4194304] 0 2024-02-15T18:31:10.868 INFO:tasks.workunit.client.0.smithi033.stdout:1/875: dwrite d5/dd/fd8 [4194304,4194304] 0 2024-02-15T18:31:10.868 INFO:tasks.workunit.client.0.smithi033.stdout:6/866: dwrite d8/d1d/d37/d4f/fcd [4194304,4194304] 0 2024-02-15T18:31:10.869 INFO:tasks.workunit.client.0.smithi033.stdout:5/984: rename d1/da/d11/d5e/db1/d63/d61/da3/l141 to d1/da/d11/d5e/db1/d63/d61/l142 0 2024-02-15T18:31:10.869 INFO:tasks.workunit.client.0.smithi033.stdout:5/985: write d1/da/d11/d5e/f94 [67423,26095] 0 2024-02-15T18:31:10.871 INFO:tasks.workunit.client.0.smithi033.stdout:1/876: unlink d5/d38/f117 0 2024-02-15T18:31:10.871 INFO:tasks.workunit.client.0.smithi033.stdout:1/877: write d5/d9/d1e/d20/d5c/d57/ff8 [928135,111229] 0 2024-02-15T18:31:10.873 INFO:tasks.workunit.client.0.smithi033.stdout:6/867: creat d8/d70/f10e x:0 0 0 2024-02-15T18:31:10.875 INFO:tasks.workunit.client.0.smithi033.stdout:4/916: dread d4/d20/d13/d1b/f109 [0,4194304] 0 2024-02-15T18:31:10.876 INFO:tasks.workunit.client.0.smithi033.stdout:4/917: write d4/d20/d13/d1b/d81/d9f/f128 [926209,116530] 0 2024-02-15T18:31:10.876 INFO:tasks.workunit.client.0.smithi033.stdout:4/918: truncate d4/d20/d13/d5c/dd1/f10a 695661 0 2024-02-15T18:31:10.876 INFO:tasks.workunit.client.0.smithi033.stdout:5/986: rename d1/da/d11/d5e/db1/d12b/d129/f4d to d1/da/d19/d3f/d68/f143 0 2024-02-15T18:31:10.876 INFO:tasks.workunit.client.0.smithi033.stdout:1/878: creat d5/d9/d1e/d20/d2c/d34/d51/d63/f119 x:0 0 0 2024-02-15T18:31:10.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/868: mknod d8/d28/d14/d2c/d31/ded/c10f 0 2024-02-15T18:31:10.877 INFO:tasks.workunit.client.0.smithi033.stdout:6/869: dread - d8/d1d/d37/d4f/dbb/d55/ffa zero size 2024-02-15T18:31:10.890 INFO:tasks.workunit.client.0.smithi033.stdout:4/919: stat d4/d20/d13/d1b/d81/d9f/cad 0 2024-02-15T18:31:10.890 INFO:tasks.workunit.client.0.smithi033.stdout:4/920: truncate d4/d20/fbf 847975 0 2024-02-15T18:31:10.890 INFO:tasks.workunit.client.0.smithi033.stdout:5/987: rmdir d1/da/d19/da6 39 2024-02-15T18:31:10.892 INFO:tasks.workunit.client.0.smithi033.stdout:1/879: rename d5/d9/d1e/d20/d2c/db2/lea to d5/d9/d1e/d20/d2c/d34/l11a 0 2024-02-15T18:31:10.893 INFO:tasks.workunit.client.0.smithi033.stdout:6/870: unlink d8/f4e 0 2024-02-15T18:31:10.894 INFO:tasks.workunit.client.0.smithi033.stdout:4/921: write d4/d20/d13/f6e [311553,115837] 0 2024-02-15T18:31:10.896 INFO:tasks.workunit.client.0.smithi033.stdout:5/988: creat d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/f144 x:0 0 0 2024-02-15T18:31:10.896 INFO:tasks.workunit.client.0.smithi033.stdout:1/880: creat d5/d9/f11b x:0 0 0 2024-02-15T18:31:10.896 INFO:tasks.workunit.client.0.smithi033.stdout:6/871: symlink d8/d1d/d37/d4f/dbb/d55/d60/dd6/l110 0 2024-02-15T18:31:10.896 INFO:tasks.workunit.client.0.smithi033.stdout:1/881: dread - d5/d9/d1e/d20/d5c/d57/d82/fb5 zero size 2024-02-15T18:31:10.896 INFO:tasks.workunit.client.0.smithi033.stdout:1/882: chown d5/dd/d12/d49/cdc 7463 1 2024-02-15T18:31:10.897 INFO:tasks.workunit.client.0.smithi033.stdout:4/922: rmdir d4/d5/d28 39 2024-02-15T18:31:10.898 INFO:tasks.workunit.client.0.smithi033.stdout:6/872: creat d8/d28/d14/d2c/d31/d30/d29/d38/f111 x:0 0 0 2024-02-15T18:31:10.899 INFO:tasks.workunit.client.0.smithi033.stdout:1/883: stat d5/d9/d1e/d20/d2c/d65/l89 0 2024-02-15T18:31:10.901 INFO:tasks.workunit.client.0.smithi033.stdout:6/873: rename d8/d28/d14/d2c/d3b/d3d/cce to d8/d28/d14/d2c/d31/d30/d29/d67/c112 0 2024-02-15T18:31:10.906 INFO:tasks.workunit.client.0.smithi033.stdout:6/874: read d8/d1d/d37/d4f/dbb/d57/fd3 [387547,85261] 0 2024-02-15T18:31:10.908 INFO:tasks.workunit.client.0.smithi033.stdout:1/884: link d5/dd/d12/d49/d23/f72 d5/d9/f11c 0 2024-02-15T18:31:10.909 INFO:tasks.workunit.client.0.smithi033.stdout:6/875: mknod d8/c113 0 2024-02-15T18:31:10.913 INFO:tasks.workunit.client.0.smithi033.stdout:6/876: creat d8/d28/d14/d2c/de7/dfe/f114 x:0 0 0 2024-02-15T18:31:10.913 INFO:tasks.workunit.client.0.smithi033.stdout:6/877: truncate d8/d70/fc2 344342 0 2024-02-15T18:31:10.916 INFO:tasks.workunit.client.0.smithi033.stdout:1/885: dread d5/d9/d1e/d20/d2c/d34/dc0/fd3 [0,4194304] 0 2024-02-15T18:31:10.917 INFO:tasks.workunit.client.0.smithi033.stdout:1/886: truncate d5/d9/d1e/d20/d2c/d34/d51/fad 1032335 0 2024-02-15T18:31:10.919 INFO:tasks.workunit.client.0.smithi033.stdout:6/878: mknod d8/d28/d14/d2c/d31/ded/c115 0 2024-02-15T18:31:10.921 INFO:tasks.workunit.client.0.smithi033.stdout:4/923: dwrite d4/d20/f131 [0,4194304] 0 2024-02-15T18:31:10.921 INFO:tasks.workunit.client.0.smithi033.stdout:4/924: chown d4/d20/d37/f4d 23615956 1 2024-02-15T18:31:10.921 INFO:tasks.workunit.client.0.smithi033.stdout:4/925: read - d4/d5/d28/d39/d62/d9c/d9e/da4/f113 zero size 2024-02-15T18:31:10.930 INFO:tasks.workunit.client.0.smithi033.stdout:4/926: dread d4/d20/fb [0,4194304] 0 2024-02-15T18:31:10.930 INFO:tasks.workunit.client.0.smithi033.stdout:1/887: creat d5/dd/d12/d49/f11d x:0 0 0 2024-02-15T18:31:10.930 INFO:tasks.workunit.client.0.smithi033.stdout:6/879: mkdir d8/d28/d14/d2c/d116 0 2024-02-15T18:31:10.930 INFO:tasks.workunit.client.0.smithi033.stdout:6/880: stat d8/d1d/d37/c5f 0 2024-02-15T18:31:10.932 INFO:tasks.workunit.client.0.smithi033.stdout:6/881: creat d8/d1d/d37/dbf/f117 x:0 0 0 2024-02-15T18:31:10.933 INFO:tasks.workunit.client.0.smithi033.stdout:6/882: creat d8/d70/f118 x:0 0 0 2024-02-15T18:31:10.934 INFO:tasks.workunit.client.0.smithi033.stdout:6/883: getdents d8/d28 0 2024-02-15T18:31:10.936 INFO:tasks.workunit.client.0.smithi033.stdout:6/884: symlink d8/d28/d14/d2c/d31/ded/d5e/da5/de0/l119 0 2024-02-15T18:31:10.937 INFO:tasks.workunit.client.0.smithi033.stdout:6/885: fsync d8/d28/fcf 0 2024-02-15T18:31:10.938 INFO:tasks.workunit.client.0.smithi033.stdout:6/886: link d8/d28/c7e d8/d70/c11a 0 2024-02-15T18:31:10.939 INFO:tasks.workunit.client.0.smithi033.stdout:1/888: dread d5/d9/d1e/d20/d2c/d34/d51/ddb/f10a [0,4194304] 0 2024-02-15T18:31:10.939 INFO:tasks.workunit.client.0.smithi033.stdout:1/889: write d5/d9/d1e/d20/d2c/d34/d51/f83 [1037311,44436] 0 2024-02-15T18:31:10.939 INFO:tasks.workunit.client.0.smithi033.stdout:1/890: write d5/d9/d1e/d20/d2c/d34/f40 [1587937,67052] 0 2024-02-15T18:31:10.939 INFO:tasks.workunit.client.0.smithi033.stdout:1/891: stat d5/d38/f99 0 2024-02-15T18:31:10.940 INFO:tasks.workunit.client.0.smithi033.stdout:6/887: creat d8/d28/d14/d2c/d31/d30/de1/df5/f11b x:0 0 0 2024-02-15T18:31:10.940 INFO:tasks.workunit.client.0.smithi033.stdout:6/888: chown d8/d28/d14/d2c/d31/d30/f71 47609004 1 2024-02-15T18:31:10.940 INFO:tasks.workunit.client.0.smithi033.stdout:1/892: chown d5/d9/f32 1545113 1 2024-02-15T18:31:10.941 INFO:tasks.workunit.client.0.smithi033.stdout:1/893: dread d5/d9/d1e/d20/d2c/f8c [0,4194304] 0 2024-02-15T18:31:10.943 INFO:tasks.workunit.client.0.smithi033.stdout:1/894: creat d5/d96/f11e x:0 0 0 2024-02-15T18:31:10.944 INFO:tasks.workunit.client.0.smithi033.stdout:1/895: creat d5/d9/d1e/d20/d2c/f11f x:0 0 0 2024-02-15T18:31:10.944 INFO:tasks.workunit.client.0.smithi033.stdout:1/896: readlink d5/dd/d12/d49/l71 0 2024-02-15T18:31:10.945 INFO:tasks.workunit.client.0.smithi033.stdout:1/897: write d5/d9/ff [2016327,58475] 0 2024-02-15T18:31:10.945 INFO:tasks.workunit.client.0.smithi033.stdout:1/898: creat d5/d9/d1e/df4/f120 x:0 0 0 2024-02-15T18:31:10.945 INFO:tasks.workunit.client.0.smithi033.stdout:1/899: write d5/d9/d1e/d20/d2c/d34/d51/d63/d76/f9f [649713,58188] 0 2024-02-15T18:31:10.945 INFO:tasks.workunit.client.0.smithi033.stdout:1/900: dread - d5/d96/f11e zero size 2024-02-15T18:31:10.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.959+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 --> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f653c057f10 con 0x7f652c05e960 2024-02-15T18:31:10.953 INFO:tasks.workunit.client.0.smithi033.stdout:4/927: dread d4/d20/ff [0,4194304] 0 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.960+0000 7f65397fa700 1 -- 172.21.15.33:0/1811357944 <== mgr.24387 v2:172.21.15.131:6828/3968122283 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f653c057f10 con 0x7f652c05e960 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [], 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "1/21 daemons upgraded", 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "", 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:31:10.954 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:31:10.955 INFO:tasks.workunit.client.0.smithi033.stdout:4/928: truncate d4/d5/d28/d39/d62/d9c/d9e/f110 1016123 0 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f652c05e960 msgr2=0x7f652c060e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f652c05e960 0x7f652c060e20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f653c060060 tx=0x7f653000b040).stop 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 msgr2=0x7f653c10c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 0x7f653c10c1c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f6528009f50 tx=0x7f6528009b30).stop 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 shutdown_connections 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:6828/3968122283,v1:172.21.15.131:6829/3968122283] conn(0x7f652c05e960 0x7f652c060e20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c0f55c0 0x7f653c109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 --2- 172.21.15.33:0/1811357944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f653c0f6860 0x7f653c10c1c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 >> 172.21.15.33:0/1811357944 conn(0x7f653c0f0d40 msgr2=0x7f653c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 shutdown_connections 2024-02-15T18:31:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:10.963+0000 7f654300e700 1 -- 172.21.15.33:0/1811357944 wait complete. 2024-02-15T18:31:10.957 INFO:tasks.workunit.client.0.smithi033.stdout:4/929: mkdir d4/d20/d13/d34/d82/df5/d136 0 2024-02-15T18:31:10.962 INFO:tasks.workunit.client.0.smithi033.stdout:6/889: dwrite d8/d28/d14/d2c/d31/ded/f88 [0,4194304] 0 2024-02-15T18:31:10.966 INFO:tasks.workunit.client.0.smithi033.stdout:6/890: dread d8/d28/d14/d2c/d31/d30/f2d [0,4194304] 0 2024-02-15T18:31:10.966 INFO:tasks.workunit.client.0.smithi033.stdout:6/891: write d8/d28/d14/d2c/d31/d5d/ffb [853057,93937] 0 2024-02-15T18:31:10.968 INFO:tasks.workunit.client.0.smithi033.stdout:6/892: symlink d8/d28/d14/d2c/d31/d30/d29/l11c 0 2024-02-15T18:31:10.968 INFO:tasks.workunit.client.0.smithi033.stdout:1/901: dwrite d5/dd/d12/d49/d23/f7f [0,4194304] 0 2024-02-15T18:31:10.968 INFO:tasks.workunit.client.0.smithi033.stdout:1/902: write d5/d9/d1e/d20/d2c/f9a [802158,25386] 0 2024-02-15T18:31:10.968 INFO:tasks.workunit.client.0.smithi033.stdout:1/903: read - d5/d9/d1e/f111 zero size 2024-02-15T18:31:10.973 INFO:tasks.workunit.client.0.smithi033.stdout:1/904: symlink d5/dd/d12/d49/l121 0 2024-02-15T18:31:10.973 INFO:tasks.workunit.client.0.smithi033.stdout:1/905: fdatasync d5/d9/d1e/d20/d2c/d34/d51/f10b 0 2024-02-15T18:31:10.975 INFO:tasks.workunit.client.0.smithi033.stdout:1/906: creat d5/dcb/f122 x:0 0 0 2024-02-15T18:31:10.975 INFO:tasks.workunit.client.0.smithi033.stdout:1/907: chown d5/d9/d1e/d20/d5c/d57/ff8 57583699 1 2024-02-15T18:31:10.975 INFO:tasks.workunit.client.0.smithi033.stdout:1/908: truncate d5/dcb/fe5 857678 0 2024-02-15T18:31:10.975 INFO:tasks.workunit.client.0.smithi033.stdout:1/909: truncate d5/dd/fcd 45310 0 2024-02-15T18:31:10.975 INFO:tasks.workunit.client.0.smithi033.stdout:1/910: fsync d5/d9/d1e/d20/d5c/d57/d59/f7b 0 2024-02-15T18:31:10.976 INFO:tasks.workunit.client.0.smithi033.stdout:1/911: link d5/d9/ff d5/d17/f123 0 2024-02-15T18:31:10.977 INFO:tasks.workunit.client.0.smithi033.stdout:1/912: creat d5/d9/f124 x:0 0 0 2024-02-15T18:31:10.977 INFO:tasks.workunit.client.0.smithi033.stdout:1/913: dread - d5/dd/f3b zero size 2024-02-15T18:31:10.977 INFO:tasks.workunit.client.0.smithi033.stdout:1/914: rename d5/dd to d5/dd/d12/d125 22 2024-02-15T18:31:10.977 INFO:tasks.workunit.client.0.smithi033.stdout:1/915: fsync d5/d9/d1e/d20/d5c/d57/ff8 0 2024-02-15T18:31:10.978 INFO:tasks.workunit.client.0.smithi033.stdout:1/916: dread d5/d9/d1e/d20/d2c/f8c [0,4194304] 0 2024-02-15T18:31:10.978 INFO:tasks.workunit.client.0.smithi033.stdout:1/917: symlink d5/d9/d1e/d20/d2c/d34/d51/d63/l126 0 2024-02-15T18:31:10.992 INFO:tasks.workunit.client.0.smithi033.stdout:4/930: dwrite d4/f22 [0,4194304] 0 2024-02-15T18:31:10.994 INFO:tasks.workunit.client.0.smithi033.stdout:4/931: dread d4/d20/d13/d1b/f6a [0,4194304] 0 2024-02-15T18:31:10.995 INFO:tasks.workunit.client.0.smithi033.stdout:4/932: read - d4/d3c/faf zero size 2024-02-15T18:31:10.999 INFO:tasks.workunit.client.0.smithi033.stdout:6/893: dwrite d8/d28/d14/d2c/de7/dfe/f114 [0,4194304] 0 2024-02-15T18:31:11.002 INFO:tasks.workunit.client.0.smithi033.stdout:1/918: dwrite d5/d9/d1e/d20/d5c/d57/fa7 [0,4194304] 0 2024-02-15T18:31:11.065 INFO:tasks.workunit.client.0.smithi033.stdout:4/933: symlink d4/d3c/l137 0 2024-02-15T18:31:11.065 INFO:tasks.workunit.client.0.smithi033.stdout:4/934: chown d4/d20/d37/fbc 15028 1 2024-02-15T18:31:11.158 INFO:tasks.workunit.client.0.smithi033.stdout:6/894: rename d8/f90 to d8/d28/d14/d2c/de7/f11d 0 2024-02-15T18:31:11.159 INFO:tasks.workunit.client.0.smithi033.stdout:6/895: chown d8/d1d/d37/d4f/dcb/lc1 943058 1 2024-02-15T18:31:11.164 INFO:tasks.workunit.client.0.smithi033.stdout:1/919: mknod d5/d9/d1e/d20/c127 0 2024-02-15T18:31:11.165 INFO:tasks.workunit.client.0.smithi033.stdout:2/841: sync 2024-02-15T18:31:11.165 INFO:tasks.workunit.client.0.smithi033.stdout:9/755: sync 2024-02-15T18:31:11.165 INFO:tasks.workunit.client.0.smithi033.stdout:7/890: sync 2024-02-15T18:31:11.165 INFO:tasks.workunit.client.0.smithi033.stdout:2/842: readlink d20/d3a/d4a/d5e/l78 0 2024-02-15T18:31:11.165 INFO:tasks.workunit.client.0.smithi033.stdout:7/891: fsync d0/dc/fd7 0 2024-02-15T18:31:11.165 INFO:tasks.workunit.client.0.smithi033.stdout:0/740: sync 2024-02-15T18:31:11.166 INFO:tasks.workunit.client.0.smithi033.stdout:3/865: sync 2024-02-15T18:31:11.166 INFO:tasks.workunit.client.0.smithi033.stdout:5/989: sync 2024-02-15T18:31:11.167 INFO:tasks.workunit.client.0.smithi033.stdout:4/935: creat d4/d5/d28/d39/d62/f138 x:0 0 0 2024-02-15T18:31:11.167 INFO:tasks.workunit.client.0.smithi033.stdout:6/896: mkdir d8/d28/d14/d2c/d11e 0 2024-02-15T18:31:11.167 INFO:tasks.workunit.client.0.smithi033.stdout:6/897: chown d8/d28/f11 7386 1 2024-02-15T18:31:11.167 INFO:tasks.workunit.client.0.smithi033.stdout:3/866: write d2/f2e [8763559,60986] 0 2024-02-15T18:31:11.167 INFO:tasks.workunit.client.0.smithi033.stdout:9/756: mknod d4/d8/dd/d5c/d6d/d97/cfc 0 2024-02-15T18:31:11.167 INFO:tasks.workunit.client.0.smithi033.stdout:4/936: write d4/d20/d37/fac [3732175,10117] 0 2024-02-15T18:31:11.169 INFO:tasks.workunit.client.0.smithi033.stdout:2/843: creat d20/d31/d47/d4c/dc4/f128 x:0 0 0 2024-02-15T18:31:11.169 INFO:tasks.workunit.client.0.smithi033.stdout:2/844: readlink d20/d31/d47/da4/l101 0 2024-02-15T18:31:11.169 INFO:tasks.workunit.client.0.smithi033.stdout:2/845: truncate d20/f43 8663413 0 2024-02-15T18:31:11.169 INFO:tasks.workunit.client.0.smithi033.stdout:5/990: mkdir d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d65/d145 0 2024-02-15T18:31:11.170 INFO:tasks.workunit.client.0.smithi033.stdout:3/867: truncate d2/d14/d23/d6f/d93/fc4 515397 0 2024-02-15T18:31:11.170 INFO:tasks.workunit.client.0.smithi033.stdout:4/937: mknod d4/d20/d13/d1b/d7c/c139 0 2024-02-15T18:31:11.171 INFO:tasks.workunit.client.0.smithi033.stdout:2/846: symlink d20/d31/d47/d82/l129 0 2024-02-15T18:31:11.171 INFO:tasks.workunit.client.0.smithi033.stdout:5/991: rmdir d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d65/d145 0 2024-02-15T18:31:11.172 INFO:tasks.workunit.client.0.smithi033.stdout:5/992: write d1/da/fc9 [909654,124619] 0 2024-02-15T18:31:11.172 INFO:tasks.workunit.client.0.smithi033.stdout:3/868: rmdir d2/d3/d17/de6 39 2024-02-15T18:31:11.175 INFO:tasks.workunit.client.0.smithi033.stdout:5/993: creat d1/da/d11/d5e/db1/d12b/d129/d42/d4c/d116/d40/d65/f146 x:0 0 0 2024-02-15T18:31:11.175 INFO:tasks.workunit.client.0.smithi033.stdout:5/994: chown d1/da/d11/c12e 0 1 2024-02-15T18:31:11.176 INFO:tasks.workunit.client.0.smithi033.stdout:3/869: getdents d2/d14/db3/dba 0 2024-02-15T18:31:11.176 INFO:tasks.workunit.client.0.smithi033.stdout:5/995: fdatasync d1/da/d11/f8f 0 2024-02-15T18:31:11.177 INFO:tasks.workunit.client.0.smithi033.stdout:5/996: mknod d1/da/d11/d5e/db1/d12b/d129/c147 0 2024-02-15T18:31:11.182 INFO:tasks.workunit.client.0.smithi033.stdout:3/870: creat d2/d3/d1e/d22/d59/f10f x:0 0 0 2024-02-15T18:31:11.183 INFO:tasks.workunit.client.0.smithi033.stdout:5/997: symlink d1/da/d11/d5e/d138/l148 0 2024-02-15T18:31:11.186 INFO:tasks.workunit.client.0.smithi033.stdout:5/998: link d1/da/d11/d5e/db1/d12b/d129/d42/d4c/lf3 d1/da/d19/d3f/d68/df2/l149 0 2024-02-15T18:31:11.189 INFO:tasks.workunit.client.0.smithi033.stdout:5/999: unlink d1/da/d11/d5e/db1/d12b/d10e/c130 0 2024-02-15T18:31:11.190 INFO:tasks.workunit.client.0.smithi033.stdout:4/938: dread d4/d20/d13/d1b/d7c/d91/dbe/f101 [0,4194304] 0 2024-02-15T18:31:11.190 INFO:tasks.workunit.client.0.smithi033.stdout:4/939: fsync d4/d20/d13/d1b/f64 0 2024-02-15T18:31:11.204 INFO:tasks.workunit.client.0.smithi033.stdout:1/920: dwrite d5/f8 [4194304,4194304] 0 2024-02-15T18:31:11.204 INFO:tasks.workunit.client.0.smithi033.stdout:0/741: dread d0/d8/d54/f90 [0,4194304] 0 2024-02-15T18:31:11.204 INFO:tasks.workunit.client.0.smithi033.stdout:1/921: chown d5/dd/d12/d49/f4a 34 1 2024-02-15T18:31:11.208 INFO:tasks.workunit.client.0.smithi033.stdout:1/922: read d5/d9/d1e/d20/d5c/d57/d82/fba [1023071,3368] 0 2024-02-15T18:31:11.208 INFO:tasks.workunit.client.0.smithi033.stdout:1/923: write d5/dd/d12/d49/fe9 [423755,77539] 0 2024-02-15T18:31:11.208 INFO:tasks.workunit.client.0.smithi033.stdout:1/924: chown d5/d9/d1e/d20/d2c/ca4 1 1 2024-02-15T18:31:11.208 INFO:tasks.workunit.client.0.smithi033.stdout:0/742: rename d0/d8/d15/d2d/d41/de6 to d0/d8/d15/d8b/da3/dae/d59/dfa 0 2024-02-15T18:31:11.208 INFO:tasks.workunit.client.0.smithi033.stdout:0/743: fdatasync d0/de8/d97/fbe 0 2024-02-15T18:31:11.209 INFO:tasks.workunit.client.0.smithi033.stdout:1/925: mkdir d5/d9/d1e/d20/d5c/d57/d82/d128 0 2024-02-15T18:31:11.209 INFO:tasks.workunit.client.0.smithi033.stdout:1/926: stat d5/d9/d1e/d20/d2c/d34/d51/d63/f119 0 2024-02-15T18:31:11.210 INFO:tasks.workunit.client.0.smithi033.stdout:0/744: mkdir d0/de8/d8d/dec/d9e/dfb 0 2024-02-15T18:31:11.210 INFO:tasks.workunit.client.0.smithi033.stdout:0/745: dread - d0/d8/d15/d8b/da3/dae/d59/fc2 zero size 2024-02-15T18:31:11.210 INFO:tasks.workunit.client.0.smithi033.stdout:0/746: chown d0/d8/d15/d8b/da3/dae/d59 3925 1 2024-02-15T18:31:11.211 INFO:tasks.workunit.client.0.smithi033.stdout:0/747: creat d0/d8/d15/d5b/d83/ffc x:0 0 0 2024-02-15T18:31:11.212 INFO:tasks.workunit.client.0.smithi033.stdout:1/927: mkdir d5/dd/d129 0 2024-02-15T18:31:11.213 INFO:tasks.workunit.client.0.smithi033.stdout:0/748: mkdir d0/d8/d15/d8b/da3/dfd 0 2024-02-15T18:31:11.216 INFO:tasks.workunit.client.0.smithi033.stdout:6/898: dwrite d8/d1d/d37/d4f/dbb/d57/ff4 [0,4194304] 0 2024-02-15T18:31:11.219 INFO:tasks.workunit.client.0.smithi033.stdout:6/899: unlink d8/d28/d14/d2c/d31/d30/lb2 0 2024-02-15T18:31:11.220 INFO:tasks.workunit.client.0.smithi033.stdout:6/900: rename d8/d28/d14/d2c/d31/ded/f88 to d8/d28/d14/d2c/d31/d30/de1/f11f 0 2024-02-15T18:31:11.222 INFO:tasks.workunit.client.0.smithi033.stdout:6/901: creat d8/d28/d14/d2c/d3b/dff/f120 x:0 0 0 2024-02-15T18:31:11.222 INFO:tasks.workunit.client.0.smithi033.stdout:6/902: chown d8/d28/fcf 1 1 2024-02-15T18:31:11.223 INFO:tasks.workunit.client.0.smithi033.stdout:6/903: rmdir d8/d1d/d37/d4f/dcb 39 2024-02-15T18:31:11.224 INFO:tasks.workunit.client.0.smithi033.stdout:6/904: truncate d8/d28/d14/f43 2462476 0 2024-02-15T18:31:11.232 INFO:tasks.workunit.client.0.smithi033.stdout:7/892: dwrite d0/dc/d10/d48/d4b/fa9 [0,4194304] 0 2024-02-15T18:31:11.234 INFO:tasks.workunit.client.0.smithi033.stdout:2/847: dwrite f19 [0,4194304] 0 2024-02-15T18:31:11.234 INFO:tasks.workunit.client.0.smithi033.stdout:2/848: fdatasync d20/d31/d47/d4c/def/d80/f85 0 2024-02-15T18:31:11.234 INFO:tasks.workunit.client.0.smithi033.stdout:0/749: dwrite d0/d8/d15/d2d/d41/d79/fc7 [0,4194304] 0 2024-02-15T18:31:11.234 INFO:tasks.workunit.client.0.smithi033.stdout:0/750: chown d0/de8/d8d/dec/d9e/la2 24747963 1 2024-02-15T18:31:11.234 INFO:tasks.workunit.client.0.smithi033.stdout:0/751: truncate d0/de8/d97/db1/dca/de0/fe5 106370 0 2024-02-15T18:31:11.235 INFO:tasks.workunit.client.0.smithi033.stdout:4/940: dwrite d4/d20/f11 [0,4194304] 0 2024-02-15T18:31:11.236 INFO:tasks.workunit.client.0.smithi033.stdout:9/757: dwrite d4/d8/d1b/d2f/f76 [8388608,4194304] 0 2024-02-15T18:31:11.236 INFO:tasks.workunit.client.0.smithi033.stdout:3/871: dwrite d2/d14/d23/f43 [0,4194304] 0 2024-02-15T18:31:11.236 INFO:tasks.workunit.client.0.smithi033.stdout:3/872: chown d2/d14/db3 3022 1 2024-02-15T18:31:11.236 INFO:tasks.workunit.client.0.smithi033.stdout:7/893: rename d0/d56/d70/fd4 to d0/dc/d10/d1d/d38/daa/f135 0 2024-02-15T18:31:11.236 INFO:tasks.workunit.client.0.smithi033.stdout:7/894: write d0/dc/d10/d1d/d38/f12d [320907,118025] 0 2024-02-15T18:31:11.237 INFO:tasks.workunit.client.0.smithi033.stdout:3/873: write d2/d14/db3/dba/f109 [3423476,60613] 0 2024-02-15T18:31:11.237 INFO:tasks.workunit.client.0.smithi033.stdout:8/816: sync 2024-02-15T18:31:11.240 INFO:tasks.workunit.client.0.smithi033.stdout:2/849: rmdir d20/de1/d125 0 2024-02-15T18:31:11.240 INFO:tasks.workunit.client.0.smithi033.stdout:2/850: fsync d20/d73/f117 0 2024-02-15T18:31:11.241 INFO:tasks.workunit.client.0.smithi033.stdout:3/874: write d2/f6d [105052,78323] 0 2024-02-15T18:31:11.242 INFO:tasks.workunit.client.0.smithi033.stdout:4/941: dread d4/d20/f7a [0,4194304] 0 2024-02-15T18:31:11.244 INFO:tasks.workunit.client.0.smithi033.stdout:6/905: dwrite d8/d28/d14/d2c/d31/d30/f71 [0,4194304] 0 2024-02-15T18:31:11.254 INFO:tasks.workunit.client.0.smithi033.stdout:0/752: unlink d0/d8/l5a 0 2024-02-15T18:31:11.258 INFO:tasks.workunit.client.0.smithi033.stdout:2/851: dwrite d20/d31/f7c [0,4194304] 0 2024-02-15T18:31:11.259 INFO:tasks.workunit.client.0.smithi033.stdout:2/852: fsync d20/d31/d47/f6d 0 2024-02-15T18:31:11.260 INFO:tasks.workunit.client.0.smithi033.stdout:9/758: creat d4/d8/dd/d5c/d6d/dbc/ffd x:0 0 0 2024-02-15T18:31:11.262 INFO:tasks.workunit.client.0.smithi033.stdout:7/895: mkdir d0/d56/d70/d91/d9e/d110/d113/d136 0 2024-02-15T18:31:11.267 INFO:tasks.workunit.client.0.smithi033.stdout:3/875: truncate d2/d14/d23/d5c/d7f/ff1 225187 0 2024-02-15T18:31:11.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/906: link d8/d28/d14/d2c/dd7/l102 d8/d28/d14/d2c/d31/ded/d5e/da5/l121 0 2024-02-15T18:31:11.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/907: stat d8/d28/d14/d2c/d11e 0 2024-02-15T18:31:11.270 INFO:tasks.workunit.client.0.smithi033.stdout:0/753: creat d0/d8/d15/d8b/da3/d6c/ffe x:0 0 0 2024-02-15T18:31:11.283 INFO:tasks.workunit.client.0.smithi033.stdout:7/896: mkdir d0/d56/d70/d91/d9e/d110/d137 0 2024-02-15T18:31:11.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/759: creat d4/d2c/db1/ddb/ffe x:0 0 0 2024-02-15T18:31:11.284 INFO:tasks.workunit.client.0.smithi033.stdout:2/853: getdents d20/d31/d47/d82 0 2024-02-15T18:31:11.284 INFO:tasks.workunit.client.0.smithi033.stdout:6/908: truncate d8/d1d/d37/dbf/dd0/fe5 1911820 0 2024-02-15T18:31:11.285 INFO:tasks.workunit.client.0.smithi033.stdout:7/897: truncate d0/dc/d10/d7d/f50 936819 0 2024-02-15T18:31:11.286 INFO:tasks.workunit.client.0.smithi033.stdout:9/760: mknod d4/d8/dd/d5c/cff 0 2024-02-15T18:31:11.288 INFO:tasks.workunit.client.0.smithi033.stdout:2/854: link d20/d3a/d4a/d5e/d6b/d88/cd7 d20/d31/d47/d82/de6/c12a 0 2024-02-15T18:31:11.289 INFO:tasks.workunit.client.0.smithi033.stdout:2/855: chown d20/d3a/d4a/d5e/d6b 4047 1 2024-02-15T18:31:11.289 INFO:tasks.workunit.client.0.smithi033.stdout:2/856: chown d20/d3a/c84 227139 1 2024-02-15T18:31:11.289 INFO:tasks.workunit.client.0.smithi033.stdout:2/857: chown d20/d3a/ff0 48967761 1 2024-02-15T18:31:11.289 INFO:tasks.workunit.client.0.smithi033.stdout:2/858: stat d20/d31/dc8/ff3 0 2024-02-15T18:31:11.289 INFO:tasks.workunit.client.0.smithi033.stdout:0/754: dread d0/d8/d15/d2d/d41/d73/d96/faf [0,4194304] 0 2024-02-15T18:31:11.290 INFO:tasks.workunit.client.0.smithi033.stdout:7/898: unlink d0/dc/d10/d7d/d93/dc2/ff4 0 2024-02-15T18:31:11.290 INFO:tasks.workunit.client.0.smithi033.stdout:7/899: dread - d0/dc/d10/d1d/d38/f129 zero size 2024-02-15T18:31:11.291 INFO:tasks.workunit.client.0.smithi033.stdout:9/761: creat d4/d8/f100 x:0 0 0 2024-02-15T18:31:11.291 INFO:tasks.workunit.client.0.smithi033.stdout:2/859: stat d20/d31/d47/d4c/def/d80/da0/cca 0 2024-02-15T18:31:11.291 INFO:tasks.workunit.client.0.smithi033.stdout:2/860: fdatasync d20/d3a/fa2 0 2024-02-15T18:31:11.292 INFO:tasks.workunit.client.0.smithi033.stdout:9/762: symlink d4/d8/dd/d28/d6b/l101 0 2024-02-15T18:31:11.292 INFO:tasks.workunit.client.0.smithi033.stdout:9/763: fdatasync d4/d8/dd/d28/feb 0 2024-02-15T18:31:11.293 INFO:tasks.workunit.client.0.smithi033.stdout:0/755: write d0/f13 [1815674,91419] 0 2024-02-15T18:31:11.293 INFO:tasks.workunit.client.0.smithi033.stdout:0/756: truncate d0/d8/d15/d2d/fab 5003991 0 2024-02-15T18:31:11.293 INFO:tasks.workunit.client.0.smithi033.stdout:2/861: mknod d20/de1/c12b 0 2024-02-15T18:31:11.294 INFO:tasks.workunit.client.0.smithi033.stdout:9/764: creat d4/d8/dd/d5c/f102 x:0 0 0 2024-02-15T18:31:11.295 INFO:tasks.workunit.client.0.smithi033.stdout:0/757: creat d0/d64/d1d/fff x:0 0 0 2024-02-15T18:31:11.295 INFO:tasks.workunit.client.0.smithi033.stdout:2/862: creat d20/d31/d47/d64/d9e/f12c x:0 0 0 2024-02-15T18:31:11.296 INFO:tasks.workunit.client.0.smithi033.stdout:2/863: truncate d20/d3a/d4a/d5e/ff6 400577 0 2024-02-15T18:31:11.297 INFO:tasks.workunit.client.0.smithi033.stdout:9/765: mknod d4/d8/d1b/d2f/c103 0 2024-02-15T18:31:11.297 INFO:tasks.workunit.client.0.smithi033.stdout:8/817: dwrite d0/df/db/f23 [0,4194304] 0 2024-02-15T18:31:11.298 INFO:tasks.workunit.client.0.smithi033.stdout:8/818: read d0/df/d53/db3/d30/d8e/fb2 [1466458,107273] 0 2024-02-15T18:31:11.298 INFO:tasks.workunit.client.0.smithi033.stdout:0/758: mkdir d0/d64/d1d/dd3/d100 0 2024-02-15T18:31:11.298 INFO:tasks.workunit.client.0.smithi033.stdout:8/819: write d0/df/d53/db3/d30/d8e/d14/d56/ff4 [1372028,87672] 0 2024-02-15T18:31:11.298 INFO:tasks.workunit.client.0.smithi033.stdout:8/820: chown d0/df/db/d45/f75 970222188 1 2024-02-15T18:31:11.298 INFO:tasks.workunit.client.0.smithi033.stdout:8/821: chown d0/df/d53/db3/d30/d8e/d14/d56/l96 96 1 2024-02-15T18:31:11.298 INFO:tasks.workunit.client.0.smithi033.stdout:0/759: chown d0/d8/d15/d8b/da3/dae/d59/dfa/ld4 1026029076 1 2024-02-15T18:31:11.298 INFO:tasks.workunit.client.0.smithi033.stdout:3/876: dwrite d2/d14/d23/fe9 [0,4194304] 0 2024-02-15T18:31:11.298 INFO:tasks.workunit.client.0.smithi033.stdout:3/877: fsync d2/d3/d1e/d22/d4d/fad 0 2024-02-15T18:31:11.298 INFO:tasks.workunit.client.0.smithi033.stdout:3/878: chown d2 27537 1 2024-02-15T18:31:11.302 INFO:tasks.workunit.client.0.smithi033.stdout:2/864: creat d20/f12d x:0 0 0 2024-02-15T18:31:11.302 INFO:tasks.workunit.client.0.smithi033.stdout:2/865: readlink d20/d3a/d4a/d5e/lfa 0 2024-02-15T18:31:11.302 INFO:tasks.workunit.client.0.smithi033.stdout:2/866: stat d20/d31/d47/d4c/f92 0 2024-02-15T18:31:11.302 INFO:tasks.workunit.client.0.smithi033.stdout:2/867: chown d20/f12d 1024113 1 2024-02-15T18:31:11.303 INFO:tasks.workunit.client.0.smithi033.stdout:9/766: creat d4/d32/d6c/f104 x:0 0 0 2024-02-15T18:31:11.304 INFO:tasks.workunit.client.0.smithi033.stdout:0/760: creat d0/de8/d8d/dec/d9e/dfb/f101 x:0 0 0 2024-02-15T18:31:11.304 INFO:tasks.workunit.client.0.smithi033.stdout:8/822: dread d0/df/d53/db3/d30/d8e/d35/f64 [0,4194304] 0 2024-02-15T18:31:11.304 INFO:tasks.workunit.client.0.smithi033.stdout:6/909: dwrite d8/d28/d14/d2c/d3b/fb8 [0,4194304] 0 2024-02-15T18:31:11.305 INFO:tasks.workunit.client.0.smithi033.stdout:8/823: fdatasync d0/df/d53/db3/d30/d8e/d35/d29/fd4 0 2024-02-15T18:31:11.306 INFO:tasks.workunit.client.0.smithi033.stdout:3/879: getdents d2/d3/d17/de6 0 2024-02-15T18:31:11.307 INFO:tasks.workunit.client.0.smithi033.stdout:2/868: creat d20/d31/d47/d64/d9e/f12e x:0 0 0 2024-02-15T18:31:11.308 INFO:tasks.workunit.client.0.smithi033.stdout:9/767: unlink d4/d32/f3b 0 2024-02-15T18:31:11.309 INFO:tasks.workunit.client.0.smithi033.stdout:0/761: mkdir d0/de8/d8d/dec/da4/d102 0 2024-02-15T18:31:11.309 INFO:tasks.workunit.client.0.smithi033.stdout:0/762: read - d0/d8/d15/d8b/da3/dae/d58/d80/dc1/fc3 zero size 2024-02-15T18:31:11.313 INFO:tasks.workunit.client.0.smithi033.stdout:6/910: getdents d8 0 2024-02-15T18:31:11.314 INFO:tasks.workunit.client.0.smithi033.stdout:8/824: rmdir d0/df/d53/db3/d30/d8e/d8f/d4b/d72 39 2024-02-15T18:31:11.316 INFO:tasks.workunit.client.0.smithi033.stdout:8/825: dread d0/df/d53/db3/d30/d8e/d35/d29/fe7 [0,4194304] 0 2024-02-15T18:31:11.317 INFO:tasks.workunit.client.0.smithi033.stdout:6/911: dread d8/d28/f17 [0,4194304] 0 2024-02-15T18:31:11.321 INFO:tasks.workunit.client.0.smithi033.stdout:6/912: dread d8/d1d/d37/dbf/dd0/fe5 [0,4194304] 0 2024-02-15T18:31:11.321 INFO:tasks.workunit.client.0.smithi033.stdout:6/913: chown d8/d1d/d37/d4f/dbb/d57/fec 1957610684 1 2024-02-15T18:31:11.321 INFO:tasks.workunit.client.0.smithi033.stdout:6/914: write d8/d70/f118 [4007,24892] 0 2024-02-15T18:31:11.321 INFO:tasks.workunit.client.0.smithi033.stdout:6/915: readlink d8/d28/d14/d2c/d31/d5d/d8c/ld9 0 2024-02-15T18:31:11.325 INFO:tasks.workunit.client.0.smithi033.stdout:8/826: dread d0/df/d53/db3/d30/fc0 [0,4194304] 0 2024-02-15T18:31:11.325 INFO:tasks.workunit.client.0.smithi033.stdout:8/827: chown d0/df/d53/db3/d30/d8e/d14/d56/d59/c83 219030 1 2024-02-15T18:31:11.325 INFO:tasks.workunit.client.0.smithi033.stdout:3/880: mknod d2/d3/df/d6c/c110 0 2024-02-15T18:31:11.326 INFO:tasks.workunit.client.0.smithi033.stdout:3/881: stat d2/d14/d23/f28 0 2024-02-15T18:31:11.327 INFO:tasks.workunit.client.0.smithi033.stdout:2/869: unlink d20/d30/f44 0 2024-02-15T18:31:11.329 INFO:tasks.workunit.client.0.smithi033.stdout:9/768: link d4/d32/cc2 d4/d8/d1b/d2f/d65/c105 0 2024-02-15T18:31:11.330 INFO:tasks.workunit.client.0.smithi033.stdout:0/763: symlink d0/d8/d15/d8b/da3/dae/d58/d80/dc1/l103 0 2024-02-15T18:31:11.331 INFO:tasks.workunit.client.0.smithi033.stdout:8/828: mknod d0/df/d53/db3/d30/d8e/d35/d58/deb/c107 0 2024-02-15T18:31:11.332 INFO:tasks.workunit.client.0.smithi033.stdout:3/882: creat d2/d14/db3/f111 x:0 0 0 2024-02-15T18:31:11.332 INFO:tasks.workunit.client.0.smithi033.stdout:2/870: creat d20/d3a/d4a/d5e/d10c/f12f x:0 0 0 2024-02-15T18:31:11.333 INFO:tasks.workunit.client.0.smithi033.stdout:2/871: chown d20/d3a/cf4 6 1 2024-02-15T18:31:11.333 INFO:tasks.workunit.client.0.smithi033.stdout:2/872: chown d20/d3a/d4a/d5e/d6b 0 1 2024-02-15T18:31:11.334 INFO:tasks.workunit.client.0.smithi033.stdout:0/764: rename d0 to d0/d8/d104 22 2024-02-15T18:31:11.334 INFO:tasks.workunit.client.0.smithi033.stdout:9/769: symlink d4/d8/d1b/d61/l106 0 2024-02-15T18:31:11.335 INFO:tasks.workunit.client.0.smithi033.stdout:3/883: dread d2/d3/d17/de6/fa2 [0,4194304] 0 2024-02-15T18:31:11.335 INFO:tasks.workunit.client.0.smithi033.stdout:3/884: truncate d2/d3/df/d6c/fd2 2794832 0 2024-02-15T18:31:11.335 INFO:tasks.workunit.client.0.smithi033.stdout:8/829: creat d0/df/df0/f108 x:0 0 0 2024-02-15T18:31:11.335 INFO:tasks.workunit.client.0.smithi033.stdout:8/830: readlink d0/df/db/l76 0 2024-02-15T18:31:11.335 INFO:tasks.workunit.client.0.smithi033.stdout:0/765: mkdir d0/de8/d8d/dec/d105 0 2024-02-15T18:31:11.336 INFO:tasks.workunit.client.0.smithi033.stdout:0/766: write d0/d8/d15/d8b/da3/dae/d58/d80/d9b/fb2 [610745,12566] 0 2024-02-15T18:31:11.336 INFO:tasks.workunit.client.0.smithi033.stdout:0/767: fdatasync d0/d2/f34 0 2024-02-15T18:31:11.336 INFO:tasks.workunit.client.0.smithi033.stdout:0/768: chown d0/f7a 0 1 2024-02-15T18:31:11.336 INFO:tasks.workunit.client.0.smithi033.stdout:9/770: creat d4/d2c/db1/ddb/de9/f107 x:0 0 0 2024-02-15T18:31:11.338 INFO:tasks.workunit.client.0.smithi033.stdout:8/831: getdents d0/df/d53/db3 0 2024-02-15T18:31:11.339 INFO:tasks.workunit.client.0.smithi033.stdout:0/769: rmdir d0/d8/d15/d2d 39 2024-02-15T18:31:11.340 INFO:tasks.workunit.client.0.smithi033.stdout:8/832: symlink d0/df/d53/db3/d30/d8e/d14/d56/d59/df2/l109 0 2024-02-15T18:31:11.341 INFO:tasks.workunit.client.0.smithi033.stdout:0/770: rename d0/f7a to d0/de8/d97/f106 0 2024-02-15T18:31:11.346 INFO:tasks.workunit.client.0.smithi033.stdout:3/885: rmdir d2/d14/db3 39 2024-02-15T18:31:11.346 INFO:tasks.workunit.client.0.smithi033.stdout:3/886: read - d2/d3/dcc/ff3 zero size 2024-02-15T18:31:11.349 INFO:tasks.workunit.client.0.smithi033.stdout:0/771: rename d0/d8/d15/d2d/l4f to d0/d8/d15/d5b/d94/l107 0 2024-02-15T18:31:11.349 INFO:tasks.workunit.client.0.smithi033.stdout:0/772: dread - d0/d8/d15/d5b/ff4 zero size 2024-02-15T18:31:11.349 INFO:tasks.workunit.client.0.smithi033.stdout:0/773: write d0/de8/d8d/fc6 [749092,80402] 0 2024-02-15T18:31:11.350 INFO:tasks.workunit.client.0.smithi033.stdout:3/887: mkdir d2/d14/d23/d5c/d7f/de7/d112 0 2024-02-15T18:31:11.351 INFO:tasks.workunit.client.0.smithi033.stdout:0/774: creat d0/d8/d15/d8b/da3/f108 x:0 0 0 2024-02-15T18:31:11.354 INFO:tasks.workunit.client.0.smithi033.stdout:6/916: dwrite d8/d28/f9c [4194304,4194304] 0 2024-02-15T18:31:11.356 INFO:tasks.workunit.client.0.smithi033.stdout:6/917: symlink d8/d28/d14/d2c/d3b/l122 0 2024-02-15T18:31:11.358 INFO:tasks.workunit.client.0.smithi033.stdout:6/918: dread d8/d1d/ff0 [0,4194304] 0 2024-02-15T18:31:11.358 INFO:tasks.workunit.client.0.smithi033.stdout:6/919: chown d8/d1d/c40 3526277 1 2024-02-15T18:31:11.366 INFO:tasks.workunit.client.0.smithi033.stdout:8/833: dwrite d0/f5c [0,4194304] 0 2024-02-15T18:31:11.368 INFO:tasks.workunit.client.0.smithi033.stdout:8/834: creat d0/daa/d102/f10a x:0 0 0 2024-02-15T18:31:11.369 INFO:tasks.workunit.client.0.smithi033.stdout:8/835: link d0/df/db/d45/dc6/f106 d0/df/db/d45/dc6/df7/f10b 0 2024-02-15T18:31:11.369 INFO:tasks.workunit.client.0.smithi033.stdout:8/836: readlink d0/l47 0 2024-02-15T18:31:11.375 INFO:tasks.workunit.client.0.smithi033.stdout:8/837: mkdir d0/df/d53/db3/d30/d8e/d35/d29/d5f/da5/d10c 0 2024-02-15T18:31:11.375 INFO:tasks.workunit.client.0.smithi033.stdout:8/838: write d0/df/db/d45/f8c [744952,84221] 0 2024-02-15T18:31:11.378 INFO:tasks.workunit.client.0.smithi033.stdout:8/839: getdents d0/df/d53/db3/d30 0 2024-02-15T18:31:11.379 INFO:tasks.workunit.client.0.smithi033.stdout:8/840: truncate d0/df/d53/db3/d30/d8e/de0/ff3 259344 0 2024-02-15T18:31:11.380 INFO:tasks.workunit.client.0.smithi033.stdout:8/841: creat d0/df/db/d45/dc6/df7/f10d x:0 0 0 2024-02-15T18:31:11.381 INFO:tasks.workunit.client.0.smithi033.stdout:8/842: creat d0/df/d53/db3/f10e x:0 0 0 2024-02-15T18:31:11.381 INFO:tasks.workunit.client.0.smithi033.stdout:8/843: chown d0/df/d53/db3/d30/d8e/da7/df8 989 1 2024-02-15T18:31:11.382 INFO:tasks.workunit.client.0.smithi033.stdout:8/844: creat d0/df/d48/dbf/f10f x:0 0 0 2024-02-15T18:31:11.382 INFO:tasks.workunit.client.0.smithi033.stdout:8/845: readlink d0/df/d53/db3/d30/d8e/da7/lce 0 2024-02-15T18:31:11.382 INFO:tasks.workunit.client.0.smithi033.stdout:8/846: read - d0/df/d53/db3/d30/d8e/d35/d58/deb/ffa zero size 2024-02-15T18:31:11.382 INFO:tasks.workunit.client.0.smithi033.stdout:3/888: dwrite d2/d14/d23/d5c/d7f/ff1 [0,4194304] 0 2024-02-15T18:31:11.384 INFO:tasks.workunit.client.0.smithi033.stdout:2/873: dwrite f19 [0,4194304] 0 2024-02-15T18:31:11.386 INFO:tasks.workunit.client.0.smithi033.stdout:2/874: creat d20/f130 x:0 0 0 2024-02-15T18:31:11.386 INFO:tasks.workunit.client.0.smithi033.stdout:6/920: dwrite d8/d28/f11 [0,4194304] 0 2024-02-15T18:31:11.387 INFO:tasks.workunit.client.0.smithi033.stdout:2/875: truncate d20/d73/fcb 2895937 0 2024-02-15T18:31:11.396 INFO:tasks.workunit.client.0.smithi033.stdout:6/921: dread d8/d28/d14/f43 [0,4194304] 0 2024-02-15T18:31:11.397 INFO:tasks.workunit.client.0.smithi033.stdout:6/922: chown d8/d28/d14/d2c/d31/d30/d29/d38/dae/lee 1031744731 1 2024-02-15T18:31:11.397 INFO:tasks.workunit.client.0.smithi033.stdout:6/923: write d8/d1d/d37/d4f/dbb/d55/f101 [40794,103248] 0 2024-02-15T18:31:11.397 INFO:tasks.workunit.client.0.smithi033.stdout:6/924: chown d8/d28/d14/d2c/d31/d30/d29/d67/fb1 768 1 2024-02-15T18:31:11.397 INFO:tasks.workunit.client.0.smithi033.stdout:6/925: readlink d8/d1d/d37/d4f/dcb/lc9 0 2024-02-15T18:31:11.398 INFO:tasks.workunit.client.0.smithi033.stdout:6/926: mknod d8/d70/c123 0 2024-02-15T18:31:11.398 INFO:tasks.workunit.client.0.smithi033.stdout:8/847: dwrite d0/df/d48/dbf/fc4 [0,4194304] 0 2024-02-15T18:31:11.400 INFO:tasks.workunit.client.0.smithi033.stdout:2/876: dread d20/d3a/f5d [0,4194304] 0 2024-02-15T18:31:11.401 INFO:tasks.workunit.client.0.smithi033.stdout:6/927: creat d8/d28/d14/d2c/d3b/f124 x:0 0 0 2024-02-15T18:31:11.410 INFO:tasks.workunit.client.0.smithi033.stdout:8/848: symlink d0/df/db/l110 0 2024-02-15T18:31:11.410 INFO:tasks.workunit.client.0.smithi033.stdout:2/877: truncate d20/d31/d6a/f9c 111977 0 2024-02-15T18:31:11.414 INFO:tasks.workunit.client.0.smithi033.stdout:8/849: creat d0/df/db/d45/f111 x:0 0 0 2024-02-15T18:31:11.426 INFO:tasks.workunit.client.0.smithi033.stdout:6/928: dwrite d8/d28/f11 [0,4194304] 0 2024-02-15T18:31:11.429 INFO:tasks.workunit.client.0.smithi033.stdout:6/929: link d8/d28/d36/fd4 d8/d28/d14/d2c/d31/d30/d29/f125 0 2024-02-15T18:31:11.430 INFO:tasks.workunit.client.0.smithi033.stdout:6/930: chown d8/d1d/d37/d72/cb5 4620873 1 2024-02-15T18:31:11.430 INFO:tasks.workunit.client.0.smithi033.stdout:6/931: write d8/d1d/d37/d4f/dcb/f105 [695431,11853] 0 2024-02-15T18:31:11.430 INFO:tasks.workunit.client.0.smithi033.stdout:8/850: dread d0/df/d53/db3/d30/d8e/d35/d58/da1/fa2 [4194304,4194304] 0 2024-02-15T18:31:11.431 INFO:tasks.workunit.client.0.smithi033.stdout:8/851: mkdir d0/df/d53/db3/d30/d8e/d14/d56/db0/d112 0 2024-02-15T18:31:11.434 INFO:tasks.workunit.client.0.smithi033.stdout:6/932: write d8/d28/f35 [3971935,22282] 0 2024-02-15T18:31:11.436 INFO:tasks.workunit.client.0.smithi033.stdout:2/878: dwrite d20/d31/d6a/f119 [0,4194304] 0 2024-02-15T18:31:11.440 INFO:tasks.workunit.client.0.smithi033.stdout:6/933: truncate d8/d1d/d37/d4f/dbb/d57/ff4 1040546 0 2024-02-15T18:31:11.440 INFO:tasks.workunit.client.0.smithi033.stdout:6/934: dread - d8/d28/d14/d2c/d31/d30/d29/fc8 zero size 2024-02-15T18:31:11.445 INFO:tasks.workunit.client.0.smithi033.stdout:2/879: link d20/d3a/f75 d20/d3a/d4a/d5e/d6b/d88/f131 0 2024-02-15T18:31:11.446 INFO:tasks.workunit.client.0.smithi033.stdout:6/935: rmdir d8/d1d 39 2024-02-15T18:31:11.446 INFO:tasks.workunit.client.0.smithi033.stdout:2/880: chown d20/d31/d47/cc6 815314 1 2024-02-15T18:31:11.447 INFO:tasks.workunit.client.0.smithi033.stdout:2/881: rmdir d20/d31/d47/da4 39 2024-02-15T18:31:11.447 INFO:tasks.workunit.client.0.smithi033.stdout:2/882: write d20/d31/d47/d4c/def/d80/da0/fe8 [1319127,39505] 0 2024-02-15T18:31:11.450 INFO:tasks.workunit.client.0.smithi033.stdout:2/883: creat d20/d31/d47/d4c/def/f132 x:0 0 0 2024-02-15T18:31:11.458 INFO:tasks.workunit.client.0.smithi033.stdout:1/928: sync 2024-02-15T18:31:11.460 INFO:tasks.workunit.client.0.smithi033.stdout:8/852: dwrite d0/df/db/fde [0,4194304] 0 2024-02-15T18:31:11.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/929: write d5/dd/d12/d49/d23/fe2 [1158952,92012] 0 2024-02-15T18:31:11.462 INFO:tasks.workunit.client.0.smithi033.stdout:1/930: chown d5/dd/fcd 24874894 1 2024-02-15T18:31:11.464 INFO:tasks.workunit.client.0.smithi033.stdout:8/853: mknod d0/df/d53/db3/d30/d8e/d35/c113 0 2024-02-15T18:31:11.465 INFO:tasks.workunit.client.0.smithi033.stdout:8/854: rmdir d0/df/d48/dbf 39 2024-02-15T18:31:11.467 INFO:tasks.workunit.client.0.smithi033.stdout:8/855: creat d0/df/d53/db3/d30/d8e/d35/d29/d5f/f114 x:0 0 0 2024-02-15T18:31:11.471 INFO:tasks.workunit.client.0.smithi033.stdout:8/856: dread d0/df/d53/db3/d30/d8e/d35/d58/da1/fb9 [0,4194304] 0 2024-02-15T18:31:11.471 INFO:tasks.workunit.client.0.smithi033.stdout:8/857: chown d0/df/d53/d9b/fa4 53531104 1 2024-02-15T18:31:11.473 INFO:tasks.workunit.client.0.smithi033.stdout:6/936: dwrite d8/d28/d14/d2c/f4b [0,4194304] 0 2024-02-15T18:31:11.473 INFO:tasks.workunit.client.0.smithi033.stdout:6/937: stat d8/d1d/d37/d4f/dbb/d57/fdf 0 2024-02-15T18:31:11.476 INFO:tasks.workunit.client.0.smithi033.stdout:2/884: dwrite d20/d3a/d4a/d5e/f66 [4194304,4194304] 0 2024-02-15T18:31:11.476 INFO:tasks.workunit.client.0.smithi033.stdout:2/885: chown d20/d31/d47/d82/de6 506 1 2024-02-15T18:31:11.477 INFO:tasks.workunit.client.0.smithi033.stdout:8/858: dread d0/df/d53/db3/d30/d8e/d35/d29/f2e [0,4194304] 0 2024-02-15T18:31:11.478 INFO:tasks.workunit.client.0.smithi033.stdout:2/886: rmdir d20/d31/dc8 39 2024-02-15T18:31:11.479 INFO:tasks.workunit.client.0.smithi033.stdout:2/887: write d20/d31/dc8/fe3 [13276919,23571] 0 2024-02-15T18:31:11.479 INFO:tasks.workunit.client.0.smithi033.stdout:2/888: dread - d20/d3a/d4a/d5e/d6b/d88/da6/fb2 zero size 2024-02-15T18:31:11.482 INFO:tasks.workunit.client.0.smithi033.stdout:8/859: truncate d0/df/d53/db3/d30/d8e/d14/f32 70549 0 2024-02-15T18:31:11.486 INFO:tasks.workunit.client.0.smithi033.stdout:8/860: symlink d0/df/db/d45/dc6/df7/l115 0 2024-02-15T18:31:11.487 INFO:tasks.workunit.client.0.smithi033.stdout:8/861: fsync d0/df/d53/db3/d30/d8e/f41 0 2024-02-15T18:31:11.488 INFO:tasks.workunit.client.0.smithi033.stdout:8/862: rename d0/df/d53/db3/d30/d8e/d35/cab to d0/df/d53/db3/d30/d8e/d14/d56/d59/df2/c116 0 2024-02-15T18:31:11.491 INFO:tasks.workunit.client.0.smithi033.stdout:2/889: dread d20/d31/d6a/f81 [0,4194304] 0 2024-02-15T18:31:11.499 INFO:tasks.workunit.client.0.smithi033.stdout:6/938: dwrite d8/d1d/d37/dbf/f117 [0,4194304] 0 2024-02-15T18:31:11.500 INFO:tasks.workunit.client.0.smithi033.stdout:6/939: write d8/d28/d14/d2c/d31/d30/de1/df5/f11b [10328,42768] 0 2024-02-15T18:31:11.500 INFO:tasks.workunit.client.0.smithi033.stdout:6/940: chown d8/d70 635 1 2024-02-15T18:31:11.501 INFO:tasks.workunit.client.0.smithi033.stdout:1/931: dwrite d5/d9/d1e/d20/d2c/d34/d51/f10b [0,4194304] 0 2024-02-15T18:31:11.501 INFO:tasks.workunit.client.0.smithi033.stdout:1/932: fsync d5/d9/d1e/d20/d5c/d57/d82/fba 0 2024-02-15T18:31:11.503 INFO:tasks.workunit.client.0.smithi033.stdout:8/863: dread d0/df/d48/dbf/fc4 [0,4194304] 0 2024-02-15T18:31:11.506 INFO:tasks.workunit.client.0.smithi033.stdout:1/933: mkdir d5/d17/d12a 0 2024-02-15T18:31:11.508 INFO:tasks.workunit.client.0.smithi033.stdout:1/934: unlink d5/d9/d1e/d20/d5c/d57/lf5 0 2024-02-15T18:31:11.511 INFO:tasks.workunit.client.0.smithi033.stdout:1/935: rename d5/d9/d1e/d20/d5c/d57/d82/d128 to d5/d9/d1e/d20/d5c/d57/d82/d12b 0 2024-02-15T18:31:11.513 INFO:tasks.workunit.client.0.smithi033.stdout:8/864: dread d0/df/db/d45/fef [0,4194304] 0 2024-02-15T18:31:11.513 INFO:tasks.workunit.client.0.smithi033.stdout:8/865: write d0/df/db/d45/f8a [613583,36008] 0 2024-02-15T18:31:11.514 INFO:tasks.workunit.client.0.smithi033.stdout:1/936: creat d5/d96/dc9/f12c x:0 0 0 2024-02-15T18:31:11.514 INFO:tasks.workunit.client.0.smithi033.stdout:1/937: fsync d5/dd/f2e 0 2024-02-15T18:31:11.516 INFO:tasks.workunit.client.0.smithi033.stdout:8/866: link d0/df/d48/ffc d0/df/d53/db3/d30/f117 0 2024-02-15T18:31:11.517 INFO:tasks.workunit.client.0.smithi033.stdout:1/938: creat d5/d17/d105/f12d x:0 0 0 2024-02-15T18:31:11.518 INFO:tasks.workunit.client.0.smithi033.stdout:8/867: truncate d0/df/db/fd5 3649426 0 2024-02-15T18:31:11.523 INFO:tasks.workunit.client.0.smithi033.stdout:1/939: dread d5/d9/d1e/d20/d5c/d57/d82/fb1 [0,4194304] 0 2024-02-15T18:31:11.523 INFO:tasks.workunit.client.0.smithi033.stdout:1/940: fdatasync d5/dd/d12/dc6/dd4/ffa 0 2024-02-15T18:31:11.523 INFO:tasks.workunit.client.0.smithi033.stdout:1/941: chown d5/dd/d12/f1b 1344421965 1 2024-02-15T18:31:11.528 INFO:tasks.workunit.client.0.smithi033.stdout:6/941: dwrite d8/d1d/d37/d4f/dbb/d57/fdf [4194304,4194304] 0 2024-02-15T18:31:11.530 INFO:tasks.workunit.client.0.smithi033.stdout:1/942: unlink d5/d9/d1e/d20/d5c/dca/cd5 0 2024-02-15T18:31:11.535 INFO:tasks.workunit.client.0.smithi033.stdout:6/942: rename d8/d1d to d8/d28/d14/d2c/de7/dfe/d126 0 2024-02-15T18:31:11.535 INFO:tasks.workunit.client.0.smithi033.stdout:6/943: chown d8/d28/d14/de8 55405464 1 2024-02-15T18:31:11.535 INFO:tasks.workunit.client.0.smithi033.stdout:6/944: chown d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/d57/fdf 2061061353 1 2024-02-15T18:31:11.538 INFO:tasks.workunit.client.0.smithi033.stdout:8/868: dwrite d0/df/d53/db3/d30/d8e/d35/f64 [0,4194304] 0 2024-02-15T18:31:11.538 INFO:tasks.workunit.client.0.smithi033.stdout:8/869: truncate d0/df/df0/f108 36296 0 2024-02-15T18:31:11.538 INFO:tasks.workunit.client.0.smithi033.stdout:1/943: rename d5/f85 to d5/d9/d1e/df4/f12e 0 2024-02-15T18:31:11.539 INFO:tasks.workunit.client.0.smithi033.stdout:6/945: write d8/d28/d14/d2c/d31/f27 [2471712,117154] 0 2024-02-15T18:31:11.543 INFO:tasks.workunit.client.0.smithi033.stdout:1/944: creat d5/d9/f12f x:0 0 0 2024-02-15T18:31:11.543 INFO:tasks.workunit.client.0.smithi033.stdout:1/945: chown d5/d9/d1e/d20/d2c/d34/d51/f5b 5615 1 2024-02-15T18:31:11.555 INFO:tasks.workunit.client.0.smithi033.stdout:7/900: sync 2024-02-15T18:31:11.555 INFO:tasks.workunit.client.0.smithi033.stdout:4/942: sync 2024-02-15T18:31:11.558 INFO:tasks.workunit.client.0.smithi033.stdout:7/901: rmdir d0/dc/d10/d1d/d2b/d5f 39 2024-02-15T18:31:11.558 INFO:tasks.workunit.client.0.smithi033.stdout:7/902: dread - d0/dc/d10/d48/d4b/fdb zero size 2024-02-15T18:31:11.561 INFO:tasks.workunit.client.0.smithi033.stdout:7/903: creat d0/dc/d10/d1d/d38/d74/f138 x:0 0 0 2024-02-15T18:31:11.561 INFO:tasks.workunit.client.0.smithi033.stdout:7/904: write d0/dc/d10/d1d/d2b/f61 [1757672,60611] 0 2024-02-15T18:31:11.562 INFO:tasks.workunit.client.0.smithi033.stdout:7/905: write d0/dc/d10/d1d/f60 [95027,102472] 0 2024-02-15T18:31:11.562 INFO:tasks.workunit.client.0.smithi033.stdout:7/906: truncate d0/dc/d10/d48/d4b/fa9 957829 0 2024-02-15T18:31:11.563 INFO:tasks.workunit.client.0.smithi033.stdout:7/907: creat d0/dc/d10/d1d/d2b/f139 x:0 0 0 2024-02-15T18:31:11.564 INFO:tasks.workunit.client.0.smithi033.stdout:7/908: readlink d0/dc/d10/d1d/d2b/l2e 0 2024-02-15T18:31:11.573 INFO:tasks.workunit.client.0.smithi033.stdout:8/870: dwrite d0/df/d53/db3/d30/d8e/fb2 [0,4194304] 0 2024-02-15T18:31:11.575 INFO:tasks.workunit.client.0.smithi033.stdout:6/946: dwrite d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/d55/d63/f7a [4194304,4194304] 0 2024-02-15T18:31:11.577 INFO:tasks.workunit.client.0.smithi033.stdout:6/947: creat d8/d28/d14/d2c/d31/d30/d29/f127 x:0 0 0 2024-02-15T18:31:11.577 INFO:tasks.workunit.client.0.smithi033.stdout:6/948: truncate d8/d28/d36/fe2 928780 0 2024-02-15T18:31:11.578 INFO:tasks.workunit.client.0.smithi033.stdout:6/949: truncate d8/d28/d14/d2c/d3b/fb8 1923124 0 2024-02-15T18:31:11.580 INFO:tasks.workunit.client.0.smithi033.stdout:1/946: dwrite d5/d9/d1e/d20/d2c/d34/d51/ddb/fde [0,4194304] 0 2024-02-15T18:31:11.583 INFO:tasks.workunit.client.0.smithi033.stdout:6/950: dread d8/d28/f11 [4194304,4194304] 0 2024-02-15T18:31:11.583 INFO:tasks.workunit.client.0.smithi033.stdout:1/947: rename d5/dd/d12/dc6/dd4/fe0 to d5/d9/f130 0 2024-02-15T18:31:11.584 INFO:tasks.workunit.client.0.smithi033.stdout:1/948: fsync d5/d9/d1e/d20/d5c/d8d/f113 0 2024-02-15T18:31:11.584 INFO:tasks.workunit.client.0.smithi033.stdout:1/949: chown d5/f106 303437844 1 2024-02-15T18:31:11.587 INFO:tasks.workunit.client.0.smithi033.stdout:8/871: dread d0/df/db/fde [0,4194304] 0 2024-02-15T18:31:11.587 INFO:tasks.workunit.client.0.smithi033.stdout:8/872: truncate d0/df/db/d45/dc6/ff6 767193 0 2024-02-15T18:31:11.588 INFO:tasks.workunit.client.0.smithi033.stdout:6/951: rename d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/d55/d63/fc4 to d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/d55/f128 0 2024-02-15T18:31:11.589 INFO:tasks.workunit.client.0.smithi033.stdout:6/952: write d8/d28/d14/d2c/de7/dfe/d126/d37/dbf/f117 [103846,17663] 0 2024-02-15T18:31:11.590 INFO:tasks.workunit.client.0.smithi033.stdout:6/953: write d8/d28/d14/d2c/de7/dfe/d126/d37/f10b [409034,21580] 0 2024-02-15T18:31:11.590 INFO:tasks.workunit.client.0.smithi033.stdout:6/954: stat d8/f5b 0 2024-02-15T18:31:11.590 INFO:tasks.workunit.client.0.smithi033.stdout:6/955: dread - d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/d55/f104 zero size 2024-02-15T18:31:11.590 INFO:tasks.workunit.client.0.smithi033.stdout:6/956: write d8/d28/d14/d2c/d31/d30/d29/f59 [404944,4217] 0 2024-02-15T18:31:11.590 INFO:tasks.workunit.client.0.smithi033.stdout:1/950: mknod d5/d9/d1e/df4/c131 0 2024-02-15T18:31:11.590 INFO:tasks.workunit.client.0.smithi033.stdout:6/957: dread - d8/d70/f10e zero size 2024-02-15T18:31:11.590 INFO:tasks.workunit.client.0.smithi033.stdout:1/951: fsync d5/dd/f10 0 2024-02-15T18:31:11.590 INFO:tasks.workunit.client.0.smithi033.stdout:6/958: readlink d8/d28/d14/d2c/de7/dfe/d126/d37/d72/lab 0 2024-02-15T18:31:11.590 INFO:tasks.workunit.client.0.smithi033.stdout:8/873: read d0/df/df0/f108 [23989,23686] 0 2024-02-15T18:31:11.591 INFO:tasks.workunit.client.0.smithi033.stdout:6/959: stat d8/d28/d14/d2c/d31/ded/c10f 0 2024-02-15T18:31:11.592 INFO:tasks.workunit.client.0.smithi033.stdout:8/874: mknod d0/df/d53/db3/d30/d8e/da7/df8/c118 0 2024-02-15T18:31:11.593 INFO:tasks.workunit.client.0.smithi033.stdout:6/960: mknod d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dcb/c129 0 2024-02-15T18:31:11.593 INFO:tasks.workunit.client.0.smithi033.stdout:6/961: truncate d8/d28/d14/d2c/d31/d30/d29/f125 847538 0 2024-02-15T18:31:11.594 INFO:tasks.workunit.client.0.smithi033.stdout:8/875: rename d0/df/d53/db3/d30/d8e/d8f/d4b/d72/c89 to d0/df/d53/db3/d30/d8e/da7/db7/c119 0 2024-02-15T18:31:11.595 INFO:tasks.workunit.client.0.smithi033.stdout:6/962: truncate d8/d28/d36/f91 7436618 0 2024-02-15T18:31:11.595 INFO:tasks.workunit.client.0.smithi033.stdout:1/952: dread d5/d9/d1e/d20/d5c/d57/f101 [0,4194304] 0 2024-02-15T18:31:11.596 INFO:tasks.workunit.client.0.smithi033.stdout:6/963: fsync d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/d55/f128 0 2024-02-15T18:31:11.599 INFO:tasks.workunit.client.0.smithi033.stdout:1/953: creat d5/d9/d1e/d20/d2c/d65/f132 x:0 0 0 2024-02-15T18:31:11.600 INFO:tasks.workunit.client.0.smithi033.stdout:6/964: symlink d8/d28/d14/de8/l12a 0 2024-02-15T18:31:11.601 INFO:tasks.workunit.client.0.smithi033.stdout:8/876: unlink d0/df/d53/db3/d30/d8e/d14/fda 0 2024-02-15T18:31:11.603 INFO:tasks.workunit.client.0.smithi033.stdout:1/954: mkdir d5/d9/d1e/d20/d2c/d34/d51/ddb/d133 0 2024-02-15T18:31:11.604 INFO:tasks.workunit.client.0.smithi033.stdout:6/965: creat d8/d28/d14/d2c/dd7/f12b x:0 0 0 2024-02-15T18:31:11.605 INFO:tasks.workunit.client.0.smithi033.stdout:6/966: write d8/d28/f11 [3742394,33520] 0 2024-02-15T18:31:11.605 INFO:tasks.workunit.client.0.smithi033.stdout:6/967: readlink d8/d28/d14/de8/lf2 0 2024-02-15T18:31:11.606 INFO:tasks.workunit.client.0.smithi033.stdout:8/877: mknod d0/df/d53/db3/d30/d8e/d35/d58/c11a 0 2024-02-15T18:31:11.607 INFO:tasks.workunit.client.0.smithi033.stdout:1/955: mkdir d5/dd/d12/d49/d134 0 2024-02-15T18:31:11.610 INFO:tasks.workunit.client.0.smithi033.stdout:8/878: rename d0/df/db/fd5 to d0/df/d53/db3/d95/f11b 0 2024-02-15T18:31:11.610 INFO:tasks.workunit.client.0.smithi033.stdout:8/879: write d0/df/d53/db3/d30/f117 [494691,74337] 0 2024-02-15T18:31:11.610 INFO:tasks.workunit.client.0.smithi033.stdout:6/968: dread d8/d70/fc2 [0,4194304] 0 2024-02-15T18:31:11.611 INFO:tasks.workunit.client.0.smithi033.stdout:1/956: mknod d5/d9/c135 0 2024-02-15T18:31:11.616 INFO:tasks.workunit.client.0.smithi033.stdout:6/969: creat d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/d55/d60/f12c x:0 0 0 2024-02-15T18:31:11.619 INFO:tasks.workunit.client.0.smithi033.stdout:6/970: link d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/c3a d8/d70/c12d 0 2024-02-15T18:31:11.620 INFO:tasks.workunit.client.0.smithi033.stdout:1/957: dread d5/dd/d12/d49/f4a [0,4194304] 0 2024-02-15T18:31:11.622 INFO:tasks.workunit.client.0.smithi033.stdout:1/958: rename d5/cb7 to d5/d9/d1e/d20/d5c/d8d/c136 0 2024-02-15T18:31:11.622 INFO:tasks.workunit.client.0.smithi033.stdout:1/959: chown d5/dd/d12/f8f 19016705 1 2024-02-15T18:31:11.623 INFO:tasks.workunit.client.0.smithi033.stdout:1/960: symlink d5/dcb/l137 0 2024-02-15T18:31:11.623 INFO:tasks.workunit.client.0.smithi033.stdout:1/961: dread - d5/d9/d1e/d20/d5c/d8d/ff6 zero size 2024-02-15T18:31:11.623 INFO:tasks.workunit.client.0.smithi033.stdout:1/962: dread - d5/dd/d12/dc6/dd4/ffe zero size 2024-02-15T18:31:11.624 INFO:tasks.workunit.client.0.smithi033.stdout:8/880: dwrite d0/df/fc9 [0,4194304] 0 2024-02-15T18:31:11.626 INFO:tasks.workunit.client.0.smithi033.stdout:1/963: dread d5/d9/d1e/d20/d2c/d34/f40 [0,4194304] 0 2024-02-15T18:31:11.626 INFO:tasks.workunit.client.0.smithi033.stdout:1/964: write d5/d38/f99 [568543,65715] 0 2024-02-15T18:31:11.628 INFO:tasks.workunit.client.0.smithi033.stdout:1/965: dread d5/d17/f123 [0,4194304] 0 2024-02-15T18:31:11.628 INFO:tasks.workunit.client.0.smithi033.stdout:1/966: fsync d5/d9/d1e/d20/d2c/d34/d51/f5b 0 2024-02-15T18:31:11.628 INFO:tasks.workunit.client.0.smithi033.stdout:1/967: truncate d5/d9/d1e/d20/d2c/f9a 1358253 0 2024-02-15T18:31:11.628 INFO:tasks.workunit.client.0.smithi033.stdout:6/971: rmdir d8/d28/d14/d2c/de7/dfe 39 2024-02-15T18:31:11.630 INFO:tasks.workunit.client.0.smithi033.stdout:8/881: symlink d0/df/d53/db3/d30/d8e/d35/d58/l11c 0 2024-02-15T18:31:11.630 INFO:tasks.workunit.client.0.smithi033.stdout:8/882: chown d0/df/dd3/fe5 3 1 2024-02-15T18:31:11.632 INFO:tasks.workunit.client.0.smithi033.stdout:6/972: mknod d8/d28/d14/d2c/dd7/c12e 0 2024-02-15T18:31:11.634 INFO:tasks.workunit.client.0.smithi033.stdout:8/883: rename d0/df/d53/db3/d30/d8e/la6 to d0/df/d53/db3/d30/d8e/d35/d29/l11d 0 2024-02-15T18:31:11.634 INFO:tasks.workunit.client.0.smithi033.stdout:8/884: fdatasync d0/df/d53/db3/d30/d8e/d35/d58/da1/fb9 0 2024-02-15T18:31:11.635 INFO:tasks.workunit.client.0.smithi033.stdout:6/973: mknod d8/d28/d14/d2c/de7/dfe/d126/d37/c12f 0 2024-02-15T18:31:11.635 INFO:tasks.workunit.client.0.smithi033.stdout:6/974: chown d8/d70/fea 17552193 1 2024-02-15T18:31:11.636 INFO:tasks.workunit.client.0.smithi033.stdout:6/975: chown d8/d28/d14/d2c/d3b/c78 456463861 1 2024-02-15T18:31:11.636 INFO:tasks.workunit.client.0.smithi033.stdout:6/976: chown d8/d28/d14/d2c/de7/dfe/d126/d37/d72/lab 757055 1 2024-02-15T18:31:11.636 INFO:tasks.workunit.client.0.smithi033.stdout:6/977: fsync d8/d28/d14/d2c/d31/d30/d29/d67/ff8 0 2024-02-15T18:31:11.636 INFO:tasks.workunit.client.0.smithi033.stdout:6/978: write d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/d57/f5a [2026316,74978] 0 2024-02-15T18:31:11.636 INFO:tasks.workunit.client.0.smithi033.stdout:8/885: mknod d0/df/d53/db3/d30/c11e 0 2024-02-15T18:31:11.637 INFO:tasks.workunit.client.0.smithi033.stdout:6/979: creat d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/f130 x:0 0 0 2024-02-15T18:31:11.638 INFO:tasks.workunit.client.0.smithi033.stdout:8/886: truncate d0/df/d53/db3/d30/d8e/f5 516789 0 2024-02-15T18:31:11.639 INFO:tasks.workunit.client.0.smithi033.stdout:6/980: creat d8/d28/d14/d2c/d3b/dff/f131 x:0 0 0 2024-02-15T18:31:11.639 INFO:tasks.workunit.client.0.smithi033.stdout:8/887: mkdir d0/df/d53/d11f 0 2024-02-15T18:31:11.641 INFO:tasks.workunit.client.0.smithi033.stdout:6/981: rename d8/d28/d14/d2c/d31/d5d/d8c/c8f to d8/c132 0 2024-02-15T18:31:11.641 INFO:tasks.workunit.client.0.smithi033.stdout:8/888: truncate d0/df/f38 269711 0 2024-02-15T18:31:11.643 INFO:tasks.workunit.client.0.smithi033.stdout:1/968: dwrite d5/d9/d1e/d20/d5c/d57/f101 [4194304,4194304] 0 2024-02-15T18:31:11.643 INFO:tasks.workunit.client.0.smithi033.stdout:1/969: fdatasync d5/d9/d1e/d20/d5c/d57/d82/fb1 0 2024-02-15T18:31:11.643 INFO:tasks.workunit.client.0.smithi033.stdout:1/970: read - d5/dd/d12/d49/d23/f72 zero size 2024-02-15T18:31:11.644 INFO:tasks.workunit.client.0.smithi033.stdout:6/982: link d8/d28/d14/d2c/f4b d8/d28/d14/d2c/d31/d5d/df3/f133 0 2024-02-15T18:31:11.644 INFO:tasks.workunit.client.0.smithi033.stdout:6/983: chown d8/d70/c123 162 1 2024-02-15T18:31:11.644 INFO:tasks.workunit.client.0.smithi033.stdout:8/889: mknod d0/df/db/d45/dc6/df7/c120 0 2024-02-15T18:31:11.656 INFO:tasks.workunit.client.0.smithi033.stdout:1/971: dread d5/d9/d1e/df4/f12e [0,4194304] 0 2024-02-15T18:31:11.660 INFO:tasks.workunit.client.0.smithi033.stdout:8/890: creat d0/df/d53/db3/d30/d8e/da7/f121 x:0 0 0 2024-02-15T18:31:11.663 INFO:tasks.workunit.client.0.smithi033.stdout:8/891: unlink d0/df/d53/db3/d30/d8e/d35/d29/l11d 0 2024-02-15T18:31:11.663 INFO:tasks.workunit.client.0.smithi033.stdout:8/892: fdatasync d0/df/fc5 0 2024-02-15T18:31:11.663 INFO:tasks.workunit.client.0.smithi033.stdout:8/893: chown d0/df/db/d45/l7e 24667248 1 2024-02-15T18:31:11.664 INFO:tasks.workunit.client.0.smithi033.stdout:8/894: fdatasync d0/df/d53/db3/d30/d8e/d8f/d4b/d72/fc3 0 2024-02-15T18:31:11.664 INFO:tasks.workunit.client.0.smithi033.stdout:8/895: fdatasync d0/df/d53/db3/d30/d8e/d35/d29/d5f/f114 0 2024-02-15T18:31:11.664 INFO:tasks.workunit.client.0.smithi033.stdout:1/972: mknod d5/dd/c138 0 2024-02-15T18:31:11.664 INFO:tasks.workunit.client.0.smithi033.stdout:8/896: mknod d0/df/d53/db3/d30/d8e/de0/c122 0 2024-02-15T18:31:11.665 INFO:tasks.workunit.client.0.smithi033.stdout:8/897: chown d0/df/d48/lec 7961 1 2024-02-15T18:31:11.665 INFO:tasks.workunit.client.0.smithi033.stdout:8/898: write d0/df/d53/db3/d30/d8e/d14/d56/ff4 [2409953,98687] 0 2024-02-15T18:31:11.665 INFO:tasks.workunit.client.0.smithi033.stdout:8/899: fsync d0/df/d53/db3/d30/d8e/d14/d56/db0/fbd 0 2024-02-15T18:31:11.665 INFO:tasks.workunit.client.0.smithi033.stdout:8/900: readlink d0/df/d53/db3/d30/d8e/d8f/d4b/d72/lb5 0 2024-02-15T18:31:11.665 INFO:tasks.workunit.client.0.smithi033.stdout:1/973: mknod d5/d9/d1e/d20/d5c/c139 0 2024-02-15T18:31:11.665 INFO:tasks.workunit.client.0.smithi033.stdout:8/901: creat d0/df/db/d45/dc6/df7/f123 x:0 0 0 2024-02-15T18:31:11.666 INFO:tasks.workunit.client.0.smithi033.stdout:8/902: write d0/df/db/d45/dc6/df7/f10d [17121,75689] 0 2024-02-15T18:31:11.666 INFO:tasks.workunit.client.0.smithi033.stdout:1/974: mkdir d5/dd/d129/d13a 0 2024-02-15T18:31:11.669 INFO:tasks.workunit.client.0.smithi033.stdout:6/984: dwrite d8/d28/d14/d2c/d3b/f124 [0,4194304] 0 2024-02-15T18:31:11.673 INFO:tasks.workunit.client.0.smithi033.stdout:8/903: dread d0/fe [0,4194304] 0 2024-02-15T18:31:11.673 INFO:tasks.workunit.client.0.smithi033.stdout:8/904: fsync d0/df/d53/db3/d30/d8e/d14/d56/d59/fdd 0 2024-02-15T18:31:11.673 INFO:tasks.workunit.client.0.smithi033.stdout:6/985: getdents d8/d28/d14/d2c/de7/dfe/d126/d37/dbf/dd0 0 2024-02-15T18:31:11.676 INFO:tasks.workunit.client.0.smithi033.stdout:6/986: rename d8/d70/f10e to d8/d28/d14/d2c/d31/ded/d5e/da5/de0/f134 0 2024-02-15T18:31:11.677 INFO:tasks.workunit.client.0.smithi033.stdout:0/775: sync 2024-02-15T18:31:11.678 INFO:tasks.workunit.client.0.smithi033.stdout:9/771: sync 2024-02-15T18:31:11.678 INFO:tasks.workunit.client.0.smithi033.stdout:0/776: write d0/d64/d1d/fff [787275,94499] 0 2024-02-15T18:31:11.680 INFO:tasks.workunit.client.0.smithi033.stdout:9/772: getdents d4/d8/dd/d5c 0 2024-02-15T18:31:11.680 INFO:tasks.workunit.client.0.smithi033.stdout:9/773: readlink d4/d8/l25 0 2024-02-15T18:31:11.680 INFO:tasks.workunit.client.0.smithi033.stdout:9/774: chown d4/d8/d1b/l2a 7201125 1 2024-02-15T18:31:11.681 INFO:tasks.workunit.client.0.smithi033.stdout:0/777: chown d0/d8/c9 7632911 1 2024-02-15T18:31:11.681 INFO:tasks.workunit.client.0.smithi033.stdout:0/778: chown d0/d8/l1b 89 1 2024-02-15T18:31:11.681 INFO:tasks.workunit.client.0.smithi033.stdout:0/779: write d0/d8/d15/d5b/fd8 [505666,4929] 0 2024-02-15T18:31:11.682 INFO:tasks.workunit.client.0.smithi033.stdout:9/775: read d4/d8/dd/d41/f4e [2530984,72888] 0 2024-02-15T18:31:11.682 INFO:tasks.workunit.client.0.smithi033.stdout:0/780: mknod d0/d8/d15/d8b/da3/dae/d59/c109 0 2024-02-15T18:31:11.682 INFO:tasks.workunit.client.0.smithi033.stdout:0/781: write d0/d8/d15/d5b/d94/fc0 [859628,6815] 0 2024-02-15T18:31:11.684 INFO:tasks.workunit.client.0.smithi033.stdout:9/776: mkdir d4/d8/dd/df9/d108 0 2024-02-15T18:31:11.684 INFO:tasks.workunit.client.0.smithi033.stdout:1/975: dwrite d5/dd/d12/d49/d23/f72 [0,4194304] 0 2024-02-15T18:31:11.687 INFO:tasks.workunit.client.0.smithi033.stdout:0/782: rename d0/d8/d15/d5b/d94 to d0/d8/d15/d2d/d41/d79/d10a 0 2024-02-15T18:31:11.687 INFO:tasks.workunit.client.0.smithi033.stdout:0/783: stat d0/d64/d1d/f1e 0 2024-02-15T18:31:11.687 INFO:tasks.workunit.client.0.smithi033.stdout:9/777: read d4/d8/f20 [1833233,23209] 0 2024-02-15T18:31:11.689 INFO:tasks.workunit.client.0.smithi033.stdout:0/784: symlink d0/de8/d97/l10b 0 2024-02-15T18:31:11.689 INFO:tasks.workunit.client.0.smithi033.stdout:0/785: write d0/d8/d54/f90 [4170255,765] 0 2024-02-15T18:31:11.690 INFO:tasks.workunit.client.0.smithi033.stdout:0/786: dread - d0/de8/d97/db1/fe4 zero size 2024-02-15T18:31:11.690 INFO:tasks.workunit.client.0.smithi033.stdout:9/778: mknod d4/d8/d1b/d2f/d65/c109 0 2024-02-15T18:31:11.690 INFO:tasks.workunit.client.0.smithi033.stdout:9/779: dread - d4/d8/d1b/d61/dc7/ff0 zero size 2024-02-15T18:31:11.691 INFO:tasks.workunit.client.0.smithi033.stdout:0/787: symlink d0/d64/d1d/dd3/d100/l10c 0 2024-02-15T18:31:11.691 INFO:tasks.workunit.client.0.smithi033.stdout:0/788: dread - d0/d8/d15/d8b/da3/dae/d58/d80/dc1/fc3 zero size 2024-02-15T18:31:11.692 INFO:tasks.workunit.client.0.smithi033.stdout:9/780: rename d4/d8/dd/l96 to d4/d2c/l10a 0 2024-02-15T18:31:11.694 INFO:tasks.workunit.client.0.smithi033.stdout:8/905: dwrite d0/df/d53/db3/d30/d8e/d8f/d4b/f7d [4194304,4194304] 0 2024-02-15T18:31:11.700 INFO:tasks.workunit.client.0.smithi033.stdout:1/976: dwrite d5/d9/d1e/f111 [0,4194304] 0 2024-02-15T18:31:11.702 INFO:tasks.workunit.client.0.smithi033.stdout:9/781: symlink d4/df2/l10b 0 2024-02-15T18:31:11.707 INFO:tasks.workunit.client.0.smithi033.stdout:1/977: write d5/d9/d1e/d20/d2c/d34/d51/ddb/fde [762844,103991] 0 2024-02-15T18:31:11.707 INFO:tasks.workunit.client.0.smithi033.stdout:1/978: dread - d5/d9/d1e/d20/d5c/d8d/ff6 zero size 2024-02-15T18:31:11.708 INFO:tasks.workunit.client.0.smithi033.stdout:1/979: truncate d5/d9/d1e/d20/d5c/d57/d82/fb5 143705 0 2024-02-15T18:31:11.711 INFO:tasks.workunit.client.0.smithi033.stdout:8/906: mkdir d0/df/db/d124 0 2024-02-15T18:31:11.712 INFO:tasks.workunit.client.0.smithi033.stdout:1/980: creat d5/d9/d1e/d20/d2c/d34/d51/d63/f13b x:0 0 0 2024-02-15T18:31:11.713 INFO:tasks.workunit.client.0.smithi033.stdout:8/907: symlink d0/df/d53/d11f/l125 0 2024-02-15T18:31:11.714 INFO:tasks.workunit.client.0.smithi033.stdout:1/981: creat d5/d9/d1e/d20/d5c/d8d/f13c x:0 0 0 2024-02-15T18:31:11.714 INFO:tasks.workunit.client.0.smithi033.stdout:1/982: write d5/dcb/fe5 [1678132,103048] 0 2024-02-15T18:31:11.714 INFO:tasks.workunit.client.0.smithi033.stdout:8/908: creat d0/df/d53/db3/d30/d8e/d35/d58/da1/f126 x:0 0 0 2024-02-15T18:31:11.715 INFO:tasks.workunit.client.0.smithi033.stdout:1/983: rmdir d5/dcb 39 2024-02-15T18:31:11.716 INFO:tasks.workunit.client.0.smithi033.stdout:8/909: mkdir d0/df/d53/db3/d30/d8e/d8f/d4b/d72/d127 0 2024-02-15T18:31:11.716 INFO:tasks.workunit.client.0.smithi033.stdout:8/910: truncate d0/df/d53/db3/d30/f117 600010 0 2024-02-15T18:31:11.717 INFO:tasks.workunit.client.0.smithi033.stdout:1/984: unlink d5/d9/d1e/d20/d2c/d34/d51/d63/f13b 0 2024-02-15T18:31:11.718 INFO:tasks.workunit.client.0.smithi033.stdout:8/911: getdents d0/df 0 2024-02-15T18:31:11.718 INFO:tasks.workunit.client.0.smithi033.stdout:8/912: dread - d0/df/d53/db3/d30/d8e/d35/d29/d5f/f114 zero size 2024-02-15T18:31:11.719 INFO:tasks.workunit.client.0.smithi033.stdout:1/985: rename d5/d96/dc9/cfc to d5/d17/d12a/c13d 0 2024-02-15T18:31:11.720 INFO:tasks.workunit.client.0.smithi033.stdout:1/986: creat d5/d9/d1e/d20/d2c/db2/f13e x:0 0 0 2024-02-15T18:31:11.723 INFO:tasks.workunit.client.0.smithi033.stdout:8/913: dread d0/df/d53/db3/d30/d8e/fb2 [0,4194304] 0 2024-02-15T18:31:11.723 INFO:tasks.workunit.client.0.smithi033.stdout:8/914: fdatasync d0/df/d53/db3/d30/d8e/d35/f64 0 2024-02-15T18:31:11.723 INFO:tasks.workunit.client.0.smithi033.stdout:0/789: dwrite d0/d8/d15/d5b/fd8 [0,4194304] 0 2024-02-15T18:31:11.723 INFO:tasks.workunit.client.0.smithi033.stdout:9/782: dwrite d4/d8/dd/d5c/d6d/f7b [0,4194304] 0 2024-02-15T18:31:11.732 INFO:tasks.workunit.client.0.smithi033.stdout:0/790: rmdir d0/d8/d15/d8b/da3/dae/d59 39 2024-02-15T18:31:11.735 INFO:tasks.workunit.client.0.smithi033.stdout:9/783: mknod d4/d8/d1b/d2f/df3/c10c 0 2024-02-15T18:31:11.737 INFO:tasks.workunit.client.0.smithi033.stdout:9/784: getdents d4/d8/dd/df9 0 2024-02-15T18:31:11.738 INFO:tasks.workunit.client.0.smithi033.stdout:9/785: symlink d4/d8/db6/l10d 0 2024-02-15T18:31:11.740 INFO:tasks.workunit.client.0.smithi033.stdout:9/786: link d4/d2c/fd9 d4/df2/f10e 0 2024-02-15T18:31:11.742 INFO:tasks.workunit.client.0.smithi033.stdout:8/915: dwrite d0/df/d53/db3/d30/d8e/d35/f4f [0,4194304] 0 2024-02-15T18:31:11.742 INFO:tasks.workunit.client.0.smithi033.stdout:9/787: creat d4/d8/dd/d5c/d6d/f10f x:0 0 0 2024-02-15T18:31:11.742 INFO:tasks.workunit.client.0.smithi033.stdout:9/788: write d4/d8/dd/d5c/f102 [64115,48697] 0 2024-02-15T18:31:11.743 INFO:tasks.workunit.client.0.smithi033.stdout:8/916: read d0/df/d53/db3/d30/d8e/d14/d56/d59/fd9 [3981651,130436] 0 2024-02-15T18:31:11.746 INFO:tasks.workunit.client.0.smithi033.stdout:8/917: creat d0/df/d53/db3/d30/d8e/d14/d56/db0/d112/f128 x:0 0 0 2024-02-15T18:31:11.746 INFO:tasks.workunit.client.0.smithi033.stdout:8/918: chown d0/df/db/c82 2966746 1 2024-02-15T18:31:11.746 INFO:tasks.workunit.client.0.smithi033.stdout:8/919: write d0/df/d53/db3/d30/d8e/d35/d29/d5f/fd1 [234968,89523] 0 2024-02-15T18:31:11.747 INFO:tasks.workunit.client.0.smithi033.stdout:8/920: dread d0/df/df0/f108 [0,4194304] 0 2024-02-15T18:31:11.748 INFO:tasks.workunit.client.0.smithi033.stdout:8/921: write d0/df/d53/db3/d95/fcc [1469004,72678] 0 2024-02-15T18:31:11.748 INFO:tasks.workunit.client.0.smithi033.stdout:8/922: readlink d0/df/d48/lec 0 2024-02-15T18:31:11.750 INFO:tasks.workunit.client.0.smithi033.stdout:8/923: mkdir d0/df/d53/db3/d30/d8e/d8f/d4b/d72/d129 0 2024-02-15T18:31:11.750 INFO:tasks.workunit.client.0.smithi033.stdout:8/924: chown d0/df/d53/db3/d30/d8e/de0 1015 1 2024-02-15T18:31:11.751 INFO:tasks.workunit.client.0.smithi033.stdout:8/925: mknod d0/df/d53/db3/d30/d8e/c12a 0 2024-02-15T18:31:11.754 INFO:tasks.workunit.client.0.smithi033.stdout:8/926: creat d0/df/d53/db3/d30/d8e/d8f/d4b/f12b x:0 0 0 2024-02-15T18:31:11.763 INFO:tasks.workunit.client.0.smithi033.stdout:0/791: dwrite d0/d2/f3 [0,4194304] 0 2024-02-15T18:31:11.765 INFO:tasks.workunit.client.0.smithi033.stdout:9/789: dwrite d4/f4f [0,4194304] 0 2024-02-15T18:31:11.765 INFO:tasks.workunit.client.0.smithi033.stdout:8/927: dread d0/df/d53/db3/d30/d8e/d35/d58/fee [8388608,4194304] 0 2024-02-15T18:31:11.766 INFO:tasks.workunit.client.0.smithi033.stdout:0/792: link d0/de8/d8d/dec/d9e/la2 d0/d8/d15/d8b/da3/dae/d58/de2/l10d 0 2024-02-15T18:31:11.766 INFO:tasks.workunit.client.0.smithi033.stdout:9/790: symlink d4/d8/db6/l110 0 2024-02-15T18:31:11.769 INFO:tasks.workunit.client.0.smithi033.stdout:2/890: sync 2024-02-15T18:31:11.769 INFO:tasks.workunit.client.0.smithi033.stdout:3/889: sync 2024-02-15T18:31:11.770 INFO:tasks.workunit.client.0.smithi033.stdout:0/793: symlink d0/d8/d15/d2d/d41/d73/d96/l10e 0 2024-02-15T18:31:11.770 INFO:tasks.workunit.client.0.smithi033.stdout:0/794: truncate d0/d8/d15/d5b/fd8 4596516 0 2024-02-15T18:31:11.770 INFO:tasks.workunit.client.0.smithi033.stdout:0/795: fsync d0/de8/f98 0 2024-02-15T18:31:11.771 INFO:tasks.workunit.client.0.smithi033.stdout:9/791: mknod d4/d8/dd/d28/c111 0 2024-02-15T18:31:11.772 INFO:tasks.workunit.client.0.smithi033.stdout:2/891: rmdir d20/d3a/d4a/d5e/d10c 39 2024-02-15T18:31:11.773 INFO:tasks.workunit.client.0.smithi033.stdout:8/928: dread d0/df/f19 [0,4194304] 0 2024-02-15T18:31:11.773 INFO:tasks.workunit.client.0.smithi033.stdout:8/929: chown d0/df/d53/db3/d30/d8e/d8f/d4b/d72/d127 14 1 2024-02-15T18:31:11.773 INFO:tasks.workunit.client.0.smithi033.stdout:3/890: unlink d2/d14/d23/d6f/fdd 0 2024-02-15T18:31:11.774 INFO:tasks.workunit.client.0.smithi033.stdout:3/891: chown d2/d14/d23/l38 114964 1 2024-02-15T18:31:11.778 INFO:tasks.workunit.client.0.smithi033.stdout:0/796: symlink d0/d8/d15/l10f 0 2024-02-15T18:31:11.778 INFO:tasks.workunit.client.0.smithi033.stdout:0/797: write d0/de8/d8d/dec/fa0 [64831,74746] 0 2024-02-15T18:31:11.779 INFO:tasks.workunit.client.0.smithi033.stdout:9/792: rename d4/d8/dd/lce to d4/d32/l112 0 2024-02-15T18:31:11.780 INFO:tasks.workunit.client.0.smithi033.stdout:9/793: write d4/d8/fa5 [1012002,38946] 0 2024-02-15T18:31:11.780 INFO:tasks.workunit.client.0.smithi033.stdout:9/794: fdatasync d4/d8/d1b/d2f/f30 0 2024-02-15T18:31:11.781 INFO:tasks.workunit.client.0.smithi033.stdout:0/798: creat d0/d8/d15/df9/f110 x:0 0 0 2024-02-15T18:31:11.783 INFO:tasks.workunit.client.0.smithi033.stdout:0/799: creat d0/d64/d1d/dd3/d100/f111 x:0 0 0 2024-02-15T18:31:11.793 INFO:tasks.workunit.client.0.smithi033.stdout:3/892: dread d2/d3/d1e/f9c [0,4194304] 0 2024-02-15T18:31:11.793 INFO:tasks.workunit.client.0.smithi033.stdout:0/800: dread d0/d2/f7 [0,4194304] 0 2024-02-15T18:31:11.794 INFO:tasks.workunit.client.0.smithi033.stdout:0/801: symlink d0/d8/d15/d8b/da3/dae/d58/d80/d9b/l112 0 2024-02-15T18:31:11.796 INFO:tasks.workunit.client.0.smithi033.stdout:0/802: link d0/d8/f39 d0/de8/d97/db1/f113 0 2024-02-15T18:31:11.796 INFO:tasks.workunit.client.0.smithi033.stdout:0/803: write d0/d8/d54/fa7 [1045065,41477] 0 2024-02-15T18:31:11.797 INFO:tasks.workunit.client.0.smithi033.stdout:6/987: sync 2024-02-15T18:31:11.797 INFO:tasks.workunit.client.0.smithi033.stdout:4/943: sync 2024-02-15T18:31:11.797 INFO:tasks.workunit.client.0.smithi033.stdout:1/987: sync 2024-02-15T18:31:11.797 INFO:tasks.workunit.client.0.smithi033.stdout:7/909: sync 2024-02-15T18:31:11.797 INFO:tasks.workunit.client.0.smithi033.stdout:7/910: fsync d0/dc/fd7 0 2024-02-15T18:31:11.797 INFO:tasks.workunit.client.0.smithi033.stdout:7/911: fsync d0/dc/d10/d1d/d38/d74/d7f/fa6 0 2024-02-15T18:31:11.798 INFO:tasks.workunit.client.0.smithi033.stdout:7/912: truncate d0/dc/d10/d1d/d38/d74/d7f/fa6 1010145 0 2024-02-15T18:31:11.798 INFO:tasks.workunit.client.0.smithi033.stdout:0/804: truncate d0/de8/d97/fbe 7187663 0 2024-02-15T18:31:11.798 INFO:tasks.workunit.client.0.smithi033.stdout:4/944: read d4/d20/d13/d34/d82/df5/d106/db5/fb9 [45390,29016] 0 2024-02-15T18:31:11.798 INFO:tasks.workunit.client.0.smithi033.stdout:1/988: symlink d5/d9/d1e/d20/dfb/l13f 0 2024-02-15T18:31:11.798 INFO:tasks.workunit.client.0.smithi033.stdout:1/989: write d5/dd/f3b [175995,43640] 0 2024-02-15T18:31:11.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:09.525170+0000 mgr.smithi131.buibla (mgr.24387) 26 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 185 MiB/s wr, 282 op/s 2024-02-15T18:31:11.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:09.580936+0000 mgr.smithi131.buibla (mgr.24387) 27 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:11.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:10.559745+0000 mon.smithi033 (mon.0) 618 : audit [DBG] from='client.? 172.21.15.33:0/1623309991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:31:11.799 INFO:tasks.workunit.client.0.smithi033.stdout:7/913: rename d0/d56/d70/d83/laf to d0/dc/d10/d1d/d38/d82/l13a 0 2024-02-15T18:31:11.800 INFO:tasks.workunit.client.0.smithi033.stdout:1/990: link d5/d9/d1e/d20/d2c/db2/fdd d5/d9/d1e/d20/d5c/d57/f140 0 2024-02-15T18:31:11.801 INFO:tasks.workunit.client.0.smithi033.stdout:6/988: dread d8/d70/fea [0,4194304] 0 2024-02-15T18:31:11.802 INFO:tasks.workunit.client.0.smithi033.stdout:2/892: dwrite d20/d31/d47/fc9 [0,4194304] 0 2024-02-15T18:31:11.802 INFO:tasks.workunit.client.0.smithi033.stdout:8/930: dwrite d0/df/d53/db3/d30/d8e/d35/d58/deb/ffa [0,4194304] 0 2024-02-15T18:31:11.803 INFO:tasks.workunit.client.0.smithi033.stdout:0/805: rename d0/d8/l30 to d0/d8/d15/d8b/da3/dfd/l114 0 2024-02-15T18:31:11.803 INFO:tasks.workunit.client.0.smithi033.stdout:0/806: chown d0/d8/d15/d2d/d2e 26029 1 2024-02-15T18:31:11.803 INFO:tasks.workunit.client.0.smithi033.stdout:0/807: chown d0/d2/c19 711 1 2024-02-15T18:31:11.804 INFO:tasks.workunit.client.0.smithi033.stdout:1/991: mknod d5/d9/d1e/d20/d2c/c141 0 2024-02-15T18:31:11.809 INFO:tasks.workunit.client.0.smithi033.stdout:9/795: dwrite d4/d8/dd/fe [0,4194304] 0 2024-02-15T18:31:11.809 INFO:tasks.workunit.client.0.smithi033.stdout:9/796: fdatasync d4/f4f 0 2024-02-15T18:31:11.809 INFO:tasks.workunit.client.0.smithi033.stdout:3/893: dread d2/d3/df/d6c/f91 [0,4194304] 0 2024-02-15T18:31:11.810 INFO:tasks.workunit.client.0.smithi033.stdout:9/797: read d4/d8/dd/f13 [3112345,5559] 0 2024-02-15T18:31:11.812 INFO:tasks.workunit.client.0.smithi033.stdout:2/893: getdents d20/d3a/dee 0 2024-02-15T18:31:11.815 INFO:tasks.workunit.client.0.smithi033.stdout:8/931: mkdir d0/df/df0/d12c 0 2024-02-15T18:31:11.817 INFO:tasks.workunit.client.0.smithi033.stdout:6/989: rename d8/d28/d14/d2c/d31/d30/d29/d38/dae/lee to d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/l135 0 2024-02-15T18:31:11.817 INFO:tasks.workunit.client.0.smithi033.stdout:6/990: write d8/d28/d14/d2c/de7/dfe/d126/d37/d4f/dbb/d57/fdf [9351825,801] 0 2024-02-15T18:31:11.818 INFO:tasks.workunit.client.0.smithi033.stdout:0/808: mknod d0/d8/d15/d8b/da3/dfd/c115 0 2024-02-15T18:31:11.818 INFO:tasks.workunit.client.0.smithi033.stdout:0/809: fdatasync d0/d64/d88/ff6 0 2024-02-15T18:31:11.818 INFO:tasks.workunit.client.0.smithi033.stdout:0/810: fsync d0/d8/d15/d8b/da3/d6c/ffe 0 2024-02-15T18:31:11.818 INFO:tasks.workunit.client.0.smithi033.stdout:0/811: write d0/d8/d15/ff3 [512011,115020] 0 2024-02-15T18:31:11.819 INFO:tasks.workunit.client.0.smithi033.stdout:0/812: chown d0/d8/d15/d8b/da3/dae/d58/d77/fbc 148751 1 2024-02-15T18:31:11.819 INFO:tasks.workunit.client.0.smithi033.stdout:1/992: mkdir d5/d142 0 2024-02-15T18:31:11.821 INFO:tasks.workunit.client.0.smithi033.stdout:3/894: creat d2/d14/d23/f113 x:0 0 0 2024-02-15T18:31:11.821 INFO:tasks.workunit.client.0.smithi033.stdout:3/895: chown d2/d14/db3/f111 5806 1 2024-02-15T18:31:11.821 INFO:tasks.workunit.client.0.smithi033.stdout:3/896: write d2/d3/d17/de6/d88/dd1/ff6 [508355,96739] 0 2024-02-15T18:31:11.822 INFO:tasks.workunit.client.0.smithi033.stdout:9/798: truncate d4/d8/f20 1810962 0 2024-02-15T18:31:11.823 INFO:tasks.workunit.client.0.smithi033.stdout:2/894: symlink d20/d3a/d4a/d5e/l133 0 2024-02-15T18:31:11.825 INFO:tasks.workunit.client.0.smithi033.stdout:0/813: mknod d0/d64/d1d/dd3/c116 0 2024-02-15T18:31:11.827 INFO:tasks.workunit.client.0.smithi033.stdout:1/993: link d5/dd/d12/d49/d23/f4d d5/d9/d1e/d20/d2c/d34/d51/d63/d76/f143 0 2024-02-15T18:31:11.828 INFO:tasks.workunit.client.0.smithi033.stdout:3/897: link d2/d14/db3/dba/f109 d2/d3/f114 0 2024-02-15T18:31:11.829 INFO:tasks.workunit.client.0.smithi033.stdout:7/914: dwrite d0/d56/d70/d83/fde [0,4194304] 0 2024-02-15T18:31:11.829 INFO:tasks.workunit.client.0.smithi033.stdout:4/945: dwrite d4/d20/d53/f61 [0,4194304] 0 2024-02-15T18:31:11.830 INFO:tasks.workunit.client.0.smithi033.stdout:9/799: rmdir d4/d8/dd/d28 39 2024-02-15T18:31:11.830 INFO:tasks.workunit.client.0.smithi033.stdout:9/800: chown d4/d8 25330 1 2024-02-15T18:31:11.830 INFO:tasks.workunit.client.0.smithi033.stdout:9/801: chown d4/d8/dd/l18 6 1 2024-02-15T18:31:11.831 INFO:tasks.workunit.client.0.smithi033.stdout:2/895: chown d20/d31/d6a/f2e 538372502 1 2024-02-15T18:31:11.832 INFO:tasks.workunit.client.0.smithi033.stdout:0/814: unlink d0/de8/d97/db1/dca/de0/fe5 0 2024-02-15T18:31:11.841 INFO:tasks.workunit.client.0.smithi033.stdout:3/898: rename d2/d3/d1e/d22/d4d/dcb/ld6 to d2/d3/d17/de6/d88/dd1/l115 0 2024-02-15T18:31:11.841 INFO:tasks.workunit.client.0.smithi033.stdout:3/899: fsync d2/d3/d17/de6/fa2 0 2024-02-15T18:31:11.842 INFO:tasks.workunit.client.0.smithi033.stdout:3/900: dread - d2/d3/d1e/d22/ff5 zero size 2024-02-15T18:31:11.842 INFO:tasks.workunit.client.0.smithi033.stdout:3/901: write d2/d3/df/d6c/f72 [4344031,65505] 0 2024-02-15T18:31:11.842 INFO:tasks.workunit.client.0.smithi033.stdout:3/902: chown d2/d14/d23/d6f/fe0 37626896 1 2024-02-15T18:31:11.842 INFO:tasks.workunit.client.0.smithi033.stdout:3/903: readlink d2/d14/d23/d6f/l92 0 2024-02-15T18:31:11.844 INFO:tasks.workunit.client.0.smithi033.stdout:4/946: symlink d4/d20/d13/d34/d82/df5/d106/db5/df8/l13a 0 2024-02-15T18:31:11.844 INFO:tasks.workunit.client.0.smithi033.stdout:4/947: chown d4/d5/d28/d39/d62/d9c 86 1 2024-02-15T18:31:11.844 INFO:tasks.workunit.client.0.smithi033.stdout:2/896: creat d20/d31/f134 x:0 0 0 2024-02-15T18:31:11.849 INFO:tasks.workunit.client.0.smithi033.stdout:3/904: creat d2/d3/d17/f116 x:0 0 0 2024-02-15T18:31:11.849 INFO:tasks.workunit.client.0.smithi033.stdout:8/932: dwrite d0/df/d53/db3/d30/d8e/d14/d56/fbe [0,4194304] 0 2024-02-15T18:31:11.849 INFO:tasks.workunit.client.0.smithi033.stdout:3/905: write d2/d14/d23/d6f/d93/f10c [782372,42055] 0 2024-02-15T18:31:11.849 INFO:tasks.workunit.client.0.smithi033.stdout:2/897: rmdir d20/d31/d47/d82/de6/d106 39 2024-02-15T18:31:11.850 INFO:tasks.workunit.client.0.smithi033.stdout:2/898: dread - d20/de1/f11a zero size 2024-02-15T18:31:11.851 INFO:tasks.workunit.client.0.smithi033.stdout:8/933: getdents d0/df/d53/db3/d30/d8e/d35/d58/da1 0 2024-02-15T18:31:11.854 INFO:tasks.workunit.client.0.smithi033.stdout:2/899: creat d20/d31/d47/d82/de6/f135 x:0 0 0 2024-02-15T18:31:11.856 INFO:tasks.workunit.client.0.smithi033.stdout:8/934: rename d0/df/d53/db3/d30/d8e/d8f/d4b/d72/d127 to d0/df/d53/db3/d30/d8e/da7/db7/d12d 0 2024-02-15T18:31:11.856 INFO:tasks.workunit.client.0.smithi033.stdout:8/935: readlink d0/df/d48/l54 0 2024-02-15T18:31:11.857 INFO:tasks.workunit.client.0.smithi033.stdout:2/900: symlink d20/d31/dc8/l136 0 2024-02-15T18:31:11.857 INFO:tasks.workunit.client.0.smithi033.stdout:2/901: symlink d20/d3a/l137 0 2024-02-15T18:31:11.858 INFO:tasks.workunit.client.0.smithi033.stdout:2/902: stat d20/d31/d47/lda 0 2024-02-15T18:31:11.859 INFO:tasks.workunit.client.0.smithi033.stdout:8/936: write d0/df/db/d45/f98 [2218482,65059] 0 2024-02-15T18:31:11.859 INFO:tasks.workunit.client.0.smithi033.stdout:2/903: rmdir d20/d30 39 2024-02-15T18:31:11.860 INFO:tasks.workunit.client.0.smithi033.stdout:2/904: mknod d20/d3a/d4a/d5e/d6b/d83/c138 0 2024-02-15T18:31:11.861 INFO:tasks.workunit.client.0.smithi033.stdout:2/905: truncate d20/d31/d47/fc9 3603171 0 2024-02-15T18:31:11.861 INFO:tasks.workunit.client.0.smithi033.stdout:2/906: chown c1d 0 1 2024-02-15T18:31:11.863 INFO:tasks.workunit.client.0.smithi033.stdout:8/937: dread d0/daa/fc8 [0,4194304] 0 2024-02-15T18:31:11.865 INFO:tasks.workunit.client.0.smithi033.stdout:8/938: creat d0/df/d53/db3/d30/d8e/d35/d58/f12e x:0 0 0 2024-02-15T18:31:11.865 INFO:tasks.workunit.client.0.smithi033.stdout:8/939: stat d0/df/d53/db3/d30/d8e/d8f/d4b/caf 0 2024-02-15T18:31:11.866 INFO:tasks.workunit.client.0.smithi033.stdout:8/940: creat d0/df/d48/f12f x:0 0 0 2024-02-15T18:31:11.871 INFO:tasks.workunit.client.0.smithi033.stdout:3/906: dread d2/d3/d17/f69 [0,4194304] 0 2024-02-15T18:31:11.872 INFO:tasks.workunit.client.0.smithi033.stdout:8/941: write d0/df/d53/db3/d95/f11b [1803379,9495] 0 2024-02-15T18:31:11.872 INFO:tasks.workunit.client.0.smithi033.stdout:8/942: truncate d0/df/d48/fea 45683 0 2024-02-15T18:31:11.873 INFO:tasks.workunit.client.0.smithi033.stdout:3/907: mkdir d2/d117 0 2024-02-15T18:31:11.874 INFO:tasks.workunit.client.0.smithi033.stdout:1/994: dwrite d5/dd/d12/dc6/dd4/ffa [0,4194304] 0 2024-02-15T18:31:11.874 INFO:tasks.workunit.client.0.smithi033.stdout:1/995: truncate d5/d9/d1e/d20/d2c/f9a 1794813 0 2024-02-15T18:31:11.875 INFO:tasks.workunit.client.0.smithi033.stdout:6/991: dwrite d8/d28/fcf [0,4194304] 0 2024-02-15T18:31:11.875 INFO:tasks.workunit.client.0.smithi033.stdout:0/815: dwrite d0/fad [4194304,4194304] 0 2024-02-15T18:31:11.875 INFO:tasks.workunit.client.0.smithi033.stdout:0/816: truncate d0/d8/d15/d8b/da3/dae/d58/d80/d9b/fce 641189 0 2024-02-15T18:31:11.877 INFO:tasks.workunit.client.0.smithi033.stdout:8/943: symlink d0/df/d53/db3/d30/d8e/d14/d56/d59/l130 0 2024-02-15T18:31:11.878 INFO:tasks.workunit.client.0.smithi033.stdout:9/802: dwrite d4/d32/d6c/f91 [4194304,4194304] 0 2024-02-15T18:31:11.878 INFO:tasks.workunit.client.0.smithi033.stdout:4/948: dwrite d4/d20/d53/f78 [0,4194304] 0 2024-02-15T18:31:11.879 INFO:tasks.workunit.client.0.smithi033.stdout:6/992: dread d8/d28/d14/d2c/d31/d30/d29/f59 [0,4194304] 0 2024-02-15T18:31:11.879 INFO:tasks.workunit.client.0.smithi033.stdout:9/803: write d4/d8/d1b/d73/fb7 [757167,96781] 0 2024-02-15T18:31:11.880 INFO:tasks.workunit.client.0.smithi033.stdout:9/804: dread d4/d32/fab [0,4194304] 0 2024-02-15T18:31:11.881 INFO:tasks.workunit.client.0.smithi033.stdout:3/908: rmdir d2/d14/d23/d5c/d7f/de7/d108 0 2024-02-15T18:31:11.883 INFO:tasks.workunit.client.0.smithi033.stdout:7/915: dwrite d0/dc/d10/d1d/d38/ff0 [4194304,4194304] 0 2024-02-15T18:31:11.883 INFO:tasks.workunit.client.0.smithi033.stdout:7/916: chown d0/dc/d10/f78 1727262425 1 2024-02-15T18:31:11.883 INFO:tasks.workunit.client.0.smithi033.stdout:7/917: chown d0/dc/d10/f2c 252646640 1 2024-02-15T18:31:11.883 INFO:tasks.workunit.client.0.smithi033.stdout:7/918: write d0/f5e [1606101,82464] 0 2024-02-15T18:31:11.890 INFO:tasks.workunit.client.0.smithi033.stdout:1/996: dread d5/d9/d1e/d20/d2c/f8c [0,4194304] 0 2024-02-15T18:31:11.890 INFO:tasks.workunit.client.0.smithi033.stdout:2/907: dwrite d20/d3a/f75 [4194304,4194304] 0 2024-02-15T18:31:11.893 INFO:tasks.workunit.client.0.smithi033.stdout:0/817: creat d0/d2/f117 x:0 0 0 2024-02-15T18:31:11.893 INFO:tasks.workunit.client.0.smithi033.stdout:0/818: stat d0/d8/d15/d8b/da3/d6c/ffe 0 2024-02-15T18:31:11.893 INFO:tasks.workunit.client.0.smithi033.stdout:0/819: write d0/d8/d15/d2d/d41/f87 [738125,123074] 0 2024-02-15T18:31:11.894 INFO:tasks.workunit.client.0.smithi033.stdout:8/944: mkdir d0/df/d53/db3/d30/d8e/d8f/d4b/d72/d129/d131 0 2024-02-15T18:31:11.894 INFO:tasks.workunit.client.0.smithi033.stdout:0/820: read d0/d8/d15/d8b/da3/dae/d59/fcb [206896,129682] 0 2024-02-15T18:31:11.894 INFO:tasks.workunit.client.0.smithi033.stdout:0/821: read - d0/d8/d15/d8b/da3/f108 zero size 2024-02-15T18:31:11.895 INFO:tasks.workunit.client.0.smithi033.stdout:0/822: readlink d0/d8/d15/d8b/da3/dfd/l114 0 2024-02-15T18:31:11.895 INFO:tasks.workunit.client.0.smithi033.stdout:0/823: truncate d0/d2/f75 998514 0 2024-02-15T18:31:11.896 INFO:tasks.workunit.client.0.smithi033.stdout:8/945: write d0/df/d53/db3/d30/d8e/d35/d29/fe7 [190414,100361] 0 2024-02-15T18:31:11.896 INFO:tasks.workunit.client.0.smithi033.stdout:8/946: write d0/df/d53/db3/d30/d8e/d14/d56/db0/ff5 [203124,21545] 0 2024-02-15T18:31:11.904 INFO:tasks.workunit.client.0.smithi033.stdout:7/919: creat d0/dc/d10/d1d/d2b/d5f/d63/f13b x:0 0 0 2024-02-15T18:31:11.906 INFO:tasks.workunit.client.0.smithi033.stdout:1/997: symlink d5/d38/l144 0 2024-02-15T18:31:11.907 INFO:tasks.workunit.client.0.smithi033.stdout:1/998: read d5/d9/d1e/d20/d5c/d57/fa7 [1311139,89316] 0 2024-02-15T18:31:11.907 INFO:tasks.workunit.client.0.smithi033.stdout:1/999: dread - d5/d9/d1e/d20/d5c/d57/f140 zero size 2024-02-15T18:31:11.909 INFO:tasks.workunit.client.0.smithi033.stdout:0/824: symlink d0/d8/d15/d8b/da3/dae/l118 0 2024-02-15T18:31:11.910 INFO:tasks.workunit.client.0.smithi033.stdout:8/947: mkdir d0/d132 0 2024-02-15T18:31:11.923 INFO:tasks.workunit.client.0.smithi033.stdout:4/949: symlink d4/d20/d13/d1b/l13b 0 2024-02-15T18:31:11.923 INFO:tasks.workunit.client.0.smithi033.stdout:4/950: getdents d4/d5/d28/d39/d62/dfa/d11d 0 2024-02-15T18:31:11.923 INFO:tasks.workunit.client.0.smithi033.stdout:4/951: readlink d4/d20/d13/d34/d82/df5/d106/db5/df8/l13a 0 2024-02-15T18:31:11.923 INFO:tasks.workunit.client.0.smithi033.stdout:6/993: mkdir d8/d28/d14/d2c/d31/d136 0 2024-02-15T18:31:11.924 INFO:tasks.workunit.client.0.smithi033.stdout:6/994: write d8/d70/fca [844759,52597] 0 2024-02-15T18:31:11.924 INFO:tasks.workunit.client.0.smithi033.stdout:4/952: write d4/d20/d37/f42 [1196286,11220] 0 2024-02-15T18:31:11.924 INFO:tasks.workunit.client.0.smithi033.stdout:4/953: stat d4/d3c 0 2024-02-15T18:31:11.924 INFO:tasks.workunit.client.0.smithi033.stdout:4/954: write d4/fed [128568,29420] 0 2024-02-15T18:31:11.924 INFO:tasks.workunit.client.0.smithi033.stdout:6/995: read d8/d28/d14/d2c/d31/d30/d29/f59 [682092,11031] 0 2024-02-15T18:31:11.926 INFO:tasks.workunit.client.0.smithi033.stdout:7/920: symlink d0/dc/d10/d48/l13c 0 2024-02-15T18:31:11.926 INFO:tasks.workunit.client.0.smithi033.stdout:7/921: fsync d0/f1c 0 2024-02-15T18:31:11.926 INFO:tasks.workunit.client.0.smithi033.stdout:2/908: dread d20/d31/d47/d4c/def/d80/fe7 [0,4194304] 0 2024-02-15T18:31:11.927 INFO:tasks.workunit.client.0.smithi033.stdout:0/825: getdents d0/d8/d15/d2d/d41/d73/d96 0 2024-02-15T18:31:11.929 INFO:tasks.workunit.client.0.smithi033.stdout:8/948: mkdir d0/df/db/d133 0 2024-02-15T18:31:11.930 INFO:tasks.workunit.client.0.smithi033.stdout:8/949: read d0/df/d53/db3/d30/d8e/d14/d56/d59/fd9 [227954,125792] 0 2024-02-15T18:31:11.930 INFO:tasks.workunit.client.0.smithi033.stdout:8/950: fsync d0/df/dd2/fe3 0 2024-02-15T18:31:11.931 INFO:tasks.workunit.client.0.smithi033.stdout:8/951: stat d0/l10 0 2024-02-15T18:31:11.931 INFO:tasks.workunit.client.0.smithi033.stdout:4/955: chown d4/d20/d13/ce7 47587 1 2024-02-15T18:31:11.931 INFO:tasks.workunit.client.0.smithi033.stdout:4/956: chown d4/d5/d28/d39/d62/d9c/d9e/da4/f113 170005879 1 2024-02-15T18:31:11.932 INFO:tasks.workunit.client.0.smithi033.stdout:7/922: mknod d0/dc/d10/d1d/d38/d74/d7f/da2/d12f/c13d 0 2024-02-15T18:31:11.933 INFO:tasks.workunit.client.0.smithi033.stdout:2/909: creat d20/d31/d47/d4c/def/d80/da5/f139 x:0 0 0 2024-02-15T18:31:11.933 INFO:tasks.workunit.client.0.smithi033.stdout:0/826: creat d0/de8/d8d/dec/d105/f119 x:0 0 0 2024-02-15T18:31:11.935 INFO:tasks.workunit.client.0.smithi033.stdout:8/952: dread d0/df/d53/db3/d30/d8e/d14/d56/ff4 [0,4194304] 0 2024-02-15T18:31:11.935 INFO:tasks.workunit.client.0.smithi033.stdout:4/957: creat d4/d20/d13/d1b/d7c/f13c x:0 0 0 2024-02-15T18:31:11.938 INFO:tasks.workunit.client.0.smithi033.stdout:2/910: rename d20/d3a/d4a/d5e/d6b/d88/da6/ddb to d20/d3a/dee/d13a 0 2024-02-15T18:31:11.941 INFO:tasks.workunit.client.0.smithi033.stdout:8/953: unlink d0/df/d53/db3/d30/d8e/d8f/d4b/cfe 0 2024-02-15T18:31:11.941 INFO:tasks.workunit.client.0.smithi033.stdout:8/954: readlink d0/df/d53/db3/d30/d8e/d35/d58/lad 0 2024-02-15T18:31:11.942 INFO:tasks.workunit.client.0.smithi033.stdout:4/958: readlink d4/d5/ld 0 2024-02-15T18:31:11.943 INFO:tasks.workunit.client.0.smithi033.stdout:7/923: dread d0/d56/d70/d91/d9e/fb5 [0,4194304] 0 2024-02-15T18:31:11.943 INFO:tasks.workunit.client.0.smithi033.stdout:2/911: mknod d20/d3a/dee/d13a/ddf/c13b 0 2024-02-15T18:31:11.944 INFO:tasks.workunit.client.0.smithi033.stdout:2/912: symlink d20/d3a/d4a/l13c 0 2024-02-15T18:31:11.946 INFO:tasks.workunit.client.0.smithi033.stdout:2/913: mknod d20/d31/d47/d4c/def/d80/c13d 0 2024-02-15T18:31:11.947 INFO:tasks.workunit.client.0.smithi033.stdout:2/914: mkdir d20/d3a/d4a/d5e/d6b/d83/d13e 0 2024-02-15T18:31:11.947 INFO:tasks.workunit.client.0.smithi033.stdout:2/915: readlink d20/d3a/dee/l122 0 2024-02-15T18:31:11.948 INFO:tasks.workunit.client.0.smithi033.stdout:2/916: mknod d20/d3a/d4a/d5e/d6b/d83/d13e/c13f 0 2024-02-15T18:31:11.950 INFO:tasks.workunit.client.0.smithi033.stdout:2/917: read d20/d73/f9d [1637413,28154] 0 2024-02-15T18:31:11.953 INFO:tasks.workunit.client.0.smithi033.stdout:2/918: unlink d20/d31/d6a/c108 0 2024-02-15T18:31:11.955 INFO:tasks.workunit.client.0.smithi033.stdout:2/919: rename d20/d3a/d4a/d5e/c97 to d20/d31/d47/d4c/c140 0 2024-02-15T18:31:11.955 INFO:tasks.workunit.client.0.smithi033.stdout:2/920: chown d20/d31/dc8 6 1 2024-02-15T18:31:11.956 INFO:tasks.workunit.client.0.smithi033.stdout:2/921: creat d20/d3a/f141 x:0 0 0 2024-02-15T18:31:11.956 INFO:tasks.workunit.client.0.smithi033.stdout:2/922: dread - d20/d3a/d4a/d5e/d6b/d83/faa zero size 2024-02-15T18:31:11.957 INFO:tasks.workunit.client.0.smithi033.stdout:2/923: rmdir d20/d31/d47/d82/de6/d106 39 2024-02-15T18:31:11.960 INFO:tasks.workunit.client.0.smithi033.stdout:2/924: write d20/f77 [2564725,12281] 0 2024-02-15T18:31:11.960 INFO:tasks.workunit.client.0.smithi033.stdout:2/925: dread - d20/d3a/d4a/d5e/d6b/d88/da6/fb2 zero size 2024-02-15T18:31:11.960 INFO:tasks.workunit.client.0.smithi033.stdout:0/827: dwrite d0/d8/d54/fa7 [0,4194304] 0 2024-02-15T18:31:11.962 INFO:tasks.workunit.client.0.smithi033.stdout:8/955: dwrite d0/f94 [8388608,4194304] 0 2024-02-15T18:31:11.962 INFO:tasks.workunit.client.0.smithi033.stdout:8/956: fdatasync d0/f94 0 2024-02-15T18:31:11.965 INFO:tasks.workunit.client.0.smithi033.stdout:8/957: symlink d0/df/d53/db3/d30/d8e/da7/db7/l134 0 2024-02-15T18:31:11.969 INFO:tasks.workunit.client.0.smithi033.stdout:2/926: dread d20/d39/f10d [0,4194304] 0 2024-02-15T18:31:11.971 INFO:tasks.workunit.client.0.smithi033.stdout:8/958: dread d0/df/d53/db3/d30/d8e/d8f/d4b/d72/fbc [0,4194304] 0 2024-02-15T18:31:11.971 INFO:tasks.workunit.client.0.smithi033.stdout:8/959: write d0/df/d53/db3/d30/d8e/d35/d29/fe7 [617917,41229] 0 2024-02-15T18:31:11.971 INFO:tasks.workunit.client.0.smithi033.stdout:8/960: readlink d0/df/d53/db3/d30/d8e/d35/d58/l11c 0 2024-02-15T18:31:11.979 INFO:tasks.workunit.client.0.smithi033.stdout:7/924: dwrite d0/dc/fe3 [0,4194304] 0 2024-02-15T18:31:11.981 INFO:tasks.workunit.client.0.smithi033.stdout:7/925: creat d0/d56/d8e/f13e x:0 0 0 2024-02-15T18:31:11.981 INFO:tasks.workunit.client.0.smithi033.stdout:0/828: dwrite d0/d8/d15/d2d/f8c [0,4194304] 0 2024-02-15T18:31:11.981 INFO:tasks.workunit.client.0.smithi033.stdout:0/829: chown d0/de8/d97/db1 10 1 2024-02-15T18:31:11.982 INFO:tasks.workunit.client.0.smithi033.stdout:7/926: symlink d0/dc/d10/d1d/d38/l13f 0 2024-02-15T18:31:11.985 INFO:tasks.workunit.client.0.smithi033.stdout:7/927: mkdir d0/dc/d10/d1d/d38/dd0/d140 0 2024-02-15T18:31:11.985 INFO:tasks.workunit.client.0.smithi033.stdout:7/928: getdents d0/dc/d10/d1d/d38/d82/d119 0 2024-02-15T18:31:11.985 INFO:tasks.workunit.client.0.smithi033.stdout:2/927: dwrite d20/d31/f127 [0,4194304] 0 2024-02-15T18:31:11.986 INFO:tasks.workunit.client.0.smithi033.stdout:7/929: creat d0/dc/d10/da1/f141 x:0 0 0 2024-02-15T18:31:11.986 INFO:tasks.workunit.client.0.smithi033.stdout:7/930: stat d0/dc/d10/d48/f5b 0 2024-02-15T18:31:11.986 INFO:tasks.workunit.client.0.smithi033.stdout:7/931: chown d0/dc/d10/d1d/d38/d82/f117 13816491 1 2024-02-15T18:31:11.993 INFO:tasks.workunit.client.0.smithi033.stdout:7/932: rename d0/dc/d10/d1d/d38/d74/d7f/da2 to d0/dc/d10/d1d/d38/d74/de7/dfa/d142 0 2024-02-15T18:31:11.993 INFO:tasks.workunit.client.0.smithi033.stdout:7/933: chown d0/dc/d10/d1d/l96 56 1 2024-02-15T18:31:11.994 INFO:tasks.workunit.client.0.smithi033.stdout:2/928: dread d20/d3a/dee/d13a/ff2 [0,4194304] 0 2024-02-15T18:31:11.994 INFO:tasks.workunit.client.0.smithi033.stdout:2/929: fdatasync d20/d31/d47/fcd 0 2024-02-15T18:31:11.994 INFO:tasks.workunit.client.0.smithi033.stdout:2/930: chown d20/de1/ffe 3 1 2024-02-15T18:31:11.995 INFO:tasks.workunit.client.0.smithi033.stdout:7/934: creat d0/dc/d10/d1d/d2b/d5f/d63/f143 x:0 0 0 2024-02-15T18:31:11.997 INFO:tasks.workunit.client.0.smithi033.stdout:7/935: truncate d0/dc/d10/f13 7061038 0 2024-02-15T18:31:11.998 INFO:tasks.workunit.client.0.smithi033.stdout:7/936: creat d0/dc/f144 x:0 0 0 2024-02-15T18:31:11.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:09.525170+0000 mgr.smithi131.buibla (mgr.24387) 26 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 185 MiB/s wr, 282 op/s 2024-02-15T18:31:11.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:09.580936+0000 mgr.smithi131.buibla (mgr.24387) 27 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:11.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:10.559745+0000 mon.smithi033 (mon.0) 618 : audit [DBG] from='client.? 172.21.15.33:0/1623309991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:31:12.000 INFO:tasks.workunit.client.0.smithi033.stdout:7/937: rename d0/dc/f144 to d0/d56/d70/d91/f145 0 2024-02-15T18:31:12.001 INFO:tasks.workunit.client.0.smithi033.stdout:7/938: creat d0/dc/d10/da1/f146 x:0 0 0 2024-02-15T18:31:12.003 INFO:tasks.workunit.client.0.smithi033.stdout:7/939: write d0/dc/d10/d1d/d2b/f4a [2197207,91846] 0 2024-02-15T18:31:12.005 INFO:tasks.workunit.client.0.smithi033.stdout:0/830: dwrite d0/d8/d15/df9/f110 [0,4194304] 0 2024-02-15T18:31:12.008 INFO:tasks.workunit.client.0.smithi033.stdout:0/831: unlink d0/d8/d15/d5b/ff4 0 2024-02-15T18:31:12.010 INFO:tasks.workunit.client.0.smithi033.stdout:0/832: symlink d0/d8/d15/d8b/da3/dfd/l11a 0 2024-02-15T18:31:12.011 INFO:tasks.workunit.client.0.smithi033.stdout:0/833: mkdir d0/d8/d15/d8b/da3/dae/d59/d11b 0 2024-02-15T18:31:12.012 INFO:tasks.workunit.client.0.smithi033.stdout:0/834: creat d0/d8/d15/d8b/da3/f11c x:0 0 0 2024-02-15T18:31:12.012 INFO:tasks.workunit.client.0.smithi033.stdout:0/835: fdatasync d0/d2/f82 0 2024-02-15T18:31:12.013 INFO:tasks.workunit.client.0.smithi033.stdout:0/836: rmdir d0/d8/d15/d8b/da3/dae/d58 39 2024-02-15T18:31:12.013 INFO:tasks.workunit.client.0.smithi033.stdout:0/837: write d0/d8/f42 [536300,91490] 0 2024-02-15T18:31:12.013 INFO:tasks.workunit.client.0.smithi033.stdout:0/838: readlink d0/la9 0 2024-02-15T18:31:12.015 INFO:tasks.workunit.client.0.smithi033.stdout:0/839: mkdir d0/de8/d8d/d11d 0 2024-02-15T18:31:12.015 INFO:tasks.workunit.client.0.smithi033.stdout:0/840: stat d0/d64/d1d/dd3 0 2024-02-15T18:31:12.018 INFO:tasks.workunit.client.0.smithi033.stdout:0/841: rename d0/d64/d1d/dd3 to d0/d8/d15/d8b/da3/dae/d11e 0 2024-02-15T18:31:12.018 INFO:tasks.workunit.client.0.smithi033.stdout:0/842: fdatasync d0/d8/d15/d8b/da3/f11c 0 2024-02-15T18:31:12.019 INFO:tasks.workunit.client.0.smithi033.stdout:0/843: mkdir d0/d8/d11f 0 2024-02-15T18:31:12.019 INFO:tasks.workunit.client.0.smithi033.stdout:0/844: symlink d0/de8/d97/l120 0 2024-02-15T18:31:12.021 INFO:tasks.workunit.client.0.smithi033.stdout:0/845: mkdir d0/d8/d15/d8b/da3/dae/d58/de2/df0/d121 0 2024-02-15T18:31:12.022 INFO:tasks.workunit.client.0.smithi033.stdout:0/846: rmdir d0/d8/d15/d2d/d41 39 2024-02-15T18:31:12.022 INFO:tasks.workunit.client.0.smithi033.stdout:0/847: chown d0/d64/c31 11427 1 2024-02-15T18:31:12.022 INFO:tasks.workunit.client.0.smithi033.stdout:2/931: dwrite d20/d31/d6a/f41 [0,4194304] 0 2024-02-15T18:31:12.023 INFO:tasks.workunit.client.0.smithi033.stdout:7/940: dwrite d0/dc/d10/d48/f6f [0,4194304] 0 2024-02-15T18:31:12.023 INFO:tasks.workunit.client.0.smithi033.stdout:7/941: stat d0/dc/d10/d1d/d38/d74/d7f 0 2024-02-15T18:31:12.023 INFO:tasks.workunit.client.0.smithi033.stdout:7/942: fdatasync d0/dc/d10/d7d/ff2 0 2024-02-15T18:31:12.023 INFO:tasks.workunit.client.0.smithi033.stdout:2/932: mknod d20/d3a/d4a/d5e/d6b/d88/c142 0 2024-02-15T18:31:12.023 INFO:tasks.workunit.client.0.smithi033.stdout:2/933: chown d20/d3a/d4a/d5e/d6b/d83/c138 804 1 2024-02-15T18:31:12.023 INFO:tasks.workunit.client.0.smithi033.stdout:2/934: stat d20/d31/d6a/f35 0 2024-02-15T18:31:12.025 INFO:tasks.workunit.client.0.smithi033.stdout:7/943: rmdir d0/dc/d10/d1d/d38/d74/de7/dfa/d142 39 2024-02-15T18:31:12.036 INFO:tasks.workunit.client.0.smithi033.stdout:2/935: dread d20/d31/d47/d4c/f102 [0,4194304] 0 2024-02-15T18:31:12.036 INFO:tasks.workunit.client.0.smithi033.stdout:7/944: dread d0/d56/d70/d83/f112 [0,4194304] 0 2024-02-15T18:31:12.036 INFO:tasks.workunit.client.0.smithi033.stdout:7/945: truncate d0/dc/d10/d1d/d38/fed 56114 0 2024-02-15T18:31:12.036 INFO:tasks.workunit.client.0.smithi033.stdout:7/946: dread - d0/dc/d10/d1d/d38/d74/de7/dfa/ffe zero size 2024-02-15T18:31:12.036 INFO:tasks.workunit.client.0.smithi033.stdout:7/947: chown d0/dc/d10/fca 1 1 2024-02-15T18:31:12.036 INFO:tasks.workunit.client.0.smithi033.stdout:7/948: dread - d0/dc/d10/d1d/d38/dd0/fe5 zero size 2024-02-15T18:31:12.036 INFO:tasks.workunit.client.0.smithi033.stdout:2/936: link d20/d31/d47/da4/f10f d20/d3a/d4a/d5e/d6b/d88/da6/f143 0 2024-02-15T18:31:12.036 INFO:tasks.workunit.client.0.smithi033.stdout:7/949: symlink d0/dc/d10/d1d/d38/d74/l147 0 2024-02-15T18:31:12.039 INFO:tasks.workunit.client.0.smithi033.stdout:7/950: creat d0/dc/d10/d1d/d38/d74/de7/dfa/f148 x:0 0 0 2024-02-15T18:31:12.039 INFO:tasks.workunit.client.0.smithi033.stdout:7/951: readlink d0/l1e 0 2024-02-15T18:31:12.040 INFO:tasks.workunit.client.0.smithi033.stdout:7/952: truncate d0/fa 1258770 0 2024-02-15T18:31:12.040 INFO:tasks.workunit.client.0.smithi033.stdout:7/953: read - d0/d56/d8e/f115 zero size 2024-02-15T18:31:12.041 INFO:tasks.workunit.client.0.smithi033.stdout:7/954: creat d0/dc/d10/d1d/d38/d74/de7/dfa/d142/d12f/f149 x:0 0 0 2024-02-15T18:31:12.048 INFO:tasks.workunit.client.0.smithi033.stdout:7/955: write d0/dc/d10/d1d/d2b/d5f/d63/f79 [772294,104475] 0 2024-02-15T18:31:12.048 INFO:tasks.workunit.client.0.smithi033.stdout:7/956: write d0/fa [1302738,25110] 0 2024-02-15T18:31:12.049 INFO:tasks.workunit.client.0.smithi033.stdout:2/937: dwrite d20/d31/d47/d4c/fd8 [0,4194304] 0 2024-02-15T18:31:12.049 INFO:tasks.workunit.client.0.smithi033.stdout:7/957: mkdir d0/dc/d10/d1d/d38/d74/de7/dfa/d14a 0 2024-02-15T18:31:12.051 INFO:tasks.workunit.client.0.smithi033.stdout:2/938: creat d20/d3a/d4a/d5e/d6b/d88/f144 x:0 0 0 2024-02-15T18:31:12.052 INFO:tasks.workunit.client.0.smithi033.stdout:7/958: dread d0/d56/d8e/fee [0,4194304] 0 2024-02-15T18:31:12.053 INFO:tasks.workunit.client.0.smithi033.stdout:7/959: symlink d0/d56/d128/l14b 0 2024-02-15T18:31:12.054 INFO:tasks.workunit.client.0.smithi033.stdout:7/960: symlink d0/dc/d10/da1/l14c 0 2024-02-15T18:31:12.077 INFO:tasks.workunit.client.0.smithi033.stdout:2/939: dwrite d20/d3a/d4a/d5e/d6b/fd0 [0,4194304] 0 2024-02-15T18:31:12.077 INFO:tasks.workunit.client.0.smithi033.stdout:7/961: dwrite d0/dc/d10/d48/f6f [0,4194304] 0 2024-02-15T18:31:12.079 INFO:tasks.workunit.client.0.smithi033.stdout:2/940: mkdir d20/de1/d145 0 2024-02-15T18:31:12.080 INFO:tasks.workunit.client.0.smithi033.stdout:7/962: symlink d0/dc/d10/d1d/d38/d74/de7/dfa/d14a/l14d 0 2024-02-15T18:31:12.085 INFO:tasks.workunit.client.0.smithi033.stdout:2/941: mkdir d20/d31/d47/da4/d146 0 2024-02-15T18:31:12.088 INFO:tasks.workunit.client.0.smithi033.stdout:2/942: rename d20/d3a/d4a/d5e/d11e to d20/d31/d47/d4c/dc4/d147 0 2024-02-15T18:31:12.090 INFO:tasks.workunit.client.0.smithi033.stdout:2/943: link d20/d31/d47/d64/fbf d20/d31/d47/d82/de6/f148 0 2024-02-15T18:31:12.092 INFO:tasks.workunit.client.0.smithi033.stdout:2/944: getdents d20/d3a/d4a/d5e/d6b/d88/da6 0 2024-02-15T18:31:12.095 INFO:tasks.workunit.client.0.smithi033.stdout:2/945: truncate d20/d31/d6a/f28 855537 0 2024-02-15T18:31:12.095 INFO:tasks.workunit.client.0.smithi033.stdout:2/946: write d20/d31/d47/d64/d110/f126 [803857,70908] 0 2024-02-15T18:31:12.096 INFO:tasks.workunit.client.0.smithi033.stdout:2/947: truncate d20/d31/d47/d82/fd3 5605330 0 2024-02-15T18:31:12.096 INFO:tasks.workunit.client.0.smithi033.stdout:2/948: dread - d20/d31/d47/d4c/dc4/d147/f11f zero size 2024-02-15T18:31:12.096 INFO:tasks.workunit.client.0.smithi033.stdout:2/949: mkdir d20/d39/d149 0 2024-02-15T18:31:12.096 INFO:tasks.workunit.client.0.smithi033.stdout:2/950: read d20/d31/d47/d82/de6/f148 [195072,112076] 0 2024-02-15T18:31:12.097 INFO:tasks.workunit.client.0.smithi033.stdout:2/951: fsync d20/d31/d47/d4c/def/d80/da0/fe8 0 2024-02-15T18:31:12.097 INFO:tasks.workunit.client.0.smithi033.stdout:2/952: fdatasync d20/d31/d6a/f26 0 2024-02-15T18:31:12.097 INFO:tasks.workunit.client.0.smithi033.stdout:7/963: dwrite d0/dc/d10/d1d/d38/daa/f135 [4194304,4194304] 0 2024-02-15T18:31:12.097 INFO:tasks.workunit.client.0.smithi033.stdout:2/953: read d20/d3a/d4a/d5e/f7d [2375242,33710] 0 2024-02-15T18:31:12.099 INFO:tasks.workunit.client.0.smithi033.stdout:2/954: symlink d20/d30/l14a 0 2024-02-15T18:31:12.099 INFO:tasks.workunit.client.0.smithi033.stdout:2/955: dread - d20/d31/d47/fce zero size 2024-02-15T18:31:12.103 INFO:tasks.workunit.client.0.smithi033.stdout:2/956: unlink d20/d31/lfb 0 2024-02-15T18:31:12.105 INFO:tasks.workunit.client.0.smithi033.stdout:2/957: mkdir d20/d14b 0 2024-02-15T18:31:12.106 INFO:tasks.workunit.client.0.smithi033.stdout:2/958: dread d20/d31/f37 [0,4194304] 0 2024-02-15T18:31:12.119 INFO:tasks.workunit.client.0.smithi033.stdout:2/959: dwrite d20/d31/d47/d82/ff5 [0,4194304] 0 2024-02-15T18:31:12.122 INFO:tasks.workunit.client.0.smithi033.stdout:2/960: creat d20/d3a/d4a/d5e/d10c/f14c x:0 0 0 2024-02-15T18:31:12.122 INFO:tasks.workunit.client.0.smithi033.stdout:2/961: write d20/de1/f11a [653954,11973] 0 2024-02-15T18:31:12.123 INFO:tasks.workunit.client.0.smithi033.stdout:2/962: truncate d20/d31/d6a/f9c 869484 0 2024-02-15T18:31:12.123 INFO:tasks.workunit.client.0.smithi033.stdout:2/963: readlink d20/d3a/dee/l122 0 2024-02-15T18:31:12.131 INFO:tasks.workunit.client.0.smithi033.stdout:2/964: dread d20/d30/fc1 [0,4194304] 0 2024-02-15T18:31:12.137 INFO:tasks.workunit.client.0.smithi033.stdout:2/965: dread d20/d3a/d4a/d5e/f76 [0,4194304] 0 2024-02-15T18:31:12.152 INFO:tasks.workunit.client.0.smithi033.stdout:2/966: dwrite d20/d31/d47/d4c/def/d80/da0/fe8 [0,4194304] 0 2024-02-15T18:31:12.152 INFO:tasks.workunit.client.0.smithi033.stdout:2/967: read d20/d31/f7c [3654363,32434] 0 2024-02-15T18:31:12.156 INFO:tasks.workunit.client.0.smithi033.stdout:2/968: link d20/d3a/d4a/d5e/d10c/f12f d20/d73/f14d 0 2024-02-15T18:31:12.162 INFO:tasks.workunit.client.0.smithi033.stdout:2/969: mkdir d20/d3a/d4a/d5e/d6b/d88/da6/d14e 0 2024-02-15T18:31:12.178 INFO:tasks.workunit.client.0.smithi033.stdout:9/805: sync 2024-02-15T18:31:12.178 INFO:tasks.workunit.client.0.smithi033.stdout:3/909: sync 2024-02-15T18:31:12.178 INFO:tasks.workunit.client.0.smithi033.stdout:3/910: readlink d2/d14/d23/d5c/lb6 0 2024-02-15T18:31:12.182 INFO:tasks.workunit.client.0.smithi033.stdout:2/970: dwrite d20/d73/fcb [0,4194304] 0 2024-02-15T18:31:12.182 INFO:tasks.workunit.client.0.smithi033.stdout:2/971: fsync d20/d3a/f5d 0 2024-02-15T18:31:12.187 INFO:tasks.workunit.client.0.smithi033.stdout:2/972: rmdir d20/de1/d145 0 2024-02-15T18:31:12.189 INFO:tasks.workunit.client.0.smithi033.stdout:2/973: creat d20/d30/f14f x:0 0 0 2024-02-15T18:31:12.191 INFO:tasks.workunit.client.0.smithi033.stdout:2/974: creat d20/d31/d47/d4c/def/d80/f150 x:0 0 0 2024-02-15T18:31:12.191 INFO:tasks.workunit.client.0.smithi033.stdout:3/911: dread d2/d3/d1e/d22/f57 [0,4194304] 0 2024-02-15T18:31:12.193 INFO:tasks.workunit.client.0.smithi033.stdout:2/975: creat d20/d31/dc8/f151 x:0 0 0 2024-02-15T18:31:12.193 INFO:tasks.workunit.client.0.smithi033.stdout:2/976: readlink d20/d31/d47/d82/de6/d106/l112 0 2024-02-15T18:31:12.193 INFO:tasks.workunit.client.0.smithi033.stdout:2/977: dread - d20/d3a/d4a/d5e/d6b/d88/f144 zero size 2024-02-15T18:31:12.194 INFO:tasks.workunit.client.0.smithi033.stdout:2/978: write d20/d3a/d4a/d5e/d6b/d88/f144 [731490,122415] 0 2024-02-15T18:31:12.198 INFO:tasks.workunit.client.0.smithi033.stdout:2/979: link d20/d31/d47/d82/de6/f148 d20/d3a/dee/f152 0 2024-02-15T18:31:12.207 INFO:tasks.workunit.client.0.smithi033.stdout:9/806: dwrite d4/d8/dd/d5c/f102 [0,4194304] 0 2024-02-15T18:31:12.208 INFO:tasks.workunit.client.0.smithi033.stdout:3/912: dread d2/d14/d23/d5c/fee [0,4194304] 0 2024-02-15T18:31:12.208 INFO:tasks.workunit.client.0.smithi033.stdout:3/913: stat d2/d14/d23/d5c/d7f/cd5 0 2024-02-15T18:31:12.208 INFO:tasks.workunit.client.0.smithi033.stdout:2/980: write d20/f4b [2572548,63975] 0 2024-02-15T18:31:12.211 INFO:tasks.workunit.client.0.smithi033.stdout:9/807: rmdir d4/d8/dd/df9/d108 0 2024-02-15T18:31:12.212 INFO:tasks.workunit.client.0.smithi033.stdout:2/981: creat d20/d31/d47/da4/f153 x:0 0 0 2024-02-15T18:31:12.213 INFO:tasks.workunit.client.0.smithi033.stdout:9/808: creat d4/d8/d1b/d2f/f113 x:0 0 0 2024-02-15T18:31:12.216 INFO:tasks.workunit.client.0.smithi033.stdout:0/848: sync 2024-02-15T18:31:12.216 INFO:tasks.workunit.client.0.smithi033.stdout:7/964: sync 2024-02-15T18:31:12.216 INFO:tasks.workunit.client.0.smithi033.stdout:4/959: sync 2024-02-15T18:31:12.216 INFO:tasks.workunit.client.0.smithi033.stdout:8/961: sync 2024-02-15T18:31:12.218 INFO:tasks.workunit.client.0.smithi033.stdout:8/962: read d0/df/d53/db3/d30/d8e/d14/d56/d59/f6c [235540,66306] 0 2024-02-15T18:31:12.218 INFO:tasks.workunit.client.0.smithi033.stdout:2/982: rename d20/d3a/d4a/l13c to d20/d31/d47/l154 0 2024-02-15T18:31:12.219 INFO:tasks.workunit.client.0.smithi033.stdout:2/983: chown d20/d39/c59 0 1 2024-02-15T18:31:12.225 INFO:tasks.workunit.client.0.smithi033.stdout:7/965: rename d0/dc/fe3 to d0/dc/d10/d7d/d93/f14e 0 2024-02-15T18:31:12.227 INFO:tasks.workunit.client.0.smithi033.stdout:4/960: unlink d4/d5/d28/d39/c63 0 2024-02-15T18:31:12.230 INFO:tasks.workunit.client.0.smithi033.stdout:7/966: unlink d0/d56/d70/d91/lc8 0 2024-02-15T18:31:12.230 INFO:tasks.workunit.client.0.smithi033.stdout:7/967: fsync d0/dc/d10/d48/d4b/fa9 0 2024-02-15T18:31:12.230 INFO:tasks.workunit.client.0.smithi033.stdout:7/968: write d0/dc/d10/d1d/d38/d74/d7f/fec [251045,95018] 0 2024-02-15T18:31:12.230 INFO:tasks.workunit.client.0.smithi033.stdout:3/914: dwrite d2/d3/d1e/d22/d4d/fe5 [0,4194304] 0 2024-02-15T18:31:12.230 INFO:tasks.workunit.client.0.smithi033.stdout:9/809: dread d4/d8/dd/f3d [0,4194304] 0 2024-02-15T18:31:12.231 INFO:tasks.workunit.client.0.smithi033.stdout:4/961: mknod d4/d20/d13/d5c/d87/dd0/c13d 0 2024-02-15T18:31:12.231 INFO:tasks.workunit.client.0.smithi033.stdout:4/962: truncate d4/d5/dc9/f12b 922041 0 2024-02-15T18:31:12.232 INFO:tasks.workunit.client.0.smithi033.stdout:2/984: dread d20/d3a/d4a/d5e/d6b/d88/fb3 [0,4194304] 0 2024-02-15T18:31:12.232 INFO:tasks.workunit.client.0.smithi033.stdout:2/985: fsync d20/d73/fcb 0 2024-02-15T18:31:12.233 INFO:tasks.workunit.client.0.smithi033.stdout:7/969: mknod d0/dc/d10/d1d/d2b/d5f/d63/c14f 0 2024-02-15T18:31:12.233 INFO:tasks.workunit.client.0.smithi033.stdout:3/915: rmdir d2/d3/df/d6c 39 2024-02-15T18:31:12.235 INFO:tasks.workunit.client.0.smithi033.stdout:4/963: read d4/d5/d28/d39/d62/d9c/fb7 [2088,81060] 0 2024-02-15T18:31:12.239 INFO:tasks.workunit.client.0.smithi033.stdout:7/970: dread d0/dc/d10/d7d/ff2 [0,4194304] 0 2024-02-15T18:31:12.239 INFO:tasks.workunit.client.0.smithi033.stdout:9/810: rename d4/d8/cdf to d4/d8/dd/d5c/d6d/dbc/c114 0 2024-02-15T18:31:12.240 INFO:tasks.workunit.client.0.smithi033.stdout:7/971: mkdir d0/dc/d10/d48/d109/d150 0 2024-02-15T18:31:12.240 INFO:tasks.workunit.client.0.smithi033.stdout:3/916: creat d2/d3/df/f118 x:0 0 0 2024-02-15T18:31:12.241 INFO:tasks.workunit.client.0.smithi033.stdout:3/917: fsync d2/d14/d23/f113 0 2024-02-15T18:31:12.241 INFO:tasks.workunit.client.0.smithi033.stdout:4/964: rename d4/d20/d13/d1b/d7c/l83 to d4/d5/d28/d39/d62/l13e 0 2024-02-15T18:31:12.241 INFO:tasks.workunit.client.0.smithi033.stdout:0/849: dwrite d0/de8/d97/db1/fe4 [0,4194304] 0 2024-02-15T18:31:12.241 INFO:tasks.workunit.client.0.smithi033.stdout:9/811: creat d4/d8/db6/f115 x:0 0 0 2024-02-15T18:31:12.241 INFO:tasks.workunit.client.0.smithi033.stdout:2/986: dread d20/d3a/f5d [0,4194304] 0 2024-02-15T18:31:12.242 INFO:tasks.workunit.client.0.smithi033.stdout:8/963: dwrite d0/df/d48/dbf/f10f [0,4194304] 0 2024-02-15T18:31:12.243 INFO:tasks.workunit.client.0.smithi033.stdout:7/972: creat d0/dc/d10/da1/d10f/f151 x:0 0 0 2024-02-15T18:31:12.243 INFO:tasks.workunit.client.0.smithi033.stdout:3/918: symlink d2/d3/df/d6c/l119 0 2024-02-15T18:31:12.243 INFO:tasks.workunit.client.0.smithi033.stdout:3/919: truncate d2/d3/d17/de6/feb 503576 0 2024-02-15T18:31:12.244 INFO:tasks.workunit.client.0.smithi033.stdout:4/965: symlink d4/d20/d13/d34/d82/l13f 0 2024-02-15T18:31:12.245 INFO:tasks.workunit.client.0.smithi033.stdout:4/966: write d4/d5/d28/d39/d62/d9c/d9e/da4/fdf [452178,3831] 0 2024-02-15T18:31:12.245 INFO:tasks.workunit.client.0.smithi033.stdout:4/967: truncate d4/d20/d13/d1b/d10f/f12c 1011205 0 2024-02-15T18:31:12.247 INFO:tasks.workunit.client.0.smithi033.stdout:9/812: rmdir d4/d2c 39 2024-02-15T18:31:12.248 INFO:tasks.workunit.client.0.smithi033.stdout:6/996: sync 2024-02-15T18:31:12.251 INFO:tasks.workunit.client.0.smithi033.stdout:2/987: unlink d20/d39/f10d 0 2024-02-15T18:31:12.266 INFO:tasks.workunit.client.0.smithi033.stdout:8/964: rename d0/df/d53/db3/d30/d8e/d35/d29/f73 to d0/df/d53/db3/d30/d8e/d8f/f135 0 2024-02-15T18:31:12.266 INFO:tasks.workunit.client.0.smithi033.stdout:8/965: dread - d0/df/d53/db3/d30/d8e/d35/d58/da1/fb6 zero size 2024-02-15T18:31:12.266 INFO:tasks.workunit.client.0.smithi033.stdout:7/973: creat d0/dc/d10/d1d/d38/d74/f152 x:0 0 0 2024-02-15T18:31:12.268 INFO:tasks.workunit.client.0.smithi033.stdout:3/920: link d2/f6d d2/d3/dcc/f11a 0 2024-02-15T18:31:12.269 INFO:tasks.workunit.client.0.smithi033.stdout:6/997: dwrite d8/d28/f18 [0,4194304] 0 2024-02-15T18:31:12.271 INFO:tasks.workunit.client.0.smithi033.stdout:4/968: symlink d4/d5/d28/d39/d62/dfa/l140 0 2024-02-15T18:31:12.273 INFO:tasks.workunit.client.0.smithi033.stdout:9/813: creat d4/d32/f116 x:0 0 0 2024-02-15T18:31:12.274 INFO:tasks.workunit.client.0.smithi033.stdout:9/814: stat d4/df2 0 2024-02-15T18:31:12.277 INFO:tasks.workunit.client.0.smithi033.stdout:8/966: creat d0/df/d53/db3/d30/d8e/d35/d29/d5f/da5/f136 x:0 0 0 2024-02-15T18:31:12.277 INFO:tasks.workunit.client.0.smithi033.stdout:8/967: chown d0/df/d53/db3/d30/d8e/d35/f64 3 1 2024-02-15T18:31:12.278 INFO:tasks.workunit.client.0.smithi033.stdout:3/921: readlink d2/d3/df/l4a 0 2024-02-15T18:31:12.282 INFO:tasks.workunit.client.0.smithi033.stdout:6/998: creat d8/f137 x:0 0 0 2024-02-15T18:31:12.286 INFO:tasks.workunit.client.0.smithi033.stdout:6/999: write d8/d28/d14/d2c/f4b [1678070,74774] 0 2024-02-15T18:31:12.287 INFO:tasks.workunit.client.0.smithi033.stdout:9/815: unlink d4/d2c/l3a 0 2024-02-15T18:31:12.287 INFO:tasks.workunit.client.0.smithi033.stdout:4/969: rename d4/d5/d28/d39/ce4 to d4/d20/d13/d5c/dd1/c141 0 2024-02-15T18:31:12.287 INFO:tasks.workunit.client.0.smithi033.stdout:7/974: dwrite d0/dc/d10/d7d/ff2 [0,4194304] 0 2024-02-15T18:31:12.291 INFO:tasks.workunit.client.0.smithi033.stdout:9/816: mkdir d4/d8/dd/d5c/d6d/dbc/d117 0 2024-02-15T18:31:12.294 INFO:tasks.workunit.client.0.smithi033.stdout:4/970: truncate d4/d20/ff 1102094 0 2024-02-15T18:31:12.298 INFO:tasks.workunit.client.0.smithi033.stdout:9/817: mkdir d4/d8/dd/d28/d6b/dd8/d118 0 2024-02-15T18:31:12.298 INFO:tasks.workunit.client.0.smithi033.stdout:9/818: getdents d4/d8/d1b/d2f/d65/d8b/d95 0 2024-02-15T18:31:12.298 INFO:tasks.workunit.client.0.smithi033.stdout:9/819: fsync d4/d8/d1b/d2f/df3/ff4 0 2024-02-15T18:31:12.298 INFO:tasks.workunit.client.0.smithi033.stdout:3/922: dwrite d2/d14/d23/d6f/d93/fc4 [0,4194304] 0 2024-02-15T18:31:12.301 INFO:tasks.workunit.client.0.smithi033.stdout:8/968: dwrite d0/df/d53/db3/d30/d8e/d14/d56/ff4 [0,4194304] 0 2024-02-15T18:31:12.301 INFO:tasks.workunit.client.0.smithi033.stdout:4/971: write d4/d5/d28/d39/f79 [3053636,98039] 0 2024-02-15T18:31:12.302 INFO:tasks.workunit.client.0.smithi033.stdout:3/923: unlink d2/d3/lc7 0 2024-02-15T18:31:12.302 INFO:tasks.workunit.client.0.smithi033.stdout:3/924: fdatasync d2/f6d 0 2024-02-15T18:31:12.302 INFO:tasks.workunit.client.0.smithi033.stdout:3/925: write d2/d14/fd4 [190020,462] 0 2024-02-15T18:31:12.304 INFO:tasks.workunit.client.0.smithi033.stdout:7/975: dread d0/dc/d10/da1/d10f/f118 [0,4194304] 0 2024-02-15T18:31:12.304 INFO:tasks.workunit.client.0.smithi033.stdout:7/976: fdatasync d0/dc/d10/d1d/fa7 0 2024-02-15T18:31:12.305 INFO:tasks.workunit.client.0.smithi033.stdout:9/820: dread d4/d8/dd/d28/f8f [0,4194304] 0 2024-02-15T18:31:12.305 INFO:tasks.workunit.client.0.smithi033.stdout:9/821: truncate d4/d8/dd/d41/f5d 1375141 0 2024-02-15T18:31:12.310 INFO:tasks.workunit.client.0.smithi033.stdout:8/969: rename d0/df/d53/db3/d30/d8e/d14/d56/db0/ldb to d0/df/db/d133/l137 0 2024-02-15T18:31:12.312 INFO:tasks.workunit.client.0.smithi033.stdout:4/972: creat d4/d5/f142 x:0 0 0 2024-02-15T18:31:12.319 INFO:tasks.workunit.client.0.smithi033.stdout:0/850: sync 2024-02-15T18:31:12.319 INFO:tasks.workunit.client.0.smithi033.stdout:0/851: getdents d0/de8/d8d/dec/da4/d102 0 2024-02-15T18:31:12.320 INFO:tasks.workunit.client.0.smithi033.stdout:0/852: write d0/de8/d8d/dec/d9e/dfb/f101 [528669,31594] 0 2024-02-15T18:31:12.320 INFO:tasks.workunit.client.0.smithi033.stdout:0/853: fdatasync d0/de8/d97/db1/f113 0 2024-02-15T18:31:12.320 INFO:tasks.workunit.client.0.smithi033.stdout:8/970: dread d0/df/d53/db3/d95/f11b [0,4194304] 0 2024-02-15T18:31:12.321 INFO:tasks.workunit.client.0.smithi033.stdout:0/854: mknod d0/d8/d15/d8b/da3/dae/d58/d80/dc1/c122 0 2024-02-15T18:31:12.322 INFO:tasks.workunit.client.0.smithi033.stdout:8/971: symlink d0/df/d53/db3/l138 0 2024-02-15T18:31:12.323 INFO:tasks.workunit.client.0.smithi033.stdout:8/972: symlink d0/df/d53/db3/d30/d8e/da7/db7/l139 0 2024-02-15T18:31:12.325 INFO:tasks.workunit.client.0.smithi033.stdout:8/973: symlink d0/df/db/d45/dc6/l13a 0 2024-02-15T18:31:12.335 INFO:tasks.workunit.client.0.smithi033.stdout:3/926: dwrite d2/d3/fdb [0,4194304] 0 2024-02-15T18:31:12.335 INFO:tasks.workunit.client.0.smithi033.stdout:7/977: dwrite d0/fd [4194304,4194304] 0 2024-02-15T18:31:12.338 INFO:tasks.workunit.client.0.smithi033.stdout:3/927: creat d2/d3/d17/de6/d73/d76/d10b/f11b x:0 0 0 2024-02-15T18:31:12.338 INFO:tasks.workunit.client.0.smithi033.stdout:3/928: write d2/d3/d1e/d22/d4d/f6b [4436705,76600] 0 2024-02-15T18:31:12.338 INFO:tasks.workunit.client.0.smithi033.stdout:3/929: stat d2/d3/d1e/d22/f57 0 2024-02-15T18:31:12.338 INFO:tasks.workunit.client.0.smithi033.stdout:7/978: getdents d0/d56 0 2024-02-15T18:31:12.339 INFO:tasks.workunit.client.0.smithi033.stdout:3/930: creat d2/d20/f11c x:0 0 0 2024-02-15T18:31:12.340 INFO:tasks.workunit.client.0.smithi033.stdout:8/974: dread d0/df/dd3/fe5 [0,4194304] 0 2024-02-15T18:31:12.340 INFO:tasks.workunit.client.0.smithi033.stdout:7/979: rename d0/dc/d10/d1d/d38/d74/de7/dfa/d14a/l14d to d0/dc/l153 0 2024-02-15T18:31:12.341 INFO:tasks.workunit.client.0.smithi033.stdout:3/931: truncate d2/d3/d1e/d22/d59/f5e 2860871 0 2024-02-15T18:31:12.341 INFO:tasks.workunit.client.0.smithi033.stdout:3/932: stat d2/d14/d23/d5c/f8e 0 2024-02-15T18:31:12.341 INFO:tasks.workunit.client.0.smithi033.stdout:7/980: write d0/dc/fd7 [3251212,96014] 0 2024-02-15T18:31:12.342 INFO:tasks.workunit.client.0.smithi033.stdout:8/975: mknod d0/df/db/d45/dc6/c13b 0 2024-02-15T18:31:12.342 INFO:tasks.workunit.client.0.smithi033.stdout:7/981: read d0/d56/fc1 [3634936,114562] 0 2024-02-15T18:31:12.343 INFO:tasks.workunit.client.0.smithi033.stdout:3/933: rmdir d2/d3/dcc 39 2024-02-15T18:31:12.345 INFO:tasks.workunit.client.0.smithi033.stdout:3/934: mknod d2/d3/d1e/d22/d4d/c11d 0 2024-02-15T18:31:12.347 INFO:tasks.workunit.client.0.smithi033.stdout:0/855: dwrite d0/d64/d1d/f21 [0,4194304] 0 2024-02-15T18:31:12.347 INFO:tasks.workunit.client.0.smithi033.stdout:0/856: getdents d0/d8/d15/d8b/da3/dae/d59/dd9 0 2024-02-15T18:31:12.350 INFO:tasks.workunit.client.0.smithi033.stdout:7/982: dread d0/f6a [0,4194304] 0 2024-02-15T18:31:12.350 INFO:tasks.workunit.client.0.smithi033.stdout:7/983: stat d0/dc/d10/d1d/l24 0 2024-02-15T18:31:12.353 INFO:tasks.workunit.client.0.smithi033.stdout:0/857: rename d0/de8/d8d/dec/da4/d102 to d0/d8/d15/d8b/da3/dae/d59/d11b/d123 0 2024-02-15T18:31:12.353 INFO:tasks.workunit.client.0.smithi033.stdout:0/858: chown d0/d8/d15 746 1 2024-02-15T18:31:12.353 INFO:tasks.workunit.client.0.smithi033.stdout:0/859: fsync d0/d8/d15/d8b/da3/d6c/f46 0 2024-02-15T18:31:12.353 INFO:tasks.workunit.client.0.smithi033.stdout:3/935: write d2/d14/d23/d6f/d93/fab [152920,9138] 0 2024-02-15T18:31:12.354 INFO:tasks.workunit.client.0.smithi033.stdout:7/984: truncate d0/dc/d10/d1d/d2b/d5f/f71 3431965 0 2024-02-15T18:31:12.359 INFO:tasks.workunit.client.0.smithi033.stdout:0/860: mknod d0/d8/d15/d2d/d41/d73/c124 0 2024-02-15T18:31:12.361 INFO:tasks.workunit.client.0.smithi033.stdout:3/936: link d2/d3/d1e/d22/d4d/f7b d2/d14/d23/d5c/f11e 0 2024-02-15T18:31:12.361 INFO:tasks.workunit.client.0.smithi033.stdout:8/976: dwrite d0/df/d53/db3/d95/fcc [4194304,4194304] 0 2024-02-15T18:31:12.362 INFO:tasks.workunit.client.0.smithi033.stdout:8/977: write d0/df/f19 [1903923,23673] 0 2024-02-15T18:31:12.364 INFO:tasks.workunit.client.0.smithi033.stdout:7/985: link d0/dc/d10/d1d/d38/d74/de7/dfa/d142/c126 d0/dc/d10/d1d/d2b/d5f/d63/c154 0 2024-02-15T18:31:12.365 INFO:tasks.workunit.client.0.smithi033.stdout:0/861: rename d0/d8/d15/d8b/da3/dae/d11e/fdb to d0/de8/d97/db1/dca/de0/f125 0 2024-02-15T18:31:12.369 INFO:tasks.workunit.client.0.smithi033.stdout:3/937: dread d2/d14/db3/dba/fc6 [0,4194304] 0 2024-02-15T18:31:12.369 INFO:tasks.workunit.client.0.smithi033.stdout:3/938: write d2/d14/d23/d5c/d7f/fd0 [121966,128808] 0 2024-02-15T18:31:12.369 INFO:tasks.workunit.client.0.smithi033.stdout:8/978: mkdir d0/df/d53/db3/d30/d8e/d35/d58/da1/d13c 0 2024-02-15T18:31:12.371 INFO:tasks.workunit.client.0.smithi033.stdout:7/986: rename d0/dc/d10/d7d/d93/dc2/l9d to d0/dc/d10/d1d/d38/d74/de7/dfa/d142/d108/d132/l155 0 2024-02-15T18:31:12.372 INFO:tasks.workunit.client.0.smithi033.stdout:3/939: stat d2/d3/d17/de6/d88/dd1/l115 0 2024-02-15T18:31:12.372 INFO:tasks.workunit.client.0.smithi033.stdout:3/940: read - d2/d3/fa4 zero size 2024-02-15T18:31:12.373 INFO:tasks.workunit.client.0.smithi033.stdout:0/862: dread d0/de8/d8d/dec/f89 [0,4194304] 0 2024-02-15T18:31:12.373 INFO:tasks.workunit.client.0.smithi033.stdout:8/979: mknod d0/df/d53/db3/d30/d8e/d35/d58/deb/c13d 0 2024-02-15T18:31:12.375 INFO:tasks.workunit.client.0.smithi033.stdout:7/987: creat d0/dc/d10/d1d/d38/f156 x:0 0 0 2024-02-15T18:31:12.380 INFO:tasks.workunit.client.0.smithi033.stdout:3/941: truncate d2/d14/d23/d6f/d93/fc4 2655155 0 2024-02-15T18:31:12.383 INFO:tasks.workunit.client.0.smithi033.stdout:0/863: symlink d0/d64/d88/l126 0 2024-02-15T18:31:12.383 INFO:tasks.workunit.client.0.smithi033.stdout:0/864: chown d0/fd 560 1 2024-02-15T18:31:12.386 INFO:tasks.workunit.client.0.smithi033.stdout:8/980: creat d0/df/d53/db3/d30/d8e/d8f/d4b/d72/d129/f13e x:0 0 0 2024-02-15T18:31:12.387 INFO:tasks.workunit.client.0.smithi033.stdout:7/988: symlink d0/dc/d10/d1d/d38/d74/de7/dfa/d14a/l157 0 2024-02-15T18:31:12.390 INFO:tasks.workunit.client.0.smithi033.stdout:0/865: write d0/d8/d15/d8b/da3/f8e [3638039,94944] 0 2024-02-15T18:31:12.390 INFO:tasks.workunit.client.0.smithi033.stdout:0/866: chown d0/d8/lf5 20 1 2024-02-15T18:31:12.390 INFO:tasks.workunit.client.0.smithi033.stdout:0/867: stat d0/d8/d15/d8b/da3/dae/d58/d80 0 2024-02-15T18:31:12.390 INFO:tasks.workunit.client.0.smithi033.stdout:0/868: truncate d0/d8/d15/d2d/d2e/f8f 939101 0 2024-02-15T18:31:12.390 INFO:tasks.workunit.client.0.smithi033.stdout:0/869: write d0/d8/d15/d2d/d41/d79/fc7 [1106918,58904] 0 2024-02-15T18:31:12.394 INFO:tasks.workunit.client.0.smithi033.stdout:8/981: creat d0/df/d53/db3/d30/d8e/d35/d58/da1/d13c/f13f x:0 0 0 2024-02-15T18:31:12.395 INFO:tasks.workunit.client.0.smithi033.stdout:8/982: chown d0/df/db/d45/dc6/df7 502 1 2024-02-15T18:31:12.396 INFO:tasks.workunit.client.0.smithi033.stdout:7/989: creat d0/dc/d10/d7d/f158 x:0 0 0 2024-02-15T18:31:12.396 INFO:tasks.workunit.client.0.smithi033.stdout:8/983: write d0/df/d53/db3/d30/d8e/d35/d29/f46 [1426906,126360] 0 2024-02-15T18:31:12.397 INFO:tasks.workunit.client.0.smithi033.stdout:8/984: stat d0/df/d53/db3/d30/d8e/d14/d56/db0/ff5 0 2024-02-15T18:31:12.397 INFO:tasks.workunit.client.0.smithi033.stdout:0/870: dread d0/d8/d15/d2d/d41/d79/d10a/fbb [0,4194304] 0 2024-02-15T18:31:12.399 INFO:tasks.workunit.client.0.smithi033.stdout:7/990: link d0/dc/d10/d48/ccb d0/dc/d10/d1d/d38/d74/de7/dfa/c159 0 2024-02-15T18:31:12.399 INFO:tasks.workunit.client.0.smithi033.stdout:7/991: dread - d0/dc/d10/d1d/d2b/d5f/d63/f13b zero size 2024-02-15T18:31:12.401 INFO:tasks.workunit.client.0.smithi033.stdout:3/942: dwrite d2/d14/d23/d5c/d7f/ff1 [0,4194304] 0 2024-02-15T18:31:12.401 INFO:tasks.workunit.client.0.smithi033.stdout:3/943: dread - d2/d3/d1e/d22/d4d/dcb/ff7 zero size 2024-02-15T18:31:12.401 INFO:tasks.workunit.client.0.smithi033.stdout:8/985: truncate d0/df/db/fde 3676051 0 2024-02-15T18:31:12.402 INFO:tasks.workunit.client.0.smithi033.stdout:0/871: getdents d0/de8/d97/db1/dca/de0 0 2024-02-15T18:31:12.402 INFO:tasks.workunit.client.0.smithi033.stdout:0/872: fsync d0/de8/d97/db1/f113 0 2024-02-15T18:31:12.403 INFO:tasks.workunit.client.0.smithi033.stdout:7/992: symlink d0/l15a 0 2024-02-15T18:31:12.403 INFO:tasks.workunit.client.0.smithi033.stdout:7/993: chown d0/dc/d10/d1d/fa7 17 1 2024-02-15T18:31:12.406 INFO:tasks.workunit.client.0.smithi033.stdout:3/944: mknod d2/d14/c11f 0 2024-02-15T18:31:12.412 INFO:tasks.workunit.client.0.smithi033.stdout:8/986: truncate d0/f94 7926892 0 2024-02-15T18:31:12.414 INFO:tasks.workunit.client.0.smithi033.stdout:0/873: getdents d0/de8/d8d/dec/d105 0 2024-02-15T18:31:12.415 INFO:tasks.workunit.client.0.smithi033.stdout:7/994: rename d0/dc/d10/d48/d4b to d0/dc/d10/d1d/d2b/d5f/d63/d15b 0 2024-02-15T18:31:12.416 INFO:tasks.workunit.client.0.smithi033.stdout:3/945: mknod d2/dfa/c120 0 2024-02-15T18:31:12.418 INFO:tasks.workunit.client.0.smithi033.stdout:8/987: mkdir d0/df/d53/db3/d30/d8e/d35/d58/d140 0 2024-02-15T18:31:12.419 INFO:tasks.workunit.client.0.smithi033.stdout:7/995: symlink d0/dc/d10/d1d/d38/d74/de7/dfa/d142/d108/d132/l15c 0 2024-02-15T18:31:12.424 INFO:tasks.workunit.client.0.smithi033.stdout:3/946: rename d2/d14/c70 to d2/d3/d17/de6/d73/d76/c121 0 2024-02-15T18:31:12.425 INFO:tasks.workunit.client.0.smithi033.stdout:8/988: mkdir d0/df/d53/db3/d30/d8e/d35/d58/d141 0 2024-02-15T18:31:12.425 INFO:tasks.workunit.client.0.smithi033.stdout:8/989: readlink d0/df/db/l15 0 2024-02-15T18:31:12.425 INFO:tasks.workunit.client.0.smithi033.stdout:8/990: chown d0/df/d53/db3/d30/d8e/da7/cbb 246304 1 2024-02-15T18:31:12.427 INFO:tasks.workunit.client.0.smithi033.stdout:3/947: unlink d2/d3/df/f7c 0 2024-02-15T18:31:12.428 INFO:tasks.workunit.client.0.smithi033.stdout:8/991: creat d0/df/d53/db3/d30/d8e/d35/f142 x:0 0 0 2024-02-15T18:31:12.429 INFO:tasks.workunit.client.0.smithi033.stdout:7/996: dread d0/dc/d10/d1d/d38/fed [0,4194304] 0 2024-02-15T18:31:12.429 INFO:tasks.workunit.client.0.smithi033.stdout:7/997: fdatasync d0/d56/d70/d83/f112 0 2024-02-15T18:31:12.430 INFO:tasks.workunit.client.0.smithi033.stdout:7/998: dread - d0/d56/f131 zero size 2024-02-15T18:31:12.430 INFO:tasks.workunit.client.0.smithi033.stdout:3/948: symlink d2/d3/d17/de6/l122 0 2024-02-15T18:31:12.431 INFO:tasks.workunit.client.0.smithi033.stdout:0/874: dwrite d0/d2/fb4 [0,4194304] 0 2024-02-15T18:31:12.431 INFO:tasks.workunit.client.0.smithi033.stdout:0/875: write d0/d8/d15/d8b/da3/dae/d11e/d100/f111 [42896,45806] 0 2024-02-15T18:31:12.431 INFO:tasks.workunit.client.0.smithi033.stdout:8/992: symlink d0/df/d48/dbf/l143 0 2024-02-15T18:31:12.432 INFO:tasks.workunit.client.0.smithi033.stdout:2/988: sync 2024-02-15T18:31:12.432 INFO:tasks.workunit.client.0.smithi033.stdout:2/989: truncate d20/d3a/d4a/d5e/fde 910884 0 2024-02-15T18:31:12.435 INFO:tasks.workunit.client.0.smithi033.stdout:0/876: link d0/f10 d0/d8/d15/d5b/d83/f127 0 2024-02-15T18:31:12.435 INFO:tasks.workunit.client.0.smithi033.stdout:0/877: readlink d0/d8/d15/l5e 0 2024-02-15T18:31:12.436 INFO:tasks.workunit.client.0.smithi033.stdout:3/949: truncate d2/d3/df/f8f 1743626 0 2024-02-15T18:31:12.442 INFO:tasks.workunit.client.0.smithi033.stdout:3/950: write d2/d3/d1e/d22/d59/f5e [2000546,55784] 0 2024-02-15T18:31:12.443 INFO:tasks.workunit.client.0.smithi033.stdout:3/951: truncate d2/d3/d1e/d22/d4d/f7b 1000320 0 2024-02-15T18:31:12.443 INFO:tasks.workunit.client.0.smithi033.stdout:7/999: dread d0/d56/d70/d83/fde [0,4194304] 0 2024-02-15T18:31:12.446 INFO:tasks.workunit.client.0.smithi033.stdout:3/952: creat d2/d3/d17/de6/d73/d76/d10b/f123 x:0 0 0 2024-02-15T18:31:12.447 INFO:tasks.workunit.client.0.smithi033.stdout:3/953: chown d2/d14/d23/d5c/d61/f63 11 1 2024-02-15T18:31:12.447 INFO:tasks.workunit.client.0.smithi033.stdout:3/954: stat d2/d14/d23/d5c/d61/l7d 0 2024-02-15T18:31:12.449 INFO:tasks.workunit.client.0.smithi033.stdout:2/990: dread d20/d31/d47/d4c/def/d80/fc2 [0,4194304] 0 2024-02-15T18:31:12.453 INFO:tasks.workunit.client.0.smithi033.stdout:8/993: dwrite d0/df/db/d45/f75 [0,4194304] 0 2024-02-15T18:31:12.454 INFO:tasks.workunit.client.0.smithi033.stdout:8/994: rmdir d0/df/d53/db3/d30 39 2024-02-15T18:31:12.455 INFO:tasks.workunit.client.0.smithi033.stdout:0/878: dwrite d0/de8/d8d/fc6 [0,4194304] 0 2024-02-15T18:31:12.455 INFO:tasks.workunit.client.0.smithi033.stdout:8/995: mkdir d0/df/d53/db3/d30/d8e/d35/d144 0 2024-02-15T18:31:12.455 INFO:tasks.workunit.client.0.smithi033.stdout:8/996: write d0/df/d53/db3/d30/f66 [1970323,97511] 0 2024-02-15T18:31:12.455 INFO:tasks.workunit.client.0.smithi033.stdout:8/997: fsync d0/df/d53/db3/d30/d8e/d14/d56/db0/fbd 0 2024-02-15T18:31:12.459 INFO:tasks.workunit.client.0.smithi033.stdout:2/991: dread d20/d3a/d4a/d5e/d6b/fc3 [0,4194304] 0 2024-02-15T18:31:12.466 INFO:tasks.workunit.client.0.smithi033.stdout:3/955: dwrite d2/d14/d23/d5c/f8e [0,4194304] 0 2024-02-15T18:31:12.511 INFO:tasks.workunit.client.0.smithi033.stdout:0/879: link d0/d8/d15/d8b/da3/f11c d0/de8/d97/f128 0 2024-02-15T18:31:12.511 INFO:tasks.workunit.client.0.smithi033.stdout:0/880: fdatasync d0/d8/d15/d2d/d2e/f76 0 2024-02-15T18:31:12.511 INFO:tasks.workunit.client.0.smithi033.stdout:0/881: chown d0/d8/d15/d8b/da3/dae/d59/fc2 41239 1 2024-02-15T18:31:12.512 INFO:tasks.workunit.client.0.smithi033.stdout:8/998: creat d0/df/d53/d9b/f145 x:0 0 0 2024-02-15T18:31:12.520 INFO:tasks.workunit.client.0.smithi033.stdout:2/992: rmdir d20 39 2024-02-15T18:31:12.520 INFO:tasks.workunit.client.0.smithi033.stdout:2/993: readlink d20/d31/d47/l154 0 2024-02-15T18:31:12.520 INFO:tasks.workunit.client.0.smithi033.stdout:2/994: write d20/d3a/dee/f152 [130362,93573] 0 2024-02-15T18:31:12.527 INFO:tasks.workunit.client.0.smithi033.stdout:8/999: mkdir d0/df/d53/db3/d30/d8e/d14/d56/db0/d112/d146 0 2024-02-15T18:31:12.529 INFO:tasks.workunit.client.0.smithi033.stdout:2/995: link d20/d31/f7c d20/d31/d47/d4c/def/f155 0 2024-02-15T18:31:12.531 INFO:tasks.workunit.client.0.smithi033.stdout:0/882: dwrite d0/d8/d15/d5b/fd8 [0,4194304] 0 2024-02-15T18:31:12.531 INFO:tasks.workunit.client.0.smithi033.stdout:0/883: write d0/d8/f39 [133901,130682] 0 2024-02-15T18:31:12.531 INFO:tasks.workunit.client.0.smithi033.stdout:0/884: write d0/d8/d15/d8b/da3/dae/d11e/d100/f111 [888892,96646] 0 2024-02-15T18:31:12.531 INFO:tasks.workunit.client.0.smithi033.stdout:0/885: read d0/d8/f39 [243351,111299] 0 2024-02-15T18:31:12.531 INFO:tasks.workunit.client.0.smithi033.stdout:2/996: creat d20/d73/f156 x:0 0 0 2024-02-15T18:31:12.533 INFO:tasks.workunit.client.0.smithi033.stdout:0/886: creat d0/d8/d11f/f129 x:0 0 0 2024-02-15T18:31:12.534 INFO:tasks.workunit.client.0.smithi033.stdout:2/997: mkdir d20/d31/dc8/d157 0 2024-02-15T18:31:12.534 INFO:tasks.workunit.client.0.smithi033.stdout:0/887: truncate d0/d8/d15/d2d/f8c 1606445 0 2024-02-15T18:31:12.535 INFO:tasks.workunit.client.0.smithi033.stdout:2/998: symlink d20/d31/d47/d4c/dc4/l158 0 2024-02-15T18:31:12.535 INFO:tasks.workunit.client.0.smithi033.stdout:2/999: write f19 [4279263,78412] 0 2024-02-15T18:31:12.536 INFO:tasks.workunit.client.0.smithi033.stdout:0/888: mknod d0/d8/d15/d2d/d41/d73/c12a 0 2024-02-15T18:31:12.537 INFO:tasks.workunit.client.0.smithi033.stdout:0/889: creat d0/d8/d15/d8b/da3/dfd/f12b x:0 0 0 2024-02-15T18:31:12.541 INFO:tasks.workunit.client.0.smithi033.stdout:0/890: rmdir d0/d8/d54 39 2024-02-15T18:31:12.546 INFO:tasks.workunit.client.0.smithi033.stdout:3/956: dwrite d2/d3/df/d6c/f91 [0,4194304] 0 2024-02-15T18:31:12.567 INFO:tasks.workunit.client.0.smithi033.stdout:3/957: dwrite d2/d3/d1e/d22/d4d/fad [0,4194304] 0 2024-02-15T18:31:12.570 INFO:tasks.workunit.client.0.smithi033.stdout:0/891: dwrite d0/fad [0,4194304] 0 2024-02-15T18:31:12.571 INFO:tasks.workunit.client.0.smithi033.stdout:0/892: truncate d0/d2/f82 512180 0 2024-02-15T18:31:12.571 INFO:tasks.workunit.client.0.smithi033.stdout:0/893: truncate d0/d8/d15/d8b/da3/dae/d58/d80/dc1/fc3 512554 0 2024-02-15T18:31:12.578 INFO:tasks.workunit.client.0.smithi033.stdout:3/958: dread d2/d14/d23/d6f/d93/fc4 [0,4194304] 0 2024-02-15T18:31:12.579 INFO:tasks.workunit.client.0.smithi033.stdout:3/959: mkdir d2/d3/d17/de6/d73/d83/d124 0 2024-02-15T18:31:12.579 INFO:tasks.workunit.client.0.smithi033.stdout:3/960: truncate d2/f4 3332131 0 2024-02-15T18:31:12.594 INFO:tasks.workunit.client.0.smithi033.stdout:0/894: dwrite d0/de8/d97/db1/dca/de0/f125 [0,4194304] 0 2024-02-15T18:31:12.595 INFO:tasks.workunit.client.0.smithi033.stdout:0/895: dread - d0/d8/d15/d8b/da3/dfd/f12b zero size 2024-02-15T18:31:12.595 INFO:tasks.workunit.client.0.smithi033.stdout:0/896: write d0/d8/d15/d8b/da3/d6c/ff2 [4784948,87295] 0 2024-02-15T18:31:12.595 INFO:tasks.workunit.client.0.smithi033.stdout:0/897: creat d0/d8/d15/d2d/d41/d79/d10a/f12c x:0 0 0 2024-02-15T18:31:12.596 INFO:tasks.workunit.client.0.smithi033.stdout:0/898: truncate d0/d64/d1d/f43 2144366 0 2024-02-15T18:31:12.603 INFO:tasks.workunit.client.0.smithi033.stdout:0/899: dread d0/d64/ff [0,4194304] 0 2024-02-15T18:31:12.603 INFO:tasks.workunit.client.0.smithi033.stdout:0/900: truncate d0/d8/d15/d2d/d41/d79/d10a/f12c 629427 0 2024-02-15T18:31:12.610 INFO:tasks.workunit.client.0.smithi033.stdout:0/901: dread d0/d8/faa [0,4194304] 0 2024-02-15T18:31:12.612 INFO:tasks.workunit.client.0.smithi033.stdout:0/902: dread d0/de8/d97/db1/f113 [0,4194304] 0 2024-02-15T18:31:12.613 INFO:tasks.workunit.client.0.smithi033.stdout:0/903: unlink d0/de8/d8d/dec/da4/l6d 0 2024-02-15T18:31:12.614 INFO:tasks.workunit.client.0.smithi033.stdout:0/904: creat d0/d8/d15/d8b/da3/dae/f12d x:0 0 0 2024-02-15T18:31:12.615 INFO:tasks.workunit.client.0.smithi033.stdout:0/905: creat d0/d8/d15/d2d/d41/f12e x:0 0 0 2024-02-15T18:31:12.616 INFO:tasks.workunit.client.0.smithi033.stdout:0/906: mkdir d0/d8/d15/d2d/d41/d79/d10a/d12f 0 2024-02-15T18:31:12.617 INFO:tasks.workunit.client.0.smithi033.stdout:0/907: write d0/fad [6166553,115430] 0 2024-02-15T18:31:12.624 INFO:tasks.workunit.client.0.smithi033.stdout:0/908: dread d0/d8/d15/d2d/d41/d79/fc7 [0,4194304] 0 2024-02-15T18:31:12.625 INFO:tasks.workunit.client.0.smithi033.stdout:0/909: link d0/d8/d15/d8b/da3/f108 d0/d8/d15/d2d/d41/d73/f130 0 2024-02-15T18:31:12.626 INFO:tasks.workunit.client.0.smithi033.stdout:0/910: fdatasync d0/d8/f39 0 2024-02-15T18:31:12.643 INFO:tasks.workunit.client.0.smithi033.stdout:9/822: sync 2024-02-15T18:31:12.643 INFO:tasks.workunit.client.0.smithi033.stdout:4/973: sync 2024-02-15T18:31:12.644 INFO:tasks.workunit.client.0.smithi033.stdout:0/911: dwrite d0/d2/f3 [8388608,4194304] 0 2024-02-15T18:31:12.644 INFO:tasks.workunit.client.0.smithi033.stdout:0/912: chown d0/d8/d15/d2d/d41/d73/d96 9862 1 2024-02-15T18:31:12.650 INFO:tasks.workunit.client.0.smithi033.stdout:9/823: symlink d4/l119 0 2024-02-15T18:31:12.650 INFO:tasks.workunit.client.0.smithi033.stdout:0/913: rename d0/d8/d15/d2d/d41/d73/ldc to d0/d8/d15/d8b/da3/dae/d58/de2/df0/d121/l131 0 2024-02-15T18:31:12.650 INFO:tasks.workunit.client.0.smithi033.stdout:9/824: truncate d4/d8/dd/d5c/d6d/dbc/ffd 112437 0 2024-02-15T18:31:12.651 INFO:tasks.workunit.client.0.smithi033.stdout:0/914: symlink d0/d8/d15/d8b/da3/dae/d59/l132 0 2024-02-15T18:31:12.652 INFO:tasks.workunit.client.0.smithi033.stdout:0/915: symlink d0/d8/d15/d8b/da3/dae/d58/d77/l133 0 2024-02-15T18:31:12.652 INFO:tasks.workunit.client.0.smithi033.stdout:0/916: dread - d0/d2/f117 zero size 2024-02-15T18:31:12.652 INFO:tasks.workunit.client.0.smithi033.stdout:0/917: fdatasync d0/de8/d97/fbe 0 2024-02-15T18:31:12.653 INFO:tasks.workunit.client.0.smithi033.stdout:0/918: creat d0/d8/d15/d2d/f134 x:0 0 0 2024-02-15T18:31:12.674 INFO:tasks.workunit.client.0.smithi033.stdout:9/825: dwrite d4/d8/d1b/d2f/df3/ff4 [4194304,4194304] 0 2024-02-15T18:31:12.674 INFO:tasks.workunit.client.0.smithi033.stdout:0/919: dwrite d0/d8/fb [0,4194304] 0 2024-02-15T18:31:12.674 INFO:tasks.workunit.client.0.smithi033.stdout:0/920: chown d0/d8/d15/d2d/d41/d79/d10a/l107 489 1 2024-02-15T18:31:12.675 INFO:tasks.workunit.client.0.smithi033.stdout:9/826: write f0 [2905238,28811] 0 2024-02-15T18:31:12.676 INFO:tasks.workunit.client.0.smithi033.stdout:0/921: symlink d0/d8/d15/d8b/da3/dae/d59/dd9/l135 0 2024-02-15T18:31:12.676 INFO:tasks.workunit.client.0.smithi033.stdout:9/827: dread d4/d8/dd/d28/fd2 [0,4194304] 0 2024-02-15T18:31:12.677 INFO:tasks.workunit.client.0.smithi033.stdout:0/922: symlink d0/d8/d15/d2d/d2e/l136 0 2024-02-15T18:31:12.677 INFO:tasks.workunit.client.0.smithi033.stdout:0/923: fdatasync d0/d8/d15/d2d/f57 0 2024-02-15T18:31:12.677 INFO:tasks.workunit.client.0.smithi033.stdout:0/924: mkdir d0/d2/d137 0 2024-02-15T18:31:12.679 INFO:tasks.workunit.client.0.smithi033.stdout:0/925: rename d0/d8/d15/d2d/d41/c52 to d0/d64/d1d/c138 0 2024-02-15T18:31:12.679 INFO:tasks.workunit.client.0.smithi033.stdout:0/926: getdents d0/d8/d15/d9f 0 2024-02-15T18:31:12.682 INFO:tasks.workunit.client.0.smithi033.stdout:0/927: creat d0/de8/d8d/dec/da4/f139 x:0 0 0 2024-02-15T18:31:12.683 INFO:tasks.workunit.client.0.smithi033.stdout:0/928: fsync d0/f10 0 2024-02-15T18:31:12.689 INFO:tasks.workunit.client.0.smithi033.stdout:9/828: dwrite d4/d8/d1b/d73/fd0 [0,4194304] 0 2024-02-15T18:31:12.701 INFO:tasks.workunit.client.0.smithi033.stdout:0/929: dwrite d0/d8/d15/d8b/da3/dae/d58/d77/fbc [0,4194304] 0 2024-02-15T18:31:12.701 INFO:tasks.workunit.client.0.smithi033.stdout:0/930: write d0/d8/d15/d8b/da3/dae/d58/d80/fa6 [4683248,83085] 0 2024-02-15T18:31:12.701 INFO:tasks.workunit.client.0.smithi033.stdout:0/931: chown d0/d8/d15/d2d/d41/d73 132473 1 2024-02-15T18:31:12.702 INFO:tasks.workunit.client.0.smithi033.stdout:0/932: truncate d0/d8/d15/d8b/da3/dae/f71 5241496 0 2024-02-15T18:31:12.702 INFO:tasks.workunit.client.0.smithi033.stdout:0/933: stat d0/d8/d15/d8b/da3/dae/d58/de2 0 2024-02-15T18:31:12.703 INFO:tasks.workunit.client.0.smithi033.stdout:0/934: mkdir d0/d8/d15/d13a 0 2024-02-15T18:31:12.714 INFO:tasks.workunit.client.0.smithi033.stdout:9/829: dwrite d4/d8/dd/d5c/f68 [4194304,4194304] 0 2024-02-15T18:31:12.714 INFO:tasks.workunit.client.0.smithi033.stdout:9/830: write d4/d2c/db1/ddb/de9/f107 [488149,98910] 0 2024-02-15T18:31:12.715 INFO:tasks.workunit.client.0.smithi033.stdout:9/831: creat d4/d8/dd/d5c/d6d/d97/f11a x:0 0 0 2024-02-15T18:31:12.716 INFO:tasks.workunit.client.0.smithi033.stdout:9/832: creat d4/d8/d1b/d2f/d65/d8b/f11b x:0 0 0 2024-02-15T18:31:12.717 INFO:tasks.workunit.client.0.smithi033.stdout:9/833: read d4/d8/dd/d28/f83 [680697,8465] 0 2024-02-15T18:31:12.721 INFO:tasks.workunit.client.0.smithi033.stdout:0/935: dwrite d0/d8/d15/df9/f110 [0,4194304] 0 2024-02-15T18:31:12.723 INFO:tasks.workunit.client.0.smithi033.stdout:9/834: dread d4/d8/dd/d41/d51/f80 [0,4194304] 0 2024-02-15T18:31:12.725 INFO:tasks.workunit.client.0.smithi033.stdout:9/835: rename d4/d8/dd/d41 to d4/d8/dd/d5c/d6d/dbc/d117/d11c 0 2024-02-15T18:31:12.725 INFO:tasks.workunit.client.0.smithi033.stdout:9/836: truncate d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/f52 4053966 0 2024-02-15T18:31:12.725 INFO:tasks.workunit.client.0.smithi033.stdout:9/837: chown d4/d8/ld4 536 1 2024-02-15T18:31:12.726 INFO:tasks.workunit.client.0.smithi033.stdout:9/838: mknod d4/d8/d1b/d2f/d65/c11d 0 2024-02-15T18:31:12.733 INFO:tasks.workunit.client.0.smithi033.stdout:0/936: dread d0/de8/d8d/dec/da4/f69 [0,4194304] 0 2024-02-15T18:31:12.733 INFO:tasks.workunit.client.0.smithi033.stdout:0/937: chown d0/d8/d15/d8b/da3/dae/d58/de2 0 1 2024-02-15T18:31:12.733 INFO:tasks.workunit.client.0.smithi033.stdout:0/938: stat d0/d8/d15/d8b/da3/dfd/c115 0 2024-02-15T18:31:12.733 INFO:tasks.workunit.client.0.smithi033.stdout:0/939: chown d0/de8/d97/db1/fe4 2153 1 2024-02-15T18:31:12.736 INFO:tasks.workunit.client.0.smithi033.stdout:0/940: symlink d0/d8/d15/d8b/da3/dfd/l13b 0 2024-02-15T18:31:12.744 INFO:tasks.workunit.client.0.smithi033.stdout:9/839: dwrite d4/d8/dd/d5c/f9b [0,4194304] 0 2024-02-15T18:31:12.746 INFO:tasks.workunit.client.0.smithi033.stdout:9/840: rename d4/d8/d1b/d2f/d65/d8b/d95/fa6 to d4/d2c/db1/ddb/f11e 0 2024-02-15T18:31:12.753 INFO:tasks.workunit.client.0.smithi033.stdout:0/941: dwrite d0/d8/d15/d8b/da3/dae/d58/f61 [0,4194304] 0 2024-02-15T18:31:12.753 INFO:tasks.workunit.client.0.smithi033.stdout:0/942: chown d0/d64/c31 3416564 1 2024-02-15T18:31:12.755 INFO:tasks.workunit.client.0.smithi033.stdout:0/943: creat d0/de8/f13c x:0 0 0 2024-02-15T18:31:12.756 INFO:tasks.workunit.client.0.smithi033.stdout:0/944: link d0/d8/d15/d8b/da3/dae/f12d d0/d8/d15/d8b/da3/dae/d58/de2/df0/d121/f13d 0 2024-02-15T18:31:12.756 INFO:tasks.workunit.client.0.smithi033.stdout:0/945: chown d0/d8/d15/d8b/da3/dae/d59/fcb 30 1 2024-02-15T18:31:12.756 INFO:tasks.workunit.client.0.smithi033.stdout:0/946: fsync d0/d8/d15/d2d/d41/d73/f93 0 2024-02-15T18:31:12.756 INFO:tasks.workunit.client.0.smithi033.stdout:9/841: dread d4/d8/d1b/d73/f8e [0,4194304] 0 2024-02-15T18:31:12.757 INFO:tasks.workunit.client.0.smithi033.stdout:9/842: creat d4/d8/dd/d28/d6b/dd8/f11f x:0 0 0 2024-02-15T18:31:12.759 INFO:tasks.workunit.client.0.smithi033.stdout:9/843: rename d4/d8/d1b/d2f/df3/ff4 to d4/d8/d1b/d2f/df3/f120 0 2024-02-15T18:31:12.773 INFO:tasks.workunit.client.0.smithi033.stdout:9/844: dwrite f0 [0,4194304] 0 2024-02-15T18:31:12.777 INFO:tasks.workunit.client.0.smithi033.stdout:9/845: write d4/d8/d1b/d2f/df3/f120 [5467565,22400] 0 2024-02-15T18:31:12.794 INFO:tasks.workunit.client.0.smithi033.stdout:9/846: dwrite d4/d8/d1b/d2f/d65/d8b/f11b [0,4194304] 0 2024-02-15T18:31:12.795 INFO:tasks.workunit.client.0.smithi033.stdout:9/847: dread d4/d8/d1b/d73/f8e [4194304,4194304] 0 2024-02-15T18:31:12.795 INFO:tasks.workunit.client.0.smithi033.stdout:9/848: dread d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/f89 [0,4194304] 0 2024-02-15T18:31:12.795 INFO:tasks.workunit.client.0.smithi033.stdout:9/849: write d4/d32/f116 [962589,92144] 0 2024-02-15T18:31:12.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:10.961101+0000 mgr.smithi131.buibla (mgr.24387) 28 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:12.808 INFO:tasks.workunit.client.0.smithi033.stdout:9/850: dwrite d4/d8/f100 [0,4194304] 0 2024-02-15T18:31:12.809 INFO:tasks.workunit.client.0.smithi033.stdout:9/851: write d4/d8/dd/d28/f4c [1643917,115004] 0 2024-02-15T18:31:12.821 INFO:tasks.workunit.client.0.smithi033.stdout:3/961: sync 2024-02-15T18:31:12.821 INFO:tasks.workunit.client.0.smithi033.stdout:4/974: sync 2024-02-15T18:31:12.821 INFO:tasks.workunit.client.0.smithi033.stdout:0/947: sync 2024-02-15T18:31:12.822 INFO:tasks.workunit.client.0.smithi033.stdout:4/975: truncate d4/d5/f55 6871623 0 2024-02-15T18:31:12.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/948: mknod d0/d8/d15/d8b/da3/dae/d58/de2/df0/d121/c13e 0 2024-02-15T18:31:12.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/949: truncate d0/de8/d97/f106 857846 0 2024-02-15T18:31:12.823 INFO:tasks.workunit.client.0.smithi033.stdout:0/950: dread - d0/d8/d15/d8b/da3/d6c/ffe zero size 2024-02-15T18:31:12.825 INFO:tasks.workunit.client.0.smithi033.stdout:0/951: mknod d0/d8/d15/d2d/d41/d73/d96/c13f 0 2024-02-15T18:31:12.827 INFO:tasks.workunit.client.0.smithi033.stdout:0/952: symlink d0/d8/d15/df9/l140 0 2024-02-15T18:31:12.863 INFO:tasks.workunit.client.0.smithi033.stdout:4/976: dwrite d4/d5/d28/d39/d62/d9c/d9e/da4/db1/ff3 [0,4194304] 0 2024-02-15T18:31:12.864 INFO:tasks.workunit.client.0.smithi033.stdout:0/953: dwrite d0/d8/d15/d8b/da3/dae/f71 [4194304,4194304] 0 2024-02-15T18:31:12.864 INFO:tasks.workunit.client.0.smithi033.stdout:0/954: chown d0/de8/d97/db1/dca/de0 409 1 2024-02-15T18:31:12.864 INFO:tasks.workunit.client.0.smithi033.stdout:3/962: dwrite d2/d3/d1e/d22/fa7 [0,4194304] 0 2024-02-15T18:31:12.866 INFO:tasks.workunit.client.0.smithi033.stdout:4/977: symlink d4/d5/dc9/dd3/l143 0 2024-02-15T18:31:12.884 INFO:tasks.workunit.client.0.smithi033.stdout:0/955: dwrite d0/de8/d8d/dec/da4/f139 [0,4194304] 0 2024-02-15T18:31:12.884 INFO:tasks.workunit.client.0.smithi033.stdout:4/978: dwrite d4/d20/d13/d1b/d10f/f122 [0,4194304] 0 2024-02-15T18:31:12.910 INFO:tasks.workunit.client.0.smithi033.stdout:4/979: dwrite d4/d20/f131 [0,4194304] 0 2024-02-15T18:31:12.911 INFO:tasks.workunit.client.0.smithi033.stdout:4/980: truncate d4/d20/d37/f42 305881 0 2024-02-15T18:31:12.912 INFO:tasks.workunit.client.0.smithi033.stdout:4/981: link d4/d5/c90 d4/d5/dc9/c144 0 2024-02-15T18:31:12.913 INFO:tasks.workunit.client.0.smithi033.stdout:4/982: dread - d4/d20/d13/d5c/d87/dd0/f129 zero size 2024-02-15T18:31:12.937 INFO:tasks.workunit.client.0.smithi033.stdout:4/983: dwrite d4/d20/d13/fa3 [0,4194304] 0 2024-02-15T18:31:12.937 INFO:tasks.workunit.client.0.smithi033.stdout:4/984: readlink d4/d20/d13/d34/d82/l13f 0 2024-02-15T18:31:12.940 INFO:tasks.workunit.client.0.smithi033.stdout:4/985: mkdir d4/d3c/d145 0 2024-02-15T18:31:12.942 INFO:tasks.workunit.client.0.smithi033.stdout:4/986: rmdir d4/d20/d13/d34/d82/df5/d12a 39 2024-02-15T18:31:12.943 INFO:tasks.workunit.client.0.smithi033.stdout:4/987: write d4/d5/d28/d39/d62/d9c/d9e/da4/fd6 [1005734,112875] 0 2024-02-15T18:31:12.943 INFO:tasks.workunit.client.0.smithi033.stdout:4/988: fdatasync d4/d5/d28/d39/d62/f98 0 2024-02-15T18:31:12.944 INFO:tasks.workunit.client.0.smithi033.stdout:4/989: rmdir d4/d5/d28/d39/d62/d9c/d9e 39 2024-02-15T18:31:12.946 INFO:tasks.workunit.client.0.smithi033.stdout:4/990: dread d4/d5/d28/d39/d62/d9c/d9e/f110 [0,4194304] 0 2024-02-15T18:31:12.947 INFO:tasks.workunit.client.0.smithi033.stdout:4/991: chown d4/d20/d13/d34/f7b 3 1 2024-02-15T18:31:12.947 INFO:tasks.workunit.client.0.smithi033.stdout:4/992: chown d4/d5/f55 3987010 1 2024-02-15T18:31:12.947 INFO:tasks.workunit.client.0.smithi033.stdout:4/993: chown d4/d20/d13/d5c/d87/f105 1618 1 2024-02-15T18:31:12.947 INFO:tasks.workunit.client.0.smithi033.stdout:4/994: symlink d4/d20/d13/dca/l146 0 2024-02-15T18:31:12.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/995: link d4/d20/d53/lcf d4/d20/d13/d5c/d87/l147 0 2024-02-15T18:31:12.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/996: write d4/d20/d13/d5c/dd1/f10a [1035162,130483] 0 2024-02-15T18:31:12.949 INFO:tasks.workunit.client.0.smithi033.stdout:4/997: truncate d4/d5/f142 849294 0 2024-02-15T18:31:12.950 INFO:tasks.workunit.client.0.smithi033.stdout:4/998: dread d4/d20/d13/d1b/d81/d9f/fcb [0,4194304] 0 2024-02-15T18:31:12.956 INFO:tasks.workunit.client.0.smithi033.stdout:4/999: dread d4/d20/d37/f8e [0,4194304] 0 2024-02-15T18:31:12.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:10.961101+0000 mgr.smithi131.buibla (mgr.24387) 28 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:13.028 INFO:tasks.workunit.client.0.smithi033.stdout:9/852: sync 2024-02-15T18:31:13.029 INFO:tasks.workunit.client.0.smithi033.stdout:9/853: mknod d4/d8/d1b/d2f/dd7/c121 0 2024-02-15T18:31:13.029 INFO:tasks.workunit.client.0.smithi033.stdout:9/854: write d4/d8/d1b/d2f/d65/d8b/d95/fb3 [1068891,43826] 0 2024-02-15T18:31:13.030 INFO:tasks.workunit.client.0.smithi033.stdout:9/855: creat d4/d8/dd/d5c/d6d/d97/f122 x:0 0 0 2024-02-15T18:31:13.076 INFO:tasks.workunit.client.0.smithi033.stdout:3/963: sync 2024-02-15T18:31:13.076 INFO:tasks.workunit.client.0.smithi033.stdout:0/956: sync 2024-02-15T18:31:13.076 INFO:tasks.workunit.client.0.smithi033.stdout:0/957: stat d0/d8/d15/f17 0 2024-02-15T18:31:13.077 INFO:tasks.workunit.client.0.smithi033.stdout:0/958: mkdir d0/d8/d15/d8b/da3/dae/d58/d77/d141 0 2024-02-15T18:31:13.078 INFO:tasks.workunit.client.0.smithi033.stdout:0/959: fdatasync d0/d64/d88/ff6 0 2024-02-15T18:31:13.078 INFO:tasks.workunit.client.0.smithi033.stdout:0/960: read - d0/de8/f13c zero size 2024-02-15T18:31:13.078 INFO:tasks.workunit.client.0.smithi033.stdout:3/964: mkdir d2/d14/d23/d5c/d7f/de7/d112/d125 0 2024-02-15T18:31:13.079 INFO:tasks.workunit.client.0.smithi033.stdout:3/965: creat d2/d20/f126 x:0 0 0 2024-02-15T18:31:13.079 INFO:tasks.workunit.client.0.smithi033.stdout:3/966: write d2/d3/df/f7a [921924,102638] 0 2024-02-15T18:31:13.080 INFO:tasks.workunit.client.0.smithi033.stdout:3/967: mknod d2/d3/d17/de6/d73/d83/d124/c127 0 2024-02-15T18:31:13.080 INFO:tasks.workunit.client.0.smithi033.stdout:3/968: write d2/f4 [3380691,61168] 0 2024-02-15T18:31:13.081 INFO:tasks.workunit.client.0.smithi033.stdout:3/969: rmdir d2/d3/d1e/d22 39 2024-02-15T18:31:13.083 INFO:tasks.workunit.client.0.smithi033.stdout:3/970: rename d2/d14/d23/d6f/d93/f10c to d2/d3/d17/de6/d88/f128 0 2024-02-15T18:31:13.084 INFO:tasks.workunit.client.0.smithi033.stdout:3/971: write d2/fa [1286207,15474] 0 2024-02-15T18:31:13.084 INFO:tasks.workunit.client.0.smithi033.stdout:3/972: chown d2/d3/c46 9296 1 2024-02-15T18:31:13.084 INFO:tasks.workunit.client.0.smithi033.stdout:3/973: rmdir d2/d14/d23/d5c/d7f/de7/d112 39 2024-02-15T18:31:13.085 INFO:tasks.workunit.client.0.smithi033.stdout:3/974: chown d2/d3/df/l52 11345464 1 2024-02-15T18:31:13.085 INFO:tasks.workunit.client.0.smithi033.stdout:3/975: fsync d2/d3/d17/f69 0 2024-02-15T18:31:13.085 INFO:tasks.workunit.client.0.smithi033.stdout:3/976: rmdir d2/d14/db3 39 2024-02-15T18:31:13.086 INFO:tasks.workunit.client.0.smithi033.stdout:0/961: dread d0/d2/fb4 [0,4194304] 0 2024-02-15T18:31:13.086 INFO:tasks.workunit.client.0.smithi033.stdout:3/977: creat d2/d14/d23/d5c/d61/de2/f129 x:0 0 0 2024-02-15T18:31:13.086 INFO:tasks.workunit.client.0.smithi033.stdout:3/978: write d2/d3/d17/de6/fde [566132,44330] 0 2024-02-15T18:31:13.087 INFO:tasks.workunit.client.0.smithi033.stdout:0/962: creat d0/d64/f142 x:0 0 0 2024-02-15T18:31:13.089 INFO:tasks.workunit.client.0.smithi033.stdout:0/963: rename d0/d8/d15/d8b/da3/dae/d59 to d0/d8/d15/d8b/da3/dae/d58/de2/d143 0 2024-02-15T18:31:13.090 INFO:tasks.workunit.client.0.smithi033.stdout:0/964: creat d0/d8/df1/f144 x:0 0 0 2024-02-15T18:31:13.107 INFO:tasks.workunit.client.0.smithi033.stdout:3/979: dwrite d2/d14/d23/d6f/d93/fc4 [0,4194304] 0 2024-02-15T18:31:13.108 INFO:tasks.workunit.client.0.smithi033.stdout:0/965: dwrite d0/d8/f45 [0,4194304] 0 2024-02-15T18:31:13.137 INFO:tasks.workunit.client.0.smithi033.stdout:0/966: dwrite d0/d8/d15/d2d/fab [0,4194304] 0 2024-02-15T18:31:13.137 INFO:tasks.workunit.client.0.smithi033.stdout:0/967: chown d0/de8/d8d/dec/da4 70571 1 2024-02-15T18:31:13.138 INFO:tasks.workunit.client.0.smithi033.stdout:3/980: dwrite d2/d3/d17/de6/fde [0,4194304] 0 2024-02-15T18:31:13.138 INFO:tasks.workunit.client.0.smithi033.stdout:3/981: chown d2/f6d 158793 1 2024-02-15T18:31:13.138 INFO:tasks.workunit.client.0.smithi033.stdout:0/968: mkdir d0/d8/d15/d5b/d145 0 2024-02-15T18:31:13.141 INFO:tasks.workunit.client.0.smithi033.stdout:3/982: mknod d2/d14/d23/d5c/d61/de2/c12a 0 2024-02-15T18:31:13.147 INFO:tasks.workunit.client.0.smithi033.stdout:9/856: sync 2024-02-15T18:31:13.155 INFO:tasks.workunit.client.0.smithi033.stdout:9/857: dread d4/d8/d1b/d2f/df3/f120 [4194304,4194304] 0 2024-02-15T18:31:13.155 INFO:tasks.workunit.client.0.smithi033.stdout:9/858: dread - d4/d8/dd/d5c/d6d/d97/f122 zero size 2024-02-15T18:31:13.168 INFO:tasks.workunit.client.0.smithi033.stdout:3/983: dwrite d2/d14/f9e [0,4194304] 0 2024-02-15T18:31:13.170 INFO:tasks.workunit.client.0.smithi033.stdout:0/969: dwrite d0/d64/d1d/f21 [4194304,4194304] 0 2024-02-15T18:31:13.170 INFO:tasks.workunit.client.0.smithi033.stdout:9/859: dread d4/d8/dd/d5c/f72 [0,4194304] 0 2024-02-15T18:31:13.170 INFO:tasks.workunit.client.0.smithi033.stdout:9/860: dread d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/f89 [0,4194304] 0 2024-02-15T18:31:13.171 INFO:tasks.workunit.client.0.smithi033.stdout:3/984: mknod d2/d14/d23/c12b 0 2024-02-15T18:31:13.171 INFO:tasks.workunit.client.0.smithi033.stdout:3/985: write d2/d14/db3/dba/f109 [4424450,69628] 0 2024-02-15T18:31:13.172 INFO:tasks.workunit.client.0.smithi033.stdout:0/970: rename d0/d8/d15/d2d/l49 to d0/d64/d88/l146 0 2024-02-15T18:31:13.174 INFO:tasks.workunit.client.0.smithi033.stdout:3/986: stat d2/d3/df/d6c/f72 0 2024-02-15T18:31:13.174 INFO:tasks.workunit.client.0.smithi033.stdout:3/987: chown d2/d3/d17/de6/d88/dd1 105 1 2024-02-15T18:31:13.174 INFO:tasks.workunit.client.0.smithi033.stdout:3/988: chown d2/d14/d23/d5c/d7f/fd0 1427115 1 2024-02-15T18:31:13.174 INFO:tasks.workunit.client.0.smithi033.stdout:3/989: fdatasync d2/d3/df/f10d 0 2024-02-15T18:31:13.180 INFO:tasks.workunit.client.0.smithi033.stdout:9/861: dread d4/d8/dd/f63 [0,4194304] 0 2024-02-15T18:31:13.182 INFO:tasks.workunit.client.0.smithi033.stdout:9/862: creat d4/d2c/db1/ddb/de9/f123 x:0 0 0 2024-02-15T18:31:13.183 INFO:tasks.workunit.client.0.smithi033.stdout:9/863: creat d4/d8/dd/d5c/d6d/dbc/d117/d11c/f124 x:0 0 0 2024-02-15T18:31:13.184 INFO:tasks.workunit.client.0.smithi033.stdout:3/990: dread d2/d14/d23/d5c/d61/fd3 [0,4194304] 0 2024-02-15T18:31:13.185 INFO:tasks.workunit.client.0.smithi033.stdout:9/864: creat d4/d8/d1b/d2f/df3/f125 x:0 0 0 2024-02-15T18:31:13.186 INFO:tasks.workunit.client.0.smithi033.stdout:9/865: chown d4/d8/d1b/d2f/df3/c10c 67371270 1 2024-02-15T18:31:13.187 INFO:tasks.workunit.client.0.smithi033.stdout:9/866: write d4/d8/d1b/d2f/f79 [3969033,62872] 0 2024-02-15T18:31:13.187 INFO:tasks.workunit.client.0.smithi033.stdout:9/867: readlink d4/d8/d1b/d2f/d65/lb5 0 2024-02-15T18:31:13.187 INFO:tasks.workunit.client.0.smithi033.stdout:9/868: write d4/d8/d1b/d61/dc7/ff0 [951034,87816] 0 2024-02-15T18:31:13.189 INFO:tasks.workunit.client.0.smithi033.stdout:9/869: link d4/d8/dd/d5c/d6d/dbc/lec d4/d8/dd/d5c/d6d/l126 0 2024-02-15T18:31:13.199 INFO:tasks.workunit.client.0.smithi033.stdout:3/991: dwrite d2/d3/d17/de6/d73/d83/f10e [0,4194304] 0 2024-02-15T18:31:13.200 INFO:tasks.workunit.client.0.smithi033.stdout:3/992: readlink d2/d3/d17/l5a 0 2024-02-15T18:31:13.201 INFO:tasks.workunit.client.0.smithi033.stdout:3/993: symlink d2/d3/d17/de6/d73/d76/l12c 0 2024-02-15T18:31:13.202 INFO:tasks.workunit.client.0.smithi033.stdout:3/994: getdents d2/d3/d17 0 2024-02-15T18:31:13.210 INFO:tasks.workunit.client.0.smithi033.stdout:9/870: dwrite d4/d8/dd/d5c/d6d/dbc/d117/d11c/f5d [0,4194304] 0 2024-02-15T18:31:13.212 INFO:tasks.workunit.client.0.smithi033.stdout:3/995: dread d2/f4 [0,4194304] 0 2024-02-15T18:31:13.213 INFO:tasks.workunit.client.0.smithi033.stdout:3/996: fsync d2/d14/d23/d5c/f8e 0 2024-02-15T18:31:13.213 INFO:tasks.workunit.client.0.smithi033.stdout:9/871: mknod d4/d8/d1b/d61/dc7/c127 0 2024-02-15T18:31:13.213 INFO:tasks.workunit.client.0.smithi033.stdout:3/997: truncate d2/d14/d23/d5c/d61/fd3 1832651 0 2024-02-15T18:31:13.255 INFO:tasks.workunit.client.0.smithi033.stdout:9/872: write d4/d8/d1b/d73/f8e [2926001,10661] 0 2024-02-15T18:31:13.257 INFO:tasks.workunit.client.0.smithi033.stdout:3/998: link d2/d14/db3/fcd d2/dfa/f12d 0 2024-02-15T18:31:13.257 INFO:tasks.workunit.client.0.smithi033.stdout:9/873: creat d4/df2/f128 x:0 0 0 2024-02-15T18:31:13.257 INFO:tasks.workunit.client.0.smithi033.stdout:9/874: chown d4/d8/dd/d5c/l77 21635 1 2024-02-15T18:31:13.257 INFO:tasks.workunit.client.0.smithi033.stdout:9/875: write d4/d2c/db1/ddb/de9/f123 [163538,33880] 0 2024-02-15T18:31:13.257 INFO:tasks.workunit.client.0.smithi033.stdout:3/999: getdents d2/d20 0 2024-02-15T18:31:13.257 INFO:tasks.workunit.client.0.smithi033.stdout:9/876: creat d4/d8/d1b/d2f/f129 x:0 0 0 2024-02-15T18:31:13.257 INFO:tasks.workunit.client.0.smithi033.stdout:9/877: creat d4/d2c/db1/ddb/f12a x:0 0 0 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/878: write d4/d8/dd/d5c/d6d/dbc/d117/d11c/f5d [5051929,57537] 0 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/879: truncate d4/d2c/f84 3702415 0 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/880: readlink d4/d8/d1b/d2f/d65/l8a 0 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/881: link d4/d8/dd/f3d d4/d8/dd/d28/d6b/dd8/d118/f12b 0 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/882: dwrite d4/d2c/db1/ddb/fed [0,4194304] 0 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/883: chown d4/d8/dd/d5c/f102 181352 1 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/884: chown d4/d8/db6/l10d 36 1 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/885: dwrite d4/d8/dd/fc5 [0,4194304] 0 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/886: chown d4/d8/d1b/d2f/d65/d8b/fb9 7850905 1 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/887: rename d4/d8/dd/d28/c49 to d4/c12c 0 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/888: creat d4/d2c/db1/ddb/f12d x:0 0 0 2024-02-15T18:31:13.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/889: creat d4/d8/d1b/d2f/d65/d8b/d95/f12e x:0 0 0 2024-02-15T18:31:13.259 INFO:tasks.workunit.client.0.smithi033.stdout:9/890: symlink d4/d8/dd/d28/l12f 0 2024-02-15T18:31:13.259 INFO:tasks.workunit.client.0.smithi033.stdout:9/891: mknod d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/c130 0 2024-02-15T18:31:13.259 INFO:tasks.workunit.client.0.smithi033.stdout:9/892: symlink d4/d8/d1b/d61/dc7/l131 0 2024-02-15T18:31:13.260 INFO:tasks.workunit.client.0.smithi033.stdout:9/893: mkdir d4/d8/dd/d5c/d6d/d132 0 2024-02-15T18:31:13.260 INFO:tasks.workunit.client.0.smithi033.stdout:9/894: mknod d4/d2c/c133 0 2024-02-15T18:31:13.269 INFO:tasks.workunit.client.0.smithi033.stdout:9/895: dread d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/f52 [0,4194304] 0 2024-02-15T18:31:13.282 INFO:tasks.workunit.client.0.smithi033.stdout:9/896: dwrite d4/d8/d1b/d2f/d65/d8b/fb9 [0,4194304] 0 2024-02-15T18:31:13.282 INFO:tasks.workunit.client.0.smithi033.stdout:9/897: fsync d4/d8/dd/d5c/d6d/dbc/d117/d11c/f4e 0 2024-02-15T18:31:13.282 INFO:tasks.workunit.client.0.smithi033.stdout:9/898: write d4/d8/d1b/d2f/f79 [4738628,126889] 0 2024-02-15T18:31:13.282 INFO:tasks.workunit.client.0.smithi033.stdout:9/899: write d4/d8/d1b/d2f/f129 [264087,126479] 0 2024-02-15T18:31:13.282 INFO:tasks.workunit.client.0.smithi033.stdout:0/971: sync 2024-02-15T18:31:13.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/900: mkdir d4/d8/dd/d28/d6b/dd8/d118/d134 0 2024-02-15T18:31:13.284 INFO:tasks.workunit.client.0.smithi033.stdout:9/901: chown d4/fe3 26014 1 2024-02-15T18:31:13.284 INFO:tasks.workunit.client.0.smithi033.stdout:0/972: creat d0/de8/d8d/dec/da4/f147 x:0 0 0 2024-02-15T18:31:13.299 INFO:tasks.workunit.client.0.smithi033.stdout:0/973: dread d0/d2/f3 [8388608,4194304] 0 2024-02-15T18:31:13.301 INFO:tasks.workunit.client.0.smithi033.stdout:9/902: dwrite d4/d8/dd/fe [0,4194304] 0 2024-02-15T18:31:13.302 INFO:tasks.workunit.client.0.smithi033.stdout:0/974: write d0/d8/d15/d8b/da3/dae/d58/d77/fbc [1250655,76785] 0 2024-02-15T18:31:13.302 INFO:tasks.workunit.client.0.smithi033.stdout:0/975: dread - d0/d8/d15/d2d/d41/f12e zero size 2024-02-15T18:31:13.302 INFO:tasks.workunit.client.0.smithi033.stdout:0/976: chown d0/d8/d15/d8b/da3/dae/d58/de2/d143/l132 71382 1 2024-02-15T18:31:13.304 INFO:tasks.workunit.client.0.smithi033.stdout:0/977: mkdir d0/d8/d15/d8b/da3/dae/d11e/d148 0 2024-02-15T18:31:13.305 INFO:tasks.workunit.client.0.smithi033.stdout:0/978: dread d0/de8/d97/db1/f113 [0,4194304] 0 2024-02-15T18:31:13.305 INFO:tasks.workunit.client.0.smithi033.stdout:0/979: chown d0/d8/c33 116 1 2024-02-15T18:31:13.306 INFO:tasks.workunit.client.0.smithi033.stdout:0/980: mkdir d0/d8/d15/d8b/da3/dae/d58/de2/d149 0 2024-02-15T18:31:13.307 INFO:tasks.workunit.client.0.smithi033.stdout:0/981: unlink d0/de8/d8d/dec/d9e/lbd 0 2024-02-15T18:31:13.308 INFO:tasks.workunit.client.0.smithi033.stdout:0/982: symlink d0/de8/d8d/dec/l14a 0 2024-02-15T18:31:13.309 INFO:tasks.workunit.client.0.smithi033.stdout:0/983: chown d0/d8/df1 1723 1 2024-02-15T18:31:13.310 INFO:tasks.workunit.client.0.smithi033.stdout:0/984: unlink d0/d8/d15/d2d/d41/d73/d96/l10e 0 2024-02-15T18:31:13.311 INFO:tasks.workunit.client.0.smithi033.stdout:0/985: truncate d0/d64/d88/f8a 4036391 0 2024-02-15T18:31:13.325 INFO:tasks.workunit.client.0.smithi033.stdout:9/903: dwrite d4/d8/dd/d28/d6b/fa7 [0,4194304] 0 2024-02-15T18:31:13.325 INFO:tasks.workunit.client.0.smithi033.stdout:9/904: readlink d4/l119 0 2024-02-15T18:31:13.325 INFO:tasks.workunit.client.0.smithi033.stdout:0/986: dread d0/d8/f45 [0,4194304] 0 2024-02-15T18:31:13.326 INFO:tasks.workunit.client.0.smithi033.stdout:9/905: write d4/d8/dd/d5c/f9b [3539666,78933] 0 2024-02-15T18:31:13.329 INFO:tasks.workunit.client.0.smithi033.stdout:9/906: mkdir d4/d8/d1b/d2f/d135 0 2024-02-15T18:31:13.341 INFO:tasks.workunit.client.0.smithi033.stdout:0/987: dwrite d0/d8/d15/f17 [0,4194304] 0 2024-02-15T18:31:13.348 INFO:tasks.workunit.client.0.smithi033.stdout:0/988: dread d0/de8/d8d/dec/da4/f69 [0,4194304] 0 2024-02-15T18:31:13.349 INFO:tasks.workunit.client.0.smithi033.stdout:0/989: truncate d0/d8/d15/d8b/da3/d6c/ff2 1127452 0 2024-02-15T18:31:13.367 INFO:tasks.workunit.client.0.smithi033.stdout:0/990: dwrite d0/d8/d15/d8b/da3/dae/d58/d80/dc1/fc3 [0,4194304] 0 2024-02-15T18:31:13.384 INFO:tasks.workunit.client.0.smithi033.stdout:0/991: dwrite d0/f4 [4194304,4194304] 0 2024-02-15T18:31:13.385 INFO:tasks.workunit.client.0.smithi033.stdout:0/992: unlink d0/d8/fb 0 2024-02-15T18:31:13.386 INFO:tasks.workunit.client.0.smithi033.stdout:0/993: symlink d0/de8/d8d/d11d/l14b 0 2024-02-15T18:31:13.386 INFO:tasks.workunit.client.0.smithi033.stdout:0/994: write d0/d8/df1/f144 [163085,54000] 0 2024-02-15T18:31:13.388 INFO:tasks.workunit.client.0.smithi033.stdout:0/995: rename d0/d8/d15/d2d/f57 to d0/d8/d15/d8b/da3/dae/d11e/f14c 0 2024-02-15T18:31:13.388 INFO:tasks.workunit.client.0.smithi033.stdout:0/996: symlink d0/d8/d15/d8b/da3/dae/d11e/l14d 0 2024-02-15T18:31:13.389 INFO:tasks.workunit.client.0.smithi033.stdout:0/997: fsync d0/d8/f39 0 2024-02-15T18:31:13.390 INFO:tasks.workunit.client.0.smithi033.stdout:0/998: creat d0/d8/d15/d2d/d41/d73/d96/f14e x:0 0 0 2024-02-15T18:31:13.390 INFO:tasks.workunit.client.0.smithi033.stdout:0/999: chown d0/d8/d15/d8b/da3/dae/d58/d80/dc1/l103 269 1 2024-02-15T18:31:13.726 INFO:tasks.workunit.client.1.smithi131.stdout:2/5: sync 2024-02-15T18:31:13.727 INFO:tasks.workunit.client.1.smithi131.stdout:2/6: read - no filename 2024-02-15T18:31:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:11.525495+0000 mgr.smithi131.buibla (mgr.24387) 29 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 185 MiB/s wr, 282 op/s 2024-02-15T18:31:13.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:11.525495+0000 mgr.smithi131.buibla (mgr.24387) 29 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 185 MiB/s wr, 282 op/s 2024-02-15T18:31:14.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:13.525932+0000 mgr.smithi131.buibla (mgr.24387) 30 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 144 MiB/s rd, 317 MiB/s wr, 473 op/s 2024-02-15T18:31:14.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:13.613909+0000 mon.smithi033 (mon.0) 619 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:14.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:13.618575+0000 mon.smithi131 (mon.1) 42 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:31:14.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:13.618969+0000 mgr.smithi131.buibla (mgr.24387) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:31:14.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:13.619791+0000 mon.smithi131 (mon.1) 43 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi033.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T18:31:14.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:13.620078+0000 mgr.smithi131.buibla (mgr.24387) 32 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi033.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T18:31:14.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:13.623772+0000 mon.smithi033 (mon.0) 620 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:14.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:13.626248+0000 mon.smithi131 (mon.1) 44 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:14.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:13.632579+0000 mon.smithi033 (mon.0) 621 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:14.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:31:13.633858+0000 mgr.smithi131.buibla (mgr.24387) 33 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi131.buibla) 2024-02-15T18:31:14.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:31:13.634228+0000 mgr.smithi131.buibla (mgr.24387) 34 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi131.buibla) 2024-02-15T18:31:14.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:13.525932+0000 mgr.smithi131.buibla (mgr.24387) 30 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 144 MiB/s rd, 317 MiB/s wr, 473 op/s 2024-02-15T18:31:14.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:13.613909+0000 mon.smithi033 (mon.0) 619 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:14.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:13.618575+0000 mon.smithi131 (mon.1) 42 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:31:14.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:13.618969+0000 mgr.smithi131.buibla (mgr.24387) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:31:14.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:13.619791+0000 mon.smithi131 (mon.1) 43 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi033.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T18:31:14.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:13.620078+0000 mgr.smithi131.buibla (mgr.24387) 32 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi033.front.sepia.ceph.com:9095"}]: dispatch 2024-02-15T18:31:15.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:13.623772+0000 mon.smithi033 (mon.0) 620 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:15.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:13.626248+0000 mon.smithi131 (mon.1) 44 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:15.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:13.632579+0000 mon.smithi033 (mon.0) 621 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:15.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:31:13.633858+0000 mgr.smithi131.buibla (mgr.24387) 33 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi131.buibla) 2024-02-15T18:31:15.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:31:13.634228+0000 mgr.smithi131.buibla (mgr.24387) 34 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi131.buibla) 2024-02-15T18:31:16.077 INFO:tasks.workunit.client.0.smithi033.stdout:9/907: sync 2024-02-15T18:31:16.154 INFO:tasks.workunit.client.0.smithi033.stdout:9/908: symlink d4/df2/l136 0 2024-02-15T18:31:16.154 INFO:tasks.workunit.client.0.smithi033.stdout:9/909: chown d4/fe3 1 1 2024-02-15T18:31:16.155 INFO:tasks.workunit.client.0.smithi033.stdout:9/910: dread d4/d32/fab [0,4194304] 0 2024-02-15T18:31:16.159 INFO:tasks.workunit.client.0.smithi033.stdout:9/911: rmdir d4/d8/d1b/d2f/d65/d8b/d95 39 2024-02-15T18:31:16.161 INFO:tasks.workunit.client.0.smithi033.stdout:9/912: mkdir d4/d8/dd/d28/d6b/d137 0 2024-02-15T18:31:16.176 INFO:tasks.workunit.client.0.smithi033.stdout:9/913: dwrite d4/d8/dd/d28/d6b/fa7 [4194304,4194304] 0 2024-02-15T18:31:16.196 INFO:tasks.workunit.client.0.smithi033.stdout:9/914: dwrite d4/d8/dd/d28/f4c [0,4194304] 0 2024-02-15T18:31:16.196 INFO:tasks.workunit.client.0.smithi033.stdout:9/915: chown d4/d2c/c56 4 1 2024-02-15T18:31:16.196 INFO:tasks.workunit.client.0.smithi033.stdout:9/916: chown d4/d8/d1b/d61/f7a 738701873 1 2024-02-15T18:31:16.197 INFO:tasks.workunit.client.0.smithi033.stdout:9/917: write d4/d8/dd/d28/d6b/dd8/d118/f12b [3018937,83631] 0 2024-02-15T18:31:16.197 INFO:tasks.workunit.client.0.smithi033.stdout:9/918: chown d4/d8/dd/fcb 7620 1 2024-02-15T18:31:16.197 INFO:tasks.workunit.client.0.smithi033.stdout:9/919: fdatasync d4/d8/d1b/fbb 0 2024-02-15T18:31:16.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:31:15.189482+0000 mgr.smithi131.buibla (mgr.24387) 35 : cephadm [INF] Upgrade: Updating mgr.smithi033.apxevf 2024-02-15T18:31:16.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:15.195102+0000 mon.smithi033 (mon.0) 622 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:16.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:15.197044+0000 mon.smithi131 (mon.1) 45 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.apxevf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:31:16.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:15.197489+0000 mon.smithi033 (mon.0) 623 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.apxevf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:31:16.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:15.198656+0000 mon.smithi131 (mon.1) 46 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:31:16.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:15.199572+0000 mon.smithi131 (mon.1) 47 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:16.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:31:15.200343+0000 mgr.smithi131.buibla (mgr.24387) 36 : cephadm [INF] Deploying daemon mgr.smithi033.apxevf on smithi033 2024-02-15T18:31:16.368 INFO:tasks.workunit.client.0.smithi033.stdout:9/920: symlink d4/d2c/l138 0 2024-02-15T18:31:16.368 INFO:tasks.workunit.client.0.smithi033.stdout:9/921: truncate d4/d8/dd/d5c/d6d/d97/f11a 308324 0 2024-02-15T18:31:16.373 INFO:tasks.workunit.client.0.smithi033.stdout:9/922: symlink d4/d8/dd/l139 0 2024-02-15T18:31:16.386 INFO:tasks.workunit.client.0.smithi033.stdout:9/923: creat d4/d2c/f13a x:0 0 0 2024-02-15T18:31:16.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:31:15.189482+0000 mgr.smithi131.buibla (mgr.24387) 35 : cephadm [INF] Upgrade: Updating mgr.smithi033.apxevf 2024-02-15T18:31:16.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:15.195102+0000 mon.smithi033 (mon.0) 622 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:16.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:15.197044+0000 mon.smithi131 (mon.1) 45 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.apxevf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:31:16.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:15.197489+0000 mon.smithi033 (mon.0) 623 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.apxevf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:31:16.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:15.198656+0000 mon.smithi131 (mon.1) 46 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:31:16.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:15.199572+0000 mon.smithi131 (mon.1) 47 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:16.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:31:15.200343+0000 mgr.smithi131.buibla (mgr.24387) 36 : cephadm [INF] Deploying daemon mgr.smithi033.apxevf on smithi033 2024-02-15T18:31:16.626 INFO:tasks.workunit.client.0.smithi033.stdout:9/924: creat d4/d8/dd/d28/d6b/d137/f13b x:0 0 0 2024-02-15T18:31:16.629 INFO:tasks.workunit.client.0.smithi033.stdout:9/925: creat d4/d2c/db1/ddb/f13c x:0 0 0 2024-02-15T18:31:16.631 INFO:tasks.workunit.client.0.smithi033.stdout:9/926: symlink d4/d8/l13d 0 2024-02-15T18:31:16.633 INFO:tasks.workunit.client.0.smithi033.stdout:9/927: getdents d4/d2c/db1/ddb/de9 0 2024-02-15T18:31:16.635 INFO:tasks.workunit.client.0.smithi033.stdout:9/928: getdents d4/d8/d1b/d61 0 2024-02-15T18:31:16.636 INFO:tasks.workunit.client.0.smithi033.stdout:9/929: creat d4/d8/dd/d28/d6b/f13e x:0 0 0 2024-02-15T18:31:16.637 INFO:tasks.workunit.client.0.smithi033.stdout:9/930: creat d4/d8/db6/f13f x:0 0 0 2024-02-15T18:31:16.639 INFO:tasks.workunit.client.0.smithi033.stdout:9/931: truncate d4/d8/d1b/d2f/d65/f90 3836149 0 2024-02-15T18:31:16.691 INFO:tasks.workunit.client.0.smithi033.stdout:9/932: unlink d4/d32/d6c/f8c 0 2024-02-15T18:31:16.691 INFO:tasks.workunit.client.0.smithi033.stdout:9/933: chown d4/d8/d1b/d73/c62 769738 1 2024-02-15T18:31:16.702 INFO:tasks.workunit.client.0.smithi033.stdout:9/934: rename d4/d8/d1b/d2f/d65/d8b/f11b to d4/d2c/f140 0 2024-02-15T18:31:16.704 INFO:tasks.workunit.client.0.smithi033.stdout:9/935: symlink d4/d8/d1b/d2f/l141 0 2024-02-15T18:31:16.704 INFO:tasks.workunit.client.0.smithi033.stdout:9/936: readlink d4/d8/dd/d28/l34 0 2024-02-15T18:31:16.704 INFO:tasks.workunit.client.0.smithi033.stdout:9/937: chown d4/d8/d1b/d73/f9e 534 1 2024-02-15T18:31:16.704 INFO:tasks.workunit.client.0.smithi033.stdout:9/938: chown d4/d8/dd/d5c/d6d/d132 1343971 1 2024-02-15T18:31:16.988 INFO:tasks.workunit.client.0.smithi033.stdout:9/939: sync 2024-02-15T18:31:16.990 INFO:tasks.workunit.client.0.smithi033.stdout:9/940: mknod d4/d8/dd/d5c/d6d/dbc/d117/d11c/c142 0 2024-02-15T18:31:16.990 INFO:tasks.workunit.client.0.smithi033.stdout:9/941: stat d4/d2c 0 2024-02-15T18:31:16.990 INFO:tasks.workunit.client.0.smithi033.stdout:9/942: write d4/d8/d1b/d2f/df3/f125 [398972,23889] 0 2024-02-15T18:31:16.991 INFO:tasks.workunit.client.0.smithi033.stdout:9/943: unlink d4/d8/dd/d28/d6b/ce0 0 2024-02-15T18:31:16.992 INFO:tasks.workunit.client.0.smithi033.stdout:9/944: link d4/d2c/db1/ddb/ffe d4/d8/d1b/d61/dc7/f143 0 2024-02-15T18:31:16.992 INFO:tasks.workunit.client.0.smithi033.stdout:9/945: dread - d4/d2c/db1/ddb/ffe zero size 2024-02-15T18:31:16.992 INFO:tasks.workunit.client.0.smithi033.stdout:9/946: fdatasync d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/f69 0 2024-02-15T18:31:16.993 INFO:tasks.workunit.client.0.smithi033.stdout:9/947: symlink d4/d2c/db1/ddb/de9/l144 0 2024-02-15T18:31:16.994 INFO:tasks.workunit.client.0.smithi033.stdout:9/948: mknod d4/d8/c145 0 2024-02-15T18:31:17.013 INFO:tasks.workunit.client.0.smithi033.stdout:9/949: dwrite d4/d8/d1b/d73/fb7 [0,4194304] 0 2024-02-15T18:31:17.014 INFO:tasks.workunit.client.0.smithi033.stdout:9/950: write d4/d8/d1b/d2f/d65/d8b/fb9 [5142306,112821] 0 2024-02-15T18:31:17.016 INFO:tasks.workunit.client.0.smithi033.stdout:9/951: mkdir d4/d8/dd/d5c/d6d/dbc/d146 0 2024-02-15T18:31:17.018 INFO:tasks.workunit.client.0.smithi033.stdout:9/952: creat d4/d8/d1b/d2f/d135/f147 x:0 0 0 2024-02-15T18:31:17.024 INFO:tasks.workunit.client.0.smithi033.stdout:9/953: getdents d4/d8/dd/d5c/d6d/dbc 0 2024-02-15T18:31:17.097 INFO:tasks.workunit.client.0.smithi033.stdout:9/954: sync 2024-02-15T18:31:17.097 INFO:tasks.workunit.client.0.smithi033.stdout:9/955: write d4/d8/dd/d5c/d6d/f10f [346427,89307] 0 2024-02-15T18:31:17.098 INFO:tasks.workunit.client.0.smithi033.stdout:9/956: symlink d4/d2c/l148 0 2024-02-15T18:31:17.100 INFO:tasks.workunit.client.0.smithi033.stdout:9/957: mkdir d4/d8/dd/d28/d6b/dd8/d118/d149 0 2024-02-15T18:31:17.121 INFO:tasks.workunit.client.0.smithi033.stdout:9/958: dwrite d4/d8/f46 [4194304,4194304] 0 2024-02-15T18:31:17.130 INFO:tasks.workunit.client.0.smithi033.stdout:9/959: unlink d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/f80 0 2024-02-15T18:31:17.131 INFO:tasks.workunit.client.0.smithi033.stdout:9/960: dread - d4/d8/d1b/d2f/d65/d8b/d95/f12e zero size 2024-02-15T18:31:17.133 INFO:tasks.workunit.client.0.smithi033.stdout:9/961: rename d4/d8/dd/d28/d6b/l101 to d4/d8/dd/l14a 0 2024-02-15T18:31:17.258 INFO:tasks.workunit.client.0.smithi033.stdout:9/962: sync 2024-02-15T18:31:17.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:15.526259+0000 mgr.smithi131.buibla (mgr.24387) 37 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 117 MiB/s rd, 265 MiB/s wr, 383 op/s 2024-02-15T18:31:17.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:16.205641+0000 mon.smithi033 (mon.0) 624 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:31:17.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:15.526259+0000 mgr.smithi131.buibla (mgr.24387) 37 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 117 MiB/s rd, 265 MiB/s wr, 383 op/s 2024-02-15T18:31:17.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:16.205641+0000 mon.smithi033 (mon.0) 624 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:31:18.335 INFO:tasks.workunit.client.0.smithi033.stdout:9/963: rename d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/cbf to d4/d8/dd/d28/d6b/dd8/d118/d134/c14b 0 2024-02-15T18:31:18.367 INFO:tasks.workunit.client.0.smithi033.stdout:9/964: creat d4/d8/f14c x:0 0 0 2024-02-15T18:31:18.367 INFO:tasks.workunit.client.0.smithi033.stdout:9/965: fdatasync d4/d8/d1b/d2f/f129 0 2024-02-15T18:31:18.369 INFO:tasks.workunit.client.0.smithi033.stdout:9/966: mkdir d4/d8/dd/d5c/d6d/dbc/d14d 0 2024-02-15T18:31:18.369 INFO:tasks.workunit.client.0.smithi033.stdout:9/967: chown d4/d8/dd/ldc 7090 1 2024-02-15T18:31:18.369 INFO:tasks.workunit.client.0.smithi033.stdout:9/968: fsync d4/d8/dd/f23 0 2024-02-15T18:31:18.369 INFO:tasks.workunit.client.0.smithi033.stdout:9/969: chown d4/d8/dd/d28/d6b/ca8 481 1 2024-02-15T18:31:18.369 INFO:tasks.workunit.client.0.smithi033.stdout:9/970: write d4/d8/dd/d5c/fa1 [336010,119042] 0 2024-02-15T18:31:18.372 INFO:tasks.workunit.client.0.smithi033.stdout:9/971: rename d4/d8/lca to d4/d8/d1b/d2f/df3/l14e 0 2024-02-15T18:31:18.375 INFO:tasks.workunit.client.0.smithi033.stdout:9/972: fdatasync d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/f89 0 2024-02-15T18:31:18.375 INFO:tasks.workunit.client.0.smithi033.stdout:9/973: getdents d4/d8/d1b 0 2024-02-15T18:31:18.379 INFO:tasks.workunit.client.0.smithi033.stdout:9/974: link d4/d8/dd/d28/c82 d4/d8/dd/d5c/d6d/dbc/d14d/c14f 0 2024-02-15T18:31:18.384 INFO:tasks.workunit.client.0.smithi033.stdout:9/975: dread d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/f52 [0,4194304] 0 2024-02-15T18:31:18.386 INFO:tasks.workunit.client.0.smithi033.stdout:9/976: creat d4/d8/dd/d5c/d6d/d132/f150 x:0 0 0 2024-02-15T18:31:18.389 INFO:tasks.workunit.client.0.smithi033.stdout:9/977: dread d4/d2c/db1/ddb/de9/f123 [0,4194304] 0 2024-02-15T18:31:18.389 INFO:tasks.workunit.client.0.smithi033.stdout:9/978: chown d4/d8/d1b/d61 2135 1 2024-02-15T18:31:18.389 INFO:tasks.workunit.client.0.smithi033.stdout:9/979: chown d4/d9f/ff6 761259 1 2024-02-15T18:31:18.390 INFO:tasks.workunit.client.0.smithi033.stdout:9/980: truncate d4/d8/d1b/d2f/f76 4475788 0 2024-02-15T18:31:18.392 INFO:tasks.workunit.client.0.smithi033.stdout:9/981: rmdir d4/d8/d1b/d2f/d65/d8b/d95 39 2024-02-15T18:31:18.401 INFO:tasks.workunit.client.0.smithi033.stdout:9/982: write d4/d8/d1b/d2f/d65/f90 [903623,10775] 0 2024-02-15T18:31:18.417 INFO:tasks.workunit.client.0.smithi033.stdout:9/983: dwrite d4/d8/dd/d5c/f66 [0,4194304] 0 2024-02-15T18:31:18.417 INFO:tasks.workunit.client.0.smithi033.stdout:9/984: chown d4/d8/dd/d5c/d6d/dbc/d146 2 1 2024-02-15T18:31:18.418 INFO:tasks.workunit.client.0.smithi033.stdout:9/985: truncate d4/d32/d6c/f104 879306 0 2024-02-15T18:31:18.418 INFO:tasks.workunit.client.0.smithi033.stdout:9/986: write d4/d8/dd/d28/d6b/fcf [24749,96860] 0 2024-02-15T18:31:18.418 INFO:tasks.workunit.client.0.smithi033.stdout:9/987: chown d4/d32/d6c/l9d 290849638 1 2024-02-15T18:31:18.418 INFO:tasks.workunit.client.0.smithi033.stdout:9/988: chown d4/d8/dd/d5c/d6d/dbc/ce8 46414865 1 2024-02-15T18:31:18.418 INFO:tasks.workunit.client.0.smithi033.stdout:9/989: read d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/f89 [2090,116867] 0 2024-02-15T18:31:18.418 INFO:tasks.workunit.client.0.smithi033.stdout:9/990: rename d4/d8/d1b/d2f/d65 to d4/d8/d1b/d2f/d65/d8b/d95/d151 22 2024-02-15T18:31:18.420 INFO:tasks.workunit.client.0.smithi033.stdout:9/991: creat d4/d32/f152 x:0 0 0 2024-02-15T18:31:18.421 INFO:tasks.workunit.client.0.smithi033.stdout:9/992: creat d4/d8/dd/df9/f153 x:0 0 0 2024-02-15T18:31:18.422 INFO:tasks.workunit.client.0.smithi033.stdout:9/993: stat d4/d2c/db1/lf8 0 2024-02-15T18:31:18.423 INFO:tasks.workunit.client.0.smithi033.stdout:9/994: symlink d4/d8/dd/d28/d6b/l154 0 2024-02-15T18:31:18.439 INFO:tasks.workunit.client.0.smithi033.stdout:9/995: dwrite d4/d2c/f13a [0,4194304] 0 2024-02-15T18:31:18.470 INFO:tasks.workunit.client.0.smithi033.stdout:9/996: dread d4/d2c/db1/ddb/fed [4194304,4194304] 0 2024-02-15T18:31:18.472 INFO:tasks.workunit.client.0.smithi033.stdout:9/997: symlink d4/d8/d1b/d2f/dd7/l155 0 2024-02-15T18:31:18.473 INFO:tasks.workunit.client.0.smithi033.stdout:9/998: rmdir d4/d8/d1b/d2f/dd7 39 2024-02-15T18:31:18.474 INFO:tasks.workunit.client.0.smithi033.stdout:9/999: mkdir d4/d8/dd/d5c/d6d/dbc/d117/d11c/d51/d156 0 2024-02-15T18:31:18.556 INFO:tasks.workunit.client.0.smithi033.stderr:+ rm -rf -- ./tmp.bIiB2KrkYv 2024-02-15T18:31:19.672 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:17.526799+0000 mgr.smithi131.buibla (mgr.24387) 38 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 133 MiB/s rd, 297 MiB/s wr, 440 op/s 2024-02-15T18:31:19.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:17.526799+0000 mgr.smithi131.buibla (mgr.24387) 38 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 133 MiB/s rd, 297 MiB/s wr, 440 op/s 2024-02-15T18:31:20.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:19.527186+0000 mgr.smithi131.buibla (mgr.24387) 39 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 72 MiB/s rd, 164 MiB/s wr, 247 op/s 2024-02-15T18:31:20.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:19.717309+0000 mon.smithi033 (mon.0) 625 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:20.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:19.718847+0000 mon.smithi131 (mon.1) 48 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:21.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:19.527186+0000 mgr.smithi131.buibla (mgr.24387) 39 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 72 MiB/s rd, 164 MiB/s wr, 247 op/s 2024-02-15T18:31:21.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:19.717309+0000 mon.smithi033 (mon.0) 625 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:21.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:19.718847+0000 mon.smithi131 (mon.1) 48 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:22.238 INFO:tasks.workunit.client.1.smithi131.stdout:4/23: sync 2024-02-15T18:31:22.238 INFO:tasks.workunit.client.1.smithi131.stdout:2/7: sync 2024-02-15T18:31:22.238 INFO:tasks.workunit.client.1.smithi131.stdout:0/46: sync 2024-02-15T18:31:22.238 INFO:tasks.workunit.client.1.smithi131.stdout:8/33: sync 2024-02-15T18:31:22.238 INFO:tasks.workunit.client.1.smithi131.stdout:5/105: sync 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:2/8: dread - no filename 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:6/64: sync 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:4/24: fdatasync d2/f9 0 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:5/106: truncate f16 5003864 0 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:4/25: fdatasync d2/f8 0 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:4/26: dread - d2/f9 zero size 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:7/25: sync 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:1/16: sync 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:1/17: dwrite - no filename 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:9/27: sync 2024-02-15T18:31:22.239 INFO:tasks.workunit.client.1.smithi131.stdout:3/0: sync 2024-02-15T18:31:22.240 INFO:tasks.workunit.client.1.smithi131.stdout:2/9: mknod c0 0 2024-02-15T18:31:22.240 INFO:tasks.workunit.client.1.smithi131.stdout:2/10: fsync - no filename 2024-02-15T18:31:22.240 INFO:tasks.workunit.client.1.smithi131.stdout:2/11: chown c0 311393 1 2024-02-15T18:31:22.240 INFO:tasks.workunit.client.1.smithi131.stdout:2/12: dread - no filename 2024-02-15T18:31:22.240 INFO:tasks.workunit.client.1.smithi131.stdout:2/13: truncate - no filename 2024-02-15T18:31:22.240 INFO:tasks.workunit.client.1.smithi131.stdout:2/14: fsync - no filename 2024-02-15T18:31:22.240 INFO:tasks.workunit.client.1.smithi131.stdout:2/15: chown c0 711041123 1 2024-02-15T18:31:22.240 INFO:tasks.workunit.client.1.smithi131.stdout:2/16: chown c0 1707 1 2024-02-15T18:31:22.243 INFO:tasks.workunit.client.1.smithi131.stdout:8/34: creat fd x:0 0 0 2024-02-15T18:31:22.243 INFO:tasks.workunit.client.1.smithi131.stdout:0/47: symlink d5/d9/le 0 2024-02-15T18:31:22.244 INFO:tasks.workunit.client.1.smithi131.stdout:0/48: write d5/fd [956084,79744] 0 2024-02-15T18:31:22.246 INFO:tasks.workunit.client.1.smithi131.stdout:4/27: getdents d2 0 2024-02-15T18:31:22.248 INFO:tasks.workunit.client.1.smithi131.stdout:7/26: symlink d0/l7 0 2024-02-15T18:31:22.249 INFO:tasks.workunit.client.1.smithi131.stdout:1/18: creat d0/f3 x:0 0 0 2024-02-15T18:31:22.249 INFO:tasks.workunit.client.1.smithi131.stdout:9/28: mknod d4/c8 0 2024-02-15T18:31:22.250 INFO:tasks.workunit.client.1.smithi131.stdout:3/1: mknod c0 0 2024-02-15T18:31:22.251 INFO:tasks.workunit.client.1.smithi131.stdout:2/17: link c0 c1 0 2024-02-15T18:31:22.254 INFO:tasks.workunit.client.1.smithi131.stdout:4/28: mkdir d2/da 0 2024-02-15T18:31:22.255 INFO:tasks.workunit.client.1.smithi131.stdout:7/27: creat d0/f8 x:0 0 0 2024-02-15T18:31:22.255 INFO:tasks.workunit.client.1.smithi131.stdout:1/19: mkdir d0/d2/d4 0 2024-02-15T18:31:22.255 INFO:tasks.workunit.client.1.smithi131.stdout:6/65: dwrite d2/d7/fd [0,4194304] 0 2024-02-15T18:31:22.257 INFO:tasks.workunit.client.1.smithi131.stdout:9/29: creat d4/f9 x:0 0 0 2024-02-15T18:31:22.257 INFO:tasks.workunit.client.1.smithi131.stdout:0/49: getdents d5/d9 0 2024-02-15T18:31:22.258 INFO:tasks.workunit.client.1.smithi131.stdout:0/50: write f1 [1412171,33437] 0 2024-02-15T18:31:22.261 INFO:tasks.workunit.client.1.smithi131.stdout:5/107: write f11 [1655718,27033] 0 2024-02-15T18:31:22.261 INFO:tasks.workunit.client.1.smithi131.stdout:3/2: mknod c1 0 2024-02-15T18:31:22.261 INFO:tasks.workunit.client.1.smithi131.stdout:3/3: write - no filename 2024-02-15T18:31:22.261 INFO:tasks.workunit.client.1.smithi131.stdout:3/4: chown c0 304937 1 2024-02-15T18:31:22.261 INFO:tasks.workunit.client.1.smithi131.stdout:3/5: write - no filename 2024-02-15T18:31:22.261 INFO:tasks.workunit.client.1.smithi131.stdout:3/6: dread - no filename 2024-02-15T18:31:22.262 INFO:tasks.workunit.client.1.smithi131.stdout:4/29: mknod d2/da/cb 0 2024-02-15T18:31:22.264 INFO:tasks.workunit.client.1.smithi131.stdout:6/66: dread d2/d7/fd [0,4194304] 0 2024-02-15T18:31:22.264 INFO:tasks.workunit.client.1.smithi131.stdout:8/35: dwrite f5 [0,4194304] 0 2024-02-15T18:31:22.264 INFO:tasks.workunit.client.1.smithi131.stdout:1/20: creat d0/d2/f5 x:0 0 0 2024-02-15T18:31:22.264 INFO:tasks.workunit.client.1.smithi131.stdout:1/21: truncate d0/f3 55949 0 2024-02-15T18:31:22.265 INFO:tasks.workunit.client.1.smithi131.stdout:6/67: write d2/d7/fd [2645691,37990] 0 2024-02-15T18:31:22.265 INFO:tasks.workunit.client.1.smithi131.stdout:6/68: fsync d2/d7/fa 0 2024-02-15T18:31:22.265 INFO:tasks.workunit.client.1.smithi131.stdout:6/69: write d2/d7/fd [482298,53155] 0 2024-02-15T18:31:22.266 INFO:tasks.workunit.client.1.smithi131.stdout:9/30: mkdir d4/da 0 2024-02-15T18:31:22.266 INFO:tasks.workunit.client.1.smithi131.stdout:9/31: chown d4 79 1 2024-02-15T18:31:22.266 INFO:tasks.workunit.client.1.smithi131.stdout:9/32: write f3 [794369,28383] 0 2024-02-15T18:31:22.266 INFO:tasks.workunit.client.1.smithi131.stdout:9/33: chown f0 24 1 2024-02-15T18:31:22.267 INFO:tasks.workunit.client.1.smithi131.stdout:0/51: creat d5/d9/ff x:0 0 0 2024-02-15T18:31:22.271 INFO:tasks.workunit.client.1.smithi131.stdout:5/108: mkdir d18/d20 0 2024-02-15T18:31:22.272 INFO:tasks.workunit.client.1.smithi131.stdout:3/7: mkdir d2 0 2024-02-15T18:31:22.272 INFO:tasks.workunit.client.1.smithi131.stdout:3/8: readlink - no filename 2024-02-15T18:31:22.272 INFO:tasks.workunit.client.1.smithi131.stdout:3/9: dwrite - no filename 2024-02-15T18:31:22.273 INFO:tasks.workunit.client.1.smithi131.stdout:8/36: creat fe x:0 0 0 2024-02-15T18:31:22.275 INFO:tasks.workunit.client.1.smithi131.stdout:1/22: link d0/f3 d0/d2/d4/f6 0 2024-02-15T18:31:22.275 INFO:tasks.workunit.client.1.smithi131.stdout:1/23: write d0/d2/f5 [324110,59031] 0 2024-02-15T18:31:22.275 INFO:tasks.workunit.client.1.smithi131.stdout:6/70: mkdir d2/d7/d12 0 2024-02-15T18:31:22.275 INFO:tasks.workunit.client.1.smithi131.stdout:6/71: readlink d2/lf 0 2024-02-15T18:31:22.276 INFO:tasks.workunit.client.1.smithi131.stdout:9/34: creat d4/da/fb x:0 0 0 2024-02-15T18:31:22.278 INFO:tasks.workunit.client.1.smithi131.stdout:5/109: symlink d18/l21 0 2024-02-15T18:31:22.279 INFO:tasks.workunit.client.1.smithi131.stdout:3/10: mkdir d2/d3 0 2024-02-15T18:31:22.280 INFO:tasks.workunit.client.1.smithi131.stdout:3/11: write - no filename 2024-02-15T18:31:22.280 INFO:tasks.workunit.client.1.smithi131.stdout:3/12: truncate - no filename 2024-02-15T18:31:22.280 INFO:tasks.workunit.client.1.smithi131.stdout:6/72: dread d2/d7/fd [0,4194304] 0 2024-02-15T18:31:22.280 INFO:tasks.workunit.client.1.smithi131.stdout:4/30: creat d2/d7/fc x:0 0 0 2024-02-15T18:31:22.282 INFO:tasks.workunit.client.1.smithi131.stdout:8/37: rename la to lf 0 2024-02-15T18:31:22.284 INFO:tasks.workunit.client.1.smithi131.stdout:1/24: mkdir d0/d2/d7 0 2024-02-15T18:31:22.285 INFO:tasks.workunit.client.1.smithi131.stdout:5/110: mknod d18/d1f/c22 0 2024-02-15T18:31:22.287 INFO:tasks.workunit.client.1.smithi131.stdout:3/13: rename c0 to d2/d3/c4 0 2024-02-15T18:31:22.288 INFO:tasks.workunit.client.1.smithi131.stdout:6/73: link d2/fe d2/f13 0 2024-02-15T18:31:22.288 INFO:tasks.workunit.client.1.smithi131.stdout:4/31: chown d2/f4 63349437 1 2024-02-15T18:31:22.290 INFO:tasks.workunit.client.1.smithi131.stdout:5/111: mkdir d18/d23 0 2024-02-15T18:31:22.293 INFO:tasks.workunit.client.1.smithi131.stdout:6/74: creat d2/dc/f14 x:0 0 0 2024-02-15T18:31:22.294 INFO:tasks.workunit.client.1.smithi131.stdout:4/32: creat d2/da/fd x:0 0 0 2024-02-15T18:31:22.297 INFO:tasks.workunit.client.1.smithi131.stdout:6/75: rename d2/d7/l8 to d2/d7/d12/l15 0 2024-02-15T18:31:22.299 INFO:tasks.workunit.client.1.smithi131.stdout:6/76: mkdir d2/d7/d16 0 2024-02-15T18:31:22.299 INFO:tasks.workunit.client.1.smithi131.stdout:4/33: symlink d2/le 0 2024-02-15T18:31:22.299 INFO:tasks.workunit.client.1.smithi131.stdout:6/77: chown d2/lf 4 1 2024-02-15T18:31:22.323 INFO:tasks.workunit.client.1.smithi131.stdout:1/25: fdatasync d0/d2/f5 0 2024-02-15T18:31:22.333 INFO:tasks.workunit.client.1.smithi131.stdout:6/78: dwrite d2/f13 [0,4194304] 0 2024-02-15T18:31:22.334 INFO:tasks.workunit.client.1.smithi131.stdout:8/38: dwrite fe [0,4194304] 0 2024-02-15T18:31:22.334 INFO:tasks.workunit.client.1.smithi131.stdout:9/35: dwrite d4/f9 [0,4194304] 0 2024-02-15T18:31:22.334 INFO:tasks.workunit.client.1.smithi131.stdout:7/28: dwrite d0/f1 [0,4194304] 0 2024-02-15T18:31:22.334 INFO:tasks.workunit.client.1.smithi131.stdout:7/29: readlink d0/l7 0 2024-02-15T18:31:22.335 INFO:tasks.workunit.client.1.smithi131.stdout:6/79: symlink d2/l17 0 2024-02-15T18:31:22.335 INFO:tasks.workunit.client.1.smithi131.stdout:6/80: chown d2/d7/d16 753 1 2024-02-15T18:31:22.339 INFO:tasks.workunit.client.1.smithi131.stdout:3/14: getdents d2 0 2024-02-15T18:31:22.339 INFO:tasks.workunit.client.1.smithi131.stdout:4/34: dwrite d2/f6 [0,4194304] 0 2024-02-15T18:31:22.342 INFO:tasks.workunit.client.1.smithi131.stdout:1/26: dwrite d0/f3 [0,4194304] 0 2024-02-15T18:31:22.354 INFO:tasks.workunit.client.1.smithi131.stdout:5/112: rename d18/d1f to d18/d24 0 2024-02-15T18:31:22.357 INFO:tasks.workunit.client.1.smithi131.stdout:8/39: getdents . 0 2024-02-15T18:31:22.359 INFO:tasks.workunit.client.1.smithi131.stdout:9/36: mkdir d4/dc 0 2024-02-15T18:31:22.359 INFO:tasks.workunit.client.1.smithi131.stdout:9/37: read f0 [22134,18936] 0 2024-02-15T18:31:22.360 INFO:tasks.workunit.client.1.smithi131.stdout:7/30: rename d0/c5 to d0/c9 0 2024-02-15T18:31:22.362 INFO:tasks.workunit.client.1.smithi131.stdout:6/81: rename d2/c11 to d2/d7/d12/c18 0 2024-02-15T18:31:22.363 INFO:tasks.workunit.client.1.smithi131.stdout:3/15: mknod d2/c5 0 2024-02-15T18:31:22.363 INFO:tasks.workunit.client.1.smithi131.stdout:3/16: truncate - no filename 2024-02-15T18:31:22.370 INFO:tasks.workunit.client.1.smithi131.stdout:8/40: dread fe [0,4194304] 0 2024-02-15T18:31:22.372 INFO:tasks.workunit.client.1.smithi131.stdout:1/27: symlink d0/d2/d4/l8 0 2024-02-15T18:31:22.372 INFO:tasks.workunit.client.1.smithi131.stdout:5/113: mknod d18/c25 0 2024-02-15T18:31:22.376 INFO:tasks.workunit.client.1.smithi131.stdout:3/17: creat d2/d3/f6 x:0 0 0 2024-02-15T18:31:22.379 INFO:tasks.workunit.client.1.smithi131.stdout:6/82: getdents d2/d7/d12 0 2024-02-15T18:31:22.379 INFO:tasks.workunit.client.1.smithi131.stdout:6/83: dread - d2/d7/fb zero size 2024-02-15T18:31:22.387 INFO:tasks.workunit.client.1.smithi131.stdout:9/38: dwrite f0 [0,4194304] 0 2024-02-15T18:31:22.392 INFO:tasks.workunit.client.1.smithi131.stdout:6/84: mkdir d2/dc/d19 0 2024-02-15T18:31:22.394 INFO:tasks.workunit.client.1.smithi131.stdout:9/39: symlink d4/da/ld 0 2024-02-15T18:31:22.394 INFO:tasks.workunit.client.1.smithi131.stdout:9/40: fdatasync d4/f9 0 2024-02-15T18:31:22.394 INFO:tasks.workunit.client.1.smithi131.stdout:6/85: creat d2/f1a x:0 0 0 2024-02-15T18:31:22.399 INFO:tasks.workunit.client.1.smithi131.stdout:9/41: mkdir d4/dc/de 0 2024-02-15T18:31:22.400 INFO:tasks.workunit.client.1.smithi131.stdout:9/42: truncate d4/f9 3284650 0 2024-02-15T18:31:22.402 INFO:tasks.workunit.client.1.smithi131.stdout:9/43: symlink d4/lf 0 2024-02-15T18:31:22.408 INFO:tasks.workunit.client.1.smithi131.stdout:7/31: dwrite d0/f8 [0,4194304] 0 2024-02-15T18:31:22.408 INFO:tasks.workunit.client.1.smithi131.stdout:7/32: fdatasync d0/f1 0 2024-02-15T18:31:22.413 INFO:tasks.workunit.client.1.smithi131.stdout:7/33: write d0/f1 [3668491,122668] 0 2024-02-15T18:31:22.413 INFO:tasks.workunit.client.1.smithi131.stdout:7/34: chown d0/c2 271 1 2024-02-15T18:31:22.414 INFO:tasks.workunit.client.1.smithi131.stdout:7/35: getdents d0 0 2024-02-15T18:31:22.415 INFO:tasks.workunit.client.1.smithi131.stdout:7/36: fsync d0/f8 0 2024-02-15T18:31:22.415 INFO:tasks.workunit.client.1.smithi131.stdout:7/37: getdents d0 0 2024-02-15T18:31:22.419 INFO:tasks.workunit.client.1.smithi131.stdout:8/41: dwrite f5 [0,4194304] 0 2024-02-15T18:31:22.419 INFO:tasks.workunit.client.1.smithi131.stdout:4/35: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:22.419 INFO:tasks.workunit.client.1.smithi131.stdout:1/28: dwrite d0/d2/f5 [0,4194304] 0 2024-02-15T18:31:22.419 INFO:tasks.workunit.client.1.smithi131.stdout:1/29: stat d0/d2/d7 0 2024-02-15T18:31:22.420 INFO:tasks.workunit.client.1.smithi131.stdout:3/18: dwrite d2/d3/f6 [0,4194304] 0 2024-02-15T18:31:22.420 INFO:tasks.workunit.client.1.smithi131.stdout:6/86: dwrite d2/dc/f14 [0,4194304] 0 2024-02-15T18:31:22.420 INFO:tasks.workunit.client.1.smithi131.stdout:6/87: readlink d2/l17 0 2024-02-15T18:31:22.421 INFO:tasks.workunit.client.1.smithi131.stdout:1/30: write d0/d2/f5 [2329000,45391] 0 2024-02-15T18:31:22.421 INFO:tasks.workunit.client.1.smithi131.stdout:5/114: dwrite f11 [0,4194304] 0 2024-02-15T18:31:22.421 INFO:tasks.workunit.client.1.smithi131.stdout:5/115: write d18/f1e [1013049,95260] 0 2024-02-15T18:31:22.425 INFO:tasks.workunit.client.1.smithi131.stdout:4/36: creat d2/d7/ff x:0 0 0 2024-02-15T18:31:22.428 INFO:tasks.workunit.client.1.smithi131.stdout:3/19: creat d2/f7 x:0 0 0 2024-02-15T18:31:22.429 INFO:tasks.workunit.client.1.smithi131.stdout:1/31: creat d0/d2/f9 x:0 0 0 2024-02-15T18:31:22.430 INFO:tasks.workunit.client.1.smithi131.stdout:5/116: unlink l10 0 2024-02-15T18:31:22.432 INFO:tasks.workunit.client.1.smithi131.stdout:4/37: link d2/f6 d2/d7/f10 0 2024-02-15T18:31:22.435 INFO:tasks.workunit.client.1.smithi131.stdout:1/32: mkdir d0/d2/d4/da 0 2024-02-15T18:31:22.436 INFO:tasks.workunit.client.1.smithi131.stdout:7/38: dread d0/f1 [4194304,4194304] 0 2024-02-15T18:31:22.437 INFO:tasks.workunit.client.1.smithi131.stdout:5/117: rename f13 to d18/d24/f26 0 2024-02-15T18:31:22.437 INFO:tasks.workunit.client.1.smithi131.stdout:5/118: readlink l14 0 2024-02-15T18:31:22.437 INFO:tasks.workunit.client.1.smithi131.stdout:4/38: creat d2/d7/f11 x:0 0 0 2024-02-15T18:31:22.440 INFO:tasks.workunit.client.1.smithi131.stdout:3/20: mkdir d2/d8 0 2024-02-15T18:31:22.440 INFO:tasks.workunit.client.1.smithi131.stdout:3/21: write d2/f7 [463303,30059] 0 2024-02-15T18:31:22.443 INFO:tasks.workunit.client.1.smithi131.stdout:4/39: mkdir d2/d7/d12 0 2024-02-15T18:31:22.443 INFO:tasks.workunit.client.1.smithi131.stdout:3/22: rename d2/c5 to d2/d3/c9 0 2024-02-15T18:31:22.443 INFO:tasks.workunit.client.1.smithi131.stdout:4/40: chown d2/d7/d12 40603619 1 2024-02-15T18:31:22.444 INFO:tasks.workunit.client.1.smithi131.stdout:3/23: mknod d2/d8/ca 0 2024-02-15T18:31:22.446 INFO:tasks.workunit.client.1.smithi131.stdout:3/24: read d2/d3/f6 [2403587,119662] 0 2024-02-15T18:31:22.446 INFO:tasks.workunit.client.1.smithi131.stdout:3/25: chown d2/f7 495799 1 2024-02-15T18:31:22.446 INFO:tasks.workunit.client.1.smithi131.stdout:3/26: fsync d2/d3/f6 0 2024-02-15T18:31:22.446 INFO:tasks.workunit.client.1.smithi131.stdout:3/27: truncate d2/f7 1264307 0 2024-02-15T18:31:22.446 INFO:tasks.workunit.client.1.smithi131.stdout:4/41: write d2/f6 [1371668,111558] 0 2024-02-15T18:31:22.446 INFO:tasks.workunit.client.1.smithi131.stdout:4/42: fdatasync d2/da/fd 0 2024-02-15T18:31:22.447 INFO:tasks.workunit.client.1.smithi131.stdout:4/43: creat d2/d7/f13 x:0 0 0 2024-02-15T18:31:22.451 INFO:tasks.workunit.client.1.smithi131.stdout:8/42: dwrite f5 [0,4194304] 0 2024-02-15T18:31:22.453 INFO:tasks.workunit.client.1.smithi131.stdout:1/33: dread d0/d2/d4/f6 [0,4194304] 0 2024-02-15T18:31:22.454 INFO:tasks.workunit.client.1.smithi131.stdout:4/44: rename d2/f6 to d2/d7/f14 0 2024-02-15T18:31:22.454 INFO:tasks.workunit.client.1.smithi131.stdout:4/45: stat d2/d7 0 2024-02-15T18:31:22.455 INFO:tasks.workunit.client.1.smithi131.stdout:8/43: symlink l10 0 2024-02-15T18:31:22.455 INFO:tasks.workunit.client.1.smithi131.stdout:8/44: fsync f5 0 2024-02-15T18:31:22.457 INFO:tasks.workunit.client.1.smithi131.stdout:1/34: mkdir d0/d2/db 0 2024-02-15T18:31:22.457 INFO:tasks.workunit.client.1.smithi131.stdout:7/39: dread d0/f8 [0,4194304] 0 2024-02-15T18:31:22.457 INFO:tasks.workunit.client.1.smithi131.stdout:7/40: readlink d0/l7 0 2024-02-15T18:31:22.457 INFO:tasks.workunit.client.1.smithi131.stdout:4/46: read - d2/f8 zero size 2024-02-15T18:31:22.457 INFO:tasks.workunit.client.1.smithi131.stdout:4/47: stat d2/d7/f11 0 2024-02-15T18:31:22.457 INFO:tasks.workunit.client.1.smithi131.stdout:4/48: dread - d2/d7/fc zero size 2024-02-15T18:31:22.458 INFO:tasks.workunit.client.1.smithi131.stdout:8/45: creat f11 x:0 0 0 2024-02-15T18:31:22.460 INFO:tasks.workunit.client.1.smithi131.stdout:7/41: rename d0/c4 to d0/ca 0 2024-02-15T18:31:22.463 INFO:tasks.workunit.client.1.smithi131.stdout:8/46: mknod c12 0 2024-02-15T18:31:22.463 INFO:tasks.workunit.client.1.smithi131.stdout:5/119: dwrite d18/d24/f26 [0,4194304] 0 2024-02-15T18:31:22.463 INFO:tasks.workunit.client.1.smithi131.stdout:4/49: mknod d2/c15 0 2024-02-15T18:31:22.464 INFO:tasks.workunit.client.1.smithi131.stdout:4/50: readlink d2/le 0 2024-02-15T18:31:22.464 INFO:tasks.workunit.client.1.smithi131.stdout:6/88: dwrite d2/f9 [0,4194304] 0 2024-02-15T18:31:22.464 INFO:tasks.workunit.client.1.smithi131.stdout:6/89: readlink d2/d7/d12/l15 0 2024-02-15T18:31:22.465 INFO:tasks.workunit.client.1.smithi131.stdout:5/120: mknod d18/d24/c27 0 2024-02-15T18:31:22.466 INFO:tasks.workunit.client.1.smithi131.stdout:6/90: rename d2/d7/fb to d2/d7/f1b 0 2024-02-15T18:31:22.466 INFO:tasks.workunit.client.1.smithi131.stdout:6/91: chown d2/d7/f1b 433548 1 2024-02-15T18:31:22.479 INFO:tasks.workunit.client.1.smithi131.stdout:8/47: getdents . 0 2024-02-15T18:31:22.481 INFO:tasks.workunit.client.1.smithi131.stdout:8/48: creat f13 x:0 0 0 2024-02-15T18:31:22.487 INFO:tasks.workunit.client.1.smithi131.stdout:5/121: dread f6 [0,4194304] 0 2024-02-15T18:31:22.488 INFO:tasks.workunit.client.1.smithi131.stdout:5/122: mknod d18/d24/c28 0 2024-02-15T18:31:22.490 INFO:tasks.workunit.client.1.smithi131.stdout:5/123: unlink l14 0 2024-02-15T18:31:22.490 INFO:tasks.workunit.client.1.smithi131.stdout:5/124: stat d18/f1e 0 2024-02-15T18:31:22.491 INFO:tasks.workunit.client.1.smithi131.stdout:5/125: mknod d18/d23/c29 0 2024-02-15T18:31:22.492 INFO:tasks.workunit.client.1.smithi131.stdout:1/35: dwrite d0/d2/d4/f6 [0,4194304] 0 2024-02-15T18:31:22.492 INFO:tasks.workunit.client.1.smithi131.stdout:1/36: fsync d0/d2/d4/f6 0 2024-02-15T18:31:22.495 INFO:tasks.workunit.client.1.smithi131.stdout:3/28: dwrite d2/f7 [0,4194304] 0 2024-02-15T18:31:22.499 INFO:tasks.workunit.client.1.smithi131.stdout:1/37: link d0/d2/d4/f6 d0/d2/d4/da/fc 0 2024-02-15T18:31:22.499 INFO:tasks.workunit.client.1.smithi131.stdout:1/38: chown d0 458044011 1 2024-02-15T18:31:22.500 INFO:tasks.workunit.client.1.smithi131.stdout:7/42: dwrite d0/f8 [4194304,4194304] 0 2024-02-15T18:31:22.502 INFO:tasks.workunit.client.1.smithi131.stdout:1/39: mknod d0/cd 0 2024-02-15T18:31:22.505 INFO:tasks.workunit.client.1.smithi131.stdout:7/43: unlink d0/c6 0 2024-02-15T18:31:22.505 INFO:tasks.workunit.client.1.smithi131.stdout:7/44: fsync d0/f8 0 2024-02-15T18:31:22.508 INFO:tasks.workunit.client.1.smithi131.stdout:7/45: creat d0/fb x:0 0 0 2024-02-15T18:31:22.513 INFO:tasks.workunit.client.1.smithi131.stdout:3/29: dread d2/d3/f6 [0,4194304] 0 2024-02-15T18:31:22.518 INFO:tasks.workunit.client.1.smithi131.stdout:4/51: dread d2/d7/f10 [0,4194304] 0 2024-02-15T18:31:22.521 INFO:tasks.workunit.client.1.smithi131.stdout:4/52: write d2/f4 [1858577,41636] 0 2024-02-15T18:31:22.521 INFO:tasks.workunit.client.1.smithi131.stdout:4/53: write d2/d7/f11 [794715,38685] 0 2024-02-15T18:31:22.522 INFO:tasks.workunit.client.1.smithi131.stdout:1/40: truncate d0/d2/d4/da/fc 3138538 0 2024-02-15T18:31:22.525 INFO:tasks.workunit.client.1.smithi131.stdout:4/54: mkdir d2/da/d16 0 2024-02-15T18:31:22.527 INFO:tasks.workunit.client.1.smithi131.stdout:4/55: link d2/c15 d2/d7/d12/c17 0 2024-02-15T18:31:22.529 INFO:tasks.workunit.client.1.smithi131.stdout:6/92: dwrite f0 [0,4194304] 0 2024-02-15T18:31:22.530 INFO:tasks.workunit.client.1.smithi131.stdout:6/93: chown d2/f13 2984532 1 2024-02-15T18:31:22.530 INFO:tasks.workunit.client.1.smithi131.stdout:6/94: truncate d2/d7/f1b 140717 0 2024-02-15T18:31:22.532 INFO:tasks.workunit.client.1.smithi131.stdout:8/49: dwrite fb [0,4194304] 0 2024-02-15T18:31:22.532 INFO:tasks.workunit.client.1.smithi131.stdout:6/95: creat d2/dc/d19/f1c x:0 0 0 2024-02-15T18:31:22.535 INFO:tasks.workunit.client.1.smithi131.stdout:8/50: truncate f11 890072 0 2024-02-15T18:31:22.535 INFO:tasks.workunit.client.1.smithi131.stdout:6/96: mknod d2/dc/c1d 0 2024-02-15T18:31:22.539 INFO:tasks.workunit.client.1.smithi131.stdout:7/46: dwrite d0/f8 [0,4194304] 0 2024-02-15T18:31:22.543 INFO:tasks.workunit.client.1.smithi131.stdout:7/47: symlink d0/lc 0 2024-02-15T18:31:22.543 INFO:tasks.workunit.client.1.smithi131.stdout:5/126: dwrite f16 [0,4194304] 0 2024-02-15T18:31:22.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/48: creat d0/fd x:0 0 0 2024-02-15T18:31:22.544 INFO:tasks.workunit.client.1.smithi131.stdout:5/127: stat c7 0 2024-02-15T18:31:22.546 INFO:tasks.workunit.client.1.smithi131.stdout:5/128: creat d18/d20/f2a x:0 0 0 2024-02-15T18:31:22.547 INFO:tasks.workunit.client.1.smithi131.stdout:5/129: symlink d18/d23/l2b 0 2024-02-15T18:31:22.548 INFO:tasks.workunit.client.1.smithi131.stdout:3/30: dwrite d2/d3/f6 [0,4194304] 0 2024-02-15T18:31:22.549 INFO:tasks.workunit.client.1.smithi131.stdout:5/130: creat d18/d24/f2c x:0 0 0 2024-02-15T18:31:22.549 INFO:tasks.workunit.client.1.smithi131.stdout:5/131: fdatasync f16 0 2024-02-15T18:31:22.550 INFO:tasks.workunit.client.1.smithi131.stdout:5/132: dread - d18/d24/f2c zero size 2024-02-15T18:31:22.551 INFO:tasks.workunit.client.1.smithi131.stdout:3/31: getdents d2 0 2024-02-15T18:31:22.552 INFO:tasks.workunit.client.1.smithi131.stdout:5/133: mknod d18/d23/c2d 0 2024-02-15T18:31:22.553 INFO:tasks.workunit.client.1.smithi131.stdout:3/32: mkdir d2/d3/db 0 2024-02-15T18:31:22.554 INFO:tasks.workunit.client.1.smithi131.stdout:1/41: write d0/d2/d4/f6 [3062801,84976] 0 2024-02-15T18:31:22.555 INFO:tasks.workunit.client.1.smithi131.stdout:3/33: read d2/f7 [1410256,1894] 0 2024-02-15T18:31:22.556 INFO:tasks.workunit.client.1.smithi131.stdout:3/34: chown d2/f7 2023 1 2024-02-15T18:31:22.556 INFO:tasks.workunit.client.1.smithi131.stdout:1/42: creat d0/d2/fe x:0 0 0 2024-02-15T18:31:22.559 INFO:tasks.workunit.client.1.smithi131.stdout:1/43: mkdir d0/d2/d4/da/df 0 2024-02-15T18:31:22.561 INFO:tasks.workunit.client.1.smithi131.stdout:1/44: rename d0/d2/d4/da/fc to d0/d2/d4/da/f10 0 2024-02-15T18:31:22.565 INFO:tasks.workunit.client.1.smithi131.stdout:5/134: dread fb [0,4194304] 0 2024-02-15T18:31:22.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/45: creat d0/d2/d7/f11 x:0 0 0 2024-02-15T18:31:22.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/46: truncate d0/d2/d7/f11 976492 0 2024-02-15T18:31:22.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/47: stat d0 0 2024-02-15T18:31:22.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/48: truncate d0/d2/d7/f11 1569632 0 2024-02-15T18:31:22.571 INFO:tasks.workunit.client.1.smithi131.stdout:6/97: dwrite d2/f13 [0,4194304] 0 2024-02-15T18:31:22.572 INFO:tasks.workunit.client.1.smithi131.stdout:7/49: getdents d0 0 2024-02-15T18:31:22.572 INFO:tasks.workunit.client.1.smithi131.stdout:5/135: truncate d18/f1e 613916 0 2024-02-15T18:31:22.572 INFO:tasks.workunit.client.1.smithi131.stdout:5/136: chown d18/d20/f2a 1163 1 2024-02-15T18:31:22.573 INFO:tasks.workunit.client.1.smithi131.stdout:8/51: dwrite fd [0,4194304] 0 2024-02-15T18:31:22.578 INFO:tasks.workunit.client.1.smithi131.stdout:3/35: dwrite d2/f7 [4194304,4194304] 0 2024-02-15T18:31:22.591 INFO:tasks.workunit.client.1.smithi131.stdout:1/49: dread d0/f3 [0,4194304] 0 2024-02-15T18:31:22.603 INFO:tasks.workunit.client.1.smithi131.stdout:6/98: dwrite d2/f9 [0,4194304] 0 2024-02-15T18:31:22.622 INFO:tasks.workunit.client.1.smithi131.stdout:6/99: dwrite d2/dc/f14 [0,4194304] 0 2024-02-15T18:31:22.663 INFO:tasks.workunit.client.1.smithi131.stdout:7/50: rename d0/c9 to d0/ce 0 2024-02-15T18:31:22.663 INFO:tasks.workunit.client.1.smithi131.stdout:7/51: dread - d0/fb zero size 2024-02-15T18:31:22.673 INFO:tasks.workunit.client.1.smithi131.stdout:5/137: unlink la 0 2024-02-15T18:31:22.675 INFO:tasks.workunit.client.1.smithi131.stdout:3/36: unlink d2/f7 0 2024-02-15T18:31:22.677 INFO:tasks.workunit.client.1.smithi131.stdout:1/50: link d0/d2/d4/da/f10 d0/d2/f12 0 2024-02-15T18:31:22.692 INFO:tasks.workunit.client.1.smithi131.stdout:6/100: creat d2/d7/d16/f1e x:0 0 0 2024-02-15T18:31:22.695 INFO:tasks.workunit.client.1.smithi131.stdout:7/52: getdents d0 0 2024-02-15T18:31:22.695 INFO:tasks.workunit.client.1.smithi131.stdout:7/53: getdents d0 0 2024-02-15T18:31:22.696 INFO:tasks.workunit.client.1.smithi131.stdout:5/138: rmdir d18/d20 39 2024-02-15T18:31:22.696 INFO:tasks.workunit.client.1.smithi131.stdout:5/139: stat f11 0 2024-02-15T18:31:22.696 INFO:tasks.workunit.client.1.smithi131.stdout:8/52: truncate fe 2787810 0 2024-02-15T18:31:22.696 INFO:tasks.workunit.client.1.smithi131.stdout:8/53: fdatasync f11 0 2024-02-15T18:31:22.699 INFO:tasks.workunit.client.1.smithi131.stdout:5/140: creat d18/d20/f2e x:0 0 0 2024-02-15T18:31:22.699 INFO:tasks.workunit.client.1.smithi131.stdout:3/37: creat d2/fc x:0 0 0 2024-02-15T18:31:22.699 INFO:tasks.workunit.client.1.smithi131.stdout:7/54: read d0/f8 [7125232,123910] 0 2024-02-15T18:31:22.699 INFO:tasks.workunit.client.1.smithi131.stdout:8/54: creat f14 x:0 0 0 2024-02-15T18:31:22.700 INFO:tasks.workunit.client.1.smithi131.stdout:3/38: symlink d2/d8/ld 0 2024-02-15T18:31:22.700 INFO:tasks.workunit.client.1.smithi131.stdout:3/39: write d2/d3/f6 [4683091,85270] 0 2024-02-15T18:31:22.700 INFO:tasks.workunit.client.1.smithi131.stdout:3/40: fdatasync d2/fc 0 2024-02-15T18:31:22.702 INFO:tasks.workunit.client.1.smithi131.stdout:5/141: creat d18/d20/f2f x:0 0 0 2024-02-15T18:31:22.704 INFO:tasks.workunit.client.1.smithi131.stdout:7/55: rename d0/ca to d0/cf 0 2024-02-15T18:31:22.706 INFO:tasks.workunit.client.1.smithi131.stdout:3/41: creat d2/d8/fe x:0 0 0 2024-02-15T18:31:22.706 INFO:tasks.workunit.client.1.smithi131.stdout:7/56: mkdir d0/d10 0 2024-02-15T18:31:22.708 INFO:tasks.workunit.client.1.smithi131.stdout:3/42: rename d2/d3/c4 to d2/cf 0 2024-02-15T18:31:22.708 INFO:tasks.workunit.client.1.smithi131.stdout:7/57: rmdir d0/d10 0 2024-02-15T18:31:22.712 INFO:tasks.workunit.client.1.smithi131.stdout:2/18: sync 2024-02-15T18:31:22.712 INFO:tasks.workunit.client.1.smithi131.stdout:0/52: sync 2024-02-15T18:31:22.712 INFO:tasks.workunit.client.1.smithi131.stdout:2/19: chown c0 585 1 2024-02-15T18:31:22.712 INFO:tasks.workunit.client.1.smithi131.stdout:2/20: chown c0 3574192 1 2024-02-15T18:31:22.713 INFO:tasks.workunit.client.1.smithi131.stdout:1/51: dwrite d0/d2/d4/f6 [0,4194304] 0 2024-02-15T18:31:22.713 INFO:tasks.workunit.client.1.smithi131.stdout:1/52: readlink d0/d2/d4/l8 0 2024-02-15T18:31:22.713 INFO:tasks.workunit.client.1.smithi131.stdout:7/58: read d0/f8 [3583692,85679] 0 2024-02-15T18:31:22.714 INFO:tasks.workunit.client.1.smithi131.stdout:3/43: unlink d2/d8/ca 0 2024-02-15T18:31:22.714 INFO:tasks.workunit.client.1.smithi131.stdout:3/44: readlink d2/d8/ld 0 2024-02-15T18:31:22.714 INFO:tasks.workunit.client.1.smithi131.stdout:2/21: stat c1 0 2024-02-15T18:31:22.714 INFO:tasks.workunit.client.1.smithi131.stdout:2/22: truncate - no filename 2024-02-15T18:31:22.716 INFO:tasks.workunit.client.1.smithi131.stdout:6/101: dwrite d2/d7/fa [0,4194304] 0 2024-02-15T18:31:22.717 INFO:tasks.workunit.client.1.smithi131.stdout:6/102: mkdir d2/dc/d1f 0 2024-02-15T18:31:22.719 INFO:tasks.workunit.client.1.smithi131.stdout:7/59: write d0/f1 [2298694,75890] 0 2024-02-15T18:31:22.720 INFO:tasks.workunit.client.1.smithi131.stdout:1/53: write d0/f3 [265739,7894] 0 2024-02-15T18:31:22.721 INFO:tasks.workunit.client.1.smithi131.stdout:7/60: rename d0/lc to d0/l11 0 2024-02-15T18:31:22.721 INFO:tasks.workunit.client.1.smithi131.stdout:7/61: readlink d0/l11 0 2024-02-15T18:31:22.722 INFO:tasks.workunit.client.1.smithi131.stdout:6/103: dread d2/d7/f1b [0,4194304] 0 2024-02-15T18:31:22.722 INFO:tasks.workunit.client.1.smithi131.stdout:6/104: chown d2/fe 36858201 1 2024-02-15T18:31:22.722 INFO:tasks.workunit.client.1.smithi131.stdout:6/105: write d2/f1a [852214,70263] 0 2024-02-15T18:31:22.723 INFO:tasks.workunit.client.1.smithi131.stdout:6/106: link d2/d7/c10 d2/c20 0 2024-02-15T18:31:22.728 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:21.527614+0000 mgr.smithi131.buibla (mgr.24387) 40 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 72 MiB/s rd, 164 MiB/s wr, 247 op/s 2024-02-15T18:31:22.731 INFO:tasks.workunit.client.1.smithi131.stdout:5/142: dwrite fb [4194304,4194304] 0 2024-02-15T18:31:22.732 INFO:tasks.workunit.client.1.smithi131.stdout:5/143: creat d18/d23/f30 x:0 0 0 2024-02-15T18:31:22.732 INFO:tasks.workunit.client.1.smithi131.stdout:5/144: chown d18 73 1 2024-02-15T18:31:22.735 INFO:tasks.workunit.client.1.smithi131.stdout:5/145: unlink d18/d23/c29 0 2024-02-15T18:31:22.735 INFO:tasks.workunit.client.1.smithi131.stdout:5/146: truncate d18/d20/f2a 228112 0 2024-02-15T18:31:22.735 INFO:tasks.workunit.client.1.smithi131.stdout:5/147: chown d18/c1c 130971 1 2024-02-15T18:31:22.736 INFO:tasks.workunit.client.1.smithi131.stdout:5/148: symlink d18/d23/l31 0 2024-02-15T18:31:22.737 INFO:tasks.workunit.client.1.smithi131.stdout:5/149: creat d18/d23/f32 x:0 0 0 2024-02-15T18:31:22.740 INFO:tasks.workunit.client.1.smithi131.stdout:1/54: dwrite d0/d2/f5 [4194304,4194304] 0 2024-02-15T18:31:22.744 INFO:tasks.workunit.client.1.smithi131.stdout:1/55: mknod d0/d2/d7/c13 0 2024-02-15T18:31:22.748 INFO:tasks.workunit.client.1.smithi131.stdout:0/53: dwrite d5/fc [0,4194304] 0 2024-02-15T18:31:22.750 INFO:tasks.workunit.client.1.smithi131.stdout:7/62: dread d0/f1 [4194304,4194304] 0 2024-02-15T18:31:22.751 INFO:tasks.workunit.client.1.smithi131.stdout:7/63: fsync d0/fd 0 2024-02-15T18:31:22.751 INFO:tasks.workunit.client.1.smithi131.stdout:3/45: dread d2/d3/f6 [0,4194304] 0 2024-02-15T18:31:22.751 INFO:tasks.workunit.client.1.smithi131.stdout:3/46: chown c1 232418499 1 2024-02-15T18:31:22.758 INFO:tasks.workunit.client.1.smithi131.stdout:5/150: dwrite d18/f1e [0,4194304] 0 2024-02-15T18:31:22.760 INFO:tasks.workunit.client.1.smithi131.stdout:5/151: dread f16 [4194304,4194304] 0 2024-02-15T18:31:22.760 INFO:tasks.workunit.client.1.smithi131.stdout:5/152: stat d18/d24/f26 0 2024-02-15T18:31:22.762 INFO:tasks.workunit.client.1.smithi131.stdout:1/56: dread d0/f3 [0,4194304] 0 2024-02-15T18:31:22.764 INFO:tasks.workunit.client.1.smithi131.stdout:7/64: unlink d0/f8 0 2024-02-15T18:31:22.764 INFO:tasks.workunit.client.1.smithi131.stdout:3/47: rename c1 to d2/d3/c10 0 2024-02-15T18:31:22.765 INFO:tasks.workunit.client.1.smithi131.stdout:7/65: read d0/f1 [3236164,14729] 0 2024-02-15T18:31:22.770 INFO:tasks.workunit.client.1.smithi131.stdout:5/153: mkdir d18/d33 0 2024-02-15T18:31:22.770 INFO:tasks.workunit.client.1.smithi131.stdout:1/57: mknod d0/c14 0 2024-02-15T18:31:22.772 INFO:tasks.workunit.client.1.smithi131.stdout:3/48: creat d2/d8/f11 x:0 0 0 2024-02-15T18:31:22.774 INFO:tasks.workunit.client.1.smithi131.stdout:7/66: mknod d0/c12 0 2024-02-15T18:31:22.776 INFO:tasks.workunit.client.1.smithi131.stdout:1/58: mknod d0/c15 0 2024-02-15T18:31:22.776 INFO:tasks.workunit.client.1.smithi131.stdout:5/154: write d18/d24/f26 [1335910,93082] 0 2024-02-15T18:31:22.779 INFO:tasks.workunit.client.1.smithi131.stdout:3/49: symlink d2/d3/l12 0 2024-02-15T18:31:22.779 INFO:tasks.workunit.client.1.smithi131.stdout:3/50: write d2/d3/f6 [4949511,56354] 0 2024-02-15T18:31:22.779 INFO:tasks.workunit.client.1.smithi131.stdout:3/51: truncate d2/fc 444242 0 2024-02-15T18:31:22.780 INFO:tasks.workunit.client.1.smithi131.stdout:7/67: rename d0/cf to d0/c13 0 2024-02-15T18:31:22.786 INFO:tasks.workunit.client.1.smithi131.stdout:7/68: link d0/fd d0/f14 0 2024-02-15T18:31:22.787 INFO:tasks.workunit.client.1.smithi131.stdout:5/155: link d18/d23/l2b d18/d20/l34 0 2024-02-15T18:31:22.787 INFO:tasks.workunit.client.1.smithi131.stdout:5/156: dread - d18/d23/f32 zero size 2024-02-15T18:31:22.788 INFO:tasks.workunit.client.1.smithi131.stdout:5/157: creat d18/d20/f35 x:0 0 0 2024-02-15T18:31:22.788 INFO:tasks.workunit.client.1.smithi131.stdout:0/54: dwrite d5/fc [0,4194304] 0 2024-02-15T18:31:22.800 INFO:tasks.workunit.client.1.smithi131.stdout:1/59: dwrite d0/d2/f9 [0,4194304] 0 2024-02-15T18:31:22.803 INFO:tasks.workunit.client.1.smithi131.stdout:7/69: fsync d0/f14 0 2024-02-15T18:31:22.803 INFO:tasks.workunit.client.1.smithi131.stdout:7/70: chown d0/ce 25 1 2024-02-15T18:31:22.803 INFO:tasks.workunit.client.1.smithi131.stdout:7/71: truncate d0/fb 693182 0 2024-02-15T18:31:22.805 INFO:tasks.workunit.client.1.smithi131.stdout:5/158: write f17 [2829835,99272] 0 2024-02-15T18:31:22.807 INFO:tasks.workunit.client.1.smithi131.stdout:1/60: rename d0/d2/d4/da/df to d0/d1/d16 0 2024-02-15T18:31:22.807 INFO:tasks.workunit.client.1.smithi131.stdout:1/61: chown d0/d1/d16 11214 1 2024-02-15T18:31:22.807 INFO:tasks.workunit.client.1.smithi131.stdout:7/72: stat d0/l11 0 2024-02-15T18:31:22.809 INFO:tasks.workunit.client.1.smithi131.stdout:5/159: rename l15 to d18/d24/l36 0 2024-02-15T18:31:22.809 INFO:tasks.workunit.client.1.smithi131.stdout:1/62: rmdir d0/d1 39 2024-02-15T18:31:22.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/63: write d0/d2/d7/f11 [606649,99626] 0 2024-02-15T18:31:22.811 INFO:tasks.workunit.client.1.smithi131.stdout:7/73: truncate d0/f1 1996793 0 2024-02-15T18:31:22.811 INFO:tasks.workunit.client.1.smithi131.stdout:7/74: truncate d0/f14 511389 0 2024-02-15T18:31:22.811 INFO:tasks.workunit.client.1.smithi131.stdout:7/75: write d0/f14 [282807,11302] 0 2024-02-15T18:31:22.812 INFO:tasks.workunit.client.1.smithi131.stdout:5/160: symlink d18/d20/l37 0 2024-02-15T18:31:22.838 INFO:tasks.workunit.client.1.smithi131.stdout:1/64: dwrite d0/d2/d7/f11 [0,4194304] 0 2024-02-15T18:31:22.840 INFO:tasks.workunit.client.1.smithi131.stdout:1/65: write d0/d2/d7/f11 [1569397,117895] 0 2024-02-15T18:31:22.840 INFO:tasks.workunit.client.1.smithi131.stdout:1/66: fdatasync d0/d2/d4/da/f10 0 2024-02-15T18:31:22.845 INFO:tasks.workunit.client.1.smithi131.stdout:7/76: dwrite d0/f14 [0,4194304] 0 2024-02-15T18:31:22.846 INFO:tasks.workunit.client.1.smithi131.stdout:5/161: dwrite f6 [0,4194304] 0 2024-02-15T18:31:22.848 INFO:tasks.workunit.client.1.smithi131.stdout:5/162: creat d18/d24/f38 x:0 0 0 2024-02-15T18:31:22.855 INFO:tasks.workunit.client.1.smithi131.stdout:7/77: truncate d0/f14 3374260 0 2024-02-15T18:31:22.857 INFO:tasks.workunit.client.1.smithi131.stdout:7/78: rename d0/f1 to d0/f15 0 2024-02-15T18:31:22.865 INFO:tasks.workunit.client.1.smithi131.stdout:1/67: dwrite d0/d2/d7/f11 [0,4194304] 0 2024-02-15T18:31:22.865 INFO:tasks.workunit.client.1.smithi131.stdout:1/68: fsync d0/d2/f12 0 2024-02-15T18:31:22.868 INFO:tasks.workunit.client.1.smithi131.stdout:5/163: dread f17 [0,4194304] 0 2024-02-15T18:31:22.868 INFO:tasks.workunit.client.1.smithi131.stdout:5/164: fdatasync f6 0 2024-02-15T18:31:22.868 INFO:tasks.workunit.client.1.smithi131.stdout:1/69: unlink d0/d2/fe 0 2024-02-15T18:31:22.868 INFO:tasks.workunit.client.1.smithi131.stdout:5/165: truncate f16 388725 0 2024-02-15T18:31:22.870 INFO:tasks.workunit.client.1.smithi131.stdout:1/70: symlink d0/d2/d4/l17 0 2024-02-15T18:31:22.871 INFO:tasks.workunit.client.1.smithi131.stdout:5/166: rmdir d18/d23 39 2024-02-15T18:31:22.871 INFO:tasks.workunit.client.1.smithi131.stdout:5/167: write d18/f1e [4663472,44641] 0 2024-02-15T18:31:22.872 INFO:tasks.workunit.client.1.smithi131.stdout:1/71: getdents d0/d2/d4/da 0 2024-02-15T18:31:22.873 INFO:tasks.workunit.client.1.smithi131.stdout:1/72: fdatasync d0/d2/d7/f11 0 2024-02-15T18:31:22.875 INFO:tasks.workunit.client.1.smithi131.stdout:5/168: dread d18/d20/f2a [0,4194304] 0 2024-02-15T18:31:22.883 INFO:tasks.workunit.client.1.smithi131.stdout:1/73: dread d0/d2/d7/f11 [0,4194304] 0 2024-02-15T18:31:22.885 INFO:tasks.workunit.client.1.smithi131.stdout:7/79: dread d0/fd [0,4194304] 0 2024-02-15T18:31:22.888 INFO:tasks.workunit.client.1.smithi131.stdout:7/80: creat d0/f16 x:0 0 0 2024-02-15T18:31:22.896 INFO:tasks.workunit.client.1.smithi131.stdout:5/169: dwrite d18/d20/f35 [0,4194304] 0 2024-02-15T18:31:22.899 INFO:tasks.workunit.client.1.smithi131.stdout:5/170: getdents d18/d23 0 2024-02-15T18:31:22.930 INFO:tasks.workunit.client.1.smithi131.stdout:7/81: dwrite d0/fd [0,4194304] 0 2024-02-15T18:31:22.930 INFO:tasks.workunit.client.1.smithi131.stdout:5/171: dwrite fb [4194304,4194304] 0 2024-02-15T18:31:22.930 INFO:tasks.workunit.client.1.smithi131.stdout:5/172: dread - d18/d20/f2e zero size 2024-02-15T18:31:22.930 INFO:tasks.workunit.client.1.smithi131.stdout:5/173: chown d18/d23/f32 10 1 2024-02-15T18:31:22.931 INFO:tasks.workunit.client.1.smithi131.stdout:1/74: dwrite d0/d2/f12 [0,4194304] 0 2024-02-15T18:31:22.931 INFO:tasks.workunit.client.1.smithi131.stdout:7/82: rmdir d0 39 2024-02-15T18:31:22.932 INFO:tasks.workunit.client.1.smithi131.stdout:5/174: symlink d18/d24/l39 0 2024-02-15T18:31:22.932 INFO:tasks.workunit.client.1.smithi131.stdout:5/175: stat d18/l21 0 2024-02-15T18:31:22.976 INFO:tasks.workunit.client.1.smithi131.stdout:7/83: mkdir d0/d17 0 2024-02-15T18:31:22.980 INFO:tasks.workunit.client.1.smithi131.stdout:5/176: rename d18/f1b to d18/d23/f3a 0 2024-02-15T18:31:22.983 INFO:tasks.workunit.client.1.smithi131.stdout:7/84: symlink d0/d17/l18 0 2024-02-15T18:31:22.984 INFO:tasks.workunit.client.1.smithi131.stdout:5/177: mknod d18/d23/c3b 0 2024-02-15T18:31:22.985 INFO:tasks.workunit.client.1.smithi131.stdout:7/85: creat d0/f19 x:0 0 0 2024-02-15T18:31:22.987 INFO:tasks.workunit.client.1.smithi131.stdout:5/178: link d18/d24/c27 d18/d33/c3c 0 2024-02-15T18:31:22.990 INFO:tasks.workunit.client.1.smithi131.stdout:1/75: truncate d0/d2/f12 3923213 0 2024-02-15T18:31:22.991 INFO:tasks.workunit.client.1.smithi131.stdout:5/179: truncate f6 6229006 0 2024-02-15T18:31:22.991 INFO:tasks.workunit.client.1.smithi131.stdout:5/180: chown d18/d24/c28 240842 1 2024-02-15T18:31:22.993 INFO:tasks.workunit.client.1.smithi131.stdout:7/86: getdents d0/d17 0 2024-02-15T18:31:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:21.527614+0000 mgr.smithi131.buibla (mgr.24387) 40 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 72 MiB/s rd, 164 MiB/s wr, 247 op/s 2024-02-15T18:31:22.999 INFO:tasks.workunit.client.1.smithi131.stdout:1/76: write d0/d2/f12 [3113325,15742] 0 2024-02-15T18:31:23.001 INFO:tasks.workunit.client.1.smithi131.stdout:1/77: truncate d0/d2/f9 3290876 0 2024-02-15T18:31:23.002 INFO:tasks.workunit.client.1.smithi131.stdout:1/78: mknod d0/d2/d4/c18 0 2024-02-15T18:31:23.003 INFO:tasks.workunit.client.1.smithi131.stdout:1/79: mkdir d0/d1/d16/d19 0 2024-02-15T18:31:23.004 INFO:tasks.workunit.client.1.smithi131.stdout:7/87: dread d0/fd [0,4194304] 0 2024-02-15T18:31:23.004 INFO:tasks.workunit.client.1.smithi131.stdout:7/88: write d0/f19 [22975,73321] 0 2024-02-15T18:31:23.004 INFO:tasks.workunit.client.1.smithi131.stdout:1/80: mknod d0/d2/d4/c1a 0 2024-02-15T18:31:23.005 INFO:tasks.workunit.client.1.smithi131.stdout:7/89: mknod d0/c1a 0 2024-02-15T18:31:23.006 INFO:tasks.workunit.client.1.smithi131.stdout:1/81: creat d0/d1/d16/d19/f1b x:0 0 0 2024-02-15T18:31:23.008 INFO:tasks.workunit.client.1.smithi131.stdout:7/90: creat d0/f1b x:0 0 0 2024-02-15T18:31:23.010 INFO:tasks.workunit.client.1.smithi131.stdout:7/91: rename d0/c13 to d0/c1c 0 2024-02-15T18:31:23.012 INFO:tasks.workunit.client.1.smithi131.stdout:7/92: mknod d0/d17/c1d 0 2024-02-15T18:31:23.012 INFO:tasks.workunit.client.1.smithi131.stdout:7/93: write d0/f19 [371326,48451] 0 2024-02-15T18:31:23.012 INFO:tasks.workunit.client.1.smithi131.stdout:7/94: stat d0/c2 0 2024-02-15T18:31:23.012 INFO:tasks.workunit.client.1.smithi131.stdout:7/95: truncate d0/f1b 1012254 0 2024-02-15T18:31:23.014 INFO:tasks.workunit.client.1.smithi131.stdout:1/82: rmdir d0/d1/d16/d19 39 2024-02-15T18:31:23.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/96: link d0/f15 d0/d17/f1e 0 2024-02-15T18:31:23.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/97: chown d0/fd 41569893 1 2024-02-15T18:31:23.021 INFO:tasks.workunit.client.1.smithi131.stdout:7/98: getdents d0/d17 0 2024-02-15T18:31:23.021 INFO:tasks.workunit.client.1.smithi131.stdout:7/99: write d0/f1b [999539,52518] 0 2024-02-15T18:31:23.023 INFO:tasks.workunit.client.1.smithi131.stdout:7/100: link d0/l7 d0/d17/l1f 0 2024-02-15T18:31:23.025 INFO:tasks.workunit.client.1.smithi131.stdout:7/101: creat d0/f20 x:0 0 0 2024-02-15T18:31:23.026 INFO:tasks.workunit.client.1.smithi131.stdout:7/102: creat d0/d17/f21 x:0 0 0 2024-02-15T18:31:23.028 INFO:tasks.workunit.client.1.smithi131.stdout:7/103: symlink d0/l22 0 2024-02-15T18:31:23.029 INFO:tasks.workunit.client.1.smithi131.stdout:7/104: creat d0/d17/f23 x:0 0 0 2024-02-15T18:31:23.029 INFO:tasks.workunit.client.1.smithi131.stdout:7/105: write d0/f20 [391284,85626] 0 2024-02-15T18:31:23.030 INFO:tasks.workunit.client.1.smithi131.stdout:7/106: link d0/f15 d0/f24 0 2024-02-15T18:31:23.035 INFO:tasks.workunit.client.1.smithi131.stdout:7/107: dread d0/f1b [0,4194304] 0 2024-02-15T18:31:23.036 INFO:tasks.workunit.client.1.smithi131.stdout:1/83: dwrite d0/d2/d7/f11 [4194304,4194304] 0 2024-02-15T18:31:23.038 INFO:tasks.workunit.client.1.smithi131.stdout:1/84: creat d0/d2/f1c x:0 0 0 2024-02-15T18:31:23.039 INFO:tasks.workunit.client.1.smithi131.stdout:1/85: read d0/d2/d4/da/f10 [3273548,35947] 0 2024-02-15T18:31:23.039 INFO:tasks.workunit.client.1.smithi131.stdout:1/86: mknod d0/d2/c1d 0 2024-02-15T18:31:23.043 INFO:tasks.workunit.client.1.smithi131.stdout:1/87: creat d0/d2/d7/f1e x:0 0 0 2024-02-15T18:31:23.061 INFO:tasks.workunit.client.1.smithi131.stdout:7/108: dwrite d0/f14 [0,4194304] 0 2024-02-15T18:31:23.061 INFO:tasks.workunit.client.1.smithi131.stdout:1/88: dwrite d0/d2/d7/f1e [0,4194304] 0 2024-02-15T18:31:23.064 INFO:tasks.workunit.client.1.smithi131.stdout:1/89: rename d0/d2/d7/f11 to d0/d2/d4/da/f1f 0 2024-02-15T18:31:23.065 INFO:tasks.workunit.client.1.smithi131.stdout:1/90: fdatasync d0/d2/f1c 0 2024-02-15T18:31:23.095 INFO:tasks.workunit.client.1.smithi131.stdout:7/109: dwrite d0/d17/f1e [0,4194304] 0 2024-02-15T18:31:23.096 INFO:tasks.workunit.client.1.smithi131.stdout:7/110: mknod d0/c25 0 2024-02-15T18:31:23.097 INFO:tasks.workunit.client.1.smithi131.stdout:7/111: dread - d0/d17/f23 zero size 2024-02-15T18:31:23.097 INFO:tasks.workunit.client.1.smithi131.stdout:7/112: creat d0/d17/f26 x:0 0 0 2024-02-15T18:31:23.098 INFO:tasks.workunit.client.1.smithi131.stdout:7/113: creat d0/f27 x:0 0 0 2024-02-15T18:31:23.099 INFO:tasks.workunit.client.1.smithi131.stdout:7/114: creat d0/f28 x:0 0 0 2024-02-15T18:31:23.100 INFO:tasks.workunit.client.1.smithi131.stdout:7/115: mknod d0/d17/c29 0 2024-02-15T18:31:23.100 INFO:tasks.workunit.client.1.smithi131.stdout:7/116: chown d0/d17 169396803 1 2024-02-15T18:31:23.101 INFO:tasks.workunit.client.1.smithi131.stdout:7/117: write d0/d17/f26 [775857,60191] 0 2024-02-15T18:31:23.101 INFO:tasks.workunit.client.1.smithi131.stdout:7/118: truncate d0/f27 987502 0 2024-02-15T18:31:23.101 INFO:tasks.workunit.client.1.smithi131.stdout:7/119: mknod d0/c2a 0 2024-02-15T18:31:23.103 INFO:tasks.workunit.client.1.smithi131.stdout:7/120: write d0/f15 [1882115,117817] 0 2024-02-15T18:31:23.103 INFO:tasks.workunit.client.1.smithi131.stdout:1/91: dwrite d0/d2/d4/f6 [0,4194304] 0 2024-02-15T18:31:23.104 INFO:tasks.workunit.client.1.smithi131.stdout:7/121: mknod d0/c2b 0 2024-02-15T18:31:23.110 INFO:tasks.workunit.client.1.smithi131.stdout:1/92: creat d0/d1/d16/f20 x:0 0 0 2024-02-15T18:31:23.110 INFO:tasks.workunit.client.1.smithi131.stdout:7/122: readlink d0/d17/l18 0 2024-02-15T18:31:23.117 INFO:tasks.workunit.client.1.smithi131.stdout:7/123: getdents d0/d17 0 2024-02-15T18:31:23.120 INFO:tasks.workunit.client.1.smithi131.stdout:1/93: truncate d0/d2/d4/f6 3714449 0 2024-02-15T18:31:23.120 INFO:tasks.workunit.client.1.smithi131.stdout:1/94: stat d0/d2/d4/l8 0 2024-02-15T18:31:23.120 INFO:tasks.workunit.client.1.smithi131.stdout:1/95: rename d0 to d0/d2/d21 22 2024-02-15T18:31:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:7/124: dread d0/fb [0,4194304] 0 2024-02-15T18:31:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:7/125: write d0/d17/f21 [250197,82661] 0 2024-02-15T18:31:23.129 INFO:tasks.workunit.client.1.smithi131.stdout:7/126: write d0/f14 [3830022,96165] 0 2024-02-15T18:31:23.137 INFO:tasks.workunit.client.1.smithi131.stdout:1/96: dwrite d0/d2/f1c [0,4194304] 0 2024-02-15T18:31:23.138 INFO:tasks.workunit.client.1.smithi131.stdout:1/97: write d0/d2/d7/f1e [1145507,15269] 0 2024-02-15T18:31:23.142 INFO:tasks.workunit.client.1.smithi131.stdout:1/98: write d0/d2/d4/da/f10 [1620062,123594] 0 2024-02-15T18:31:23.143 INFO:tasks.workunit.client.1.smithi131.stdout:1/99: creat d0/f22 x:0 0 0 2024-02-15T18:31:23.144 INFO:tasks.workunit.client.1.smithi131.stdout:1/100: read d0/d2/f9 [2368252,40386] 0 2024-02-15T18:31:23.144 INFO:tasks.workunit.client.1.smithi131.stdout:1/101: write d0/d2/d7/f1e [4484924,52561] 0 2024-02-15T18:31:23.147 INFO:tasks.workunit.client.1.smithi131.stdout:7/127: dread d0/fd [0,4194304] 0 2024-02-15T18:31:23.147 INFO:tasks.workunit.client.1.smithi131.stdout:7/128: dread - d0/d17/f23 zero size 2024-02-15T18:31:23.147 INFO:tasks.workunit.client.1.smithi131.stdout:7/129: fsync d0/f28 0 2024-02-15T18:31:23.148 INFO:tasks.workunit.client.1.smithi131.stdout:7/130: symlink d0/d17/l2c 0 2024-02-15T18:31:23.148 INFO:tasks.workunit.client.1.smithi131.stdout:7/131: fdatasync d0/d17/f23 0 2024-02-15T18:31:23.148 INFO:tasks.workunit.client.1.smithi131.stdout:7/132: fdatasync d0/f1b 0 2024-02-15T18:31:23.149 INFO:tasks.workunit.client.1.smithi131.stdout:7/133: write d0/f15 [2999862,5461] 0 2024-02-15T18:31:23.150 INFO:tasks.workunit.client.1.smithi131.stdout:7/134: symlink d0/l2d 0 2024-02-15T18:31:23.156 INFO:tasks.workunit.client.1.smithi131.stdout:1/102: dread d0/d2/d4/f6 [0,4194304] 0 2024-02-15T18:31:23.172 INFO:tasks.workunit.client.1.smithi131.stdout:7/135: dwrite d0/f14 [0,4194304] 0 2024-02-15T18:31:23.173 INFO:tasks.workunit.client.1.smithi131.stdout:7/136: rename d0/f27 to d0/f2e 0 2024-02-15T18:31:23.180 INFO:tasks.workunit.client.1.smithi131.stdout:7/137: getdents d0 0 2024-02-15T18:31:23.180 INFO:tasks.workunit.client.1.smithi131.stdout:7/138: write d0/d17/f26 [1374303,128823] 0 2024-02-15T18:31:23.181 INFO:tasks.workunit.client.1.smithi131.stdout:7/139: dread d0/fb [0,4194304] 0 2024-02-15T18:31:23.182 INFO:tasks.workunit.client.1.smithi131.stdout:7/140: unlink d0/f28 0 2024-02-15T18:31:23.183 INFO:tasks.workunit.client.1.smithi131.stdout:7/141: truncate d0/f16 619894 0 2024-02-15T18:31:23.183 INFO:tasks.workunit.client.1.smithi131.stdout:7/142: dread d0/fb [0,4194304] 0 2024-02-15T18:31:23.183 INFO:tasks.workunit.client.1.smithi131.stdout:7/143: truncate d0/f2e 1437441 0 2024-02-15T18:31:23.183 INFO:tasks.workunit.client.1.smithi131.stdout:7/144: readlink d0/l2d 0 2024-02-15T18:31:23.183 INFO:tasks.workunit.client.1.smithi131.stdout:7/145: chown d0/ce 150389 1 2024-02-15T18:31:23.184 INFO:tasks.workunit.client.1.smithi131.stdout:7/146: symlink d0/l2f 0 2024-02-15T18:31:23.185 INFO:tasks.workunit.client.1.smithi131.stdout:7/147: unlink d0/f20 0 2024-02-15T18:31:23.187 INFO:tasks.workunit.client.1.smithi131.stdout:4/56: sync 2024-02-15T18:31:23.187 INFO:tasks.workunit.client.1.smithi131.stdout:4/57: dread - d2/d7/ff zero size 2024-02-15T18:31:23.187 INFO:tasks.workunit.client.1.smithi131.stdout:9/44: sync 2024-02-15T18:31:23.190 INFO:tasks.workunit.client.1.smithi131.stdout:4/58: symlink d2/d7/l18 0 2024-02-15T18:31:23.190 INFO:tasks.workunit.client.1.smithi131.stdout:4/59: chown d2/f8 1219 1 2024-02-15T18:31:23.190 INFO:tasks.workunit.client.1.smithi131.stdout:1/103: dwrite d0/d2/d7/f1e [0,4194304] 0 2024-02-15T18:31:23.193 INFO:tasks.workunit.client.1.smithi131.stdout:4/60: creat d2/da/f19 x:0 0 0 2024-02-15T18:31:23.193 INFO:tasks.workunit.client.1.smithi131.stdout:1/104: link d0/d1/d16/f20 d0/d2/db/f23 0 2024-02-15T18:31:23.193 INFO:tasks.workunit.client.1.smithi131.stdout:1/105: readlink d0/d2/d4/l8 0 2024-02-15T18:31:23.194 INFO:tasks.workunit.client.1.smithi131.stdout:4/61: creat d2/f1a x:0 0 0 2024-02-15T18:31:23.194 INFO:tasks.workunit.client.1.smithi131.stdout:4/62: rename d2/da to d2/da/d1b 22 2024-02-15T18:31:23.195 INFO:tasks.workunit.client.1.smithi131.stdout:1/106: mkdir d0/d1/d24 0 2024-02-15T18:31:23.196 INFO:tasks.workunit.client.1.smithi131.stdout:4/63: mkdir d2/d7/d1c 0 2024-02-15T18:31:23.196 INFO:tasks.workunit.client.1.smithi131.stdout:4/64: chown d2/da/cb 1713 1 2024-02-15T18:31:23.197 INFO:tasks.workunit.client.1.smithi131.stdout:1/107: creat d0/d1/d16/f25 x:0 0 0 2024-02-15T18:31:23.198 INFO:tasks.workunit.client.1.smithi131.stdout:4/65: creat d2/d7/f1d x:0 0 0 2024-02-15T18:31:23.198 INFO:tasks.workunit.client.1.smithi131.stdout:1/108: mknod d0/c26 0 2024-02-15T18:31:23.200 INFO:tasks.workunit.client.1.smithi131.stdout:4/66: symlink d2/l1e 0 2024-02-15T18:31:23.200 INFO:tasks.workunit.client.1.smithi131.stdout:4/67: truncate d2/da/f19 241471 0 2024-02-15T18:31:23.200 INFO:tasks.workunit.client.1.smithi131.stdout:4/68: dread - d2/d7/ff zero size 2024-02-15T18:31:23.200 INFO:tasks.workunit.client.1.smithi131.stdout:1/109: read d0/d2/d4/da/f10 [2535112,53201] 0 2024-02-15T18:31:23.205 INFO:tasks.workunit.client.1.smithi131.stdout:1/110: dread d0/d2/d4/da/f10 [0,4194304] 0 2024-02-15T18:31:23.207 INFO:tasks.workunit.client.1.smithi131.stdout:1/111: link d0/d2/d4/f6 d0/f27 0 2024-02-15T18:31:23.208 INFO:tasks.workunit.client.1.smithi131.stdout:7/148: dwrite d0/f19 [0,4194304] 0 2024-02-15T18:31:23.209 INFO:tasks.workunit.client.1.smithi131.stdout:7/149: chown d0/c2a 189 1 2024-02-15T18:31:23.209 INFO:tasks.workunit.client.1.smithi131.stdout:1/112: mkdir d0/d2/d28 0 2024-02-15T18:31:23.209 INFO:tasks.workunit.client.1.smithi131.stdout:9/45: dwrite d4/f9 [0,4194304] 0 2024-02-15T18:31:23.210 INFO:tasks.workunit.client.1.smithi131.stdout:1/113: read d0/f27 [1526298,81421] 0 2024-02-15T18:31:23.210 INFO:tasks.workunit.client.1.smithi131.stdout:7/150: truncate d0/fb 323293 0 2024-02-15T18:31:23.212 INFO:tasks.workunit.client.1.smithi131.stdout:9/46: unlink d4/lf 0 2024-02-15T18:31:23.212 INFO:tasks.workunit.client.1.smithi131.stdout:9/47: chown f1 1002466278 1 2024-02-15T18:31:23.212 INFO:tasks.workunit.client.1.smithi131.stdout:9/48: chown d4/dc/de 7654068 1 2024-02-15T18:31:23.214 INFO:tasks.workunit.client.1.smithi131.stdout:9/49: mkdir d4/dc/d10 0 2024-02-15T18:31:23.214 INFO:tasks.workunit.client.1.smithi131.stdout:7/151: mknod d0/d17/c30 0 2024-02-15T18:31:23.216 INFO:tasks.workunit.client.1.smithi131.stdout:7/152: rename d0/d17/c30 to d0/c31 0 2024-02-15T18:31:23.217 INFO:tasks.workunit.client.1.smithi131.stdout:7/153: truncate d0/fb 1284094 0 2024-02-15T18:31:23.219 INFO:tasks.workunit.client.1.smithi131.stdout:7/154: symlink d0/d17/l32 0 2024-02-15T18:31:23.220 INFO:tasks.workunit.client.1.smithi131.stdout:7/155: mknod d0/d17/c33 0 2024-02-15T18:31:23.221 INFO:tasks.workunit.client.1.smithi131.stdout:7/156: mkdir d0/d34 0 2024-02-15T18:31:23.224 INFO:tasks.workunit.client.1.smithi131.stdout:9/50: dread d4/f9 [0,4194304] 0 2024-02-15T18:31:23.224 INFO:tasks.workunit.client.1.smithi131.stdout:4/69: dwrite d2/f9 [0,4194304] 0 2024-02-15T18:31:23.225 INFO:tasks.workunit.client.1.smithi131.stdout:4/70: readlink d2/d7/l18 0 2024-02-15T18:31:23.225 INFO:tasks.workunit.client.1.smithi131.stdout:9/51: fsync f1 0 2024-02-15T18:31:23.227 INFO:tasks.workunit.client.1.smithi131.stdout:7/157: link d0/d17/f23 d0/d34/f35 0 2024-02-15T18:31:23.228 INFO:tasks.workunit.client.1.smithi131.stdout:7/158: dread - d0/d17/f23 zero size 2024-02-15T18:31:23.233 INFO:tasks.workunit.client.1.smithi131.stdout:1/114: dwrite d0/d2/f1c [0,4194304] 0 2024-02-15T18:31:23.233 INFO:tasks.workunit.client.1.smithi131.stdout:9/52: mknod d4/dc/c11 0 2024-02-15T18:31:23.234 INFO:tasks.workunit.client.1.smithi131.stdout:9/53: write d4/f9 [53132,111165] 0 2024-02-15T18:31:23.235 INFO:tasks.workunit.client.1.smithi131.stdout:9/54: read f1 [358086,55097] 0 2024-02-15T18:31:23.237 INFO:tasks.workunit.client.1.smithi131.stdout:4/71: creat d2/f1f x:0 0 0 2024-02-15T18:31:23.237 INFO:tasks.workunit.client.1.smithi131.stdout:4/72: fsync d2/f9 0 2024-02-15T18:31:23.238 INFO:tasks.workunit.client.1.smithi131.stdout:4/73: truncate d2/f1a 770646 0 2024-02-15T18:31:23.239 INFO:tasks.workunit.client.1.smithi131.stdout:7/159: mkdir d0/d17/d36 0 2024-02-15T18:31:23.240 INFO:tasks.workunit.client.1.smithi131.stdout:1/115: creat d0/d1/f29 x:0 0 0 2024-02-15T18:31:23.244 INFO:tasks.workunit.client.1.smithi131.stdout:9/55: symlink d4/l12 0 2024-02-15T18:31:23.244 INFO:tasks.workunit.client.1.smithi131.stdout:4/74: getdents d2/d7/d12 0 2024-02-15T18:31:23.246 INFO:tasks.workunit.client.1.smithi131.stdout:7/160: rename d0/d17/l32 to d0/d17/d36/l37 0 2024-02-15T18:31:23.247 INFO:tasks.workunit.client.1.smithi131.stdout:7/161: dread d0/fb [0,4194304] 0 2024-02-15T18:31:23.250 INFO:tasks.workunit.client.1.smithi131.stdout:4/75: dread d2/d7/f10 [0,4194304] 0 2024-02-15T18:31:23.251 INFO:tasks.workunit.client.1.smithi131.stdout:9/56: dread f3 [0,4194304] 0 2024-02-15T18:31:23.251 INFO:tasks.workunit.client.1.smithi131.stdout:9/57: truncate d4/da/fb 188179 0 2024-02-15T18:31:23.253 INFO:tasks.workunit.client.1.smithi131.stdout:9/58: dread f1 [0,4194304] 0 2024-02-15T18:31:23.255 INFO:tasks.workunit.client.1.smithi131.stdout:7/162: unlink d0/d17/d36/l37 0 2024-02-15T18:31:23.257 INFO:tasks.workunit.client.1.smithi131.stdout:9/59: creat d4/da/f13 x:0 0 0 2024-02-15T18:31:23.257 INFO:tasks.workunit.client.1.smithi131.stdout:7/163: rmdir d0/d34 39 2024-02-15T18:31:23.257 INFO:tasks.workunit.client.1.smithi131.stdout:7/164: write d0/f15 [5065099,85359] 0 2024-02-15T18:31:23.259 INFO:tasks.workunit.client.1.smithi131.stdout:9/60: creat d4/dc/d10/f14 x:0 0 0 2024-02-15T18:31:23.260 INFO:tasks.workunit.client.1.smithi131.stdout:7/165: mknod d0/d34/c38 0 2024-02-15T18:31:23.260 INFO:tasks.workunit.client.1.smithi131.stdout:7/166: chown d0/f14 11 1 2024-02-15T18:31:23.260 INFO:tasks.workunit.client.1.smithi131.stdout:7/167: fsync d0/d17/f23 0 2024-02-15T18:31:23.260 INFO:tasks.workunit.client.1.smithi131.stdout:7/168: write d0/f24 [5984779,130965] 0 2024-02-15T18:31:23.261 INFO:tasks.workunit.client.1.smithi131.stdout:7/169: mknod d0/d17/d36/c39 0 2024-02-15T18:31:23.262 INFO:tasks.workunit.client.1.smithi131.stdout:7/170: unlink d0/d17/c29 0 2024-02-15T18:31:23.264 INFO:tasks.workunit.client.1.smithi131.stdout:7/171: mkdir d0/d17/d3a 0 2024-02-15T18:31:23.266 INFO:tasks.workunit.client.1.smithi131.stdout:7/172: creat d0/d17/d36/f3b x:0 0 0 2024-02-15T18:31:23.266 INFO:tasks.workunit.client.1.smithi131.stdout:9/61: getdents d4/da 0 2024-02-15T18:31:23.268 INFO:tasks.workunit.client.1.smithi131.stdout:7/173: creat d0/d17/f3c x:0 0 0 2024-02-15T18:31:23.271 INFO:tasks.workunit.client.1.smithi131.stdout:7/174: dread d0/f16 [0,4194304] 0 2024-02-15T18:31:23.271 INFO:tasks.workunit.client.1.smithi131.stdout:7/175: getdents d0/d17/d3a 0 2024-02-15T18:31:23.278 INFO:tasks.workunit.client.1.smithi131.stdout:7/176: truncate d0/fd 917124 0 2024-02-15T18:31:23.281 INFO:tasks.workunit.client.1.smithi131.stdout:7/177: mkdir d0/d17/d3a/d3d 0 2024-02-15T18:31:23.283 INFO:tasks.workunit.client.1.smithi131.stdout:7/178: getdents d0/d17/d36 0 2024-02-15T18:31:23.285 INFO:tasks.workunit.client.1.smithi131.stdout:7/179: rename d0/l2d to d0/d17/d3a/l3e 0 2024-02-15T18:31:23.285 INFO:tasks.workunit.client.1.smithi131.stdout:7/180: fsync d0/f19 0 2024-02-15T18:31:23.285 INFO:tasks.workunit.client.1.smithi131.stdout:7/181: truncate d0/d34/f35 1027043 0 2024-02-15T18:31:23.286 INFO:tasks.workunit.client.1.smithi131.stdout:7/182: creat d0/d17/d36/f3f x:0 0 0 2024-02-15T18:31:23.287 INFO:tasks.workunit.client.1.smithi131.stdout:7/183: mknod d0/d17/d3a/d3d/c40 0 2024-02-15T18:31:23.288 INFO:tasks.workunit.client.1.smithi131.stdout:7/184: dread d0/d34/f35 [0,4194304] 0 2024-02-15T18:31:23.290 INFO:tasks.workunit.client.1.smithi131.stdout:7/185: dread d0/f1b [0,4194304] 0 2024-02-15T18:31:23.290 INFO:tasks.workunit.client.1.smithi131.stdout:7/186: stat d0/d34 0 2024-02-15T18:31:23.291 INFO:tasks.workunit.client.1.smithi131.stdout:9/62: dwrite d4/da/f13 [0,4194304] 0 2024-02-15T18:31:23.294 INFO:tasks.workunit.client.1.smithi131.stdout:7/187: write d0/d17/f1e [3947692,73736] 0 2024-02-15T18:31:23.302 INFO:tasks.workunit.client.1.smithi131.stdout:9/63: rename d4/f9 to d4/dc/d10/f15 0 2024-02-15T18:31:23.304 INFO:tasks.workunit.client.1.smithi131.stdout:9/64: creat d4/dc/d10/f16 x:0 0 0 2024-02-15T18:31:23.304 INFO:tasks.workunit.client.1.smithi131.stdout:9/65: chown d4/l12 1013 1 2024-02-15T18:31:23.304 INFO:tasks.workunit.client.1.smithi131.stdout:9/66: fsync d4/dc/d10/f14 0 2024-02-15T18:31:23.304 INFO:tasks.workunit.client.1.smithi131.stdout:9/67: truncate d4/da/fb 736450 0 2024-02-15T18:31:23.313 INFO:tasks.workunit.client.1.smithi131.stdout:9/68: rename d4/dc/d10 to d4/dc/d17 0 2024-02-15T18:31:23.314 INFO:tasks.workunit.client.1.smithi131.stdout:9/69: symlink d4/dc/d17/l18 0 2024-02-15T18:31:23.317 INFO:tasks.workunit.client.1.smithi131.stdout:7/188: dwrite d0/f1b [0,4194304] 0 2024-02-15T18:31:23.317 INFO:tasks.workunit.client.1.smithi131.stdout:7/189: fdatasync d0/d17/f23 0 2024-02-15T18:31:23.317 INFO:tasks.workunit.client.1.smithi131.stdout:7/190: readlink d0/l2f 0 2024-02-15T18:31:23.318 INFO:tasks.workunit.client.1.smithi131.stdout:7/191: dread - d0/d17/f3c zero size 2024-02-15T18:31:23.326 INFO:tasks.workunit.client.1.smithi131.stdout:9/70: dread d4/da/f13 [0,4194304] 0 2024-02-15T18:31:23.431 INFO:tasks.workunit.client.1.smithi131.stdout:7/192: creat d0/d34/f41 x:0 0 0 2024-02-15T18:31:23.436 INFO:tasks.workunit.client.1.smithi131.stdout:9/71: rename d4/da to d4/dc/d17/d19 0 2024-02-15T18:31:23.438 INFO:tasks.workunit.client.1.smithi131.stdout:7/193: rename d0/f24 to d0/d17/d3a/d3d/f42 0 2024-02-15T18:31:23.440 INFO:tasks.workunit.client.1.smithi131.stdout:7/194: dread d0/f2e [0,4194304] 0 2024-02-15T18:31:23.440 INFO:tasks.workunit.client.1.smithi131.stdout:7/195: write d0/fd [1609520,45173] 0 2024-02-15T18:31:23.440 INFO:tasks.workunit.client.1.smithi131.stdout:7/196: readlink d0/d17/d3a/l3e 0 2024-02-15T18:31:23.441 INFO:tasks.workunit.client.1.smithi131.stdout:7/197: dread d0/f2e [0,4194304] 0 2024-02-15T18:31:23.441 INFO:tasks.workunit.client.1.smithi131.stdout:7/198: chown d0/d17/d36/f3f 504 1 2024-02-15T18:31:23.457 INFO:tasks.workunit.client.1.smithi131.stdout:7/199: rmdir d0/d17 39 2024-02-15T18:31:23.457 INFO:tasks.workunit.client.1.smithi131.stdout:9/72: dwrite f0 [0,4194304] 0 2024-02-15T18:31:23.459 INFO:tasks.workunit.client.1.smithi131.stdout:9/73: symlink d4/dc/d17/l1a 0 2024-02-15T18:31:23.463 INFO:tasks.workunit.client.1.smithi131.stdout:9/74: unlink d4/dc/d17/f15 0 2024-02-15T18:31:23.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/75: mknod d4/dc/de/c1b 0 2024-02-15T18:31:23.466 INFO:tasks.workunit.client.1.smithi131.stdout:9/76: unlink d4/dc/d17/f14 0 2024-02-15T18:31:23.468 INFO:tasks.workunit.client.1.smithi131.stdout:9/77: link d4/c8 d4/dc/d17/d19/c1c 0 2024-02-15T18:31:23.476 INFO:tasks.workunit.client.1.smithi131.stdout:9/78: truncate f0 2621164 0 2024-02-15T18:31:23.476 INFO:tasks.workunit.client.1.smithi131.stdout:9/79: write d4/dc/d17/f16 [474078,42460] 0 2024-02-15T18:31:23.478 INFO:tasks.workunit.client.1.smithi131.stdout:7/200: dwrite d0/f1b [0,4194304] 0 2024-02-15T18:31:23.479 INFO:tasks.workunit.client.1.smithi131.stdout:8/55: sync 2024-02-15T18:31:23.479 INFO:tasks.workunit.client.1.smithi131.stdout:2/23: sync 2024-02-15T18:31:23.479 INFO:tasks.workunit.client.1.smithi131.stdout:6/107: sync 2024-02-15T18:31:23.479 INFO:tasks.workunit.client.1.smithi131.stdout:6/108: chown d2/dc/d19/f1c 290 1 2024-02-15T18:31:23.480 INFO:tasks.workunit.client.1.smithi131.stdout:7/201: creat d0/f43 x:0 0 0 2024-02-15T18:31:23.483 INFO:tasks.workunit.client.1.smithi131.stdout:8/56: readlink l6 0 2024-02-15T18:31:23.483 INFO:tasks.workunit.client.1.smithi131.stdout:8/57: fdatasync fd 0 2024-02-15T18:31:23.485 INFO:tasks.workunit.client.1.smithi131.stdout:2/24: creat f2 x:0 0 0 2024-02-15T18:31:23.485 INFO:tasks.workunit.client.1.smithi131.stdout:2/25: dread - f2 zero size 2024-02-15T18:31:23.485 INFO:tasks.workunit.client.1.smithi131.stdout:2/26: truncate f2 1011648 0 2024-02-15T18:31:23.485 INFO:tasks.workunit.client.1.smithi131.stdout:7/202: mkdir d0/d17/d44 0 2024-02-15T18:31:23.487 INFO:tasks.workunit.client.1.smithi131.stdout:7/203: creat d0/d17/d3a/d3d/f45 x:0 0 0 2024-02-15T18:31:23.492 INFO:tasks.workunit.client.1.smithi131.stdout:7/204: rename d0/d17/d36/c39 to d0/c46 0 2024-02-15T18:31:23.494 INFO:tasks.workunit.client.1.smithi131.stdout:8/58: rename c12 to c15 0 2024-02-15T18:31:23.495 INFO:tasks.workunit.client.1.smithi131.stdout:3/52: sync 2024-02-15T18:31:23.496 INFO:tasks.workunit.client.1.smithi131.stdout:9/80: dread f0 [0,4194304] 0 2024-02-15T18:31:23.496 INFO:tasks.workunit.client.1.smithi131.stdout:9/81: chown f1 34858 1 2024-02-15T18:31:23.497 INFO:tasks.workunit.client.1.smithi131.stdout:3/53: rename d2/fc to d2/f13 0 2024-02-15T18:31:23.497 INFO:tasks.workunit.client.1.smithi131.stdout:9/82: rmdir d4/dc/d17/d19 39 2024-02-15T18:31:23.499 INFO:tasks.workunit.client.1.smithi131.stdout:3/54: rename d2/cf to d2/d3/c14 0 2024-02-15T18:31:23.499 INFO:tasks.workunit.client.1.smithi131.stdout:3/55: write d2/d8/fe [1008793,122506] 0 2024-02-15T18:31:23.500 INFO:tasks.workunit.client.1.smithi131.stdout:9/83: creat d4/dc/de/f1d x:0 0 0 2024-02-15T18:31:23.500 INFO:tasks.workunit.client.1.smithi131.stdout:9/84: chown d4/c5 12059 1 2024-02-15T18:31:23.500 INFO:tasks.workunit.client.1.smithi131.stdout:9/85: write d4/dc/de/f1d [347435,29084] 0 2024-02-15T18:31:23.500 INFO:tasks.workunit.client.1.smithi131.stdout:9/86: chown d4/l12 25039 1 2024-02-15T18:31:23.502 INFO:tasks.workunit.client.1.smithi131.stdout:9/87: dread f0 [0,4194304] 0 2024-02-15T18:31:23.503 INFO:tasks.workunit.client.1.smithi131.stdout:9/88: truncate f3 58431 0 2024-02-15T18:31:23.505 INFO:tasks.workunit.client.1.smithi131.stdout:3/56: write d2/d8/fe [700188,101120] 0 2024-02-15T18:31:23.506 INFO:tasks.workunit.client.1.smithi131.stdout:8/59: write f5 [411303,112578] 0 2024-02-15T18:31:23.506 INFO:tasks.workunit.client.1.smithi131.stdout:8/60: rmdir - no directory 2024-02-15T18:31:23.506 INFO:tasks.workunit.client.1.smithi131.stdout:8/61: rmdir - no directory 2024-02-15T18:31:23.509 INFO:tasks.workunit.client.1.smithi131.stdout:9/89: mkdir d4/dc/de/d1e 0 2024-02-15T18:31:23.512 INFO:tasks.workunit.client.1.smithi131.stdout:3/57: dread d2/d3/f6 [0,4194304] 0 2024-02-15T18:31:23.515 INFO:tasks.workunit.client.1.smithi131.stdout:3/58: mknod d2/d3/db/c15 0 2024-02-15T18:31:23.517 INFO:tasks.workunit.client.1.smithi131.stdout:3/59: link d2/d3/db/c15 d2/c16 0 2024-02-15T18:31:23.521 INFO:tasks.workunit.client.1.smithi131.stdout:7/205: dwrite d0/d17/f1e [4194304,4194304] 0 2024-02-15T18:31:23.523 INFO:tasks.workunit.client.1.smithi131.stdout:9/90: dread f3 [0,4194304] 0 2024-02-15T18:31:23.523 INFO:tasks.workunit.client.1.smithi131.stdout:7/206: creat d0/f47 x:0 0 0 2024-02-15T18:31:23.524 INFO:tasks.workunit.client.1.smithi131.stdout:9/91: mkdir d4/dc/de/d1e/d1f 0 2024-02-15T18:31:23.526 INFO:tasks.workunit.client.1.smithi131.stdout:9/92: getdents d4/dc/d17 0 2024-02-15T18:31:23.526 INFO:tasks.workunit.client.1.smithi131.stdout:9/93: chown d4/dc/d17/d19/f13 682 1 2024-02-15T18:31:23.526 INFO:tasks.workunit.client.1.smithi131.stdout:9/94: fdatasync d4/dc/d17/d19/f13 0 2024-02-15T18:31:23.530 INFO:tasks.workunit.client.1.smithi131.stdout:9/95: write d4/dc/d17/d19/f13 [1175604,121622] 0 2024-02-15T18:31:23.530 INFO:tasks.workunit.client.1.smithi131.stdout:9/96: write d4/dc/d17/f16 [1485639,77968] 0 2024-02-15T18:31:23.532 INFO:tasks.workunit.client.1.smithi131.stdout:8/62: dwrite f13 [0,4194304] 0 2024-02-15T18:31:23.533 INFO:tasks.workunit.client.1.smithi131.stdout:9/97: dread f3 [0,4194304] 0 2024-02-15T18:31:23.533 INFO:tasks.workunit.client.1.smithi131.stdout:9/98: truncate d4/dc/de/f1d 669916 0 2024-02-15T18:31:23.535 INFO:tasks.workunit.client.1.smithi131.stdout:9/99: symlink d4/dc/de/d1e/l20 0 2024-02-15T18:31:23.536 INFO:tasks.workunit.client.1.smithi131.stdout:9/100: write d4/dc/de/f1d [183683,95622] 0 2024-02-15T18:31:23.536 INFO:tasks.workunit.client.1.smithi131.stdout:9/101: stat d4/dc/d17/d19/f13 0 2024-02-15T18:31:23.537 INFO:tasks.workunit.client.1.smithi131.stdout:9/102: rmdir d4/dc/de/d1e 39 2024-02-15T18:31:23.540 INFO:tasks.workunit.client.1.smithi131.stdout:9/103: write d4/dc/d17/d19/f13 [1610522,91844] 0 2024-02-15T18:31:23.540 INFO:tasks.workunit.client.1.smithi131.stdout:7/207: dwrite d0/d17/d3a/d3d/f45 [0,4194304] 0 2024-02-15T18:31:23.541 INFO:tasks.workunit.client.1.smithi131.stdout:8/63: write f5 [93398,99994] 0 2024-02-15T18:31:23.541 INFO:tasks.workunit.client.1.smithi131.stdout:8/64: fdatasync fd 0 2024-02-15T18:31:23.542 INFO:tasks.workunit.client.1.smithi131.stdout:8/65: chown c15 3099435 1 2024-02-15T18:31:23.542 INFO:tasks.workunit.client.1.smithi131.stdout:8/66: dread - f14 zero size 2024-02-15T18:31:23.547 INFO:tasks.workunit.client.1.smithi131.stdout:9/104: dread d4/dc/de/f1d [0,4194304] 0 2024-02-15T18:31:23.550 INFO:tasks.workunit.client.1.smithi131.stdout:7/208: creat d0/d17/d36/f48 x:0 0 0 2024-02-15T18:31:23.551 INFO:tasks.workunit.client.1.smithi131.stdout:8/67: unlink f11 0 2024-02-15T18:31:23.552 INFO:tasks.workunit.client.1.smithi131.stdout:8/68: fdatasync fb 0 2024-02-15T18:31:23.556 INFO:tasks.workunit.client.1.smithi131.stdout:9/105: rename d4/l12 to d4/l21 0 2024-02-15T18:31:23.558 INFO:tasks.workunit.client.1.smithi131.stdout:8/69: rename c8 to c16 0 2024-02-15T18:31:23.558 INFO:tasks.workunit.client.1.smithi131.stdout:9/106: dread f0 [0,4194304] 0 2024-02-15T18:31:23.558 INFO:tasks.workunit.client.1.smithi131.stdout:9/107: truncate d4/dc/d17/d19/fb 1653914 0 2024-02-15T18:31:23.560 INFO:tasks.workunit.client.1.smithi131.stdout:9/108: mknod d4/dc/d17/c22 0 2024-02-15T18:31:23.560 INFO:tasks.workunit.client.1.smithi131.stdout:8/70: read fb [2918453,92866] 0 2024-02-15T18:31:23.560 INFO:tasks.workunit.client.1.smithi131.stdout:7/209: dread d0/f15 [4194304,4194304] 0 2024-02-15T18:31:23.562 INFO:tasks.workunit.client.1.smithi131.stdout:8/71: creat f17 x:0 0 0 2024-02-15T18:31:23.564 INFO:tasks.workunit.client.1.smithi131.stdout:7/210: symlink d0/d34/l49 0 2024-02-15T18:31:23.564 INFO:tasks.workunit.client.1.smithi131.stdout:7/211: readlink d0/d34/l49 0 2024-02-15T18:31:23.564 INFO:tasks.workunit.client.1.smithi131.stdout:7/212: chown d0/l7 137788932 1 2024-02-15T18:31:23.565 INFO:tasks.workunit.client.1.smithi131.stdout:7/213: fdatasync d0/d17/d36/f48 0 2024-02-15T18:31:23.565 INFO:tasks.workunit.client.1.smithi131.stdout:8/72: symlink l18 0 2024-02-15T18:31:23.566 INFO:tasks.workunit.client.1.smithi131.stdout:8/73: chown c9 987720 1 2024-02-15T18:31:23.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/74: chown lc 755229393 1 2024-02-15T18:31:23.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/75: chown fe 1195755 1 2024-02-15T18:31:23.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/76: rmdir - no directory 2024-02-15T18:31:23.571 INFO:tasks.workunit.client.1.smithi131.stdout:8/77: symlink l19 0 2024-02-15T18:31:23.571 INFO:tasks.workunit.client.1.smithi131.stdout:8/78: stat f14 0 2024-02-15T18:31:23.571 INFO:tasks.workunit.client.1.smithi131.stdout:8/79: dread - f14 zero size 2024-02-15T18:31:23.580 INFO:tasks.workunit.client.1.smithi131.stdout:7/214: getdents d0/d34 0 2024-02-15T18:31:23.583 INFO:tasks.workunit.client.1.smithi131.stdout:7/215: rename d0/d17/d3a/d3d/f45 to d0/f4a 0 2024-02-15T18:31:23.588 INFO:tasks.workunit.client.1.smithi131.stdout:9/109: dwrite f1 [0,4194304] 0 2024-02-15T18:31:23.599 INFO:tasks.workunit.client.1.smithi131.stdout:8/80: dwrite fe [0,4194304] 0 2024-02-15T18:31:23.600 INFO:tasks.workunit.client.1.smithi131.stdout:8/81: creat f1a x:0 0 0 2024-02-15T18:31:23.605 INFO:tasks.workunit.client.1.smithi131.stdout:9/110: dread f2 [0,4194304] 0 2024-02-15T18:31:23.607 INFO:tasks.workunit.client.1.smithi131.stdout:8/82: rename c16 to c1b 0 2024-02-15T18:31:23.607 INFO:tasks.workunit.client.1.smithi131.stdout:8/83: rmdir - no directory 2024-02-15T18:31:23.608 INFO:tasks.workunit.client.1.smithi131.stdout:8/84: creat f1c x:0 0 0 2024-02-15T18:31:23.612 INFO:tasks.workunit.client.1.smithi131.stdout:8/85: read fd [2048019,23336] 0 2024-02-15T18:31:23.613 INFO:tasks.workunit.client.1.smithi131.stdout:8/86: write f17 [792029,84472] 0 2024-02-15T18:31:23.617 INFO:tasks.workunit.client.1.smithi131.stdout:9/111: truncate d4/dc/d17/d19/fb 1042865 0 2024-02-15T18:31:23.619 INFO:tasks.workunit.client.1.smithi131.stdout:9/112: unlink d4/c5 0 2024-02-15T18:31:23.619 INFO:tasks.workunit.client.1.smithi131.stdout:9/113: truncate d4/dc/d17/d19/f13 5017376 0 2024-02-15T18:31:23.680 INFO:tasks.workunit.client.1.smithi131.stdout:0/55: sync 2024-02-15T18:31:23.681 INFO:tasks.workunit.client.1.smithi131.stdout:0/56: mkdir d5/d9/d10 0 2024-02-15T18:31:23.683 INFO:tasks.workunit.client.1.smithi131.stdout:0/57: mkdir d5/d9/d11 0 2024-02-15T18:31:23.720 INFO:tasks.workunit.client.1.smithi131.stdout:0/58: mknod d5/d9/d10/c12 0 2024-02-15T18:31:23.727 INFO:tasks.workunit.client.1.smithi131.stdout:0/59: dread f4 [0,4194304] 0 2024-02-15T18:31:23.728 INFO:tasks.workunit.client.1.smithi131.stdout:0/60: mknod d5/d9/d11/c13 0 2024-02-15T18:31:23.729 INFO:tasks.workunit.client.1.smithi131.stdout:0/61: creat d5/d9/d11/f14 x:0 0 0 2024-02-15T18:31:23.730 INFO:tasks.workunit.client.1.smithi131.stdout:0/62: mkdir d5/d15 0 2024-02-15T18:31:23.730 INFO:tasks.workunit.client.1.smithi131.stdout:0/63: chown d5/fc 127 1 2024-02-15T18:31:23.730 INFO:tasks.workunit.client.1.smithi131.stdout:0/64: truncate d5/fd 1428464 0 2024-02-15T18:31:23.731 INFO:tasks.workunit.client.1.smithi131.stdout:0/65: mknod d5/d9/c16 0 2024-02-15T18:31:23.731 INFO:tasks.workunit.client.1.smithi131.stdout:0/66: creat d5/d9/d10/f17 x:0 0 0 2024-02-15T18:31:23.732 INFO:tasks.workunit.client.1.smithi131.stdout:0/67: dread - d5/d9/ff zero size 2024-02-15T18:31:23.732 INFO:tasks.workunit.client.1.smithi131.stdout:0/68: mknod d5/d15/c18 0 2024-02-15T18:31:23.733 INFO:tasks.workunit.client.1.smithi131.stdout:0/69: unlink f2 0 2024-02-15T18:31:23.738 INFO:tasks.workunit.client.1.smithi131.stdout:0/70: getdents d5 0 2024-02-15T18:31:23.741 INFO:tasks.workunit.client.1.smithi131.stdout:0/71: rename d5/d9/d10/f17 to d5/d9/d10/f19 0 2024-02-15T18:31:23.741 INFO:tasks.workunit.client.1.smithi131.stdout:0/72: truncate d5/fc 5055709 0 2024-02-15T18:31:23.741 INFO:tasks.workunit.client.1.smithi131.stdout:0/73: dread - d5/d9/d11/f14 zero size 2024-02-15T18:31:23.742 INFO:tasks.workunit.client.1.smithi131.stdout:0/74: creat d5/d9/f1a x:0 0 0 2024-02-15T18:31:23.742 INFO:tasks.workunit.client.1.smithi131.stdout:0/75: symlink d5/l1b 0 2024-02-15T18:31:23.744 INFO:tasks.workunit.client.1.smithi131.stdout:0/76: creat d5/f1c x:0 0 0 2024-02-15T18:31:23.744 INFO:tasks.workunit.client.1.smithi131.stdout:0/77: chown d5/d9/lb 51 1 2024-02-15T18:31:23.744 INFO:tasks.workunit.client.1.smithi131.stdout:0/78: creat d5/d9/f1d x:0 0 0 2024-02-15T18:31:23.745 INFO:tasks.workunit.client.1.smithi131.stdout:0/79: fsync d5/d9/d11/f14 0 2024-02-15T18:31:23.745 INFO:tasks.workunit.client.1.smithi131.stdout:0/80: unlink f1 0 2024-02-15T18:31:23.754 INFO:tasks.workunit.client.1.smithi131.stdout:0/81: dread d5/fc [0,4194304] 0 2024-02-15T18:31:23.755 INFO:tasks.workunit.client.1.smithi131.stdout:0/82: creat d5/d9/d10/f1e x:0 0 0 2024-02-15T18:31:23.763 INFO:tasks.workunit.client.1.smithi131.stdout:0/83: getdents d5/d9/d10 0 2024-02-15T18:31:23.763 INFO:tasks.workunit.client.1.smithi131.stdout:0/84: fdatasync d5/d9/ff 0 2024-02-15T18:31:23.765 INFO:tasks.workunit.client.1.smithi131.stdout:0/85: mkdir d5/d15/d1f 0 2024-02-15T18:31:23.766 INFO:tasks.workunit.client.1.smithi131.stdout:0/86: dread f0 [0,4194304] 0 2024-02-15T18:31:23.771 INFO:tasks.workunit.client.1.smithi131.stdout:0/87: dread d5/fc [0,4194304] 0 2024-02-15T18:31:23.771 INFO:tasks.workunit.client.1.smithi131.stdout:0/88: dread f0 [0,4194304] 0 2024-02-15T18:31:23.771 INFO:tasks.workunit.client.1.smithi131.stdout:0/89: chown d5/fa 0 1 2024-02-15T18:31:23.773 INFO:tasks.workunit.client.1.smithi131.stdout:0/90: mkdir d5/d9/d11/d20 0 2024-02-15T18:31:23.773 INFO:tasks.workunit.client.1.smithi131.stdout:0/91: read f4 [255707,108025] 0 2024-02-15T18:31:23.773 INFO:tasks.workunit.client.1.smithi131.stdout:0/92: dread - d5/d9/d11/f14 zero size 2024-02-15T18:31:23.774 INFO:tasks.workunit.client.1.smithi131.stdout:0/93: creat d5/f21 x:0 0 0 2024-02-15T18:31:23.775 INFO:tasks.workunit.client.1.smithi131.stdout:0/94: creat d5/d15/d1f/f22 x:0 0 0 2024-02-15T18:31:23.777 INFO:tasks.workunit.client.1.smithi131.stdout:0/95: creat d5/d9/d11/d20/f23 x:0 0 0 2024-02-15T18:31:23.777 INFO:tasks.workunit.client.1.smithi131.stdout:0/96: chown d5/d9/d10/c12 6 1 2024-02-15T18:31:23.793 INFO:tasks.workunit.client.1.smithi131.stdout:0/97: dwrite f4 [4194304,4194304] 0 2024-02-15T18:31:23.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/98: dwrite d5/fa [0,4194304] 0 2024-02-15T18:31:23.836 INFO:tasks.workunit.client.1.smithi131.stdout:0/99: dwrite f4 [4194304,4194304] 0 2024-02-15T18:31:23.836 INFO:tasks.workunit.client.1.smithi131.stdout:0/100: dread - d5/f21 zero size 2024-02-15T18:31:23.848 INFO:tasks.workunit.client.1.smithi131.stdout:0/101: dread d5/fa [0,4194304] 0 2024-02-15T18:31:23.849 INFO:tasks.workunit.client.1.smithi131.stdout:0/102: mknod d5/c24 0 2024-02-15T18:31:23.849 INFO:tasks.workunit.client.1.smithi131.stdout:0/103: write d5/f21 [426564,110489] 0 2024-02-15T18:31:23.851 INFO:tasks.workunit.client.1.smithi131.stdout:0/104: dread d5/fd [0,4194304] 0 2024-02-15T18:31:23.852 INFO:tasks.workunit.client.1.smithi131.stdout:0/105: rename d5/d9/d11/c13 to d5/d9/d11/d20/c25 0 2024-02-15T18:31:23.853 INFO:tasks.workunit.client.1.smithi131.stdout:0/106: creat d5/d9/d11/d20/f26 x:0 0 0 2024-02-15T18:31:23.854 INFO:tasks.workunit.client.1.smithi131.stdout:0/107: creat d5/d15/f27 x:0 0 0 2024-02-15T18:31:23.856 INFO:tasks.workunit.client.1.smithi131.stdout:0/108: rename d5/d9/d11/d20/f26 to d5/d9/d10/f28 0 2024-02-15T18:31:23.856 INFO:tasks.workunit.client.1.smithi131.stdout:0/109: truncate f0 1568868 0 2024-02-15T18:31:23.856 INFO:tasks.workunit.client.1.smithi131.stdout:0/110: chown f0 2512536 1 2024-02-15T18:31:23.856 INFO:tasks.workunit.client.1.smithi131.stdout:0/111: truncate d5/d9/d11/d20/f23 154835 0 2024-02-15T18:31:23.856 INFO:tasks.workunit.client.1.smithi131.stdout:0/112: truncate d5/d9/ff 374574 0 2024-02-15T18:31:23.856 INFO:tasks.workunit.client.1.smithi131.stdout:0/113: unlink d5/d9/f1a 0 2024-02-15T18:31:23.857 INFO:tasks.workunit.client.1.smithi131.stdout:0/114: mknod d5/d9/c29 0 2024-02-15T18:31:23.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/115: dwrite f4 [0,4194304] 0 2024-02-15T18:31:23.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/116: write d5/d9/d10/f19 [397829,200] 0 2024-02-15T18:31:23.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/117: write d5/d15/d1f/f22 [623766,11168] 0 2024-02-15T18:31:23.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/118: write f0 [1368459,11010] 0 2024-02-15T18:31:23.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/119: stat f4 0 2024-02-15T18:31:23.881 INFO:tasks.workunit.client.1.smithi131.stdout:0/120: unlink d5/d9/d11/d20/c25 0 2024-02-15T18:31:23.886 INFO:tasks.workunit.client.1.smithi131.stdout:0/121: creat d5/d15/f2a x:0 0 0 2024-02-15T18:31:23.887 INFO:tasks.workunit.client.1.smithi131.stdout:0/122: symlink d5/l2b 0 2024-02-15T18:31:23.888 INFO:tasks.workunit.client.1.smithi131.stdout:0/123: chown d5/d9/le 160305446 1 2024-02-15T18:31:23.890 INFO:tasks.workunit.client.1.smithi131.stdout:0/124: fsync d5/d9/d10/f19 0 2024-02-15T18:31:23.891 INFO:tasks.workunit.client.1.smithi131.stdout:0/125: creat d5/d9/d11/d20/f2c x:0 0 0 2024-02-15T18:31:23.891 INFO:tasks.workunit.client.1.smithi131.stdout:0/126: chown d5/d9/c29 161 1 2024-02-15T18:31:23.891 INFO:tasks.workunit.client.1.smithi131.stdout:0/127: write d5/d9/d10/f28 [430660,42476] 0 2024-02-15T18:31:23.891 INFO:tasks.workunit.client.1.smithi131.stdout:0/128: write f0 [2168967,127745] 0 2024-02-15T18:31:23.891 INFO:tasks.workunit.client.1.smithi131.stdout:0/129: fdatasync d5/fc 0 2024-02-15T18:31:23.891 INFO:tasks.workunit.client.1.smithi131.stdout:0/130: fdatasync f3 0 2024-02-15T18:31:23.892 INFO:tasks.workunit.client.1.smithi131.stdout:0/131: write d5/d15/d1f/f22 [414172,124907] 0 2024-02-15T18:31:23.892 INFO:tasks.workunit.client.1.smithi131.stdout:0/132: dread d5/d9/d11/d20/f23 [0,4194304] 0 2024-02-15T18:31:23.894 INFO:tasks.workunit.client.1.smithi131.stdout:0/133: unlink d5/l7 0 2024-02-15T18:31:23.899 INFO:tasks.workunit.client.1.smithi131.stdout:1/116: sync 2024-02-15T18:31:23.899 INFO:tasks.workunit.client.1.smithi131.stdout:5/181: sync 2024-02-15T18:31:23.902 INFO:tasks.workunit.client.1.smithi131.stdout:1/117: rename d0/d2/f9 to d0/d2/d4/da/f2a 0 2024-02-15T18:31:23.902 INFO:tasks.workunit.client.1.smithi131.stdout:1/118: write d0/d2/f5 [9161089,83717] 0 2024-02-15T18:31:23.904 INFO:tasks.workunit.client.1.smithi131.stdout:1/119: rename d0/d1/f29 to d0/d2/f2b 0 2024-02-15T18:31:23.905 INFO:tasks.workunit.client.1.smithi131.stdout:1/120: creat d0/d2/d4/da/f2c x:0 0 0 2024-02-15T18:31:23.907 INFO:tasks.workunit.client.1.smithi131.stdout:1/121: write d0/d2/d4/f6 [2129009,95985] 0 2024-02-15T18:31:23.908 INFO:tasks.workunit.client.1.smithi131.stdout:1/122: creat d0/d1/d24/f2d x:0 0 0 2024-02-15T18:31:23.908 INFO:tasks.workunit.client.1.smithi131.stdout:1/123: truncate d0/d2/d7/f1e 5217220 0 2024-02-15T18:31:23.909 INFO:tasks.workunit.client.1.smithi131.stdout:1/124: chown d0/d2/d4 519261490 1 2024-02-15T18:31:23.909 INFO:tasks.workunit.client.1.smithi131.stdout:0/134: dwrite d5/d9/d11/d20/f23 [0,4194304] 0 2024-02-15T18:31:23.915 INFO:tasks.workunit.client.1.smithi131.stdout:5/182: dwrite d18/d24/f26 [0,4194304] 0 2024-02-15T18:31:23.917 INFO:tasks.workunit.client.1.smithi131.stdout:1/125: write d0/d2/f12 [1294461,113037] 0 2024-02-15T18:31:23.939 INFO:tasks.workunit.client.1.smithi131.stdout:1/126: dwrite d0/d2/f2b [0,4194304] 0 2024-02-15T18:31:23.939 INFO:tasks.workunit.client.1.smithi131.stdout:5/183: dwrite f16 [0,4194304] 0 2024-02-15T18:31:23.943 INFO:tasks.workunit.client.1.smithi131.stdout:1/127: rename d0/d1/d16/f25 to d0/d1/d16/d19/f2e 0 2024-02-15T18:31:23.944 INFO:tasks.workunit.client.1.smithi131.stdout:1/128: write d0/d1/d16/f20 [342852,61986] 0 2024-02-15T18:31:23.945 INFO:tasks.workunit.client.1.smithi131.stdout:5/184: unlink d18/d23/l31 0 2024-02-15T18:31:23.945 INFO:tasks.workunit.client.1.smithi131.stdout:5/185: readlink d18/d23/l2b 0 2024-02-15T18:31:23.945 INFO:tasks.workunit.client.1.smithi131.stdout:1/129: write d0/d2/d7/f1e [2541491,64838] 0 2024-02-15T18:31:23.945 INFO:tasks.workunit.client.1.smithi131.stdout:1/130: chown d0/d1/d16 12363 1 2024-02-15T18:31:23.945 INFO:tasks.workunit.client.1.smithi131.stdout:1/131: dread - d0/f22 zero size 2024-02-15T18:31:23.946 INFO:tasks.workunit.client.1.smithi131.stdout:5/186: rename c7 to d18/d24/c3d 0 2024-02-15T18:31:23.949 INFO:tasks.workunit.client.1.smithi131.stdout:1/132: rmdir d0/d2/d4/da 39 2024-02-15T18:31:23.950 INFO:tasks.workunit.client.1.smithi131.stdout:5/187: symlink d18/d20/l3e 0 2024-02-15T18:31:23.954 INFO:tasks.workunit.client.1.smithi131.stdout:1/133: dread d0/d2/f12 [0,4194304] 0 2024-02-15T18:31:23.956 INFO:tasks.workunit.client.1.smithi131.stdout:1/134: rmdir d0/d2/d7 39 2024-02-15T18:31:23.956 INFO:tasks.workunit.client.1.smithi131.stdout:1/135: read - d0/d1/d16/d19/f2e zero size 2024-02-15T18:31:23.957 INFO:tasks.workunit.client.1.smithi131.stdout:1/136: creat d0/d1/d24/f2f x:0 0 0 2024-02-15T18:31:23.957 INFO:tasks.workunit.client.1.smithi131.stdout:1/137: read - d0/d1/d16/d19/f2e zero size 2024-02-15T18:31:23.957 INFO:tasks.workunit.client.1.smithi131.stdout:1/138: write d0/f22 [892455,109012] 0 2024-02-15T18:31:23.959 INFO:tasks.workunit.client.1.smithi131.stdout:1/139: mkdir d0/d1/d16/d30 0 2024-02-15T18:31:23.960 INFO:tasks.workunit.client.1.smithi131.stdout:1/140: mkdir d0/d2/d31 0 2024-02-15T18:31:23.960 INFO:tasks.workunit.client.1.smithi131.stdout:1/141: truncate d0/d1/d16/d19/f1b 72503 0 2024-02-15T18:31:23.961 INFO:tasks.workunit.client.1.smithi131.stdout:1/142: creat d0/d2/d4/f32 x:0 0 0 2024-02-15T18:31:23.962 INFO:tasks.workunit.client.1.smithi131.stdout:1/143: rename d0/c15 to d0/d2/d4/da/c33 0 2024-02-15T18:31:23.963 INFO:tasks.workunit.client.1.smithi131.stdout:1/144: unlink d0/c26 0 2024-02-15T18:31:23.966 INFO:tasks.workunit.client.1.smithi131.stdout:5/188: dwrite d18/d23/f32 [0,4194304] 0 2024-02-15T18:31:23.969 INFO:tasks.workunit.client.1.smithi131.stdout:5/189: dread f17 [0,4194304] 0 2024-02-15T18:31:23.970 INFO:tasks.workunit.client.1.smithi131.stdout:5/190: rename d18/d23/c3b to d18/d24/c3f 0 2024-02-15T18:31:23.988 INFO:tasks.workunit.client.1.smithi131.stdout:5/191: dwrite d18/d23/f3a [0,4194304] 0 2024-02-15T18:31:23.991 INFO:tasks.workunit.client.1.smithi131.stdout:5/192: dread f17 [0,4194304] 0 2024-02-15T18:31:23.993 INFO:tasks.workunit.client.1.smithi131.stdout:5/193: read fb [7899376,129883] 0 2024-02-15T18:31:23.994 INFO:tasks.workunit.client.1.smithi131.stdout:5/194: mknod d18/d20/c40 0 2024-02-15T18:31:23.995 INFO:tasks.workunit.client.1.smithi131.stdout:5/195: truncate d18/f19 318058 0 2024-02-15T18:31:23.995 INFO:tasks.workunit.client.1.smithi131.stdout:5/196: truncate f17 4883582 0 2024-02-15T18:31:23.995 INFO:tasks.workunit.client.1.smithi131.stdout:5/197: readlink d18/d24/l39 0 2024-02-15T18:31:24.011 INFO:tasks.workunit.client.1.smithi131.stdout:5/198: dwrite f6 [4194304,4194304] 0 2024-02-15T18:31:24.014 INFO:tasks.workunit.client.1.smithi131.stdout:1/145: getdents d0/d2/d4/da 0 2024-02-15T18:31:24.021 INFO:tasks.workunit.client.1.smithi131.stdout:5/199: link d18/d24/l36 d18/d23/l41 0 2024-02-15T18:31:24.022 INFO:tasks.workunit.client.1.smithi131.stdout:5/200: chown f6 2 1 2024-02-15T18:31:24.022 INFO:tasks.workunit.client.1.smithi131.stdout:1/146: dread d0/d2/d4/da/f1f [4194304,4194304] 0 2024-02-15T18:31:24.026 INFO:tasks.workunit.client.1.smithi131.stdout:5/201: mknod d18/d24/c42 0 2024-02-15T18:31:24.028 INFO:tasks.workunit.client.1.smithi131.stdout:1/147: link d0/d1/d24/f2f d0/d2/d7/f34 0 2024-02-15T18:31:24.030 INFO:tasks.workunit.client.1.smithi131.stdout:1/148: creat d0/d2/db/f35 x:0 0 0 2024-02-15T18:31:24.032 INFO:tasks.workunit.client.1.smithi131.stdout:1/149: mknod d0/d1/d16/d30/c36 0 2024-02-15T18:31:24.032 INFO:tasks.workunit.client.1.smithi131.stdout:1/150: truncate d0/d2/db/f35 94181 0 2024-02-15T18:31:24.032 INFO:tasks.workunit.client.1.smithi131.stdout:1/151: fdatasync d0/d2/d4/da/f10 0 2024-02-15T18:31:24.034 INFO:tasks.workunit.client.1.smithi131.stdout:1/152: creat d0/d2/f37 x:0 0 0 2024-02-15T18:31:24.041 INFO:tasks.workunit.client.1.smithi131.stdout:5/202: dwrite d18/d23/f30 [0,4194304] 0 2024-02-15T18:31:24.041 INFO:tasks.workunit.client.1.smithi131.stdout:5/203: chown c12 69088235 1 2024-02-15T18:31:24.067 INFO:tasks.workunit.client.1.smithi131.stdout:1/153: dwrite d0/d2/d4/f32 [0,4194304] 0 2024-02-15T18:31:24.075 INFO:tasks.workunit.client.1.smithi131.stdout:5/204: dwrite d18/d20/f2a [0,4194304] 0 2024-02-15T18:31:24.085 INFO:tasks.workunit.client.1.smithi131.stdout:1/154: dwrite d0/d1/d24/f2f [0,4194304] 0 2024-02-15T18:31:24.091 INFO:tasks.workunit.client.1.smithi131.stdout:1/155: dread d0/f3 [0,4194304] 0 2024-02-15T18:31:24.095 INFO:tasks.workunit.client.1.smithi131.stdout:4/76: sync 2024-02-15T18:31:24.095 INFO:tasks.workunit.client.1.smithi131.stdout:4/77: write d2/d7/f1d [671793,75048] 0 2024-02-15T18:31:24.096 INFO:tasks.workunit.client.1.smithi131.stdout:4/78: symlink d2/d7/d1c/l20 0 2024-02-15T18:31:24.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/79: truncate d2/d7/fc 947435 0 2024-02-15T18:31:24.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/80: read - d2/f8 zero size 2024-02-15T18:31:24.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/81: write d2/d7/f13 [780425,118884] 0 2024-02-15T18:31:24.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/82: mkdir d2/da/d21 0 2024-02-15T18:31:24.102 INFO:tasks.workunit.client.1.smithi131.stdout:5/205: dwrite f11 [0,4194304] 0 2024-02-15T18:31:24.102 INFO:tasks.workunit.client.1.smithi131.stdout:6/109: sync 2024-02-15T18:31:24.104 INFO:tasks.workunit.client.1.smithi131.stdout:5/206: mknod d18/c43 0 2024-02-15T18:31:24.105 INFO:tasks.workunit.client.1.smithi131.stdout:6/110: symlink d2/d7/d16/l21 0 2024-02-15T18:31:24.105 INFO:tasks.workunit.client.1.smithi131.stdout:6/111: write f0 [5044442,105639] 0 2024-02-15T18:31:24.106 INFO:tasks.workunit.client.1.smithi131.stdout:5/207: rmdir d18/d20 39 2024-02-15T18:31:24.109 INFO:tasks.workunit.client.1.smithi131.stdout:5/208: mknod d18/d20/c44 0 2024-02-15T18:31:24.110 INFO:tasks.workunit.client.1.smithi131.stdout:5/209: symlink d18/d23/l45 0 2024-02-15T18:31:24.111 INFO:tasks.workunit.client.1.smithi131.stdout:5/210: symlink d18/d20/l46 0 2024-02-15T18:31:24.112 INFO:tasks.workunit.client.1.smithi131.stdout:5/211: symlink d18/d24/l47 0 2024-02-15T18:31:24.113 INFO:tasks.workunit.client.1.smithi131.stdout:5/212: creat d18/d20/f48 x:0 0 0 2024-02-15T18:31:24.114 INFO:tasks.workunit.client.1.smithi131.stdout:5/213: symlink d18/d33/l49 0 2024-02-15T18:31:24.116 INFO:tasks.workunit.client.1.smithi131.stdout:5/214: creat d18/d24/f4a x:0 0 0 2024-02-15T18:31:24.117 INFO:tasks.workunit.client.1.smithi131.stdout:5/215: truncate d18/d20/f2a 1807961 0 2024-02-15T18:31:24.117 INFO:tasks.workunit.client.1.smithi131.stdout:5/216: write d18/d20/f2e [857930,41856] 0 2024-02-15T18:31:24.117 INFO:tasks.workunit.client.1.smithi131.stdout:5/217: chown d18/d24/c3d 24 1 2024-02-15T18:31:24.119 INFO:tasks.workunit.client.1.smithi131.stdout:1/156: dwrite d0/f3 [0,4194304] 0 2024-02-15T18:31:24.119 INFO:tasks.workunit.client.1.smithi131.stdout:4/83: dwrite d2/f9 [0,4194304] 0 2024-02-15T18:31:24.120 INFO:tasks.workunit.client.1.smithi131.stdout:6/112: getdents d2/d7/d16 0 2024-02-15T18:31:24.121 INFO:tasks.workunit.client.1.smithi131.stdout:1/157: creat d0/d1/f38 x:0 0 0 2024-02-15T18:31:24.121 INFO:tasks.workunit.client.1.smithi131.stdout:1/158: readlink d0/d2/d4/l8 0 2024-02-15T18:31:24.130 INFO:tasks.workunit.client.1.smithi131.stdout:6/113: creat d2/dc/f22 x:0 0 0 2024-02-15T18:31:24.130 INFO:tasks.workunit.client.1.smithi131.stdout:1/159: write d0/f3 [3727079,19984] 0 2024-02-15T18:31:24.131 INFO:tasks.workunit.client.1.smithi131.stdout:1/160: chown d0/d2/c1d 147893957 1 2024-02-15T18:31:24.131 INFO:tasks.workunit.client.1.smithi131.stdout:4/84: rename d2/c5 to d2/da/c22 0 2024-02-15T18:31:24.132 INFO:tasks.workunit.client.1.smithi131.stdout:1/161: rename d0/d2/d7 to d0/d2/d7/d39 22 2024-02-15T18:31:24.132 INFO:tasks.workunit.client.1.smithi131.stdout:1/162: stat d0/d2/f12 0 2024-02-15T18:31:24.133 INFO:tasks.workunit.client.1.smithi131.stdout:6/114: unlink d2/fe 0 2024-02-15T18:31:24.133 INFO:tasks.workunit.client.1.smithi131.stdout:1/163: mknod d0/d2/c3a 0 2024-02-15T18:31:24.135 INFO:tasks.workunit.client.1.smithi131.stdout:6/115: creat d2/f23 x:0 0 0 2024-02-15T18:31:24.136 INFO:tasks.workunit.client.1.smithi131.stdout:1/164: creat d0/d2/d4/da/f3b x:0 0 0 2024-02-15T18:31:24.139 INFO:tasks.workunit.client.1.smithi131.stdout:4/85: dread d2/f1a [0,4194304] 0 2024-02-15T18:31:24.140 INFO:tasks.workunit.client.1.smithi131.stdout:3/60: sync 2024-02-15T18:31:24.140 INFO:tasks.workunit.client.1.smithi131.stdout:2/27: sync 2024-02-15T18:31:24.140 INFO:tasks.workunit.client.1.smithi131.stdout:7/216: sync 2024-02-15T18:31:24.140 INFO:tasks.workunit.client.1.smithi131.stdout:3/61: chown d2/d3/c14 2990395 1 2024-02-15T18:31:24.140 INFO:tasks.workunit.client.1.smithi131.stdout:7/217: chown d0/d34/f35 25195 1 2024-02-15T18:31:24.140 INFO:tasks.workunit.client.1.smithi131.stdout:2/28: write f2 [1045340,54348] 0 2024-02-15T18:31:24.142 INFO:tasks.workunit.client.1.smithi131.stdout:6/116: symlink d2/d7/d16/l24 0 2024-02-15T18:31:24.142 INFO:tasks.workunit.client.1.smithi131.stdout:3/62: getdents d2/d3/db 0 2024-02-15T18:31:24.143 INFO:tasks.workunit.client.1.smithi131.stdout:6/117: creat d2/d7/d16/f25 x:0 0 0 2024-02-15T18:31:24.143 INFO:tasks.workunit.client.1.smithi131.stdout:6/118: chown d2/d7/fd 1013456248 1 2024-02-15T18:31:24.145 INFO:tasks.workunit.client.1.smithi131.stdout:3/63: creat d2/d3/f17 x:0 0 0 2024-02-15T18:31:24.149 INFO:tasks.workunit.client.1.smithi131.stdout:5/218: dwrite d18/d20/f2a [0,4194304] 0 2024-02-15T18:31:24.150 INFO:tasks.workunit.client.1.smithi131.stdout:3/64: dread d2/d3/f6 [0,4194304] 0 2024-02-15T18:31:24.150 INFO:tasks.workunit.client.1.smithi131.stdout:3/65: chown d2/c16 15741 1 2024-02-15T18:31:24.150 INFO:tasks.workunit.client.1.smithi131.stdout:3/66: chown d2/d3/c10 24854 1 2024-02-15T18:31:24.155 INFO:tasks.workunit.client.1.smithi131.stdout:2/29: truncate f2 149600 0 2024-02-15T18:31:24.157 INFO:tasks.workunit.client.1.smithi131.stdout:1/165: dread d0/d2/f12 [0,4194304] 0 2024-02-15T18:31:24.158 INFO:tasks.workunit.client.1.smithi131.stdout:3/67: rename d2/f13 to d2/d3/db/f18 0 2024-02-15T18:31:24.158 INFO:tasks.workunit.client.1.smithi131.stdout:3/68: write d2/d3/f17 [931917,62491] 0 2024-02-15T18:31:24.159 INFO:tasks.workunit.client.1.smithi131.stdout:3/69: write d2/d3/f6 [4562255,42751] 0 2024-02-15T18:31:24.160 INFO:tasks.workunit.client.1.smithi131.stdout:1/166: unlink d0/d2/db/f35 0 2024-02-15T18:31:24.161 INFO:tasks.workunit.client.1.smithi131.stdout:5/219: write f6 [2692735,50321] 0 2024-02-15T18:31:24.164 INFO:tasks.workunit.client.1.smithi131.stdout:1/167: truncate d0/d2/f2b 4111269 0 2024-02-15T18:31:24.165 INFO:tasks.workunit.client.1.smithi131.stdout:4/86: dwrite d2/d7/f14 [0,4194304] 0 2024-02-15T18:31:24.167 INFO:tasks.workunit.client.1.smithi131.stdout:5/220: mknod d18/c4b 0 2024-02-15T18:31:24.167 INFO:tasks.workunit.client.1.smithi131.stdout:1/168: creat d0/d2/db/f3c x:0 0 0 2024-02-15T18:31:24.167 INFO:tasks.workunit.client.1.smithi131.stdout:1/169: mkdir d0/d2/d31/d3d 0 2024-02-15T18:31:24.167 INFO:tasks.workunit.client.1.smithi131.stdout:1/170: fdatasync d0/d2/f5 0 2024-02-15T18:31:24.172 INFO:tasks.workunit.client.1.smithi131.stdout:7/218: dwrite d0/f1b [0,4194304] 0 2024-02-15T18:31:24.175 INFO:tasks.workunit.client.1.smithi131.stdout:7/219: write d0/fd [736018,57998] 0 2024-02-15T18:31:24.175 INFO:tasks.workunit.client.1.smithi131.stdout:7/220: dread - d0/d34/f41 zero size 2024-02-15T18:31:24.177 INFO:tasks.workunit.client.1.smithi131.stdout:6/119: dwrite d2/d7/f1b [0,4194304] 0 2024-02-15T18:31:24.177 INFO:tasks.workunit.client.1.smithi131.stdout:4/87: fsync d2/d7/f13 0 2024-02-15T18:31:24.178 INFO:tasks.workunit.client.1.smithi131.stdout:4/88: readlink d2/l1e 0 2024-02-15T18:31:24.178 INFO:tasks.workunit.client.1.smithi131.stdout:7/221: rename d0/f1b to d0/d17/f4b 0 2024-02-15T18:31:24.178 INFO:tasks.workunit.client.1.smithi131.stdout:7/222: fsync d0/d34/f35 0 2024-02-15T18:31:24.178 INFO:tasks.workunit.client.1.smithi131.stdout:7/223: chown d0/fd 18572 1 2024-02-15T18:31:24.178 INFO:tasks.workunit.client.1.smithi131.stdout:9/114: sync 2024-02-15T18:31:24.178 INFO:tasks.workunit.client.1.smithi131.stdout:8/87: sync 2024-02-15T18:31:24.178 INFO:tasks.workunit.client.1.smithi131.stdout:0/135: sync 2024-02-15T18:31:24.179 INFO:tasks.workunit.client.1.smithi131.stdout:0/136: chown f3 4775 1 2024-02-15T18:31:24.179 INFO:tasks.workunit.client.1.smithi131.stdout:0/137: write d5/d9/d10/f1e [824818,10957] 0 2024-02-15T18:31:24.182 INFO:tasks.workunit.client.1.smithi131.stdout:2/30: dread f2 [0,4194304] 0 2024-02-15T18:31:24.188 INFO:tasks.workunit.client.1.smithi131.stdout:7/224: rmdir d0/d17/d44 0 2024-02-15T18:31:24.188 INFO:tasks.workunit.client.1.smithi131.stdout:7/225: truncate d0/f43 904924 0 2024-02-15T18:31:24.191 INFO:tasks.workunit.client.1.smithi131.stdout:9/115: mknod d4/dc/d17/c23 0 2024-02-15T18:31:24.191 INFO:tasks.workunit.client.1.smithi131.stdout:0/138: symlink d5/d15/l2d 0 2024-02-15T18:31:24.191 INFO:tasks.workunit.client.1.smithi131.stdout:2/31: mknod c3 0 2024-02-15T18:31:24.192 INFO:tasks.workunit.client.1.smithi131.stdout:3/70: dread d2/d3/f6 [0,4194304] 0 2024-02-15T18:31:24.193 INFO:tasks.workunit.client.1.smithi131.stdout:6/120: creat d2/dc/d1f/f26 x:0 0 0 2024-02-15T18:31:24.194 INFO:tasks.workunit.client.1.smithi131.stdout:6/121: write d2/dc/d19/f1c [648000,88384] 0 2024-02-15T18:31:24.194 INFO:tasks.workunit.client.1.smithi131.stdout:5/221: dwrite d18/d23/f32 [0,4194304] 0 2024-02-15T18:31:24.194 INFO:tasks.workunit.client.1.smithi131.stdout:7/226: creat d0/d17/d36/f4c x:0 0 0 2024-02-15T18:31:24.195 INFO:tasks.workunit.client.1.smithi131.stdout:8/88: rename fd to f1d 0 2024-02-15T18:31:24.197 INFO:tasks.workunit.client.1.smithi131.stdout:0/139: rmdir d5/d9/d11 39 2024-02-15T18:31:24.197 INFO:tasks.workunit.client.1.smithi131.stdout:8/89: write f5 [11557,123366] 0 2024-02-15T18:31:24.199 INFO:tasks.workunit.client.1.smithi131.stdout:9/116: symlink d4/dc/l24 0 2024-02-15T18:31:24.199 INFO:tasks.workunit.client.1.smithi131.stdout:2/32: creat f4 x:0 0 0 2024-02-15T18:31:24.199 INFO:tasks.workunit.client.1.smithi131.stdout:2/33: write f2 [758301,120195] 0 2024-02-15T18:31:24.200 INFO:tasks.workunit.client.1.smithi131.stdout:3/71: creat d2/f19 x:0 0 0 2024-02-15T18:31:24.201 INFO:tasks.workunit.client.1.smithi131.stdout:1/171: dwrite d0/d2/d4/da/f10 [0,4194304] 0 2024-02-15T18:31:24.204 INFO:tasks.workunit.client.1.smithi131.stdout:4/89: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:24.204 INFO:tasks.workunit.client.1.smithi131.stdout:4/90: fdatasync d2/d7/f14 0 2024-02-15T18:31:24.204 INFO:tasks.workunit.client.1.smithi131.stdout:4/91: truncate d2/d7/f11 1080894 0 2024-02-15T18:31:24.205 INFO:tasks.workunit.client.1.smithi131.stdout:2/34: fsync f2 0 2024-02-15T18:31:24.205 INFO:tasks.workunit.client.1.smithi131.stdout:5/222: creat d18/d20/f4c x:0 0 0 2024-02-15T18:31:24.205 INFO:tasks.workunit.client.1.smithi131.stdout:5/223: chown d18/d20/l34 13831155 1 2024-02-15T18:31:24.209 INFO:tasks.workunit.client.1.smithi131.stdout:7/227: rmdir d0/d17/d3a 39 2024-02-15T18:31:24.211 INFO:tasks.workunit.client.1.smithi131.stdout:9/117: read d4/dc/d17/d19/fb [817420,60127] 0 2024-02-15T18:31:24.211 INFO:tasks.workunit.client.1.smithi131.stdout:1/172: symlink d0/d1/d16/l3e 0 2024-02-15T18:31:24.214 INFO:tasks.workunit.client.1.smithi131.stdout:2/35: mknod c5 0 2024-02-15T18:31:24.215 INFO:tasks.workunit.client.1.smithi131.stdout:7/228: link d0/l2f d0/l4d 0 2024-02-15T18:31:24.215 INFO:tasks.workunit.client.1.smithi131.stdout:7/229: fsync d0/d34/f35 0 2024-02-15T18:31:24.215 INFO:tasks.workunit.client.1.smithi131.stdout:7/230: dread - d0/f47 zero size 2024-02-15T18:31:24.215 INFO:tasks.workunit.client.1.smithi131.stdout:0/140: rename d5/fc to d5/d9/f2e 0 2024-02-15T18:31:24.216 INFO:tasks.workunit.client.1.smithi131.stdout:8/90: mknod c1e 0 2024-02-15T18:31:24.217 INFO:tasks.workunit.client.1.smithi131.stdout:9/118: mkdir d4/dc/d25 0 2024-02-15T18:31:24.218 INFO:tasks.workunit.client.1.smithi131.stdout:7/231: write d0/f14 [750127,87204] 0 2024-02-15T18:31:24.218 INFO:tasks.workunit.client.1.smithi131.stdout:7/232: fsync d0/f4a 0 2024-02-15T18:31:24.218 INFO:tasks.workunit.client.1.smithi131.stdout:1/173: mkdir d0/d1/d16/d3f 0 2024-02-15T18:31:24.219 INFO:tasks.workunit.client.1.smithi131.stdout:6/122: dwrite f0 [4194304,4194304] 0 2024-02-15T18:31:24.219 INFO:tasks.workunit.client.1.smithi131.stdout:6/123: fsync d2/dc/f14 0 2024-02-15T18:31:24.219 INFO:tasks.workunit.client.1.smithi131.stdout:4/92: mkdir d2/d23 0 2024-02-15T18:31:24.222 INFO:tasks.workunit.client.1.smithi131.stdout:2/36: rename c0 to c6 0 2024-02-15T18:31:24.224 INFO:tasks.workunit.client.1.smithi131.stdout:2/37: dread f2 [0,4194304] 0 2024-02-15T18:31:24.224 INFO:tasks.workunit.client.1.smithi131.stdout:2/38: write f4 [248803,108474] 0 2024-02-15T18:31:24.225 INFO:tasks.workunit.client.1.smithi131.stdout:3/72: rename d2/d8 to d2/d3/db/d1a 0 2024-02-15T18:31:24.225 INFO:tasks.workunit.client.1.smithi131.stdout:3/73: stat d2/d3/db/d1a/f11 0 2024-02-15T18:31:24.226 INFO:tasks.workunit.client.1.smithi131.stdout:9/119: truncate f2 4007912 0 2024-02-15T18:31:24.226 INFO:tasks.workunit.client.1.smithi131.stdout:9/120: truncate d4/dc/d17/d19/fb 1284438 0 2024-02-15T18:31:24.227 INFO:tasks.workunit.client.1.smithi131.stdout:1/174: creat d0/d2/d7/f40 x:0 0 0 2024-02-15T18:31:24.227 INFO:tasks.workunit.client.1.smithi131.stdout:1/175: write d0/d2/db/f3c [491011,11685] 0 2024-02-15T18:31:24.227 INFO:tasks.workunit.client.1.smithi131.stdout:7/233: dread d0/fb [0,4194304] 0 2024-02-15T18:31:24.228 INFO:tasks.workunit.client.1.smithi131.stdout:6/124: mkdir d2/dc/d27 0 2024-02-15T18:31:24.229 INFO:tasks.workunit.client.1.smithi131.stdout:4/93: symlink d2/da/l24 0 2024-02-15T18:31:24.229 INFO:tasks.workunit.client.1.smithi131.stdout:4/94: readlink d2/da/l24 0 2024-02-15T18:31:24.230 INFO:tasks.workunit.client.1.smithi131.stdout:3/74: mknod d2/d3/db/d1a/c1b 0 2024-02-15T18:31:24.230 INFO:tasks.workunit.client.1.smithi131.stdout:3/75: write d2/d3/db/f18 [1332803,126357] 0 2024-02-15T18:31:24.233 INFO:tasks.workunit.client.1.smithi131.stdout:5/224: rename d18/d33/c3c to d18/d23/c4d 0 2024-02-15T18:31:24.234 INFO:tasks.workunit.client.1.smithi131.stdout:9/121: unlink d4/dc/d17/d19/f13 0 2024-02-15T18:31:24.235 INFO:tasks.workunit.client.1.smithi131.stdout:1/176: mkdir d0/d2/d4/d41 0 2024-02-15T18:31:24.235 INFO:tasks.workunit.client.1.smithi131.stdout:1/177: readlink d0/d2/d4/l17 0 2024-02-15T18:31:24.235 INFO:tasks.workunit.client.1.smithi131.stdout:7/234: creat d0/d17/d3a/f4e x:0 0 0 2024-02-15T18:31:24.236 INFO:tasks.workunit.client.1.smithi131.stdout:3/76: creat d2/d3/db/d1a/f1c x:0 0 0 2024-02-15T18:31:24.239 INFO:tasks.workunit.client.1.smithi131.stdout:0/141: rename d5/d9/d11/d20 to d5/d2f 0 2024-02-15T18:31:24.240 INFO:tasks.workunit.client.1.smithi131.stdout:6/125: dread d2/dc/f14 [0,4194304] 0 2024-02-15T18:31:24.240 INFO:tasks.workunit.client.1.smithi131.stdout:8/91: dwrite f17 [0,4194304] 0 2024-02-15T18:31:24.245 INFO:tasks.workunit.client.1.smithi131.stdout:5/225: mkdir d18/d4e 0 2024-02-15T18:31:24.246 INFO:tasks.workunit.client.1.smithi131.stdout:9/122: mkdir d4/dc/de/d1e/d26 0 2024-02-15T18:31:24.247 INFO:tasks.workunit.client.1.smithi131.stdout:3/77: rmdir d2/d3/db 39 2024-02-15T18:31:24.249 INFO:tasks.workunit.client.1.smithi131.stdout:5/226: write d18/d23/f30 [365698,57284] 0 2024-02-15T18:31:24.249 INFO:tasks.workunit.client.1.smithi131.stdout:8/92: dread f1d [0,4194304] 0 2024-02-15T18:31:24.259 INFO:tasks.workunit.client.1.smithi131.stdout:0/142: rename d5/d15/d1f/f22 to d5/d9/d11/f30 0 2024-02-15T18:31:24.259 INFO:tasks.workunit.client.1.smithi131.stdout:6/126: creat d2/f28 x:0 0 0 2024-02-15T18:31:24.260 INFO:tasks.workunit.client.1.smithi131.stdout:9/123: unlink f2 0 2024-02-15T18:31:24.260 INFO:tasks.workunit.client.1.smithi131.stdout:9/124: chown d4/l21 5907270 1 2024-02-15T18:31:24.260 INFO:tasks.workunit.client.1.smithi131.stdout:1/178: dread d0/d2/f1c [0,4194304] 0 2024-02-15T18:31:24.262 INFO:tasks.workunit.client.1.smithi131.stdout:6/127: symlink d2/dc/d27/l29 0 2024-02-15T18:31:24.262 INFO:tasks.workunit.client.1.smithi131.stdout:9/125: dread f3 [0,4194304] 0 2024-02-15T18:31:24.264 INFO:tasks.workunit.client.1.smithi131.stdout:8/93: link c1e c1f 0 2024-02-15T18:31:24.266 INFO:tasks.workunit.client.1.smithi131.stdout:6/128: truncate d2/f1a 544470 0 2024-02-15T18:31:24.267 INFO:tasks.workunit.client.1.smithi131.stdout:6/129: creat d2/dc/f2a x:0 0 0 2024-02-15T18:31:24.270 INFO:tasks.workunit.client.1.smithi131.stdout:6/130: mkdir d2/d2b 0 2024-02-15T18:31:24.270 INFO:tasks.workunit.client.1.smithi131.stdout:6/131: chown d2/dc 15521 1 2024-02-15T18:31:24.270 INFO:tasks.workunit.client.1.smithi131.stdout:6/132: chown d2 3466 1 2024-02-15T18:31:24.272 INFO:tasks.workunit.client.1.smithi131.stdout:6/133: symlink d2/d7/d16/l2c 0 2024-02-15T18:31:24.276 INFO:tasks.workunit.client.1.smithi131.stdout:1/179: dread d0/d2/d4/f6 [0,4194304] 0 2024-02-15T18:31:24.277 INFO:tasks.workunit.client.1.smithi131.stdout:1/180: stat d0/d2/c1d 0 2024-02-15T18:31:24.280 INFO:tasks.workunit.client.1.smithi131.stdout:1/181: getdents d0/d1/d16 0 2024-02-15T18:31:24.284 INFO:tasks.workunit.client.1.smithi131.stdout:6/134: dread d2/d7/fa [0,4194304] 0 2024-02-15T18:31:24.293 INFO:tasks.workunit.client.1.smithi131.stdout:3/78: dwrite d2/d3/db/f18 [0,4194304] 0 2024-02-15T18:31:24.295 INFO:tasks.workunit.client.1.smithi131.stdout:2/39: dwrite f4 [0,4194304] 0 2024-02-15T18:31:24.295 INFO:tasks.workunit.client.1.smithi131.stdout:2/40: stat c3 0 2024-02-15T18:31:24.296 INFO:tasks.workunit.client.1.smithi131.stdout:2/41: link f4 f7 0 2024-02-15T18:31:24.297 INFO:tasks.workunit.client.1.smithi131.stdout:2/42: creat f8 x:0 0 0 2024-02-15T18:31:24.297 INFO:tasks.workunit.client.1.smithi131.stdout:2/43: readlink - no filename 2024-02-15T18:31:24.298 INFO:tasks.workunit.client.1.smithi131.stdout:2/44: symlink l9 0 2024-02-15T18:31:24.307 INFO:tasks.workunit.client.1.smithi131.stdout:9/126: dwrite d4/dc/d17/d19/fb [0,4194304] 0 2024-02-15T18:31:24.307 INFO:tasks.workunit.client.1.smithi131.stdout:9/127: chown d4/dc/de/d1e/d1f 108 1 2024-02-15T18:31:24.309 INFO:tasks.workunit.client.1.smithi131.stdout:5/227: dwrite d18/f1e [0,4194304] 0 2024-02-15T18:31:24.309 INFO:tasks.workunit.client.1.smithi131.stdout:1/182: dwrite d0/d2/d4/da/f3b [0,4194304] 0 2024-02-15T18:31:24.309 INFO:tasks.workunit.client.1.smithi131.stdout:5/228: chown d18/d24/f4a 5 1 2024-02-15T18:31:24.309 INFO:tasks.workunit.client.1.smithi131.stdout:1/183: readlink d0/d2/d4/l17 0 2024-02-15T18:31:24.309 INFO:tasks.workunit.client.1.smithi131.stdout:5/229: chown d18/d23 153 1 2024-02-15T18:31:24.312 INFO:tasks.workunit.client.1.smithi131.stdout:2/45: dread f7 [0,4194304] 0 2024-02-15T18:31:24.312 INFO:tasks.workunit.client.1.smithi131.stdout:8/94: dwrite f5 [0,4194304] 0 2024-02-15T18:31:24.313 INFO:tasks.workunit.client.1.smithi131.stdout:9/128: dread f3 [0,4194304] 0 2024-02-15T18:31:24.316 INFO:tasks.workunit.client.1.smithi131.stdout:3/79: rmdir d2 39 2024-02-15T18:31:24.323 INFO:tasks.workunit.client.1.smithi131.stdout:8/95: read f17 [1162747,115816] 0 2024-02-15T18:31:24.327 INFO:tasks.workunit.client.1.smithi131.stdout:8/96: write fb [1312312,83336] 0 2024-02-15T18:31:24.334 INFO:tasks.workunit.client.1.smithi131.stdout:5/230: symlink d18/l4f 0 2024-02-15T18:31:24.335 INFO:tasks.workunit.client.1.smithi131.stdout:8/97: getdents . 0 2024-02-15T18:31:24.337 INFO:tasks.workunit.client.1.smithi131.stdout:5/231: creat d18/f50 x:0 0 0 2024-02-15T18:31:24.340 INFO:tasks.workunit.client.1.smithi131.stdout:8/98: link c1b c20 0 2024-02-15T18:31:24.343 INFO:tasks.workunit.client.1.smithi131.stdout:2/46: getdents . 0 2024-02-15T18:31:24.346 INFO:tasks.workunit.client.1.smithi131.stdout:2/47: unlink f2 0 2024-02-15T18:31:24.347 INFO:tasks.workunit.client.1.smithi131.stdout:2/48: read f7 [3268213,40478] 0 2024-02-15T18:31:24.348 INFO:tasks.workunit.client.1.smithi131.stdout:2/49: write f4 [1843119,104031] 0 2024-02-15T18:31:24.352 INFO:tasks.workunit.client.1.smithi131.stdout:5/232: dread d18/d23/f32 [0,4194304] 0 2024-02-15T18:31:24.353 INFO:tasks.workunit.client.1.smithi131.stdout:3/80: dwrite d2/f19 [0,4194304] 0 2024-02-15T18:31:24.355 INFO:tasks.workunit.client.1.smithi131.stdout:3/81: read d2/f19 [2601983,27168] 0 2024-02-15T18:31:24.355 INFO:tasks.workunit.client.1.smithi131.stdout:3/82: stat d2/d3/db/d1a/ld 0 2024-02-15T18:31:24.355 INFO:tasks.workunit.client.1.smithi131.stdout:3/83: fsync d2/d3/db/d1a/f1c 0 2024-02-15T18:31:24.355 INFO:tasks.workunit.client.1.smithi131.stdout:3/84: chown d2/d3/c14 104595717 1 2024-02-15T18:31:24.356 INFO:tasks.workunit.client.1.smithi131.stdout:9/129: dwrite f0 [0,4194304] 0 2024-02-15T18:31:24.356 INFO:tasks.workunit.client.1.smithi131.stdout:5/233: write d18/d20/f2a [1952728,41367] 0 2024-02-15T18:31:24.356 INFO:tasks.workunit.client.1.smithi131.stdout:9/130: chown d4/dc/d17/d19/c1c 162 1 2024-02-15T18:31:24.356 INFO:tasks.workunit.client.1.smithi131.stdout:5/234: write d18/d24/f2c [583895,71727] 0 2024-02-15T18:31:24.356 INFO:tasks.workunit.client.1.smithi131.stdout:1/184: dwrite d0/d2/f37 [0,4194304] 0 2024-02-15T18:31:24.358 INFO:tasks.workunit.client.1.smithi131.stdout:6/135: dwrite d2/f1a [0,4194304] 0 2024-02-15T18:31:24.358 INFO:tasks.workunit.client.1.smithi131.stdout:3/85: creat d2/d3/db/f1d x:0 0 0 2024-02-15T18:31:24.362 INFO:tasks.workunit.client.1.smithi131.stdout:9/131: mknod d4/dc/d25/c27 0 2024-02-15T18:31:24.362 INFO:tasks.workunit.client.1.smithi131.stdout:2/50: getdents . 0 2024-02-15T18:31:24.366 INFO:tasks.workunit.client.1.smithi131.stdout:1/185: mkdir d0/d2/d28/d42 0 2024-02-15T18:31:24.368 INFO:tasks.workunit.client.1.smithi131.stdout:9/132: mknod d4/dc/de/d1e/d1f/c28 0 2024-02-15T18:31:24.368 INFO:tasks.workunit.client.1.smithi131.stdout:5/235: dread f11 [0,4194304] 0 2024-02-15T18:31:24.369 INFO:tasks.workunit.client.1.smithi131.stdout:2/51: creat fa x:0 0 0 2024-02-15T18:31:24.371 INFO:tasks.workunit.client.1.smithi131.stdout:1/186: creat d0/d1/d16/f43 x:0 0 0 2024-02-15T18:31:24.371 INFO:tasks.workunit.client.1.smithi131.stdout:8/99: dread fb [0,4194304] 0 2024-02-15T18:31:24.371 INFO:tasks.workunit.client.1.smithi131.stdout:9/133: read f3 [19895,109525] 0 2024-02-15T18:31:24.372 INFO:tasks.workunit.client.1.smithi131.stdout:8/100: mknod c21 0 2024-02-15T18:31:24.372 INFO:tasks.workunit.client.1.smithi131.stdout:1/187: write d0/d2/d7/f34 [264610,41515] 0 2024-02-15T18:31:24.373 INFO:tasks.workunit.client.1.smithi131.stdout:8/101: write fb [4084291,15697] 0 2024-02-15T18:31:24.373 INFO:tasks.workunit.client.1.smithi131.stdout:8/102: fdatasync f14 0 2024-02-15T18:31:24.373 INFO:tasks.workunit.client.1.smithi131.stdout:2/52: link f7 fb 0 2024-02-15T18:31:24.375 INFO:tasks.workunit.client.1.smithi131.stdout:1/188: mkdir d0/d1/d44 0 2024-02-15T18:31:24.375 INFO:tasks.workunit.client.1.smithi131.stdout:1/189: write d0/d1/f38 [292265,28297] 0 2024-02-15T18:31:24.375 INFO:tasks.workunit.client.1.smithi131.stdout:6/136: dwrite d2/d7/d16/f1e [0,4194304] 0 2024-02-15T18:31:24.375 INFO:tasks.workunit.client.1.smithi131.stdout:6/137: write d2/dc/d1f/f26 [237669,12686] 0 2024-02-15T18:31:24.376 INFO:tasks.workunit.client.1.smithi131.stdout:8/103: mkdir d22 0 2024-02-15T18:31:24.378 INFO:tasks.workunit.client.1.smithi131.stdout:3/86: getdents d2/d3/db 0 2024-02-15T18:31:24.379 INFO:tasks.workunit.client.1.smithi131.stdout:2/53: creat fc x:0 0 0 2024-02-15T18:31:24.381 INFO:tasks.workunit.client.1.smithi131.stdout:1/190: creat d0/d2/d28/f45 x:0 0 0 2024-02-15T18:31:24.381 INFO:tasks.workunit.client.1.smithi131.stdout:1/191: chown d0/d2/d4/f32 63756 1 2024-02-15T18:31:24.381 INFO:tasks.workunit.client.1.smithi131.stdout:1/192: stat d0/d1/d24/f2f 0 2024-02-15T18:31:24.382 INFO:tasks.workunit.client.1.smithi131.stdout:6/138: dread - d2/f23 zero size 2024-02-15T18:31:24.384 INFO:tasks.workunit.client.1.smithi131.stdout:8/104: creat d22/f23 x:0 0 0 2024-02-15T18:31:24.384 INFO:tasks.workunit.client.1.smithi131.stdout:8/105: fdatasync f17 0 2024-02-15T18:31:24.385 INFO:tasks.workunit.client.1.smithi131.stdout:2/54: chown c5 34824 1 2024-02-15T18:31:24.386 INFO:tasks.workunit.client.1.smithi131.stdout:3/87: dread d2/d3/db/d1a/fe [0,4194304] 0 2024-02-15T18:31:24.388 INFO:tasks.workunit.client.1.smithi131.stdout:3/88: rmdir d2/d3 39 2024-02-15T18:31:24.388 INFO:tasks.workunit.client.1.smithi131.stdout:8/106: rename f5 to d22/f24 0 2024-02-15T18:31:24.389 INFO:tasks.workunit.client.1.smithi131.stdout:6/139: dread d2/dc/f14 [0,4194304] 0 2024-02-15T18:31:24.389 INFO:tasks.workunit.client.1.smithi131.stdout:6/140: write d2/d7/d16/f25 [613331,97202] 0 2024-02-15T18:31:24.389 INFO:tasks.workunit.client.1.smithi131.stdout:6/141: truncate d2/dc/f22 1024096 0 2024-02-15T18:31:24.390 INFO:tasks.workunit.client.1.smithi131.stdout:3/89: creat d2/d3/db/f1e x:0 0 0 2024-02-15T18:31:24.393 INFO:tasks.workunit.client.1.smithi131.stdout:1/193: dread d0/d2/d4/f32 [0,4194304] 0 2024-02-15T18:31:24.393 INFO:tasks.workunit.client.1.smithi131.stdout:3/90: write d2/d3/db/d1a/fe [31489,130180] 0 2024-02-15T18:31:24.395 INFO:tasks.workunit.client.1.smithi131.stdout:6/142: dread d2/dc/f14 [0,4194304] 0 2024-02-15T18:31:24.395 INFO:tasks.workunit.client.1.smithi131.stdout:5/236: dwrite d18/d20/f2f [0,4194304] 0 2024-02-15T18:31:24.396 INFO:tasks.workunit.client.1.smithi131.stdout:5/237: write d18/d20/f2e [1382431,123115] 0 2024-02-15T18:31:24.396 INFO:tasks.workunit.client.1.smithi131.stdout:5/238: chown d18/d24/c3f 3505547 1 2024-02-15T18:31:24.397 INFO:tasks.workunit.client.1.smithi131.stdout:2/55: fsync f4 0 2024-02-15T18:31:24.397 INFO:tasks.workunit.client.1.smithi131.stdout:8/107: write fb [990508,100001] 0 2024-02-15T18:31:24.398 INFO:tasks.workunit.client.1.smithi131.stdout:9/134: dwrite f1 [0,4194304] 0 2024-02-15T18:31:24.402 INFO:tasks.workunit.client.1.smithi131.stdout:6/143: mknod d2/dc/d1f/c2d 0 2024-02-15T18:31:24.403 INFO:tasks.workunit.client.1.smithi131.stdout:5/239: symlink d18/d24/l51 0 2024-02-15T18:31:24.413 INFO:tasks.workunit.client.1.smithi131.stdout:8/108: mknod d22/c25 0 2024-02-15T18:31:24.414 INFO:tasks.workunit.client.1.smithi131.stdout:9/135: dread d4/dc/d17/f16 [0,4194304] 0 2024-02-15T18:31:24.416 INFO:tasks.workunit.client.1.smithi131.stdout:5/240: truncate d18/d23/f30 986127 0 2024-02-15T18:31:24.416 INFO:tasks.workunit.client.1.smithi131.stdout:8/109: mkdir d22/d26 0 2024-02-15T18:31:24.417 INFO:tasks.workunit.client.1.smithi131.stdout:9/136: mknod d4/dc/de/d1e/d1f/c29 0 2024-02-15T18:31:24.419 INFO:tasks.workunit.client.1.smithi131.stdout:5/241: creat d18/d23/f52 x:0 0 0 2024-02-15T18:31:24.419 INFO:tasks.workunit.client.1.smithi131.stdout:5/242: write d18/d20/f4c [60004,55634] 0 2024-02-15T18:31:24.422 INFO:tasks.workunit.client.1.smithi131.stdout:1/194: dwrite d0/f27 [0,4194304] 0 2024-02-15T18:31:24.422 INFO:tasks.workunit.client.1.smithi131.stdout:1/195: dread - d0/d1/d16/d19/f2e zero size 2024-02-15T18:31:24.422 INFO:tasks.workunit.client.1.smithi131.stdout:1/196: dread - d0/d1/d16/d19/f2e zero size 2024-02-15T18:31:24.422 INFO:tasks.workunit.client.1.smithi131.stdout:3/91: dwrite d2/d3/f6 [0,4194304] 0 2024-02-15T18:31:24.423 INFO:tasks.workunit.client.1.smithi131.stdout:9/137: truncate d4/dc/d17/d19/fb 2345963 0 2024-02-15T18:31:24.423 INFO:tasks.workunit.client.1.smithi131.stdout:6/144: getdents d2/dc/d1f 0 2024-02-15T18:31:24.426 INFO:tasks.workunit.client.1.smithi131.stdout:5/243: symlink d18/d4e/l53 0 2024-02-15T18:31:24.428 INFO:tasks.workunit.client.1.smithi131.stdout:2/56: dwrite fa [0,4194304] 0 2024-02-15T18:31:24.429 INFO:tasks.workunit.client.1.smithi131.stdout:2/57: read f7 [668967,51724] 0 2024-02-15T18:31:24.437 INFO:tasks.workunit.client.1.smithi131.stdout:1/197: mkdir d0/d2/d31/d3d/d46 0 2024-02-15T18:31:24.437 INFO:tasks.workunit.client.1.smithi131.stdout:3/92: creat d2/d3/f1f x:0 0 0 2024-02-15T18:31:24.438 INFO:tasks.workunit.client.1.smithi131.stdout:5/244: truncate d18/d24/f26 2755397 0 2024-02-15T18:31:24.438 INFO:tasks.workunit.client.1.smithi131.stdout:5/245: readlink d18/d23/l45 0 2024-02-15T18:31:24.444 INFO:tasks.workunit.client.1.smithi131.stdout:2/58: readlink l9 0 2024-02-15T18:31:24.444 INFO:tasks.workunit.client.1.smithi131.stdout:2/59: dread - fc zero size 2024-02-15T18:31:24.446 INFO:tasks.workunit.client.1.smithi131.stdout:3/93: mkdir d2/d3/d20 0 2024-02-15T18:31:24.446 INFO:tasks.workunit.client.1.smithi131.stdout:5/246: dread d18/f19 [0,4194304] 0 2024-02-15T18:31:24.446 INFO:tasks.workunit.client.1.smithi131.stdout:9/138: truncate d4/dc/d17/d19/fb 2924364 0 2024-02-15T18:31:24.449 INFO:tasks.workunit.client.1.smithi131.stdout:9/139: truncate f1 4067592 0 2024-02-15T18:31:24.449 INFO:tasks.workunit.client.1.smithi131.stdout:9/140: write f0 [4667474,85331] 0 2024-02-15T18:31:24.452 INFO:tasks.workunit.client.1.smithi131.stdout:8/110: truncate fb 569506 0 2024-02-15T18:31:24.454 INFO:tasks.workunit.client.1.smithi131.stdout:1/198: dread d0/f27 [0,4194304] 0 2024-02-15T18:31:24.454 INFO:tasks.workunit.client.1.smithi131.stdout:1/199: write d0/d1/d24/f2d [106707,91378] 0 2024-02-15T18:31:24.454 INFO:tasks.workunit.client.1.smithi131.stdout:1/200: stat d0/d2/d4/da/f2a 0 2024-02-15T18:31:24.454 INFO:tasks.workunit.client.1.smithi131.stdout:9/141: unlink d4/c8 0 2024-02-15T18:31:24.454 INFO:tasks.workunit.client.1.smithi131.stdout:9/142: readlink d4/dc/l24 0 2024-02-15T18:31:24.456 INFO:tasks.workunit.client.1.smithi131.stdout:1/201: mkdir d0/d1/d16/d30/d47 0 2024-02-15T18:31:24.456 INFO:tasks.workunit.client.1.smithi131.stdout:1/202: chown d0/c14 10343 1 2024-02-15T18:31:24.458 INFO:tasks.workunit.client.1.smithi131.stdout:1/203: creat d0/d1/d16/d30/d47/f48 x:0 0 0 2024-02-15T18:31:24.458 INFO:tasks.workunit.client.1.smithi131.stdout:1/204: chown d0/d2/d7/f34 429758292 1 2024-02-15T18:31:24.459 INFO:tasks.workunit.client.1.smithi131.stdout:6/145: write d2/f9 [1796458,35704] 0 2024-02-15T18:31:24.462 INFO:tasks.workunit.client.1.smithi131.stdout:6/146: mknod d2/dc/d19/c2e 0 2024-02-15T18:31:24.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/247: dwrite d18/d23/f30 [0,4194304] 0 2024-02-15T18:31:24.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/248: truncate d18/d24/f4a 142538 0 2024-02-15T18:31:24.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/249: chown d18/c1c 443943 1 2024-02-15T18:31:24.481 INFO:tasks.workunit.client.1.smithi131.stdout:5/250: creat d18/d33/f54 x:0 0 0 2024-02-15T18:31:24.481 INFO:tasks.workunit.client.1.smithi131.stdout:5/251: write d18/d24/f2c [929119,81853] 0 2024-02-15T18:31:24.485 INFO:tasks.workunit.client.1.smithi131.stdout:5/252: creat d18/d24/f55 x:0 0 0 2024-02-15T18:31:24.485 INFO:tasks.workunit.client.1.smithi131.stdout:5/253: write d18/d24/f2c [1058361,14557] 0 2024-02-15T18:31:24.488 INFO:tasks.workunit.client.1.smithi131.stdout:5/254: mknod d18/d24/c56 0 2024-02-15T18:31:24.516 INFO:tasks.workunit.client.1.smithi131.stdout:9/143: dwrite d4/dc/d17/d19/fb [0,4194304] 0 2024-02-15T18:31:24.517 INFO:tasks.workunit.client.1.smithi131.stdout:8/111: dwrite f1c [0,4194304] 0 2024-02-15T18:31:24.517 INFO:tasks.workunit.client.1.smithi131.stdout:6/147: dwrite d2/dc/f2a [0,4194304] 0 2024-02-15T18:31:24.517 INFO:tasks.workunit.client.1.smithi131.stdout:8/112: write d22/f23 [337515,23421] 0 2024-02-15T18:31:24.517 INFO:tasks.workunit.client.1.smithi131.stdout:1/205: dwrite d0/f27 [4194304,4194304] 0 2024-02-15T18:31:24.519 INFO:tasks.workunit.client.1.smithi131.stdout:5/255: dwrite d18/d20/f48 [0,4194304] 0 2024-02-15T18:31:24.522 INFO:tasks.workunit.client.1.smithi131.stdout:2/60: dwrite f7 [0,4194304] 0 2024-02-15T18:31:24.524 INFO:tasks.workunit.client.1.smithi131.stdout:6/148: mknod d2/d2b/c2f 0 2024-02-15T18:31:24.524 INFO:tasks.workunit.client.1.smithi131.stdout:6/149: readlink d2/dc/d27/l29 0 2024-02-15T18:31:24.529 INFO:tasks.workunit.client.1.smithi131.stdout:8/113: dread f1c [0,4194304] 0 2024-02-15T18:31:24.529 INFO:tasks.workunit.client.1.smithi131.stdout:1/206: symlink d0/d2/d4/da/l49 0 2024-02-15T18:31:24.530 INFO:tasks.workunit.client.1.smithi131.stdout:5/256: unlink d18/d23/l41 0 2024-02-15T18:31:24.534 INFO:tasks.workunit.client.1.smithi131.stdout:6/150: symlink d2/dc/d27/l30 0 2024-02-15T18:31:24.536 INFO:tasks.workunit.client.1.smithi131.stdout:8/114: dread f1c [0,4194304] 0 2024-02-15T18:31:24.537 INFO:tasks.workunit.client.1.smithi131.stdout:5/257: dread d18/d23/f32 [0,4194304] 0 2024-02-15T18:31:24.537 INFO:tasks.workunit.client.1.smithi131.stdout:5/258: chown d18/d20/c40 3473087 1 2024-02-15T18:31:24.537 INFO:tasks.workunit.client.1.smithi131.stdout:5/259: chown d18/d24/l51 0 1 2024-02-15T18:31:24.537 INFO:tasks.workunit.client.1.smithi131.stdout:5/260: write d18/d33/f54 [752105,70629] 0 2024-02-15T18:31:24.539 INFO:tasks.workunit.client.1.smithi131.stdout:2/61: mkdir dd 0 2024-02-15T18:31:24.541 INFO:tasks.workunit.client.1.smithi131.stdout:6/151: rmdir d2/d2b 39 2024-02-15T18:31:24.541 INFO:tasks.workunit.client.1.smithi131.stdout:6/152: fdatasync d2/d7/fa 0 2024-02-15T18:31:24.542 INFO:tasks.workunit.client.1.smithi131.stdout:8/115: rename fe to d22/f27 0 2024-02-15T18:31:24.542 INFO:tasks.workunit.client.1.smithi131.stdout:8/116: write f1a [321978,74494] 0 2024-02-15T18:31:24.543 INFO:tasks.workunit.client.1.smithi131.stdout:5/261: creat d18/d20/f57 x:0 0 0 2024-02-15T18:31:24.544 INFO:tasks.workunit.client.1.smithi131.stdout:9/144: dread f0 [0,4194304] 0 2024-02-15T18:31:24.544 INFO:tasks.workunit.client.1.smithi131.stdout:1/207: mknod d0/d1/d44/c4a 0 2024-02-15T18:31:24.544 INFO:tasks.workunit.client.1.smithi131.stdout:9/145: read f3 [34262,52335] 0 2024-02-15T18:31:24.544 INFO:tasks.workunit.client.1.smithi131.stdout:2/62: symlink dd/le 0 2024-02-15T18:31:24.548 INFO:tasks.workunit.client.1.smithi131.stdout:2/63: read fa [2363776,3798] 0 2024-02-15T18:31:24.548 INFO:tasks.workunit.client.1.smithi131.stdout:2/64: write fc [257309,81836] 0 2024-02-15T18:31:24.549 INFO:tasks.workunit.client.1.smithi131.stdout:5/262: symlink d18/d23/l58 0 2024-02-15T18:31:24.549 INFO:tasks.workunit.client.1.smithi131.stdout:5/263: readlink d18/d20/l46 0 2024-02-15T18:31:24.549 INFO:tasks.workunit.client.1.smithi131.stdout:9/146: creat d4/dc/d17/d19/f2a x:0 0 0 2024-02-15T18:31:24.551 INFO:tasks.workunit.client.1.smithi131.stdout:5/264: creat d18/d24/f59 x:0 0 0 2024-02-15T18:31:24.554 INFO:tasks.workunit.client.1.smithi131.stdout:5/265: unlink d18/d33/l49 0 2024-02-15T18:31:24.555 INFO:tasks.workunit.client.1.smithi131.stdout:5/266: chown d18/d23/l58 63541709 1 2024-02-15T18:31:24.555 INFO:tasks.workunit.client.1.smithi131.stdout:5/267: truncate fb 8979378 0 2024-02-15T18:31:24.558 INFO:tasks.workunit.client.1.smithi131.stdout:5/268: dread d18/f1e [4194304,4194304] 0 2024-02-15T18:31:24.560 INFO:tasks.workunit.client.1.smithi131.stdout:5/269: creat d18/d33/f5a x:0 0 0 2024-02-15T18:31:24.591 INFO:tasks.workunit.client.1.smithi131.stdout:5/270: dwrite d18/d20/f4c [0,4194304] 0 2024-02-15T18:31:24.591 INFO:tasks.workunit.client.1.smithi131.stdout:6/153: dwrite d2/d7/d16/f1e [0,4194304] 0 2024-02-15T18:31:24.591 INFO:tasks.workunit.client.1.smithi131.stdout:6/154: fdatasync d2/dc/d19/f1c 0 2024-02-15T18:31:24.593 INFO:tasks.workunit.client.1.smithi131.stdout:9/147: dwrite d4/dc/d17/f16 [0,4194304] 0 2024-02-15T18:31:24.593 INFO:tasks.workunit.client.1.smithi131.stdout:1/208: dwrite d0/d1/d16/d19/f1b [0,4194304] 0 2024-02-15T18:31:24.595 INFO:tasks.workunit.client.1.smithi131.stdout:6/155: write d2/d7/fa [546375,108061] 0 2024-02-15T18:31:24.596 INFO:tasks.workunit.client.1.smithi131.stdout:5/271: creat d18/d33/f5b x:0 0 0 2024-02-15T18:31:24.596 INFO:tasks.workunit.client.1.smithi131.stdout:5/272: fdatasync f11 0 2024-02-15T18:31:24.596 INFO:tasks.workunit.client.1.smithi131.stdout:5/273: dread - d18/d23/f52 zero size 2024-02-15T18:31:24.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/148: rename d4/dc/d17/d19 to d4/dc/d17/d19/d2b 22 2024-02-15T18:31:24.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/149: chown d4 60539387 1 2024-02-15T18:31:24.602 INFO:tasks.workunit.client.1.smithi131.stdout:5/274: symlink d18/d20/l5c 0 2024-02-15T18:31:24.604 INFO:tasks.workunit.client.1.smithi131.stdout:9/150: mkdir d4/dc/de/d1e/d1f/d2c 0 2024-02-15T18:31:24.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/65: dwrite fa [4194304,4194304] 0 2024-02-15T18:31:24.608 INFO:tasks.workunit.client.1.smithi131.stdout:6/156: rmdir d2/dc 39 2024-02-15T18:31:24.621 INFO:tasks.workunit.client.1.smithi131.stdout:6/157: creat d2/dc/d27/f31 x:0 0 0 2024-02-15T18:31:24.621 INFO:tasks.workunit.client.1.smithi131.stdout:2/66: write f8 [713897,120035] 0 2024-02-15T18:31:24.622 INFO:tasks.workunit.client.1.smithi131.stdout:9/151: creat d4/dc/f2d x:0 0 0 2024-02-15T18:31:24.622 INFO:tasks.workunit.client.1.smithi131.stdout:9/152: stat d4/dc/de/d1e/d1f/d2c 0 2024-02-15T18:31:24.623 INFO:tasks.workunit.client.1.smithi131.stdout:2/67: rename f7 to dd/ff 0 2024-02-15T18:31:24.623 INFO:tasks.workunit.client.1.smithi131.stdout:2/68: write fb [4845663,66472] 0 2024-02-15T18:31:24.623 INFO:tasks.workunit.client.1.smithi131.stdout:9/153: rename d4 to d4/dc/de/d1e/d1f/d2e 22 2024-02-15T18:31:24.623 INFO:tasks.workunit.client.1.smithi131.stdout:9/154: fsync d4/dc/d17/f16 0 2024-02-15T18:31:24.625 INFO:tasks.workunit.client.1.smithi131.stdout:5/275: dwrite d18/d33/f5a [0,4194304] 0 2024-02-15T18:31:24.626 INFO:tasks.workunit.client.1.smithi131.stdout:9/155: creat d4/dc/de/f2f x:0 0 0 2024-02-15T18:31:24.631 INFO:tasks.workunit.client.1.smithi131.stdout:6/158: dread d2/d7/d16/f1e [0,4194304] 0 2024-02-15T18:31:24.631 INFO:tasks.workunit.client.1.smithi131.stdout:6/159: chown d2/d2b 631 1 2024-02-15T18:31:24.632 INFO:tasks.workunit.client.1.smithi131.stdout:9/156: symlink d4/dc/de/l30 0 2024-02-15T18:31:24.632 INFO:tasks.workunit.client.1.smithi131.stdout:9/157: readlink d4/dc/de/l30 0 2024-02-15T18:31:24.633 INFO:tasks.workunit.client.1.smithi131.stdout:5/276: dread f11 [0,4194304] 0 2024-02-15T18:31:24.633 INFO:tasks.workunit.client.1.smithi131.stdout:5/277: chown d18/c25 2713 1 2024-02-15T18:31:24.633 INFO:tasks.workunit.client.1.smithi131.stdout:5/278: read - d18/d24/f55 zero size 2024-02-15T18:31:24.635 INFO:tasks.workunit.client.1.smithi131.stdout:6/160: symlink d2/dc/d1f/l32 0 2024-02-15T18:31:24.635 INFO:tasks.workunit.client.1.smithi131.stdout:6/161: getdents d2/d7/d12 0 2024-02-15T18:31:24.644 INFO:tasks.workunit.client.1.smithi131.stdout:6/162: write d2/d7/fa [684478,84061] 0 2024-02-15T18:31:24.644 INFO:tasks.workunit.client.1.smithi131.stdout:6/163: fdatasync d2/f9 0 2024-02-15T18:31:24.645 INFO:tasks.workunit.client.1.smithi131.stdout:6/164: write d2/dc/f14 [416607,29410] 0 2024-02-15T18:31:24.645 INFO:tasks.workunit.client.1.smithi131.stdout:6/165: readlink d2/d7/d12/l15 0 2024-02-15T18:31:24.646 INFO:tasks.workunit.client.1.smithi131.stdout:2/69: fsync dd/ff 0 2024-02-15T18:31:24.646 INFO:tasks.workunit.client.1.smithi131.stdout:9/158: dread f1 [0,4194304] 0 2024-02-15T18:31:24.646 INFO:tasks.workunit.client.1.smithi131.stdout:4/95: sync 2024-02-15T18:31:24.646 INFO:tasks.workunit.client.1.smithi131.stdout:4/96: fdatasync d2/d7/f10 0 2024-02-15T18:31:24.648 INFO:tasks.workunit.client.1.smithi131.stdout:2/70: getdents dd 0 2024-02-15T18:31:24.650 INFO:tasks.workunit.client.1.smithi131.stdout:4/97: symlink d2/da/d21/l25 0 2024-02-15T18:31:24.650 INFO:tasks.workunit.client.1.smithi131.stdout:4/98: dread - d2/f8 zero size 2024-02-15T18:31:24.653 INFO:tasks.workunit.client.1.smithi131.stdout:9/159: rename d4/dc/d17/d19/ld to d4/dc/d25/l31 0 2024-02-15T18:31:24.653 INFO:tasks.workunit.client.1.smithi131.stdout:2/71: read fa [704519,90016] 0 2024-02-15T18:31:24.655 INFO:tasks.workunit.client.1.smithi131.stdout:6/166: link d2/l17 d2/dc/d1f/l33 0 2024-02-15T18:31:24.655 INFO:tasks.workunit.client.1.smithi131.stdout:6/167: fdatasync d2/dc/f2a 0 2024-02-15T18:31:24.677 INFO:tasks.workunit.client.1.smithi131.stdout:4/99: dwrite d2/d7/ff [0,4194304] 0 2024-02-15T18:31:24.682 INFO:tasks.workunit.client.1.smithi131.stdout:4/100: creat d2/d7/d1c/f26 x:0 0 0 2024-02-15T18:31:24.692 INFO:tasks.workunit.client.1.smithi131.stdout:4/101: write d2/d7/ff [2763129,105293] 0 2024-02-15T18:31:24.693 INFO:tasks.workunit.client.1.smithi131.stdout:9/160: dwrite f1 [0,4194304] 0 2024-02-15T18:31:24.694 INFO:tasks.workunit.client.1.smithi131.stdout:4/102: rename d2/d7/d1c/f26 to d2/da/f27 0 2024-02-15T18:31:24.694 INFO:tasks.workunit.client.1.smithi131.stdout:6/168: dwrite d2/f1a [0,4194304] 0 2024-02-15T18:31:24.696 INFO:tasks.workunit.client.1.smithi131.stdout:4/103: unlink d2/d7/d12/c17 0 2024-02-15T18:31:24.696 INFO:tasks.workunit.client.1.smithi131.stdout:4/104: write d2/d7/f11 [1921868,40767] 0 2024-02-15T18:31:24.697 INFO:tasks.workunit.client.1.smithi131.stdout:6/169: creat d2/dc/d19/f34 x:0 0 0 2024-02-15T18:31:24.698 INFO:tasks.workunit.client.1.smithi131.stdout:4/105: creat d2/d7/d12/f28 x:0 0 0 2024-02-15T18:31:24.698 INFO:tasks.workunit.client.1.smithi131.stdout:4/106: write d2/f1a [223870,19885] 0 2024-02-15T18:31:24.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/170: symlink d2/dc/d1f/l35 0 2024-02-15T18:31:24.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/171: write d2/dc/f14 [4528722,13557] 0 2024-02-15T18:31:24.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/172: chown d2/dc/d1f/l32 126202 1 2024-02-15T18:31:24.699 INFO:tasks.workunit.client.1.smithi131.stdout:4/107: creat d2/da/d21/f29 x:0 0 0 2024-02-15T18:31:24.701 INFO:tasks.workunit.client.1.smithi131.stdout:6/173: truncate d2/f13 3742307 0 2024-02-15T18:31:24.701 INFO:tasks.workunit.client.1.smithi131.stdout:6/174: fsync d2/dc/d19/f1c 0 2024-02-15T18:31:24.702 INFO:tasks.workunit.client.1.smithi131.stdout:4/108: mkdir d2/d2a 0 2024-02-15T18:31:24.702 INFO:tasks.workunit.client.1.smithi131.stdout:2/72: dwrite f8 [0,4194304] 0 2024-02-15T18:31:24.703 INFO:tasks.workunit.client.1.smithi131.stdout:2/73: getdents dd 0 2024-02-15T18:31:24.705 INFO:tasks.workunit.client.1.smithi131.stdout:2/74: truncate dd/ff 786992 0 2024-02-15T18:31:24.706 INFO:tasks.workunit.client.1.smithi131.stdout:2/75: chown c1 409588 1 2024-02-15T18:31:24.708 INFO:tasks.workunit.client.1.smithi131.stdout:6/175: dread d2/dc/d19/f1c [0,4194304] 0 2024-02-15T18:31:24.715 INFO:tasks.workunit.client.1.smithi131.stdout:6/176: mkdir d2/d36 0 2024-02-15T18:31:24.715 INFO:tasks.workunit.client.1.smithi131.stdout:6/177: chown d2/d7/d12 143849 1 2024-02-15T18:31:24.716 INFO:tasks.workunit.client.1.smithi131.stdout:6/178: getdents d2/d7/d12 0 2024-02-15T18:31:24.727 INFO:tasks.workunit.client.1.smithi131.stdout:9/161: dwrite d4/dc/d17/f16 [0,4194304] 0 2024-02-15T18:31:24.727 INFO:tasks.workunit.client.1.smithi131.stdout:4/109: dwrite d2/d7/f1d [0,4194304] 0 2024-02-15T18:31:24.727 INFO:tasks.workunit.client.1.smithi131.stdout:4/110: readlink d2/l1e 0 2024-02-15T18:31:24.727 INFO:tasks.workunit.client.1.smithi131.stdout:4/111: fdatasync d2/da/fd 0 2024-02-15T18:31:24.730 INFO:tasks.workunit.client.1.smithi131.stdout:4/112: creat d2/d2a/f2b x:0 0 0 2024-02-15T18:31:24.732 INFO:tasks.workunit.client.1.smithi131.stdout:9/162: mkdir d4/dc/d17/d19/d32 0 2024-02-15T18:31:24.732 INFO:tasks.workunit.client.1.smithi131.stdout:9/163: dread - d4/dc/f2d zero size 2024-02-15T18:31:24.732 INFO:tasks.workunit.client.1.smithi131.stdout:4/113: creat d2/d7/f2c x:0 0 0 2024-02-15T18:31:24.732 INFO:tasks.workunit.client.1.smithi131.stdout:4/114: write d2/d7/fc [1773264,94557] 0 2024-02-15T18:31:24.734 INFO:tasks.workunit.client.1.smithi131.stdout:9/164: unlink d4/dc/d17/f16 0 2024-02-15T18:31:24.734 INFO:tasks.workunit.client.1.smithi131.stdout:9/165: fsync d4/dc/de/f1d 0 2024-02-15T18:31:24.734 INFO:tasks.workunit.client.1.smithi131.stdout:4/115: mkdir d2/da/d16/d2d 0 2024-02-15T18:31:24.735 INFO:tasks.workunit.client.1.smithi131.stdout:9/166: write f1 [1282597,43228] 0 2024-02-15T18:31:24.735 INFO:tasks.workunit.client.1.smithi131.stdout:9/167: stat d4 0 2024-02-15T18:31:24.735 INFO:tasks.workunit.client.1.smithi131.stdout:6/179: truncate d2/f13 2293763 0 2024-02-15T18:31:24.736 INFO:tasks.workunit.client.1.smithi131.stdout:4/116: read d2/d7/f10 [2267591,121338] 0 2024-02-15T18:31:24.737 INFO:tasks.workunit.client.1.smithi131.stdout:9/168: symlink d4/dc/l33 0 2024-02-15T18:31:24.737 INFO:tasks.workunit.client.1.smithi131.stdout:9/169: fsync d4/dc/de/f2f 0 2024-02-15T18:31:24.737 INFO:tasks.workunit.client.1.smithi131.stdout:9/170: truncate d4/dc/de/f1d 810661 0 2024-02-15T18:31:24.737 INFO:tasks.workunit.client.1.smithi131.stdout:9/171: dread - d4/dc/d17/d19/f2a zero size 2024-02-15T18:31:24.737 INFO:tasks.workunit.client.1.smithi131.stdout:9/172: write d4/dc/f2d [484998,17969] 0 2024-02-15T18:31:24.737 INFO:tasks.workunit.client.1.smithi131.stdout:9/173: write d4/dc/de/f2f [544799,63608] 0 2024-02-15T18:31:24.737 INFO:tasks.workunit.client.1.smithi131.stdout:9/174: mknod d4/dc/de/d1e/d1f/d2c/c34 0 2024-02-15T18:31:24.739 INFO:tasks.workunit.client.1.smithi131.stdout:9/175: creat d4/dc/de/d1e/d26/f35 x:0 0 0 2024-02-15T18:31:24.739 INFO:tasks.workunit.client.1.smithi131.stdout:9/176: write d4/dc/de/f1d [105770,102204] 0 2024-02-15T18:31:24.739 INFO:tasks.workunit.client.1.smithi131.stdout:9/177: chown d4/dc/d17/d19/f2a 5403480 1 2024-02-15T18:31:24.739 INFO:tasks.workunit.client.1.smithi131.stdout:9/178: readlink d4/l21 0 2024-02-15T18:31:24.740 INFO:tasks.workunit.client.1.smithi131.stdout:9/179: creat d4/dc/f36 x:0 0 0 2024-02-15T18:31:24.740 INFO:tasks.workunit.client.1.smithi131.stdout:9/180: write d4/dc/f36 [606652,33078] 0 2024-02-15T18:31:24.742 INFO:tasks.workunit.client.1.smithi131.stdout:9/181: unlink d4/dc/de/d1e/d26/f35 0 2024-02-15T18:31:24.742 INFO:tasks.workunit.client.1.smithi131.stdout:9/182: chown d4/dc/de/d1e/d1f/d2c/c34 1574941804 1 2024-02-15T18:31:24.742 INFO:tasks.workunit.client.1.smithi131.stdout:2/76: dwrite fb [0,4194304] 0 2024-02-15T18:31:24.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/183: creat d4/dc/de/d1e/f37 x:0 0 0 2024-02-15T18:31:24.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/184: truncate d4/dc/de/d1e/f37 675695 0 2024-02-15T18:31:24.745 INFO:tasks.workunit.client.1.smithi131.stdout:6/180: dread d2/f1a [0,4194304] 0 2024-02-15T18:31:24.748 INFO:tasks.workunit.client.1.smithi131.stdout:2/77: mkdir dd/d10 0 2024-02-15T18:31:24.749 INFO:tasks.workunit.client.1.smithi131.stdout:9/185: mkdir d4/dc/de/d1e/d26/d38 0 2024-02-15T18:31:24.750 INFO:tasks.workunit.client.1.smithi131.stdout:6/181: creat d2/d2b/f37 x:0 0 0 2024-02-15T18:31:24.752 INFO:tasks.workunit.client.1.smithi131.stdout:9/186: rename d4/dc/d25/c27 to d4/dc/d17/d19/d32/c39 0 2024-02-15T18:31:24.753 INFO:tasks.workunit.client.1.smithi131.stdout:4/117: dread d2/d7/ff [0,4194304] 0 2024-02-15T18:31:24.755 INFO:tasks.workunit.client.1.smithi131.stdout:6/182: mkdir d2/d38 0 2024-02-15T18:31:24.755 INFO:tasks.workunit.client.1.smithi131.stdout:6/183: chown d2/d7/f1b 389 1 2024-02-15T18:31:24.756 INFO:tasks.workunit.client.1.smithi131.stdout:6/184: fdatasync d2/dc/f2a 0 2024-02-15T18:31:24.756 INFO:tasks.workunit.client.1.smithi131.stdout:6/185: truncate d2/d7/f1b 4691528 0 2024-02-15T18:31:24.758 INFO:tasks.workunit.client.1.smithi131.stdout:4/118: mkdir d2/d7/d12/d2e 0 2024-02-15T18:31:24.761 INFO:tasks.workunit.client.1.smithi131.stdout:6/186: creat d2/d7/f39 x:0 0 0 2024-02-15T18:31:24.800 INFO:tasks.workunit.client.1.smithi131.stdout:6/187: dwrite d2/d7/d16/f1e [0,4194304] 0 2024-02-15T18:31:24.803 INFO:tasks.workunit.client.1.smithi131.stdout:4/119: dwrite d2/f8 [0,4194304] 0 2024-02-15T18:31:24.804 INFO:tasks.workunit.client.1.smithi131.stdout:2/78: dwrite f4 [0,4194304] 0 2024-02-15T18:31:24.804 INFO:tasks.workunit.client.1.smithi131.stdout:2/79: fsync f4 0 2024-02-15T18:31:24.804 INFO:tasks.workunit.client.1.smithi131.stdout:6/188: symlink d2/d7/d16/l3a 0 2024-02-15T18:31:24.807 INFO:tasks.workunit.client.1.smithi131.stdout:6/189: write d2/d7/d16/f1e [3752497,14759] 0 2024-02-15T18:31:24.807 INFO:tasks.workunit.client.1.smithi131.stdout:6/190: fsync d2/d7/fa 0 2024-02-15T18:31:24.809 INFO:tasks.workunit.client.1.smithi131.stdout:4/120: rename d2/da/l24 to d2/da/d16/l2f 0 2024-02-15T18:31:24.809 INFO:tasks.workunit.client.1.smithi131.stdout:4/121: stat d2/d7/f1d 0 2024-02-15T18:31:24.809 INFO:tasks.workunit.client.1.smithi131.stdout:4/122: chown d2/f9 92674041 1 2024-02-15T18:31:24.810 INFO:tasks.workunit.client.1.smithi131.stdout:2/80: link f8 dd/f11 0 2024-02-15T18:31:24.812 INFO:tasks.workunit.client.1.smithi131.stdout:6/191: rename d2/l17 to d2/d7/d12/l3b 0 2024-02-15T18:31:24.813 INFO:tasks.workunit.client.1.smithi131.stdout:2/81: mkdir dd/d12 0 2024-02-15T18:31:24.813 INFO:tasks.workunit.client.1.smithi131.stdout:2/82: readlink l9 0 2024-02-15T18:31:24.821 INFO:tasks.workunit.client.1.smithi131.stdout:4/123: dread d2/d7/f1d [0,4194304] 0 2024-02-15T18:31:24.821 INFO:tasks.workunit.client.1.smithi131.stdout:4/124: dread - d2/d7/d12/f28 zero size 2024-02-15T18:31:24.827 INFO:tasks.workunit.client.1.smithi131.stdout:4/125: creat d2/da/d16/f30 x:0 0 0 2024-02-15T18:31:24.827 INFO:tasks.workunit.client.1.smithi131.stdout:4/126: chown d2/d2a/f2b 645487 1 2024-02-15T18:31:24.827 INFO:tasks.workunit.client.1.smithi131.stdout:4/127: fdatasync d2/da/d16/f30 0 2024-02-15T18:31:24.827 INFO:tasks.workunit.client.1.smithi131.stdout:4/128: dread - d2/d2a/f2b zero size 2024-02-15T18:31:24.830 INFO:tasks.workunit.client.1.smithi131.stdout:4/129: read d2/d7/f14 [225771,123063] 0 2024-02-15T18:31:24.832 INFO:tasks.workunit.client.1.smithi131.stdout:4/130: rename d2/le to d2/da/l31 0 2024-02-15T18:31:24.836 INFO:tasks.workunit.client.1.smithi131.stdout:6/192: dwrite d2/d7/f1b [0,4194304] 0 2024-02-15T18:31:24.836 INFO:tasks.workunit.client.1.smithi131.stdout:6/193: readlink d2/d7/d16/l24 0 2024-02-15T18:31:24.836 INFO:tasks.workunit.client.1.smithi131.stdout:6/194: write d2/d2b/f37 [241683,10404] 0 2024-02-15T18:31:24.838 INFO:tasks.workunit.client.1.smithi131.stdout:4/131: creat d2/da/d16/f32 x:0 0 0 2024-02-15T18:31:24.840 INFO:tasks.workunit.client.1.smithi131.stdout:4/132: unlink d2/da/d16/l2f 0 2024-02-15T18:31:24.842 INFO:tasks.workunit.client.1.smithi131.stdout:4/133: getdents d2/d7/d1c 0 2024-02-15T18:31:24.842 INFO:tasks.workunit.client.1.smithi131.stdout:4/134: chown d2/d7/d12/d2e 16237135 1 2024-02-15T18:31:24.843 INFO:tasks.workunit.client.1.smithi131.stdout:4/135: symlink d2/da/d16/l33 0 2024-02-15T18:31:24.845 INFO:tasks.workunit.client.1.smithi131.stdout:4/136: write d2/d7/ff [3270464,58864] 0 2024-02-15T18:31:24.847 INFO:tasks.workunit.client.1.smithi131.stdout:4/137: truncate d2/f4 1960945 0 2024-02-15T18:31:24.850 INFO:tasks.workunit.client.1.smithi131.stdout:4/138: creat d2/d7/d12/d2e/f34 x:0 0 0 2024-02-15T18:31:24.850 INFO:tasks.workunit.client.1.smithi131.stdout:4/139: write d2/da/d16/f30 [986485,4291] 0 2024-02-15T18:31:24.850 INFO:tasks.workunit.client.1.smithi131.stdout:4/140: truncate d2/da/f19 1245335 0 2024-02-15T18:31:24.850 INFO:tasks.workunit.client.1.smithi131.stdout:4/141: chown d2/d2a/f2b 195 1 2024-02-15T18:31:24.853 INFO:tasks.workunit.client.1.smithi131.stdout:4/142: unlink d2/da/fd 0 2024-02-15T18:31:24.857 INFO:tasks.workunit.client.1.smithi131.stdout:4/143: creat d2/f35 x:0 0 0 2024-02-15T18:31:24.857 INFO:tasks.workunit.client.1.smithi131.stdout:6/195: dwrite d2/d7/d16/f25 [0,4194304] 0 2024-02-15T18:31:24.858 INFO:tasks.workunit.client.1.smithi131.stdout:6/196: fdatasync d2/d7/f1b 0 2024-02-15T18:31:24.861 INFO:tasks.workunit.client.1.smithi131.stdout:4/144: symlink d2/da/d16/l36 0 2024-02-15T18:31:24.861 INFO:tasks.workunit.client.1.smithi131.stdout:6/197: read d2/dc/d19/f1c [377152,38147] 0 2024-02-15T18:31:24.886 INFO:tasks.workunit.client.1.smithi131.stdout:6/198: dwrite d2/d7/d16/f1e [0,4194304] 0 2024-02-15T18:31:24.886 INFO:tasks.workunit.client.1.smithi131.stdout:6/199: stat d2/dc/d19/f34 0 2024-02-15T18:31:24.888 INFO:tasks.workunit.client.1.smithi131.stdout:4/145: dwrite d2/da/f19 [0,4194304] 0 2024-02-15T18:31:24.891 INFO:tasks.workunit.client.1.smithi131.stdout:4/146: creat d2/da/d16/f37 x:0 0 0 2024-02-15T18:31:24.894 INFO:tasks.workunit.client.1.smithi131.stdout:4/147: mkdir d2/da/d38 0 2024-02-15T18:31:24.894 INFO:tasks.workunit.client.1.smithi131.stdout:4/148: read - d2/da/d16/f37 zero size 2024-02-15T18:31:24.896 INFO:tasks.workunit.client.1.smithi131.stdout:4/149: rmdir d2/d7/d12 39 2024-02-15T18:31:24.896 INFO:tasks.workunit.client.1.smithi131.stdout:4/150: chown d2/da/d16/f32 112034 1 2024-02-15T18:31:24.897 INFO:tasks.workunit.client.1.smithi131.stdout:4/151: mkdir d2/d7/d12/d2e/d39 0 2024-02-15T18:31:24.902 INFO:tasks.workunit.client.1.smithi131.stdout:4/152: dread d2/d7/f13 [0,4194304] 0 2024-02-15T18:31:24.902 INFO:tasks.workunit.client.1.smithi131.stdout:4/153: chown d2/c15 0 1 2024-02-15T18:31:24.904 INFO:tasks.workunit.client.1.smithi131.stdout:4/154: creat d2/da/d21/f3a x:0 0 0 2024-02-15T18:31:24.904 INFO:tasks.workunit.client.1.smithi131.stdout:4/155: symlink d2/d7/d1c/l3b 0 2024-02-15T18:31:24.905 INFO:tasks.workunit.client.1.smithi131.stdout:6/200: dwrite f0 [4194304,4194304] 0 2024-02-15T18:31:24.905 INFO:tasks.workunit.client.1.smithi131.stdout:4/156: creat d2/d2a/f3c x:0 0 0 2024-02-15T18:31:24.909 INFO:tasks.workunit.client.1.smithi131.stdout:6/201: write d2/f9 [4538678,39689] 0 2024-02-15T18:31:24.909 INFO:tasks.workunit.client.1.smithi131.stdout:6/202: chown d2/d7 20204722 1 2024-02-15T18:31:24.911 INFO:tasks.workunit.client.1.smithi131.stdout:6/203: creat d2/d36/f3c x:0 0 0 2024-02-15T18:31:24.911 INFO:tasks.workunit.client.1.smithi131.stdout:6/204: chown d2/d7/c10 1461290 1 2024-02-15T18:31:24.911 INFO:tasks.workunit.client.1.smithi131.stdout:6/205: chown d2/d7/f1b 0 1 2024-02-15T18:31:24.911 INFO:tasks.workunit.client.1.smithi131.stdout:6/206: fsync d2/dc/d19/f1c 0 2024-02-15T18:31:24.912 INFO:tasks.workunit.client.1.smithi131.stdout:6/207: symlink d2/d7/d16/l3d 0 2024-02-15T18:31:24.912 INFO:tasks.workunit.client.1.smithi131.stdout:6/208: dread - d2/dc/d27/f31 zero size 2024-02-15T18:31:24.913 INFO:tasks.workunit.client.1.smithi131.stdout:6/209: write d2/dc/d1f/f26 [66136,90290] 0 2024-02-15T18:31:24.919 INFO:tasks.workunit.client.1.smithi131.stdout:6/210: dread d2/f13 [0,4194304] 0 2024-02-15T18:31:24.920 INFO:tasks.workunit.client.1.smithi131.stdout:4/157: dwrite d2/d7/f11 [0,4194304] 0 2024-02-15T18:31:24.921 INFO:tasks.workunit.client.1.smithi131.stdout:6/211: unlink d2/dc/d19/f34 0 2024-02-15T18:31:24.924 INFO:tasks.workunit.client.1.smithi131.stdout:4/158: unlink d2/d2a/f2b 0 2024-02-15T18:31:24.924 INFO:tasks.workunit.client.1.smithi131.stdout:4/159: write d2/da/d16/f32 [465840,117807] 0 2024-02-15T18:31:24.925 INFO:tasks.workunit.client.1.smithi131.stdout:6/212: symlink d2/d36/l3e 0 2024-02-15T18:31:24.930 INFO:tasks.workunit.client.1.smithi131.stdout:6/213: dread d2/d7/fd [0,4194304] 0 2024-02-15T18:31:24.931 INFO:tasks.workunit.client.1.smithi131.stdout:6/214: read d2/d7/f1b [2500680,100314] 0 2024-02-15T18:31:24.931 INFO:tasks.workunit.client.1.smithi131.stdout:6/215: dread - d2/f28 zero size 2024-02-15T18:31:24.932 INFO:tasks.workunit.client.1.smithi131.stdout:6/216: mknod d2/d36/c3f 0 2024-02-15T18:31:24.933 INFO:tasks.workunit.client.1.smithi131.stdout:6/217: mkdir d2/dc/d19/d40 0 2024-02-15T18:31:24.934 INFO:tasks.workunit.client.1.smithi131.stdout:6/218: mknod d2/d7/d12/c41 0 2024-02-15T18:31:24.934 INFO:tasks.workunit.client.1.smithi131.stdout:6/219: fsync d2/d7/d16/f1e 0 2024-02-15T18:31:24.934 INFO:tasks.workunit.client.1.smithi131.stdout:6/220: fsync d2/f13 0 2024-02-15T18:31:24.936 INFO:tasks.workunit.client.1.smithi131.stdout:6/221: creat d2/f42 x:0 0 0 2024-02-15T18:31:24.937 INFO:tasks.workunit.client.1.smithi131.stdout:6/222: getdents d2/d7 0 2024-02-15T18:31:24.938 INFO:tasks.workunit.client.1.smithi131.stdout:6/223: creat d2/d7/d16/f43 x:0 0 0 2024-02-15T18:31:24.939 INFO:tasks.workunit.client.1.smithi131.stdout:6/224: getdents d2/d7 0 2024-02-15T18:31:24.940 INFO:tasks.workunit.client.1.smithi131.stdout:6/225: link d2/d7/d16/f25 d2/dc/d19/f44 0 2024-02-15T18:31:24.940 INFO:tasks.workunit.client.1.smithi131.stdout:6/226: chown d2/dc/f2a 3174322 1 2024-02-15T18:31:24.940 INFO:tasks.workunit.client.1.smithi131.stdout:6/227: fdatasync d2/dc/d19/f44 0 2024-02-15T18:31:24.942 INFO:tasks.workunit.client.1.smithi131.stdout:4/160: dwrite d2/d7/f1d [0,4194304] 0 2024-02-15T18:31:24.943 INFO:tasks.workunit.client.1.smithi131.stdout:4/161: mkdir d2/da/d16/d2d/d3d 0 2024-02-15T18:31:24.943 INFO:tasks.workunit.client.1.smithi131.stdout:6/228: fdatasync f0 0 2024-02-15T18:31:24.944 INFO:tasks.workunit.client.1.smithi131.stdout:6/229: creat d2/f45 x:0 0 0 2024-02-15T18:31:24.944 INFO:tasks.workunit.client.1.smithi131.stdout:6/230: chown d2/d7/d16/l3d 3975272 1 2024-02-15T18:31:24.946 INFO:tasks.workunit.client.1.smithi131.stdout:7/235: sync 2024-02-15T18:31:24.946 INFO:tasks.workunit.client.1.smithi131.stdout:0/143: sync 2024-02-15T18:31:24.946 INFO:tasks.workunit.client.1.smithi131.stdout:0/144: fsync f4 0 2024-02-15T18:31:24.948 INFO:tasks.workunit.client.1.smithi131.stdout:7/236: rename d0/l22 to d0/l4f 0 2024-02-15T18:31:24.950 INFO:tasks.workunit.client.1.smithi131.stdout:0/145: unlink d5/f21 0 2024-02-15T18:31:24.951 INFO:tasks.workunit.client.1.smithi131.stdout:0/146: link d5/fd d5/d9/d11/f31 0 2024-02-15T18:31:24.953 INFO:tasks.workunit.client.1.smithi131.stdout:0/147: write f4 [1178989,31530] 0 2024-02-15T18:31:24.953 INFO:tasks.workunit.client.1.smithi131.stdout:0/148: read f0 [2295251,107559] 0 2024-02-15T18:31:24.954 INFO:tasks.workunit.client.1.smithi131.stdout:0/149: mknod d5/d15/d1f/c32 0 2024-02-15T18:31:24.954 INFO:tasks.workunit.client.1.smithi131.stdout:0/150: mknod d5/d15/c33 0 2024-02-15T18:31:24.957 INFO:tasks.workunit.client.1.smithi131.stdout:0/151: symlink d5/d2f/l34 0 2024-02-15T18:31:24.958 INFO:tasks.workunit.client.1.smithi131.stdout:0/152: dread d5/d9/d10/f19 [0,4194304] 0 2024-02-15T18:31:24.960 INFO:tasks.workunit.client.1.smithi131.stdout:4/162: dread d2/f9 [0,4194304] 0 2024-02-15T18:31:24.960 INFO:tasks.workunit.client.1.smithi131.stdout:4/163: write d2/f4 [2872507,80652] 0 2024-02-15T18:31:24.961 INFO:tasks.workunit.client.1.smithi131.stdout:0/153: link d5/d9/d10/c12 d5/c35 0 2024-02-15T18:31:24.964 INFO:tasks.workunit.client.1.smithi131.stdout:4/164: rename d2/d7/d12/f28 to d2/da/d21/f3e 0 2024-02-15T18:31:24.964 INFO:tasks.workunit.client.1.smithi131.stdout:4/165: read - d2/f35 zero size 2024-02-15T18:31:24.964 INFO:tasks.workunit.client.1.smithi131.stdout:4/166: fsync d2/da/d16/f30 0 2024-02-15T18:31:24.965 INFO:tasks.workunit.client.1.smithi131.stdout:0/154: creat d5/d15/d1f/f36 x:0 0 0 2024-02-15T18:31:24.971 INFO:tasks.workunit.client.1.smithi131.stdout:6/231: dwrite d2/d7/d16/f25 [0,4194304] 0 2024-02-15T18:31:24.991 INFO:tasks.workunit.client.1.smithi131.stdout:0/155: dwrite d5/d9/d11/f14 [0,4194304] 0 2024-02-15T18:31:24.993 INFO:tasks.workunit.client.1.smithi131.stdout:4/167: dwrite d2/da/d16/f32 [0,4194304] 0 2024-02-15T18:31:24.993 INFO:tasks.workunit.client.1.smithi131.stdout:0/156: mknod d5/d9/d11/c37 0 2024-02-15T18:31:24.993 INFO:tasks.workunit.client.1.smithi131.stdout:6/232: dwrite d2/d7/d16/f1e [0,4194304] 0 2024-02-15T18:31:24.997 INFO:tasks.workunit.client.1.smithi131.stdout:6/233: dread d2/f1a [0,4194304] 0 2024-02-15T18:31:24.997 INFO:tasks.workunit.client.1.smithi131.stdout:0/157: creat d5/d9/d11/f38 x:0 0 0 2024-02-15T18:31:24.999 INFO:tasks.workunit.client.1.smithi131.stdout:0/158: write d5/fa [2144951,131006] 0 2024-02-15T18:31:24.999 INFO:tasks.workunit.client.1.smithi131.stdout:0/159: fdatasync d5/d9/d10/f19 0 2024-02-15T18:31:25.000 INFO:tasks.workunit.client.1.smithi131.stdout:4/168: dread d2/f9 [0,4194304] 0 2024-02-15T18:31:25.000 INFO:tasks.workunit.client.1.smithi131.stdout:6/234: rename d2/d7/fd to d2/d7/f46 0 2024-02-15T18:31:25.000 INFO:tasks.workunit.client.1.smithi131.stdout:0/160: mknod d5/d2f/c39 0 2024-02-15T18:31:25.002 INFO:tasks.workunit.client.1.smithi131.stdout:0/161: mknod d5/d9/d11/c3a 0 2024-02-15T18:31:25.004 INFO:tasks.workunit.client.1.smithi131.stdout:4/169: dread d2/f1a [0,4194304] 0 2024-02-15T18:31:25.011 INFO:tasks.workunit.client.1.smithi131.stdout:3/94: sync 2024-02-15T18:31:25.013 INFO:tasks.workunit.client.1.smithi131.stdout:4/170: dread d2/d7/f10 [0,4194304] 0 2024-02-15T18:31:25.013 INFO:tasks.workunit.client.1.smithi131.stdout:3/95: rename d2/d3/f1f to d2/d3/d20/f21 0 2024-02-15T18:31:25.014 INFO:tasks.workunit.client.1.smithi131.stdout:4/171: rename d2/d7/f14 to d2/d7/d12/f3f 0 2024-02-15T18:31:25.015 INFO:tasks.workunit.client.1.smithi131.stdout:4/172: dread - d2/d2a/f3c zero size 2024-02-15T18:31:25.015 INFO:tasks.workunit.client.1.smithi131.stdout:4/173: read - d2/da/d21/f3a zero size 2024-02-15T18:31:25.015 INFO:tasks.workunit.client.1.smithi131.stdout:4/174: dread - d2/d7/d12/d2e/f34 zero size 2024-02-15T18:31:25.016 INFO:tasks.workunit.client.1.smithi131.stdout:3/96: write d2/d3/f6 [4504357,30191] 0 2024-02-15T18:31:25.016 INFO:tasks.workunit.client.1.smithi131.stdout:0/162: dwrite d5/d15/f2a [0,4194304] 0 2024-02-15T18:31:25.017 INFO:tasks.workunit.client.1.smithi131.stdout:3/97: mkdir d2/d22 0 2024-02-15T18:31:25.019 INFO:tasks.workunit.client.1.smithi131.stdout:0/163: getdents d5/d9/d11 0 2024-02-15T18:31:25.021 INFO:tasks.workunit.client.1.smithi131.stdout:3/98: mkdir d2/d3/db/d23 0 2024-02-15T18:31:25.023 INFO:tasks.workunit.client.1.smithi131.stdout:3/99: dread d2/d3/f17 [0,4194304] 0 2024-02-15T18:31:25.023 INFO:tasks.workunit.client.1.smithi131.stdout:3/100: readlink d2/d3/db/d1a/ld 0 2024-02-15T18:31:25.023 INFO:tasks.workunit.client.1.smithi131.stdout:3/101: mkdir d2/d22/d24 0 2024-02-15T18:31:25.028 INFO:tasks.workunit.client.1.smithi131.stdout:0/164: dread d5/d9/f2e [0,4194304] 0 2024-02-15T18:31:25.030 INFO:tasks.workunit.client.1.smithi131.stdout:0/165: unlink d5/d2f/l34 0 2024-02-15T18:31:25.031 INFO:tasks.workunit.client.1.smithi131.stdout:0/166: truncate d5/d9/d10/f1e 74954 0 2024-02-15T18:31:25.031 INFO:tasks.workunit.client.1.smithi131.stdout:0/167: chown d5/d2f/c39 501312859 1 2024-02-15T18:31:25.035 INFO:tasks.workunit.client.1.smithi131.stdout:4/175: dwrite d2/d7/ff [0,4194304] 0 2024-02-15T18:31:25.035 INFO:tasks.workunit.client.1.smithi131.stdout:0/168: write d5/d9/d11/f14 [1851429,63372] 0 2024-02-15T18:31:25.038 INFO:tasks.workunit.client.1.smithi131.stdout:0/169: read f3 [81659,9063] 0 2024-02-15T18:31:25.039 INFO:tasks.workunit.client.1.smithi131.stdout:0/170: symlink d5/d9/d10/l3b 0 2024-02-15T18:31:25.039 INFO:tasks.workunit.client.1.smithi131.stdout:0/171: chown d5/d9/d11/c3a 3 1 2024-02-15T18:31:25.040 INFO:tasks.workunit.client.1.smithi131.stdout:0/172: rename d5/l1b to d5/d9/d11/l3c 0 2024-02-15T18:31:25.044 INFO:tasks.workunit.client.1.smithi131.stdout:0/173: dread f0 [0,4194304] 0 2024-02-15T18:31:25.044 INFO:tasks.workunit.client.1.smithi131.stdout:0/174: write d5/f1c [538076,106002] 0 2024-02-15T18:31:25.045 INFO:tasks.workunit.client.1.smithi131.stdout:3/102: dwrite d2/d3/db/d1a/fe [0,4194304] 0 2024-02-15T18:31:25.046 INFO:tasks.workunit.client.1.smithi131.stdout:0/175: rmdir d5/d15 39 2024-02-15T18:31:25.046 INFO:tasks.workunit.client.1.smithi131.stdout:0/176: truncate d5/d15/f27 834991 0 2024-02-15T18:31:25.046 INFO:tasks.workunit.client.1.smithi131.stdout:0/177: chown d5/d15/f27 5613783 1 2024-02-15T18:31:25.046 INFO:tasks.workunit.client.1.smithi131.stdout:0/178: stat d5/c24 0 2024-02-15T18:31:25.048 INFO:tasks.workunit.client.1.smithi131.stdout:4/176: dread d2/d7/ff [0,4194304] 0 2024-02-15T18:31:25.048 INFO:tasks.workunit.client.1.smithi131.stdout:4/177: chown d2/f1a 751249 1 2024-02-15T18:31:25.049 INFO:tasks.workunit.client.1.smithi131.stdout:3/103: symlink d2/d3/db/d1a/l25 0 2024-02-15T18:31:25.057 INFO:tasks.workunit.client.1.smithi131.stdout:0/179: rename d5/d9/d11/f38 to d5/d9/f3d 0 2024-02-15T18:31:25.057 INFO:tasks.workunit.client.1.smithi131.stdout:0/180: stat f4 0 2024-02-15T18:31:25.058 INFO:tasks.workunit.client.1.smithi131.stdout:4/178: link d2/d7/d12/f3f d2/f40 0 2024-02-15T18:31:25.059 INFO:tasks.workunit.client.1.smithi131.stdout:0/181: unlink d5/d15/l2d 0 2024-02-15T18:31:25.063 INFO:tasks.workunit.client.1.smithi131.stdout:4/179: rmdir d2/da 39 2024-02-15T18:31:25.066 INFO:tasks.workunit.client.1.smithi131.stdout:3/104: dwrite d2/d3/db/d1a/f1c [0,4194304] 0 2024-02-15T18:31:25.071 INFO:tasks.workunit.client.1.smithi131.stdout:0/182: dread f4 [4194304,4194304] 0 2024-02-15T18:31:25.071 INFO:tasks.workunit.client.1.smithi131.stdout:3/105: rename d2/d3/db/d1a/f1c to d2/f26 0 2024-02-15T18:31:25.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/180: dread d2/d7/f11 [0,4194304] 0 2024-02-15T18:31:25.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/181: stat d2/f35 0 2024-02-15T18:31:25.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/182: truncate d2/da/d16/f32 4748648 0 2024-02-15T18:31:25.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/183: chown d2/d7/d1c/l3b 7 1 2024-02-15T18:31:25.073 INFO:tasks.workunit.client.1.smithi131.stdout:3/106: mknod d2/d3/d20/c27 0 2024-02-15T18:31:25.073 INFO:tasks.workunit.client.1.smithi131.stdout:3/107: chown d2/d3/db/d1a/l25 9409 1 2024-02-15T18:31:25.073 INFO:tasks.workunit.client.1.smithi131.stdout:4/184: creat d2/da/d21/f41 x:0 0 0 2024-02-15T18:31:25.074 INFO:tasks.workunit.client.1.smithi131.stdout:3/108: truncate d2/d3/db/d1a/fe 940457 0 2024-02-15T18:31:25.074 INFO:tasks.workunit.client.1.smithi131.stdout:3/109: dread - d2/d3/d20/f21 zero size 2024-02-15T18:31:25.076 INFO:tasks.workunit.client.1.smithi131.stdout:3/110: unlink d2/d3/db/f18 0 2024-02-15T18:31:25.076 INFO:tasks.workunit.client.1.smithi131.stdout:3/111: rename d2/d3 to d2/d3/db/d23/d28 22 2024-02-15T18:31:25.077 INFO:tasks.workunit.client.1.smithi131.stdout:0/183: dread d5/d9/f2e [0,4194304] 0 2024-02-15T18:31:25.077 INFO:tasks.workunit.client.1.smithi131.stdout:0/184: stat d5/d9/lb 0 2024-02-15T18:31:25.078 INFO:tasks.workunit.client.1.smithi131.stdout:0/185: getdents d5/d15 0 2024-02-15T18:31:25.079 INFO:tasks.workunit.client.1.smithi131.stdout:0/186: mkdir d5/d9/d11/d3e 0 2024-02-15T18:31:25.084 INFO:tasks.workunit.client.1.smithi131.stdout:0/187: rmdir d5 39 2024-02-15T18:31:25.086 INFO:tasks.workunit.client.1.smithi131.stdout:0/188: write d5/fa [1055261,95380] 0 2024-02-15T18:31:25.087 INFO:tasks.workunit.client.1.smithi131.stdout:3/112: rename d2/d3 to d2/d22/d29 0 2024-02-15T18:31:25.087 INFO:tasks.workunit.client.1.smithi131.stdout:0/189: truncate d5/d2f/f23 940051 0 2024-02-15T18:31:25.088 INFO:tasks.workunit.client.1.smithi131.stdout:0/190: mkdir d5/d9/d10/d3f 0 2024-02-15T18:31:25.094 INFO:tasks.workunit.client.1.smithi131.stdout:4/185: dwrite d2/da/d16/f37 [0,4194304] 0 2024-02-15T18:31:25.098 INFO:tasks.workunit.client.1.smithi131.stdout:4/186: write d2/d7/fc [257275,20931] 0 2024-02-15T18:31:25.098 INFO:tasks.workunit.client.1.smithi131.stdout:3/113: dread d2/f19 [0,4194304] 0 2024-02-15T18:31:25.100 INFO:tasks.workunit.client.1.smithi131.stdout:4/187: rename d2/da/d21/f29 to d2/d2a/f42 0 2024-02-15T18:31:25.101 INFO:tasks.workunit.client.1.smithi131.stdout:3/114: mkdir d2/d22/d29/db/d23/d2a 0 2024-02-15T18:31:25.102 INFO:tasks.workunit.client.1.smithi131.stdout:4/188: mkdir d2/da/d16/d43 0 2024-02-15T18:31:25.103 INFO:tasks.workunit.client.1.smithi131.stdout:3/115: rmdir d2/d22/d29 39 2024-02-15T18:31:25.103 INFO:tasks.workunit.client.1.smithi131.stdout:3/116: fdatasync d2/d22/d29/db/d1a/fe 0 2024-02-15T18:31:25.104 INFO:tasks.workunit.client.1.smithi131.stdout:4/189: link d2/d7/f11 d2/d7/d1c/f44 0 2024-02-15T18:31:25.104 INFO:tasks.workunit.client.1.smithi131.stdout:0/191: dwrite d5/d9/d10/f19 [0,4194304] 0 2024-02-15T18:31:25.105 INFO:tasks.workunit.client.1.smithi131.stdout:4/190: write d2/d7/fc [7018,109680] 0 2024-02-15T18:31:25.106 INFO:tasks.workunit.client.1.smithi131.stdout:3/117: creat d2/d22/d29/db/d23/f2b x:0 0 0 2024-02-15T18:31:25.108 INFO:tasks.workunit.client.1.smithi131.stdout:4/191: mknod d2/da/d16/d2d/d3d/c45 0 2024-02-15T18:31:25.129 INFO:tasks.workunit.client.1.smithi131.stdout:0/192: dwrite d5/d9/ff [0,4194304] 0 2024-02-15T18:31:25.136 INFO:tasks.workunit.client.1.smithi131.stdout:3/118: dwrite d2/d22/d29/db/f1e [0,4194304] 0 2024-02-15T18:31:25.139 INFO:tasks.workunit.client.1.smithi131.stdout:0/193: dread d5/d15/f2a [0,4194304] 0 2024-02-15T18:31:25.139 INFO:tasks.workunit.client.1.smithi131.stdout:4/192: dwrite d2/da/d21/f41 [0,4194304] 0 2024-02-15T18:31:25.139 INFO:tasks.workunit.client.1.smithi131.stdout:4/193: read d2/f4 [2415558,25905] 0 2024-02-15T18:31:25.142 INFO:tasks.workunit.client.1.smithi131.stdout:0/194: read d5/d9/d10/f19 [1059916,120221] 0 2024-02-15T18:31:25.142 INFO:tasks.workunit.client.1.smithi131.stdout:0/195: fsync f3 0 2024-02-15T18:31:25.145 INFO:tasks.workunit.client.1.smithi131.stdout:4/194: rename d2/da/d16/d2d/d3d to d2/da/d21/d46 0 2024-02-15T18:31:25.145 INFO:tasks.workunit.client.1.smithi131.stdout:0/196: symlink d5/d9/d10/d3f/l40 0 2024-02-15T18:31:25.148 INFO:tasks.workunit.client.1.smithi131.stdout:3/119: dread d2/d22/d29/f6 [0,4194304] 0 2024-02-15T18:31:25.148 INFO:tasks.workunit.client.1.smithi131.stdout:3/120: dread - d2/d22/d29/db/d1a/f11 zero size 2024-02-15T18:31:25.151 INFO:tasks.workunit.client.1.smithi131.stdout:3/121: link d2/d22/d29/c9 d2/d22/d29/c2c 0 2024-02-15T18:31:25.152 INFO:tasks.workunit.client.1.smithi131.stdout:3/122: creat d2/d22/d29/db/d23/d2a/f2d x:0 0 0 2024-02-15T18:31:25.154 INFO:tasks.workunit.client.1.smithi131.stdout:3/123: creat d2/d22/f2e x:0 0 0 2024-02-15T18:31:25.154 INFO:tasks.workunit.client.1.smithi131.stdout:3/124: chown d2/d22/d29 0 1 2024-02-15T18:31:25.166 INFO:tasks.workunit.client.1.smithi131.stdout:4/195: dwrite d2/da/d21/f3a [0,4194304] 0 2024-02-15T18:31:25.166 INFO:tasks.workunit.client.1.smithi131.stdout:4/196: chown d2 6 1 2024-02-15T18:31:25.167 INFO:tasks.workunit.client.1.smithi131.stdout:0/197: dwrite d5/d15/f2a [0,4194304] 0 2024-02-15T18:31:25.168 INFO:tasks.workunit.client.1.smithi131.stdout:4/197: write d2/d7/f10 [1732577,53402] 0 2024-02-15T18:31:25.179 INFO:tasks.workunit.client.1.smithi131.stdout:4/198: rename d2/da to d2/d2a/d47 0 2024-02-15T18:31:25.180 INFO:tasks.workunit.client.1.smithi131.stdout:4/199: write d2/f40 [3862586,98283] 0 2024-02-15T18:31:25.184 INFO:tasks.workunit.client.1.smithi131.stdout:0/198: dwrite f0 [0,4194304] 0 2024-02-15T18:31:25.186 INFO:tasks.workunit.client.1.smithi131.stdout:4/200: dread d2/f9 [0,4194304] 0 2024-02-15T18:31:25.188 INFO:tasks.workunit.client.1.smithi131.stdout:0/199: symlink d5/d15/d1f/l41 0 2024-02-15T18:31:25.188 INFO:tasks.workunit.client.1.smithi131.stdout:0/200: stat d5/d9/d10 0 2024-02-15T18:31:25.189 INFO:tasks.workunit.client.1.smithi131.stdout:4/201: creat d2/d7/d1c/f48 x:0 0 0 2024-02-15T18:31:25.189 INFO:tasks.workunit.client.1.smithi131.stdout:0/201: mknod d5/d15/c42 0 2024-02-15T18:31:25.191 INFO:tasks.workunit.client.1.smithi131.stdout:4/202: dread d2/d2a/d47/d16/f30 [0,4194304] 0 2024-02-15T18:31:25.191 INFO:tasks.workunit.client.1.smithi131.stdout:4/203: dread - d2/d2a/d47/d21/f3e zero size 2024-02-15T18:31:25.193 INFO:tasks.workunit.client.1.smithi131.stdout:0/202: truncate f0 2948013 0 2024-02-15T18:31:25.193 INFO:tasks.workunit.client.1.smithi131.stdout:0/203: write d5/d9/d11/f30 [1518812,80602] 0 2024-02-15T18:31:25.196 INFO:tasks.workunit.client.1.smithi131.stdout:0/204: creat d5/d9/f43 x:0 0 0 2024-02-15T18:31:25.196 INFO:tasks.workunit.client.1.smithi131.stdout:0/205: chown d5/d9/d10/d3f 3170912 1 2024-02-15T18:31:25.197 INFO:tasks.workunit.client.1.smithi131.stdout:0/206: mknod d5/d9/d11/d3e/c44 0 2024-02-15T18:31:25.201 INFO:tasks.workunit.client.1.smithi131.stdout:5/279: sync 2024-02-15T18:31:25.201 INFO:tasks.workunit.client.1.smithi131.stdout:8/117: sync 2024-02-15T18:31:25.202 INFO:tasks.workunit.client.1.smithi131.stdout:1/209: sync 2024-02-15T18:31:25.206 INFO:tasks.workunit.client.1.smithi131.stdout:8/118: write f13 [2895213,60322] 0 2024-02-15T18:31:25.206 INFO:tasks.workunit.client.1.smithi131.stdout:8/119: fsync f1c 0 2024-02-15T18:31:25.206 INFO:tasks.workunit.client.1.smithi131.stdout:5/280: mkdir d18/d23/d5d 0 2024-02-15T18:31:25.208 INFO:tasks.workunit.client.1.smithi131.stdout:8/120: creat d22/f28 x:0 0 0 2024-02-15T18:31:25.209 INFO:tasks.workunit.client.1.smithi131.stdout:8/121: truncate f1c 2167483 0 2024-02-15T18:31:25.209 INFO:tasks.workunit.client.1.smithi131.stdout:8/122: fdatasync f1d 0 2024-02-15T18:31:25.214 INFO:tasks.workunit.client.1.smithi131.stdout:5/281: write d18/d24/f26 [117144,58756] 0 2024-02-15T18:31:25.214 INFO:tasks.workunit.client.1.smithi131.stdout:5/282: write d18/d24/f4a [1190260,93257] 0 2024-02-15T18:31:25.214 INFO:tasks.workunit.client.1.smithi131.stdout:8/123: write d22/f23 [89399,53077] 0 2024-02-15T18:31:25.214 INFO:tasks.workunit.client.1.smithi131.stdout:8/124: mknod d22/d26/c29 0 2024-02-15T18:31:25.216 INFO:tasks.workunit.client.1.smithi131.stdout:5/283: write d18/d33/f5a [3792392,74619] 0 2024-02-15T18:31:25.222 INFO:tasks.workunit.client.1.smithi131.stdout:1/210: dwrite d0/d2/db/f3c [0,4194304] 0 2024-02-15T18:31:25.226 INFO:tasks.workunit.client.1.smithi131.stdout:8/125: dread d22/f24 [0,4194304] 0 2024-02-15T18:31:25.226 INFO:tasks.workunit.client.1.smithi131.stdout:4/204: dwrite d2/d2a/d47/d21/f3e [0,4194304] 0 2024-02-15T18:31:25.229 INFO:tasks.workunit.client.1.smithi131.stdout:4/205: mknod d2/d2a/c49 0 2024-02-15T18:31:25.230 INFO:tasks.workunit.client.1.smithi131.stdout:8/126: creat d22/d26/f2a x:0 0 0 2024-02-15T18:31:25.234 INFO:tasks.workunit.client.1.smithi131.stdout:5/284: dwrite d18/f1e [4194304,4194304] 0 2024-02-15T18:31:25.235 INFO:tasks.workunit.client.1.smithi131.stdout:5/285: creat d18/d33/f5e x:0 0 0 2024-02-15T18:31:25.235 INFO:tasks.workunit.client.1.smithi131.stdout:5/286: write d18/d20/f2f [4874443,95471] 0 2024-02-15T18:31:25.237 INFO:tasks.workunit.client.1.smithi131.stdout:4/206: write d2/d2a/d47/d21/f3e [4938072,116765] 0 2024-02-15T18:31:25.241 INFO:tasks.workunit.client.1.smithi131.stdout:1/211: dwrite d0/d2/f2b [0,4194304] 0 2024-02-15T18:31:25.243 INFO:tasks.workunit.client.1.smithi131.stdout:1/212: mkdir d0/d1/d16/d4b 0 2024-02-15T18:31:25.255 INFO:tasks.workunit.client.1.smithi131.stdout:1/213: dread d0/d2/f2b [0,4194304] 0 2024-02-15T18:31:25.255 INFO:tasks.workunit.client.1.smithi131.stdout:1/214: stat d0/d1/d16/l3e 0 2024-02-15T18:31:25.255 INFO:tasks.workunit.client.1.smithi131.stdout:1/215: write d0/d2/d7/f40 [1040648,38771] 0 2024-02-15T18:31:25.259 INFO:tasks.workunit.client.1.smithi131.stdout:8/127: dwrite f13 [0,4194304] 0 2024-02-15T18:31:25.260 INFO:tasks.workunit.client.1.smithi131.stdout:8/128: write f13 [4646112,89099] 0 2024-02-15T18:31:25.260 INFO:tasks.workunit.client.1.smithi131.stdout:8/129: creat d22/d26/f2b x:0 0 0 2024-02-15T18:31:25.266 INFO:tasks.workunit.client.1.smithi131.stdout:1/216: dread d0/d1/d24/f2f [0,4194304] 0 2024-02-15T18:31:25.266 INFO:tasks.workunit.client.1.smithi131.stdout:1/217: read d0/d1/f38 [45113,50076] 0 2024-02-15T18:31:25.267 INFO:tasks.workunit.client.1.smithi131.stdout:1/218: write d0/d2/f2b [2640271,123957] 0 2024-02-15T18:31:25.269 INFO:tasks.workunit.client.1.smithi131.stdout:1/219: rename d0/d2/db/f23 to d0/d2/d7/f4c 0 2024-02-15T18:31:25.269 INFO:tasks.workunit.client.1.smithi131.stdout:1/220: stat d0/d1/d16 0 2024-02-15T18:31:25.273 INFO:tasks.workunit.client.1.smithi131.stdout:1/221: dread d0/d1/f38 [0,4194304] 0 2024-02-15T18:31:25.274 INFO:tasks.workunit.client.1.smithi131.stdout:1/222: rename d0/f3 to d0/f4d 0 2024-02-15T18:31:25.275 INFO:tasks.workunit.client.1.smithi131.stdout:1/223: unlink d0/d2/d4/c1a 0 2024-02-15T18:31:25.276 INFO:tasks.workunit.client.1.smithi131.stdout:1/224: read d0/f22 [238008,89414] 0 2024-02-15T18:31:25.276 INFO:tasks.workunit.client.1.smithi131.stdout:1/225: symlink d0/d2/d31/d3d/d46/l4e 0 2024-02-15T18:31:25.277 INFO:tasks.workunit.client.1.smithi131.stdout:1/226: truncate d0/d2/d4/da/f2c 326988 0 2024-02-15T18:31:25.280 INFO:tasks.workunit.client.1.smithi131.stdout:8/130: dwrite f13 [0,4194304] 0 2024-02-15T18:31:25.280 INFO:tasks.workunit.client.1.smithi131.stdout:8/131: fsync f17 0 2024-02-15T18:31:25.280 INFO:tasks.workunit.client.1.smithi131.stdout:8/132: chown c20 1000 0 2024-02-15T18:31:25.281 INFO:tasks.workunit.client.1.smithi131.stdout:8/133: write fb [11597,61463] 0 2024-02-15T18:31:25.298 INFO:tasks.workunit.client.1.smithi131.stdout:1/227: dwrite d0/f22 [0,4194304] 0 2024-02-15T18:31:25.299 INFO:tasks.workunit.client.1.smithi131.stdout:8/134: dwrite f17 [0,4194304] 0 2024-02-15T18:31:25.321 INFO:tasks.workunit.client.1.smithi131.stdout:8/135: dwrite f1a [0,4194304] 0 2024-02-15T18:31:25.322 INFO:tasks.workunit.client.1.smithi131.stdout:1/228: dwrite d0/d2/f5 [0,4194304] 0 2024-02-15T18:31:25.347 INFO:tasks.workunit.client.1.smithi131.stdout:8/136: dwrite f1c [0,4194304] 0 2024-02-15T18:31:25.347 INFO:tasks.workunit.client.1.smithi131.stdout:8/137: dread - d22/d26/f2b zero size 2024-02-15T18:31:25.349 INFO:tasks.workunit.client.1.smithi131.stdout:1/229: dwrite d0/d2/d7/f4c [0,4194304] 0 2024-02-15T18:31:25.358 INFO:tasks.workunit.client.1.smithi131.stdout:1/230: dread d0/d2/db/f3c [0,4194304] 0 2024-02-15T18:31:25.359 INFO:tasks.workunit.client.1.smithi131.stdout:1/231: getdents d0 0 2024-02-15T18:31:25.361 INFO:tasks.workunit.client.1.smithi131.stdout:1/232: write d0/d1/d24/f2f [1128832,38033] 0 2024-02-15T18:31:25.361 INFO:tasks.workunit.client.1.smithi131.stdout:1/233: write d0/d1/d24/f2d [131969,126586] 0 2024-02-15T18:31:25.362 INFO:tasks.workunit.client.1.smithi131.stdout:1/234: truncate d0/d2/d7/f34 4595251 0 2024-02-15T18:31:25.382 INFO:tasks.workunit.client.1.smithi131.stdout:8/138: dwrite fb [0,4194304] 0 2024-02-15T18:31:25.382 INFO:tasks.workunit.client.1.smithi131.stdout:1/235: dwrite d0/d2/d28/f45 [0,4194304] 0 2024-02-15T18:31:25.383 INFO:tasks.workunit.client.1.smithi131.stdout:8/139: mknod d22/d26/c2c 0 2024-02-15T18:31:25.383 INFO:tasks.workunit.client.1.smithi131.stdout:1/236: write d0/d1/d16/f20 [1924795,52569] 0 2024-02-15T18:31:25.393 INFO:tasks.workunit.client.1.smithi131.stdout:1/237: dread d0/d2/d4/f6 [4194304,4194304] 0 2024-02-15T18:31:25.394 INFO:tasks.workunit.client.1.smithi131.stdout:1/238: symlink d0/d1/l4f 0 2024-02-15T18:31:25.394 INFO:tasks.workunit.client.1.smithi131.stdout:1/239: write d0/d1/d16/f43 [1012304,84135] 0 2024-02-15T18:31:25.397 INFO:tasks.workunit.client.1.smithi131.stdout:8/140: dwrite f1a [4194304,4194304] 0 2024-02-15T18:31:25.398 INFO:tasks.workunit.client.1.smithi131.stdout:1/240: dread d0/d2/db/f3c [0,4194304] 0 2024-02-15T18:31:25.399 INFO:tasks.workunit.client.1.smithi131.stdout:8/141: creat d22/d26/f2d x:0 0 0 2024-02-15T18:31:25.399 INFO:tasks.workunit.client.1.smithi131.stdout:8/142: chown f13 244821 1 2024-02-15T18:31:25.400 INFO:tasks.workunit.client.1.smithi131.stdout:8/143: mkdir d22/d2e 0 2024-02-15T18:31:25.402 INFO:tasks.workunit.client.1.smithi131.stdout:8/144: unlink l6 0 2024-02-15T18:31:25.404 INFO:tasks.workunit.client.1.smithi131.stdout:8/145: creat d22/d26/f2f x:0 0 0 2024-02-15T18:31:25.406 INFO:tasks.workunit.client.1.smithi131.stdout:8/146: unlink c1f 0 2024-02-15T18:31:25.407 INFO:tasks.workunit.client.1.smithi131.stdout:1/241: dread d0/d2/d4/da/f1f [0,4194304] 0 2024-02-15T18:31:25.407 INFO:tasks.workunit.client.1.smithi131.stdout:1/242: chown d0/d1/d16/l3e 188 1 2024-02-15T18:31:25.407 INFO:tasks.workunit.client.1.smithi131.stdout:1/243: fsync d0/d2/d4/da/f2c 0 2024-02-15T18:31:25.407 INFO:tasks.workunit.client.1.smithi131.stdout:8/147: creat d22/f30 x:0 0 0 2024-02-15T18:31:25.416 INFO:tasks.workunit.client.1.smithi131.stdout:1/244: dread d0/f22 [0,4194304] 0 2024-02-15T18:31:25.417 INFO:tasks.workunit.client.1.smithi131.stdout:8/148: truncate f1a 2921334 0 2024-02-15T18:31:25.418 INFO:tasks.workunit.client.1.smithi131.stdout:1/245: write d0/d2/d28/f45 [1990591,28595] 0 2024-02-15T18:31:25.425 INFO:tasks.workunit.client.1.smithi131.stdout:8/149: symlink d22/d2e/l31 0 2024-02-15T18:31:25.428 INFO:tasks.workunit.client.1.smithi131.stdout:8/150: rmdir d22/d26 39 2024-02-15T18:31:25.430 INFO:tasks.workunit.client.1.smithi131.stdout:8/151: unlink f13 0 2024-02-15T18:31:25.431 INFO:tasks.workunit.client.1.smithi131.stdout:8/152: link f14 d22/f32 0 2024-02-15T18:31:25.440 INFO:tasks.workunit.client.1.smithi131.stdout:9/187: sync 2024-02-15T18:31:25.440 INFO:tasks.workunit.client.1.smithi131.stdout:2/83: sync 2024-02-15T18:31:25.440 INFO:tasks.workunit.client.1.smithi131.stdout:2/84: readlink dd/le 0 2024-02-15T18:31:25.440 INFO:tasks.workunit.client.1.smithi131.stdout:2/85: readlink dd/le 0 2024-02-15T18:31:25.440 INFO:tasks.workunit.client.1.smithi131.stdout:9/188: truncate d4/dc/f36 666624 0 2024-02-15T18:31:25.441 INFO:tasks.workunit.client.1.smithi131.stdout:8/153: getdents d22/d2e 0 2024-02-15T18:31:25.441 INFO:tasks.workunit.client.1.smithi131.stdout:8/154: write d22/d26/f2d [587539,13490] 0 2024-02-15T18:31:25.442 INFO:tasks.workunit.client.1.smithi131.stdout:9/189: dread f3 [0,4194304] 0 2024-02-15T18:31:25.442 INFO:tasks.workunit.client.1.smithi131.stdout:1/246: dwrite d0/d2/d7/f34 [0,4194304] 0 2024-02-15T18:31:25.443 INFO:tasks.workunit.client.1.smithi131.stdout:8/155: write d22/f27 [1010942,66626] 0 2024-02-15T18:31:25.475 INFO:tasks.workunit.client.1.smithi131.stdout:8/156: dwrite d22/f23 [0,4194304] 0 2024-02-15T18:31:25.476 INFO:tasks.workunit.client.1.smithi131.stdout:9/190: dwrite d4/dc/de/f2f [0,4194304] 0 2024-02-15T18:31:25.478 INFO:tasks.workunit.client.1.smithi131.stdout:1/247: dwrite d0/d2/f37 [4194304,4194304] 0 2024-02-15T18:31:25.479 INFO:tasks.workunit.client.1.smithi131.stdout:8/157: symlink d22/d2e/l33 0 2024-02-15T18:31:25.479 INFO:tasks.workunit.client.1.smithi131.stdout:2/86: dwrite dd/ff [0,4194304] 0 2024-02-15T18:31:25.479 INFO:tasks.workunit.client.1.smithi131.stdout:2/87: write fc [406272,125465] 0 2024-02-15T18:31:25.480 INFO:tasks.workunit.client.1.smithi131.stdout:9/191: creat d4/dc/de/d1e/d1f/f3a x:0 0 0 2024-02-15T18:31:25.480 INFO:tasks.workunit.client.1.smithi131.stdout:9/192: write d4/dc/d17/d19/f2a [532882,95980] 0 2024-02-15T18:31:25.480 INFO:tasks.workunit.client.1.smithi131.stdout:9/193: stat d4/dc/de/d1e/d1f/c29 0 2024-02-15T18:31:25.480 INFO:tasks.workunit.client.1.smithi131.stdout:9/194: chown d4/dc/f36 47908400 1 2024-02-15T18:31:25.482 INFO:tasks.workunit.client.1.smithi131.stdout:2/88: write f8 [2371072,113947] 0 2024-02-15T18:31:25.483 INFO:tasks.workunit.client.1.smithi131.stdout:1/248: creat d0/d2/d31/d3d/d46/f50 x:0 0 0 2024-02-15T18:31:25.485 INFO:tasks.workunit.client.1.smithi131.stdout:8/158: rename c15 to d22/c34 0 2024-02-15T18:31:25.485 INFO:tasks.workunit.client.1.smithi131.stdout:8/159: chown d22/d2e 451 1 2024-02-15T18:31:25.494 INFO:tasks.workunit.client.1.smithi131.stdout:9/195: unlink d4/dc/de/f1d 0 2024-02-15T18:31:25.495 INFO:tasks.workunit.client.1.smithi131.stdout:9/196: write f3 [949831,98694] 0 2024-02-15T18:31:25.496 INFO:tasks.workunit.client.1.smithi131.stdout:9/197: link d4/dc/d17/c22 d4/dc/de/d1e/d26/c3b 0 2024-02-15T18:31:25.497 INFO:tasks.workunit.client.1.smithi131.stdout:9/198: link d4/dc/de/d1e/d1f/d2c/c34 d4/dc/de/c3c 0 2024-02-15T18:31:25.498 INFO:tasks.workunit.client.1.smithi131.stdout:9/199: truncate f0 2283104 0 2024-02-15T18:31:25.499 INFO:tasks.workunit.client.1.smithi131.stdout:9/200: creat d4/dc/d17/f3d x:0 0 0 2024-02-15T18:31:25.499 INFO:tasks.workunit.client.1.smithi131.stdout:9/201: chown d4/dc/d17/l18 2 1 2024-02-15T18:31:25.500 INFO:tasks.workunit.client.1.smithi131.stdout:9/202: mknod d4/dc/de/d1e/d1f/c3e 0 2024-02-15T18:31:25.501 INFO:tasks.workunit.client.1.smithi131.stdout:9/203: mkdir d4/dc/d25/d3f 0 2024-02-15T18:31:25.501 INFO:tasks.workunit.client.1.smithi131.stdout:9/204: write d4/dc/f2d [1515083,25777] 0 2024-02-15T18:31:25.504 INFO:tasks.workunit.client.1.smithi131.stdout:2/89: dwrite dd/ff [4194304,4194304] 0 2024-02-15T18:31:25.504 INFO:tasks.workunit.client.1.smithi131.stdout:2/90: chown dd 72814 1 2024-02-15T18:31:25.504 INFO:tasks.workunit.client.1.smithi131.stdout:1/249: dwrite d0/d2/f12 [8388608,4194304] 0 2024-02-15T18:31:25.505 INFO:tasks.workunit.client.1.smithi131.stdout:1/250: link d0/d2/d4/da/l49 d0/d1/d16/d30/l51 0 2024-02-15T18:31:25.511 INFO:tasks.workunit.client.1.smithi131.stdout:5/287: sync 2024-02-15T18:31:25.511 INFO:tasks.workunit.client.1.smithi131.stdout:3/125: sync 2024-02-15T18:31:25.512 INFO:tasks.workunit.client.1.smithi131.stdout:7/237: sync 2024-02-15T18:31:25.512 INFO:tasks.workunit.client.1.smithi131.stdout:4/207: sync 2024-02-15T18:31:25.512 INFO:tasks.workunit.client.1.smithi131.stdout:6/235: sync 2024-02-15T18:31:25.512 INFO:tasks.workunit.client.1.smithi131.stdout:7/238: truncate d0/fd 2150367 0 2024-02-15T18:31:25.512 INFO:tasks.workunit.client.1.smithi131.stdout:0/207: sync 2024-02-15T18:31:25.512 INFO:tasks.workunit.client.1.smithi131.stdout:0/208: truncate d5/d9/f2e 5408577 0 2024-02-15T18:31:25.512 INFO:tasks.workunit.client.1.smithi131.stdout:1/251: mknod d0/d2/d31/d3d/c52 0 2024-02-15T18:31:25.522 INFO:tasks.workunit.client.1.smithi131.stdout:6/236: creat d2/d38/f47 x:0 0 0 2024-02-15T18:31:25.522 INFO:tasks.workunit.client.1.smithi131.stdout:6/237: fsync d2/d2b/f37 0 2024-02-15T18:31:25.522 INFO:tasks.workunit.client.1.smithi131.stdout:3/126: link d2/d22/d29/l12 d2/l2f 0 2024-02-15T18:31:25.523 INFO:tasks.workunit.client.1.smithi131.stdout:1/252: creat d0/d2/d7/f53 x:0 0 0 2024-02-15T18:31:25.523 INFO:tasks.workunit.client.1.smithi131.stdout:1/253: fsync d0/d1/d16/f43 0 2024-02-15T18:31:25.526 INFO:tasks.workunit.client.1.smithi131.stdout:6/238: rename d2/dc/d19 to d2/d7/d48 0 2024-02-15T18:31:25.527 INFO:tasks.workunit.client.1.smithi131.stdout:3/127: stat d2/d22/d29/c10 0 2024-02-15T18:31:25.527 INFO:tasks.workunit.client.1.smithi131.stdout:3/128: dread - d2/d22/d29/db/f1d zero size 2024-02-15T18:31:25.528 INFO:tasks.workunit.client.1.smithi131.stdout:1/254: rmdir d0/d1/d16/d3f 0 2024-02-15T18:31:25.533 INFO:tasks.workunit.client.1.smithi131.stdout:3/129: mknod d2/d22/d24/c30 0 2024-02-15T18:31:25.534 INFO:tasks.workunit.client.1.smithi131.stdout:1/255: write d0/d2/d4/f6 [1058142,53570] 0 2024-02-15T18:31:25.535 INFO:tasks.workunit.client.1.smithi131.stdout:8/160: dwrite d22/d26/f2d [0,4194304] 0 2024-02-15T18:31:25.538 INFO:tasks.workunit.client.1.smithi131.stdout:8/161: creat d22/d26/f35 x:0 0 0 2024-02-15T18:31:25.538 INFO:tasks.workunit.client.1.smithi131.stdout:9/205: dwrite d4/dc/f36 [0,4194304] 0 2024-02-15T18:31:25.539 INFO:tasks.workunit.client.1.smithi131.stdout:1/256: read d0/d2/d4/f6 [12141548,32154] 0 2024-02-15T18:31:25.540 INFO:tasks.workunit.client.1.smithi131.stdout:8/162: rmdir d22/d2e 39 2024-02-15T18:31:25.540 INFO:tasks.workunit.client.1.smithi131.stdout:8/163: read - d22/d26/f2a zero size 2024-02-15T18:31:25.540 INFO:tasks.workunit.client.1.smithi131.stdout:8/164: dread - d22/d26/f2f zero size 2024-02-15T18:31:25.542 INFO:tasks.workunit.client.1.smithi131.stdout:9/206: creat d4/dc/d25/f40 x:0 0 0 2024-02-15T18:31:25.543 INFO:tasks.workunit.client.1.smithi131.stdout:1/257: symlink d0/d2/d28/d42/l54 0 2024-02-15T18:31:25.545 INFO:tasks.workunit.client.1.smithi131.stdout:8/165: rename l10 to d22/l36 0 2024-02-15T18:31:25.546 INFO:tasks.workunit.client.1.smithi131.stdout:1/258: mknod d0/d2/db/c55 0 2024-02-15T18:31:25.546 INFO:tasks.workunit.client.1.smithi131.stdout:1/259: truncate d0/d2/d31/d3d/d46/f50 519953 0 2024-02-15T18:31:25.548 INFO:tasks.workunit.client.1.smithi131.stdout:8/166: rename f1a to d22/d2e/f37 0 2024-02-15T18:31:25.549 INFO:tasks.workunit.client.1.smithi131.stdout:7/239: dwrite d0/fd [0,4194304] 0 2024-02-15T18:31:25.550 INFO:tasks.workunit.client.1.smithi131.stdout:2/91: truncate dd/f11 2799831 0 2024-02-15T18:31:25.552 INFO:tasks.workunit.client.1.smithi131.stdout:9/207: mkdir d4/dc/d17/d19/d41 0 2024-02-15T18:31:25.552 INFO:tasks.workunit.client.1.smithi131.stdout:1/260: symlink d0/d2/d31/l56 0 2024-02-15T18:31:25.553 INFO:tasks.workunit.client.1.smithi131.stdout:5/288: dwrite d18/d33/f5a [0,4194304] 0 2024-02-15T18:31:25.554 INFO:tasks.workunit.client.1.smithi131.stdout:4/208: dwrite d2/d2a/f3c [0,4194304] 0 2024-02-15T18:31:25.554 INFO:tasks.workunit.client.1.smithi131.stdout:8/167: creat d22/d2e/f38 x:0 0 0 2024-02-15T18:31:25.559 INFO:tasks.workunit.client.1.smithi131.stdout:6/239: rmdir d2/d7/d48 39 2024-02-15T18:31:25.559 INFO:tasks.workunit.client.1.smithi131.stdout:6/240: dread - d2/d38/f47 zero size 2024-02-15T18:31:25.559 INFO:tasks.workunit.client.1.smithi131.stdout:6/241: fdatasync d2/f45 0 2024-02-15T18:31:25.559 INFO:tasks.workunit.client.1.smithi131.stdout:6/242: chown d2/dc/d1f/f26 3671007 1 2024-02-15T18:31:25.559 INFO:tasks.workunit.client.1.smithi131.stdout:6/243: stat d2/d38/f47 0 2024-02-15T18:31:25.564 INFO:tasks.workunit.client.1.smithi131.stdout:3/130: dwrite d2/d22/d29/db/d23/d2a/f2d [0,4194304] 0 2024-02-15T18:31:25.564 INFO:tasks.workunit.client.1.smithi131.stdout:3/131: chown d2/d22/d29/c14 26744 1 2024-02-15T18:31:25.564 INFO:tasks.workunit.client.1.smithi131.stdout:3/132: dread - d2/d22/d29/db/d1a/f11 zero size 2024-02-15T18:31:25.565 INFO:tasks.workunit.client.1.smithi131.stdout:3/133: dread d2/f19 [0,4194304] 0 2024-02-15T18:31:25.568 INFO:tasks.workunit.client.1.smithi131.stdout:2/92: rmdir dd/d12 0 2024-02-15T18:31:25.568 INFO:tasks.workunit.client.1.smithi131.stdout:2/93: getdents dd/d10 0 2024-02-15T18:31:25.568 INFO:tasks.workunit.client.1.smithi131.stdout:1/261: rmdir d0 39 2024-02-15T18:31:25.569 INFO:tasks.workunit.client.1.smithi131.stdout:9/208: write d4/dc/d17/d19/fb [4927594,51235] 0 2024-02-15T18:31:25.571 INFO:tasks.workunit.client.1.smithi131.stdout:4/209: rename d2/d2a/d47/l31 to d2/d2a/d47/l4a 0 2024-02-15T18:31:25.572 INFO:tasks.workunit.client.1.smithi131.stdout:8/168: mkdir d22/d39 0 2024-02-15T18:31:25.572 INFO:tasks.workunit.client.1.smithi131.stdout:8/169: readlink l18 0 2024-02-15T18:31:25.574 INFO:tasks.workunit.client.1.smithi131.stdout:6/244: unlink d2/d7/f1b 0 2024-02-15T18:31:25.576 INFO:tasks.workunit.client.1.smithi131.stdout:2/94: mkdir dd/d10/d13 0 2024-02-15T18:31:25.576 INFO:tasks.workunit.client.1.smithi131.stdout:3/134: dread d2/d22/d29/db/f1e [0,4194304] 0 2024-02-15T18:31:25.576 INFO:tasks.workunit.client.1.smithi131.stdout:1/262: mknod d0/d2/db/c57 0 2024-02-15T18:31:25.577 INFO:tasks.workunit.client.1.smithi131.stdout:9/209: symlink d4/dc/d17/l42 0 2024-02-15T18:31:25.577 INFO:tasks.workunit.client.1.smithi131.stdout:9/210: chown d4/dc/d25/d3f 173 1 2024-02-15T18:31:25.578 INFO:tasks.workunit.client.1.smithi131.stdout:5/289: dwrite d18/d33/f5a [0,4194304] 0 2024-02-15T18:31:25.578 INFO:tasks.workunit.client.1.smithi131.stdout:4/210: mkdir d2/d7/d12/d2e/d39/d4b 0 2024-02-15T18:31:25.578 INFO:tasks.workunit.client.1.smithi131.stdout:4/211: stat d2/d7/l18 0 2024-02-15T18:31:25.579 INFO:tasks.workunit.client.1.smithi131.stdout:8/170: creat d22/d2e/f3a x:0 0 0 2024-02-15T18:31:25.580 INFO:tasks.workunit.client.1.smithi131.stdout:6/245: rename d2/f13 to d2/d7/d48/f49 0 2024-02-15T18:31:25.581 INFO:tasks.workunit.client.1.smithi131.stdout:3/135: truncate d2/d22/d29/f6 4863145 0 2024-02-15T18:31:25.581 INFO:tasks.workunit.client.1.smithi131.stdout:3/136: read - d2/d22/d29/db/d1a/f11 zero size 2024-02-15T18:31:25.582 INFO:tasks.workunit.client.1.smithi131.stdout:9/211: creat d4/dc/d25/f43 x:0 0 0 2024-02-15T18:31:25.583 INFO:tasks.workunit.client.1.smithi131.stdout:9/212: chown d4/dc/d17/l42 13132 1 2024-02-15T18:31:25.583 INFO:tasks.workunit.client.1.smithi131.stdout:9/213: truncate d4/dc/d25/f43 386629 0 2024-02-15T18:31:25.583 INFO:tasks.workunit.client.1.smithi131.stdout:9/214: chown d4/l21 999893514 1 2024-02-15T18:31:25.583 INFO:tasks.workunit.client.1.smithi131.stdout:5/290: truncate d18/d23/f30 3416114 0 2024-02-15T18:31:25.585 INFO:tasks.workunit.client.1.smithi131.stdout:4/212: symlink d2/d2a/d47/d16/l4c 0 2024-02-15T18:31:25.585 INFO:tasks.workunit.client.1.smithi131.stdout:2/95: dread f4 [0,4194304] 0 2024-02-15T18:31:25.586 INFO:tasks.workunit.client.1.smithi131.stdout:7/240: dwrite d0/d17/d36/f4c [0,4194304] 0 2024-02-15T18:31:25.587 INFO:tasks.workunit.client.1.smithi131.stdout:6/246: mknod d2/d7/d16/c4a 0 2024-02-15T18:31:25.587 INFO:tasks.workunit.client.1.smithi131.stdout:8/171: creat d22/d26/f3b x:0 0 0 2024-02-15T18:31:25.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/172: truncate d22/d2e/f38 274994 0 2024-02-15T18:31:25.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/173: chown d22/d26/f2b 177517 1 2024-02-15T18:31:25.589 INFO:tasks.workunit.client.1.smithi131.stdout:1/263: dread d0/d2/d7/f1e [0,4194304] 0 2024-02-15T18:31:25.590 INFO:tasks.workunit.client.1.smithi131.stdout:3/137: creat d2/d22/d29/db/d23/f31 x:0 0 0 2024-02-15T18:31:25.598 INFO:tasks.workunit.client.1.smithi131.stdout:2/96: dread f4 [0,4194304] 0 2024-02-15T18:31:25.600 INFO:tasks.workunit.client.1.smithi131.stdout:5/291: symlink d18/d23/d5d/l5f 0 2024-02-15T18:31:25.602 INFO:tasks.workunit.client.1.smithi131.stdout:4/213: rmdir d2/d7 39 2024-02-15T18:31:25.604 INFO:tasks.workunit.client.1.smithi131.stdout:7/241: unlink d0/c1c 0 2024-02-15T18:31:25.608 INFO:tasks.workunit.client.1.smithi131.stdout:6/247: rename d2/d7/d16/l2c to d2/dc/d1f/l4b 0 2024-02-15T18:31:25.608 INFO:tasks.workunit.client.1.smithi131.stdout:1/264: symlink d0/d2/d28/d42/l58 0 2024-02-15T18:31:25.608 INFO:tasks.workunit.client.1.smithi131.stdout:1/265: fsync d0/d1/d16/f20 0 2024-02-15T18:31:25.608 INFO:tasks.workunit.client.1.smithi131.stdout:3/138: mknod d2/c32 0 2024-02-15T18:31:25.609 INFO:tasks.workunit.client.1.smithi131.stdout:2/97: mkdir dd/d14 0 2024-02-15T18:31:25.609 INFO:tasks.workunit.client.1.smithi131.stdout:2/98: fdatasync f8 0 2024-02-15T18:31:25.609 INFO:tasks.workunit.client.1.smithi131.stdout:5/292: creat d18/d20/f60 x:0 0 0 2024-02-15T18:31:25.610 INFO:tasks.workunit.client.1.smithi131.stdout:7/242: creat d0/d17/d36/f50 x:0 0 0 2024-02-15T18:31:25.610 INFO:tasks.workunit.client.1.smithi131.stdout:7/243: chown d0/c2b 33012982 1 2024-02-15T18:31:25.610 INFO:tasks.workunit.client.1.smithi131.stdout:2/99: write f4 [6693747,114828] 0 2024-02-15T18:31:25.612 INFO:tasks.workunit.client.1.smithi131.stdout:6/248: link d2/d7/f39 d2/d36/f4c 0 2024-02-15T18:31:25.613 INFO:tasks.workunit.client.1.smithi131.stdout:3/139: rename d2/c16 to d2/c33 0 2024-02-15T18:31:25.613 INFO:tasks.workunit.client.1.smithi131.stdout:3/140: readlink d2/d22/d29/db/d1a/ld 0 2024-02-15T18:31:25.614 INFO:tasks.workunit.client.1.smithi131.stdout:1/266: write d0/f27 [11917798,83431] 0 2024-02-15T18:31:25.614 INFO:tasks.workunit.client.1.smithi131.stdout:1/267: stat d0/d2/db 0 2024-02-15T18:31:25.614 INFO:tasks.workunit.client.1.smithi131.stdout:5/293: mkdir d18/d33/d61 0 2024-02-15T18:31:25.616 INFO:tasks.workunit.client.1.smithi131.stdout:9/215: dwrite f3 [0,4194304] 0 2024-02-15T18:31:25.617 INFO:tasks.workunit.client.1.smithi131.stdout:8/174: dwrite d22/d26/f2f [0,4194304] 0 2024-02-15T18:31:25.618 INFO:tasks.workunit.client.1.smithi131.stdout:7/244: symlink d0/d17/d36/l51 0 2024-02-15T18:31:25.618 INFO:tasks.workunit.client.1.smithi131.stdout:7/245: write d0/f43 [970068,129315] 0 2024-02-15T18:31:25.620 INFO:tasks.workunit.client.1.smithi131.stdout:2/100: symlink dd/l15 0 2024-02-15T18:31:25.620 INFO:tasks.workunit.client.1.smithi131.stdout:3/141: unlink d2/d22/d29/f6 0 2024-02-15T18:31:25.622 INFO:tasks.workunit.client.1.smithi131.stdout:5/294: truncate d18/d24/f26 2181650 0 2024-02-15T18:31:25.622 INFO:tasks.workunit.client.1.smithi131.stdout:5/295: dread - d18/d20/f60 zero size 2024-02-15T18:31:25.623 INFO:tasks.workunit.client.1.smithi131.stdout:5/296: stat d18/l21 0 2024-02-15T18:31:25.623 INFO:tasks.workunit.client.1.smithi131.stdout:5/297: chown d18/d24/c28 8247060 1 2024-02-15T18:31:25.623 INFO:tasks.workunit.client.1.smithi131.stdout:5/298: stat d18/l4f 0 2024-02-15T18:31:25.626 INFO:tasks.workunit.client.1.smithi131.stdout:4/214: dwrite d2/d7/f2c [0,4194304] 0 2024-02-15T18:31:25.626 INFO:tasks.workunit.client.1.smithi131.stdout:4/215: write d2/d2a/d47/d16/f30 [1163182,79218] 0 2024-02-15T18:31:25.628 INFO:tasks.workunit.client.1.smithi131.stdout:2/101: dread fc [0,4194304] 0 2024-02-15T18:31:25.629 INFO:tasks.workunit.client.1.smithi131.stdout:1/268: rename d0/d2/d28 to d0/d1/d44/d59 0 2024-02-15T18:31:25.634 INFO:tasks.workunit.client.1.smithi131.stdout:8/175: mknod d22/d39/c3c 0 2024-02-15T18:31:25.635 INFO:tasks.workunit.client.1.smithi131.stdout:3/142: mkdir d2/d22/d29/db/d34 0 2024-02-15T18:31:25.638 INFO:tasks.workunit.client.1.smithi131.stdout:4/216: mkdir d2/d2a/d47/d21/d46/d4d 0 2024-02-15T18:31:25.638 INFO:tasks.workunit.client.1.smithi131.stdout:2/102: mknod dd/d10/d13/c16 0 2024-02-15T18:31:25.639 INFO:tasks.workunit.client.1.smithi131.stdout:1/269: mkdir d0/d2/d4/d41/d5a 0 2024-02-15T18:31:25.639 INFO:tasks.workunit.client.1.smithi131.stdout:1/270: dread - d0/d2/d7/f53 zero size 2024-02-15T18:31:25.642 INFO:tasks.workunit.client.1.smithi131.stdout:8/176: symlink d22/d2e/l3d 0 2024-02-15T18:31:25.644 INFO:tasks.workunit.client.1.smithi131.stdout:3/143: rename d2/d22/d29/db/d23/f31 to d2/d22/f35 0 2024-02-15T18:31:25.648 INFO:tasks.workunit.client.1.smithi131.stdout:2/103: symlink dd/l17 0 2024-02-15T18:31:25.649 INFO:tasks.workunit.client.1.smithi131.stdout:9/216: dwrite d4/dc/de/d1e/d1f/f3a [0,4194304] 0 2024-02-15T18:31:25.649 INFO:tasks.workunit.client.1.smithi131.stdout:1/271: mkdir d0/d1/d16/d19/d5b 0 2024-02-15T18:31:25.650 INFO:tasks.workunit.client.1.smithi131.stdout:9/217: write d4/dc/f2d [700168,58959] 0 2024-02-15T18:31:25.650 INFO:tasks.workunit.client.1.smithi131.stdout:8/177: getdents d22 0 2024-02-15T18:31:25.652 INFO:tasks.workunit.client.1.smithi131.stdout:3/144: symlink d2/d22/d29/d20/l36 0 2024-02-15T18:31:25.654 INFO:tasks.workunit.client.1.smithi131.stdout:1/272: dread d0/d2/db/f3c [0,4194304] 0 2024-02-15T18:31:25.654 INFO:tasks.workunit.client.1.smithi131.stdout:2/104: unlink c5 0 2024-02-15T18:31:25.654 INFO:tasks.workunit.client.1.smithi131.stdout:2/105: readlink l9 0 2024-02-15T18:31:25.654 INFO:tasks.workunit.client.1.smithi131.stdout:9/218: write d4/dc/f36 [807267,45043] 0 2024-02-15T18:31:25.655 INFO:tasks.workunit.client.1.smithi131.stdout:5/299: dwrite d18/d24/f4a [0,4194304] 0 2024-02-15T18:31:25.658 INFO:tasks.workunit.client.1.smithi131.stdout:6/249: dwrite d2/d7/d16/f25 [0,4194304] 0 2024-02-15T18:31:25.658 INFO:tasks.workunit.client.1.smithi131.stdout:6/250: dread - d2/d36/f4c zero size 2024-02-15T18:31:25.658 INFO:tasks.workunit.client.1.smithi131.stdout:4/217: dwrite d2/d7/fc [0,4194304] 0 2024-02-15T18:31:25.658 INFO:tasks.workunit.client.1.smithi131.stdout:6/251: truncate d2/f28 871260 0 2024-02-15T18:31:25.658 INFO:tasks.workunit.client.1.smithi131.stdout:6/252: write d2/f28 [980303,34243] 0 2024-02-15T18:31:25.659 INFO:tasks.workunit.client.1.smithi131.stdout:8/178: creat d22/f3e x:0 0 0 2024-02-15T18:31:25.660 INFO:tasks.workunit.client.1.smithi131.stdout:3/145: rename d2/d22/d29/db/d23/f2b to d2/d22/d29/d20/f37 0 2024-02-15T18:31:25.664 INFO:tasks.workunit.client.1.smithi131.stdout:2/106: creat dd/f18 x:0 0 0 2024-02-15T18:31:25.664 INFO:tasks.workunit.client.1.smithi131.stdout:2/107: write dd/f18 [113973,90328] 0 2024-02-15T18:31:25.673 INFO:tasks.workunit.client.1.smithi131.stdout:2/108: dread f4 [4194304,4194304] 0 2024-02-15T18:31:25.674 INFO:tasks.workunit.client.1.smithi131.stdout:5/300: dread d18/d20/f2f [0,4194304] 0 2024-02-15T18:31:25.675 INFO:tasks.workunit.client.1.smithi131.stdout:9/219: creat d4/dc/de/d1e/d26/d38/f44 x:0 0 0 2024-02-15T18:31:25.676 INFO:tasks.workunit.client.1.smithi131.stdout:9/220: write d4/dc/de/d1e/d1f/f3a [1070076,10402] 0 2024-02-15T18:31:25.676 INFO:tasks.workunit.client.1.smithi131.stdout:9/221: dread - d4/dc/d17/f3d zero size 2024-02-15T18:31:25.677 INFO:tasks.workunit.client.1.smithi131.stdout:2/109: dread dd/ff [4194304,4194304] 0 2024-02-15T18:31:25.678 INFO:tasks.workunit.client.1.smithi131.stdout:1/273: dwrite d0/d2/d7/f40 [0,4194304] 0 2024-02-15T18:31:25.678 INFO:tasks.workunit.client.1.smithi131.stdout:1/274: chown d0/d1/d44/d59/f45 256940 1 2024-02-15T18:31:25.679 INFO:tasks.workunit.client.1.smithi131.stdout:4/218: mknod d2/d7/d12/d2e/d39/d4b/c4e 0 2024-02-15T18:31:25.680 INFO:tasks.workunit.client.1.smithi131.stdout:6/253: mkdir d2/d7/d12/d4d 0 2024-02-15T18:31:25.680 INFO:tasks.workunit.client.1.smithi131.stdout:6/254: getdents d2/d7/d48/d40 0 2024-02-15T18:31:25.682 INFO:tasks.workunit.client.1.smithi131.stdout:8/179: chown d22/d26/f2b 83 1 2024-02-15T18:31:25.683 INFO:tasks.workunit.client.1.smithi131.stdout:3/146: mknod d2/d22/d29/db/d23/d2a/c38 0 2024-02-15T18:31:25.686 INFO:tasks.workunit.client.1.smithi131.stdout:5/301: rename d18/d24/c27 to d18/d24/c62 0 2024-02-15T18:31:25.687 INFO:tasks.workunit.client.1.smithi131.stdout:9/222: mknod d4/dc/de/d1e/d26/d38/c45 0 2024-02-15T18:31:25.687 INFO:tasks.workunit.client.1.smithi131.stdout:9/223: write d4/dc/de/d1e/d26/d38/f44 [520792,9950] 0 2024-02-15T18:31:25.688 INFO:tasks.workunit.client.1.smithi131.stdout:2/110: creat dd/d10/f19 x:0 0 0 2024-02-15T18:31:25.688 INFO:tasks.workunit.client.1.smithi131.stdout:2/111: readlink dd/l17 0 2024-02-15T18:31:25.690 INFO:tasks.workunit.client.1.smithi131.stdout:1/275: creat d0/d1/d44/d59/d42/f5c x:0 0 0 2024-02-15T18:31:25.690 INFO:tasks.workunit.client.1.smithi131.stdout:1/276: chown d0/d1/d16/d30/d47 13 1 2024-02-15T18:31:25.691 INFO:tasks.workunit.client.1.smithi131.stdout:4/219: mknod d2/d2a/d47/d21/d46/c4f 0 2024-02-15T18:31:25.691 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:23.528156+0000 mgr.smithi131.buibla (mgr.24387) 41 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 166 MiB/s wr, 299 op/s 2024-02-15T18:31:25.692 INFO:tasks.workunit.client.1.smithi131.stdout:6/255: creat d2/d7/d16/f4e x:0 0 0 2024-02-15T18:31:25.692 INFO:tasks.workunit.client.1.smithi131.stdout:8/180: mkdir d22/d26/d3f 0 2024-02-15T18:31:25.693 INFO:tasks.workunit.client.1.smithi131.stdout:3/147: dread d2/d22/d29/db/d23/d2a/f2d [0,4194304] 0 2024-02-15T18:31:25.693 INFO:tasks.workunit.client.1.smithi131.stdout:3/148: write d2/d22/f2e [339033,13061] 0 2024-02-15T18:31:25.693 INFO:tasks.workunit.client.1.smithi131.stdout:3/149: dread - d2/d22/f35 zero size 2024-02-15T18:31:25.693 INFO:tasks.workunit.client.1.smithi131.stdout:3/150: chown d2/d22/d29/db/f1e 798005738 1 2024-02-15T18:31:25.693 INFO:tasks.workunit.client.1.smithi131.stdout:3/151: write d2/d22/d29/d20/f37 [49646,451] 0 2024-02-15T18:31:25.699 INFO:tasks.workunit.client.1.smithi131.stdout:5/302: mkdir d18/d24/d63 0 2024-02-15T18:31:25.699 INFO:tasks.workunit.client.1.smithi131.stdout:3/152: dread d2/d22/d29/d20/f37 [0,4194304] 0 2024-02-15T18:31:25.700 INFO:tasks.workunit.client.1.smithi131.stdout:2/112: write dd/ff [401851,80639] 0 2024-02-15T18:31:25.700 INFO:tasks.workunit.client.1.smithi131.stdout:4/220: dread d2/f40 [0,4194304] 0 2024-02-15T18:31:25.700 INFO:tasks.workunit.client.1.smithi131.stdout:4/221: fdatasync d2/d7/d1c/f44 0 2024-02-15T18:31:25.700 INFO:tasks.workunit.client.1.smithi131.stdout:9/224: truncate d4/dc/d25/f43 45187 0 2024-02-15T18:31:25.700 INFO:tasks.workunit.client.1.smithi131.stdout:9/225: chown d4/dc/d17/d19/fb 109752 1 2024-02-15T18:31:25.700 INFO:tasks.workunit.client.1.smithi131.stdout:3/153: write d2/d22/d29/db/d23/d2a/f2d [1614858,42762] 0 2024-02-15T18:31:25.701 INFO:tasks.workunit.client.1.smithi131.stdout:1/277: mkdir d0/d2/d4/d5d 0 2024-02-15T18:31:25.702 INFO:tasks.workunit.client.1.smithi131.stdout:6/256: creat d2/f4f x:0 0 0 2024-02-15T18:31:25.702 INFO:tasks.workunit.client.1.smithi131.stdout:1/278: read d0/d2/d7/f40 [1753919,109845] 0 2024-02-15T18:31:25.702 INFO:tasks.workunit.client.1.smithi131.stdout:1/279: stat d0/d2/d31/d3d/d46 0 2024-02-15T18:31:25.702 INFO:tasks.workunit.client.1.smithi131.stdout:1/280: stat d0/d2/d4/l8 0 2024-02-15T18:31:25.702 INFO:tasks.workunit.client.1.smithi131.stdout:1/281: fdatasync d0/d2/d4/da/f2c 0 2024-02-15T18:31:25.702 INFO:tasks.workunit.client.1.smithi131.stdout:3/154: write d2/f26 [2513549,34979] 0 2024-02-15T18:31:25.703 INFO:tasks.workunit.client.1.smithi131.stdout:5/303: creat d18/d4e/f64 x:0 0 0 2024-02-15T18:31:25.706 INFO:tasks.workunit.client.1.smithi131.stdout:9/226: chown d4/dc/d17/d19/c1c 58828 1 2024-02-15T18:31:25.706 INFO:tasks.workunit.client.1.smithi131.stdout:4/222: creat d2/d7/d12/d2e/f50 x:0 0 0 2024-02-15T18:31:25.708 INFO:tasks.workunit.client.1.smithi131.stdout:2/113: creat dd/d10/d13/f1a x:0 0 0 2024-02-15T18:31:25.709 INFO:tasks.workunit.client.1.smithi131.stdout:6/257: symlink d2/d7/d48/d40/l50 0 2024-02-15T18:31:25.709 INFO:tasks.workunit.client.1.smithi131.stdout:1/282: rename d0/d2/db/f3c to d0/d2/d4/da/f5e 0 2024-02-15T18:31:25.709 INFO:tasks.workunit.client.1.smithi131.stdout:1/283: write d0/d1/d16/d19/f2e [37350,80874] 0 2024-02-15T18:31:25.710 INFO:tasks.workunit.client.1.smithi131.stdout:6/258: write d2/d7/d16/f25 [5011654,114085] 0 2024-02-15T18:31:25.710 INFO:tasks.workunit.client.1.smithi131.stdout:1/284: stat d0/d1/d16/d30/c36 0 2024-02-15T18:31:25.710 INFO:tasks.workunit.client.1.smithi131.stdout:6/259: stat d2/dc/f14 0 2024-02-15T18:31:25.710 INFO:tasks.workunit.client.1.smithi131.stdout:6/260: chown d2/dc/c1d 13872070 1 2024-02-15T18:31:25.710 INFO:tasks.workunit.client.1.smithi131.stdout:6/261: fdatasync d2/dc/f14 0 2024-02-15T18:31:25.710 INFO:tasks.workunit.client.1.smithi131.stdout:3/155: creat d2/d22/d29/f39 x:0 0 0 2024-02-15T18:31:25.712 INFO:tasks.workunit.client.1.smithi131.stdout:9/227: read f1 [3055665,48096] 0 2024-02-15T18:31:25.712 INFO:tasks.workunit.client.1.smithi131.stdout:9/228: write d4/dc/d25/f40 [130881,68399] 0 2024-02-15T18:31:25.712 INFO:tasks.workunit.client.1.smithi131.stdout:9/229: write d4/dc/de/d1e/f37 [1688736,70953] 0 2024-02-15T18:31:25.715 INFO:tasks.workunit.client.1.smithi131.stdout:8/181: dwrite d22/d26/f2b [0,4194304] 0 2024-02-15T18:31:25.715 INFO:tasks.workunit.client.1.smithi131.stdout:8/182: chown d22/d26/f2f 22539 1 2024-02-15T18:31:25.716 INFO:tasks.workunit.client.1.smithi131.stdout:1/285: rename d0/d1/d16/d30/d47 to d0/d2/d4/d41/d5a/d5f 0 2024-02-15T18:31:25.716 INFO:tasks.workunit.client.1.smithi131.stdout:3/156: mkdir d2/d22/d3a 0 2024-02-15T18:31:25.716 INFO:tasks.workunit.client.1.smithi131.stdout:3/157: chown d2/d22/d29/db/d1a/f11 71740075 1 2024-02-15T18:31:25.722 INFO:tasks.workunit.client.1.smithi131.stdout:9/230: mknod d4/dc/d17/d19/d32/c46 0 2024-02-15T18:31:25.722 INFO:tasks.workunit.client.1.smithi131.stdout:9/231: write d4/dc/d17/d19/f2a [1442766,128764] 0 2024-02-15T18:31:25.731 INFO:tasks.workunit.client.1.smithi131.stdout:1/286: unlink d0/d2/d4/d41/d5a/d5f/f48 0 2024-02-15T18:31:25.731 INFO:tasks.workunit.client.1.smithi131.stdout:3/158: rmdir d2 39 2024-02-15T18:31:25.731 INFO:tasks.workunit.client.1.smithi131.stdout:3/159: chown d2 6556 1 2024-02-15T18:31:25.732 INFO:tasks.workunit.client.1.smithi131.stdout:8/183: unlink d22/f24 0 2024-02-15T18:31:25.733 INFO:tasks.workunit.client.1.smithi131.stdout:6/262: rename d2/f4f to d2/f51 0 2024-02-15T18:31:25.733 INFO:tasks.workunit.client.1.smithi131.stdout:6/263: fdatasync d2/d7/fa 0 2024-02-15T18:31:25.736 INFO:tasks.workunit.client.1.smithi131.stdout:8/184: read fb [3416447,18022] 0 2024-02-15T18:31:25.740 INFO:tasks.workunit.client.1.smithi131.stdout:4/223: dwrite d2/d2a/d47/f27 [0,4194304] 0 2024-02-15T18:31:25.741 INFO:tasks.workunit.client.1.smithi131.stdout:2/114: dwrite fa [0,4194304] 0 2024-02-15T18:31:25.742 INFO:tasks.workunit.client.1.smithi131.stdout:2/115: write dd/ff [5474078,108233] 0 2024-02-15T18:31:25.742 INFO:tasks.workunit.client.1.smithi131.stdout:2/116: write dd/d10/d13/f1a [98738,63079] 0 2024-02-15T18:31:25.742 INFO:tasks.workunit.client.1.smithi131.stdout:2/117: read dd/d10/d13/f1a [11578,110767] 0 2024-02-15T18:31:25.742 INFO:tasks.workunit.client.1.smithi131.stdout:2/118: truncate dd/d10/d13/f1a 974695 0 2024-02-15T18:31:25.742 INFO:tasks.workunit.client.1.smithi131.stdout:2/119: fsync dd/d10/f19 0 2024-02-15T18:31:25.743 INFO:tasks.workunit.client.1.smithi131.stdout:2/120: write dd/ff [5699893,93440] 0 2024-02-15T18:31:25.745 INFO:tasks.workunit.client.1.smithi131.stdout:1/287: dread d0/d2/d4/da/f10 [8388608,4194304] 0 2024-02-15T18:31:25.746 INFO:tasks.workunit.client.1.smithi131.stdout:9/232: dwrite d4/dc/d17/f3d [0,4194304] 0 2024-02-15T18:31:25.747 INFO:tasks.workunit.client.1.smithi131.stdout:9/233: read d4/dc/d17/d19/fb [2372817,18647] 0 2024-02-15T18:31:25.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:23.528156+0000 mgr.smithi131.buibla (mgr.24387) 41 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 166 MiB/s wr, 299 op/s 2024-02-15T18:31:25.759 INFO:tasks.workunit.client.1.smithi131.stdout:6/264: dwrite d2/dc/d27/f31 [0,4194304] 0 2024-02-15T18:31:25.803 INFO:tasks.workunit.client.1.smithi131.stdout:3/160: creat d2/d22/d29/db/d34/f3b x:0 0 0 2024-02-15T18:31:25.807 INFO:tasks.workunit.client.1.smithi131.stdout:8/185: readlink d22/d2e/l31 0 2024-02-15T18:31:25.807 INFO:tasks.workunit.client.1.smithi131.stdout:8/186: write d22/d26/f2a [964805,124696] 0 2024-02-15T18:31:25.807 INFO:tasks.workunit.client.1.smithi131.stdout:8/187: readlink d22/d2e/l3d 0 2024-02-15T18:31:25.810 INFO:tasks.workunit.client.1.smithi131.stdout:4/224: rename d2/d7/f11 to d2/d7/d1c/f51 0 2024-02-15T18:31:25.810 INFO:tasks.workunit.client.1.smithi131.stdout:4/225: readlink d2/d2a/d47/d21/l25 0 2024-02-15T18:31:25.810 INFO:tasks.workunit.client.1.smithi131.stdout:4/226: fsync d2/d7/d12/d2e/f50 0 2024-02-15T18:31:25.811 INFO:tasks.workunit.client.1.smithi131.stdout:8/188: fsync d22/d26/f2a 0 2024-02-15T18:31:25.812 INFO:tasks.workunit.client.1.smithi131.stdout:2/121: rename dd/d10/d13/c16 to dd/d10/d13/c1b 0 2024-02-15T18:31:25.816 INFO:tasks.workunit.client.1.smithi131.stdout:1/288: creat d0/d2/d4/d5d/f60 x:0 0 0 2024-02-15T18:31:25.816 INFO:tasks.workunit.client.1.smithi131.stdout:1/289: write d0/d2/d4/d5d/f60 [618411,33584] 0 2024-02-15T18:31:25.820 INFO:tasks.workunit.client.1.smithi131.stdout:9/234: getdents d4/dc/de/d1e/d1f/d2c 0 2024-02-15T18:31:25.820 INFO:tasks.workunit.client.1.smithi131.stdout:6/265: creat d2/d7/d12/d4d/f52 x:0 0 0 2024-02-15T18:31:25.830 INFO:tasks.workunit.client.1.smithi131.stdout:3/161: creat d2/f3c x:0 0 0 2024-02-15T18:31:25.831 INFO:tasks.workunit.client.1.smithi131.stdout:3/162: write d2/d22/d29/f17 [779309,76547] 0 2024-02-15T18:31:25.831 INFO:tasks.workunit.client.1.smithi131.stdout:3/163: chown d2/d22/d29/db/d34/f3b 250379 1 2024-02-15T18:31:25.831 INFO:tasks.workunit.client.1.smithi131.stdout:3/164: chown d2/d22/d29/db/d1a 1998530 1 2024-02-15T18:31:25.831 INFO:tasks.workunit.client.1.smithi131.stdout:4/227: creat d2/d7/d12/f52 x:0 0 0 2024-02-15T18:31:25.833 INFO:tasks.workunit.client.1.smithi131.stdout:2/122: symlink dd/l1c 0 2024-02-15T18:31:25.833 INFO:tasks.workunit.client.1.smithi131.stdout:2/123: chown fb 101233437 1 2024-02-15T18:31:25.835 INFO:tasks.workunit.client.1.smithi131.stdout:1/290: unlink d0/d2/d4/f6 0 2024-02-15T18:31:25.835 INFO:tasks.workunit.client.1.smithi131.stdout:9/235: unlink d4/dc/de/f2f 0 2024-02-15T18:31:25.837 INFO:tasks.workunit.client.1.smithi131.stdout:3/165: rename d2/d22/d29/db/c15 to d2/d22/c3d 0 2024-02-15T18:31:25.837 INFO:tasks.workunit.client.1.smithi131.stdout:9/236: write d4/dc/d17/f3d [3887653,54979] 0 2024-02-15T18:31:25.837 INFO:tasks.workunit.client.1.smithi131.stdout:9/237: stat d4/dc/d17/d19/f2a 0 2024-02-15T18:31:25.837 INFO:tasks.workunit.client.1.smithi131.stdout:3/166: write d2/d22/d29/db/d1a/f11 [693271,94766] 0 2024-02-15T18:31:25.838 INFO:tasks.workunit.client.1.smithi131.stdout:3/167: write d2/d22/d29/db/d1a/f11 [1317689,21066] 0 2024-02-15T18:31:25.838 INFO:tasks.workunit.client.1.smithi131.stdout:6/266: dwrite d2/d38/f47 [0,4194304] 0 2024-02-15T18:31:25.838 INFO:tasks.workunit.client.1.smithi131.stdout:4/228: mkdir d2/d7/d12/d53 0 2024-02-15T18:31:25.838 INFO:tasks.workunit.client.1.smithi131.stdout:2/124: write f8 [1591020,42251] 0 2024-02-15T18:31:25.841 INFO:tasks.workunit.client.1.smithi131.stdout:8/189: truncate d22/f23 3619683 0 2024-02-15T18:31:25.844 INFO:tasks.workunit.client.1.smithi131.stdout:1/291: link d0/d2/d7/c13 d0/d2/d4/c61 0 2024-02-15T18:31:25.848 INFO:tasks.workunit.client.1.smithi131.stdout:9/238: unlink d4/dc/d17/c23 0 2024-02-15T18:31:25.849 INFO:tasks.workunit.client.1.smithi131.stdout:3/168: getdents d2/d22/d29/db/d23 0 2024-02-15T18:31:25.850 INFO:tasks.workunit.client.1.smithi131.stdout:0/209: sync 2024-02-15T18:31:25.851 INFO:tasks.workunit.client.1.smithi131.stdout:2/125: dread f8 [0,4194304] 0 2024-02-15T18:31:25.855 INFO:tasks.workunit.client.1.smithi131.stdout:6/267: unlink d2/d7/d16/f4e 0 2024-02-15T18:31:25.856 INFO:tasks.workunit.client.1.smithi131.stdout:4/229: mknod d2/d2a/d47/c54 0 2024-02-15T18:31:25.859 INFO:tasks.workunit.client.1.smithi131.stdout:8/190: truncate d22/f32 27109 0 2024-02-15T18:31:25.860 INFO:tasks.workunit.client.1.smithi131.stdout:9/239: mknod d4/dc/de/d1e/d1f/c47 0 2024-02-15T18:31:25.860 INFO:tasks.workunit.client.1.smithi131.stdout:9/240: chown d4/dc/f2d 695089 1 2024-02-15T18:31:25.861 INFO:tasks.workunit.client.1.smithi131.stdout:0/210: mkdir d5/d2f/d45 0 2024-02-15T18:31:25.861 INFO:tasks.workunit.client.1.smithi131.stdout:0/211: stat d5/d2f/d45 0 2024-02-15T18:31:25.861 INFO:tasks.workunit.client.1.smithi131.stdout:0/212: dread - d5/d9/f1d zero size 2024-02-15T18:31:25.865 INFO:tasks.workunit.client.1.smithi131.stdout:1/292: dwrite d0/d2/d7/f4c [0,4194304] 0 2024-02-15T18:31:25.865 INFO:tasks.workunit.client.1.smithi131.stdout:1/293: truncate d0/d1/d44/d59/d42/f5c 44818 0 2024-02-15T18:31:25.866 INFO:tasks.workunit.client.1.smithi131.stdout:4/230: link d2/d7/d1c/l3b d2/d7/l55 0 2024-02-15T18:31:25.867 INFO:tasks.workunit.client.1.smithi131.stdout:8/191: link d22/d26/f2a d22/d26/d3f/f40 0 2024-02-15T18:31:25.867 INFO:tasks.workunit.client.1.smithi131.stdout:9/241: rename d4/dc/d17/d19/f2a to d4/dc/d17/d19/d32/f48 0 2024-02-15T18:31:25.869 INFO:tasks.workunit.client.1.smithi131.stdout:4/231: write d2/d7/ff [546145,81062] 0 2024-02-15T18:31:25.871 INFO:tasks.workunit.client.1.smithi131.stdout:2/126: link c6 dd/d10/c1d 0 2024-02-15T18:31:25.872 INFO:tasks.workunit.client.1.smithi131.stdout:2/127: truncate dd/f11 3137660 0 2024-02-15T18:31:25.872 INFO:tasks.workunit.client.1.smithi131.stdout:2/128: write dd/ff [7379798,34511] 0 2024-02-15T18:31:25.873 INFO:tasks.workunit.client.1.smithi131.stdout:0/213: link d5/d9/d10/f28 d5/d15/d1f/f46 0 2024-02-15T18:31:25.873 INFO:tasks.workunit.client.1.smithi131.stdout:0/214: write d5/fd [2044792,56182] 0 2024-02-15T18:31:25.876 INFO:tasks.workunit.client.1.smithi131.stdout:1/294: truncate d0/d2/d7/f1e 1662387 0 2024-02-15T18:31:25.878 INFO:tasks.workunit.client.1.smithi131.stdout:4/232: creat d2/d2a/d47/d21/d46/f56 x:0 0 0 2024-02-15T18:31:25.880 INFO:tasks.workunit.client.1.smithi131.stdout:4/233: read d2/d7/d1c/f51 [3156803,84770] 0 2024-02-15T18:31:25.883 INFO:tasks.workunit.client.1.smithi131.stdout:6/268: dwrite d2/dc/f2a [4194304,4194304] 0 2024-02-15T18:31:25.883 INFO:tasks.workunit.client.1.smithi131.stdout:6/269: fdatasync d2/d7/d48/f49 0 2024-02-15T18:31:25.883 INFO:tasks.workunit.client.1.smithi131.stdout:2/129: mkdir dd/d1e 0 2024-02-15T18:31:25.883 INFO:tasks.workunit.client.1.smithi131.stdout:2/130: chown dd/f18 3 1 2024-02-15T18:31:25.886 INFO:tasks.workunit.client.1.smithi131.stdout:4/234: mknod d2/d7/d12/d2e/d39/d4b/c57 0 2024-02-15T18:31:25.887 INFO:tasks.workunit.client.1.smithi131.stdout:4/235: write d2/d2a/d47/f27 [774802,88405] 0 2024-02-15T18:31:25.892 INFO:tasks.workunit.client.1.smithi131.stdout:2/131: mkdir dd/d14/d1f 0 2024-02-15T18:31:25.892 INFO:tasks.workunit.client.1.smithi131.stdout:2/132: chown dd/d10/d13 35628 1 2024-02-15T18:31:25.894 INFO:tasks.workunit.client.1.smithi131.stdout:2/133: mknod dd/c20 0 2024-02-15T18:31:25.902 INFO:tasks.workunit.client.1.smithi131.stdout:4/236: link d2/d2a/d47/d16/l36 d2/l58 0 2024-02-15T18:31:25.903 INFO:tasks.workunit.client.1.smithi131.stdout:2/134: rename dd/l1c to dd/d1e/l21 0 2024-02-15T18:31:25.905 INFO:tasks.workunit.client.1.smithi131.stdout:2/135: mkdir dd/d10/d22 0 2024-02-15T18:31:25.906 INFO:tasks.workunit.client.1.smithi131.stdout:2/136: mknod dd/d10/d13/c23 0 2024-02-15T18:31:25.907 INFO:tasks.workunit.client.1.smithi131.stdout:2/137: mknod dd/d14/d1f/c24 0 2024-02-15T18:31:25.909 INFO:tasks.workunit.client.1.smithi131.stdout:2/138: symlink dd/l25 0 2024-02-15T18:31:25.912 INFO:tasks.workunit.client.1.smithi131.stdout:1/295: dwrite d0/d2/d4/da/f1f [4194304,4194304] 0 2024-02-15T18:31:25.915 INFO:tasks.workunit.client.1.smithi131.stdout:6/270: dwrite d2/d7/fa [0,4194304] 0 2024-02-15T18:31:25.915 INFO:tasks.workunit.client.1.smithi131.stdout:1/296: rename d0/d1/d44/d59/d42/l54 to d0/d2/d4/d41/l62 0 2024-02-15T18:31:25.915 INFO:tasks.workunit.client.1.smithi131.stdout:9/242: dwrite d4/dc/f36 [0,4194304] 0 2024-02-15T18:31:25.915 INFO:tasks.workunit.client.1.smithi131.stdout:8/192: dwrite d22/d2e/f3a [0,4194304] 0 2024-02-15T18:31:25.918 INFO:tasks.workunit.client.1.smithi131.stdout:6/271: write f0 [5282090,87507] 0 2024-02-15T18:31:25.918 INFO:tasks.workunit.client.1.smithi131.stdout:6/272: fsync d2/dc/d1f/f26 0 2024-02-15T18:31:25.918 INFO:tasks.workunit.client.1.smithi131.stdout:6/273: chown d2/dc/d1f/l32 86219 1 2024-02-15T18:31:25.920 INFO:tasks.workunit.client.1.smithi131.stdout:6/274: write d2/d7/d16/f1e [3975302,85466] 0 2024-02-15T18:31:25.920 INFO:tasks.workunit.client.1.smithi131.stdout:6/275: read - d2/d36/f4c zero size 2024-02-15T18:31:25.920 INFO:tasks.workunit.client.1.smithi131.stdout:9/243: write d4/dc/d17/d19/fb [1491788,72700] 0 2024-02-15T18:31:25.920 INFO:tasks.workunit.client.1.smithi131.stdout:9/244: fsync d4/dc/d17/f3d 0 2024-02-15T18:31:25.921 INFO:tasks.workunit.client.1.smithi131.stdout:9/245: write f0 [606638,41897] 0 2024-02-15T18:31:25.921 INFO:tasks.workunit.client.1.smithi131.stdout:4/237: dwrite d2/d7/d12/f52 [0,4194304] 0 2024-02-15T18:31:25.931 INFO:tasks.workunit.client.1.smithi131.stdout:2/139: getdents dd/d1e 0 2024-02-15T18:31:25.935 INFO:tasks.workunit.client.1.smithi131.stdout:6/276: creat d2/d7/d48/f53 x:0 0 0 2024-02-15T18:31:25.935 INFO:tasks.workunit.client.1.smithi131.stdout:9/246: mknod d4/dc/d25/d3f/c49 0 2024-02-15T18:31:25.937 INFO:tasks.workunit.client.1.smithi131.stdout:2/140: creat dd/d1e/f26 x:0 0 0 2024-02-15T18:31:25.937 INFO:tasks.workunit.client.1.smithi131.stdout:2/141: read f4 [5902124,1897] 0 2024-02-15T18:31:25.938 INFO:tasks.workunit.client.1.smithi131.stdout:8/193: mkdir d22/d41 0 2024-02-15T18:31:25.939 INFO:tasks.workunit.client.1.smithi131.stdout:4/238: dwrite d2/d2a/f42 [0,4194304] 0 2024-02-15T18:31:25.940 INFO:tasks.workunit.client.1.smithi131.stdout:6/277: rename d2/dc/d27/f31 to d2/d7/f54 0 2024-02-15T18:31:25.940 INFO:tasks.workunit.client.1.smithi131.stdout:1/297: dwrite d0/d2/d7/f34 [0,4194304] 0 2024-02-15T18:31:25.941 INFO:tasks.workunit.client.1.smithi131.stdout:9/247: creat d4/dc/d17/d19/d32/f4a x:0 0 0 2024-02-15T18:31:25.943 INFO:tasks.workunit.client.1.smithi131.stdout:2/142: symlink dd/d10/d22/l27 0 2024-02-15T18:31:25.943 INFO:tasks.workunit.client.1.smithi131.stdout:2/143: write dd/d1e/f26 [450503,37854] 0 2024-02-15T18:31:25.944 INFO:tasks.workunit.client.1.smithi131.stdout:8/194: creat d22/f42 x:0 0 0 2024-02-15T18:31:25.944 INFO:tasks.workunit.client.1.smithi131.stdout:8/195: chown d22/d26/f2f 381 1 2024-02-15T18:31:25.946 INFO:tasks.workunit.client.1.smithi131.stdout:4/239: truncate d2/d2a/f3c 4013929 0 2024-02-15T18:31:25.947 INFO:tasks.workunit.client.1.smithi131.stdout:6/278: creat d2/dc/d27/f55 x:0 0 0 2024-02-15T18:31:25.949 INFO:tasks.workunit.client.1.smithi131.stdout:1/298: symlink d0/d1/d24/l63 0 2024-02-15T18:31:25.949 INFO:tasks.workunit.client.1.smithi131.stdout:1/299: chown d0/d1/d24 290654 1 2024-02-15T18:31:25.949 INFO:tasks.workunit.client.1.smithi131.stdout:9/248: truncate d4/dc/f2d 1284066 0 2024-02-15T18:31:25.950 INFO:tasks.workunit.client.1.smithi131.stdout:2/144: symlink dd/d14/l28 0 2024-02-15T18:31:25.952 INFO:tasks.workunit.client.1.smithi131.stdout:8/196: getdents d22/d2e 0 2024-02-15T18:31:25.952 INFO:tasks.workunit.client.1.smithi131.stdout:8/197: chown d22/f32 12 1 2024-02-15T18:31:25.952 INFO:tasks.workunit.client.1.smithi131.stdout:6/279: creat d2/d2b/f56 x:0 0 0 2024-02-15T18:31:25.956 INFO:tasks.workunit.client.1.smithi131.stdout:1/300: link d0/d1/l4f d0/l64 0 2024-02-15T18:31:25.959 INFO:tasks.workunit.client.1.smithi131.stdout:2/145: rename dd/ff to dd/f29 0 2024-02-15T18:31:25.960 INFO:tasks.workunit.client.1.smithi131.stdout:8/198: symlink d22/d2e/l43 0 2024-02-15T18:31:25.961 INFO:tasks.workunit.client.1.smithi131.stdout:6/280: link d2/dc/f2a d2/d7/d12/d4d/f57 0 2024-02-15T18:31:25.961 INFO:tasks.workunit.client.1.smithi131.stdout:2/146: dread dd/f18 [0,4194304] 0 2024-02-15T18:31:25.962 INFO:tasks.workunit.client.1.smithi131.stdout:9/249: dread d4/dc/de/d1e/d1f/f3a [0,4194304] 0 2024-02-15T18:31:25.962 INFO:tasks.workunit.client.1.smithi131.stdout:9/250: fsync f1 0 2024-02-15T18:31:25.970 INFO:tasks.workunit.client.1.smithi131.stdout:2/147: mkdir dd/d10/d22/d2a 0 2024-02-15T18:31:25.971 INFO:tasks.workunit.client.1.smithi131.stdout:9/251: getdents d4 0 2024-02-15T18:31:25.971 INFO:tasks.workunit.client.1.smithi131.stdout:9/252: stat d4/dc/d17/l42 0 2024-02-15T18:31:25.973 INFO:tasks.workunit.client.1.smithi131.stdout:8/199: rename d22/f28 to d22/d26/d3f/f44 0 2024-02-15T18:31:25.973 INFO:tasks.workunit.client.1.smithi131.stdout:8/200: write d22/d26/d3f/f44 [503572,26587] 0 2024-02-15T18:31:25.973 INFO:tasks.workunit.client.1.smithi131.stdout:6/281: dread f0 [4194304,4194304] 0 2024-02-15T18:31:25.975 INFO:tasks.workunit.client.1.smithi131.stdout:2/148: getdents dd/d10/d13 0 2024-02-15T18:31:25.976 INFO:tasks.workunit.client.1.smithi131.stdout:1/301: dwrite d0/d1/d24/f2d [0,4194304] 0 2024-02-15T18:31:25.977 INFO:tasks.workunit.client.1.smithi131.stdout:9/253: creat d4/dc/de/d1e/d1f/d2c/f4b x:0 0 0 2024-02-15T18:31:25.977 INFO:tasks.workunit.client.1.smithi131.stdout:9/254: getdents d4 0 2024-02-15T18:31:25.977 INFO:tasks.workunit.client.1.smithi131.stdout:8/201: stat d22/f30 0 2024-02-15T18:31:25.977 INFO:tasks.workunit.client.1.smithi131.stdout:8/202: stat d22/d2e 0 2024-02-15T18:31:25.983 INFO:tasks.workunit.client.1.smithi131.stdout:8/203: truncate d22/d26/f2d 717108 0 2024-02-15T18:31:25.984 INFO:tasks.workunit.client.1.smithi131.stdout:1/302: rmdir d0/d1/d16/d19/d5b 0 2024-02-15T18:31:25.991 INFO:tasks.workunit.client.1.smithi131.stdout:9/255: dread f3 [0,4194304] 0 2024-02-15T18:31:25.991 INFO:tasks.workunit.client.1.smithi131.stdout:9/256: fdatasync f0 0 2024-02-15T18:31:25.992 INFO:tasks.workunit.client.1.smithi131.stdout:1/303: mknod d0/d1/d16/d19/c65 0 2024-02-15T18:31:25.994 INFO:tasks.workunit.client.1.smithi131.stdout:1/304: mknod d0/d2/d4/d41/d5a/d5f/c66 0 2024-02-15T18:31:25.996 INFO:tasks.workunit.client.1.smithi131.stdout:8/204: dread d22/d26/f2f [0,4194304] 0 2024-02-15T18:31:25.996 INFO:tasks.workunit.client.1.smithi131.stdout:8/205: fdatasync d22/d26/d3f/f40 0 2024-02-15T18:31:25.996 INFO:tasks.workunit.client.1.smithi131.stdout:9/257: write d4/dc/f2d [384210,54755] 0 2024-02-15T18:31:25.996 INFO:tasks.workunit.client.1.smithi131.stdout:9/258: stat d4/dc/de/d1e/d26 0 2024-02-15T18:31:25.997 INFO:tasks.workunit.client.1.smithi131.stdout:2/149: dwrite fb [4194304,4194304] 0 2024-02-15T18:31:26.000 INFO:tasks.workunit.client.1.smithi131.stdout:9/259: creat d4/dc/d17/d19/d41/f4c x:0 0 0 2024-02-15T18:31:26.002 INFO:tasks.workunit.client.1.smithi131.stdout:9/260: mkdir d4/dc/d25/d4d 0 2024-02-15T18:31:26.004 INFO:tasks.workunit.client.1.smithi131.stdout:8/206: write d22/d26/f2d [1589106,34711] 0 2024-02-15T18:31:26.004 INFO:tasks.workunit.client.1.smithi131.stdout:8/207: readlink l3 0 2024-02-15T18:31:26.009 INFO:tasks.workunit.client.1.smithi131.stdout:2/150: dread fb [0,4194304] 0 2024-02-15T18:31:26.009 INFO:tasks.workunit.client.1.smithi131.stdout:2/151: write dd/d10/d13/f1a [2005035,20738] 0 2024-02-15T18:31:26.010 INFO:tasks.workunit.client.1.smithi131.stdout:9/261: rename d4/dc/de/d1e/d26 to d4/dc/d25/d4e 0 2024-02-15T18:31:26.010 INFO:tasks.workunit.client.1.smithi131.stdout:9/262: chown d4/l21 12 1 2024-02-15T18:31:26.011 INFO:tasks.workunit.client.1.smithi131.stdout:9/263: write f0 [3075649,63285] 0 2024-02-15T18:31:26.011 INFO:tasks.workunit.client.1.smithi131.stdout:8/208: link l3 d22/d26/l45 0 2024-02-15T18:31:26.012 INFO:tasks.workunit.client.1.smithi131.stdout:2/152: mkdir dd/d14/d2b 0 2024-02-15T18:31:26.012 INFO:tasks.workunit.client.1.smithi131.stdout:2/153: truncate fc 847180 0 2024-02-15T18:31:26.014 INFO:tasks.workunit.client.1.smithi131.stdout:1/305: dwrite d0/d1/f38 [0,4194304] 0 2024-02-15T18:31:26.015 INFO:tasks.workunit.client.1.smithi131.stdout:9/264: dread d4/dc/de/d1e/d1f/f3a [0,4194304] 0 2024-02-15T18:31:26.015 INFO:tasks.workunit.client.1.smithi131.stdout:9/265: readlink d4/dc/d25/l31 0 2024-02-15T18:31:26.015 INFO:tasks.workunit.client.1.smithi131.stdout:9/266: chown d4/dc/de/d1e/d1f/c28 64 1 2024-02-15T18:31:26.015 INFO:tasks.workunit.client.1.smithi131.stdout:9/267: chown d4/dc/d17/d19/fb 13 1 2024-02-15T18:31:26.019 INFO:tasks.workunit.client.1.smithi131.stdout:1/306: creat d0/d2/d4/d5d/f67 x:0 0 0 2024-02-15T18:31:26.024 INFO:tasks.workunit.client.1.smithi131.stdout:2/154: dread fa [4194304,4194304] 0 2024-02-15T18:31:26.025 INFO:tasks.workunit.client.1.smithi131.stdout:2/155: rmdir dd/d14 39 2024-02-15T18:31:26.025 INFO:tasks.workunit.client.1.smithi131.stdout:2/156: getdents dd/d10/d22 0 2024-02-15T18:31:26.025 INFO:tasks.workunit.client.1.smithi131.stdout:2/157: fsync dd/f11 0 2024-02-15T18:31:26.026 INFO:tasks.workunit.client.1.smithi131.stdout:2/158: creat dd/d10/d22/d2a/f2c x:0 0 0 2024-02-15T18:31:26.032 INFO:tasks.workunit.client.1.smithi131.stdout:2/159: dread dd/f29 [0,4194304] 0 2024-02-15T18:31:26.039 INFO:tasks.workunit.client.1.smithi131.stdout:8/209: dwrite f1d [0,4194304] 0 2024-02-15T18:31:26.041 INFO:tasks.workunit.client.1.smithi131.stdout:8/210: unlink c21 0 2024-02-15T18:31:26.042 INFO:tasks.workunit.client.1.smithi131.stdout:8/211: dread f14 [0,4194304] 0 2024-02-15T18:31:26.042 INFO:tasks.workunit.client.1.smithi131.stdout:9/268: dwrite d4/dc/de/d1e/d1f/d2c/f4b [0,4194304] 0 2024-02-15T18:31:26.043 INFO:tasks.workunit.client.1.smithi131.stdout:2/160: dread fa [0,4194304] 0 2024-02-15T18:31:26.048 INFO:tasks.workunit.client.1.smithi131.stdout:8/212: unlink d22/c34 0 2024-02-15T18:31:26.050 INFO:tasks.workunit.client.1.smithi131.stdout:2/161: dread dd/d10/d13/f1a [0,4194304] 0 2024-02-15T18:31:26.051 INFO:tasks.workunit.client.1.smithi131.stdout:2/162: readlink dd/le 0 2024-02-15T18:31:26.051 INFO:tasks.workunit.client.1.smithi131.stdout:8/213: write d22/d26/f2d [1321386,83807] 0 2024-02-15T18:31:26.051 INFO:tasks.workunit.client.1.smithi131.stdout:8/214: write d22/d26/d3f/f40 [1931664,120753] 0 2024-02-15T18:31:26.054 INFO:tasks.workunit.client.1.smithi131.stdout:8/215: mknod d22/d41/c46 0 2024-02-15T18:31:26.054 INFO:tasks.workunit.client.1.smithi131.stdout:8/216: write d22/d26/f35 [383411,16731] 0 2024-02-15T18:31:26.056 INFO:tasks.workunit.client.1.smithi131.stdout:2/163: dread fa [0,4194304] 0 2024-02-15T18:31:26.056 INFO:tasks.workunit.client.1.smithi131.stdout:2/164: write fc [506908,9482] 0 2024-02-15T18:31:26.057 INFO:tasks.workunit.client.1.smithi131.stdout:2/165: chown dd/d14/d1f/c24 1453906499 1 2024-02-15T18:31:26.058 INFO:tasks.workunit.client.1.smithi131.stdout:2/166: mknod dd/d1e/c2d 0 2024-02-15T18:31:26.060 INFO:tasks.workunit.client.1.smithi131.stdout:9/269: dwrite f0 [0,4194304] 0 2024-02-15T18:31:26.061 INFO:tasks.workunit.client.1.smithi131.stdout:9/270: chown d4/dc/l24 140 1 2024-02-15T18:31:26.061 INFO:tasks.workunit.client.1.smithi131.stdout:2/167: dread dd/d1e/f26 [0,4194304] 0 2024-02-15T18:31:26.062 INFO:tasks.workunit.client.1.smithi131.stdout:2/168: mkdir dd/d10/d13/d2e 0 2024-02-15T18:31:26.063 INFO:tasks.workunit.client.1.smithi131.stdout:2/169: mkdir dd/d10/d22/d2f 0 2024-02-15T18:31:26.066 INFO:tasks.workunit.client.1.smithi131.stdout:2/170: read f4 [4702649,37453] 0 2024-02-15T18:31:26.067 INFO:tasks.workunit.client.1.smithi131.stdout:2/171: creat dd/d10/d22/d2a/f30 x:0 0 0 2024-02-15T18:31:26.067 INFO:tasks.workunit.client.1.smithi131.stdout:2/172: truncate f8 3764277 0 2024-02-15T18:31:26.067 INFO:tasks.workunit.client.1.smithi131.stdout:2/173: rename dd/d10/d22/d2f to dd/d10/d22/d2f/d31 22 2024-02-15T18:31:26.072 INFO:tasks.workunit.client.1.smithi131.stdout:9/271: dread f0 [0,4194304] 0 2024-02-15T18:31:26.073 INFO:tasks.workunit.client.1.smithi131.stdout:9/272: stat d4/dc/d17/d19/d32/f4a 0 2024-02-15T18:31:26.074 INFO:tasks.workunit.client.1.smithi131.stdout:9/273: getdents d4/dc/d25 0 2024-02-15T18:31:26.075 INFO:tasks.workunit.client.1.smithi131.stdout:8/217: dwrite d22/f30 [0,4194304] 0 2024-02-15T18:31:26.077 INFO:tasks.workunit.client.1.smithi131.stdout:9/274: dread d4/dc/d25/d4e/d38/f44 [0,4194304] 0 2024-02-15T18:31:26.077 INFO:tasks.workunit.client.1.smithi131.stdout:8/218: mkdir d22/d26/d3f/d47 0 2024-02-15T18:31:26.079 INFO:tasks.workunit.client.1.smithi131.stdout:9/275: truncate d4/dc/d17/d19/fb 2350982 0 2024-02-15T18:31:26.080 INFO:tasks.workunit.client.1.smithi131.stdout:8/219: truncate fb 3021620 0 2024-02-15T18:31:26.081 INFO:tasks.workunit.client.1.smithi131.stdout:9/276: rename d4/dc/de/l30 to d4/dc/d17/d19/d32/l4f 0 2024-02-15T18:31:26.081 INFO:tasks.workunit.client.1.smithi131.stdout:9/277: fsync d4/dc/f2d 0 2024-02-15T18:31:26.083 INFO:tasks.workunit.client.1.smithi131.stdout:8/220: mkdir d22/d26/d3f/d47/d48 0 2024-02-15T18:31:26.083 INFO:tasks.workunit.client.1.smithi131.stdout:8/221: readlink l19 0 2024-02-15T18:31:26.083 INFO:tasks.workunit.client.1.smithi131.stdout:9/278: write d4/dc/d17/f3d [2139486,115173] 0 2024-02-15T18:31:26.089 INFO:tasks.workunit.client.1.smithi131.stdout:8/222: creat d22/d41/f49 x:0 0 0 2024-02-15T18:31:26.089 INFO:tasks.workunit.client.1.smithi131.stdout:8/223: write f1c [4626166,80369] 0 2024-02-15T18:31:26.094 INFO:tasks.workunit.client.1.smithi131.stdout:8/224: link d22/f42 d22/d26/d3f/d47/f4a 0 2024-02-15T18:31:26.094 INFO:tasks.workunit.client.1.smithi131.stdout:8/225: chown d22/d26 172027991 1 2024-02-15T18:31:26.095 INFO:tasks.workunit.client.1.smithi131.stdout:9/279: dread d4/dc/d17/f3d [0,4194304] 0 2024-02-15T18:31:26.096 INFO:tasks.workunit.client.1.smithi131.stdout:9/280: getdents d4/dc/de/d1e/d1f 0 2024-02-15T18:31:26.096 INFO:tasks.workunit.client.1.smithi131.stdout:9/281: truncate d4/dc/d25/f40 717528 0 2024-02-15T18:31:26.097 INFO:tasks.workunit.client.1.smithi131.stdout:9/282: rmdir d4/dc/d25 39 2024-02-15T18:31:26.098 INFO:tasks.workunit.client.1.smithi131.stdout:9/283: write d4/dc/d17/d19/fb [1206434,114614] 0 2024-02-15T18:31:26.108 INFO:tasks.workunit.client.1.smithi131.stdout:8/226: dread d22/d2e/f3a [0,4194304] 0 2024-02-15T18:31:26.108 INFO:tasks.workunit.client.1.smithi131.stdout:8/227: truncate f1d 715127 0 2024-02-15T18:31:26.111 INFO:tasks.workunit.client.1.smithi131.stdout:8/228: write d22/f23 [814738,56828] 0 2024-02-15T18:31:26.112 INFO:tasks.workunit.client.1.smithi131.stdout:8/229: symlink d22/l4b 0 2024-02-15T18:31:26.112 INFO:tasks.workunit.client.1.smithi131.stdout:9/284: dwrite d4/dc/d25/f40 [0,4194304] 0 2024-02-15T18:31:26.113 INFO:tasks.workunit.client.1.smithi131.stdout:9/285: truncate d4/dc/d17/d19/d41/f4c 649288 0 2024-02-15T18:31:26.113 INFO:tasks.workunit.client.1.smithi131.stdout:8/230: write f17 [4122374,73400] 0 2024-02-15T18:31:26.116 INFO:tasks.workunit.client.1.smithi131.stdout:8/231: mknod d22/d26/d3f/d47/c4c 0 2024-02-15T18:31:26.116 INFO:tasks.workunit.client.1.smithi131.stdout:8/232: stat d22/d26/f2f 0 2024-02-15T18:31:26.120 INFO:tasks.workunit.client.1.smithi131.stdout:8/233: getdents d22 0 2024-02-15T18:31:26.120 INFO:tasks.workunit.client.1.smithi131.stdout:8/234: chown d22/c25 46630 1 2024-02-15T18:31:26.123 INFO:tasks.workunit.client.1.smithi131.stdout:8/235: read d22/f27 [3203282,57257] 0 2024-02-15T18:31:26.124 INFO:tasks.workunit.client.1.smithi131.stdout:8/236: unlink d22/d26/d3f/f40 0 2024-02-15T18:31:26.124 INFO:tasks.workunit.client.1.smithi131.stdout:8/237: fsync d22/f30 0 2024-02-15T18:31:26.131 INFO:tasks.workunit.client.1.smithi131.stdout:9/286: dwrite f1 [0,4194304] 0 2024-02-15T18:31:26.144 INFO:tasks.workunit.client.1.smithi131.stdout:8/238: dwrite d22/f27 [0,4194304] 0 2024-02-15T18:31:26.144 INFO:tasks.workunit.client.1.smithi131.stdout:8/239: chown c4 198392 1 2024-02-15T18:31:26.147 INFO:tasks.workunit.client.1.smithi131.stdout:9/287: dwrite d4/dc/d17/d19/d32/f4a [0,4194304] 0 2024-02-15T18:31:26.149 INFO:tasks.workunit.client.1.smithi131.stdout:9/288: creat d4/dc/d25/d4e/d38/f50 x:0 0 0 2024-02-15T18:31:26.149 INFO:tasks.workunit.client.1.smithi131.stdout:9/289: truncate d4/dc/d17/d19/d32/f4a 4230190 0 2024-02-15T18:31:26.150 INFO:tasks.workunit.client.1.smithi131.stdout:9/290: write d4/dc/f2d [1653577,129867] 0 2024-02-15T18:31:26.150 INFO:tasks.workunit.client.1.smithi131.stdout:9/291: mkdir d4/dc/de/d1e/d1f/d51 0 2024-02-15T18:31:26.150 INFO:tasks.workunit.client.1.smithi131.stdout:9/292: fsync d4/dc/d25/d4e/d38/f44 0 2024-02-15T18:31:26.150 INFO:tasks.workunit.client.1.smithi131.stdout:9/293: write d4/dc/d25/f43 [322527,100725] 0 2024-02-15T18:31:26.156 INFO:tasks.workunit.client.1.smithi131.stdout:8/240: dread d22/d26/f2b [0,4194304] 0 2024-02-15T18:31:26.157 INFO:tasks.workunit.client.1.smithi131.stdout:8/241: mkdir d22/d26/d3f/d47/d4d 0 2024-02-15T18:31:26.158 INFO:tasks.workunit.client.1.smithi131.stdout:8/242: dread f14 [0,4194304] 0 2024-02-15T18:31:26.158 INFO:tasks.workunit.client.1.smithi131.stdout:8/243: truncate d22/f3e 224911 0 2024-02-15T18:31:26.158 INFO:tasks.workunit.client.1.smithi131.stdout:8/244: rmdir d22/d2e 39 2024-02-15T18:31:26.159 INFO:tasks.workunit.client.1.smithi131.stdout:8/245: creat d22/d26/f4e x:0 0 0 2024-02-15T18:31:26.160 INFO:tasks.workunit.client.1.smithi131.stdout:8/246: creat d22/d26/d3f/f4f x:0 0 0 2024-02-15T18:31:26.161 INFO:tasks.workunit.client.1.smithi131.stdout:8/247: symlink d22/d39/l50 0 2024-02-15T18:31:26.162 INFO:tasks.workunit.client.1.smithi131.stdout:8/248: rename c1b to d22/d26/d3f/d47/c51 0 2024-02-15T18:31:26.163 INFO:tasks.workunit.client.1.smithi131.stdout:8/249: mknod d22/d26/d3f/c52 0 2024-02-15T18:31:26.163 INFO:tasks.workunit.client.1.smithi131.stdout:8/250: truncate d22/d2e/f37 3536489 0 2024-02-15T18:31:26.165 INFO:tasks.workunit.client.1.smithi131.stdout:9/294: dwrite d4/dc/d25/d4e/d38/f44 [0,4194304] 0 2024-02-15T18:31:26.168 INFO:tasks.workunit.client.1.smithi131.stdout:9/295: getdents d4/dc 0 2024-02-15T18:31:26.168 INFO:tasks.workunit.client.1.smithi131.stdout:9/296: chown d4/dc/de/d1e 19166 1 2024-02-15T18:31:26.168 INFO:tasks.workunit.client.1.smithi131.stdout:9/297: read f0 [544683,54547] 0 2024-02-15T18:31:26.170 INFO:tasks.workunit.client.1.smithi131.stdout:9/298: mknod d4/dc/de/d1e/d1f/c52 0 2024-02-15T18:31:26.170 INFO:tasks.workunit.client.1.smithi131.stdout:9/299: write d4/dc/d17/d19/d41/f4c [1497982,113552] 0 2024-02-15T18:31:26.172 INFO:tasks.workunit.client.1.smithi131.stdout:9/300: getdents d4/dc/de 0 2024-02-15T18:31:26.173 INFO:tasks.workunit.client.1.smithi131.stdout:9/301: rename d4/dc/de/d1e/d1f/d2c/c34 to d4/dc/d25/d3f/c53 0 2024-02-15T18:31:26.187 INFO:tasks.workunit.client.1.smithi131.stdout:9/302: dread d4/dc/f2d [0,4194304] 0 2024-02-15T18:31:26.190 INFO:tasks.workunit.client.1.smithi131.stdout:8/251: dwrite d22/f23 [0,4194304] 0 2024-02-15T18:31:26.192 INFO:tasks.workunit.client.1.smithi131.stdout:8/252: symlink d22/d26/d3f/d47/d48/l53 0 2024-02-15T18:31:26.193 INFO:tasks.workunit.client.1.smithi131.stdout:8/253: mknod d22/d41/c54 0 2024-02-15T18:31:26.195 INFO:tasks.workunit.client.1.smithi131.stdout:8/254: creat d22/d26/f55 x:0 0 0 2024-02-15T18:31:26.195 INFO:tasks.workunit.client.1.smithi131.stdout:8/255: readlink d22/l4b 0 2024-02-15T18:31:26.196 INFO:tasks.workunit.client.1.smithi131.stdout:8/256: unlink lf 0 2024-02-15T18:31:26.199 INFO:tasks.workunit.client.1.smithi131.stdout:8/257: dread d22/d26/f2d [0,4194304] 0 2024-02-15T18:31:26.199 INFO:tasks.workunit.client.1.smithi131.stdout:8/258: dread f14 [0,4194304] 0 2024-02-15T18:31:26.199 INFO:tasks.workunit.client.1.smithi131.stdout:8/259: readlink d22/d26/d3f/d47/d48/l53 0 2024-02-15T18:31:26.200 INFO:tasks.workunit.client.1.smithi131.stdout:8/260: mknod d22/d26/d3f/d47/c56 0 2024-02-15T18:31:26.201 INFO:tasks.workunit.client.1.smithi131.stdout:8/261: rmdir d22/d26/d3f/d47/d4d 0 2024-02-15T18:31:26.237 INFO:tasks.workunit.client.1.smithi131.stdout:7/246: sync 2024-02-15T18:31:26.237 INFO:tasks.workunit.client.1.smithi131.stdout:3/169: sync 2024-02-15T18:31:26.237 INFO:tasks.workunit.client.1.smithi131.stdout:5/304: sync 2024-02-15T18:31:26.237 INFO:tasks.workunit.client.1.smithi131.stdout:3/170: fdatasync d2/d22/f35 0 2024-02-15T18:31:26.237 INFO:tasks.workunit.client.1.smithi131.stdout:3/171: dread - d2/d22/d29/f39 zero size 2024-02-15T18:31:26.237 INFO:tasks.workunit.client.1.smithi131.stdout:3/172: fdatasync d2/d22/d29/f39 0 2024-02-15T18:31:26.238 INFO:tasks.workunit.client.1.smithi131.stdout:5/305: symlink d18/d24/d63/l65 0 2024-02-15T18:31:26.238 INFO:tasks.workunit.client.1.smithi131.stdout:5/306: chown d18/d4e/f64 5980120 1 2024-02-15T18:31:26.238 INFO:tasks.workunit.client.1.smithi131.stdout:5/307: readlink d18/l21 0 2024-02-15T18:31:26.238 INFO:tasks.workunit.client.1.smithi131.stdout:7/247: mknod d0/d34/c52 0 2024-02-15T18:31:26.239 INFO:tasks.workunit.client.1.smithi131.stdout:3/173: creat d2/d22/d29/db/f3e x:0 0 0 2024-02-15T18:31:26.239 INFO:tasks.workunit.client.1.smithi131.stdout:5/308: mknod d18/d23/c66 0 2024-02-15T18:31:26.240 INFO:tasks.workunit.client.1.smithi131.stdout:3/174: write d2/f26 [2601897,123976] 0 2024-02-15T18:31:26.240 INFO:tasks.workunit.client.1.smithi131.stdout:7/248: creat d0/d17/d3a/d3d/f53 x:0 0 0 2024-02-15T18:31:26.240 INFO:tasks.workunit.client.1.smithi131.stdout:3/175: write d2/d22/d29/db/f1e [2330809,73349] 0 2024-02-15T18:31:26.242 INFO:tasks.workunit.client.1.smithi131.stdout:5/309: link d18/d20/f2e d18/d4e/f67 0 2024-02-15T18:31:26.242 INFO:tasks.workunit.client.1.smithi131.stdout:3/176: truncate d2/d22/d29/f17 609237 0 2024-02-15T18:31:26.243 INFO:tasks.workunit.client.1.smithi131.stdout:5/310: mknod d18/d33/d61/c68 0 2024-02-15T18:31:26.244 INFO:tasks.workunit.client.1.smithi131.stdout:3/177: mkdir d2/d22/d3f 0 2024-02-15T18:31:26.244 INFO:tasks.workunit.client.1.smithi131.stdout:3/178: write d2/d22/f2e [494751,10477] 0 2024-02-15T18:31:26.244 INFO:tasks.workunit.client.1.smithi131.stdout:3/179: truncate d2/d22/f35 868645 0 2024-02-15T18:31:26.245 INFO:tasks.workunit.client.1.smithi131.stdout:5/311: mkdir d18/d4e/d69 0 2024-02-15T18:31:26.248 INFO:tasks.workunit.client.1.smithi131.stdout:7/249: dread d0/f4a [0,4194304] 0 2024-02-15T18:31:26.249 INFO:tasks.workunit.client.1.smithi131.stdout:3/180: fsync d2/d22/d29/db/f3e 0 2024-02-15T18:31:26.249 INFO:tasks.workunit.client.1.smithi131.stdout:3/181: stat d2/d22/d29/f17 0 2024-02-15T18:31:26.249 INFO:tasks.workunit.client.1.smithi131.stdout:3/182: dread - d2/d22/d29/db/d34/f3b zero size 2024-02-15T18:31:26.251 INFO:tasks.workunit.client.1.smithi131.stdout:7/250: rename d0/d17/f26 to d0/d17/d3a/f54 0 2024-02-15T18:31:26.257 INFO:tasks.workunit.client.1.smithi131.stdout:3/183: write d2/d22/d29/f17 [469237,70587] 0 2024-02-15T18:31:26.258 INFO:tasks.workunit.client.1.smithi131.stdout:5/312: dread fb [4194304,4194304] 0 2024-02-15T18:31:26.259 INFO:tasks.workunit.client.1.smithi131.stdout:5/313: symlink d18/l6a 0 2024-02-15T18:31:26.261 INFO:tasks.workunit.client.1.smithi131.stdout:5/314: symlink d18/d33/d61/l6b 0 2024-02-15T18:31:26.262 INFO:tasks.workunit.client.1.smithi131.stdout:5/315: mknod d18/d20/c6c 0 2024-02-15T18:31:26.262 INFO:tasks.workunit.client.1.smithi131.stdout:3/184: dread d2/d22/d29/db/d23/d2a/f2d [0,4194304] 0 2024-02-15T18:31:26.264 INFO:tasks.workunit.client.1.smithi131.stdout:5/316: mkdir d18/d6d 0 2024-02-15T18:31:26.265 INFO:tasks.workunit.client.1.smithi131.stdout:5/317: creat d18/d23/f6e x:0 0 0 2024-02-15T18:31:26.268 INFO:tasks.workunit.client.1.smithi131.stdout:7/251: dwrite d0/d17/d3a/f54 [0,4194304] 0 2024-02-15T18:31:26.268 INFO:tasks.workunit.client.1.smithi131.stdout:5/318: read f11 [3955749,56107] 0 2024-02-15T18:31:26.270 INFO:tasks.workunit.client.1.smithi131.stdout:5/319: truncate d18/d33/f5a 996394 0 2024-02-15T18:31:26.276 INFO:tasks.workunit.client.1.smithi131.stdout:3/185: truncate d2/d22/f35 346421 0 2024-02-15T18:31:26.277 INFO:tasks.workunit.client.1.smithi131.stdout:5/320: creat d18/d4e/f6f x:0 0 0 2024-02-15T18:31:26.278 INFO:tasks.workunit.client.1.smithi131.stdout:3/186: mknod d2/d22/d29/db/d23/d2a/c40 0 2024-02-15T18:31:26.294 INFO:tasks.workunit.client.1.smithi131.stdout:7/252: dwrite d0/f43 [0,4194304] 0 2024-02-15T18:31:26.294 INFO:tasks.workunit.client.1.smithi131.stdout:7/253: chown d0/d17/f4b 341527 1 2024-02-15T18:31:26.294 INFO:tasks.workunit.client.1.smithi131.stdout:7/254: chown d0/c2b 430807 1 2024-02-15T18:31:26.298 INFO:tasks.workunit.client.1.smithi131.stdout:3/187: dwrite d2/d22/d29/d20/f37 [0,4194304] 0 2024-02-15T18:31:26.298 INFO:tasks.workunit.client.1.smithi131.stdout:3/188: dread - d2/f3c zero size 2024-02-15T18:31:26.316 INFO:tasks.workunit.client.1.smithi131.stdout:7/255: dwrite d0/d17/f21 [0,4194304] 0 2024-02-15T18:31:26.317 INFO:tasks.workunit.client.1.smithi131.stdout:3/189: dwrite d2/d22/d29/db/f1d [0,4194304] 0 2024-02-15T18:31:26.319 INFO:tasks.workunit.client.1.smithi131.stdout:7/256: rename d0/d34/c38 to d0/d17/d36/c55 0 2024-02-15T18:31:26.319 INFO:tasks.workunit.client.1.smithi131.stdout:7/257: chown d0/fd 850107568 1 2024-02-15T18:31:26.321 INFO:tasks.workunit.client.1.smithi131.stdout:3/190: link d2/d22/d29/d20/f37 d2/d22/d29/db/d23/f41 0 2024-02-15T18:31:26.322 INFO:tasks.workunit.client.1.smithi131.stdout:3/191: fdatasync d2/d22/d29/db/d23/f41 0 2024-02-15T18:31:26.322 INFO:tasks.workunit.client.1.smithi131.stdout:7/258: rmdir d0/d34 39 2024-02-15T18:31:26.322 INFO:tasks.workunit.client.1.smithi131.stdout:7/259: dread - d0/d34/f41 zero size 2024-02-15T18:31:26.324 INFO:tasks.workunit.client.1.smithi131.stdout:3/192: truncate d2/d22/d29/db/d23/d2a/f2d 475729 0 2024-02-15T18:31:26.324 INFO:tasks.workunit.client.1.smithi131.stdout:7/260: creat d0/d17/d3a/d3d/f56 x:0 0 0 2024-02-15T18:31:26.325 INFO:tasks.workunit.client.1.smithi131.stdout:3/193: truncate d2/d22/d29/db/f1e 3080616 0 2024-02-15T18:31:26.327 INFO:tasks.workunit.client.1.smithi131.stdout:3/194: mkdir d2/d22/d42 0 2024-02-15T18:31:26.328 INFO:tasks.workunit.client.1.smithi131.stdout:3/195: symlink d2/d22/d29/db/d1a/l43 0 2024-02-15T18:31:26.329 INFO:tasks.workunit.client.1.smithi131.stdout:3/196: truncate d2/d22/d29/db/f3e 432941 0 2024-02-15T18:31:26.329 INFO:tasks.workunit.client.1.smithi131.stdout:3/197: chown d2/d22/d29/db/d1a/fe 37135 1 2024-02-15T18:31:26.348 INFO:tasks.workunit.client.1.smithi131.stdout:7/261: dwrite d0/f47 [0,4194304] 0 2024-02-15T18:31:26.348 INFO:tasks.workunit.client.1.smithi131.stdout:7/262: read - d0/d34/f41 zero size 2024-02-15T18:31:26.350 INFO:tasks.workunit.client.1.smithi131.stdout:7/263: creat d0/f57 x:0 0 0 2024-02-15T18:31:26.350 INFO:tasks.workunit.client.1.smithi131.stdout:7/264: truncate d0/d17/d3a/f54 4975939 0 2024-02-15T18:31:26.350 INFO:tasks.workunit.client.1.smithi131.stdout:3/198: dwrite d2/d22/d29/db/f1d [0,4194304] 0 2024-02-15T18:31:26.351 INFO:tasks.workunit.client.1.smithi131.stdout:7/265: rename d0/d34/c52 to d0/d17/d3a/c58 0 2024-02-15T18:31:26.352 INFO:tasks.workunit.client.1.smithi131.stdout:7/266: creat d0/d17/d3a/f59 x:0 0 0 2024-02-15T18:31:26.354 INFO:tasks.workunit.client.1.smithi131.stdout:7/267: mknod d0/d17/d3a/c5a 0 2024-02-15T18:31:26.354 INFO:tasks.workunit.client.1.smithi131.stdout:7/268: write d0/d17/d36/f48 [631332,26710] 0 2024-02-15T18:31:26.356 INFO:tasks.workunit.client.1.smithi131.stdout:7/269: mknod d0/c5b 0 2024-02-15T18:31:26.357 INFO:tasks.workunit.client.1.smithi131.stdout:7/270: creat d0/d17/f5c x:0 0 0 2024-02-15T18:31:26.357 INFO:tasks.workunit.client.1.smithi131.stdout:7/271: stat d0/d17/l2c 0 2024-02-15T18:31:26.357 INFO:tasks.workunit.client.1.smithi131.stdout:7/272: dread - d0/d17/d36/f3f zero size 2024-02-15T18:31:26.368 INFO:tasks.workunit.client.1.smithi131.stdout:3/199: dwrite d2/d22/d29/f39 [0,4194304] 0 2024-02-15T18:31:26.368 INFO:tasks.workunit.client.1.smithi131.stdout:3/200: chown d2/d22/d29/c9 1 1 2024-02-15T18:31:26.370 INFO:tasks.workunit.client.1.smithi131.stdout:3/201: creat d2/d22/d3f/f44 x:0 0 0 2024-02-15T18:31:26.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/202: fdatasync d2/d22/d29/db/f3e 0 2024-02-15T18:31:26.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/203: creat d2/d22/d42/f45 x:0 0 0 2024-02-15T18:31:26.375 INFO:tasks.workunit.client.1.smithi131.stdout:7/273: dwrite d0/d17/d36/f3b [0,4194304] 0 2024-02-15T18:31:26.375 INFO:tasks.workunit.client.1.smithi131.stdout:7/274: dread - d0/d17/f5c zero size 2024-02-15T18:31:26.375 INFO:tasks.workunit.client.1.smithi131.stdout:7/275: chown d0/d17/f23 101 1 2024-02-15T18:31:26.378 INFO:tasks.workunit.client.1.smithi131.stdout:7/276: unlink d0/c1a 0 2024-02-15T18:31:26.378 INFO:tasks.workunit.client.1.smithi131.stdout:7/277: chown d0/d17/d3a/f54 2 1 2024-02-15T18:31:26.378 INFO:tasks.workunit.client.1.smithi131.stdout:7/278: write d0/d17/d3a/f54 [833835,24218] 0 2024-02-15T18:31:26.384 INFO:tasks.workunit.client.1.smithi131.stdout:7/279: mknod d0/d17/d36/c5d 0 2024-02-15T18:31:26.390 INFO:tasks.workunit.client.1.smithi131.stdout:3/204: dwrite d2/d22/d29/db/f1d [0,4194304] 0 2024-02-15T18:31:26.392 INFO:tasks.workunit.client.1.smithi131.stdout:3/205: link d2/d22/d29/db/d23/d2a/c38 d2/d22/d29/d20/c46 0 2024-02-15T18:31:26.394 INFO:tasks.workunit.client.1.smithi131.stdout:3/206: link d2/d22/d29/db/d1a/c1b d2/d22/c47 0 2024-02-15T18:31:26.395 INFO:tasks.workunit.client.1.smithi131.stdout:3/207: mknod d2/d22/d29/db/d23/c48 0 2024-02-15T18:31:26.395 INFO:tasks.workunit.client.1.smithi131.stdout:3/208: chown d2/d22/c3d 88985852 1 2024-02-15T18:31:26.397 INFO:tasks.workunit.client.1.smithi131.stdout:3/209: dread d2/d22/d29/db/f3e [0,4194304] 0 2024-02-15T18:31:26.398 INFO:tasks.workunit.client.1.smithi131.stdout:3/210: getdents d2 0 2024-02-15T18:31:26.398 INFO:tasks.workunit.client.1.smithi131.stdout:3/211: fdatasync d2/d22/d29/db/f3e 0 2024-02-15T18:31:26.398 INFO:tasks.workunit.client.1.smithi131.stdout:3/212: chown d2/d22/c47 1816 1 2024-02-15T18:31:26.398 INFO:tasks.workunit.client.1.smithi131.stdout:3/213: mkdir d2/d22/d29/db/d23/d2a/d49 0 2024-02-15T18:31:26.402 INFO:tasks.workunit.client.1.smithi131.stdout:3/214: creat d2/d22/d29/f4a x:0 0 0 2024-02-15T18:31:26.403 INFO:tasks.workunit.client.1.smithi131.stdout:3/215: fsync d2/d22/d42/f45 0 2024-02-15T18:31:26.404 INFO:tasks.workunit.client.1.smithi131.stdout:3/216: mkdir d2/d22/d4b 0 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:0/215: sync 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:6/282: sync 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:4/240: sync 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:7/280: sync 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:6/283: chown d2/f1a 79844 1 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:5/321: sync 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:2/174: sync 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:1/307: sync 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:9/303: sync 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:8/262: sync 2024-02-15T18:31:26.940 INFO:tasks.workunit.client.1.smithi131.stdout:3/217: sync 2024-02-15T18:31:26.942 INFO:tasks.workunit.client.1.smithi131.stdout:6/284: rmdir d2/d7/d48 39 2024-02-15T18:31:26.942 INFO:tasks.workunit.client.1.smithi131.stdout:6/285: chown d2 10415128 1 2024-02-15T18:31:26.946 INFO:tasks.workunit.client.1.smithi131.stdout:7/281: rename d0/ce to d0/d17/d36/c5e 0 2024-02-15T18:31:26.946 INFO:tasks.workunit.client.1.smithi131.stdout:7/282: write d0/d17/d36/f3b [4938678,122483] 0 2024-02-15T18:31:26.948 INFO:tasks.workunit.client.1.smithi131.stdout:0/216: creat d5/d9/d10/d3f/f47 x:0 0 0 2024-02-15T18:31:26.952 INFO:tasks.workunit.client.1.smithi131.stdout:2/175: creat dd/d10/d13/d2e/f32 x:0 0 0 2024-02-15T18:31:26.952 INFO:tasks.workunit.client.1.smithi131.stdout:8/263: mkdir d22/d26/d3f/d47/d57 0 2024-02-15T18:31:26.956 INFO:tasks.workunit.client.1.smithi131.stdout:6/286: creat d2/d7/d16/f58 x:0 0 0 2024-02-15T18:31:26.959 INFO:tasks.workunit.client.1.smithi131.stdout:5/322: rename d18/d23/d5d to d18/d6d/d70 0 2024-02-15T18:31:26.959 INFO:tasks.workunit.client.1.smithi131.stdout:5/323: dread - d18/d23/f52 zero size 2024-02-15T18:31:26.964 INFO:tasks.workunit.client.1.smithi131.stdout:2/176: symlink dd/d10/d22/d2f/l33 0 2024-02-15T18:31:26.964 INFO:tasks.workunit.client.1.smithi131.stdout:8/264: rmdir d22 39 2024-02-15T18:31:26.964 INFO:tasks.workunit.client.1.smithi131.stdout:8/265: chown d22/f27 1034119219 1 2024-02-15T18:31:26.964 INFO:tasks.workunit.client.1.smithi131.stdout:9/304: rename d4/dc/de/d1e/d1f/c3e to d4/dc/de/d1e/d1f/d2c/c54 0 2024-02-15T18:31:26.964 INFO:tasks.workunit.client.1.smithi131.stdout:9/305: fdatasync d4/dc/f2d 0 2024-02-15T18:31:26.964 INFO:tasks.workunit.client.1.smithi131.stdout:2/177: write dd/d10/d13/d2e/f32 [662050,100237] 0 2024-02-15T18:31:26.966 INFO:tasks.workunit.client.1.smithi131.stdout:6/287: unlink d2/c20 0 2024-02-15T18:31:26.966 INFO:tasks.workunit.client.1.smithi131.stdout:8/266: getdents d22/d39 0 2024-02-15T18:31:26.966 INFO:tasks.workunit.client.1.smithi131.stdout:8/267: chown d22/d2e/l3d 735520 1 2024-02-15T18:31:26.968 INFO:tasks.workunit.client.1.smithi131.stdout:7/283: rename d0/d17/d3a/f4e to d0/f5f 0 2024-02-15T18:31:26.970 INFO:tasks.workunit.client.1.smithi131.stdout:2/178: symlink dd/d10/l34 0 2024-02-15T18:31:26.971 INFO:tasks.workunit.client.1.smithi131.stdout:8/268: rmdir d22 39 2024-02-15T18:31:26.971 INFO:tasks.workunit.client.1.smithi131.stdout:6/288: creat d2/d7/d48/f59 x:0 0 0 2024-02-15T18:31:26.971 INFO:tasks.workunit.client.1.smithi131.stdout:8/269: chown c9 0 1 2024-02-15T18:31:26.972 INFO:tasks.workunit.client.1.smithi131.stdout:5/324: rename d18/d4e/f67 to d18/d20/f71 0 2024-02-15T18:31:26.972 INFO:tasks.workunit.client.1.smithi131.stdout:6/289: unlink d2/f9 0 2024-02-15T18:31:26.974 INFO:tasks.workunit.client.1.smithi131.stdout:5/325: unlink d18/c4b 0 2024-02-15T18:31:26.974 INFO:tasks.workunit.client.1.smithi131.stdout:5/326: write d18/f50 [317815,81772] 0 2024-02-15T18:31:26.976 INFO:tasks.workunit.client.1.smithi131.stdout:6/290: link d2/d7/f54 d2/d36/f5a 0 2024-02-15T18:31:26.977 INFO:tasks.workunit.client.1.smithi131.stdout:5/327: creat d18/d24/d63/f72 x:0 0 0 2024-02-15T18:31:26.979 INFO:tasks.workunit.client.1.smithi131.stdout:6/291: rename d2/d7/d12/l15 to d2/d7/d48/l5b 0 2024-02-15T18:31:26.980 INFO:tasks.workunit.client.1.smithi131.stdout:6/292: truncate d2/f28 720959 0 2024-02-15T18:31:26.981 INFO:tasks.workunit.client.1.smithi131.stdout:8/270: dread d22/d26/f2a [0,4194304] 0 2024-02-15T18:31:26.983 INFO:tasks.workunit.client.1.smithi131.stdout:6/293: creat d2/d7/d48/f5c x:0 0 0 2024-02-15T18:31:26.983 INFO:tasks.workunit.client.1.smithi131.stdout:3/218: dwrite d2/d22/d29/f39 [0,4194304] 0 2024-02-15T18:31:26.984 INFO:tasks.workunit.client.1.smithi131.stdout:3/219: chown d2 3980 1 2024-02-15T18:31:26.984 INFO:tasks.workunit.client.1.smithi131.stdout:8/271: creat d22/d39/f58 x:0 0 0 2024-02-15T18:31:26.984 INFO:tasks.workunit.client.1.smithi131.stdout:7/284: dread d0/d17/d3a/f54 [0,4194304] 0 2024-02-15T18:31:26.985 INFO:tasks.workunit.client.1.smithi131.stdout:7/285: fsync d0/d17/f4b 0 2024-02-15T18:31:26.987 INFO:tasks.workunit.client.1.smithi131.stdout:6/294: mknod d2/d7/d12/c5d 0 2024-02-15T18:31:26.987 INFO:tasks.workunit.client.1.smithi131.stdout:4/241: dwrite d2/f40 [0,4194304] 0 2024-02-15T18:31:26.988 INFO:tasks.workunit.client.1.smithi131.stdout:3/220: rename d2/c32 to d2/d22/d3a/c4c 0 2024-02-15T18:31:26.988 INFO:tasks.workunit.client.1.smithi131.stdout:3/221: dread - d2/d22/d29/f4a zero size 2024-02-15T18:31:26.988 INFO:tasks.workunit.client.1.smithi131.stdout:3/222: readlink d2/d22/d29/db/d1a/l25 0 2024-02-15T18:31:26.988 INFO:tasks.workunit.client.1.smithi131.stdout:8/272: link d22/d26/f2a d22/d41/f59 0 2024-02-15T18:31:26.990 INFO:tasks.workunit.client.1.smithi131.stdout:0/217: dwrite d5/d15/d1f/f36 [0,4194304] 0 2024-02-15T18:31:26.990 INFO:tasks.workunit.client.1.smithi131.stdout:0/218: readlink d5/d9/d10/l3b 0 2024-02-15T18:31:26.990 INFO:tasks.workunit.client.1.smithi131.stdout:4/242: symlink d2/d7/d12/d2e/d39/d4b/l59 0 2024-02-15T18:31:26.995 INFO:tasks.workunit.client.1.smithi131.stdout:0/219: write d5/fa [3834156,10371] 0 2024-02-15T18:31:26.995 INFO:tasks.workunit.client.1.smithi131.stdout:7/286: dread d0/d17/f1e [0,4194304] 0 2024-02-15T18:31:27.003 INFO:tasks.workunit.client.1.smithi131.stdout:3/223: symlink d2/d22/d29/d20/l4d 0 2024-02-15T18:31:27.005 INFO:tasks.workunit.client.1.smithi131.stdout:3/224: write d2/d22/d29/f39 [1967423,85745] 0 2024-02-15T18:31:27.006 INFO:tasks.workunit.client.1.smithi131.stdout:3/225: fdatasync d2/f26 0 2024-02-15T18:31:27.007 INFO:tasks.workunit.client.1.smithi131.stdout:2/179: dwrite dd/f29 [0,4194304] 0 2024-02-15T18:31:27.008 INFO:tasks.workunit.client.1.smithi131.stdout:4/243: rmdir d2/d2a/d47/d21/d46 39 2024-02-15T18:31:27.008 INFO:tasks.workunit.client.1.smithi131.stdout:5/328: dwrite d18/d20/f71 [0,4194304] 0 2024-02-15T18:31:27.008 INFO:tasks.workunit.client.1.smithi131.stdout:5/329: write d18/d24/f38 [763011,81273] 0 2024-02-15T18:31:27.009 INFO:tasks.workunit.client.1.smithi131.stdout:0/220: creat d5/d9/d11/d3e/f48 x:0 0 0 2024-02-15T18:31:27.010 INFO:tasks.workunit.client.1.smithi131.stdout:7/287: mknod d0/d17/c60 0 2024-02-15T18:31:27.011 INFO:tasks.workunit.client.1.smithi131.stdout:7/288: write d0/f47 [2434340,95722] 0 2024-02-15T18:31:27.011 INFO:tasks.workunit.client.1.smithi131.stdout:3/226: rmdir d2/d22/d29/d20 39 2024-02-15T18:31:27.014 INFO:tasks.workunit.client.1.smithi131.stdout:4/244: truncate d2/d7/d12/f52 95858 0 2024-02-15T18:31:27.015 INFO:tasks.workunit.client.1.smithi131.stdout:3/227: dread d2/d22/d29/db/d1a/f11 [0,4194304] 0 2024-02-15T18:31:27.015 INFO:tasks.workunit.client.1.smithi131.stdout:3/228: readlink d2/d22/d29/d20/l4d 0 2024-02-15T18:31:27.017 INFO:tasks.workunit.client.1.smithi131.stdout:8/273: getdents d22/d39 0 2024-02-15T18:31:27.017 INFO:tasks.workunit.client.1.smithi131.stdout:8/274: read d22/d2e/f38 [64531,67079] 0 2024-02-15T18:31:27.017 INFO:tasks.workunit.client.1.smithi131.stdout:8/275: stat d22/d2e/l31 0 2024-02-15T18:31:27.017 INFO:tasks.workunit.client.1.smithi131.stdout:8/276: dread - d22/d26/f55 zero size 2024-02-15T18:31:27.017 INFO:tasks.workunit.client.1.smithi131.stdout:8/277: dread - d22/f42 zero size 2024-02-15T18:31:27.026 INFO:tasks.workunit.client.1.smithi131.stdout:5/330: mkdir d18/d33/d73 0 2024-02-15T18:31:27.026 INFO:tasks.workunit.client.1.smithi131.stdout:3/229: dread d2/f26 [0,4194304] 0 2024-02-15T18:31:27.026 INFO:tasks.workunit.client.1.smithi131.stdout:0/221: symlink d5/d15/d1f/l49 0 2024-02-15T18:31:27.026 INFO:tasks.workunit.client.1.smithi131.stdout:0/222: stat d5/d9/d10/d3f/l40 0 2024-02-15T18:31:27.028 INFO:tasks.workunit.client.1.smithi131.stdout:7/289: unlink d0/d17/f1e 0 2024-02-15T18:31:27.030 INFO:tasks.workunit.client.1.smithi131.stdout:7/290: read d0/d17/f4b [1096199,31791] 0 2024-02-15T18:31:27.030 INFO:tasks.workunit.client.1.smithi131.stdout:8/278: creat d22/d26/d3f/d47/d48/f5a x:0 0 0 2024-02-15T18:31:27.030 INFO:tasks.workunit.client.1.smithi131.stdout:8/279: chown d22/f30 611592498 1 2024-02-15T18:31:27.031 INFO:tasks.workunit.client.1.smithi131.stdout:3/230: mknod d2/d22/c4e 0 2024-02-15T18:31:27.032 INFO:tasks.workunit.client.1.smithi131.stdout:0/223: mknod d5/d2f/c4a 0 2024-02-15T18:31:27.033 INFO:tasks.workunit.client.1.smithi131.stdout:7/291: creat d0/d17/d36/f61 x:0 0 0 2024-02-15T18:31:27.034 INFO:tasks.workunit.client.1.smithi131.stdout:3/231: rename d2/f19 to d2/d22/d29/db/d34/f4f 0 2024-02-15T18:31:27.036 INFO:tasks.workunit.client.1.smithi131.stdout:0/224: unlink d5/d9/f1d 0 2024-02-15T18:31:27.037 INFO:tasks.workunit.client.1.smithi131.stdout:7/292: write d0/d17/d3a/d3d/f42 [5816357,83759] 0 2024-02-15T18:31:27.037 INFO:tasks.workunit.client.1.smithi131.stdout:0/225: mkdir d5/d2f/d4b 0 2024-02-15T18:31:27.039 INFO:tasks.workunit.client.1.smithi131.stdout:3/232: dread d2/d22/d29/db/f1e [0,4194304] 0 2024-02-15T18:31:27.039 INFO:tasks.workunit.client.1.smithi131.stdout:7/293: rename d0/f19 to d0/d17/d3a/f62 0 2024-02-15T18:31:27.040 INFO:tasks.workunit.client.1.smithi131.stdout:3/233: rmdir d2/d22/d3f 39 2024-02-15T18:31:27.043 INFO:tasks.workunit.client.1.smithi131.stdout:2/180: dwrite fb [0,4194304] 0 2024-02-15T18:31:27.043 INFO:tasks.workunit.client.1.smithi131.stdout:3/234: creat d2/d22/d29/db/d1a/f50 x:0 0 0 2024-02-15T18:31:27.045 INFO:tasks.workunit.client.1.smithi131.stdout:2/181: symlink dd/d10/d13/l35 0 2024-02-15T18:31:27.045 INFO:tasks.workunit.client.1.smithi131.stdout:5/331: dwrite d18/d33/f54 [0,4194304] 0 2024-02-15T18:31:27.046 INFO:tasks.workunit.client.1.smithi131.stdout:3/235: unlink d2/d22/d3f/f44 0 2024-02-15T18:31:27.046 INFO:tasks.workunit.client.1.smithi131.stdout:4/245: dwrite d2/d7/d1c/f44 [0,4194304] 0 2024-02-15T18:31:27.048 INFO:tasks.workunit.client.1.smithi131.stdout:3/236: write d2/d22/d29/db/d23/d2a/f2d [45594,69644] 0 2024-02-15T18:31:27.057 INFO:tasks.workunit.client.1.smithi131.stdout:2/182: creat dd/d14/f36 x:0 0 0 2024-02-15T18:31:27.057 INFO:tasks.workunit.client.1.smithi131.stdout:2/183: dread - dd/d14/f36 zero size 2024-02-15T18:31:27.060 INFO:tasks.workunit.client.1.smithi131.stdout:3/237: dread d2/d22/d29/db/d23/f41 [0,4194304] 0 2024-02-15T18:31:27.060 INFO:tasks.workunit.client.1.smithi131.stdout:3/238: write d2/d22/f2e [705663,110934] 0 2024-02-15T18:31:27.061 INFO:tasks.workunit.client.1.smithi131.stdout:2/184: mknod dd/d14/c37 0 2024-02-15T18:31:27.061 INFO:tasks.workunit.client.1.smithi131.stdout:4/246: mkdir d2/d2a/d47/d16/d5a 0 2024-02-15T18:31:27.062 INFO:tasks.workunit.client.1.smithi131.stdout:5/332: dwrite d18/d23/f6e [0,4194304] 0 2024-02-15T18:31:27.062 INFO:tasks.workunit.client.1.smithi131.stdout:5/333: chown l4 8 1 2024-02-15T18:31:27.063 INFO:tasks.workunit.client.1.smithi131.stdout:2/185: unlink dd/le 0 2024-02-15T18:31:27.066 INFO:tasks.workunit.client.1.smithi131.stdout:2/186: getdents dd/d10 0 2024-02-15T18:31:27.066 INFO:tasks.workunit.client.1.smithi131.stdout:5/334: truncate d18/f19 684527 0 2024-02-15T18:31:27.073 INFO:tasks.workunit.client.1.smithi131.stdout:4/247: dread d2/d2a/d47/d16/f32 [0,4194304] 0 2024-02-15T18:31:27.077 INFO:tasks.workunit.client.1.smithi131.stdout:2/187: write fb [7852073,63093] 0 2024-02-15T18:31:27.079 INFO:tasks.workunit.client.1.smithi131.stdout:4/248: link d2/d7/f10 d2/f5b 0 2024-02-15T18:31:27.080 INFO:tasks.workunit.client.1.smithi131.stdout:2/188: mkdir dd/d10/d22/d2f/d38 0 2024-02-15T18:31:27.080 INFO:tasks.workunit.client.1.smithi131.stdout:2/189: truncate dd/d10/d13/d2e/f32 1747562 0 2024-02-15T18:31:27.081 INFO:tasks.workunit.client.1.smithi131.stdout:2/190: creat dd/d1e/f39 x:0 0 0 2024-02-15T18:31:27.082 INFO:tasks.workunit.client.1.smithi131.stdout:2/191: mknod dd/d14/d1f/c3a 0 2024-02-15T18:31:27.082 INFO:tasks.workunit.client.1.smithi131.stdout:2/192: truncate dd/d10/d22/d2a/f30 3439 0 2024-02-15T18:31:27.082 INFO:tasks.workunit.client.1.smithi131.stdout:2/193: mknod dd/d10/d13/c3b 0 2024-02-15T18:31:27.083 INFO:tasks.workunit.client.1.smithi131.stdout:2/194: mkdir dd/d14/d2b/d3c 0 2024-02-15T18:31:27.084 INFO:tasks.workunit.client.1.smithi131.stdout:2/195: rename c1 to dd/d14/d2b/c3d 0 2024-02-15T18:31:27.086 INFO:tasks.workunit.client.1.smithi131.stdout:2/196: write dd/f18 [103558,95866] 0 2024-02-15T18:31:27.087 INFO:tasks.workunit.client.1.smithi131.stdout:5/335: dwrite d18/d24/f26 [0,4194304] 0 2024-02-15T18:31:27.088 INFO:tasks.workunit.client.1.smithi131.stdout:3/239: dwrite d2/d22/d29/db/d23/f41 [0,4194304] 0 2024-02-15T18:31:27.088 INFO:tasks.workunit.client.1.smithi131.stdout:5/336: symlink d18/d33/l74 0 2024-02-15T18:31:27.088 INFO:tasks.workunit.client.1.smithi131.stdout:5/337: fdatasync d18/d23/f52 0 2024-02-15T18:31:27.088 INFO:tasks.workunit.client.1.smithi131.stdout:5/338: fsync d18/f19 0 2024-02-15T18:31:27.089 INFO:tasks.workunit.client.1.smithi131.stdout:2/197: write f4 [3262352,92102] 0 2024-02-15T18:31:27.089 INFO:tasks.workunit.client.1.smithi131.stdout:4/249: dread d2/d2a/f3c [0,4194304] 0 2024-02-15T18:31:27.089 INFO:tasks.workunit.client.1.smithi131.stdout:2/198: chown dd/d14 59994989 1 2024-02-15T18:31:27.089 INFO:tasks.workunit.client.1.smithi131.stdout:2/199: chown f4 21924470 1 2024-02-15T18:31:27.089 INFO:tasks.workunit.client.1.smithi131.stdout:4/250: fdatasync d2/f9 0 2024-02-15T18:31:27.090 INFO:tasks.workunit.client.1.smithi131.stdout:3/240: rename d2/c33 to d2/d22/d3f/c51 0 2024-02-15T18:31:27.091 INFO:tasks.workunit.client.1.smithi131.stdout:5/339: creat d18/d24/d63/f75 x:0 0 0 2024-02-15T18:31:27.091 INFO:tasks.workunit.client.1.smithi131.stdout:5/340: fsync d18/d33/f5b 0 2024-02-15T18:31:27.092 INFO:tasks.workunit.client.1.smithi131.stdout:4/251: creat d2/d7/f5c x:0 0 0 2024-02-15T18:31:27.100 INFO:tasks.workunit.client.1.smithi131.stdout:2/200: getdents dd/d14/d2b 0 2024-02-15T18:31:27.100 INFO:tasks.workunit.client.1.smithi131.stdout:2/201: chown dd/d10/d22/d2a/f2c 24 1 2024-02-15T18:31:27.100 INFO:tasks.workunit.client.1.smithi131.stdout:2/202: fsync dd/d10/d22/d2a/f2c 0 2024-02-15T18:31:27.100 INFO:tasks.workunit.client.1.smithi131.stdout:2/203: readlink dd/d1e/l21 0 2024-02-15T18:31:27.101 INFO:tasks.workunit.client.1.smithi131.stdout:4/252: dread d2/d7/ff [0,4194304] 0 2024-02-15T18:31:27.101 INFO:tasks.workunit.client.1.smithi131.stdout:4/253: readlink d2/l1e 0 2024-02-15T18:31:27.101 INFO:tasks.workunit.client.1.smithi131.stdout:4/254: write d2/f1a [1706029,118028] 0 2024-02-15T18:31:27.101 INFO:tasks.workunit.client.1.smithi131.stdout:4/255: truncate d2/f1f 818568 0 2024-02-15T18:31:27.101 INFO:tasks.workunit.client.1.smithi131.stdout:4/256: chown d2/d2a/d47/c22 28148089 1 2024-02-15T18:31:27.106 INFO:tasks.workunit.client.1.smithi131.stdout:4/257: dread d2/d2a/d47/d21/f3e [4194304,4194304] 0 2024-02-15T18:31:27.106 INFO:tasks.workunit.client.1.smithi131.stdout:5/341: truncate d18/d20/f2e 3745195 0 2024-02-15T18:31:27.107 INFO:tasks.workunit.client.1.smithi131.stdout:2/204: fdatasync dd/f29 0 2024-02-15T18:31:27.107 INFO:tasks.workunit.client.1.smithi131.stdout:2/205: readlink dd/d10/d13/l35 0 2024-02-15T18:31:27.107 INFO:tasks.workunit.client.1.smithi131.stdout:5/342: creat d18/d24/d63/f76 x:0 0 0 2024-02-15T18:31:27.109 INFO:tasks.workunit.client.1.smithi131.stdout:5/343: rename d18/d24/l39 to d18/d4e/d69/l77 0 2024-02-15T18:31:27.110 INFO:tasks.workunit.client.1.smithi131.stdout:3/241: dwrite d2/d22/d29/db/d23/d2a/f2d [0,4194304] 0 2024-02-15T18:31:27.110 INFO:tasks.workunit.client.1.smithi131.stdout:5/344: mknod d18/d24/d63/c78 0 2024-02-15T18:31:27.111 INFO:tasks.workunit.client.1.smithi131.stdout:3/242: symlink d2/d22/d24/l52 0 2024-02-15T18:31:27.111 INFO:tasks.workunit.client.1.smithi131.stdout:3/243: fsync d2/d22/d29/db/d1a/fe 0 2024-02-15T18:31:27.111 INFO:tasks.workunit.client.1.smithi131.stdout:3/244: fsync d2/d22/f2e 0 2024-02-15T18:31:27.111 INFO:tasks.workunit.client.1.smithi131.stdout:3/245: creat d2/d22/d29/db/f53 x:0 0 0 2024-02-15T18:31:27.116 INFO:tasks.workunit.client.1.smithi131.stdout:3/246: truncate d2/d22/d29/db/f1e 2403204 0 2024-02-15T18:31:27.118 INFO:tasks.workunit.client.1.smithi131.stdout:3/247: link d2/d22/d29/db/d1a/l25 d2/d22/d29/d20/l54 0 2024-02-15T18:31:27.120 INFO:tasks.workunit.client.1.smithi131.stdout:3/248: symlink d2/d22/d29/db/d23/d2a/d49/l55 0 2024-02-15T18:31:27.120 INFO:tasks.workunit.client.1.smithi131.stdout:3/249: write d2/d22/d29/f39 [4974195,25081] 0 2024-02-15T18:31:27.122 INFO:tasks.workunit.client.1.smithi131.stdout:4/258: dread d2/d2a/d47/d21/f41 [0,4194304] 0 2024-02-15T18:31:27.123 INFO:tasks.workunit.client.1.smithi131.stdout:5/345: dread d18/d20/f2f [0,4194304] 0 2024-02-15T18:31:27.124 INFO:tasks.workunit.client.1.smithi131.stdout:5/346: chown d18/d23/f3a 294 1 2024-02-15T18:31:27.125 INFO:tasks.workunit.client.1.smithi131.stdout:4/259: mkdir d2/d7/d1c/d5d 0 2024-02-15T18:31:27.125 INFO:tasks.workunit.client.1.smithi131.stdout:5/347: creat d18/d33/d73/f79 x:0 0 0 2024-02-15T18:31:27.126 INFO:tasks.workunit.client.1.smithi131.stdout:4/260: dread d2/d7/d12/f52 [0,4194304] 0 2024-02-15T18:31:27.130 INFO:tasks.workunit.client.1.smithi131.stdout:2/206: dwrite dd/d10/d22/d2a/f30 [0,4194304] 0 2024-02-15T18:31:27.137 INFO:tasks.workunit.client.1.smithi131.stdout:5/348: rmdir d18/d20 39 2024-02-15T18:31:27.139 INFO:tasks.workunit.client.1.smithi131.stdout:4/261: dread d2/d2a/f42 [0,4194304] 0 2024-02-15T18:31:27.141 INFO:tasks.workunit.client.1.smithi131.stdout:4/262: rename d2/d2a/d47/c54 to d2/d7/d12/d2e/d39/c5e 0 2024-02-15T18:31:27.142 INFO:tasks.workunit.client.1.smithi131.stdout:4/263: fdatasync d2/f4 0 2024-02-15T18:31:27.143 INFO:tasks.workunit.client.1.smithi131.stdout:4/264: truncate d2/d2a/d47/d21/f3e 1158341 0 2024-02-15T18:31:27.148 INFO:tasks.workunit.client.1.smithi131.stdout:5/349: dread d18/d23/f30 [0,4194304] 0 2024-02-15T18:31:27.148 INFO:tasks.workunit.client.1.smithi131.stdout:5/350: dread - d18/d4e/f6f zero size 2024-02-15T18:31:27.148 INFO:tasks.workunit.client.1.smithi131.stdout:5/351: fsync d18/d24/f2c 0 2024-02-15T18:31:27.153 INFO:tasks.workunit.client.1.smithi131.stdout:2/207: dwrite fa [0,4194304] 0 2024-02-15T18:31:27.154 INFO:tasks.workunit.client.1.smithi131.stdout:3/250: dwrite d2/d22/d29/db/f1e [0,4194304] 0 2024-02-15T18:31:27.154 INFO:tasks.workunit.client.1.smithi131.stdout:3/251: dread - d2/d22/d29/db/d1a/f50 zero size 2024-02-15T18:31:27.160 INFO:tasks.workunit.client.1.smithi131.stdout:3/252: link d2/d22/d29/d20/f37 d2/d22/d29/db/d23/d2a/d49/f56 0 2024-02-15T18:31:27.162 INFO:tasks.workunit.client.1.smithi131.stdout:3/253: unlink d2/d22/d29/db/d34/f4f 0 2024-02-15T18:31:27.179 INFO:tasks.workunit.client.1.smithi131.stdout:4/265: dwrite d2/d2a/d47/d21/f3a [4194304,4194304] 0 2024-02-15T18:31:27.179 INFO:tasks.workunit.client.1.smithi131.stdout:5/352: dwrite d18/d20/f35 [0,4194304] 0 2024-02-15T18:31:27.180 INFO:tasks.workunit.client.1.smithi131.stdout:4/266: write d2/d2a/d47/d21/f41 [1910438,18690] 0 2024-02-15T18:31:27.180 INFO:tasks.workunit.client.1.smithi131.stdout:2/208: dwrite dd/d1e/f26 [0,4194304] 0 2024-02-15T18:31:27.182 INFO:tasks.workunit.client.1.smithi131.stdout:5/353: creat d18/d4e/d69/f7a x:0 0 0 2024-02-15T18:31:27.184 INFO:tasks.workunit.client.1.smithi131.stdout:3/254: dwrite d2/d22/d29/d20/f21 [0,4194304] 0 2024-02-15T18:31:27.184 INFO:tasks.workunit.client.1.smithi131.stdout:4/267: mkdir d2/d7/d12/d2e/d5f 0 2024-02-15T18:31:27.186 INFO:tasks.workunit.client.1.smithi131.stdout:5/354: mkdir d18/d24/d7b 0 2024-02-15T18:31:27.191 INFO:tasks.workunit.client.1.smithi131.stdout:5/355: getdents d18/d6d 0 2024-02-15T18:31:27.192 INFO:tasks.workunit.client.1.smithi131.stdout:5/356: truncate d18/d23/f32 4177565 0 2024-02-15T18:31:27.192 INFO:tasks.workunit.client.1.smithi131.stdout:5/357: fsync d18/d24/f2c 0 2024-02-15T18:31:27.198 INFO:tasks.workunit.client.1.smithi131.stdout:5/358: rmdir d18/d33/d61 39 2024-02-15T18:31:27.198 INFO:tasks.workunit.client.1.smithi131.stdout:5/359: stat d18/d24/f4a 0 2024-02-15T18:31:27.199 INFO:tasks.workunit.client.1.smithi131.stdout:4/268: getdents d2/d7/d12/d2e 0 2024-02-15T18:31:27.202 INFO:tasks.workunit.client.1.smithi131.stdout:5/360: getdents d18/d6d/d70 0 2024-02-15T18:31:27.203 INFO:tasks.workunit.client.1.smithi131.stdout:4/269: stat d2/l58 0 2024-02-15T18:31:27.204 INFO:tasks.workunit.client.1.smithi131.stdout:4/270: write d2/d2a/d47/d16/f32 [4404375,5304] 0 2024-02-15T18:31:27.204 INFO:tasks.workunit.client.1.smithi131.stdout:4/271: chown d2/f35 18605558 1 2024-02-15T18:31:27.204 INFO:tasks.workunit.client.1.smithi131.stdout:4/272: mknod d2/d7/d12/d2e/d39/c60 0 2024-02-15T18:31:27.206 INFO:tasks.workunit.client.1.smithi131.stdout:4/273: getdents d2/d2a 0 2024-02-15T18:31:27.206 INFO:tasks.workunit.client.1.smithi131.stdout:4/274: stat d2/d7/d12/d2e/f34 0 2024-02-15T18:31:27.207 INFO:tasks.workunit.client.1.smithi131.stdout:4/275: rename d2/f9 to d2/d2a/d47/d16/d43/f61 0 2024-02-15T18:31:27.208 INFO:tasks.workunit.client.1.smithi131.stdout:4/276: symlink d2/d23/l62 0 2024-02-15T18:31:27.212 INFO:tasks.workunit.client.1.smithi131.stdout:3/255: dwrite d2/d22/d29/d20/f21 [0,4194304] 0 2024-02-15T18:31:27.213 INFO:tasks.workunit.client.1.smithi131.stdout:2/209: dwrite fa [4194304,4194304] 0 2024-02-15T18:31:27.216 INFO:tasks.workunit.client.1.smithi131.stdout:5/361: dread d18/d20/f2a [0,4194304] 0 2024-02-15T18:31:27.216 INFO:tasks.workunit.client.1.smithi131.stdout:5/362: chown d18/d20/f48 319940 1 2024-02-15T18:31:27.217 INFO:tasks.workunit.client.1.smithi131.stdout:2/210: symlink dd/d10/d22/d2f/d38/l3e 0 2024-02-15T18:31:27.220 INFO:tasks.workunit.client.1.smithi131.stdout:2/211: unlink l9 0 2024-02-15T18:31:27.223 INFO:tasks.workunit.client.1.smithi131.stdout:2/212: creat dd/d10/d22/d2f/d38/f3f x:0 0 0 2024-02-15T18:31:27.284 INFO:tasks.workunit.client.1.smithi131.stdout:5/363: dwrite d18/d24/f55 [0,4194304] 0 2024-02-15T18:31:27.286 INFO:tasks.workunit.client.1.smithi131.stdout:5/364: rename d18/d33/d61/c68 to d18/d24/c7c 0 2024-02-15T18:31:27.290 INFO:tasks.workunit.client.1.smithi131.stdout:4/277: dwrite d2/d2a/d47/d16/f32 [0,4194304] 0 2024-02-15T18:31:27.293 INFO:tasks.workunit.client.1.smithi131.stdout:4/278: creat d2/d7/d1c/f63 x:0 0 0 2024-02-15T18:31:27.294 INFO:tasks.workunit.client.1.smithi131.stdout:4/279: rmdir d2/d2a/d47/d38 0 2024-02-15T18:31:27.319 INFO:tasks.workunit.client.1.smithi131.stdout:4/280: dwrite d2/f8 [0,4194304] 0 2024-02-15T18:31:27.320 INFO:tasks.workunit.client.1.smithi131.stdout:4/281: read - d2/d7/d12/d2e/f34 zero size 2024-02-15T18:31:27.320 INFO:tasks.workunit.client.1.smithi131.stdout:4/282: fdatasync d2/d2a/f3c 0 2024-02-15T18:31:27.320 INFO:tasks.workunit.client.1.smithi131.stdout:4/283: readlink d2/d23/l62 0 2024-02-15T18:31:27.320 INFO:tasks.workunit.client.1.smithi131.stdout:4/284: read - d2/d7/f5c zero size 2024-02-15T18:31:27.338 INFO:tasks.workunit.client.1.smithi131.stdout:4/285: dwrite d2/d7/ff [0,4194304] 0 2024-02-15T18:31:27.339 INFO:tasks.workunit.client.1.smithi131.stdout:4/286: dread d2/d7/d12/f52 [0,4194304] 0 2024-02-15T18:31:27.350 INFO:tasks.workunit.client.1.smithi131.stdout:4/287: dread d2/d2a/d47/d16/d43/f61 [0,4194304] 0 2024-02-15T18:31:27.366 INFO:tasks.workunit.client.1.smithi131.stdout:4/288: dwrite d2/f5b [4194304,4194304] 0 2024-02-15T18:31:27.367 INFO:tasks.workunit.client.1.smithi131.stdout:4/289: read d2/d7/fc [1405726,124440] 0 2024-02-15T18:31:27.369 INFO:tasks.workunit.client.1.smithi131.stdout:4/290: dread d2/d7/f13 [0,4194304] 0 2024-02-15T18:31:27.369 INFO:tasks.workunit.client.1.smithi131.stdout:4/291: chown d2/d2a/d47/d16/d43/f61 449601854 1 2024-02-15T18:31:27.369 INFO:tasks.workunit.client.1.smithi131.stdout:4/292: fdatasync d2/f8 0 2024-02-15T18:31:27.370 INFO:tasks.workunit.client.1.smithi131.stdout:4/293: write d2/d2a/d47/d16/d43/f61 [167921,36917] 0 2024-02-15T18:31:27.370 INFO:tasks.workunit.client.1.smithi131.stdout:4/294: stat d2/d7/d12/d2e/d39 0 2024-02-15T18:31:27.373 INFO:tasks.workunit.client.1.smithi131.stdout:4/295: rmdir d2 39 2024-02-15T18:31:27.383 INFO:tasks.workunit.client.1.smithi131.stdout:4/296: truncate d2/d7/ff 2576544 0 2024-02-15T18:31:27.386 INFO:tasks.workunit.client.1.smithi131.stdout:4/297: creat d2/d7/d12/d2e/f64 x:0 0 0 2024-02-15T18:31:27.387 INFO:tasks.workunit.client.1.smithi131.stdout:4/298: symlink d2/d2a/d47/d16/l65 0 2024-02-15T18:31:27.388 INFO:tasks.workunit.client.1.smithi131.stdout:4/299: write d2/d7/f2c [3379186,73677] 0 2024-02-15T18:31:27.389 INFO:tasks.workunit.client.1.smithi131.stdout:4/300: rename d2/d7/l18 to d2/d2a/d47/d21/l66 0 2024-02-15T18:31:27.393 INFO:tasks.workunit.client.1.smithi131.stdout:4/301: rmdir d2/d7/d12/d2e 39 2024-02-15T18:31:27.394 INFO:tasks.workunit.client.1.smithi131.stdout:4/302: symlink d2/d7/d12/d2e/d5f/l67 0 2024-02-15T18:31:27.395 INFO:tasks.workunit.client.1.smithi131.stdout:4/303: rename d2/d2a/d47/d21/d46/d4d to d2/d2a/d68 0 2024-02-15T18:31:27.414 INFO:tasks.workunit.client.1.smithi131.stdout:4/304: dwrite d2/d2a/d47/d16/f37 [0,4194304] 0 2024-02-15T18:31:27.423 INFO:tasks.workunit.client.1.smithi131.stdout:4/305: dread d2/d7/fc [0,4194304] 0 2024-02-15T18:31:27.429 INFO:tasks.workunit.client.1.smithi131.stdout:4/306: dread d2/d7/ff [0,4194304] 0 2024-02-15T18:31:27.432 INFO:tasks.workunit.client.1.smithi131.stdout:4/307: link d2/d2a/d47/d16/f32 d2/d7/d12/d2e/d39/d4b/f69 0 2024-02-15T18:31:27.434 INFO:tasks.workunit.client.1.smithi131.stdout:4/308: link d2/d7/d12/d2e/f34 d2/d7/d12/d2e/d39/d4b/f6a 0 2024-02-15T18:31:27.435 INFO:tasks.workunit.client.1.smithi131.stdout:4/309: creat d2/d2a/d68/f6b x:0 0 0 2024-02-15T18:31:27.437 INFO:tasks.workunit.client.1.smithi131.stdout:4/310: creat d2/d2a/d47/d16/d43/f6c x:0 0 0 2024-02-15T18:31:27.438 INFO:tasks.workunit.client.1.smithi131.stdout:4/311: link d2/d2a/d47/d21/d46/c4f d2/d2a/d68/c6d 0 2024-02-15T18:31:27.440 INFO:tasks.workunit.client.1.smithi131.stdout:4/312: truncate d2/f40 6357679 0 2024-02-15T18:31:27.442 INFO:tasks.workunit.client.1.smithi131.stdout:4/313: mknod d2/d2a/d47/c6e 0 2024-02-15T18:31:27.445 INFO:tasks.workunit.client.1.smithi131.stdout:4/314: dread d2/d2a/d47/d21/f3e [0,4194304] 0 2024-02-15T18:31:27.455 INFO:tasks.workunit.client.1.smithi131.stdout:4/315: dread d2/d2a/d47/f27 [0,4194304] 0 2024-02-15T18:31:27.457 INFO:tasks.workunit.client.1.smithi131.stdout:4/316: dread d2/d2a/d47/d21/f3e [0,4194304] 0 2024-02-15T18:31:27.459 INFO:tasks.workunit.client.1.smithi131.stdout:4/317: creat d2/d2a/d47/f6f x:0 0 0 2024-02-15T18:31:27.459 INFO:tasks.workunit.client.1.smithi131.stdout:4/318: fsync d2/d7/d1c/f44 0 2024-02-15T18:31:27.461 INFO:tasks.workunit.client.1.smithi131.stdout:4/319: rename d2/d2a/d47/d21/d46 to d2/d7/d12/d2e/d5f/d70 0 2024-02-15T18:31:27.463 INFO:tasks.workunit.client.1.smithi131.stdout:4/320: creat d2/d7/d1c/d5d/f71 x:0 0 0 2024-02-15T18:31:27.464 INFO:tasks.workunit.client.1.smithi131.stdout:4/321: write d2/d7/fc [3949591,5017] 0 2024-02-15T18:31:27.464 INFO:tasks.workunit.client.1.smithi131.stdout:4/322: chown d2/l58 987544 1 2024-02-15T18:31:27.464 INFO:tasks.workunit.client.1.smithi131.stdout:4/323: read d2/f1f [69329,83477] 0 2024-02-15T18:31:27.466 INFO:tasks.workunit.client.1.smithi131.stdout:4/324: write d2/f4 [2178321,25013] 0 2024-02-15T18:31:27.471 INFO:tasks.workunit.client.1.smithi131.stdout:4/325: dread d2/f1a [0,4194304] 0 2024-02-15T18:31:27.471 INFO:tasks.workunit.client.1.smithi131.stdout:4/326: chown d2/d7/d12/d2e/d5f/d70/f56 320546 1 2024-02-15T18:31:27.472 INFO:tasks.workunit.client.1.smithi131.stdout:4/327: creat d2/d23/f72 x:0 0 0 2024-02-15T18:31:27.473 INFO:tasks.workunit.client.1.smithi131.stdout:4/328: creat d2/d7/d12/d2e/d5f/d70/f73 x:0 0 0 2024-02-15T18:31:27.511 INFO:tasks.workunit.client.1.smithi131.stdout:4/329: dwrite d2/f40 [0,4194304] 0 2024-02-15T18:31:27.514 INFO:tasks.workunit.client.1.smithi131.stdout:4/330: creat d2/d7/d1c/f74 x:0 0 0 2024-02-15T18:31:27.562 INFO:tasks.workunit.client.1.smithi131.stdout:4/331: fsync d2/d7/d12/d2e/d5f/d70/f73 0 2024-02-15T18:31:27.562 INFO:tasks.workunit.client.1.smithi131.stdout:4/332: fsync d2/d2a/d47/d21/f3e 0 2024-02-15T18:31:27.563 INFO:tasks.workunit.client.1.smithi131.stdout:4/333: write d2/d2a/d47/f19 [3257598,85944] 0 2024-02-15T18:31:27.565 INFO:tasks.workunit.client.1.smithi131.stdout:4/334: mknod d2/d7/d12/d2e/d5f/c75 0 2024-02-15T18:31:27.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/280: sync 2024-02-15T18:31:27.568 INFO:tasks.workunit.client.1.smithi131.stdout:0/226: sync 2024-02-15T18:31:27.568 INFO:tasks.workunit.client.1.smithi131.stdout:0/227: write d5/d9/d10/d3f/f47 [209507,25240] 0 2024-02-15T18:31:27.568 INFO:tasks.workunit.client.1.smithi131.stdout:6/295: sync 2024-02-15T18:31:27.568 INFO:tasks.workunit.client.1.smithi131.stdout:7/294: sync 2024-02-15T18:31:27.570 INFO:tasks.workunit.client.1.smithi131.stdout:6/296: rmdir d2/dc/d27 39 2024-02-15T18:31:27.571 INFO:tasks.workunit.client.1.smithi131.stdout:1/308: sync 2024-02-15T18:31:27.571 INFO:tasks.workunit.client.1.smithi131.stdout:9/306: sync 2024-02-15T18:31:27.571 INFO:tasks.workunit.client.1.smithi131.stdout:9/307: stat d4/dc/de/d1e/d1f/d2c/f4b 0 2024-02-15T18:31:27.571 INFO:tasks.workunit.client.1.smithi131.stdout:3/256: sync 2024-02-15T18:31:27.572 INFO:tasks.workunit.client.1.smithi131.stdout:7/295: dread d0/d17/d36/f3b [4194304,4194304] 0 2024-02-15T18:31:27.573 INFO:tasks.workunit.client.1.smithi131.stdout:6/297: mkdir d2/d7/d48/d40/d5e 0 2024-02-15T18:31:27.573 INFO:tasks.workunit.client.1.smithi131.stdout:1/309: mkdir d0/d68 0 2024-02-15T18:31:27.575 INFO:tasks.workunit.client.1.smithi131.stdout:9/308: creat d4/dc/d25/f55 x:0 0 0 2024-02-15T18:31:27.577 INFO:tasks.workunit.client.1.smithi131.stdout:3/257: unlink d2/l2f 0 2024-02-15T18:31:27.577 INFO:tasks.workunit.client.1.smithi131.stdout:7/296: creat d0/d17/d3a/f63 x:0 0 0 2024-02-15T18:31:27.577 INFO:tasks.workunit.client.1.smithi131.stdout:7/297: chown d0/d17/d3a/c58 1011 1 2024-02-15T18:31:27.577 INFO:tasks.workunit.client.1.smithi131.stdout:7/298: dread - d0/f5f zero size 2024-02-15T18:31:27.578 INFO:tasks.workunit.client.1.smithi131.stdout:6/298: creat d2/dc/f5f x:0 0 0 2024-02-15T18:31:27.579 INFO:tasks.workunit.client.1.smithi131.stdout:9/309: creat d4/dc/f56 x:0 0 0 2024-02-15T18:31:27.581 INFO:tasks.workunit.client.1.smithi131.stdout:6/299: link d2/d7/d12/c41 d2/d7/d12/c60 0 2024-02-15T18:31:27.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/310: write d4/dc/d17/d19/d32/f4a [2242945,57195] 0 2024-02-15T18:31:27.600 INFO:tasks.workunit.client.1.smithi131.stdout:9/311: mknod d4/dc/de/d1e/d1f/d2c/c57 0 2024-02-15T18:31:27.600 INFO:tasks.workunit.client.1.smithi131.stdout:9/312: chown d4/dc/de 343 1 2024-02-15T18:31:27.602 INFO:tasks.workunit.client.1.smithi131.stdout:9/313: truncate d4/dc/d17/d19/fb 796473 0 2024-02-15T18:31:27.628 INFO:tasks.workunit.client.1.smithi131.stdout:0/228: dwrite d5/d9/d10/d3f/f47 [0,4194304] 0 2024-02-15T18:31:27.630 INFO:tasks.workunit.client.1.smithi131.stdout:7/299: dwrite d0/d17/d3a/f62 [0,4194304] 0 2024-02-15T18:31:27.630 INFO:tasks.workunit.client.1.smithi131.stdout:7/300: fdatasync d0/d17/d3a/f63 0 2024-02-15T18:31:27.631 INFO:tasks.workunit.client.1.smithi131.stdout:7/301: read d0/d17/d3a/f54 [1210471,123048] 0 2024-02-15T18:31:27.631 INFO:tasks.workunit.client.1.smithi131.stdout:7/302: fsync d0/f2e 0 2024-02-15T18:31:27.631 INFO:tasks.workunit.client.1.smithi131.stdout:6/300: dwrite d2/d7/d48/f1c [0,4194304] 0 2024-02-15T18:31:27.631 INFO:tasks.workunit.client.1.smithi131.stdout:6/301: truncate d2/f51 646260 0 2024-02-15T18:31:27.632 INFO:tasks.workunit.client.1.smithi131.stdout:9/314: dwrite d4/dc/f56 [0,4194304] 0 2024-02-15T18:31:27.632 INFO:tasks.workunit.client.1.smithi131.stdout:0/229: rename f3 to d5/f4c 0 2024-02-15T18:31:27.632 INFO:tasks.workunit.client.1.smithi131.stdout:9/315: read d4/dc/d25/f43 [17765,38870] 0 2024-02-15T18:31:27.632 INFO:tasks.workunit.client.1.smithi131.stdout:3/258: dwrite d2/d22/d29/db/d1a/f11 [0,4194304] 0 2024-02-15T18:31:27.637 INFO:tasks.workunit.client.1.smithi131.stdout:6/302: mkdir d2/d7/d48/d40/d61 0 2024-02-15T18:31:27.637 INFO:tasks.workunit.client.1.smithi131.stdout:6/303: fsync d2/f23 0 2024-02-15T18:31:27.641 INFO:tasks.workunit.client.1.smithi131.stdout:6/304: dread d2/d7/d48/f49 [0,4194304] 0 2024-02-15T18:31:27.641 INFO:tasks.workunit.client.1.smithi131.stdout:9/316: link d4/dc/d25/f40 d4/dc/de/f58 0 2024-02-15T18:31:27.641 INFO:tasks.workunit.client.1.smithi131.stdout:6/305: dread - d2/f23 zero size 2024-02-15T18:31:27.641 INFO:tasks.workunit.client.1.smithi131.stdout:6/306: chown d2/dc/d1f/l35 251 1 2024-02-15T18:31:27.641 INFO:tasks.workunit.client.1.smithi131.stdout:3/259: mknod d2/d22/d29/db/d23/d2a/c57 0 2024-02-15T18:31:27.641 INFO:tasks.workunit.client.1.smithi131.stdout:3/260: truncate d2/f3c 938890 0 2024-02-15T18:31:27.645 INFO:tasks.workunit.client.1.smithi131.stdout:1/310: dwrite d0/d2/f5 [4194304,4194304] 0 2024-02-15T18:31:27.645 INFO:tasks.workunit.client.1.smithi131.stdout:7/303: dread d0/fd [0,4194304] 0 2024-02-15T18:31:27.646 INFO:tasks.workunit.client.1.smithi131.stdout:0/230: mkdir d5/d9/d4d 0 2024-02-15T18:31:27.646 INFO:tasks.workunit.client.1.smithi131.stdout:9/317: rename d4/dc/de/c3c to d4/dc/de/d1e/d1f/c59 0 2024-02-15T18:31:27.648 INFO:tasks.workunit.client.1.smithi131.stdout:3/261: creat d2/d22/d29/f58 x:0 0 0 2024-02-15T18:31:27.648 INFO:tasks.workunit.client.1.smithi131.stdout:3/262: fsync d2/d22/f2e 0 2024-02-15T18:31:27.648 INFO:tasks.workunit.client.1.smithi131.stdout:9/318: read d4/dc/f36 [2894473,65855] 0 2024-02-15T18:31:27.648 INFO:tasks.workunit.client.1.smithi131.stdout:7/304: write d0/d17/f4b [4011718,23365] 0 2024-02-15T18:31:27.650 INFO:tasks.workunit.client.1.smithi131.stdout:3/263: read d2/d22/d29/d20/f37 [424828,121729] 0 2024-02-15T18:31:27.651 INFO:tasks.workunit.client.1.smithi131.stdout:1/311: mknod d0/d2/d4/d41/d5a/d5f/c69 0 2024-02-15T18:31:27.651 INFO:tasks.workunit.client.1.smithi131.stdout:9/319: dread d4/dc/d25/f43 [0,4194304] 0 2024-02-15T18:31:27.651 INFO:tasks.workunit.client.1.smithi131.stdout:9/320: chown d4/dc/de/d1e/d1f 56111 1 2024-02-15T18:31:27.651 INFO:tasks.workunit.client.1.smithi131.stdout:9/321: stat d4/dc/de/d1e/d1f/c47 0 2024-02-15T18:31:27.661 INFO:tasks.workunit.client.1.smithi131.stdout:3/264: getdents d2/d22/d24 0 2024-02-15T18:31:27.661 INFO:tasks.workunit.client.1.smithi131.stdout:0/231: rmdir d5/d9/d11 39 2024-02-15T18:31:27.661 INFO:tasks.workunit.client.1.smithi131.stdout:7/305: mknod d0/d34/c64 0 2024-02-15T18:31:27.661 INFO:tasks.workunit.client.1.smithi131.stdout:7/306: chown d0/f5f 1 1 2024-02-15T18:31:27.672 INFO:tasks.workunit.client.1.smithi131.stdout:6/307: rmdir d2/d7 39 2024-02-15T18:31:27.680 INFO:tasks.workunit.client.1.smithi131.stdout:1/312: dwrite d0/d2/d7/f1e [0,4194304] 0 2024-02-15T18:31:27.681 INFO:tasks.workunit.client.1.smithi131.stdout:1/313: read - d0/d2/d4/d5d/f67 zero size 2024-02-15T18:31:27.681 INFO:tasks.workunit.client.1.smithi131.stdout:1/314: chown d0/d1/d24/f2d 2 1 2024-02-15T18:31:27.684 INFO:tasks.workunit.client.1.smithi131.stdout:1/315: rename d0/d2/d4/da/f3b to d0/d2/d31/d3d/f6a 0 2024-02-15T18:31:27.684 INFO:tasks.workunit.client.1.smithi131.stdout:1/316: fsync d0/d2/d7/f53 0 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:25.528621+0000 mgr.smithi131.buibla (mgr.24387) 42 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 34 MiB/s wr, 108 op/s 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:26.557606+0000 mon.smithi033 (mon.0) 626 : cluster [DBG] Standby manager daemon smithi033.apxevf restarted 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:26.557758+0000 mon.smithi033 (mon.0) 627 : cluster [DBG] Standby manager daemon smithi033.apxevf started 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.560188+0000 mon.smithi033 (mon.0) 628 : audit [DBG] from='mgr.? 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.apxevf/crt"}]: dispatch 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.560839+0000 mon.smithi033 (mon.0) 629 : audit [DBG] from='mgr.? 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.563229+0000 mon.smithi033 (mon.0) 630 : audit [DBG] from='mgr.? 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.apxevf/key"}]: dispatch 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.564053+0000 mon.smithi033 (mon.0) 631 : audit [DBG] from='mgr.? 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.917257+0000 mon.smithi033 (mon.0) 632 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.918721+0000 mon.smithi131 (mon.1) 49 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.919413+0000 mon.smithi131 (mon.1) 50 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.923182+0000 mon.smithi033 (mon.0) 633 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.928773+0000 mon.smithi131 (mon.1) 51 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:27.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.933423+0000 mon.smithi131 (mon.1) 52 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr fail", "who": "smithi131.buibla"}]: dispatch 2024-02-15T18:31:27.686 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.933910+0000 mon.smithi033 (mon.0) 634 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr fail", "who": "smithi131.buibla"}]: dispatch 2024-02-15T18:31:27.686 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:26.938436+0000 mon.smithi033 (mon.0) 635 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-02-15T18:31:27.686 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.939351+0000 mon.smithi131 (mon.1) 53 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:31:27.686 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.939912+0000 mon.smithi033 (mon.0) 636 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:31:27.686 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.941608+0000 mon.smithi131 (mon.1) 54 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:31:27.686 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:26.941952+0000 mon.smithi033 (mon.0) 637 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:31:27.688 INFO:tasks.workunit.client.1.smithi131.stdout:1/317: mkdir d0/d1/d16/d6b 0 2024-02-15T18:31:27.690 INFO:tasks.workunit.client.1.smithi131.stdout:1/318: creat d0/d1/d44/f6c x:0 0 0 2024-02-15T18:31:27.690 INFO:tasks.workunit.client.1.smithi131.stdout:1/319: chown d0/d2/d4/da/c33 3 1 2024-02-15T18:31:27.690 INFO:tasks.workunit.client.1.smithi131.stdout:1/320: chown d0/d1 14125310 1 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:25.528621+0000 mgr.smithi131.buibla (mgr.24387) 42 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 34 MiB/s wr, 108 op/s 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:26.557606+0000 mon.smithi033 (mon.0) 626 : cluster [DBG] Standby manager daemon smithi033.apxevf restarted 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:26.557758+0000 mon.smithi033 (mon.0) 627 : cluster [DBG] Standby manager daemon smithi033.apxevf started 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.560188+0000 mon.smithi033 (mon.0) 628 : audit [DBG] from='mgr.? 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.apxevf/crt"}]: dispatch 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.560839+0000 mon.smithi033 (mon.0) 629 : audit [DBG] from='mgr.? 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.563229+0000 mon.smithi033 (mon.0) 630 : audit [DBG] from='mgr.? 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.apxevf/key"}]: dispatch 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.564053+0000 mon.smithi033 (mon.0) 631 : audit [DBG] from='mgr.? 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.917257+0000 mon.smithi033 (mon.0) 632 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.918721+0000 mon.smithi131 (mon.1) 49 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:27.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.919413+0000 mon.smithi131 (mon.1) 50 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:27.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.923182+0000 mon.smithi033 (mon.0) 633 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' 2024-02-15T18:31:27.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.928773+0000 mon.smithi131 (mon.1) 51 : audit [DBG] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:27.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.933423+0000 mon.smithi131 (mon.1) 52 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr fail", "who": "smithi131.buibla"}]: dispatch 2024-02-15T18:31:27.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.933910+0000 mon.smithi033 (mon.0) 634 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix": "mgr fail", "who": "smithi131.buibla"}]: dispatch 2024-02-15T18:31:27.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:26.938436+0000 mon.smithi033 (mon.0) 635 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-02-15T18:31:27.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.939351+0000 mon.smithi131 (mon.1) 53 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:31:27.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.939912+0000 mon.smithi033 (mon.0) 636 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:31:27.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.941608+0000 mon.smithi131 (mon.1) 54 : audit [INF] from='mgr.24387 172.21.15.131:0/3661309452' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:31:27.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:26.941952+0000 mon.smithi033 (mon.0) 637 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:31:27.700 INFO:tasks.workunit.client.1.smithi131.stdout:3/265: dwrite d2/d22/d29/db/f1d [0,4194304] 0 2024-02-15T18:31:27.704 INFO:tasks.workunit.client.1.smithi131.stdout:1/321: getdents d0/d2/d4/d41/d5a/d5f 0 2024-02-15T18:31:27.706 INFO:tasks.workunit.client.1.smithi131.stdout:7/307: dwrite d0/d17/d3a/f62 [0,4194304] 0 2024-02-15T18:31:27.708 INFO:tasks.workunit.client.1.smithi131.stdout:6/308: dwrite d2/dc/f22 [0,4194304] 0 2024-02-15T18:31:27.711 INFO:tasks.workunit.client.1.smithi131.stdout:1/322: rename d0/f22 to d0/d1/d44/d59/f6d 0 2024-02-15T18:31:27.711 INFO:tasks.workunit.client.1.smithi131.stdout:3/266: creat d2/f59 x:0 0 0 2024-02-15T18:31:27.711 INFO:tasks.workunit.client.1.smithi131.stdout:7/308: creat d0/f65 x:0 0 0 2024-02-15T18:31:27.711 INFO:tasks.workunit.client.1.smithi131.stdout:3/267: dread - d2/d22/d29/f58 zero size 2024-02-15T18:31:27.716 INFO:tasks.workunit.client.1.smithi131.stdout:3/268: symlink d2/d22/d3a/l5a 0 2024-02-15T18:31:27.716 INFO:tasks.workunit.client.1.smithi131.stdout:1/323: mknod d0/d1/d44/d59/d42/c6e 0 2024-02-15T18:31:27.716 INFO:tasks.workunit.client.1.smithi131.stdout:7/309: dread d0/f14 [0,4194304] 0 2024-02-15T18:31:27.719 INFO:tasks.workunit.client.1.smithi131.stdout:3/269: rename d2/d22/d4b to d2/d22/d29/db/d23/d2a/d5b 0 2024-02-15T18:31:27.719 INFO:tasks.workunit.client.1.smithi131.stdout:3/270: dread - d2/d22/d42/f45 zero size 2024-02-15T18:31:27.719 INFO:tasks.workunit.client.1.smithi131.stdout:3/271: write d2/d22/f2e [1085301,75592] 0 2024-02-15T18:31:27.719 INFO:tasks.workunit.client.1.smithi131.stdout:3/272: fdatasync d2/f26 0 2024-02-15T18:31:27.724 INFO:tasks.workunit.client.1.smithi131.stdout:1/324: link d0/d2/d7/f34 d0/d2/d4/d41/f6f 0 2024-02-15T18:31:27.724 INFO:tasks.workunit.client.1.smithi131.stdout:1/325: dread - d0/d2/d4/d5d/f67 zero size 2024-02-15T18:31:27.726 INFO:tasks.workunit.client.1.smithi131.stdout:7/310: rmdir d0/d17/d3a/d3d 39 2024-02-15T18:31:27.726 INFO:tasks.workunit.client.1.smithi131.stdout:7/311: write d0/d17/d3a/f54 [5722202,16576] 0 2024-02-15T18:31:27.727 INFO:tasks.workunit.client.1.smithi131.stdout:3/273: link d2/d22/d3f/c51 d2/d22/d29/db/d23/d2a/d49/c5c 0 2024-02-15T18:31:27.727 INFO:tasks.workunit.client.1.smithi131.stdout:3/274: chown d2/d22/d29/f4a 124264 1 2024-02-15T18:31:27.727 INFO:tasks.workunit.client.1.smithi131.stdout:3/275: getdents d2/d22/d24 0 2024-02-15T18:31:27.735 INFO:tasks.workunit.client.1.smithi131.stdout:6/309: dwrite d2/d7/d48/f49 [0,4194304] 0 2024-02-15T18:31:27.736 INFO:tasks.workunit.client.1.smithi131.stdout:6/310: dread - d2/dc/d27/f55 zero size 2024-02-15T18:31:27.736 INFO:tasks.workunit.client.1.smithi131.stdout:6/311: write d2/d7/d16/f43 [394033,117946] 0 2024-02-15T18:31:27.736 INFO:tasks.workunit.client.1.smithi131.stdout:6/312: readlink d2/dc/d27/l29 0 2024-02-15T18:31:27.753 INFO:tasks.workunit.client.1.smithi131.stdout:7/312: dwrite d0/d17/d3a/f63 [0,4194304] 0 2024-02-15T18:31:27.753 INFO:tasks.workunit.client.1.smithi131.stdout:7/313: write d0/f65 [723398,99585] 0 2024-02-15T18:31:27.753 INFO:tasks.workunit.client.1.smithi131.stdout:7/314: readlink d0/d17/d3a/l3e 0 2024-02-15T18:31:27.753 INFO:tasks.workunit.client.1.smithi131.stdout:1/326: dwrite d0/d2/f2b [0,4194304] 0 2024-02-15T18:31:27.753 INFO:tasks.workunit.client.1.smithi131.stdout:1/327: chown d0/d1/d16/f43 3 1 2024-02-15T18:31:27.756 INFO:tasks.workunit.client.1.smithi131.stdout:1/328: creat d0/d1/d44/f70 x:0 0 0 2024-02-15T18:31:27.757 INFO:tasks.workunit.client.1.smithi131.stdout:7/315: dread d0/d34/f35 [0,4194304] 0 2024-02-15T18:31:27.757 INFO:tasks.workunit.client.1.smithi131.stdout:7/316: fsync d0/f47 0 2024-02-15T18:31:27.758 INFO:tasks.workunit.client.1.smithi131.stdout:1/329: mknod d0/d2/d7/c71 0 2024-02-15T18:31:27.759 INFO:tasks.workunit.client.1.smithi131.stdout:7/317: write d0/d17/f21 [4018181,40721] 0 2024-02-15T18:31:27.759 INFO:tasks.workunit.client.1.smithi131.stdout:7/318: mknod d0/c66 0 2024-02-15T18:31:27.760 INFO:tasks.workunit.client.1.smithi131.stdout:7/319: creat d0/d34/f67 x:0 0 0 2024-02-15T18:31:27.760 INFO:tasks.workunit.client.1.smithi131.stdout:7/320: dread - d0/d17/d3a/d3d/f53 zero size 2024-02-15T18:31:27.761 INFO:tasks.workunit.client.1.smithi131.stdout:7/321: creat d0/d17/f68 x:0 0 0 2024-02-15T18:31:27.761 INFO:tasks.workunit.client.1.smithi131.stdout:7/322: chown d0/c12 3209 1 2024-02-15T18:31:27.763 INFO:tasks.workunit.client.1.smithi131.stdout:7/323: mknod d0/c69 0 2024-02-15T18:31:27.764 INFO:tasks.workunit.client.1.smithi131.stdout:7/324: dread d0/f16 [0,4194304] 0 2024-02-15T18:31:27.765 INFO:tasks.workunit.client.1.smithi131.stdout:3/276: dwrite d2/d22/d29/f17 [0,4194304] 0 2024-02-15T18:31:27.768 INFO:tasks.workunit.client.1.smithi131.stdout:3/277: truncate d2/d22/f35 149477 0 2024-02-15T18:31:27.783 INFO:tasks.workunit.client.1.smithi131.stdout:1/330: dread d0/d1/d24/f2f [0,4194304] 0 2024-02-15T18:31:27.789 INFO:tasks.workunit.client.1.smithi131.stdout:1/331: dread d0/d2/d4/da/f5e [0,4194304] 0 2024-02-15T18:31:27.796 INFO:tasks.workunit.client.1.smithi131.stdout:3/278: dwrite d2/d22/d29/db/f53 [0,4194304] 0 2024-02-15T18:31:27.807 INFO:tasks.workunit.client.1.smithi131.stdout:3/279: rmdir d2/d22/d42 39 2024-02-15T18:31:27.807 INFO:tasks.workunit.client.1.smithi131.stdout:1/332: dread d0/d1/d44/d59/f45 [0,4194304] 0 2024-02-15T18:31:27.808 INFO:tasks.workunit.client.1.smithi131.stdout:7/325: dwrite d0/fd [0,4194304] 0 2024-02-15T18:31:27.813 INFO:tasks.workunit.client.1.smithi131.stdout:7/326: symlink d0/d17/l6a 0 2024-02-15T18:31:27.814 INFO:tasks.workunit.client.1.smithi131.stdout:7/327: chown d0/c2a 0 1 2024-02-15T18:31:27.831 INFO:tasks.workunit.client.1.smithi131.stdout:7/328: dread d0/f65 [0,4194304] 0 2024-02-15T18:31:27.832 INFO:tasks.workunit.client.1.smithi131.stdout:7/329: creat d0/d17/d36/f6b x:0 0 0 2024-02-15T18:31:27.834 INFO:tasks.workunit.client.1.smithi131.stdout:7/330: creat d0/d17/f6c x:0 0 0 2024-02-15T18:31:27.834 INFO:tasks.workunit.client.1.smithi131.stdout:3/280: dwrite d2/d22/d29/db/d1a/fe [0,4194304] 0 2024-02-15T18:31:27.835 INFO:tasks.workunit.client.1.smithi131.stdout:7/331: unlink d0/c69 0 2024-02-15T18:31:27.835 INFO:tasks.workunit.client.1.smithi131.stdout:7/332: truncate d0/d17/f3c 80170 0 2024-02-15T18:31:27.835 INFO:tasks.workunit.client.1.smithi131.stdout:7/333: fsync d0/f47 0 2024-02-15T18:31:27.836 INFO:tasks.workunit.client.1.smithi131.stdout:7/334: chown d0/d17/d3a/d3d/f53 1 1 2024-02-15T18:31:27.836 INFO:tasks.workunit.client.1.smithi131.stdout:7/335: symlink d0/l6d 0 2024-02-15T18:31:27.838 INFO:tasks.workunit.client.1.smithi131.stdout:3/281: write d2/d22/d29/f39 [1923157,66754] 0 2024-02-15T18:31:27.839 INFO:tasks.workunit.client.1.smithi131.stdout:1/333: dwrite d0/d2/d7/f40 [0,4194304] 0 2024-02-15T18:31:27.842 INFO:tasks.workunit.client.1.smithi131.stdout:3/282: unlink d2/d22/c47 0 2024-02-15T18:31:27.842 INFO:tasks.workunit.client.1.smithi131.stdout:1/334: mkdir d0/d2/d7/d72 0 2024-02-15T18:31:27.844 INFO:tasks.workunit.client.1.smithi131.stdout:3/283: link d2/d22/d29/db/d1a/l25 d2/d22/d29/db/d34/l5d 0 2024-02-15T18:31:27.845 INFO:tasks.workunit.client.1.smithi131.stdout:3/284: truncate d2/d22/f2e 1096461 0 2024-02-15T18:31:27.848 INFO:tasks.workunit.client.1.smithi131.stdout:3/285: mkdir d2/d22/d5e 0 2024-02-15T18:31:27.855 INFO:tasks.workunit.client.1.smithi131.stdout:7/336: dread d0/f47 [0,4194304] 0 2024-02-15T18:31:27.856 INFO:tasks.workunit.client.1.smithi131.stdout:7/337: chown d0/c12 1516263 1 2024-02-15T18:31:27.856 INFO:tasks.workunit.client.1.smithi131.stdout:7/338: chown d0/c25 0 1 2024-02-15T18:31:27.859 INFO:tasks.workunit.client.1.smithi131.stdout:7/339: truncate d0/d17/d36/f4c 3928330 0 2024-02-15T18:31:27.863 INFO:tasks.workunit.client.1.smithi131.stdout:7/340: unlink d0/c66 0 2024-02-15T18:31:27.864 INFO:tasks.workunit.client.1.smithi131.stdout:3/286: dread d2/d22/d29/db/f53 [0,4194304] 0 2024-02-15T18:31:27.864 INFO:tasks.workunit.client.1.smithi131.stdout:7/341: mknod d0/d17/c6e 0 2024-02-15T18:31:27.866 INFO:tasks.workunit.client.1.smithi131.stdout:1/335: dwrite d0/d1/d16/d19/f1b [4194304,4194304] 0 2024-02-15T18:31:27.871 INFO:tasks.workunit.client.1.smithi131.stdout:3/287: mknod d2/d22/d3f/c5f 0 2024-02-15T18:31:27.871 INFO:tasks.workunit.client.1.smithi131.stdout:7/342: rename d0/d17/d3a/c58 to d0/d17/d36/c6f 0 2024-02-15T18:31:27.893 INFO:tasks.workunit.client.1.smithi131.stdout:3/288: dwrite d2/f3c [0,4194304] 0 2024-02-15T18:31:27.899 INFO:tasks.workunit.client.1.smithi131.stdout:3/289: symlink d2/d22/d3f/l60 0 2024-02-15T18:31:27.899 INFO:tasks.workunit.client.1.smithi131.stdout:3/290: fdatasync d2/d22/d29/d20/f37 0 2024-02-15T18:31:27.899 INFO:tasks.workunit.client.1.smithi131.stdout:3/291: chown d2/d22/d29/db/f1e 773 1 2024-02-15T18:31:27.901 INFO:tasks.workunit.client.1.smithi131.stdout:3/292: symlink d2/d22/d29/db/d23/d2a/l61 0 2024-02-15T18:31:27.902 INFO:tasks.workunit.client.1.smithi131.stdout:3/293: mknod d2/d22/c62 0 2024-02-15T18:31:27.903 INFO:tasks.workunit.client.1.smithi131.stdout:3/294: getdents d2/d22/d29/db/d23 0 2024-02-15T18:31:27.903 INFO:tasks.workunit.client.1.smithi131.stdout:3/295: fsync d2/d22/d29/db/f3e 0 2024-02-15T18:31:27.905 INFO:tasks.workunit.client.1.smithi131.stdout:3/296: creat d2/d22/f63 x:0 0 0 2024-02-15T18:31:27.906 INFO:tasks.workunit.client.1.smithi131.stdout:3/297: link d2/d22/d29/db/d23/f41 d2/d22/d24/f64 0 2024-02-15T18:31:27.909 INFO:tasks.workunit.client.1.smithi131.stdout:7/343: dwrite d0/d17/d3a/d3d/f56 [0,4194304] 0 2024-02-15T18:31:27.910 INFO:tasks.workunit.client.1.smithi131.stdout:3/298: write d2/d22/d29/db/d1a/f11 [149175,26122] 0 2024-02-15T18:31:27.910 INFO:tasks.workunit.client.1.smithi131.stdout:3/299: chown d2/d22/d29/db/d23/d2a/d49/l55 2 1 2024-02-15T18:31:27.910 INFO:tasks.workunit.client.1.smithi131.stdout:3/300: dread - d2/d22/f63 zero size 2024-02-15T18:31:27.913 INFO:tasks.workunit.client.1.smithi131.stdout:3/301: creat d2/d22/d29/d20/f65 x:0 0 0 2024-02-15T18:31:27.920 INFO:tasks.workunit.client.1.smithi131.stdout:3/302: creat d2/d22/d29/db/d23/d2a/d49/f66 x:0 0 0 2024-02-15T18:31:27.920 INFO:tasks.workunit.client.1.smithi131.stdout:3/303: fdatasync d2/d22/d29/d20/f21 0 2024-02-15T18:31:27.934 INFO:tasks.workunit.client.1.smithi131.stdout:7/344: dwrite d0/f47 [0,4194304] 0 2024-02-15T18:31:27.934 INFO:tasks.workunit.client.1.smithi131.stdout:7/345: chown d0/d17/d36 94 1 2024-02-15T18:31:27.936 INFO:tasks.workunit.client.1.smithi131.stdout:7/346: creat d0/f70 x:0 0 0 2024-02-15T18:31:27.937 INFO:tasks.workunit.client.1.smithi131.stdout:3/304: dread d2/d22/d29/f39 [0,4194304] 0 2024-02-15T18:31:27.937 INFO:tasks.workunit.client.1.smithi131.stdout:3/305: chown d2/d22/d24/l52 33068712 1 2024-02-15T18:31:27.937 INFO:tasks.workunit.client.1.smithi131.stdout:3/306: write d2/d22/d29/f58 [114859,34752] 0 2024-02-15T18:31:27.938 INFO:tasks.workunit.client.1.smithi131.stdout:3/307: chown d2/d22/d29/c2c 11563836 1 2024-02-15T18:31:27.938 INFO:tasks.workunit.client.1.smithi131.stdout:3/308: dread - d2/f59 zero size 2024-02-15T18:31:27.938 INFO:tasks.workunit.client.1.smithi131.stdout:3/309: fsync d2/d22/d29/db/d34/f3b 0 2024-02-15T18:31:27.938 INFO:tasks.workunit.client.1.smithi131.stdout:3/310: chown d2/d22/d42 3219 1 2024-02-15T18:31:27.938 INFO:tasks.workunit.client.1.smithi131.stdout:7/347: creat d0/f71 x:0 0 0 2024-02-15T18:31:27.941 INFO:tasks.workunit.client.1.smithi131.stdout:7/348: rename d0/f2e to d0/d17/d36/f72 0 2024-02-15T18:31:27.942 INFO:tasks.workunit.client.1.smithi131.stdout:3/311: dread d2/d22/f2e [0,4194304] 0 2024-02-15T18:31:27.946 INFO:tasks.workunit.client.1.smithi131.stdout:7/349: creat d0/d17/d3a/d3d/f73 x:0 0 0 2024-02-15T18:31:27.946 INFO:tasks.workunit.client.1.smithi131.stdout:3/312: rename d2/d22/d29/db/d23/d2a/c40 to d2/d22/d29/db/d34/c67 0 2024-02-15T18:31:27.950 INFO:tasks.workunit.client.1.smithi131.stdout:7/350: creat d0/d34/f74 x:0 0 0 2024-02-15T18:31:27.952 INFO:tasks.workunit.client.1.smithi131.stdout:7/351: unlink d0/d17/c33 0 2024-02-15T18:31:27.953 INFO:tasks.workunit.client.1.smithi131.stdout:7/352: creat d0/d17/d36/f75 x:0 0 0 2024-02-15T18:31:27.956 INFO:tasks.workunit.client.1.smithi131.stdout:3/313: getdents d2/d22 0 2024-02-15T18:31:27.969 INFO:tasks.workunit.client.1.smithi131.stdout:7/353: getdents d0/d17/d3a/d3d 0 2024-02-15T18:31:27.969 INFO:tasks.workunit.client.1.smithi131.stdout:7/354: read - d0/f57 zero size 2024-02-15T18:31:27.976 INFO:tasks.workunit.client.1.smithi131.stdout:7/355: symlink d0/d17/d3a/l76 0 2024-02-15T18:31:27.976 INFO:tasks.workunit.client.1.smithi131.stdout:7/356: chown d0/d17/d3a/d3d/f42 559074 1 2024-02-15T18:31:27.976 INFO:tasks.workunit.client.1.smithi131.stdout:7/357: mknod d0/d17/d3a/c77 0 2024-02-15T18:31:27.990 INFO:tasks.workunit.client.1.smithi131.stdout:7/358: rename d0/d17/c60 to d0/d17/c78 0 2024-02-15T18:31:27.990 INFO:tasks.workunit.client.1.smithi131.stdout:7/359: stat d0/f57 0 2024-02-15T18:31:27.990 INFO:tasks.workunit.client.1.smithi131.stdout:7/360: stat d0/d34/c64 0 2024-02-15T18:31:27.990 INFO:tasks.workunit.client.1.smithi131.stdout:7/361: chown d0/d17/d36/f48 1731 1 2024-02-15T18:31:27.996 INFO:tasks.workunit.client.1.smithi131.stdout:7/362: mkdir d0/d17/d3a/d3d/d79 0 2024-02-15T18:31:27.996 INFO:tasks.workunit.client.1.smithi131.stdout:7/363: fdatasync d0/f15 0 2024-02-15T18:31:27.998 INFO:tasks.workunit.client.1.smithi131.stdout:3/314: truncate d2/d22/d29/db/d1a/fe 966782 0 2024-02-15T18:31:27.998 INFO:tasks.workunit.client.1.smithi131.stdout:3/315: truncate d2/d22/d29/d20/f37 5211290 0 2024-02-15T18:31:28.000 INFO:tasks.workunit.client.1.smithi131.stdout:3/316: creat d2/d22/d29/db/d1a/f68 x:0 0 0 2024-02-15T18:31:28.001 INFO:tasks.workunit.client.1.smithi131.stdout:3/317: link d2/d22/d29/db/d34/l5d d2/d22/d3f/l69 0 2024-02-15T18:31:28.003 INFO:tasks.workunit.client.1.smithi131.stdout:3/318: getdents d2/d22/d29/d20 0 2024-02-15T18:31:28.008 INFO:tasks.workunit.client.1.smithi131.stdout:3/319: mknod d2/d22/d5e/c6a 0 2024-02-15T18:31:28.011 INFO:tasks.workunit.client.1.smithi131.stdout:3/320: rmdir d2/d22/d29/db/d23/d2a 39 2024-02-15T18:31:28.011 INFO:tasks.workunit.client.1.smithi131.stdout:3/321: fdatasync d2/d22/d29/f17 0 2024-02-15T18:31:28.011 INFO:tasks.workunit.client.1.smithi131.stdout:3/322: truncate d2/d22/d29/db/d23/d2a/d49/f66 280792 0 2024-02-15T18:31:28.013 INFO:tasks.workunit.client.1.smithi131.stdout:3/323: getdents d2 0 2024-02-15T18:31:28.013 INFO:tasks.workunit.client.1.smithi131.stdout:3/324: chown d2/d22/d3f 182601882 1 2024-02-15T18:31:28.013 INFO:tasks.workunit.client.1.smithi131.stdout:3/325: truncate d2/d22/d29/db/d1a/f68 774427 0 2024-02-15T18:31:28.017 INFO:tasks.workunit.client.1.smithi131.stdout:7/364: dread d0/f43 [0,4194304] 0 2024-02-15T18:31:28.020 INFO:tasks.workunit.client.1.smithi131.stdout:7/365: write d0/fd [3576377,93513] 0 2024-02-15T18:31:28.020 INFO:tasks.workunit.client.1.smithi131.stdout:7/366: write d0/fd [4520326,97309] 0 2024-02-15T18:31:28.038 INFO:tasks.workunit.client.1.smithi131.stdout:3/326: dwrite d2/f26 [0,4194304] 0 2024-02-15T18:31:28.039 INFO:tasks.workunit.client.1.smithi131.stdout:3/327: dread - d2/d22/d29/db/d34/f3b zero size 2024-02-15T18:31:28.039 INFO:tasks.workunit.client.1.smithi131.stdout:3/328: chown d2/d22/d5e 55 1 2024-02-15T18:31:28.039 INFO:tasks.workunit.client.1.smithi131.stdout:3/329: write d2/d22/d29/db/d1a/fe [1910912,18634] 0 2024-02-15T18:31:28.040 INFO:tasks.workunit.client.1.smithi131.stdout:3/330: link d2/d22/d29/db/d1a/f68 d2/d22/d29/db/d1a/f6b 0 2024-02-15T18:31:28.044 INFO:tasks.workunit.client.1.smithi131.stdout:7/367: dwrite d0/d34/f74 [0,4194304] 0 2024-02-15T18:31:28.045 INFO:tasks.workunit.client.1.smithi131.stdout:7/368: readlink d0/l2f 0 2024-02-15T18:31:28.047 INFO:tasks.workunit.client.1.smithi131.stdout:7/369: rmdir d0/d17/d36 39 2024-02-15T18:31:28.049 INFO:tasks.workunit.client.1.smithi131.stdout:7/370: link d0/f65 d0/d17/d3a/d3d/f7a 0 2024-02-15T18:31:28.053 INFO:tasks.workunit.client.1.smithi131.stdout:3/331: write d2/d22/d29/f17 [644480,21256] 0 2024-02-15T18:31:28.053 INFO:tasks.workunit.client.1.smithi131.stdout:3/332: write d2/d22/d29/db/f3e [961651,42426] 0 2024-02-15T18:31:28.053 INFO:tasks.workunit.client.1.smithi131.stdout:3/333: fsync d2/d22/d29/db/d23/d2a/f2d 0 2024-02-15T18:31:28.053 INFO:tasks.workunit.client.1.smithi131.stdout:3/334: chown d2/d22/d29/c2c 83653 1 2024-02-15T18:31:28.054 INFO:tasks.workunit.client.1.smithi131.stdout:3/335: rename d2/d22/d24 to d2/d22/d3a/d6c 0 2024-02-15T18:31:28.054 INFO:tasks.workunit.client.1.smithi131.stdout:3/336: getdents d2 0 2024-02-15T18:31:28.057 INFO:tasks.workunit.client.1.smithi131.stdout:3/337: link d2/d22/d29/db/d23/d2a/d49/f56 d2/d22/d29/d20/f6d 0 2024-02-15T18:31:28.059 INFO:tasks.workunit.client.1.smithi131.stdout:3/338: rename d2/d22/d29/c9 to d2/c6e 0 2024-02-15T18:31:28.061 INFO:tasks.workunit.client.1.smithi131.stdout:3/339: dread d2/d22/d29/db/d23/d2a/d49/f66 [0,4194304] 0 2024-02-15T18:31:28.064 INFO:tasks.workunit.client.1.smithi131.stdout:3/340: unlink d2/d22/d29/d20/f65 0 2024-02-15T18:31:28.064 INFO:tasks.workunit.client.1.smithi131.stdout:3/341: write d2/d22/d29/db/d1a/f6b [794834,15634] 0 2024-02-15T18:31:28.064 INFO:tasks.workunit.client.1.smithi131.stdout:3/342: chown d2/d22/d29/db/d1a/f68 4878 1 2024-02-15T18:31:28.064 INFO:tasks.workunit.client.1.smithi131.stdout:3/343: stat d2/d22/d29/db/d1a 0 2024-02-15T18:31:28.066 INFO:tasks.workunit.client.1.smithi131.stdout:7/371: rmdir d0/d17 39 2024-02-15T18:31:28.067 INFO:tasks.workunit.client.1.smithi131.stdout:3/344: mknod d2/d22/d29/db/d23/d2a/d49/c6f 0 2024-02-15T18:31:28.067 INFO:tasks.workunit.client.1.smithi131.stdout:3/345: write d2/d22/d3a/d6c/f64 [5749812,115017] 0 2024-02-15T18:31:28.068 INFO:tasks.workunit.client.1.smithi131.stdout:7/372: rename d0/d34/l49 to d0/d17/d3a/d3d/d79/l7b 0 2024-02-15T18:31:28.068 INFO:tasks.workunit.client.1.smithi131.stdout:7/373: truncate d0/d17/d36/f6b 507629 0 2024-02-15T18:31:28.070 INFO:tasks.workunit.client.1.smithi131.stdout:3/346: mkdir d2/d22/d3a/d6c/d70 0 2024-02-15T18:31:28.071 INFO:tasks.workunit.client.1.smithi131.stdout:3/347: stat d2/d22/d3f 0 2024-02-15T18:31:28.073 INFO:tasks.workunit.client.1.smithi131.stdout:3/348: creat d2/d22/d29/db/d23/d2a/d5b/f71 x:0 0 0 2024-02-15T18:31:28.073 INFO:tasks.workunit.client.1.smithi131.stdout:3/349: chown d2/d22/d29/d20/c46 2343572 1 2024-02-15T18:31:28.075 INFO:tasks.workunit.client.1.smithi131.stdout:3/350: creat d2/d22/f72 x:0 0 0 2024-02-15T18:31:28.090 INFO:tasks.workunit.client.1.smithi131.stdout:7/374: dwrite d0/f47 [0,4194304] 0 2024-02-15T18:31:28.095 INFO:tasks.workunit.client.1.smithi131.stdout:7/375: creat d0/f7c x:0 0 0 2024-02-15T18:31:28.095 INFO:tasks.workunit.client.1.smithi131.stdout:7/376: chown d0/d17/d36/f50 10197067 1 2024-02-15T18:31:28.105 INFO:tasks.workunit.client.1.smithi131.stdout:7/377: dread d0/d17/d3a/f62 [0,4194304] 0 2024-02-15T18:31:28.105 INFO:tasks.workunit.client.1.smithi131.stdout:7/378: write d0/fb [2007934,38340] 0 2024-02-15T18:31:28.107 INFO:tasks.workunit.client.1.smithi131.stdout:7/379: mknod d0/d34/c7d 0 2024-02-15T18:31:28.109 INFO:tasks.workunit.client.1.smithi131.stdout:7/380: link d0/d17/f23 d0/d34/f7e 0 2024-02-15T18:31:28.109 INFO:tasks.workunit.client.1.smithi131.stdout:7/381: fdatasync d0/f43 0 2024-02-15T18:31:28.109 INFO:tasks.workunit.client.1.smithi131.stdout:7/382: write d0/d17/d3a/d3d/f53 [293664,33225] 0 2024-02-15T18:31:28.109 INFO:tasks.workunit.client.1.smithi131.stdout:7/383: fdatasync d0/d17/d36/f6b 0 2024-02-15T18:31:28.109 INFO:tasks.workunit.client.1.smithi131.stdout:7/384: rename d0 to d0/d17/d3a/d3d/d79/d7f 22 2024-02-15T18:31:28.110 INFO:tasks.workunit.client.1.smithi131.stdout:7/385: fdatasync d0/d17/d36/f75 0 2024-02-15T18:31:28.110 INFO:tasks.workunit.client.1.smithi131.stdout:7/386: readlink d0/d17/l2c 0 2024-02-15T18:31:28.110 INFO:tasks.workunit.client.1.smithi131.stdout:7/387: chown d0/l4f 155648 1 2024-02-15T18:31:28.112 INFO:tasks.workunit.client.1.smithi131.stdout:2/213: sync 2024-02-15T18:31:28.119 INFO:tasks.workunit.client.1.smithi131.stdout:3/351: dwrite d2/d22/d29/d20/f6d [4194304,4194304] 0 2024-02-15T18:31:28.124 INFO:tasks.workunit.client.1.smithi131.stdout:3/352: creat d2/d22/d3a/f73 x:0 0 0 2024-02-15T18:31:28.132 INFO:tasks.workunit.client.1.smithi131.stdout:2/214: dread fa [0,4194304] 0 2024-02-15T18:31:28.134 INFO:tasks.workunit.client.1.smithi131.stdout:3/353: mknod d2/d22/d29/db/d23/d2a/d49/c74 0 2024-02-15T18:31:28.145 INFO:tasks.workunit.client.1.smithi131.stdout:3/354: dread d2/d22/d29/db/f1e [0,4194304] 0 2024-02-15T18:31:28.148 INFO:tasks.workunit.client.1.smithi131.stdout:3/355: rmdir d2/d22/d3a/d6c 39 2024-02-15T18:31:28.148 INFO:tasks.workunit.client.1.smithi131.stdout:2/215: creat dd/d10/d22/d2f/f40 x:0 0 0 2024-02-15T18:31:28.149 INFO:tasks.workunit.client.1.smithi131.stdout:3/356: write d2/d22/d29/d20/f6d [8377286,118217] 0 2024-02-15T18:31:28.150 INFO:tasks.workunit.client.1.smithi131.stdout:7/388: dwrite d0/d34/f41 [0,4194304] 0 2024-02-15T18:31:28.155 INFO:tasks.workunit.client.1.smithi131.stdout:3/357: creat d2/d22/d29/f75 x:0 0 0 2024-02-15T18:31:28.155 INFO:tasks.workunit.client.1.smithi131.stdout:7/389: mknod d0/c80 0 2024-02-15T18:31:28.161 INFO:tasks.workunit.client.1.smithi131.stdout:7/390: getdents d0/d17/d36 0 2024-02-15T18:31:28.162 INFO:tasks.workunit.client.1.smithi131.stdout:7/391: truncate d0/d17/d36/f4c 3005599 0 2024-02-15T18:31:28.162 INFO:tasks.workunit.client.1.smithi131.stdout:7/392: write d0/d17/d3a/d3d/f53 [963195,64042] 0 2024-02-15T18:31:28.163 INFO:tasks.workunit.client.1.smithi131.stdout:7/393: write d0/d17/d3a/d3d/f42 [8110013,54087] 0 2024-02-15T18:31:28.166 INFO:tasks.workunit.client.1.smithi131.stdout:3/358: dread d2/f3c [0,4194304] 0 2024-02-15T18:31:28.168 INFO:tasks.workunit.client.1.smithi131.stdout:7/394: truncate d0/d17/d36/f72 1346458 0 2024-02-15T18:31:28.168 INFO:tasks.workunit.client.1.smithi131.stdout:7/395: stat d0/d17/d3a/f62 0 2024-02-15T18:31:28.169 INFO:tasks.workunit.client.1.smithi131.stdout:3/359: stat d2/d22/d3f/c51 0 2024-02-15T18:31:28.169 INFO:tasks.workunit.client.1.smithi131.stdout:3/360: write d2/d22/d29/db/d1a/f50 [504405,38026] 0 2024-02-15T18:31:28.172 INFO:tasks.workunit.client.1.smithi131.stdout:3/361: rename d2/d22/d29/d20/f21 to d2/d22/d29/db/f76 0 2024-02-15T18:31:28.172 INFO:tasks.workunit.client.1.smithi131.stdout:3/362: dread - d2/d22/d3a/f73 zero size 2024-02-15T18:31:28.176 INFO:tasks.workunit.client.1.smithi131.stdout:2/216: dwrite dd/d10/f19 [0,4194304] 0 2024-02-15T18:31:28.184 INFO:tasks.workunit.client.1.smithi131.stdout:2/217: link fc dd/d14/d2b/f41 0 2024-02-15T18:31:28.186 INFO:tasks.workunit.client.1.smithi131.stdout:2/218: mknod dd/d14/d1f/c42 0 2024-02-15T18:31:28.187 INFO:tasks.workunit.client.1.smithi131.stdout:7/396: dread d0/d17/d3a/d3d/f56 [0,4194304] 0 2024-02-15T18:31:28.188 INFO:tasks.workunit.client.1.smithi131.stdout:2/219: truncate fa 1123282 0 2024-02-15T18:31:28.191 INFO:tasks.workunit.client.1.smithi131.stdout:2/220: write dd/d1e/f26 [1870287,66406] 0 2024-02-15T18:31:28.192 INFO:tasks.workunit.client.1.smithi131.stdout:2/221: symlink dd/d14/d2b/l43 0 2024-02-15T18:31:28.193 INFO:tasks.workunit.client.1.smithi131.stdout:7/397: creat d0/d17/d36/f81 x:0 0 0 2024-02-15T18:31:28.193 INFO:tasks.workunit.client.1.smithi131.stdout:7/398: readlink d0/l6d 0 2024-02-15T18:31:28.193 INFO:tasks.workunit.client.1.smithi131.stdout:7/399: dread - d0/d34/f67 zero size 2024-02-15T18:31:28.199 INFO:tasks.workunit.client.1.smithi131.stdout:7/400: unlink d0/d17/d3a/f59 0 2024-02-15T18:31:28.207 INFO:tasks.workunit.client.1.smithi131.stdout:7/401: dread d0/d17/d3a/d3d/f42 [4194304,4194304] 0 2024-02-15T18:31:28.207 INFO:tasks.workunit.client.1.smithi131.stdout:3/363: truncate d2/d22/d29/d20/f6d 6201344 0 2024-02-15T18:31:28.209 INFO:tasks.workunit.client.1.smithi131.stdout:3/364: unlink d2/d22/d29/d20/l36 0 2024-02-15T18:31:28.221 INFO:tasks.workunit.client.1.smithi131.stdout:2/222: dwrite dd/d1e/f39 [0,4194304] 0 2024-02-15T18:31:28.222 INFO:tasks.workunit.client.1.smithi131.stdout:7/402: write d0/f14 [3020835,22431] 0 2024-02-15T18:31:28.223 INFO:tasks.workunit.client.1.smithi131.stdout:7/403: dread - d0/d17/d36/f3f zero size 2024-02-15T18:31:28.223 INFO:tasks.workunit.client.1.smithi131.stdout:7/404: stat d0/fd 0 2024-02-15T18:31:28.223 INFO:tasks.workunit.client.1.smithi131.stdout:7/405: write d0/d17/d3a/d3d/f53 [1427464,67353] 0 2024-02-15T18:31:28.226 INFO:tasks.workunit.client.1.smithi131.stdout:2/223: symlink dd/d10/d22/d2f/d38/l44 0 2024-02-15T18:31:28.231 INFO:tasks.workunit.client.1.smithi131.stdout:2/224: rmdir dd/d14/d2b/d3c 0 2024-02-15T18:31:28.232 INFO:tasks.workunit.client.1.smithi131.stdout:2/225: creat dd/d10/d22/d2f/d38/f45 x:0 0 0 2024-02-15T18:31:28.235 INFO:tasks.workunit.client.1.smithi131.stdout:2/226: mkdir dd/d14/d46 0 2024-02-15T18:31:28.235 INFO:tasks.workunit.client.1.smithi131.stdout:4/335: sync 2024-02-15T18:31:28.235 INFO:tasks.workunit.client.1.smithi131.stdout:5/365: sync 2024-02-15T18:31:28.235 INFO:tasks.workunit.client.1.smithi131.stdout:5/366: dread - d18/d24/d63/f72 zero size 2024-02-15T18:31:28.241 INFO:tasks.workunit.client.1.smithi131.stdout:4/336: unlink d2/d2a/d47/d16/l33 0 2024-02-15T18:31:28.241 INFO:tasks.workunit.client.1.smithi131.stdout:5/367: stat l3 0 2024-02-15T18:31:28.241 INFO:tasks.workunit.client.1.smithi131.stdout:1/336: sync 2024-02-15T18:31:28.241 INFO:tasks.workunit.client.1.smithi131.stdout:1/337: chown d0/d1/d16/d30 1773639 1 2024-02-15T18:31:28.245 INFO:tasks.workunit.client.1.smithi131.stdout:1/338: symlink d0/d2/d31/d3d/d46/l73 0 2024-02-15T18:31:28.245 INFO:tasks.workunit.client.1.smithi131.stdout:4/337: mkdir d2/d2a/d76 0 2024-02-15T18:31:28.250 INFO:tasks.workunit.client.1.smithi131.stdout:3/365: dread d2/d22/d29/db/d23/d2a/d49/f56 [0,4194304] 0 2024-02-15T18:31:28.251 INFO:tasks.workunit.client.1.smithi131.stdout:1/339: symlink d0/d2/d4/l74 0 2024-02-15T18:31:28.251 INFO:tasks.workunit.client.1.smithi131.stdout:1/340: fsync d0/d1/d44/d59/f45 0 2024-02-15T18:31:28.251 INFO:tasks.workunit.client.1.smithi131.stdout:1/341: chown d0/d2/d4/da/f2a 42473 1 2024-02-15T18:31:28.257 INFO:tasks.workunit.client.1.smithi131.stdout:6/313: sync 2024-02-15T18:31:28.257 INFO:tasks.workunit.client.1.smithi131.stdout:8/281: sync 2024-02-15T18:31:28.257 INFO:tasks.workunit.client.1.smithi131.stdout:8/282: chown lc 2524 1 2024-02-15T18:31:28.257 INFO:tasks.workunit.client.1.smithi131.stdout:9/322: sync 2024-02-15T18:31:28.257 INFO:tasks.workunit.client.1.smithi131.stdout:1/342: symlink d0/d1/d16/d19/l75 0 2024-02-15T18:31:28.258 INFO:tasks.workunit.client.1.smithi131.stdout:0/232: sync 2024-02-15T18:31:28.259 INFO:tasks.workunit.client.1.smithi131.stdout:8/283: symlink d22/d26/l5b 0 2024-02-15T18:31:28.259 INFO:tasks.workunit.client.1.smithi131.stdout:9/323: creat d4/dc/d17/d19/f5a x:0 0 0 2024-02-15T18:31:28.262 INFO:tasks.workunit.client.1.smithi131.stdout:3/366: symlink d2/d22/d29/db/d23/l77 0 2024-02-15T18:31:28.265 INFO:tasks.workunit.client.1.smithi131.stdout:9/324: getdents d4/dc/d17 0 2024-02-15T18:31:28.265 INFO:tasks.workunit.client.1.smithi131.stdout:8/284: rename d22/l36 to d22/d26/d3f/d47/l5c 0 2024-02-15T18:31:28.272 INFO:tasks.workunit.client.1.smithi131.stdout:7/406: dwrite d0/d17/d3a/d3d/f53 [0,4194304] 0 2024-02-15T18:31:28.272 INFO:tasks.workunit.client.1.smithi131.stdout:9/325: truncate d4/dc/f2d 754728 0 2024-02-15T18:31:28.272 INFO:tasks.workunit.client.1.smithi131.stdout:9/326: fsync d4/dc/f56 0 2024-02-15T18:31:28.272 INFO:tasks.workunit.client.1.smithi131.stdout:9/327: fsync d4/dc/d25/f40 0 2024-02-15T18:31:28.274 INFO:tasks.workunit.client.1.smithi131.stdout:5/368: dwrite d18/d4e/d69/f7a [0,4194304] 0 2024-02-15T18:31:28.274 INFO:tasks.workunit.client.1.smithi131.stdout:0/233: dread d5/d2f/f23 [0,4194304] 0 2024-02-15T18:31:28.276 INFO:tasks.workunit.client.1.smithi131.stdout:8/285: write f17 [2147010,43880] 0 2024-02-15T18:31:28.276 INFO:tasks.workunit.client.1.smithi131.stdout:8/286: dread - d22/d26/f4e zero size 2024-02-15T18:31:28.276 INFO:tasks.workunit.client.1.smithi131.stdout:3/367: rename d2/d22/d29/db/d34/l5d to d2/d22/d29/db/d23/d2a/l78 0 2024-02-15T18:31:28.285 INFO:tasks.workunit.client.1.smithi131.stdout:7/407: getdents d0 0 2024-02-15T18:31:28.286 INFO:tasks.workunit.client.1.smithi131.stdout:7/408: dread - d0/d34/f67 zero size 2024-02-15T18:31:28.288 INFO:tasks.workunit.client.1.smithi131.stdout:0/234: write d5/d9/d10/f1e [16484,31441] 0 2024-02-15T18:31:28.289 INFO:tasks.workunit.client.1.smithi131.stdout:8/287: creat d22/d41/f5d x:0 0 0 2024-02-15T18:31:28.290 INFO:tasks.workunit.client.1.smithi131.stdout:2/227: dwrite dd/d10/f19 [4194304,4194304] 0 2024-02-15T18:31:28.290 INFO:tasks.workunit.client.1.smithi131.stdout:8/288: write d22/d2e/f38 [838148,57695] 0 2024-02-15T18:31:28.290 INFO:tasks.workunit.client.1.smithi131.stdout:8/289: chown d22/d26/l45 61 1 2024-02-15T18:31:28.290 INFO:tasks.workunit.client.1.smithi131.stdout:8/290: write d22/f42 [601905,91635] 0 2024-02-15T18:31:28.293 INFO:tasks.workunit.client.1.smithi131.stdout:9/328: rename d4/dc/d25/d4d to d4/dc/d17/d19/d41/d5b 0 2024-02-15T18:31:28.294 INFO:tasks.workunit.client.1.smithi131.stdout:7/409: creat d0/d17/f82 x:0 0 0 2024-02-15T18:31:28.294 INFO:tasks.workunit.client.1.smithi131.stdout:7/410: readlink d0/d17/d3a/l3e 0 2024-02-15T18:31:28.294 INFO:tasks.workunit.client.1.smithi131.stdout:7/411: chown d0/c2 121860 1 2024-02-15T18:31:28.294 INFO:tasks.workunit.client.1.smithi131.stdout:3/368: unlink d2/f26 0 2024-02-15T18:31:28.294 INFO:tasks.workunit.client.1.smithi131.stdout:3/369: write d2/d22/d29/db/d23/d2a/d49/f66 [28841,100258] 0 2024-02-15T18:31:28.294 INFO:tasks.workunit.client.1.smithi131.stdout:3/370: truncate d2/d22/d42/f45 730372 0 2024-02-15T18:31:28.302 INFO:tasks.workunit.client.1.smithi131.stdout:2/228: truncate dd/f29 4159670 0 2024-02-15T18:31:28.305 INFO:tasks.workunit.client.1.smithi131.stdout:9/329: rename d4/dc/d25/f43 to d4/dc/d25/d3f/f5c 0 2024-02-15T18:31:28.305 INFO:tasks.workunit.client.1.smithi131.stdout:2/229: symlink dd/d10/d13/l47 0 2024-02-15T18:31:28.307 INFO:tasks.workunit.client.1.smithi131.stdout:5/369: rename d18/d24/c62 to d18/c7d 0 2024-02-15T18:31:28.308 INFO:tasks.workunit.client.1.smithi131.stdout:9/330: read d4/dc/d17/f3d [1839538,27906] 0 2024-02-15T18:31:28.308 INFO:tasks.workunit.client.1.smithi131.stdout:2/230: truncate dd/d1e/f26 2635663 0 2024-02-15T18:31:28.311 INFO:tasks.workunit.client.1.smithi131.stdout:0/235: rename d5/c24 to d5/d15/d1f/c4e 0 2024-02-15T18:31:28.311 INFO:tasks.workunit.client.1.smithi131.stdout:0/236: write d5/d9/d11/d3e/f48 [878818,22811] 0 2024-02-15T18:31:28.319 INFO:tasks.workunit.client.1.smithi131.stdout:5/370: read d18/d24/f26 [2323463,88373] 0 2024-02-15T18:31:28.319 INFO:tasks.workunit.client.1.smithi131.stdout:7/412: dread d0/d17/d3a/f63 [0,4194304] 0 2024-02-15T18:31:28.324 INFO:tasks.workunit.client.1.smithi131.stdout:1/343: dwrite d0/d2/f12 [4194304,4194304] 0 2024-02-15T18:31:28.326 INFO:tasks.workunit.client.1.smithi131.stdout:2/231: unlink dd/d10/d22/l27 0 2024-02-15T18:31:28.326 INFO:tasks.workunit.client.1.smithi131.stdout:2/232: readlink dd/d14/d2b/l43 0 2024-02-15T18:31:28.328 INFO:tasks.workunit.client.1.smithi131.stdout:7/413: mknod d0/d17/d36/c83 0 2024-02-15T18:31:28.332 INFO:tasks.workunit.client.1.smithi131.stdout:7/414: truncate d0/d17/d3a/d3d/f42 6544228 0 2024-02-15T18:31:28.332 INFO:tasks.workunit.client.1.smithi131.stdout:5/371: creat d18/d24/d63/f7e x:0 0 0 2024-02-15T18:31:28.332 INFO:tasks.workunit.client.1.smithi131.stdout:1/344: symlink d0/d1/d44/l76 0 2024-02-15T18:31:28.332 INFO:tasks.workunit.client.1.smithi131.stdout:6/314: dwrite d2/dc/f22 [4194304,4194304] 0 2024-02-15T18:31:28.332 INFO:tasks.workunit.client.1.smithi131.stdout:6/315: getdents d2/d7/d48/d40/d61 0 2024-02-15T18:31:28.333 INFO:tasks.workunit.client.1.smithi131.stdout:8/291: dwrite d22/d26/f2d [0,4194304] 0 2024-02-15T18:31:28.335 INFO:tasks.workunit.client.1.smithi131.stdout:5/372: symlink d18/d4e/l7f 0 2024-02-15T18:31:28.335 INFO:tasks.workunit.client.1.smithi131.stdout:5/373: chown d18/d20/f2a 202818 1 2024-02-15T18:31:28.335 INFO:tasks.workunit.client.1.smithi131.stdout:5/374: chown d18/d4e/l7f 175436662 1 2024-02-15T18:31:28.335 INFO:tasks.workunit.client.1.smithi131.stdout:1/345: mknod d0/d1/d44/d59/c77 0 2024-02-15T18:31:28.338 INFO:tasks.workunit.client.1.smithi131.stdout:4/338: dwrite d2/d7/ff [0,4194304] 0 2024-02-15T18:31:28.338 INFO:tasks.workunit.client.1.smithi131.stdout:4/339: fsync d2/d2a/f3c 0 2024-02-15T18:31:28.338 INFO:tasks.workunit.client.1.smithi131.stdout:4/340: chown d2/d2a/d47/cb 7 1 2024-02-15T18:31:28.343 INFO:tasks.workunit.client.1.smithi131.stdout:2/233: dread dd/f11 [0,4194304] 0 2024-02-15T18:31:28.343 INFO:tasks.workunit.client.1.smithi131.stdout:2/234: chown dd/d1e 32562040 1 2024-02-15T18:31:28.346 INFO:tasks.workunit.client.1.smithi131.stdout:6/316: rename d2/d7/d48/d40/d5e to d2/dc/d27/d62 0 2024-02-15T18:31:28.347 INFO:tasks.workunit.client.1.smithi131.stdout:1/346: mkdir d0/d2/d7/d72/d78 0 2024-02-15T18:31:28.348 INFO:tasks.workunit.client.1.smithi131.stdout:2/235: mkdir dd/d10/d22/d2a/d48 0 2024-02-15T18:31:28.349 INFO:tasks.workunit.client.1.smithi131.stdout:8/292: dread d22/f3e [0,4194304] 0 2024-02-15T18:31:28.349 INFO:tasks.workunit.client.1.smithi131.stdout:6/317: rmdir d2/d7/d48/d40 39 2024-02-15T18:31:28.351 INFO:tasks.workunit.client.1.smithi131.stdout:1/347: rename d0/d2/d4/l17 to d0/d2/d4/d41/d5a/l79 0 2024-02-15T18:31:28.351 INFO:tasks.workunit.client.1.smithi131.stdout:2/236: creat dd/d10/d22/d2a/f49 x:0 0 0 2024-02-15T18:31:28.352 INFO:tasks.workunit.client.1.smithi131.stdout:9/331: dwrite d4/dc/d17/d19/d41/f4c [0,4194304] 0 2024-02-15T18:31:28.354 INFO:tasks.workunit.client.1.smithi131.stdout:4/341: write d2/d2a/d47/d21/f3a [2704450,106227] 0 2024-02-15T18:31:28.354 INFO:tasks.workunit.client.1.smithi131.stdout:8/293: mkdir d22/d2e/d5e 0 2024-02-15T18:31:28.354 INFO:tasks.workunit.client.1.smithi131.stdout:2/237: write dd/f18 [34140,8364] 0 2024-02-15T18:31:28.354 INFO:tasks.workunit.client.1.smithi131.stdout:7/415: dread d0/d17/d36/f4c [0,4194304] 0 2024-02-15T18:31:28.354 INFO:tasks.workunit.client.1.smithi131.stdout:7/416: dread - d0/d17/d36/f81 zero size 2024-02-15T18:31:28.356 INFO:tasks.workunit.client.1.smithi131.stdout:6/318: getdents d2/d7/d12 0 2024-02-15T18:31:28.359 INFO:tasks.workunit.client.1.smithi131.stdout:1/348: rename d0/d2/d7/f34 to d0/d2/d4/d41/d5a/f7a 0 2024-02-15T18:31:28.363 INFO:tasks.workunit.client.1.smithi131.stdout:4/342: creat d2/f77 x:0 0 0 2024-02-15T18:31:28.365 INFO:tasks.workunit.client.1.smithi131.stdout:0/237: dwrite d5/d9/d11/f31 [0,4194304] 0 2024-02-15T18:31:28.366 INFO:tasks.workunit.client.1.smithi131.stdout:8/294: mkdir d22/d26/d3f/d47/d48/d5f 0 2024-02-15T18:31:28.366 INFO:tasks.workunit.client.1.smithi131.stdout:8/295: chown d22/f32 154613893 1 2024-02-15T18:31:28.368 INFO:tasks.workunit.client.1.smithi131.stdout:1/349: link d0/d1/d16/l3e d0/d2/l7b 0 2024-02-15T18:31:28.368 INFO:tasks.workunit.client.1.smithi131.stdout:1/350: chown d0/d2/d4/d5d 6062361 1 2024-02-15T18:31:28.371 INFO:tasks.workunit.client.1.smithi131.stdout:7/417: link d0/f47 d0/d17/d3a/d3d/f84 0 2024-02-15T18:31:28.371 INFO:tasks.workunit.client.1.smithi131.stdout:7/418: fsync d0/d17/d36/f3b 0 2024-02-15T18:31:28.374 INFO:tasks.workunit.client.1.smithi131.stdout:2/238: mkdir dd/d10/d13/d2e/d4a 0 2024-02-15T18:31:28.380 INFO:tasks.workunit.client.1.smithi131.stdout:0/238: truncate d5/f4c 114114 0 2024-02-15T18:31:28.380 INFO:tasks.workunit.client.1.smithi131.stdout:0/239: readlink d5/d9/le 0 2024-02-15T18:31:28.381 INFO:tasks.workunit.client.1.smithi131.stdout:0/240: chown d5/d9/d10/f1e 58 1 2024-02-15T18:31:28.381 INFO:tasks.workunit.client.1.smithi131.stdout:0/241: stat d5/d2f/f23 0 2024-02-15T18:31:28.381 INFO:tasks.workunit.client.1.smithi131.stdout:8/296: mkdir d22/d2e/d60 0 2024-02-15T18:31:28.382 INFO:tasks.workunit.client.1.smithi131.stdout:8/297: mknod d22/d2e/c61 0 2024-02-15T18:31:28.382 INFO:tasks.workunit.client.1.smithi131.stdout:7/419: getdents d0/d17/d3a 0 2024-02-15T18:31:28.392 INFO:tasks.workunit.client.1.smithi131.stdout:5/375: getdents d18/d24/d63 0 2024-02-15T18:31:28.392 INFO:tasks.workunit.client.1.smithi131.stdout:5/376: fdatasync d18/d33/d73/f79 0 2024-02-15T18:31:28.393 INFO:tasks.workunit.client.1.smithi131.stdout:5/377: fdatasync d18/d20/f2e 0 2024-02-15T18:31:28.393 INFO:tasks.workunit.client.1.smithi131.stdout:8/298: symlink d22/d2e/l62 0 2024-02-15T18:31:28.393 INFO:tasks.workunit.client.1.smithi131.stdout:7/420: creat d0/d17/d36/f85 x:0 0 0 2024-02-15T18:31:28.395 INFO:tasks.workunit.client.1.smithi131.stdout:0/242: dread d5/fd [0,4194304] 0 2024-02-15T18:31:28.395 INFO:tasks.workunit.client.1.smithi131.stdout:0/243: chown d5/d9/d11/d3e 54259898 1 2024-02-15T18:31:28.399 INFO:tasks.workunit.client.1.smithi131.stdout:2/239: dwrite fc [0,4194304] 0 2024-02-15T18:31:28.401 INFO:tasks.workunit.client.1.smithi131.stdout:7/421: write d0/d34/f41 [982661,27561] 0 2024-02-15T18:31:28.401 INFO:tasks.workunit.client.1.smithi131.stdout:7/422: read - d0/d17/d3a/d3d/f73 zero size 2024-02-15T18:31:28.401 INFO:tasks.workunit.client.1.smithi131.stdout:7/423: fsync d0/f43 0 2024-02-15T18:31:28.401 INFO:tasks.workunit.client.1.smithi131.stdout:6/319: dwrite d2/d7/d16/f43 [0,4194304] 0 2024-02-15T18:31:28.402 INFO:tasks.workunit.client.1.smithi131.stdout:6/320: read - d2/d7/f39 zero size 2024-02-15T18:31:28.402 INFO:tasks.workunit.client.1.smithi131.stdout:5/378: truncate d18/d23/f30 593774 0 2024-02-15T18:31:28.402 INFO:tasks.workunit.client.1.smithi131.stdout:1/351: dwrite d0/d2/d4/d41/f6f [4194304,4194304] 0 2024-02-15T18:31:28.403 INFO:tasks.workunit.client.1.smithi131.stdout:4/343: write d2/d2a/f3c [3747880,73740] 0 2024-02-15T18:31:28.406 INFO:tasks.workunit.client.1.smithi131.stdout:9/332: dwrite d4/dc/f2d [0,4194304] 0 2024-02-15T18:31:28.407 INFO:tasks.workunit.client.1.smithi131.stdout:0/244: unlink d5/d15/d1f/c32 0 2024-02-15T18:31:28.408 INFO:tasks.workunit.client.1.smithi131.stdout:2/240: getdents dd/d10/d22/d2f 0 2024-02-15T18:31:28.408 INFO:tasks.workunit.client.1.smithi131.stdout:2/241: chown dd/d10/d13/c3b 2 1 2024-02-15T18:31:28.412 INFO:tasks.workunit.client.1.smithi131.stdout:2/242: read dd/d10/d13/f1a [179391,80325] 0 2024-02-15T18:31:28.413 INFO:tasks.workunit.client.1.smithi131.stdout:7/424: link d0/d17/d3a/d3d/d79/l7b d0/l86 0 2024-02-15T18:31:28.413 INFO:tasks.workunit.client.1.smithi131.stdout:7/425: chown d0/d17/d36/f4c 116 1 2024-02-15T18:31:28.417 INFO:tasks.workunit.client.1.smithi131.stdout:6/321: rename d2/f51 to d2/dc/d1f/f63 0 2024-02-15T18:31:28.417 INFO:tasks.workunit.client.1.smithi131.stdout:5/379: mknod d18/d6d/d70/c80 0 2024-02-15T18:31:28.421 INFO:tasks.workunit.client.1.smithi131.stdout:5/380: read fb [4201040,57978] 0 2024-02-15T18:31:28.422 INFO:tasks.workunit.client.1.smithi131.stdout:5/381: chown d18/d4e/d69/f7a 0 1 2024-02-15T18:31:28.422 INFO:tasks.workunit.client.1.smithi131.stdout:5/382: write d18/d24/f38 [1222721,16770] 0 2024-02-15T18:31:28.422 INFO:tasks.workunit.client.1.smithi131.stdout:5/383: getdents d18/d24/d7b 0 2024-02-15T18:31:28.422 INFO:tasks.workunit.client.1.smithi131.stdout:5/384: chown d18/d33 86506 1 2024-02-15T18:31:28.422 INFO:tasks.workunit.client.1.smithi131.stdout:8/299: dwrite d22/d26/d3f/d47/f4a [0,4194304] 0 2024-02-15T18:31:28.422 INFO:tasks.workunit.client.1.smithi131.stdout:1/352: creat d0/d2/db/f7c x:0 0 0 2024-02-15T18:31:28.426 INFO:tasks.workunit.client.1.smithi131.stdout:9/333: unlink d4/dc/de/d1e/d1f/d2c/c54 0 2024-02-15T18:31:28.426 INFO:tasks.workunit.client.1.smithi131.stdout:9/334: fsync d4/dc/d17/d19/fb 0 2024-02-15T18:31:28.434 INFO:tasks.workunit.client.1.smithi131.stdout:0/245: symlink d5/d9/d10/l4f 0 2024-02-15T18:31:28.441 INFO:tasks.workunit.client.1.smithi131.stdout:6/322: link d2/f42 d2/dc/f64 0 2024-02-15T18:31:28.448 INFO:tasks.workunit.client.1.smithi131.stdout:0/246: creat d5/d2f/d45/f50 x:0 0 0 2024-02-15T18:31:28.448 INFO:tasks.workunit.client.1.smithi131.stdout:0/247: dread - d5/d9/f3d zero size 2024-02-15T18:31:28.448 INFO:tasks.workunit.client.1.smithi131.stdout:0/248: write d5/d15/d1f/f46 [542791,86215] 0 2024-02-15T18:31:28.448 INFO:tasks.workunit.client.1.smithi131.stdout:9/335: mkdir d4/dc/de/d1e/d1f/d51/d5d 0 2024-02-15T18:31:28.448 INFO:tasks.workunit.client.1.smithi131.stdout:4/344: rmdir d2/d2a/d47/d16/d2d 0 2024-02-15T18:31:28.448 INFO:tasks.workunit.client.1.smithi131.stdout:4/345: chown d2/d2a/d47/d21/l66 11 1 2024-02-15T18:31:28.450 INFO:tasks.workunit.client.1.smithi131.stdout:8/300: creat d22/d2e/f63 x:0 0 0 2024-02-15T18:31:28.450 INFO:tasks.workunit.client.1.smithi131.stdout:0/249: rename d5/d9/d10/f28 to d5/d2f/d45/f51 0 2024-02-15T18:31:28.452 INFO:tasks.workunit.client.1.smithi131.stdout:4/346: rmdir d2/d7/d12/d2e/d5f/d70 39 2024-02-15T18:31:28.452 INFO:tasks.workunit.client.1.smithi131.stdout:9/336: mknod d4/dc/de/d1e/d1f/c5e 0 2024-02-15T18:31:28.456 INFO:tasks.workunit.client.1.smithi131.stdout:0/250: creat d5/d9/d10/d3f/f52 x:0 0 0 2024-02-15T18:31:28.456 INFO:tasks.workunit.client.1.smithi131.stdout:0/251: write d5/f4c [926574,72060] 0 2024-02-15T18:31:28.458 INFO:tasks.workunit.client.1.smithi131.stdout:4/347: stat d2/d2a/d47/d21/l66 0 2024-02-15T18:31:28.458 INFO:tasks.workunit.client.1.smithi131.stdout:4/348: chown d2/d2a/d47/l4a 12276 1 2024-02-15T18:31:28.458 INFO:tasks.workunit.client.1.smithi131.stdout:4/349: write d2/f77 [966555,98218] 0 2024-02-15T18:31:28.458 INFO:tasks.workunit.client.1.smithi131.stdout:9/337: read d4/dc/d25/d4e/d38/f44 [567607,58572] 0 2024-02-15T18:31:28.459 INFO:tasks.workunit.client.1.smithi131.stdout:0/252: rmdir d5/d2f 39 2024-02-15T18:31:28.461 INFO:tasks.workunit.client.1.smithi131.stdout:4/350: mknod d2/d7/d12/d2e/d5f/c78 0 2024-02-15T18:31:28.472 INFO:tasks.workunit.client.1.smithi131.stdout:9/338: creat d4/dc/d17/d19/f5f x:0 0 0 2024-02-15T18:31:28.472 INFO:tasks.workunit.client.1.smithi131.stdout:9/339: chown d4/dc/d17/d19/d32/f4a 4789 1 2024-02-15T18:31:28.473 INFO:tasks.workunit.client.1.smithi131.stdout:0/253: creat d5/d9/d10/f53 x:0 0 0 2024-02-15T18:31:28.474 INFO:tasks.workunit.client.1.smithi131.stdout:4/351: stat d2/d2a/d47/c22 0 2024-02-15T18:31:28.477 INFO:tasks.workunit.client.1.smithi131.stdout:9/340: write f0 [402953,83943] 0 2024-02-15T18:31:28.477 INFO:tasks.workunit.client.1.smithi131.stdout:9/341: write d4/dc/d25/d4e/d38/f50 [913678,30251] 0 2024-02-15T18:31:28.477 INFO:tasks.workunit.client.1.smithi131.stdout:4/352: creat d2/d7/d12/f79 x:0 0 0 2024-02-15T18:31:28.477 INFO:tasks.workunit.client.1.smithi131.stdout:4/353: readlink d2/l1e 0 2024-02-15T18:31:28.478 INFO:tasks.workunit.client.1.smithi131.stdout:1/353: dwrite d0/f27 [8388608,4194304] 0 2024-02-15T18:31:28.480 INFO:tasks.workunit.client.1.smithi131.stdout:2/243: dwrite dd/f18 [0,4194304] 0 2024-02-15T18:31:28.480 INFO:tasks.workunit.client.1.smithi131.stdout:4/354: mkdir d2/d7/d1c/d5d/d7a 0 2024-02-15T18:31:28.480 INFO:tasks.workunit.client.1.smithi131.stdout:4/355: fdatasync d2/d2a/d47/f19 0 2024-02-15T18:31:28.480 INFO:tasks.workunit.client.1.smithi131.stdout:0/254: symlink d5/d9/l54 0 2024-02-15T18:31:28.480 INFO:tasks.workunit.client.1.smithi131.stdout:0/255: readlink d5/d15/d1f/l41 0 2024-02-15T18:31:28.480 INFO:tasks.workunit.client.1.smithi131.stdout:0/256: truncate d5/d9/d10/d3f/f52 613263 0 2024-02-15T18:31:28.483 INFO:tasks.workunit.client.1.smithi131.stdout:2/244: read dd/d1e/f26 [1180427,11738] 0 2024-02-15T18:31:28.485 INFO:tasks.workunit.client.1.smithi131.stdout:4/356: creat d2/d7/d1c/d5d/f7b x:0 0 0 2024-02-15T18:31:28.486 INFO:tasks.workunit.client.1.smithi131.stdout:0/257: unlink d5/d15/c18 0 2024-02-15T18:31:28.486 INFO:tasks.workunit.client.1.smithi131.stdout:5/385: dwrite d18/d4e/f64 [0,4194304] 0 2024-02-15T18:31:28.492 INFO:tasks.workunit.client.1.smithi131.stdout:2/245: symlink dd/d10/l4b 0 2024-02-15T18:31:28.492 INFO:tasks.workunit.client.1.smithi131.stdout:4/357: symlink d2/d2a/d47/d16/l7c 0 2024-02-15T18:31:28.492 INFO:tasks.workunit.client.1.smithi131.stdout:4/358: truncate d2/d23/f72 4977 0 2024-02-15T18:31:28.498 INFO:tasks.workunit.client.1.smithi131.stdout:5/386: creat d18/d6d/d70/f81 x:0 0 0 2024-02-15T18:31:28.498 INFO:tasks.workunit.client.1.smithi131.stdout:5/387: readlink d18/d24/l47 0 2024-02-15T18:31:28.498 INFO:tasks.workunit.client.1.smithi131.stdout:5/388: truncate d18/d4e/f6f 916833 0 2024-02-15T18:31:28.500 INFO:tasks.workunit.client.1.smithi131.stdout:4/359: unlink d2/f40 0 2024-02-15T18:31:28.502 INFO:tasks.workunit.client.1.smithi131.stdout:1/354: dread d0/d2/f37 [0,4194304] 0 2024-02-15T18:31:28.503 INFO:tasks.workunit.client.1.smithi131.stdout:5/389: truncate f6 4762258 0 2024-02-15T18:31:28.503 INFO:tasks.workunit.client.1.smithi131.stdout:5/390: truncate d18/d20/f60 373486 0 2024-02-15T18:31:28.503 INFO:tasks.workunit.client.1.smithi131.stdout:4/360: mkdir d2/d7/d1c/d5d/d7d 0 2024-02-15T18:31:28.507 INFO:tasks.workunit.client.1.smithi131.stdout:1/355: getdents d0/d2/d7/d72 0 2024-02-15T18:31:28.508 INFO:tasks.workunit.client.1.smithi131.stdout:1/356: dread - d0/d1/d44/f70 zero size 2024-02-15T18:31:28.508 INFO:tasks.workunit.client.1.smithi131.stdout:5/391: link d18/d24/d63/f72 d18/d4e/d69/f82 0 2024-02-15T18:31:28.508 INFO:tasks.workunit.client.1.smithi131.stdout:5/392: readlink d18/d20/l3e 0 2024-02-15T18:31:28.513 INFO:tasks.workunit.client.1.smithi131.stdout:4/361: link d2/d7/f1d d2/d2a/d47/d16/d43/f7e 0 2024-02-15T18:31:28.518 INFO:tasks.workunit.client.1.smithi131.stdout:5/393: write d18/d20/f71 [344503,118735] 0 2024-02-15T18:31:28.518 INFO:tasks.workunit.client.1.smithi131.stdout:7/426: dwrite d0/d17/d36/f4c [0,4194304] 0 2024-02-15T18:31:28.518 INFO:tasks.workunit.client.1.smithi131.stdout:1/357: rename d0/d2/l7b to d0/d2/d4/d41/d5a/l7d 0 2024-02-15T18:31:28.530 INFO:tasks.workunit.client.1.smithi131.stdout:4/362: creat d2/d23/f7f x:0 0 0 2024-02-15T18:31:28.535 INFO:tasks.workunit.client.1.smithi131.stdout:7/427: truncate d0/f4a 1608318 0 2024-02-15T18:31:28.535 INFO:tasks.workunit.client.1.smithi131.stdout:7/428: write d0/d17/d36/f75 [179445,100526] 0 2024-02-15T18:31:28.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/358: truncate d0/d2/d31/d3d/f6a 2427700 0 2024-02-15T18:31:28.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/359: stat d0/d1/d44/c4a 0 2024-02-15T18:31:28.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/360: readlink d0/d1/d16/l3e 0 2024-02-15T18:31:28.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/361: readlink d0/d2/d31/d3d/d46/l73 0 2024-02-15T18:31:28.536 INFO:tasks.workunit.client.1.smithi131.stdout:5/394: mkdir d18/d83 0 2024-02-15T18:31:28.537 INFO:tasks.workunit.client.1.smithi131.stdout:2/246: dwrite dd/f29 [4194304,4194304] 0 2024-02-15T18:31:28.538 INFO:tasks.workunit.client.1.smithi131.stdout:9/342: dwrite d4/dc/d25/d4e/d38/f44 [4194304,4194304] 0 2024-02-15T18:31:28.544 INFO:tasks.workunit.client.1.smithi131.stdout:9/343: mknod d4/dc/c60 0 2024-02-15T18:31:28.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/429: symlink d0/d17/d36/l87 0 2024-02-15T18:31:28.544 INFO:tasks.workunit.client.1.smithi131.stdout:2/247: mknod dd/d1e/c4c 0 2024-02-15T18:31:28.544 INFO:tasks.workunit.client.1.smithi131.stdout:2/248: stat dd/d10/d22/d2f/d38/f3f 0 2024-02-15T18:31:28.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/430: write d0/d17/f5c [667099,12824] 0 2024-02-15T18:31:28.544 INFO:tasks.workunit.client.1.smithi131.stdout:5/395: creat d18/d24/d7b/f84 x:0 0 0 2024-02-15T18:31:28.544 INFO:tasks.workunit.client.1.smithi131.stdout:5/396: chown d18/d33 503076091 1 2024-02-15T18:31:28.554 INFO:tasks.workunit.client.1.smithi131.stdout:4/363: dwrite d2/d7/d12/d2e/f64 [0,4194304] 0 2024-02-15T18:31:28.555 INFO:tasks.workunit.client.1.smithi131.stdout:1/362: dread d0/d1/f38 [0,4194304] 0 2024-02-15T18:31:28.562 INFO:tasks.workunit.client.1.smithi131.stdout:9/344: creat d4/dc/de/d1e/f61 x:0 0 0 2024-02-15T18:31:28.563 INFO:tasks.workunit.client.1.smithi131.stdout:9/345: chown d4/dc/de/d1e/d1f/c29 49845335 1 2024-02-15T18:31:28.563 INFO:tasks.workunit.client.1.smithi131.stdout:7/431: creat d0/f88 x:0 0 0 2024-02-15T18:31:28.563 INFO:tasks.workunit.client.1.smithi131.stdout:7/432: truncate d0/d17/f3c 988948 0 2024-02-15T18:31:28.571 INFO:tasks.workunit.client.1.smithi131.stdout:5/397: dwrite d18/d33/f5a [0,4194304] 0 2024-02-15T18:31:28.573 INFO:tasks.workunit.client.1.smithi131.stdout:2/249: creat dd/d10/d22/d2f/d38/f4d x:0 0 0 2024-02-15T18:31:28.584 INFO:tasks.workunit.client.1.smithi131.stdout:5/398: dread d18/d24/f4a [0,4194304] 0 2024-02-15T18:31:28.584 INFO:tasks.workunit.client.1.smithi131.stdout:2/250: dread dd/d10/d13/f1a [0,4194304] 0 2024-02-15T18:31:28.584 INFO:tasks.workunit.client.1.smithi131.stdout:2/251: write fc [4952551,20501] 0 2024-02-15T18:31:28.584 INFO:tasks.workunit.client.1.smithi131.stdout:1/363: dwrite d0/d1/d16/f43 [0,4194304] 0 2024-02-15T18:31:28.584 INFO:tasks.workunit.client.1.smithi131.stdout:1/364: write d0/d2/db/f7c [31185,42784] 0 2024-02-15T18:31:28.590 INFO:tasks.workunit.client.1.smithi131.stdout:9/346: symlink d4/dc/d17/l62 0 2024-02-15T18:31:28.590 INFO:tasks.workunit.client.1.smithi131.stdout:4/364: rmdir d2/d23 39 2024-02-15T18:31:28.591 INFO:tasks.workunit.client.1.smithi131.stdout:5/399: mkdir d18/d4e/d69/d85 0 2024-02-15T18:31:28.591 INFO:tasks.workunit.client.1.smithi131.stdout:7/433: truncate d0/d17/d36/f48 408844 0 2024-02-15T18:31:28.591 INFO:tasks.workunit.client.1.smithi131.stdout:5/400: chown d18/d24/d63/f76 8852152 1 2024-02-15T18:31:28.591 INFO:tasks.workunit.client.1.smithi131.stdout:5/401: readlink d18/d20/l5c 0 2024-02-15T18:31:28.591 INFO:tasks.workunit.client.1.smithi131.stdout:2/252: mknod dd/d10/c4e 0 2024-02-15T18:31:28.592 INFO:tasks.workunit.client.1.smithi131.stdout:4/365: mknod d2/d2a/d68/c80 0 2024-02-15T18:31:28.592 INFO:tasks.workunit.client.1.smithi131.stdout:4/366: chown d2/d7/d1c/l20 417140 1 2024-02-15T18:31:28.595 INFO:tasks.workunit.client.1.smithi131.stdout:7/434: rmdir d0/d34 39 2024-02-15T18:31:28.597 INFO:tasks.workunit.client.1.smithi131.stdout:5/402: mkdir d18/d4e/d69/d86 0 2024-02-15T18:31:28.597 INFO:tasks.workunit.client.1.smithi131.stdout:4/367: write d2/d7/d1c/f44 [1231220,92059] 0 2024-02-15T18:31:28.597 INFO:tasks.workunit.client.1.smithi131.stdout:2/253: rename c6 to dd/d10/d13/d2e/c4f 0 2024-02-15T18:31:28.603 INFO:tasks.workunit.client.1.smithi131.stdout:2/254: creat dd/d10/d22/d2f/d38/f50 x:0 0 0 2024-02-15T18:31:28.603 INFO:tasks.workunit.client.1.smithi131.stdout:4/368: creat d2/d7/d12/d53/f81 x:0 0 0 2024-02-15T18:31:28.603 INFO:tasks.workunit.client.1.smithi131.stdout:4/369: chown d2/d2a/d68/c6d 114945 1 2024-02-15T18:31:28.603 INFO:tasks.workunit.client.1.smithi131.stdout:4/370: write d2/d7/d1c/f48 [691851,45978] 0 2024-02-15T18:31:28.604 INFO:tasks.workunit.client.1.smithi131.stdout:7/435: mkdir d0/d17/d3a/d3d/d79/d89 0 2024-02-15T18:31:28.604 INFO:tasks.workunit.client.1.smithi131.stdout:5/403: dread d18/d4e/d69/f7a [0,4194304] 0 2024-02-15T18:31:28.604 INFO:tasks.workunit.client.1.smithi131.stdout:9/347: dread d4/dc/f2d [0,4194304] 0 2024-02-15T18:31:28.615 INFO:tasks.workunit.client.1.smithi131.stdout:5/404: creat d18/d24/f87 x:0 0 0 2024-02-15T18:31:28.618 INFO:tasks.workunit.client.1.smithi131.stdout:4/371: rename d2/d7/d12/d2e/d5f/d70/c45 to d2/d7/d12/d2e/d5f/d70/c82 0 2024-02-15T18:31:28.618 INFO:tasks.workunit.client.1.smithi131.stdout:4/372: chown d2/d7/d12/d2e/d39/d4b/f69 1343 1 2024-02-15T18:31:28.620 INFO:tasks.workunit.client.1.smithi131.stdout:5/405: creat d18/d33/d73/f88 x:0 0 0 2024-02-15T18:31:28.620 INFO:tasks.workunit.client.1.smithi131.stdout:9/348: mkdir d4/dc/d17/d19/d41/d63 0 2024-02-15T18:31:28.620 INFO:tasks.workunit.client.1.smithi131.stdout:5/406: getdents d18/d4e/d69/d86 0 2024-02-15T18:31:28.620 INFO:tasks.workunit.client.1.smithi131.stdout:5/407: getdents d18/d24/d63 0 2024-02-15T18:31:28.621 INFO:tasks.workunit.client.1.smithi131.stdout:5/408: truncate d18/d24/d63/f7e 185152 0 2024-02-15T18:31:28.621 INFO:tasks.workunit.client.1.smithi131.stdout:7/436: dread d0/d34/f74 [0,4194304] 0 2024-02-15T18:31:28.621 INFO:tasks.workunit.client.1.smithi131.stdout:7/437: chown d0/d17/d36/f48 80061 1 2024-02-15T18:31:28.621 INFO:tasks.workunit.client.1.smithi131.stdout:7/438: write d0/d34/f67 [684128,124297] 0 2024-02-15T18:31:28.624 INFO:tasks.workunit.client.1.smithi131.stdout:4/373: rename d2/f5b to d2/d7/d1c/d5d/d7d/f83 0 2024-02-15T18:31:28.628 INFO:tasks.workunit.client.1.smithi131.stdout:9/349: link d4/dc/d17/l42 d4/dc/de/d1e/l64 0 2024-02-15T18:31:28.628 INFO:tasks.workunit.client.1.smithi131.stdout:9/350: fsync d4/dc/d25/f40 0 2024-02-15T18:31:28.629 INFO:tasks.workunit.client.1.smithi131.stdout:7/439: creat d0/d17/d36/f8a x:0 0 0 2024-02-15T18:31:28.629 INFO:tasks.workunit.client.1.smithi131.stdout:7/440: write d0/fb [2575493,17555] 0 2024-02-15T18:31:28.629 INFO:tasks.workunit.client.1.smithi131.stdout:7/441: chown d0/d17/d3a/d3d/c40 613 1 2024-02-15T18:31:28.629 INFO:tasks.workunit.client.1.smithi131.stdout:4/374: unlink d2/d2a/d47/cb 0 2024-02-15T18:31:28.637 INFO:tasks.workunit.client.1.smithi131.stdout:9/351: rename d4/dc/de/d1e/d1f/c28 to d4/dc/d17/d19/d41/d63/c65 0 2024-02-15T18:31:28.637 INFO:tasks.workunit.client.1.smithi131.stdout:7/442: dread d0/f15 [0,4194304] 0 2024-02-15T18:31:28.637 INFO:tasks.workunit.client.1.smithi131.stdout:7/443: chown d0/d17/l6a 1743333 1 2024-02-15T18:31:28.638 INFO:tasks.workunit.client.1.smithi131.stdout:4/375: mkdir d2/d7/d1c/d84 0 2024-02-15T18:31:28.638 INFO:tasks.workunit.client.1.smithi131.stdout:4/376: dread - d2/d7/d12/d2e/f34 zero size 2024-02-15T18:31:28.640 INFO:tasks.workunit.client.1.smithi131.stdout:9/352: write d4/dc/de/d1e/d1f/f3a [3289545,66654] 0 2024-02-15T18:31:28.640 INFO:tasks.workunit.client.1.smithi131.stdout:9/353: chown d4/dc/d25/d4e/c3b 25598 1 2024-02-15T18:31:28.640 INFO:tasks.workunit.client.1.smithi131.stdout:9/354: fsync d4/dc/d17/d19/fb 0 2024-02-15T18:31:28.640 INFO:tasks.workunit.client.1.smithi131.stdout:4/377: mkdir d2/d2a/d85 0 2024-02-15T18:31:28.645 INFO:tasks.workunit.client.1.smithi131.stdout:9/355: fsync d4/dc/de/d1e/d1f/f3a 0 2024-02-15T18:31:28.646 INFO:tasks.workunit.client.1.smithi131.stdout:5/409: getdents d18/d33/d73 0 2024-02-15T18:31:28.650 INFO:tasks.workunit.client.1.smithi131.stdout:9/356: creat d4/dc/d25/d3f/f66 x:0 0 0 2024-02-15T18:31:28.657 INFO:tasks.workunit.client.1.smithi131.stdout:7/444: write d0/fd [1022187,20076] 0 2024-02-15T18:31:28.657 INFO:tasks.workunit.client.1.smithi131.stdout:7/445: truncate d0/d17/f6c 680049 0 2024-02-15T18:31:28.660 INFO:tasks.workunit.client.1.smithi131.stdout:7/446: unlink d0/f71 0 2024-02-15T18:31:28.670 INFO:tasks.workunit.client.1.smithi131.stdout:5/410: dwrite d18/d24/f2c [0,4194304] 0 2024-02-15T18:31:28.671 INFO:tasks.workunit.client.1.smithi131.stdout:7/447: truncate d0/d17/f6c 236489 0 2024-02-15T18:31:28.672 INFO:tasks.workunit.client.1.smithi131.stdout:4/378: dwrite d2/d7/d12/d2e/f50 [0,4194304] 0 2024-02-15T18:31:28.683 INFO:tasks.workunit.client.1.smithi131.stdout:5/411: mkdir d18/d83/d89 0 2024-02-15T18:31:28.684 INFO:tasks.workunit.client.1.smithi131.stdout:7/448: mkdir d0/d34/d8b 0 2024-02-15T18:31:28.686 INFO:tasks.workunit.client.1.smithi131.stdout:4/379: symlink d2/d7/d12/d2e/d39/l86 0 2024-02-15T18:31:28.688 INFO:tasks.workunit.client.1.smithi131.stdout:7/449: rename d0/f15 to d0/d17/d3a/d3d/d79/d89/f8c 0 2024-02-15T18:31:28.690 INFO:tasks.workunit.client.1.smithi131.stdout:4/380: getdents d2/d2a/d47 0 2024-02-15T18:31:28.690 INFO:tasks.workunit.client.1.smithi131.stdout:4/381: chown d2/d2a/d47/d16/l7c 1 1 2024-02-15T18:31:28.690 INFO:tasks.workunit.client.1.smithi131.stdout:4/382: truncate d2/d7/fc 4685426 0 2024-02-15T18:31:28.694 INFO:tasks.workunit.client.1.smithi131.stdout:7/450: creat d0/d34/f8d x:0 0 0 2024-02-15T18:31:28.696 INFO:tasks.workunit.client.1.smithi131.stdout:7/451: mkdir d0/d34/d8e 0 2024-02-15T18:31:28.696 INFO:tasks.workunit.client.1.smithi131.stdout:7/452: getdents d0/d34/d8b 0 2024-02-15T18:31:28.696 INFO:tasks.workunit.client.1.smithi131.stdout:7/453: fdatasync d0/d17/d3a/d3d/f56 0 2024-02-15T18:31:28.699 INFO:tasks.workunit.client.1.smithi131.stdout:7/454: symlink d0/d34/l8f 0 2024-02-15T18:31:28.699 INFO:tasks.workunit.client.1.smithi131.stdout:7/455: stat d0/c2a 0 2024-02-15T18:31:28.699 INFO:tasks.workunit.client.1.smithi131.stdout:7/456: chown d0/l86 377821 1 2024-02-15T18:31:28.700 INFO:tasks.workunit.client.1.smithi131.stdout:7/457: unlink d0/d17/d3a/d3d/f42 0 2024-02-15T18:31:28.702 INFO:tasks.workunit.client.1.smithi131.stdout:7/458: mknod d0/d17/c90 0 2024-02-15T18:31:28.703 INFO:tasks.workunit.client.1.smithi131.stdout:7/459: truncate d0/d17/d3a/d3d/f53 442735 0 2024-02-15T18:31:28.703 INFO:tasks.workunit.client.1.smithi131.stdout:7/460: truncate d0/d17/d3a/d3d/f73 147810 0 2024-02-15T18:31:28.704 INFO:tasks.workunit.client.1.smithi131.stdout:4/383: rename d2/d7/f13 to d2/d7/d12/d2e/d5f/d70/f87 0 2024-02-15T18:31:28.704 INFO:tasks.workunit.client.1.smithi131.stdout:4/384: chown d2/l58 1 1 2024-02-15T18:31:28.704 INFO:tasks.workunit.client.1.smithi131.stdout:4/385: chown d2/d7/d1c/l20 30041321 1 2024-02-15T18:31:28.704 INFO:tasks.workunit.client.1.smithi131.stdout:7/461: read d0/fb [755890,31558] 0 2024-02-15T18:31:28.707 INFO:tasks.workunit.client.1.smithi131.stdout:4/386: mkdir d2/d7/d1c/d88 0 2024-02-15T18:31:28.707 INFO:tasks.workunit.client.1.smithi131.stdout:4/387: getdents d2/d7/d1c/d88 0 2024-02-15T18:31:28.707 INFO:tasks.workunit.client.1.smithi131.stdout:4/388: fsync d2/d2a/d47/d16/d43/f7e 0 2024-02-15T18:31:28.707 INFO:tasks.workunit.client.1.smithi131.stdout:4/389: readlink d2/d2a/d47/d16/l4c 0 2024-02-15T18:31:28.707 INFO:tasks.workunit.client.1.smithi131.stdout:7/462: unlink d0/c80 0 2024-02-15T18:31:28.707 INFO:tasks.workunit.client.1.smithi131.stdout:7/463: truncate d0/d17/f6c 1038171 0 2024-02-15T18:31:28.712 INFO:tasks.workunit.client.1.smithi131.stdout:4/390: rename d2/d2a/f3c to d2/d2a/d47/d16/d43/f89 0 2024-02-15T18:31:28.713 INFO:tasks.workunit.client.1.smithi131.stdout:7/464: creat d0/d17/d3a/f91 x:0 0 0 2024-02-15T18:31:28.713 INFO:tasks.workunit.client.1.smithi131.stdout:7/465: chown d0/d34/f8d 3441911 1 2024-02-15T18:31:28.717 INFO:tasks.workunit.client.1.smithi131.stdout:3/371: sync 2024-02-15T18:31:28.718 INFO:tasks.workunit.client.1.smithi131.stdout:7/466: mkdir d0/d17/d3a/d3d/d92 0 2024-02-15T18:31:28.726 INFO:tasks.workunit.client.1.smithi131.stdout:3/372: mkdir d2/d22/d5e/d79 0 2024-02-15T18:31:28.732 INFO:tasks.workunit.client.1.smithi131.stdout:7/467: link d0/d17/f3c d0/d17/d3a/d3d/d92/f93 0 2024-02-15T18:31:28.732 INFO:tasks.workunit.client.1.smithi131.stdout:4/391: dwrite d2/f77 [0,4194304] 0 2024-02-15T18:31:28.733 INFO:tasks.workunit.client.1.smithi131.stdout:7/468: rename d0/d17/d36/f61 to d0/d34/d8e/f94 0 2024-02-15T18:31:28.738 INFO:tasks.workunit.client.1.smithi131.stdout:4/392: creat d2/d7/f8a x:0 0 0 2024-02-15T18:31:28.740 INFO:tasks.workunit.client.1.smithi131.stdout:4/393: mknod d2/d7/d1c/c8b 0 2024-02-15T18:31:28.743 INFO:tasks.workunit.client.1.smithi131.stdout:4/394: link d2/d7/d12/d2e/d39/c60 d2/d7/c8c 0 2024-02-15T18:31:28.744 INFO:tasks.workunit.client.1.smithi131.stdout:4/395: mknod d2/d2a/d47/c8d 0 2024-02-15T18:31:28.744 INFO:tasks.workunit.client.1.smithi131.stdout:4/396: readlink d2/l1e 0 2024-02-15T18:31:28.744 INFO:tasks.workunit.client.1.smithi131.stdout:7/469: dread d0/d17/d3a/d3d/d92/f93 [0,4194304] 0 2024-02-15T18:31:28.745 INFO:tasks.workunit.client.1.smithi131.stdout:7/470: chown d0/l4d 731711 1 2024-02-15T18:31:28.748 INFO:tasks.workunit.client.1.smithi131.stdout:3/373: dwrite d2/d22/d42/f45 [0,4194304] 0 2024-02-15T18:31:28.748 INFO:tasks.workunit.client.1.smithi131.stdout:3/374: fdatasync d2/d22/d29/f4a 0 2024-02-15T18:31:28.748 INFO:tasks.workunit.client.1.smithi131.stdout:7/471: creat d0/d17/d3a/d3d/d79/d89/f95 x:0 0 0 2024-02-15T18:31:28.749 INFO:tasks.workunit.client.1.smithi131.stdout:4/397: rename d2/d7/d12/d2e/d39/d4b/f6a to d2/d7/d12/f8e 0 2024-02-15T18:31:28.749 INFO:tasks.workunit.client.1.smithi131.stdout:7/472: chown d0/f88 0 1 2024-02-15T18:31:28.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.445552+0000 mon.smithi033 (mon.0) 638 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd='[{"prefix": "mgr fail", "who": "smithi131.buibla"}]': finished 2024-02-15T18:31:28.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:27.445609+0000 mon.smithi033 (mon.0) 639 : cluster [DBG] mgrmap e24: smithi033.apxevf(active, starting, since 0.511194s) 2024-02-15T18:31:28.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.446505+0000 mon.smithi033 (mon.0) 640 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:31:28.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.446630+0000 mon.smithi033 (mon.0) 641 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:31:28.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.446934+0000 mon.smithi033 (mon.0) 642 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.447117+0000 mon.smithi033 (mon.0) 643 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.447278+0000 mon.smithi033 (mon.0) 644 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.447437+0000 mon.smithi033 (mon.0) 645 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.447633+0000 mon.smithi033 (mon.0) 646 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi033.apxevf", "id": "smithi033.apxevf"}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.447875+0000 mon.smithi033 (mon.0) 647 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.448125+0000 mon.smithi033 (mon.0) 648 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.448385+0000 mon.smithi033 (mon.0) 649 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.448705+0000 mon.smithi033 (mon.0) 650 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.448997+0000 mon.smithi033 (mon.0) 651 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.449231+0000 mon.smithi033 (mon.0) 652 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.449428+0000 mon.smithi033 (mon.0) 653 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.449705+0000 mon.smithi033 (mon.0) 654 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.450149+0000 mon.smithi033 (mon.0) 655 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:27.477744+0000 mon.smithi033 (mon.0) 656 : cluster [INF] Manager daemon smithi033.apxevf is now available 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:31:27.494667+0000 mgr.smithi033.apxevf (mgr.14626) 1 : cephadm [INF] inventory: adjusted host smithi131 addr 'smithi131' -> '172.21.15.131' 2024-02-15T18:31:28.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.506731+0000 mon.smithi033 (mon.0) 657 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:31:28.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.624876+0000 mon.smithi033 (mon.0) 658 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:28.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.628439+0000 mon.smithi033 (mon.0) 659 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:28.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.697104+0000 mon.smithi033 (mon.0) 660 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:31:28.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.710282+0000 mon.smithi033 (mon.0) 661 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:31:28.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.940733+0000 mon.smithi033 (mon.0) 662 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:31:28.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:27.940820+0000 mon.smithi033 (mon.0) 663 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-02-15T18:31:28.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.942572+0000 mon.smithi033 (mon.0) 664 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:31:28.751 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:27.951601+0000 mon.smithi033 (mon.0) 665 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:31:28.759 INFO:tasks.workunit.client.1.smithi131.stdout:3/375: mknod d2/d22/d29/db/d1a/c7a 0 2024-02-15T18:31:28.760 INFO:tasks.workunit.client.1.smithi131.stdout:4/398: symlink d2/d7/d12/d2e/l8f 0 2024-02-15T18:31:28.760 INFO:tasks.workunit.client.1.smithi131.stdout:7/473: creat d0/d17/d3a/d3d/d79/d89/f96 x:0 0 0 2024-02-15T18:31:28.761 INFO:tasks.workunit.client.1.smithi131.stdout:4/399: write d2/d7/d12/d2e/f64 [3017058,882] 0 2024-02-15T18:31:28.761 INFO:tasks.workunit.client.1.smithi131.stdout:4/400: chown d2/d7/f10 523040 1 2024-02-15T18:31:28.761 INFO:tasks.workunit.client.1.smithi131.stdout:7/474: creat d0/d34/f97 x:0 0 0 2024-02-15T18:31:28.765 INFO:tasks.workunit.client.1.smithi131.stdout:7/475: rmdir d0/d17/d3a/d3d/d92 39 2024-02-15T18:31:28.765 INFO:tasks.workunit.client.1.smithi131.stdout:7/476: fsync d0/d17/d36/f3f 0 2024-02-15T18:31:28.766 INFO:tasks.workunit.client.1.smithi131.stdout:4/401: mknod d2/d7/c90 0 2024-02-15T18:31:28.766 INFO:tasks.workunit.client.1.smithi131.stdout:4/402: readlink d2/d7/d1c/l20 0 2024-02-15T18:31:28.770 INFO:tasks.workunit.client.1.smithi131.stdout:4/403: link d2/d23/f7f d2/d2a/d47/d21/f91 0 2024-02-15T18:31:28.770 INFO:tasks.workunit.client.1.smithi131.stdout:4/404: stat d2/d23/f72 0 2024-02-15T18:31:28.770 INFO:tasks.workunit.client.1.smithi131.stdout:4/405: readlink d2/l1e 0 2024-02-15T18:31:28.770 INFO:tasks.workunit.client.1.smithi131.stdout:4/406: chown d2/d7/d12/d2e/d5f/d70/f87 749639863 1 2024-02-15T18:31:28.779 INFO:tasks.workunit.client.1.smithi131.stdout:3/376: dwrite d2/d22/d29/d20/f37 [0,4194304] 0 2024-02-15T18:31:28.779 INFO:tasks.workunit.client.1.smithi131.stdout:3/377: chown d2/f3c 46507 1 2024-02-15T18:31:28.780 INFO:tasks.workunit.client.1.smithi131.stdout:3/378: mknod d2/d22/c7b 0 2024-02-15T18:31:28.781 INFO:tasks.workunit.client.1.smithi131.stdout:3/379: chown d2/d22/d29/db/d23/d2a/d49 7 1 2024-02-15T18:31:28.781 INFO:tasks.workunit.client.1.smithi131.stdout:3/380: creat d2/f7c x:0 0 0 2024-02-15T18:31:28.783 INFO:tasks.workunit.client.1.smithi131.stdout:3/381: creat d2/d22/d29/db/d23/d2a/d5b/f7d x:0 0 0 2024-02-15T18:31:28.783 INFO:tasks.workunit.client.1.smithi131.stdout:3/382: write d2/d22/d29/f4a [856090,94522] 0 2024-02-15T18:31:28.784 INFO:tasks.workunit.client.1.smithi131.stdout:3/383: creat d2/d22/d29/f7e x:0 0 0 2024-02-15T18:31:28.785 INFO:tasks.workunit.client.1.smithi131.stdout:3/384: mknod d2/c7f 0 2024-02-15T18:31:28.791 INFO:tasks.workunit.client.1.smithi131.stdout:4/407: dwrite d2/d7/d12/d53/f81 [0,4194304] 0 2024-02-15T18:31:28.792 INFO:tasks.workunit.client.1.smithi131.stdout:7/477: dwrite d0/d17/d36/f3b [0,4194304] 0 2024-02-15T18:31:28.795 INFO:tasks.workunit.client.1.smithi131.stdout:7/478: unlink d0/c2a 0 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.445552+0000 mon.smithi033 (mon.0) 638 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd='[{"prefix": "mgr fail", "who": "smithi131.buibla"}]': finished 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:27.445609+0000 mon.smithi033 (mon.0) 639 : cluster [DBG] mgrmap e24: smithi033.apxevf(active, starting, since 0.511194s) 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.446505+0000 mon.smithi033 (mon.0) 640 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.446630+0000 mon.smithi033 (mon.0) 641 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.446934+0000 mon.smithi033 (mon.0) 642 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.447117+0000 mon.smithi033 (mon.0) 643 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.447278+0000 mon.smithi033 (mon.0) 644 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.447437+0000 mon.smithi033 (mon.0) 645 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.447633+0000 mon.smithi033 (mon.0) 646 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi033.apxevf", "id": "smithi033.apxevf"}]: dispatch 2024-02-15T18:31:28.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.447875+0000 mon.smithi033 (mon.0) 647 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.448125+0000 mon.smithi033 (mon.0) 648 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.448385+0000 mon.smithi033 (mon.0) 649 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.448705+0000 mon.smithi033 (mon.0) 650 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.448997+0000 mon.smithi033 (mon.0) 651 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.449231+0000 mon.smithi033 (mon.0) 652 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.449428+0000 mon.smithi033 (mon.0) 653 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.449705+0000 mon.smithi033 (mon.0) 654 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.450149+0000 mon.smithi033 (mon.0) 655 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:27.477744+0000 mon.smithi033 (mon.0) 656 : cluster [INF] Manager daemon smithi033.apxevf is now available 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:31:27.494667+0000 mgr.smithi033.apxevf (mgr.14626) 1 : cephadm [INF] inventory: adjusted host smithi131 addr 'smithi131' -> '172.21.15.131' 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.506731+0000 mon.smithi033 (mon.0) 657 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.624876+0000 mon.smithi033 (mon.0) 658 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.628439+0000 mon.smithi033 (mon.0) 659 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:28.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.697104+0000 mon.smithi033 (mon.0) 660 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/mirror_snapshot_schedule"}]: dispatch 2024-02-15T18:31:28.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.710282+0000 mon.smithi033 (mon.0) 661 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.apxevf/trash_purge_schedule"}]: dispatch 2024-02-15T18:31:28.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.940733+0000 mon.smithi033 (mon.0) 662 : audit [INF] from='mgr.24387 ' entity='mgr.smithi131.buibla' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:31:28.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:27.940820+0000 mon.smithi033 (mon.0) 663 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-02-15T18:31:28.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.942572+0000 mon.smithi033 (mon.0) 664 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-15T18:31:28.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:27.951601+0000 mon.smithi033 (mon.0) 665 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-15T18:31:28.801 INFO:tasks.workunit.client.1.smithi131.stdout:4/408: getdents d2/d7 0 2024-02-15T18:31:28.801 INFO:tasks.workunit.client.1.smithi131.stdout:4/409: stat d2/d2a/d47/d16/f37 0 2024-02-15T18:31:28.805 INFO:tasks.workunit.client.1.smithi131.stdout:4/410: mkdir d2/d7/d1c/d5d/d7a/d92 0 2024-02-15T18:31:28.805 INFO:tasks.workunit.client.1.smithi131.stdout:4/411: readlink d2/d2a/d47/l4a 0 2024-02-15T18:31:28.806 INFO:tasks.workunit.client.1.smithi131.stdout:4/412: truncate d2/d7/f8a 321308 0 2024-02-15T18:31:28.807 INFO:tasks.workunit.client.1.smithi131.stdout:4/413: link d2/c15 d2/d2a/d85/c93 0 2024-02-15T18:31:28.808 INFO:tasks.workunit.client.1.smithi131.stdout:4/414: rename d2/d7/d1c/d5d/d7d to d2/d7/d1c/d94 0 2024-02-15T18:31:28.808 INFO:tasks.workunit.client.1.smithi131.stdout:4/415: fdatasync d2/d7/d12/d2e/d5f/d70/f56 0 2024-02-15T18:31:28.809 INFO:tasks.workunit.client.1.smithi131.stdout:4/416: creat d2/d7/d1c/d94/f95 x:0 0 0 2024-02-15T18:31:28.811 INFO:tasks.workunit.client.1.smithi131.stdout:3/385: dwrite d2/d22/d29/db/f1e [4194304,4194304] 0 2024-02-15T18:31:28.811 INFO:tasks.workunit.client.1.smithi131.stdout:3/386: chown d2/d22/d29/db/d1a/c7a 238684460 1 2024-02-15T18:31:28.820 INFO:tasks.workunit.client.1.smithi131.stdout:3/387: dread d2/d22/d29/d20/f6d [0,4194304] 0 2024-02-15T18:31:28.824 INFO:tasks.workunit.client.1.smithi131.stdout:3/388: rmdir d2/d22/d29/db/d23/d2a/d5b 39 2024-02-15T18:31:28.824 INFO:tasks.workunit.client.1.smithi131.stdout:3/389: stat d2/d22/d29/f7e 0 2024-02-15T18:31:28.824 INFO:tasks.workunit.client.1.smithi131.stdout:3/390: write d2/d22/d29/db/d1a/fe [2924959,91338] 0 2024-02-15T18:31:28.825 INFO:tasks.workunit.client.1.smithi131.stdout:3/391: getdents d2/d22/d29/d20 0 2024-02-15T18:31:28.828 INFO:tasks.workunit.client.1.smithi131.stdout:4/417: dwrite d2/d7/d1c/d94/f83 [4194304,4194304] 0 2024-02-15T18:31:28.828 INFO:tasks.workunit.client.1.smithi131.stdout:4/418: chown d2/d2a/c49 31 1 2024-02-15T18:31:28.828 INFO:tasks.workunit.client.1.smithi131.stdout:3/392: unlink d2/d22/d3a/d6c/c30 0 2024-02-15T18:31:28.833 INFO:tasks.workunit.client.1.smithi131.stdout:3/393: dread d2/d22/d3a/d6c/f64 [4194304,4194304] 0 2024-02-15T18:31:28.836 INFO:tasks.workunit.client.1.smithi131.stdout:3/394: unlink d2/d22/d29/db/d1a/f50 0 2024-02-15T18:31:28.840 INFO:tasks.workunit.client.1.smithi131.stdout:3/395: dread d2/d22/d29/db/d23/f41 [0,4194304] 0 2024-02-15T18:31:28.841 INFO:tasks.workunit.client.1.smithi131.stdout:3/396: mknod d2/d22/d3f/c80 0 2024-02-15T18:31:28.841 INFO:tasks.workunit.client.1.smithi131.stdout:3/397: stat d2/d22/d29/db/d1a/f6b 0 2024-02-15T18:31:28.842 INFO:tasks.workunit.client.1.smithi131.stdout:3/398: mknod d2/d22/d29/db/c81 0 2024-02-15T18:31:28.844 INFO:tasks.workunit.client.1.smithi131.stdout:3/399: unlink d2/d22/d3a/f73 0 2024-02-15T18:31:28.845 INFO:tasks.workunit.client.1.smithi131.stdout:4/419: dwrite d2/d7/d1c/d5d/f7b [0,4194304] 0 2024-02-15T18:31:28.845 INFO:tasks.workunit.client.1.smithi131.stdout:4/420: read d2/d2a/d47/d16/f30 [190352,113889] 0 2024-02-15T18:31:28.846 INFO:tasks.workunit.client.1.smithi131.stdout:3/400: dread d2/d22/d29/db/d23/d2a/d49/f66 [0,4194304] 0 2024-02-15T18:31:28.849 INFO:tasks.workunit.client.1.smithi131.stdout:4/421: mkdir d2/d7/d96 0 2024-02-15T18:31:28.849 INFO:tasks.workunit.client.1.smithi131.stdout:3/401: dread d2/d22/d29/db/d23/f41 [4194304,4194304] 0 2024-02-15T18:31:28.860 INFO:tasks.workunit.client.1.smithi131.stdout:4/422: dread d2/d7/ff [0,4194304] 0 2024-02-15T18:31:28.862 INFO:tasks.workunit.client.1.smithi131.stdout:4/423: symlink d2/d2a/d47/d16/d43/l97 0 2024-02-15T18:31:28.862 INFO:tasks.workunit.client.1.smithi131.stdout:4/424: write d2/d2a/d47/f6f [671710,52501] 0 2024-02-15T18:31:28.863 INFO:tasks.workunit.client.1.smithi131.stdout:4/425: mknod d2/d2a/d68/c98 0 2024-02-15T18:31:28.863 INFO:tasks.workunit.client.1.smithi131.stdout:4/426: chown d2/d2a/d47/c22 38004228 1 2024-02-15T18:31:28.863 INFO:tasks.workunit.client.1.smithi131.stdout:4/427: mknod d2/d7/d1c/d94/c99 0 2024-02-15T18:31:28.871 INFO:tasks.workunit.client.1.smithi131.stdout:4/428: truncate d2/d7/f10 311734 0 2024-02-15T18:31:28.872 INFO:tasks.workunit.client.1.smithi131.stdout:4/429: chown d2/d7/fc 7 1 2024-02-15T18:31:28.873 INFO:tasks.workunit.client.1.smithi131.stdout:4/430: mknod d2/d2a/d47/d16/d43/c9a 0 2024-02-15T18:31:28.873 INFO:tasks.workunit.client.1.smithi131.stdout:3/402: dwrite d2/f59 [0,4194304] 0 2024-02-15T18:31:28.873 INFO:tasks.workunit.client.1.smithi131.stdout:3/403: chown d2/d22/d5e/c6a 0 1 2024-02-15T18:31:28.874 INFO:tasks.workunit.client.1.smithi131.stdout:4/431: write d2/d2a/d47/d21/f3a [6326675,47903] 0 2024-02-15T18:31:28.876 INFO:tasks.workunit.client.1.smithi131.stdout:3/404: getdents d2/d22 0 2024-02-15T18:31:28.934 INFO:tasks.workunit.client.1.smithi131.stdout:4/432: symlink d2/d7/d1c/d84/l9b 0 2024-02-15T18:31:28.936 INFO:tasks.workunit.client.1.smithi131.stdout:4/433: fsync d2/d7/f10 0 2024-02-15T18:31:28.936 INFO:tasks.workunit.client.1.smithi131.stdout:4/434: stat d2/d2a/d47/d16/d43/f7e 0 2024-02-15T18:31:28.937 INFO:tasks.workunit.client.1.smithi131.stdout:3/405: rename d2/d22/d29/db/d23/d2a/c57 to d2/d22/d29/d20/c82 0 2024-02-15T18:31:28.937 INFO:tasks.workunit.client.1.smithi131.stdout:4/435: write d2/f4 [1245312,93251] 0 2024-02-15T18:31:28.944 INFO:tasks.workunit.client.1.smithi131.stdout:4/436: creat d2/d7/d12/f9c x:0 0 0 2024-02-15T18:31:28.945 INFO:tasks.workunit.client.1.smithi131.stdout:3/406: link d2/d22/d3a/l5a d2/d22/d29/db/d23/d2a/l83 0 2024-02-15T18:31:28.945 INFO:tasks.workunit.client.1.smithi131.stdout:3/407: chown d2/d22/d29/c2c 32 1 2024-02-15T18:31:28.946 INFO:tasks.workunit.client.1.smithi131.stdout:3/408: mkdir d2/d22/d29/db/d84 0 2024-02-15T18:31:28.948 INFO:tasks.workunit.client.1.smithi131.stdout:3/409: rmdir d2/d22/d29/d20 39 2024-02-15T18:31:28.952 INFO:tasks.workunit.client.1.smithi131.stdout:3/410: write d2/d22/d29/f17 [1780925,15217] 0 2024-02-15T18:31:28.952 INFO:tasks.workunit.client.1.smithi131.stdout:3/411: chown d2/d22/d29/d20/l54 13694807 1 2024-02-15T18:31:28.968 INFO:tasks.workunit.client.1.smithi131.stdout:3/412: dwrite d2/d22/d29/f58 [0,4194304] 0 2024-02-15T18:31:28.968 INFO:tasks.workunit.client.1.smithi131.stdout:3/413: readlink d2/d22/d29/d20/l4d 0 2024-02-15T18:31:28.968 INFO:tasks.workunit.client.1.smithi131.stdout:3/414: readlink d2/d22/d3f/l60 0 2024-02-15T18:31:28.970 INFO:tasks.workunit.client.1.smithi131.stdout:6/323: sync 2024-02-15T18:31:28.972 INFO:tasks.workunit.client.1.smithi131.stdout:6/324: creat d2/d7/d12/d4d/f65 x:0 0 0 2024-02-15T18:31:28.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/325: rename d2/dc/d1f/c2d to d2/d7/c66 0 2024-02-15T18:31:28.977 INFO:tasks.workunit.client.1.smithi131.stdout:6/326: unlink d2/d7/d16/f58 0 2024-02-15T18:31:28.988 INFO:tasks.workunit.client.1.smithi131.stdout:3/415: dwrite d2/d22/d29/db/f1d [0,4194304] 0 2024-02-15T18:31:28.990 INFO:tasks.workunit.client.1.smithi131.stdout:3/416: dread d2/d22/f35 [0,4194304] 0 2024-02-15T18:31:28.990 INFO:tasks.workunit.client.1.smithi131.stdout:3/417: fdatasync d2/d22/d29/db/f1d 0 2024-02-15T18:31:28.990 INFO:tasks.workunit.client.1.smithi131.stdout:3/418: chown d2/d22/d29/l12 0 1 2024-02-15T18:31:29.001 INFO:tasks.workunit.client.1.smithi131.stdout:3/419: dread d2/d22/d29/db/f1e [4194304,4194304] 0 2024-02-15T18:31:29.002 INFO:tasks.workunit.client.1.smithi131.stdout:3/420: write d2/d22/d29/f7e [854617,124122] 0 2024-02-15T18:31:29.027 INFO:tasks.workunit.client.1.smithi131.stdout:3/421: mkdir d2/d22/d3a/d6c/d85 0 2024-02-15T18:31:29.027 INFO:tasks.workunit.client.1.smithi131.stdout:3/422: stat d2/d22/d29/db/d23/d2a/d49/c74 0 2024-02-15T18:31:29.030 INFO:tasks.workunit.client.1.smithi131.stdout:3/423: mkdir d2/d22/d29/d20/d86 0 2024-02-15T18:31:29.048 INFO:tasks.workunit.client.1.smithi131.stdout:3/424: creat d2/d22/d29/db/d23/d2a/f87 x:0 0 0 2024-02-15T18:31:29.069 INFO:tasks.workunit.client.1.smithi131.stdout:3/425: unlink d2/d22/d29/f75 0 2024-02-15T18:31:29.069 INFO:tasks.workunit.client.1.smithi131.stdout:3/426: dread - d2/d22/f63 zero size 2024-02-15T18:31:29.071 INFO:tasks.workunit.client.1.smithi131.stdout:3/427: rename d2/d22/d29/db/d23/d2a/d49/l55 to d2/d22/l88 0 2024-02-15T18:31:29.071 INFO:tasks.workunit.client.1.smithi131.stdout:3/428: chown d2/d22/d29/db/d34/f3b 0 1 2024-02-15T18:31:29.072 INFO:tasks.workunit.client.1.smithi131.stdout:3/429: link d2/d22/d29/db/c81 d2/d22/d29/d20/d86/c89 0 2024-02-15T18:31:29.090 INFO:tasks.workunit.client.1.smithi131.stdout:3/430: dwrite d2/d22/d29/d20/f6d [0,4194304] 0 2024-02-15T18:31:29.091 INFO:tasks.workunit.client.1.smithi131.stdout:3/431: creat d2/d22/d29/db/d34/f8a x:0 0 0 2024-02-15T18:31:29.091 INFO:tasks.workunit.client.1.smithi131.stdout:3/432: chown d2/d22/d29/db/d34/f8a 1890787783 1 2024-02-15T18:31:29.092 INFO:tasks.workunit.client.1.smithi131.stdout:3/433: creat d2/d22/d29/d20/f8b x:0 0 0 2024-02-15T18:31:29.209 INFO:tasks.workunit.client.1.smithi131.stdout:0/258: sync 2024-02-15T18:31:29.209 INFO:tasks.workunit.client.1.smithi131.stdout:8/301: sync 2024-02-15T18:31:29.210 INFO:tasks.workunit.client.1.smithi131.stdout:8/302: mkdir d22/d2e/d64 0 2024-02-15T18:31:29.211 INFO:tasks.workunit.client.1.smithi131.stdout:0/259: creat d5/d9/d10/d3f/f55 x:0 0 0 2024-02-15T18:31:29.212 INFO:tasks.workunit.client.1.smithi131.stdout:8/303: write d22/d26/f2d [1277473,125019] 0 2024-02-15T18:31:29.212 INFO:tasks.workunit.client.1.smithi131.stdout:0/260: creat d5/f56 x:0 0 0 2024-02-15T18:31:29.212 INFO:tasks.workunit.client.1.smithi131.stdout:0/261: dread - d5/f56 zero size 2024-02-15T18:31:29.212 INFO:tasks.workunit.client.1.smithi131.stdout:0/262: truncate d5/d9/d10/f1e 631371 0 2024-02-15T18:31:29.214 INFO:tasks.workunit.client.1.smithi131.stdout:0/263: rename d5/d9/d10/d3f/f52 to d5/d15/d1f/f57 0 2024-02-15T18:31:29.233 INFO:tasks.workunit.client.1.smithi131.stdout:0/264: dwrite d5/d9/d11/f30 [0,4194304] 0 2024-02-15T18:31:29.233 INFO:tasks.workunit.client.1.smithi131.stdout:0/265: chown d5/d15/d1f 204 1 2024-02-15T18:31:29.235 INFO:tasks.workunit.client.1.smithi131.stdout:0/266: mknod d5/d2f/c58 0 2024-02-15T18:31:29.241 INFO:tasks.workunit.client.1.smithi131.stdout:0/267: truncate d5/d9/d10/f1e 154660 0 2024-02-15T18:31:29.243 INFO:tasks.workunit.client.1.smithi131.stdout:0/268: rename d5/f1c to d5/d9/d11/d3e/f59 0 2024-02-15T18:31:29.248 INFO:tasks.workunit.client.1.smithi131.stdout:0/269: getdents d5/d9/d11/d3e 0 2024-02-15T18:31:29.249 INFO:tasks.workunit.client.1.smithi131.stdout:0/270: truncate d5/d9/ff 345241 0 2024-02-15T18:31:29.251 INFO:tasks.workunit.client.1.smithi131.stdout:0/271: symlink d5/d2f/l5a 0 2024-02-15T18:31:29.269 INFO:tasks.workunit.client.1.smithi131.stdout:0/272: dwrite d5/d9/d10/f1e [0,4194304] 0 2024-02-15T18:31:29.269 INFO:tasks.workunit.client.1.smithi131.stdout:0/273: chown d5/d9/d10/d3f/f47 2 1 2024-02-15T18:31:29.270 INFO:tasks.workunit.client.1.smithi131.stdout:0/274: chown d5/d15/f27 28009422 1 2024-02-15T18:31:29.270 INFO:tasks.workunit.client.1.smithi131.stdout:0/275: readlink d5/d9/le 0 2024-02-15T18:31:29.277 INFO:tasks.workunit.client.1.smithi131.stdout:0/276: dread d5/d9/d11/f14 [0,4194304] 0 2024-02-15T18:31:29.279 INFO:tasks.workunit.client.1.smithi131.stdout:0/277: symlink d5/d9/d11/l5b 0 2024-02-15T18:31:29.279 INFO:tasks.workunit.client.1.smithi131.stdout:0/278: chown d5/d2f/d45 157973 1 2024-02-15T18:31:29.279 INFO:tasks.workunit.client.1.smithi131.stdout:0/279: chown d5/f56 0 1 2024-02-15T18:31:29.279 INFO:tasks.workunit.client.1.smithi131.stdout:0/280: write d5/d15/f27 [513769,83828] 0 2024-02-15T18:31:29.296 INFO:tasks.workunit.client.1.smithi131.stdout:0/281: dwrite d5/d9/d10/f1e [0,4194304] 0 2024-02-15T18:31:29.296 INFO:tasks.workunit.client.1.smithi131.stdout:0/282: stat d5/d15/f27 0 2024-02-15T18:31:29.296 INFO:tasks.workunit.client.1.smithi131.stdout:0/283: readlink d5/d2f/l5a 0 2024-02-15T18:31:29.296 INFO:tasks.workunit.client.1.smithi131.stdout:0/284: write d5/d9/d11/f14 [5164004,118266] 0 2024-02-15T18:31:29.297 INFO:tasks.workunit.client.1.smithi131.stdout:0/285: rename d5/d9/d10/l4f to d5/d15/l5c 0 2024-02-15T18:31:29.298 INFO:tasks.workunit.client.1.smithi131.stdout:0/286: mknod d5/d15/d1f/c5d 0 2024-02-15T18:31:29.298 INFO:tasks.workunit.client.1.smithi131.stdout:0/287: write d5/d9/d10/d3f/f47 [5085912,34565] 0 2024-02-15T18:31:29.303 INFO:tasks.workunit.client.1.smithi131.stdout:0/288: dread d5/d9/d11/f31 [0,4194304] 0 2024-02-15T18:31:29.303 INFO:tasks.workunit.client.1.smithi131.stdout:0/289: dread - d5/d2f/f2c zero size 2024-02-15T18:31:29.303 INFO:tasks.workunit.client.1.smithi131.stdout:0/290: write d5/f56 [292151,81359] 0 2024-02-15T18:31:29.305 INFO:tasks.workunit.client.1.smithi131.stdout:0/291: dread d5/d2f/f23 [0,4194304] 0 2024-02-15T18:31:29.305 INFO:tasks.workunit.client.1.smithi131.stdout:0/292: fsync d5/d2f/d45/f51 0 2024-02-15T18:31:29.306 INFO:tasks.workunit.client.1.smithi131.stdout:0/293: link d5/fd d5/d2f/f5e 0 2024-02-15T18:31:29.306 INFO:tasks.workunit.client.1.smithi131.stdout:0/294: chown d5/d15/d1f/c5d 1958 1 2024-02-15T18:31:29.306 INFO:tasks.workunit.client.1.smithi131.stdout:0/295: creat d5/d9/d10/f5f x:0 0 0 2024-02-15T18:31:29.307 INFO:tasks.workunit.client.1.smithi131.stdout:0/296: truncate d5/f4c 209512 0 2024-02-15T18:31:29.309 INFO:tasks.workunit.client.1.smithi131.stdout:0/297: unlink d5/c35 0 2024-02-15T18:31:29.310 INFO:tasks.workunit.client.1.smithi131.stdout:0/298: write f0 [1180593,83589] 0 2024-02-15T18:31:29.311 INFO:tasks.workunit.client.1.smithi131.stdout:0/299: rename d5/d9/d10/f5f to d5/d15/f60 0 2024-02-15T18:31:29.312 INFO:tasks.workunit.client.1.smithi131.stdout:0/300: read d5/d9/d10/f19 [98436,11766] 0 2024-02-15T18:31:29.316 INFO:tasks.workunit.client.1.smithi131.stdout:0/301: rename d5/d2f/f2c to d5/d9/d10/d3f/f61 0 2024-02-15T18:31:29.318 INFO:tasks.workunit.client.1.smithi131.stdout:0/302: unlink d5/d15/f2a 0 2024-02-15T18:31:29.320 INFO:tasks.workunit.client.1.smithi131.stdout:0/303: rename d5/d9/d10/f53 to d5/f62 0 2024-02-15T18:31:29.320 INFO:tasks.workunit.client.1.smithi131.stdout:0/304: read - d5/d9/d10/d3f/f55 zero size 2024-02-15T18:31:29.321 INFO:tasks.workunit.client.1.smithi131.stdout:0/305: creat d5/d9/d4d/f63 x:0 0 0 2024-02-15T18:31:29.325 INFO:tasks.workunit.client.1.smithi131.stdout:0/306: link d5/d9/d10/l3b d5/d9/d10/l64 0 2024-02-15T18:31:29.328 INFO:tasks.workunit.client.1.smithi131.stdout:0/307: dread d5/fd [0,4194304] 0 2024-02-15T18:31:29.328 INFO:tasks.workunit.client.1.smithi131.stdout:0/308: chown d5/fd 102369 1 2024-02-15T18:31:29.329 INFO:tasks.workunit.client.1.smithi131.stdout:0/309: mknod d5/d15/d1f/c65 0 2024-02-15T18:31:29.329 INFO:tasks.workunit.client.1.smithi131.stdout:0/310: chown d5/d15/c33 6739415 1 2024-02-15T18:31:29.343 INFO:tasks.workunit.client.1.smithi131.stdout:0/311: dwrite d5/d2f/d45/f51 [0,4194304] 0 2024-02-15T18:31:29.346 INFO:tasks.workunit.client.1.smithi131.stdout:0/312: rename d5/d9/d11/d3e/c44 to d5/d2f/d45/c66 0 2024-02-15T18:31:29.348 INFO:tasks.workunit.client.1.smithi131.stdout:0/313: rename d5/d9/lb to d5/d15/d1f/l67 0 2024-02-15T18:31:29.374 INFO:tasks.workunit.client.1.smithi131.stdout:9/357: sync 2024-02-15T18:31:29.375 INFO:tasks.workunit.client.1.smithi131.stdout:1/365: sync 2024-02-15T18:31:29.375 INFO:tasks.workunit.client.1.smithi131.stdout:2/255: sync 2024-02-15T18:31:29.375 INFO:tasks.workunit.client.1.smithi131.stdout:1/366: read d0/d2/d4/d41/f6f [8032892,2397] 0 2024-02-15T18:31:29.375 INFO:tasks.workunit.client.1.smithi131.stdout:1/367: stat d0/d1/d44/d59 0 2024-02-15T18:31:29.377 INFO:tasks.workunit.client.1.smithi131.stdout:9/358: link d4/dc/d25/d3f/c53 d4/dc/de/d1e/d1f/d51/d5d/c67 0 2024-02-15T18:31:29.378 INFO:tasks.workunit.client.1.smithi131.stdout:1/368: mknod d0/d2/db/c7e 0 2024-02-15T18:31:29.379 INFO:tasks.workunit.client.1.smithi131.stdout:1/369: creat d0/d1/d24/f7f x:0 0 0 2024-02-15T18:31:29.379 INFO:tasks.workunit.client.1.smithi131.stdout:1/370: readlink d0/d2/d4/l8 0 2024-02-15T18:31:29.381 INFO:tasks.workunit.client.1.smithi131.stdout:1/371: mkdir d0/d68/d80 0 2024-02-15T18:31:29.381 INFO:tasks.workunit.client.1.smithi131.stdout:1/372: fsync d0/d2/d7/f4c 0 2024-02-15T18:31:29.381 INFO:tasks.workunit.client.1.smithi131.stdout:9/359: dread d4/dc/f2d [0,4194304] 0 2024-02-15T18:31:29.384 INFO:tasks.workunit.client.1.smithi131.stdout:9/360: rename d4/dc/de/d1e/d1f/c5e to d4/dc/d17/d19/c68 0 2024-02-15T18:31:29.399 INFO:tasks.workunit.client.1.smithi131.stdout:2/256: dwrite dd/d1e/f26 [0,4194304] 0 2024-02-15T18:31:29.399 INFO:tasks.workunit.client.1.smithi131.stdout:2/257: unlink dd/d14/d2b/f41 0 2024-02-15T18:31:29.401 INFO:tasks.workunit.client.1.smithi131.stdout:2/258: truncate dd/d10/d13/d2e/f32 731693 0 2024-02-15T18:31:29.401 INFO:tasks.workunit.client.1.smithi131.stdout:2/259: fdatasync f4 0 2024-02-15T18:31:29.403 INFO:tasks.workunit.client.1.smithi131.stdout:2/260: symlink dd/d10/d22/d2a/d48/l51 0 2024-02-15T18:31:29.413 INFO:tasks.workunit.client.1.smithi131.stdout:9/361: dwrite d4/dc/d25/d3f/f5c [0,4194304] 0 2024-02-15T18:31:29.413 INFO:tasks.workunit.client.1.smithi131.stdout:1/373: dwrite d0/d1/f38 [0,4194304] 0 2024-02-15T18:31:29.418 INFO:tasks.workunit.client.1.smithi131.stdout:1/374: dread d0/d2/db/f7c [0,4194304] 0 2024-02-15T18:31:29.418 INFO:tasks.workunit.client.1.smithi131.stdout:1/375: read - d0/d2/d7/f53 zero size 2024-02-15T18:31:29.421 INFO:tasks.workunit.client.1.smithi131.stdout:9/362: rmdir d4/dc/de/d1e 39 2024-02-15T18:31:29.421 INFO:tasks.workunit.client.1.smithi131.stdout:9/363: fsync d4/dc/d25/d3f/f5c 0 2024-02-15T18:31:29.424 INFO:tasks.workunit.client.1.smithi131.stdout:1/376: unlink d0/d2/d4/da/f10 0 2024-02-15T18:31:29.424 INFO:tasks.workunit.client.1.smithi131.stdout:1/377: write d0/d1/d44/d59/f6d [5176529,116193] 0 2024-02-15T18:31:29.425 INFO:tasks.workunit.client.1.smithi131.stdout:1/378: read d0/d2/d7/f4c [3902807,54948] 0 2024-02-15T18:31:29.426 INFO:tasks.workunit.client.1.smithi131.stdout:1/379: write d0/d1/f38 [4107930,56784] 0 2024-02-15T18:31:29.447 INFO:tasks.workunit.client.1.smithi131.stdout:1/380: dwrite d0/f4d [0,4194304] 0 2024-02-15T18:31:29.447 INFO:tasks.workunit.client.1.smithi131.stdout:1/381: rmdir d0/d2/d4 39 2024-02-15T18:31:29.449 INFO:tasks.workunit.client.1.smithi131.stdout:1/382: symlink d0/d1/d44/d59/d42/l81 0 2024-02-15T18:31:29.450 INFO:tasks.workunit.client.1.smithi131.stdout:1/383: read d0/d1/d16/d19/f1b [5189880,104898] 0 2024-02-15T18:31:29.450 INFO:tasks.workunit.client.1.smithi131.stdout:1/384: dread - d0/d1/d44/f70 zero size 2024-02-15T18:31:29.470 INFO:tasks.workunit.client.1.smithi131.stdout:1/385: dwrite d0/d2/d31/d3d/d46/f50 [0,4194304] 0 2024-02-15T18:31:29.472 INFO:tasks.workunit.client.1.smithi131.stdout:1/386: symlink d0/d68/l82 0 2024-02-15T18:31:29.488 INFO:tasks.workunit.client.1.smithi131.stdout:1/387: dread d0/d2/d4/da/f2a [0,4194304] 0 2024-02-15T18:31:29.490 INFO:tasks.workunit.client.1.smithi131.stdout:1/388: write d0/d1/d16/f43 [3952823,129744] 0 2024-02-15T18:31:29.493 INFO:tasks.workunit.client.1.smithi131.stdout:1/389: link d0/d1/d16/d19/l75 d0/d1/d16/d4b/l83 0 2024-02-15T18:31:29.494 INFO:tasks.workunit.client.1.smithi131.stdout:1/390: write d0/d1/d16/f20 [3629904,76090] 0 2024-02-15T18:31:29.494 INFO:tasks.workunit.client.1.smithi131.stdout:1/391: chown d0/d2/d4/d5d 17744634 1 2024-02-15T18:31:29.496 INFO:tasks.workunit.client.1.smithi131.stdout:1/392: mknod d0/d2/d31/d3d/d46/c84 0 2024-02-15T18:31:29.498 INFO:tasks.workunit.client.1.smithi131.stdout:1/393: creat d0/d2/db/f85 x:0 0 0 2024-02-15T18:31:29.498 INFO:tasks.workunit.client.1.smithi131.stdout:1/394: stat d0/d2/d4/c18 0 2024-02-15T18:31:29.499 INFO:tasks.workunit.client.1.smithi131.stdout:1/395: dread d0/d2/db/f7c [0,4194304] 0 2024-02-15T18:31:29.501 INFO:tasks.workunit.client.1.smithi131.stdout:1/396: dread d0/d2/d4/d5d/f60 [0,4194304] 0 2024-02-15T18:31:29.503 INFO:tasks.workunit.client.1.smithi131.stdout:1/397: creat d0/d2/d4/d41/d5a/f86 x:0 0 0 2024-02-15T18:31:29.508 INFO:tasks.workunit.client.1.smithi131.stdout:1/398: dread d0/d1/d24/f2f [0,4194304] 0 2024-02-15T18:31:29.510 INFO:tasks.workunit.client.1.smithi131.stdout:1/399: creat d0/d1/d16/d6b/f87 x:0 0 0 2024-02-15T18:31:29.511 INFO:tasks.workunit.client.1.smithi131.stdout:1/400: write d0/d2/d4/f32 [1489776,128959] 0 2024-02-15T18:31:29.511 INFO:tasks.workunit.client.1.smithi131.stdout:1/401: dread - d0/d2/d7/f53 zero size 2024-02-15T18:31:29.511 INFO:tasks.workunit.client.1.smithi131.stdout:1/402: chown d0/d1/d44 7 1 2024-02-15T18:31:29.511 INFO:tasks.workunit.client.1.smithi131.stdout:1/403: fdatasync d0/d2/d4/da/f2a 0 2024-02-15T18:31:29.512 INFO:tasks.workunit.client.1.smithi131.stdout:1/404: creat d0/d2/d4/d5d/f88 x:0 0 0 2024-02-15T18:31:29.513 INFO:tasks.workunit.client.1.smithi131.stdout:1/405: mkdir d0/d1/d24/d89 0 2024-02-15T18:31:29.513 INFO:tasks.workunit.client.1.smithi131.stdout:1/406: chown d0/d1/d44/f6c 58879 1 2024-02-15T18:31:29.515 INFO:tasks.workunit.client.1.smithi131.stdout:1/407: mknod d0/d1/d16/d6b/c8a 0 2024-02-15T18:31:29.516 INFO:tasks.workunit.client.1.smithi131.stdout:1/408: symlink d0/d2/d7/d72/l8b 0 2024-02-15T18:31:29.518 INFO:tasks.workunit.client.1.smithi131.stdout:1/409: truncate d0/d2/f37 4573558 0 2024-02-15T18:31:29.520 INFO:tasks.workunit.client.1.smithi131.stdout:1/410: rmdir d0/d2/d4/d41 39 2024-02-15T18:31:29.522 INFO:tasks.workunit.client.1.smithi131.stdout:1/411: link d0/d1/d44/l76 d0/d2/d4/l8c 0 2024-02-15T18:31:29.547 INFO:tasks.workunit.client.1.smithi131.stdout:1/412: dwrite d0/d2/d4/d41/f6f [0,4194304] 0 2024-02-15T18:31:29.550 INFO:tasks.workunit.client.1.smithi131.stdout:1/413: mknod d0/d1/d24/c8d 0 2024-02-15T18:31:29.550 INFO:tasks.workunit.client.1.smithi131.stdout:1/414: write d0/d1/d44/f6c [441356,3924] 0 2024-02-15T18:31:29.573 INFO:tasks.workunit.client.1.smithi131.stdout:1/415: dwrite d0/d2/d4/da/f1f [4194304,4194304] 0 2024-02-15T18:31:29.576 INFO:tasks.workunit.client.1.smithi131.stdout:1/416: read d0/d2/d7/f1e [2290702,120768] 0 2024-02-15T18:31:29.576 INFO:tasks.workunit.client.1.smithi131.stdout:1/417: write d0/d2/db/f85 [221141,112877] 0 2024-02-15T18:31:29.580 INFO:tasks.workunit.client.1.smithi131.stdout:1/418: symlink d0/d1/d16/l8e 0 2024-02-15T18:31:29.610 INFO:tasks.workunit.client.1.smithi131.stdout:1/419: dwrite d0/d1/d16/d6b/f87 [0,4194304] 0 2024-02-15T18:31:29.614 INFO:tasks.workunit.client.1.smithi131.stdout:7/479: sync 2024-02-15T18:31:29.614 INFO:tasks.workunit.client.1.smithi131.stdout:5/412: sync 2024-02-15T18:31:29.614 INFO:tasks.workunit.client.1.smithi131.stdout:1/420: unlink d0/d1/l4f 0 2024-02-15T18:31:29.616 INFO:tasks.workunit.client.1.smithi131.stdout:7/480: read d0/d17/f21 [3571819,41664] 0 2024-02-15T18:31:29.616 INFO:tasks.workunit.client.1.smithi131.stdout:7/481: write d0/d17/d36/f48 [1021878,86065] 0 2024-02-15T18:31:29.616 INFO:tasks.workunit.client.1.smithi131.stdout:7/482: readlink d0/d34/l8f 0 2024-02-15T18:31:29.616 INFO:tasks.workunit.client.1.smithi131.stdout:7/483: readlink d0/l4d 0 2024-02-15T18:31:29.616 INFO:tasks.workunit.client.1.smithi131.stdout:7/484: truncate d0/f88 894162 0 2024-02-15T18:31:29.617 INFO:tasks.workunit.client.1.smithi131.stdout:7/485: write d0/d17/d3a/f91 [848881,77206] 0 2024-02-15T18:31:29.617 INFO:tasks.workunit.client.1.smithi131.stdout:1/421: mknod d0/d2/d7/c8f 0 2024-02-15T18:31:29.620 INFO:tasks.workunit.client.1.smithi131.stdout:1/422: creat d0/d2/d7/f90 x:0 0 0 2024-02-15T18:31:29.652 INFO:tasks.workunit.client.1.smithi131.stdout:5/413: dwrite d18/d4e/f64 [0,4194304] 0 2024-02-15T18:31:29.653 INFO:tasks.workunit.client.1.smithi131.stdout:5/414: truncate d18/f50 703010 0 2024-02-15T18:31:29.653 INFO:tasks.workunit.client.1.smithi131.stdout:5/415: stat d18/d24/f4a 0 2024-02-15T18:31:29.653 INFO:tasks.workunit.client.1.smithi131.stdout:5/416: stat d18/d24/l47 0 2024-02-15T18:31:29.653 INFO:tasks.workunit.client.1.smithi131.stdout:5/417: stat d18/d4e 0 2024-02-15T18:31:29.653 INFO:tasks.workunit.client.1.smithi131.stdout:5/418: write d18/d24/d7b/f84 [577344,125546] 0 2024-02-15T18:31:29.653 INFO:tasks.workunit.client.1.smithi131.stdout:5/419: read d18/d24/d7b/f84 [119032,12633] 0 2024-02-15T18:31:29.655 INFO:tasks.workunit.client.1.smithi131.stdout:7/486: dwrite d0/d17/f3c [0,4194304] 0 2024-02-15T18:31:29.655 INFO:tasks.workunit.client.1.smithi131.stdout:5/420: creat d18/d83/d89/f8a x:0 0 0 2024-02-15T18:31:29.658 INFO:tasks.workunit.client.1.smithi131.stdout:7/487: mkdir d0/d34/d8e/d98 0 2024-02-15T18:31:29.660 INFO:tasks.workunit.client.1.smithi131.stdout:7/488: link d0/d34/l8f d0/d17/d3a/d3d/d92/l99 0 2024-02-15T18:31:29.662 INFO:tasks.workunit.client.1.smithi131.stdout:7/489: mkdir d0/d34/d8b/d9a 0 2024-02-15T18:31:29.662 INFO:tasks.workunit.client.1.smithi131.stdout:7/490: truncate d0/d17/d36/f81 962970 0 2024-02-15T18:31:29.681 INFO:tasks.workunit.client.1.smithi131.stdout:7/491: dread d0/f14 [0,4194304] 0 2024-02-15T18:31:29.681 INFO:tasks.workunit.client.1.smithi131.stdout:7/492: fsync d0/d34/f35 0 2024-02-15T18:31:29.685 INFO:tasks.workunit.client.1.smithi131.stdout:7/493: mknod d0/d34/d8e/c9b 0 2024-02-15T18:31:29.685 INFO:tasks.workunit.client.1.smithi131.stdout:7/494: write d0/d17/d3a/d3d/f73 [27269,96000] 0 2024-02-15T18:31:29.694 INFO:tasks.workunit.client.1.smithi131.stdout:7/495: dread d0/d17/d3a/d3d/d92/f93 [0,4194304] 0 2024-02-15T18:31:29.697 INFO:tasks.workunit.client.1.smithi131.stdout:7/496: creat d0/d17/d3a/d3d/d79/f9c x:0 0 0 2024-02-15T18:31:29.698 INFO:tasks.workunit.client.1.smithi131.stdout:7/497: mkdir d0/d9d 0 2024-02-15T18:31:29.698 INFO:tasks.workunit.client.1.smithi131.stdout:7/498: write d0/f88 [342311,36351] 0 2024-02-15T18:31:29.698 INFO:tasks.workunit.client.1.smithi131.stdout:7/499: chown d0/d17/d3a/f91 0 1 2024-02-15T18:31:29.698 INFO:tasks.workunit.client.1.smithi131.stdout:7/500: chown d0/d34/l8f 281 1 2024-02-15T18:31:29.700 INFO:tasks.workunit.client.1.smithi131.stdout:7/501: creat d0/d17/d3a/d3d/d92/f9e x:0 0 0 2024-02-15T18:31:29.701 INFO:tasks.workunit.client.1.smithi131.stdout:7/502: mknod d0/d17/d3a/d3d/c9f 0 2024-02-15T18:31:29.703 INFO:tasks.workunit.client.1.smithi131.stdout:7/503: mknod d0/ca0 0 2024-02-15T18:31:29.725 INFO:tasks.workunit.client.1.smithi131.stdout:7/504: dwrite d0/d17/d36/f3f [0,4194304] 0 2024-02-15T18:31:29.729 INFO:tasks.workunit.client.1.smithi131.stdout:7/505: truncate d0/d17/d36/f6b 458102 0 2024-02-15T18:31:29.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:28.467116+0000 mon.smithi033 (mon.0) 666 : cluster [DBG] mgrmap e25: smithi033.apxevf(active, since 1.5327s) 2024-02-15T18:31:29.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:28.507253+0000 mgr.smithi033.apxevf (mgr.14626) 2 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-02-15T18:31:29.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:28.941379+0000 mon.smithi033 (mon.0) 667 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:31:29.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:28.941503+0000 mon.smithi033 (mon.0) 668 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2024-02-15T18:31:29.754 INFO:tasks.workunit.client.1.smithi131.stdout:7/506: dwrite d0/f65 [0,4194304] 0 2024-02-15T18:31:29.758 INFO:tasks.workunit.client.1.smithi131.stdout:7/507: rename d0/d17/l1f to d0/d34/la1 0 2024-02-15T18:31:29.758 INFO:tasks.workunit.client.1.smithi131.stdout:7/508: getdents d0/d34/d8b/d9a 0 2024-02-15T18:31:29.758 INFO:tasks.workunit.client.1.smithi131.stdout:7/509: dread - d0/d34/f8d zero size 2024-02-15T18:31:29.762 INFO:tasks.workunit.client.1.smithi131.stdout:7/510: dread d0/d34/f67 [0,4194304] 0 2024-02-15T18:31:29.785 INFO:tasks.workunit.client.1.smithi131.stdout:7/511: dwrite d0/d34/f97 [0,4194304] 0 2024-02-15T18:31:29.787 INFO:tasks.workunit.client.1.smithi131.stdout:7/512: creat d0/d34/fa2 x:0 0 0 2024-02-15T18:31:29.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:28.467116+0000 mon.smithi033 (mon.0) 666 : cluster [DBG] mgrmap e25: smithi033.apxevf(active, since 1.5327s) 2024-02-15T18:31:29.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:28.507253+0000 mgr.smithi033.apxevf (mgr.14626) 2 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-02-15T18:31:29.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:28.941379+0000 mon.smithi033 (mon.0) 667 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-15T18:31:29.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:28.941503+0000 mon.smithi033 (mon.0) 668 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2024-02-15T18:31:29.806 INFO:tasks.workunit.client.1.smithi131.stdout:7/513: dwrite d0/d17/f5c [0,4194304] 0 2024-02-15T18:31:29.806 INFO:tasks.workunit.client.1.smithi131.stdout:7/514: chown d0/d17/d3a/d3d/d79/d89/f96 852849 1 2024-02-15T18:31:29.807 INFO:tasks.workunit.client.1.smithi131.stdout:7/515: symlink d0/d17/d3a/d3d/la3 0 2024-02-15T18:31:29.808 INFO:tasks.workunit.client.1.smithi131.stdout:7/516: getdents d0/d17 0 2024-02-15T18:31:29.809 INFO:tasks.workunit.client.1.smithi131.stdout:7/517: unlink d0/f5f 0 2024-02-15T18:31:29.830 INFO:tasks.workunit.client.1.smithi131.stdout:6/327: sync 2024-02-15T18:31:29.831 INFO:tasks.workunit.client.1.smithi131.stdout:7/518: symlink d0/d17/d36/la4 0 2024-02-15T18:31:29.831 INFO:tasks.workunit.client.1.smithi131.stdout:7/519: write d0/fb [781137,15418] 0 2024-02-15T18:31:29.832 INFO:tasks.workunit.client.1.smithi131.stdout:6/328: rename d2/d7/d16/l3d to d2/d36/l67 0 2024-02-15T18:31:29.833 INFO:tasks.workunit.client.1.smithi131.stdout:7/520: symlink d0/d34/d8b/la5 0 2024-02-15T18:31:29.833 INFO:tasks.workunit.client.1.smithi131.stdout:7/521: readlink d0/d34/d8b/la5 0 2024-02-15T18:31:29.844 INFO:tasks.workunit.client.1.smithi131.stdout:7/522: dread d0/d17/d3a/d3d/f56 [0,4194304] 0 2024-02-15T18:31:29.863 INFO:tasks.workunit.client.1.smithi131.stdout:6/329: dwrite d2/f28 [0,4194304] 0 2024-02-15T18:31:29.863 INFO:tasks.workunit.client.1.smithi131.stdout:6/330: stat d2/dc/c1d 0 2024-02-15T18:31:29.866 INFO:tasks.workunit.client.1.smithi131.stdout:6/331: creat d2/dc/f68 x:0 0 0 2024-02-15T18:31:29.866 INFO:tasks.workunit.client.1.smithi131.stdout:6/332: dread - d2/d2b/f56 zero size 2024-02-15T18:31:29.872 INFO:tasks.workunit.client.1.smithi131.stdout:7/523: dwrite d0/d34/f41 [0,4194304] 0 2024-02-15T18:31:29.875 INFO:tasks.workunit.client.1.smithi131.stdout:7/524: creat d0/d17/d3a/d3d/fa6 x:0 0 0 2024-02-15T18:31:29.875 INFO:tasks.workunit.client.1.smithi131.stdout:7/525: write d0/d17/f21 [4232820,115334] 0 2024-02-15T18:31:29.875 INFO:tasks.workunit.client.1.smithi131.stdout:7/526: stat d0/f57 0 2024-02-15T18:31:29.875 INFO:tasks.workunit.client.1.smithi131.stdout:3/434: sync 2024-02-15T18:31:29.875 INFO:tasks.workunit.client.1.smithi131.stdout:4/437: sync 2024-02-15T18:31:29.875 INFO:tasks.workunit.client.1.smithi131.stdout:3/435: write d2/d22/d29/db/f76 [4333862,69080] 0 2024-02-15T18:31:29.876 INFO:tasks.workunit.client.1.smithi131.stdout:6/333: dread d2/d7/d16/f1e [0,4194304] 0 2024-02-15T18:31:29.879 INFO:tasks.workunit.client.1.smithi131.stdout:7/527: creat d0/d34/d8b/fa7 x:0 0 0 2024-02-15T18:31:29.880 INFO:tasks.workunit.client.1.smithi131.stdout:4/438: creat d2/d7/d12/d2e/d39/f9d x:0 0 0 2024-02-15T18:31:29.881 INFO:tasks.workunit.client.1.smithi131.stdout:6/334: truncate d2/d7/d48/f49 1045527 0 2024-02-15T18:31:29.881 INFO:tasks.workunit.client.1.smithi131.stdout:6/335: chown d2/d36/f5a 7 1 2024-02-15T18:31:29.882 INFO:tasks.workunit.client.1.smithi131.stdout:7/528: creat d0/d34/d8e/d98/fa8 x:0 0 0 2024-02-15T18:31:29.882 INFO:tasks.workunit.client.1.smithi131.stdout:7/529: dread - d0/d17/d3a/d3d/d79/d89/f95 zero size 2024-02-15T18:31:29.882 INFO:tasks.workunit.client.1.smithi131.stdout:7/530: write d0/d17/d36/f48 [1806326,36019] 0 2024-02-15T18:31:29.882 INFO:tasks.workunit.client.1.smithi131.stdout:7/531: chown d0/l11 8412 1 2024-02-15T18:31:29.883 INFO:tasks.workunit.client.1.smithi131.stdout:4/439: getdents d2 0 2024-02-15T18:31:29.883 INFO:tasks.workunit.client.1.smithi131.stdout:4/440: fdatasync d2/f8 0 2024-02-15T18:31:29.888 INFO:tasks.workunit.client.1.smithi131.stdout:6/336: creat d2/d2b/f69 x:0 0 0 2024-02-15T18:31:29.888 INFO:tasks.workunit.client.1.smithi131.stdout:6/337: truncate d2/dc/f5f 103410 0 2024-02-15T18:31:29.889 INFO:tasks.workunit.client.1.smithi131.stdout:7/532: mkdir d0/da9 0 2024-02-15T18:31:29.889 INFO:tasks.workunit.client.1.smithi131.stdout:7/533: fdatasync d0/d17/d3a/d3d/fa6 0 2024-02-15T18:31:29.889 INFO:tasks.workunit.client.1.smithi131.stdout:6/338: write d2/d7/fa [2240972,29770] 0 2024-02-15T18:31:29.889 INFO:tasks.workunit.client.1.smithi131.stdout:6/339: truncate d2/dc/f64 323 0 2024-02-15T18:31:29.889 INFO:tasks.workunit.client.1.smithi131.stdout:6/340: dread - d2/dc/d27/f55 zero size 2024-02-15T18:31:29.890 INFO:tasks.workunit.client.1.smithi131.stdout:6/341: mknod d2/d7/d48/d40/d61/c6a 0 2024-02-15T18:31:29.893 INFO:tasks.workunit.client.1.smithi131.stdout:4/441: dread d2/d2a/d47/d16/f30 [0,4194304] 0 2024-02-15T18:31:29.894 INFO:tasks.workunit.client.1.smithi131.stdout:6/342: read d2/f28 [2503425,1465] 0 2024-02-15T18:31:29.898 INFO:tasks.workunit.client.1.smithi131.stdout:4/442: mkdir d2/d2a/d47/d21/d9e 0 2024-02-15T18:31:29.898 INFO:tasks.workunit.client.1.smithi131.stdout:4/443: chown d2/d7/d12/f9c 1215 1 2024-02-15T18:31:29.898 INFO:tasks.workunit.client.1.smithi131.stdout:4/444: chown d2/l1e 6009803 1 2024-02-15T18:31:29.898 INFO:tasks.workunit.client.1.smithi131.stdout:4/445: chown d2/d23/l62 2438 1 2024-02-15T18:31:29.899 INFO:tasks.workunit.client.1.smithi131.stdout:6/343: symlink d2/d7/d12/d4d/l6b 0 2024-02-15T18:31:29.901 INFO:tasks.workunit.client.1.smithi131.stdout:4/446: creat d2/d2a/f9f x:0 0 0 2024-02-15T18:31:29.902 INFO:tasks.workunit.client.1.smithi131.stdout:4/447: write d2/f4 [2330064,1016] 0 2024-02-15T18:31:29.902 INFO:tasks.workunit.client.1.smithi131.stdout:6/344: symlink d2/d7/d12/d4d/l6c 0 2024-02-15T18:31:29.902 INFO:tasks.workunit.client.1.smithi131.stdout:4/448: read d2/f4 [2491037,106948] 0 2024-02-15T18:31:29.903 INFO:tasks.workunit.client.1.smithi131.stdout:4/449: creat d2/d7/d12/fa0 x:0 0 0 2024-02-15T18:31:29.904 INFO:tasks.workunit.client.1.smithi131.stdout:6/345: truncate f0 7713345 0 2024-02-15T18:31:29.905 INFO:tasks.workunit.client.1.smithi131.stdout:4/450: rmdir d2/d7/d1c/d5d/d7a 39 2024-02-15T18:31:29.906 INFO:tasks.workunit.client.1.smithi131.stdout:7/534: dwrite d0/f4a [0,4194304] 0 2024-02-15T18:31:29.906 INFO:tasks.workunit.client.1.smithi131.stdout:6/346: mkdir d2/d6d 0 2024-02-15T18:31:29.908 INFO:tasks.workunit.client.1.smithi131.stdout:4/451: creat d2/d7/d1c/d94/fa1 x:0 0 0 2024-02-15T18:31:29.909 INFO:tasks.workunit.client.1.smithi131.stdout:7/535: mknod d0/d17/d3a/d3d/d92/caa 0 2024-02-15T18:31:29.909 INFO:tasks.workunit.client.1.smithi131.stdout:7/536: write d0/d17/d3a/d3d/d79/d89/f95 [894097,81040] 0 2024-02-15T18:31:29.909 INFO:tasks.workunit.client.1.smithi131.stdout:7/537: stat d0/d34/d8e/d98 0 2024-02-15T18:31:29.913 INFO:tasks.workunit.client.1.smithi131.stdout:6/347: rename d2/d38 to d2/d2b/d6e 0 2024-02-15T18:31:29.913 INFO:tasks.workunit.client.1.smithi131.stdout:6/348: chown d2/d36 13201 1 2024-02-15T18:31:29.914 INFO:tasks.workunit.client.1.smithi131.stdout:4/452: symlink d2/d2a/d47/la2 0 2024-02-15T18:31:29.914 INFO:tasks.workunit.client.1.smithi131.stdout:7/538: creat d0/d34/d8b/fab x:0 0 0 2024-02-15T18:31:29.915 INFO:tasks.workunit.client.1.smithi131.stdout:6/349: read d2/dc/f64 [30,128615] 0 2024-02-15T18:31:29.915 INFO:tasks.workunit.client.1.smithi131.stdout:6/350: readlink d2/d36/l67 0 2024-02-15T18:31:29.915 INFO:tasks.workunit.client.1.smithi131.stdout:6/351: chown d2/d36 0 1 2024-02-15T18:31:29.917 INFO:tasks.workunit.client.1.smithi131.stdout:6/352: getdents d2/dc 0 2024-02-15T18:31:29.922 INFO:tasks.workunit.client.1.smithi131.stdout:6/353: creat d2/d2b/d6e/f6f x:0 0 0 2024-02-15T18:31:29.939 INFO:tasks.workunit.client.1.smithi131.stdout:7/539: dwrite d0/d17/d3a/d3d/f84 [4194304,4194304] 0 2024-02-15T18:31:29.939 INFO:tasks.workunit.client.1.smithi131.stdout:7/540: truncate d0/f7c 287642 0 2024-02-15T18:31:29.941 INFO:tasks.workunit.client.1.smithi131.stdout:7/541: dread d0/f88 [0,4194304] 0 2024-02-15T18:31:29.951 INFO:tasks.workunit.client.1.smithi131.stdout:6/354: dwrite d2/d7/f54 [0,4194304] 0 2024-02-15T18:31:29.953 INFO:tasks.workunit.client.1.smithi131.stdout:6/355: creat d2/dc/d1f/f70 x:0 0 0 2024-02-15T18:31:29.953 INFO:tasks.workunit.client.1.smithi131.stdout:4/453: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:29.953 INFO:tasks.workunit.client.1.smithi131.stdout:7/542: dread d0/f4a [0,4194304] 0 2024-02-15T18:31:29.953 INFO:tasks.workunit.client.1.smithi131.stdout:7/543: truncate d0/d17/f82 400962 0 2024-02-15T18:31:29.954 INFO:tasks.workunit.client.1.smithi131.stdout:6/356: mknod d2/d7/c71 0 2024-02-15T18:31:29.954 INFO:tasks.workunit.client.1.smithi131.stdout:6/357: stat d2/d36 0 2024-02-15T18:31:29.954 INFO:tasks.workunit.client.1.smithi131.stdout:4/454: mkdir d2/d2a/d85/da3 0 2024-02-15T18:31:29.956 INFO:tasks.workunit.client.1.smithi131.stdout:7/544: link d0/c5b d0/d17/d3a/d3d/d79/d89/cac 0 2024-02-15T18:31:29.956 INFO:tasks.workunit.client.1.smithi131.stdout:7/545: fsync d0/d34/f67 0 2024-02-15T18:31:29.966 INFO:tasks.workunit.client.1.smithi131.stdout:4/455: dread d2/d7/f1d [0,4194304] 0 2024-02-15T18:31:30.037 INFO:tasks.workunit.client.1.smithi131.stdout:6/358: mknod d2/dc/d27/c72 0 2024-02-15T18:31:30.037 INFO:tasks.workunit.client.1.smithi131.stdout:6/359: readlink d2/d7/d12/d4d/l6c 0 2024-02-15T18:31:30.038 INFO:tasks.workunit.client.1.smithi131.stdout:7/546: rename d0/d17/d36/c5d to d0/d34/d8b/cad 0 2024-02-15T18:31:30.046 INFO:tasks.workunit.client.1.smithi131.stdout:6/360: creat d2/d7/f73 x:0 0 0 2024-02-15T18:31:30.047 INFO:tasks.workunit.client.1.smithi131.stdout:7/547: stat d0/d34/d8b/cad 0 2024-02-15T18:31:30.047 INFO:tasks.workunit.client.1.smithi131.stdout:6/361: mkdir d2/dc/d27/d74 0 2024-02-15T18:31:30.048 INFO:tasks.workunit.client.1.smithi131.stdout:7/548: mknod d0/d9d/cae 0 2024-02-15T18:31:30.048 INFO:tasks.workunit.client.1.smithi131.stdout:7/549: write d0/f4a [996508,28432] 0 2024-02-15T18:31:30.056 INFO:tasks.workunit.client.1.smithi131.stdout:8/304: sync 2024-02-15T18:31:30.056 INFO:tasks.workunit.client.1.smithi131.stdout:8/305: chown l3 12342 1 2024-02-15T18:31:30.056 INFO:tasks.workunit.client.1.smithi131.stdout:8/306: chown d22/c25 3 1 2024-02-15T18:31:30.057 INFO:tasks.workunit.client.1.smithi131.stdout:6/362: mkdir d2/dc/d27/d74/d75 0 2024-02-15T18:31:30.057 INFO:tasks.workunit.client.1.smithi131.stdout:6/363: dread - d2/d7/d48/f5c zero size 2024-02-15T18:31:30.058 INFO:tasks.workunit.client.1.smithi131.stdout:8/307: rename c9 to d22/d26/d3f/d47/d57/c65 0 2024-02-15T18:31:30.061 INFO:tasks.workunit.client.1.smithi131.stdout:8/308: symlink d22/d26/d3f/d47/d48/l66 0 2024-02-15T18:31:30.062 INFO:tasks.workunit.client.1.smithi131.stdout:8/309: getdents d22 0 2024-02-15T18:31:30.064 INFO:tasks.workunit.client.1.smithi131.stdout:8/310: rename c20 to d22/d26/d3f/d47/d57/c67 0 2024-02-15T18:31:30.065 INFO:tasks.workunit.client.1.smithi131.stdout:8/311: creat d22/d2e/d60/f68 x:0 0 0 2024-02-15T18:31:30.066 INFO:tasks.workunit.client.1.smithi131.stdout:6/364: dread d2/d7/d16/f43 [0,4194304] 0 2024-02-15T18:31:30.066 INFO:tasks.workunit.client.1.smithi131.stdout:6/365: write d2/f45 [508485,116602] 0 2024-02-15T18:31:30.067 INFO:tasks.workunit.client.1.smithi131.stdout:6/366: symlink d2/dc/d27/d74/l76 0 2024-02-15T18:31:30.067 INFO:tasks.workunit.client.1.smithi131.stdout:8/312: dread d22/d26/d3f/f44 [0,4194304] 0 2024-02-15T18:31:30.068 INFO:tasks.workunit.client.1.smithi131.stdout:7/550: dwrite d0/d17/d36/f3f [0,4194304] 0 2024-02-15T18:31:30.069 INFO:tasks.workunit.client.1.smithi131.stdout:6/367: unlink d2/d7/d16/l3a 0 2024-02-15T18:31:30.069 INFO:tasks.workunit.client.1.smithi131.stdout:6/368: readlink d2/d7/d12/d4d/l6b 0 2024-02-15T18:31:30.069 INFO:tasks.workunit.client.1.smithi131.stdout:7/551: symlink d0/d17/laf 0 2024-02-15T18:31:30.083 INFO:tasks.workunit.client.1.smithi131.stdout:7/552: dwrite d0/d17/f6c [0,4194304] 0 2024-02-15T18:31:30.104 INFO:tasks.workunit.client.1.smithi131.stdout:6/369: symlink d2/dc/d1f/l77 0 2024-02-15T18:31:30.104 INFO:tasks.workunit.client.1.smithi131.stdout:6/370: dread - d2/d7/d48/f59 zero size 2024-02-15T18:31:30.107 INFO:tasks.workunit.client.1.smithi131.stdout:7/553: symlink d0/da9/lb0 0 2024-02-15T18:31:30.127 INFO:tasks.workunit.client.1.smithi131.stdout:7/554: dwrite d0/d17/f23 [0,4194304] 0 2024-02-15T18:31:30.206 INFO:tasks.workunit.client.1.smithi131.stdout:7/555: truncate d0/d17/d3a/f62 82988 0 2024-02-15T18:31:30.208 INFO:tasks.workunit.client.1.smithi131.stdout:7/556: rmdir d0/d17/d3a/d3d 39 2024-02-15T18:31:30.218 INFO:tasks.workunit.client.1.smithi131.stdout:7/557: dread d0/f65 [0,4194304] 0 2024-02-15T18:31:30.218 INFO:tasks.workunit.client.1.smithi131.stdout:7/558: fsync d0/d17/f4b 0 2024-02-15T18:31:30.218 INFO:tasks.workunit.client.1.smithi131.stdout:7/559: read d0/d17/d3a/f63 [4096269,18414] 0 2024-02-15T18:31:30.282 INFO:tasks.workunit.client.1.smithi131.stdout:1/423: sync 2024-02-15T18:31:30.282 INFO:tasks.workunit.client.1.smithi131.stdout:9/364: sync 2024-02-15T18:31:30.282 INFO:tasks.workunit.client.1.smithi131.stdout:9/365: chown d4/dc/de 32590 1 2024-02-15T18:31:30.282 INFO:tasks.workunit.client.1.smithi131.stdout:0/314: sync 2024-02-15T18:31:30.282 INFO:tasks.workunit.client.1.smithi131.stdout:0/315: write d5/d9/f3d [102987,17243] 0 2024-02-15T18:31:30.282 INFO:tasks.workunit.client.1.smithi131.stdout:2/261: sync 2024-02-15T18:31:30.283 INFO:tasks.workunit.client.1.smithi131.stdout:1/424: chown d0/d68 119 1 2024-02-15T18:31:30.284 INFO:tasks.workunit.client.1.smithi131.stdout:9/366: read d4/dc/de/d1e/d1f/f3a [3464336,44535] 0 2024-02-15T18:31:30.285 INFO:tasks.workunit.client.1.smithi131.stdout:2/262: creat dd/d10/d22/f52 x:0 0 0 2024-02-15T18:31:30.286 INFO:tasks.workunit.client.1.smithi131.stdout:1/425: write d0/d2/d4/f32 [5041190,25632] 0 2024-02-15T18:31:30.287 INFO:tasks.workunit.client.1.smithi131.stdout:9/367: link d4/dc/f36 d4/dc/d17/f69 0 2024-02-15T18:31:30.287 INFO:tasks.workunit.client.1.smithi131.stdout:9/368: fsync d4/dc/d17/d19/fb 0 2024-02-15T18:31:30.288 INFO:tasks.workunit.client.1.smithi131.stdout:1/426: getdents d0/d2 0 2024-02-15T18:31:30.288 INFO:tasks.workunit.client.1.smithi131.stdout:1/427: stat d0/d2/d4/d41/d5a/d5f/c66 0 2024-02-15T18:31:30.290 INFO:tasks.workunit.client.1.smithi131.stdout:0/316: dread f0 [0,4194304] 0 2024-02-15T18:31:30.293 INFO:tasks.workunit.client.1.smithi131.stdout:0/317: read d5/d9/f2e [1628747,16327] 0 2024-02-15T18:31:30.293 INFO:tasks.workunit.client.1.smithi131.stdout:9/369: creat d4/dc/de/d1e/d1f/d2c/f6a x:0 0 0 2024-02-15T18:31:30.294 INFO:tasks.workunit.client.1.smithi131.stdout:1/428: creat d0/d1/d16/d30/f91 x:0 0 0 2024-02-15T18:31:30.294 INFO:tasks.workunit.client.1.smithi131.stdout:1/429: chown d0/d1/d16/d6b/f87 0 1 2024-02-15T18:31:30.294 INFO:tasks.workunit.client.1.smithi131.stdout:1/430: dread - d0/d2/d4/d5d/f67 zero size 2024-02-15T18:31:30.295 INFO:tasks.workunit.client.1.smithi131.stdout:9/370: write d4/dc/d25/d3f/f5c [165647,42467] 0 2024-02-15T18:31:30.297 INFO:tasks.workunit.client.1.smithi131.stdout:1/431: mknod d0/d2/d31/d3d/c92 0 2024-02-15T18:31:30.300 INFO:tasks.workunit.client.1.smithi131.stdout:9/371: creat d4/dc/d17/d19/d41/d5b/f6b x:0 0 0 2024-02-15T18:31:30.304 INFO:tasks.workunit.client.1.smithi131.stdout:1/432: symlink d0/d2/d7/d72/l93 0 2024-02-15T18:31:30.309 INFO:tasks.workunit.client.1.smithi131.stdout:1/433: mknod d0/d2/d4/c94 0 2024-02-15T18:31:30.310 INFO:tasks.workunit.client.1.smithi131.stdout:1/434: symlink d0/d2/d31/l95 0 2024-02-15T18:31:30.311 INFO:tasks.workunit.client.1.smithi131.stdout:1/435: link d0/d2/f37 d0/d2/d4/d41/d5a/f96 0 2024-02-15T18:31:30.311 INFO:tasks.workunit.client.1.smithi131.stdout:1/436: chown d0/d2/d4/c94 13 1 2024-02-15T18:31:30.313 INFO:tasks.workunit.client.1.smithi131.stdout:1/437: creat d0/d2/d7/d72/f97 x:0 0 0 2024-02-15T18:31:30.317 INFO:tasks.workunit.client.1.smithi131.stdout:2/263: dwrite f4 [4194304,4194304] 0 2024-02-15T18:31:30.317 INFO:tasks.workunit.client.1.smithi131.stdout:2/264: chown dd/d10/d22/d2f/d38/l3e 191379586 1 2024-02-15T18:31:30.317 INFO:tasks.workunit.client.1.smithi131.stdout:2/265: chown dd/d14/d46 7 1 2024-02-15T18:31:30.319 INFO:tasks.workunit.client.1.smithi131.stdout:2/266: creat dd/f53 x:0 0 0 2024-02-15T18:31:30.328 INFO:tasks.workunit.client.1.smithi131.stdout:0/318: dwrite d5/d9/d10/d3f/f47 [4194304,4194304] 0 2024-02-15T18:31:30.330 INFO:tasks.workunit.client.1.smithi131.stdout:0/319: link d5/fa d5/f68 0 2024-02-15T18:31:30.331 INFO:tasks.workunit.client.1.smithi131.stdout:0/320: truncate d5/d9/d10/f1e 2373159 0 2024-02-15T18:31:30.334 INFO:tasks.workunit.client.1.smithi131.stdout:9/372: dwrite d4/dc/de/d1e/f37 [0,4194304] 0 2024-02-15T18:31:30.344 INFO:tasks.workunit.client.1.smithi131.stdout:2/267: dwrite dd/f53 [0,4194304] 0 2024-02-15T18:31:30.347 INFO:tasks.workunit.client.1.smithi131.stdout:9/373: dread d4/dc/f36 [0,4194304] 0 2024-02-15T18:31:30.347 INFO:tasks.workunit.client.1.smithi131.stdout:9/374: fdatasync d4/dc/d17/d19/d32/f4a 0 2024-02-15T18:31:30.347 INFO:tasks.workunit.client.1.smithi131.stdout:1/438: dwrite d0/d2/d4/d5d/f67 [0,4194304] 0 2024-02-15T18:31:30.347 INFO:tasks.workunit.client.1.smithi131.stdout:2/268: mknod dd/d10/d22/d2a/c54 0 2024-02-15T18:31:30.349 INFO:tasks.workunit.client.1.smithi131.stdout:9/375: symlink d4/dc/d25/l6c 0 2024-02-15T18:31:30.349 INFO:tasks.workunit.client.1.smithi131.stdout:9/376: write f0 [4919794,125669] 0 2024-02-15T18:31:30.349 INFO:tasks.workunit.client.1.smithi131.stdout:9/377: readlink d4/dc/d25/l6c 0 2024-02-15T18:31:30.349 INFO:tasks.workunit.client.1.smithi131.stdout:9/378: write d4/dc/de/d1e/f61 [896356,71993] 0 2024-02-15T18:31:30.352 INFO:tasks.workunit.client.1.smithi131.stdout:2/269: link dd/d10/c1d dd/d10/d22/d2f/d38/c55 0 2024-02-15T18:31:30.353 INFO:tasks.workunit.client.1.smithi131.stdout:2/270: rename dd/d10/d13/f1a to dd/d10/d22/f56 0 2024-02-15T18:31:30.356 INFO:tasks.workunit.client.1.smithi131.stdout:1/439: dread d0/d1/d16/f20 [0,4194304] 0 2024-02-15T18:31:30.356 INFO:tasks.workunit.client.1.smithi131.stdout:1/440: chown d0/d1/d24/f2f 1762306 1 2024-02-15T18:31:30.442 INFO:tasks.workunit.client.1.smithi131.stdout:1/441: read d0/d2/d4/f32 [4873760,799] 0 2024-02-15T18:31:30.443 INFO:tasks.workunit.client.1.smithi131.stdout:1/442: mkdir d0/d68/d80/d98 0 2024-02-15T18:31:30.444 INFO:tasks.workunit.client.1.smithi131.stdout:1/443: read d0/f4d [7051615,101519] 0 2024-02-15T18:31:30.457 INFO:tasks.workunit.client.1.smithi131.stdout:1/444: mknod d0/d1/d16/d6b/c99 0 2024-02-15T18:31:30.459 INFO:tasks.workunit.client.1.smithi131.stdout:1/445: mknod d0/d2/db/c9a 0 2024-02-15T18:31:30.461 INFO:tasks.workunit.client.1.smithi131.stdout:1/446: rmdir d0 39 2024-02-15T18:31:30.463 INFO:tasks.workunit.client.1.smithi131.stdout:1/447: rename d0/d68/d80/d98 to d0/d1/d16/d19/d9b 0 2024-02-15T18:31:30.466 INFO:tasks.workunit.client.1.smithi131.stdout:1/448: creat d0/d68/f9c x:0 0 0 2024-02-15T18:31:30.466 INFO:tasks.workunit.client.1.smithi131.stdout:1/449: fsync d0/d2/f5 0 2024-02-15T18:31:30.466 INFO:tasks.workunit.client.1.smithi131.stdout:1/450: readlink d0/d1/d16/l3e 0 2024-02-15T18:31:30.488 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:29.448865+0000 mgr.smithi033.apxevf (mgr.14626) 3 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-02-15T18:31:30.493 INFO:tasks.workunit.client.1.smithi131.stdout:1/451: dwrite d0/d2/d4/da/f1f [0,4194304] 0 2024-02-15T18:31:30.493 INFO:tasks.workunit.client.1.smithi131.stdout:1/452: truncate d0/d68/f9c 170889 0 2024-02-15T18:31:30.494 INFO:tasks.workunit.client.1.smithi131.stdout:1/453: mkdir d0/d1/d16/d9d 0 2024-02-15T18:31:30.501 INFO:tasks.workunit.client.1.smithi131.stdout:1/454: read d0/d2/f5 [1579527,90147] 0 2024-02-15T18:31:30.556 INFO:tasks.workunit.client.1.smithi131.stdout:5/421: sync 2024-02-15T18:31:30.556 INFO:tasks.workunit.client.1.smithi131.stdout:3/436: sync 2024-02-15T18:31:30.557 INFO:tasks.workunit.client.1.smithi131.stdout:3/437: truncate d2/d22/f63 992292 0 2024-02-15T18:31:30.558 INFO:tasks.workunit.client.1.smithi131.stdout:5/422: write d18/f50 [629250,65765] 0 2024-02-15T18:31:30.558 INFO:tasks.workunit.client.1.smithi131.stdout:5/423: read - d18/d4e/d69/f82 zero size 2024-02-15T18:31:30.562 INFO:tasks.workunit.client.1.smithi131.stdout:5/424: mkdir d18/d83/d8b 0 2024-02-15T18:31:30.562 INFO:tasks.workunit.client.1.smithi131.stdout:5/425: stat d18/d33 0 2024-02-15T18:31:30.562 INFO:tasks.workunit.client.1.smithi131.stdout:3/438: rename d2/d22/d29/db/d23/f41 to d2/d22/d29/db/d23/d2a/d5b/f8c 0 2024-02-15T18:31:30.565 INFO:tasks.workunit.client.1.smithi131.stdout:5/426: creat d18/d20/f8c x:0 0 0 2024-02-15T18:31:30.565 INFO:tasks.workunit.client.1.smithi131.stdout:5/427: readlink d18/d24/l36 0 2024-02-15T18:31:30.565 INFO:tasks.workunit.client.1.smithi131.stdout:5/428: fsync d18/d33/f5a 0 2024-02-15T18:31:30.565 INFO:tasks.workunit.client.1.smithi131.stdout:5/429: readlink d18/d24/l36 0 2024-02-15T18:31:30.566 INFO:tasks.workunit.client.1.smithi131.stdout:3/439: mkdir d2/d22/d3a/d6c/d8d 0 2024-02-15T18:31:30.566 INFO:tasks.workunit.client.1.smithi131.stdout:1/455: dwrite d0/d1/d16/f20 [0,4194304] 0 2024-02-15T18:31:30.570 INFO:tasks.workunit.client.1.smithi131.stdout:3/440: write d2/d22/d29/db/f1e [6078135,73783] 0 2024-02-15T18:31:30.570 INFO:tasks.workunit.client.1.smithi131.stdout:3/441: dread - d2/d22/d29/db/d34/f3b zero size 2024-02-15T18:31:30.570 INFO:tasks.workunit.client.1.smithi131.stdout:3/442: write d2/d22/d29/d20/f8b [949451,89160] 0 2024-02-15T18:31:30.571 INFO:tasks.workunit.client.1.smithi131.stdout:5/430: rename d18/d20/l34 to d18/d83/l8d 0 2024-02-15T18:31:30.571 INFO:tasks.workunit.client.1.smithi131.stdout:5/431: write d18/d24/d63/f75 [846242,21976] 0 2024-02-15T18:31:30.571 INFO:tasks.workunit.client.1.smithi131.stdout:1/456: symlink d0/d2/d7/d72/l9e 0 2024-02-15T18:31:30.571 INFO:tasks.workunit.client.1.smithi131.stdout:1/457: read - d0/d1/d44/f70 zero size 2024-02-15T18:31:30.573 INFO:tasks.workunit.client.1.smithi131.stdout:5/432: mkdir d18/d20/d8e 0 2024-02-15T18:31:30.573 INFO:tasks.workunit.client.1.smithi131.stdout:5/433: chown d18/d20/f4c 18 1 2024-02-15T18:31:30.574 INFO:tasks.workunit.client.1.smithi131.stdout:1/458: rename d0/d1/d16/l8e to d0/d2/db/l9f 0 2024-02-15T18:31:30.576 INFO:tasks.workunit.client.1.smithi131.stdout:5/434: creat d18/d23/f8f x:0 0 0 2024-02-15T18:31:30.576 INFO:tasks.workunit.client.1.smithi131.stdout:5/435: chown d18/d23/l2b 6840737 1 2024-02-15T18:31:30.577 INFO:tasks.workunit.client.1.smithi131.stdout:5/436: truncate fb 8131946 0 2024-02-15T18:31:30.583 INFO:tasks.workunit.client.1.smithi131.stdout:5/437: rename d18/d4e/d69 to d18/d20/d90 0 2024-02-15T18:31:30.586 INFO:tasks.workunit.client.1.smithi131.stdout:5/438: creat d18/d33/d61/f91 x:0 0 0 2024-02-15T18:31:30.586 INFO:tasks.workunit.client.1.smithi131.stdout:5/439: dread - d18/d20/f8c zero size 2024-02-15T18:31:30.586 INFO:tasks.workunit.client.1.smithi131.stdout:5/440: dread - d18/d23/f52 zero size 2024-02-15T18:31:30.588 INFO:tasks.workunit.client.1.smithi131.stdout:5/441: creat d18/f92 x:0 0 0 2024-02-15T18:31:30.590 INFO:tasks.workunit.client.1.smithi131.stdout:5/442: mknod d18/c93 0 2024-02-15T18:31:30.592 INFO:tasks.workunit.client.1.smithi131.stdout:5/443: rename d18/d20/f8c to d18/d4e/f94 0 2024-02-15T18:31:30.603 INFO:tasks.workunit.client.1.smithi131.stdout:3/443: dwrite d2/d22/f72 [0,4194304] 0 2024-02-15T18:31:30.603 INFO:tasks.workunit.client.1.smithi131.stdout:3/444: chown d2/d22/d5e/d79 29185 1 2024-02-15T18:31:30.608 INFO:tasks.workunit.client.1.smithi131.stdout:1/459: dwrite d0/d2/d4/d41/f6f [0,4194304] 0 2024-02-15T18:31:30.608 INFO:tasks.workunit.client.1.smithi131.stdout:1/460: chown d0/d1/d16/f20 10098 1 2024-02-15T18:31:30.610 INFO:tasks.workunit.client.1.smithi131.stdout:1/461: creat d0/d2/d4/fa0 x:0 0 0 2024-02-15T18:31:30.612 INFO:tasks.workunit.client.1.smithi131.stdout:1/462: mkdir d0/d2/d4/d41/d5a/d5f/da1 0 2024-02-15T18:31:30.613 INFO:tasks.workunit.client.1.smithi131.stdout:1/463: dread d0/d2/d4/d5d/f60 [0,4194304] 0 2024-02-15T18:31:30.614 INFO:tasks.workunit.client.1.smithi131.stdout:1/464: creat d0/d1/d16/d30/fa2 x:0 0 0 2024-02-15T18:31:30.616 INFO:tasks.workunit.client.1.smithi131.stdout:1/465: truncate d0/d2/d4/d41/d5a/f96 2428145 0 2024-02-15T18:31:30.618 INFO:tasks.workunit.client.1.smithi131.stdout:5/444: dwrite f11 [0,4194304] 0 2024-02-15T18:31:30.620 INFO:tasks.workunit.client.1.smithi131.stdout:1/466: rmdir d0/d2/d7 39 2024-02-15T18:31:30.623 INFO:tasks.workunit.client.1.smithi131.stdout:5/445: mkdir d18/d20/d90/d85/d95 0 2024-02-15T18:31:30.623 INFO:tasks.workunit.client.1.smithi131.stdout:5/446: read - d18/d24/f59 zero size 2024-02-15T18:31:30.625 INFO:tasks.workunit.client.1.smithi131.stdout:5/447: read d18/d20/f4c [2468644,66119] 0 2024-02-15T18:31:30.625 INFO:tasks.workunit.client.1.smithi131.stdout:1/467: write d0/d2/f1c [2878072,23449] 0 2024-02-15T18:31:30.629 INFO:tasks.workunit.client.1.smithi131.stdout:5/448: link d18/d24/c42 d18/d33/c96 0 2024-02-15T18:31:30.630 INFO:tasks.workunit.client.1.smithi131.stdout:1/468: mknod d0/d1/d24/d89/ca3 0 2024-02-15T18:31:30.660 INFO:tasks.workunit.client.1.smithi131.stdout:1/469: dwrite d0/d2/f37 [0,4194304] 0 2024-02-15T18:31:30.683 INFO:tasks.workunit.client.1.smithi131.stdout:1/470: dwrite d0/d2/d7/d72/f97 [0,4194304] 0 2024-02-15T18:31:30.683 INFO:tasks.workunit.client.1.smithi131.stdout:1/471: readlink d0/d1/d44/d59/d42/l58 0 2024-02-15T18:31:30.683 INFO:tasks.workunit.client.1.smithi131.stdout:1/472: chown d0/d2/c1d 473105 1 2024-02-15T18:31:30.711 INFO:tasks.workunit.client.1.smithi131.stdout:1/473: dwrite d0/d1/d16/f20 [0,4194304] 0 2024-02-15T18:31:30.712 INFO:tasks.workunit.client.1.smithi131.stdout:1/474: read d0/d2/f5 [5980161,39429] 0 2024-02-15T18:31:30.712 INFO:tasks.workunit.client.1.smithi131.stdout:1/475: chown d0/d2/d7/d72/d78 0 1 2024-02-15T18:31:30.713 INFO:tasks.workunit.client.1.smithi131.stdout:1/476: mkdir d0/d1/d16/d19/d9b/da4 0 2024-02-15T18:31:30.716 INFO:tasks.workunit.client.1.smithi131.stdout:1/477: creat d0/d2/d4/d41/fa5 x:0 0 0 2024-02-15T18:31:30.718 INFO:tasks.workunit.client.1.smithi131.stdout:1/478: link d0/d2/d4/l8 d0/d2/d4/d5d/la6 0 2024-02-15T18:31:30.719 INFO:tasks.workunit.client.1.smithi131.stdout:1/479: mkdir d0/d2/d7/d72/d78/da7 0 2024-02-15T18:31:30.719 INFO:tasks.workunit.client.1.smithi131.stdout:1/480: fdatasync d0/d2/d4/d5d/f67 0 2024-02-15T18:31:30.719 INFO:tasks.workunit.client.1.smithi131.stdout:1/481: fdatasync d0/d1/d16/d30/fa2 0 2024-02-15T18:31:30.720 INFO:tasks.workunit.client.1.smithi131.stdout:1/482: mkdir d0/d2/da8 0 2024-02-15T18:31:30.722 INFO:tasks.workunit.client.1.smithi131.stdout:1/483: truncate d0/f4d 3878700 0 2024-02-15T18:31:30.722 INFO:tasks.workunit.client.1.smithi131.stdout:1/484: truncate d0/d2/d4/d41/fa5 1021417 0 2024-02-15T18:31:30.724 INFO:tasks.workunit.client.1.smithi131.stdout:1/485: symlink d0/d1/d44/d59/la9 0 2024-02-15T18:31:30.728 INFO:tasks.workunit.client.1.smithi131.stdout:1/486: creat d0/d2/d4/faa x:0 0 0 2024-02-15T18:31:30.735 INFO:tasks.workunit.client.1.smithi131.stdout:1/487: write d0/d1/d24/f2d [2515490,72280] 0 2024-02-15T18:31:30.735 INFO:tasks.workunit.client.1.smithi131.stdout:1/488: truncate d0/d1/d16/f20 4672079 0 2024-02-15T18:31:30.738 INFO:tasks.workunit.client.1.smithi131.stdout:1/489: creat d0/d2/d7/fab x:0 0 0 2024-02-15T18:31:30.739 INFO:tasks.workunit.client.1.smithi131.stdout:1/490: mkdir d0/d2/db/dac 0 2024-02-15T18:31:30.740 INFO:tasks.workunit.client.1.smithi131.stdout:1/491: write d0/d2/db/f7c [999453,96536] 0 2024-02-15T18:31:30.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:29.495151+0000 mon.smithi033 (mon.0) 669 : cluster [DBG] mgrmap e26: smithi033.apxevf(active, since 2s) 2024-02-15T18:31:30.790 INFO:tasks.workunit.client.1.smithi131.stdout:1/492: dwrite d0/d2/db/f7c [0,4194304] 0 2024-02-15T18:31:30.790 INFO:tasks.workunit.client.1.smithi131.stdout:1/493: fdatasync d0/d2/f37 0 2024-02-15T18:31:30.793 INFO:tasks.workunit.client.1.smithi131.stdout:1/494: symlink d0/d2/d7/d72/lad 0 2024-02-15T18:31:30.796 INFO:tasks.workunit.client.1.smithi131.stdout:1/495: creat d0/d1/d16/d30/fae x:0 0 0 2024-02-15T18:31:30.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:29.448865+0000 mgr.smithi033.apxevf (mgr.14626) 3 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-02-15T18:31:30.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:29.495151+0000 mon.smithi033 (mon.0) 669 : cluster [DBG] mgrmap e26: smithi033.apxevf(active, since 2s) 2024-02-15T18:31:30.799 INFO:tasks.workunit.client.1.smithi131.stdout:1/496: rename d0/d2/d4/d41/d5a/f86 to d0/d2/d7/d72/faf 0 2024-02-15T18:31:30.801 INFO:tasks.workunit.client.1.smithi131.stdout:1/497: rename d0/d1/d16/d30/l51 to d0/d2/db/lb0 0 2024-02-15T18:31:30.802 INFO:tasks.workunit.client.1.smithi131.stdout:1/498: mkdir d0/d2/d4/d5d/db1 0 2024-02-15T18:31:30.804 INFO:tasks.workunit.client.1.smithi131.stdout:1/499: creat d0/d1/d16/d9d/fb2 x:0 0 0 2024-02-15T18:31:30.806 INFO:tasks.workunit.client.1.smithi131.stdout:1/500: mkdir d0/d2/d4/d41/d5a/d5f/da1/db3 0 2024-02-15T18:31:30.806 INFO:tasks.workunit.client.1.smithi131.stdout:1/501: fdatasync d0/d1/d44/d59/f45 0 2024-02-15T18:31:30.808 INFO:tasks.workunit.client.1.smithi131.stdout:1/502: unlink d0/d1/d24/l63 0 2024-02-15T18:31:30.809 INFO:tasks.workunit.client.1.smithi131.stdout:1/503: creat d0/d1/d44/fb4 x:0 0 0 2024-02-15T18:31:30.809 INFO:tasks.workunit.client.1.smithi131.stdout:1/504: fsync d0/d2/d4/d5d/f67 0 2024-02-15T18:31:30.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/505: rmdir d0/d2/d31 39 2024-02-15T18:31:30.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/506: chown d0/d2/db/c55 1713936 1 2024-02-15T18:31:30.812 INFO:tasks.workunit.client.1.smithi131.stdout:1/507: symlink d0/lb5 0 2024-02-15T18:31:30.813 INFO:tasks.workunit.client.1.smithi131.stdout:1/508: read d0/d2/d31/d3d/f6a [943912,53308] 0 2024-02-15T18:31:30.813 INFO:tasks.workunit.client.1.smithi131.stdout:1/509: chown d0/d2/d4/l74 26985 1 2024-02-15T18:31:30.813 INFO:tasks.workunit.client.1.smithi131.stdout:1/510: read - d0/d2/d7/f90 zero size 2024-02-15T18:31:30.813 INFO:tasks.workunit.client.1.smithi131.stdout:1/511: creat d0/d2/d7/fb6 x:0 0 0 2024-02-15T18:31:30.814 INFO:tasks.workunit.client.1.smithi131.stdout:1/512: rmdir d0/d1/d16 39 2024-02-15T18:31:30.815 INFO:tasks.workunit.client.1.smithi131.stdout:1/513: mkdir d0/d1/d16/db7 0 2024-02-15T18:31:30.816 INFO:tasks.workunit.client.1.smithi131.stdout:1/514: mknod d0/d68/cb8 0 2024-02-15T18:31:30.816 INFO:tasks.workunit.client.1.smithi131.stdout:1/515: chown d0/d1/f38 11713 1 2024-02-15T18:31:30.816 INFO:tasks.workunit.client.1.smithi131.stdout:1/516: chown d0/d2/f5 6598691 1 2024-02-15T18:31:30.818 INFO:tasks.workunit.client.1.smithi131.stdout:1/517: unlink d0/d2/db/c57 0 2024-02-15T18:31:30.820 INFO:tasks.workunit.client.1.smithi131.stdout:1/518: creat d0/d1/d44/d59/fb9 x:0 0 0 2024-02-15T18:31:30.823 INFO:tasks.workunit.client.1.smithi131.stdout:1/519: symlink d0/lba 0 2024-02-15T18:31:30.823 INFO:tasks.workunit.client.1.smithi131.stdout:1/520: write d0/d2/d4/da/f2c [1217133,70570] 0 2024-02-15T18:31:30.823 INFO:tasks.workunit.client.1.smithi131.stdout:1/521: dread - d0/d1/d16/d9d/fb2 zero size 2024-02-15T18:31:30.827 INFO:tasks.workunit.client.1.smithi131.stdout:1/522: mkdir d0/d2/d7/d72/dbb 0 2024-02-15T18:31:30.827 INFO:tasks.workunit.client.1.smithi131.stdout:1/523: mknod d0/d2/d4/d5d/db1/cbc 0 2024-02-15T18:31:30.827 INFO:tasks.workunit.client.1.smithi131.stdout:1/524: write d0/d2/d7/f53 [512494,123143] 0 2024-02-15T18:31:30.829 INFO:tasks.workunit.client.1.smithi131.stdout:1/525: write d0/d2/d4/d41/d5a/f7a [1402541,97801] 0 2024-02-15T18:31:30.835 INFO:tasks.workunit.client.1.smithi131.stdout:1/526: symlink d0/d2/d4/d41/d5a/d5f/da1/lbd 0 2024-02-15T18:31:30.836 INFO:tasks.workunit.client.1.smithi131.stdout:1/527: rename d0/d2/d4/d41/f6f to d0/d1/d16/d19/fbe 0 2024-02-15T18:31:30.846 INFO:tasks.workunit.client.1.smithi131.stdout:1/528: dread d0/d1/f38 [0,4194304] 0 2024-02-15T18:31:30.848 INFO:tasks.workunit.client.1.smithi131.stdout:6/371: sync 2024-02-15T18:31:30.848 INFO:tasks.workunit.client.1.smithi131.stdout:8/313: sync 2024-02-15T18:31:30.848 INFO:tasks.workunit.client.1.smithi131.stdout:4/456: sync 2024-02-15T18:31:30.848 INFO:tasks.workunit.client.1.smithi131.stdout:4/457: stat d2/d2a/f9f 0 2024-02-15T18:31:30.848 INFO:tasks.workunit.client.1.smithi131.stdout:4/458: fdatasync d2/d7/d12/f9c 0 2024-02-15T18:31:30.848 INFO:tasks.workunit.client.1.smithi131.stdout:4/459: readlink d2/d2a/d47/d16/l4c 0 2024-02-15T18:31:30.848 INFO:tasks.workunit.client.1.smithi131.stdout:4/460: stat d2/d7/d1c/d5d/f71 0 2024-02-15T18:31:30.848 INFO:tasks.workunit.client.1.smithi131.stdout:6/372: write d2/d7/d16/f43 [4661811,87345] 0 2024-02-15T18:31:30.848 INFO:tasks.workunit.client.1.smithi131.stdout:6/373: dread - d2/d7/d48/f59 zero size 2024-02-15T18:31:30.849 INFO:tasks.workunit.client.1.smithi131.stdout:1/529: unlink d0/d2/db/c55 0 2024-02-15T18:31:30.849 INFO:tasks.workunit.client.1.smithi131.stdout:1/530: write d0/d1/d44/f70 [553917,102667] 0 2024-02-15T18:31:30.849 INFO:tasks.workunit.client.1.smithi131.stdout:8/314: rmdir d22/d2e/d64 0 2024-02-15T18:31:30.849 INFO:tasks.workunit.client.1.smithi131.stdout:8/315: rename d22/d26/d3f/d47 to d22/d26/d3f/d47/d48/d5f/d69 22 2024-02-15T18:31:30.849 INFO:tasks.workunit.client.1.smithi131.stdout:8/316: chown d22/d26/f4e 3745 1 2024-02-15T18:31:30.849 INFO:tasks.workunit.client.1.smithi131.stdout:8/317: truncate d22/f3e 483324 0 2024-02-15T18:31:30.849 INFO:tasks.workunit.client.1.smithi131.stdout:8/318: chown d22/d26/d3f/f44 2705806 1 2024-02-15T18:31:30.853 INFO:tasks.workunit.client.1.smithi131.stdout:1/531: symlink d0/d1/d16/db7/lbf 0 2024-02-15T18:31:30.853 INFO:tasks.workunit.client.1.smithi131.stdout:1/532: fdatasync d0/d2/d4/d5d/f60 0 2024-02-15T18:31:30.855 INFO:tasks.workunit.client.1.smithi131.stdout:8/319: rename d22/d26/f2b to d22/d26/d3f/d47/f6a 0 2024-02-15T18:31:30.855 INFO:tasks.workunit.client.1.smithi131.stdout:6/374: dread d2/d36/f5a [0,4194304] 0 2024-02-15T18:31:30.857 INFO:tasks.workunit.client.1.smithi131.stdout:1/533: rename d0/d2/d7/c71 to d0/d2/d7/d72/dbb/cc0 0 2024-02-15T18:31:30.858 INFO:tasks.workunit.client.1.smithi131.stdout:1/534: read - d0/d1/d44/d59/fb9 zero size 2024-02-15T18:31:30.858 INFO:tasks.workunit.client.1.smithi131.stdout:8/320: creat d22/f6b x:0 0 0 2024-02-15T18:31:30.860 INFO:tasks.workunit.client.1.smithi131.stdout:6/375: mkdir d2/dc/d27/d78 0 2024-02-15T18:31:30.861 INFO:tasks.workunit.client.1.smithi131.stdout:1/535: creat d0/d2/d4/d41/d5a/d5f/da1/db3/fc1 x:0 0 0 2024-02-15T18:31:30.863 INFO:tasks.workunit.client.1.smithi131.stdout:6/376: rename d2/d7/d48/d40/d61 to d2/d79 0 2024-02-15T18:31:30.865 INFO:tasks.workunit.client.1.smithi131.stdout:1/536: write d0/d2/d4/d5d/f67 [2936808,42757] 0 2024-02-15T18:31:30.867 INFO:tasks.workunit.client.1.smithi131.stdout:4/461: dwrite d2/d7/d1c/f63 [0,4194304] 0 2024-02-15T18:31:30.867 INFO:tasks.workunit.client.1.smithi131.stdout:4/462: truncate d2/d2a/d47/d16/d43/f7e 5100985 0 2024-02-15T18:31:30.868 INFO:tasks.workunit.client.1.smithi131.stdout:6/377: dread d2/d36/f5a [0,4194304] 0 2024-02-15T18:31:30.868 INFO:tasks.workunit.client.1.smithi131.stdout:6/378: read - d2/f23 zero size 2024-02-15T18:31:30.871 INFO:tasks.workunit.client.1.smithi131.stdout:4/463: mknod d2/d7/d12/d2e/d5f/ca4 0 2024-02-15T18:31:30.871 INFO:tasks.workunit.client.1.smithi131.stdout:4/464: dread - d2/d7/d12/f79 zero size 2024-02-15T18:31:30.872 INFO:tasks.workunit.client.1.smithi131.stdout:6/379: dread d2/d7/d16/f1e [0,4194304] 0 2024-02-15T18:31:30.872 INFO:tasks.workunit.client.1.smithi131.stdout:6/380: chown d2/dc/d1f/l77 1043338350 1 2024-02-15T18:31:30.872 INFO:tasks.workunit.client.1.smithi131.stdout:6/381: dread - d2/d7/d48/f59 zero size 2024-02-15T18:31:30.872 INFO:tasks.workunit.client.1.smithi131.stdout:4/465: symlink d2/d7/d12/d2e/d5f/d70/la5 0 2024-02-15T18:31:30.874 INFO:tasks.workunit.client.1.smithi131.stdout:4/466: symlink d2/d7/d12/d2e/d5f/d70/la6 0 2024-02-15T18:31:30.890 INFO:tasks.workunit.client.1.smithi131.stdout:4/467: truncate d2/d2a/d47/d16/d43/f7e 771924 0 2024-02-15T18:31:30.899 INFO:tasks.workunit.client.1.smithi131.stdout:6/382: dwrite d2/dc/f22 [4194304,4194304] 0 2024-02-15T18:31:30.899 INFO:tasks.workunit.client.1.smithi131.stdout:6/383: write d2/dc/d27/f55 [555432,15104] 0 2024-02-15T18:31:30.899 INFO:tasks.workunit.client.1.smithi131.stdout:6/384: readlink d2/dc/d1f/l4b 0 2024-02-15T18:31:30.899 INFO:tasks.workunit.client.1.smithi131.stdout:6/385: fdatasync f0 0 2024-02-15T18:31:30.904 INFO:tasks.workunit.client.1.smithi131.stdout:6/386: dread d2/d7/d16/f43 [0,4194304] 0 2024-02-15T18:31:30.906 INFO:tasks.workunit.client.1.smithi131.stdout:6/387: rename d2/dc/f64 to d2/d79/f7a 0 2024-02-15T18:31:30.906 INFO:tasks.workunit.client.1.smithi131.stdout:6/388: truncate d2/d2b/f69 781909 0 2024-02-15T18:31:30.908 INFO:tasks.workunit.client.1.smithi131.stdout:6/389: write d2/f1a [3725396,121803] 0 2024-02-15T18:31:30.908 INFO:tasks.workunit.client.1.smithi131.stdout:6/390: chown d2/d7/d48/l5b 70654 1 2024-02-15T18:31:30.912 INFO:tasks.workunit.client.1.smithi131.stdout:4/468: dwrite d2/d2a/d47/d21/f3a [0,4194304] 0 2024-02-15T18:31:30.914 INFO:tasks.workunit.client.1.smithi131.stdout:6/391: dread d2/f45 [0,4194304] 0 2024-02-15T18:31:30.914 INFO:tasks.workunit.client.1.smithi131.stdout:4/469: creat d2/d2a/d85/da3/fa7 x:0 0 0 2024-02-15T18:31:30.916 INFO:tasks.workunit.client.1.smithi131.stdout:4/470: symlink d2/d7/d12/d2e/d39/d4b/la8 0 2024-02-15T18:31:30.916 INFO:tasks.workunit.client.1.smithi131.stdout:4/471: fdatasync d2/d7/d12/f3f 0 2024-02-15T18:31:30.940 INFO:tasks.workunit.client.1.smithi131.stdout:4/472: dwrite d2/d7/d12/d2e/d39/f9d [0,4194304] 0 2024-02-15T18:31:30.940 INFO:tasks.workunit.client.1.smithi131.stdout:6/392: dwrite d2/d7/d16/f43 [0,4194304] 0 2024-02-15T18:31:30.940 INFO:tasks.workunit.client.1.smithi131.stdout:6/393: stat d2/d7/d12 0 2024-02-15T18:31:30.942 INFO:tasks.workunit.client.1.smithi131.stdout:4/473: mknod d2/ca9 0 2024-02-15T18:31:30.947 INFO:tasks.workunit.client.1.smithi131.stdout:6/394: mknod d2/d36/c7b 0 2024-02-15T18:31:30.949 INFO:tasks.workunit.client.1.smithi131.stdout:4/474: rename d2/l1e to d2/d2a/d47/d21/d9e/laa 0 2024-02-15T18:31:30.950 INFO:tasks.workunit.client.1.smithi131.stdout:6/395: creat d2/d2b/d6e/f7c x:0 0 0 2024-02-15T18:31:30.951 INFO:tasks.workunit.client.1.smithi131.stdout:4/475: creat d2/d7/fab x:0 0 0 2024-02-15T18:31:30.957 INFO:tasks.workunit.client.1.smithi131.stdout:4/476: link d2/d7/d1c/d84/l9b d2/d23/lac 0 2024-02-15T18:31:30.957 INFO:tasks.workunit.client.1.smithi131.stdout:4/477: chown d2/d7/d12/d2e/d39/c5e 116547638 1 2024-02-15T18:31:30.958 INFO:tasks.workunit.client.1.smithi131.stdout:6/396: mknod d2/c7d 0 2024-02-15T18:31:30.959 INFO:tasks.workunit.client.1.smithi131.stdout:4/478: creat d2/d7/d1c/d5d/d7a/d92/fad x:0 0 0 2024-02-15T18:31:30.961 INFO:tasks.workunit.client.1.smithi131.stdout:6/397: symlink d2/d7/d12/l7e 0 2024-02-15T18:31:30.961 INFO:tasks.workunit.client.1.smithi131.stdout:6/398: fdatasync d2/d7/d12/d4d/f65 0 2024-02-15T18:31:30.963 INFO:tasks.workunit.client.1.smithi131.stdout:4/479: getdents d2/d2a/d47/d21 0 2024-02-15T18:31:30.963 INFO:tasks.workunit.client.1.smithi131.stdout:4/480: truncate d2/f1a 2752540 0 2024-02-15T18:31:30.963 INFO:tasks.workunit.client.1.smithi131.stdout:6/399: mkdir d2/d7/d48/d7f 0 2024-02-15T18:31:30.963 INFO:tasks.workunit.client.1.smithi131.stdout:6/400: fdatasync d2/d7/d48/f49 0 2024-02-15T18:31:30.965 INFO:tasks.workunit.client.1.smithi131.stdout:4/481: creat d2/d2a/d47/d21/d9e/fae x:0 0 0 2024-02-15T18:31:30.966 INFO:tasks.workunit.client.1.smithi131.stdout:4/482: write d2/d7/d1c/d5d/f7b [1339556,43235] 0 2024-02-15T18:31:30.966 INFO:tasks.workunit.client.1.smithi131.stdout:4/483: fsync d2/d2a/f42 0 2024-02-15T18:31:30.966 INFO:tasks.workunit.client.1.smithi131.stdout:6/401: mkdir d2/d7/d12/d80 0 2024-02-15T18:31:30.967 INFO:tasks.workunit.client.1.smithi131.stdout:4/484: creat d2/d7/d96/faf x:0 0 0 2024-02-15T18:31:30.969 INFO:tasks.workunit.client.1.smithi131.stdout:4/485: symlink d2/d7/lb0 0 2024-02-15T18:31:30.971 INFO:tasks.workunit.client.1.smithi131.stdout:4/486: mknod d2/d2a/d68/cb1 0 2024-02-15T18:31:30.980 INFO:tasks.workunit.client.1.smithi131.stdout:4/487: dread d2/d7/d12/d2e/f50 [0,4194304] 0 2024-02-15T18:31:30.981 INFO:tasks.workunit.client.1.smithi131.stdout:4/488: creat d2/d2a/fb2 x:0 0 0 2024-02-15T18:31:30.981 INFO:tasks.workunit.client.1.smithi131.stdout:4/489: fdatasync d2/d7/d1c/d94/f95 0 2024-02-15T18:31:30.984 INFO:tasks.workunit.client.1.smithi131.stdout:4/490: rename d2/d7/d12/d2e/d5f/d70/f56 to d2/d2a/d47/d16/d43/fb3 0 2024-02-15T18:31:30.989 INFO:tasks.workunit.client.1.smithi131.stdout:6/402: dwrite d2/d36/f5a [0,4194304] 0 2024-02-15T18:31:30.992 INFO:tasks.workunit.client.1.smithi131.stdout:4/491: dread d2/d7/d1c/f63 [0,4194304] 0 2024-02-15T18:31:30.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/403: truncate d2/dc/f14 4236600 0 2024-02-15T18:31:30.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/404: chown d2/dc/d1f/l32 4712 1 2024-02-15T18:31:30.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/405: write d2/dc/d1f/f70 [1006812,37514] 0 2024-02-15T18:31:30.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/406: readlink d2/d7/d12/l7e 0 2024-02-15T18:31:30.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/407: truncate d2/d36/f4c 148721 0 2024-02-15T18:31:30.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/408: chown d2/dc/d27/d74 279684 1 2024-02-15T18:31:31.007 INFO:tasks.workunit.client.1.smithi131.stdout:6/409: dread d2/d7/d48/f44 [0,4194304] 0 2024-02-15T18:31:31.007 INFO:tasks.workunit.client.1.smithi131.stdout:6/410: chown d2/d7/d16/f43 1584420 1 2024-02-15T18:31:31.058 INFO:tasks.workunit.client.1.smithi131.stdout:9/379: sync 2024-02-15T18:31:31.059 INFO:tasks.workunit.client.1.smithi131.stdout:7/560: sync 2024-02-15T18:31:31.059 INFO:tasks.workunit.client.1.smithi131.stdout:0/321: sync 2024-02-15T18:31:31.059 INFO:tasks.workunit.client.1.smithi131.stdout:0/322: chown d5/d9/f43 116262 1 2024-02-15T18:31:31.059 INFO:tasks.workunit.client.1.smithi131.stdout:7/561: read - d0/d17/d36/f85 zero size 2024-02-15T18:31:31.059 INFO:tasks.workunit.client.1.smithi131.stdout:7/562: write d0/d17/d3a/f63 [3832156,22883] 0 2024-02-15T18:31:31.059 INFO:tasks.workunit.client.1.smithi131.stdout:9/380: write d4/dc/d17/d19/fb [764530,5084] 0 2024-02-15T18:31:31.060 INFO:tasks.workunit.client.1.smithi131.stdout:4/492: mkdir d2/d2a/d85/da3/db4 0 2024-02-15T18:31:31.067 INFO:tasks.workunit.client.1.smithi131.stdout:6/411: unlink d2/d2b/c2f 0 2024-02-15T18:31:31.067 INFO:tasks.workunit.client.1.smithi131.stdout:7/563: creat d0/d17/d3a/d3d/d79/d89/fb1 x:0 0 0 2024-02-15T18:31:31.067 INFO:tasks.workunit.client.1.smithi131.stdout:9/381: mkdir d4/dc/d25/d4e/d6d 0 2024-02-15T18:31:31.068 INFO:tasks.workunit.client.1.smithi131.stdout:6/412: truncate d2/d7/d48/f44 1280736 0 2024-02-15T18:31:31.068 INFO:tasks.workunit.client.1.smithi131.stdout:6/413: chown d2/dc/d27/d74/d75 44 1 2024-02-15T18:31:31.068 INFO:tasks.workunit.client.1.smithi131.stdout:6/414: truncate d2/d7/d12/d4d/f52 916607 0 2024-02-15T18:31:31.069 INFO:tasks.workunit.client.1.smithi131.stdout:7/564: symlink d0/d34/d8e/lb2 0 2024-02-15T18:31:31.069 INFO:tasks.workunit.client.1.smithi131.stdout:7/565: write d0/d17/d3a/d3d/f53 [1062937,52194] 0 2024-02-15T18:31:31.069 INFO:tasks.workunit.client.1.smithi131.stdout:7/566: fdatasync d0/d17/f23 0 2024-02-15T18:31:31.070 INFO:tasks.workunit.client.1.smithi131.stdout:9/382: symlink d4/dc/d25/l6e 0 2024-02-15T18:31:31.072 INFO:tasks.workunit.client.1.smithi131.stdout:9/383: write d4/dc/de/d1e/d1f/f3a [541094,101970] 0 2024-02-15T18:31:31.074 INFO:tasks.workunit.client.1.smithi131.stdout:6/415: write d2/d7/fa [1447801,114903] 0 2024-02-15T18:31:31.075 INFO:tasks.workunit.client.1.smithi131.stdout:9/384: rename d4/dc/d17/d19/d41/f4c to d4/dc/d17/d19/d41/d5b/f6f 0 2024-02-15T18:31:31.076 INFO:tasks.workunit.client.1.smithi131.stdout:6/416: symlink d2/d36/l81 0 2024-02-15T18:31:31.083 INFO:tasks.workunit.client.1.smithi131.stdout:6/417: write d2/d7/d12/d4d/f57 [4074994,62487] 0 2024-02-15T18:31:31.083 INFO:tasks.workunit.client.1.smithi131.stdout:4/493: dwrite d2/d7/f2c [0,4194304] 0 2024-02-15T18:31:31.083 INFO:tasks.workunit.client.1.smithi131.stdout:4/494: stat d2/d7/d1c/d5d 0 2024-02-15T18:31:31.084 INFO:tasks.workunit.client.1.smithi131.stdout:4/495: chown d2/d2a/d47/d21/d9e 26639 1 2024-02-15T18:31:31.086 INFO:tasks.workunit.client.1.smithi131.stdout:4/496: getdents d2/d7/d96 0 2024-02-15T18:31:31.086 INFO:tasks.workunit.client.1.smithi131.stdout:4/497: chown d2/d7/d1c/d84 6219 1 2024-02-15T18:31:31.086 INFO:tasks.workunit.client.1.smithi131.stdout:4/498: chown d2/d7/d12/d2e/d5f/l67 1 1 2024-02-15T18:31:31.086 INFO:tasks.workunit.client.1.smithi131.stdout:6/418: read d2/d7/d48/f49 [710870,119120] 0 2024-02-15T18:31:31.087 INFO:tasks.workunit.client.1.smithi131.stdout:4/499: creat d2/d2a/d76/fb5 x:0 0 0 2024-02-15T18:31:31.089 INFO:tasks.workunit.client.1.smithi131.stdout:6/419: rmdir d2/d7/d12/d4d 39 2024-02-15T18:31:31.091 INFO:tasks.workunit.client.1.smithi131.stdout:9/385: getdents d4/dc/d17/d19/d41 0 2024-02-15T18:31:31.091 INFO:tasks.workunit.client.1.smithi131.stdout:9/386: chown d4/dc/de/d1e/d1f/c29 1330862 1 2024-02-15T18:31:31.092 INFO:tasks.workunit.client.1.smithi131.stdout:4/500: mknod d2/d7/d1c/d5d/cb6 0 2024-02-15T18:31:31.093 INFO:tasks.workunit.client.1.smithi131.stdout:6/420: symlink d2/dc/d27/d78/l82 0 2024-02-15T18:31:31.095 INFO:tasks.workunit.client.1.smithi131.stdout:9/387: mknod d4/dc/d17/d19/d32/c70 0 2024-02-15T18:31:31.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/501: creat d2/d2a/d85/fb7 x:0 0 0 2024-02-15T18:31:31.097 INFO:tasks.workunit.client.1.smithi131.stdout:9/388: rmdir d4/dc/de/d1e 39 2024-02-15T18:31:31.100 INFO:tasks.workunit.client.1.smithi131.stdout:4/502: dread d2/d7/d1c/f63 [0,4194304] 0 2024-02-15T18:31:31.101 INFO:tasks.workunit.client.1.smithi131.stdout:4/503: mkdir d2/d7/d1c/d84/db8 0 2024-02-15T18:31:31.102 INFO:tasks.workunit.client.1.smithi131.stdout:4/504: dread - d2/d2a/fb2 zero size 2024-02-15T18:31:31.102 INFO:tasks.workunit.client.1.smithi131.stdout:4/505: dread - d2/d7/d1c/f74 zero size 2024-02-15T18:31:31.102 INFO:tasks.workunit.client.1.smithi131.stdout:4/506: mkdir d2/d7/d12/d53/db9 0 2024-02-15T18:31:31.109 INFO:tasks.workunit.client.1.smithi131.stdout:9/389: dread f3 [0,4194304] 0 2024-02-15T18:31:31.109 INFO:tasks.workunit.client.1.smithi131.stdout:9/390: chown d4/dc/d17/d19/f5a 0 1 2024-02-15T18:31:31.110 INFO:tasks.workunit.client.1.smithi131.stdout:9/391: write d4/dc/de/d1e/d1f/f3a [158941,3164] 0 2024-02-15T18:31:31.111 INFO:tasks.workunit.client.1.smithi131.stdout:9/392: mkdir d4/dc/de/d1e/d1f/d51/d5d/d71 0 2024-02-15T18:31:31.112 INFO:tasks.workunit.client.1.smithi131.stdout:9/393: mkdir d4/dc/d17/d19/d41/d72 0 2024-02-15T18:31:31.121 INFO:tasks.workunit.client.1.smithi131.stdout:9/394: rmdir d4/dc/d17/d19 39 2024-02-15T18:31:31.121 INFO:tasks.workunit.client.1.smithi131.stdout:9/395: chown d4/dc/de/d1e/f37 59908 1 2024-02-15T18:31:31.121 INFO:tasks.workunit.client.1.smithi131.stdout:9/396: fsync d4/dc/f56 0 2024-02-15T18:31:31.125 INFO:tasks.workunit.client.1.smithi131.stdout:4/507: dwrite d2/d7/d12/f52 [0,4194304] 0 2024-02-15T18:31:31.166 INFO:tasks.workunit.client.1.smithi131.stdout:4/508: mkdir d2/d2a/d85/da3/dba 0 2024-02-15T18:31:31.167 INFO:tasks.workunit.client.1.smithi131.stdout:4/509: creat d2/d7/d12/d53/fbb x:0 0 0 2024-02-15T18:31:31.167 INFO:tasks.workunit.client.1.smithi131.stdout:4/510: mknod d2/d2a/d68/cbc 0 2024-02-15T18:31:31.168 INFO:tasks.workunit.client.1.smithi131.stdout:4/511: mknod d2/d2a/d76/cbd 0 2024-02-15T18:31:31.169 INFO:tasks.workunit.client.1.smithi131.stdout:4/512: chown d2/d7/d12/d2e/d5f/d70/la6 9 1 2024-02-15T18:31:31.169 INFO:tasks.workunit.client.1.smithi131.stdout:4/513: write d2/f1a [3163563,77147] 0 2024-02-15T18:31:31.169 INFO:tasks.workunit.client.1.smithi131.stdout:4/514: dread - d2/d7/d1c/d94/f95 zero size 2024-02-15T18:31:31.169 INFO:tasks.workunit.client.1.smithi131.stdout:4/515: dread - d2/d7/d1c/d94/f95 zero size 2024-02-15T18:31:31.169 INFO:tasks.workunit.client.1.smithi131.stdout:4/516: chown d2/d7/d12/d2e/l8f 258557 1 2024-02-15T18:31:31.173 INFO:tasks.workunit.client.1.smithi131.stdout:9/397: dwrite d4/dc/de/d1e/d1f/f3a [0,4194304] 0 2024-02-15T18:31:31.201 INFO:tasks.workunit.client.1.smithi131.stdout:9/398: dwrite d4/dc/d17/d19/d32/f48 [0,4194304] 0 2024-02-15T18:31:31.202 INFO:tasks.workunit.client.1.smithi131.stdout:9/399: fsync d4/dc/d17/d19/d32/f4a 0 2024-02-15T18:31:31.202 INFO:tasks.workunit.client.1.smithi131.stdout:9/400: rename d4/dc to d4/dc/d73 22 2024-02-15T18:31:31.202 INFO:tasks.workunit.client.1.smithi131.stdout:9/401: stat d4/dc/d17 0 2024-02-15T18:31:31.203 INFO:tasks.workunit.client.1.smithi131.stdout:4/517: dwrite d2/d7/d1c/d94/f95 [0,4194304] 0 2024-02-15T18:31:31.203 INFO:tasks.workunit.client.1.smithi131.stdout:4/518: dread - d2/d7/d12/d53/fbb zero size 2024-02-15T18:31:31.203 INFO:tasks.workunit.client.1.smithi131.stdout:4/519: fdatasync d2/f4 0 2024-02-15T18:31:31.204 INFO:tasks.workunit.client.1.smithi131.stdout:9/402: mknod d4/dc/d25/c74 0 2024-02-15T18:31:31.207 INFO:tasks.workunit.client.1.smithi131.stdout:4/520: truncate d2/d2a/d47/d21/f41 2581750 0 2024-02-15T18:31:31.207 INFO:tasks.workunit.client.1.smithi131.stdout:4/521: chown d2/d2a/d85/da3/dba 7 1 2024-02-15T18:31:31.209 INFO:tasks.workunit.client.1.smithi131.stdout:9/403: link d4/dc/d25/f40 d4/dc/d17/d19/d41/f75 0 2024-02-15T18:31:31.211 INFO:tasks.workunit.client.1.smithi131.stdout:9/404: rename d4/dc/d17/d19/fb to d4/dc/d25/d4e/d6d/f76 0 2024-02-15T18:31:31.217 INFO:tasks.workunit.client.1.smithi131.stdout:9/405: getdents d4/dc/de/d1e 0 2024-02-15T18:31:31.218 INFO:tasks.workunit.client.1.smithi131.stdout:9/406: creat d4/dc/de/d1e/d1f/d51/f77 x:0 0 0 2024-02-15T18:31:31.218 INFO:tasks.workunit.client.1.smithi131.stdout:9/407: stat d4/dc/d17/l18 0 2024-02-15T18:31:31.220 INFO:tasks.workunit.client.1.smithi131.stdout:9/408: mkdir d4/d78 0 2024-02-15T18:31:31.220 INFO:tasks.workunit.client.1.smithi131.stdout:9/409: chown d4/dc/de/d1e/d1f/c29 340395 1 2024-02-15T18:31:31.222 INFO:tasks.workunit.client.1.smithi131.stdout:9/410: dread d4/dc/d25/d4e/d38/f50 [0,4194304] 0 2024-02-15T18:31:31.223 INFO:tasks.workunit.client.1.smithi131.stdout:9/411: readlink d4/dc/d25/l31 0 2024-02-15T18:31:31.226 INFO:tasks.workunit.client.1.smithi131.stdout:4/522: dwrite d2/d2a/d47/d16/d43/f6c [0,4194304] 0 2024-02-15T18:31:31.226 INFO:tasks.workunit.client.1.smithi131.stdout:4/523: stat d2/d2a/d47 0 2024-02-15T18:31:31.228 INFO:tasks.workunit.client.1.smithi131.stdout:4/524: creat d2/d2a/d47/d21/d9e/fbe x:0 0 0 2024-02-15T18:31:31.229 INFO:tasks.workunit.client.1.smithi131.stdout:9/412: getdents d4/dc/d17/d19/d41 0 2024-02-15T18:31:31.231 INFO:tasks.workunit.client.1.smithi131.stdout:4/525: mkdir d2/d2a/d85/da3/dbf 0 2024-02-15T18:31:31.232 INFO:tasks.workunit.client.1.smithi131.stdout:4/526: symlink d2/d2a/d85/da3/lc0 0 2024-02-15T18:31:31.233 INFO:tasks.workunit.client.1.smithi131.stdout:4/527: chown d2/f1a 199 1 2024-02-15T18:31:31.234 INFO:tasks.workunit.client.1.smithi131.stdout:4/528: link d2/d7/d12/f79 d2/d7/d12/d2e/fc1 0 2024-02-15T18:31:31.236 INFO:tasks.workunit.client.1.smithi131.stdout:4/529: mknod d2/d7/d1c/d5d/d7a/cc2 0 2024-02-15T18:31:31.239 INFO:tasks.workunit.client.1.smithi131.stdout:4/530: link d2/f35 d2/d2a/d85/da3/fc3 0 2024-02-15T18:31:31.241 INFO:tasks.workunit.client.1.smithi131.stdout:4/531: truncate d2/d7/d12/f52 1995565 0 2024-02-15T18:31:31.249 INFO:tasks.workunit.client.1.smithi131.stdout:4/532: dread d2/d2a/d47/d16/d43/f89 [0,4194304] 0 2024-02-15T18:31:31.250 INFO:tasks.workunit.client.1.smithi131.stdout:4/533: creat d2/d23/fc4 x:0 0 0 2024-02-15T18:31:31.251 INFO:tasks.workunit.client.1.smithi131.stdout:4/534: chown d2/d7/d12/d2e/d39/d4b/la8 3 1 2024-02-15T18:31:31.252 INFO:tasks.workunit.client.1.smithi131.stdout:4/535: unlink d2/d2a/d85/da3/fc3 0 2024-02-15T18:31:31.253 INFO:tasks.workunit.client.1.smithi131.stdout:9/413: dwrite f0 [4194304,4194304] 0 2024-02-15T18:31:31.254 INFO:tasks.workunit.client.1.smithi131.stdout:4/536: rename d2/d23/l62 to d2/d7/d1c/d84/db8/lc5 0 2024-02-15T18:31:31.255 INFO:tasks.workunit.client.1.smithi131.stdout:4/537: mknod d2/d2a/d47/d21/cc6 0 2024-02-15T18:31:31.268 INFO:tasks.workunit.client.1.smithi131.stdout:9/414: dwrite d4/dc/d17/d19/f5f [0,4194304] 0 2024-02-15T18:31:31.272 INFO:tasks.workunit.client.1.smithi131.stdout:9/415: rename d4/dc/d17/f3d to d4/dc/de/d1e/d1f/d2c/f79 0 2024-02-15T18:31:31.276 INFO:tasks.workunit.client.1.smithi131.stdout:9/416: unlink d4/dc/d25/l6e 0 2024-02-15T18:31:31.278 INFO:tasks.workunit.client.1.smithi131.stdout:9/417: rename d4/dc/f36 to d4/dc/d25/d4e/d6d/f7a 0 2024-02-15T18:31:31.279 INFO:tasks.workunit.client.1.smithi131.stdout:9/418: rename d4/dc/c60 to d4/dc/d25/c7b 0 2024-02-15T18:31:31.280 INFO:tasks.workunit.client.1.smithi131.stdout:9/419: symlink d4/dc/de/d1e/d1f/d2c/l7c 0 2024-02-15T18:31:31.281 INFO:tasks.workunit.client.1.smithi131.stdout:9/420: write d4/dc/d17/d19/f5f [1528712,25718] 0 2024-02-15T18:31:31.281 INFO:tasks.workunit.client.1.smithi131.stdout:9/421: readlink d4/dc/de/d1e/d1f/d2c/l7c 0 2024-02-15T18:31:31.282 INFO:tasks.workunit.client.1.smithi131.stdout:4/538: dread d2/f8 [0,4194304] 0 2024-02-15T18:31:31.282 INFO:tasks.workunit.client.1.smithi131.stdout:9/422: mknod d4/dc/d17/d19/c7d 0 2024-02-15T18:31:31.283 INFO:tasks.workunit.client.1.smithi131.stdout:4/539: symlink d2/d7/d12/d2e/lc7 0 2024-02-15T18:31:31.283 INFO:tasks.workunit.client.1.smithi131.stdout:9/423: write d4/dc/d25/f40 [1855336,22409] 0 2024-02-15T18:31:31.285 INFO:tasks.workunit.client.1.smithi131.stdout:4/540: link d2/d7/d12/f9c d2/d7/d12/d2e/d39/d4b/fc8 0 2024-02-15T18:31:31.286 INFO:tasks.workunit.client.1.smithi131.stdout:9/424: mknod d4/dc/de/c7e 0 2024-02-15T18:31:31.287 INFO:tasks.workunit.client.1.smithi131.stdout:4/541: creat d2/d7/fc9 x:0 0 0 2024-02-15T18:31:31.288 INFO:tasks.workunit.client.1.smithi131.stdout:9/425: mkdir d4/dc/de/d1e/d1f/d51/d7f 0 2024-02-15T18:31:31.289 INFO:tasks.workunit.client.1.smithi131.stdout:9/426: dread - d4/dc/de/d1e/d1f/d2c/f6a zero size 2024-02-15T18:31:31.289 INFO:tasks.workunit.client.1.smithi131.stdout:4/542: dread d2/d2a/d47/f6f [0,4194304] 0 2024-02-15T18:31:31.290 INFO:tasks.workunit.client.1.smithi131.stdout:9/427: creat d4/dc/de/f80 x:0 0 0 2024-02-15T18:31:31.292 INFO:tasks.workunit.client.1.smithi131.stdout:9/428: rename d4/dc/d17/d19/d41 to d4/dc/d25/d3f/d81 0 2024-02-15T18:31:31.292 INFO:tasks.workunit.client.1.smithi131.stdout:9/429: chown d4/dc/de/d1e/d1f/d51/d5d 112476330 1 2024-02-15T18:31:31.293 INFO:tasks.workunit.client.1.smithi131.stdout:9/430: creat d4/dc/d17/d19/f82 x:0 0 0 2024-02-15T18:31:31.295 INFO:tasks.workunit.client.1.smithi131.stdout:9/431: link d4/dc/d17/l62 d4/dc/d25/d4e/d38/l83 0 2024-02-15T18:31:31.295 INFO:tasks.workunit.client.1.smithi131.stdout:9/432: rmdir d4/dc/d17/d19/d32 39 2024-02-15T18:31:31.298 INFO:tasks.workunit.client.1.smithi131.stdout:9/433: mkdir d4/dc/d17/d19/d84 0 2024-02-15T18:31:31.299 INFO:tasks.workunit.client.1.smithi131.stdout:9/434: symlink d4/dc/de/d1e/d1f/d2c/l85 0 2024-02-15T18:31:31.300 INFO:tasks.workunit.client.1.smithi131.stdout:9/435: creat d4/dc/d25/d3f/d81/f86 x:0 0 0 2024-02-15T18:31:31.300 INFO:tasks.workunit.client.1.smithi131.stdout:9/436: truncate d4/dc/d25/d4e/d38/f50 1887146 0 2024-02-15T18:31:31.300 INFO:tasks.workunit.client.1.smithi131.stdout:9/437: truncate d4/dc/d25/d3f/d81/f86 288709 0 2024-02-15T18:31:31.301 INFO:tasks.workunit.client.1.smithi131.stdout:9/438: creat d4/dc/d25/d3f/d81/d5b/f87 x:0 0 0 2024-02-15T18:31:31.302 INFO:tasks.workunit.client.1.smithi131.stdout:9/439: dread - d4/dc/d25/f55 zero size 2024-02-15T18:31:31.302 INFO:tasks.workunit.client.1.smithi131.stdout:9/440: chown d4/dc/d17/d19/c7d 2674452 1 2024-02-15T18:31:31.303 INFO:tasks.workunit.client.1.smithi131.stdout:9/441: truncate d4/dc/f56 3974954 0 2024-02-15T18:31:31.305 INFO:tasks.workunit.client.1.smithi131.stdout:2/271: sync 2024-02-15T18:31:31.306 INFO:tasks.workunit.client.1.smithi131.stdout:9/442: write f3 [2827689,72910] 0 2024-02-15T18:31:31.306 INFO:tasks.workunit.client.1.smithi131.stdout:3/445: sync 2024-02-15T18:31:31.306 INFO:tasks.workunit.client.1.smithi131.stdout:3/446: fdatasync d2/d22/d29/d20/f8b 0 2024-02-15T18:31:31.307 INFO:tasks.workunit.client.1.smithi131.stdout:2/272: truncate dd/d10/d22/f56 1875051 0 2024-02-15T18:31:31.309 INFO:tasks.workunit.client.1.smithi131.stdout:9/443: truncate d4/dc/de/d1e/f37 3201518 0 2024-02-15T18:31:31.309 INFO:tasks.workunit.client.1.smithi131.stdout:9/444: truncate d4/dc/d25/d3f/d81/d5b/f6f 4925382 0 2024-02-15T18:31:31.311 INFO:tasks.workunit.client.1.smithi131.stdout:2/273: rename dd/c20 to dd/c57 0 2024-02-15T18:31:31.311 INFO:tasks.workunit.client.1.smithi131.stdout:2/274: dread - dd/d10/d22/f52 zero size 2024-02-15T18:31:31.311 INFO:tasks.workunit.client.1.smithi131.stdout:2/275: readlink dd/d10/d22/d2a/d48/l51 0 2024-02-15T18:31:31.311 INFO:tasks.workunit.client.1.smithi131.stdout:2/276: write dd/d10/d13/d2e/f32 [1463184,45166] 0 2024-02-15T18:31:31.312 INFO:tasks.workunit.client.1.smithi131.stdout:9/445: creat d4/dc/d25/d4e/d6d/f88 x:0 0 0 2024-02-15T18:31:31.314 INFO:tasks.workunit.client.1.smithi131.stdout:2/277: write dd/d10/f19 [1961038,52758] 0 2024-02-15T18:31:31.314 INFO:tasks.workunit.client.1.smithi131.stdout:2/278: chown dd/d10/d22/d2f/l33 218 1 2024-02-15T18:31:31.315 INFO:tasks.workunit.client.1.smithi131.stdout:4/543: dwrite d2/d2a/d85/da3/fa7 [0,4194304] 0 2024-02-15T18:31:31.316 INFO:tasks.workunit.client.1.smithi131.stdout:3/447: dread d2/f59 [0,4194304] 0 2024-02-15T18:31:31.316 INFO:tasks.workunit.client.1.smithi131.stdout:9/446: symlink d4/dc/de/d1e/d1f/l89 0 2024-02-15T18:31:31.338 INFO:tasks.workunit.client.1.smithi131.stdout:3/448: getdents d2/d22/d42 0 2024-02-15T18:31:31.348 INFO:tasks.workunit.client.1.smithi131.stdout:9/447: dwrite d4/dc/d17/d19/f5f [0,4194304] 0 2024-02-15T18:31:31.357 INFO:tasks.workunit.client.1.smithi131.stdout:9/448: dread d4/dc/de/d1e/d1f/d2c/f79 [0,4194304] 0 2024-02-15T18:31:31.358 INFO:tasks.workunit.client.1.smithi131.stdout:9/449: mkdir d4/dc/d25/d4e/d8a 0 2024-02-15T18:31:31.360 INFO:tasks.workunit.client.1.smithi131.stdout:2/279: dwrite dd/d10/d22/f56 [0,4194304] 0 2024-02-15T18:31:31.360 INFO:tasks.workunit.client.1.smithi131.stdout:9/450: rename d4/dc/d17/d19/d32/f4a to d4/dc/d25/d4e/d8a/f8b 0 2024-02-15T18:31:31.361 INFO:tasks.workunit.client.1.smithi131.stdout:3/449: dwrite d2/d22/d29/db/d34/f8a [0,4194304] 0 2024-02-15T18:31:31.361 INFO:tasks.workunit.client.1.smithi131.stdout:3/450: chown d2/d22/c7b 2 1 2024-02-15T18:31:31.361 INFO:tasks.workunit.client.1.smithi131.stdout:3/451: fsync d2/d22/d29/db/d23/d2a/d49/f56 0 2024-02-15T18:31:31.363 INFO:tasks.workunit.client.1.smithi131.stdout:2/280: mknod dd/d10/d22/c58 0 2024-02-15T18:31:31.364 INFO:tasks.workunit.client.1.smithi131.stdout:9/451: creat d4/dc/de/d1e/d1f/d51/d7f/f8c x:0 0 0 2024-02-15T18:31:31.370 INFO:tasks.workunit.client.1.smithi131.stdout:3/452: mknod d2/d22/d29/db/d23/d2a/d5b/c8e 0 2024-02-15T18:31:31.370 INFO:tasks.workunit.client.1.smithi131.stdout:2/281: truncate f8 1141495 0 2024-02-15T18:31:31.372 INFO:tasks.workunit.client.1.smithi131.stdout:9/452: unlink d4/dc/d25/d4e/d6d/f76 0 2024-02-15T18:31:31.373 INFO:tasks.workunit.client.1.smithi131.stdout:2/282: getdents dd/d14/d2b 0 2024-02-15T18:31:31.373 INFO:tasks.workunit.client.1.smithi131.stdout:2/283: fsync dd/d10/d22/d2f/d38/f50 0 2024-02-15T18:31:31.374 INFO:tasks.workunit.client.1.smithi131.stdout:9/453: creat d4/dc/d25/d4e/d8a/f8d x:0 0 0 2024-02-15T18:31:31.375 INFO:tasks.workunit.client.1.smithi131.stdout:3/453: dread d2/f59 [0,4194304] 0 2024-02-15T18:31:31.376 INFO:tasks.workunit.client.1.smithi131.stdout:2/284: rename dd/c57 to dd/d10/d22/d2a/d48/c59 0 2024-02-15T18:31:31.379 INFO:tasks.workunit.client.1.smithi131.stdout:9/454: mknod d4/dc/d25/d3f/c8e 0 2024-02-15T18:31:31.382 INFO:tasks.workunit.client.1.smithi131.stdout:3/454: mknod d2/d22/d29/db/d34/c8f 0 2024-02-15T18:31:31.382 INFO:tasks.workunit.client.1.smithi131.stdout:5/449: sync 2024-02-15T18:31:31.382 INFO:tasks.workunit.client.1.smithi131.stdout:8/321: sync 2024-02-15T18:31:31.383 INFO:tasks.workunit.client.1.smithi131.stdout:9/455: mknod d4/dc/d17/c8f 0 2024-02-15T18:31:31.384 INFO:tasks.workunit.client.1.smithi131.stdout:9/456: write d4/dc/d17/d19/f82 [932818,41754] 0 2024-02-15T18:31:31.384 INFO:tasks.workunit.client.1.smithi131.stdout:3/455: rmdir d2/d22/d29/db/d23/d2a/d5b 39 2024-02-15T18:31:31.385 INFO:tasks.workunit.client.1.smithi131.stdout:8/322: unlink d22/d26/d3f/d47/c56 0 2024-02-15T18:31:31.385 INFO:tasks.workunit.client.1.smithi131.stdout:8/323: fdatasync d22/d26/f2a 0 2024-02-15T18:31:31.385 INFO:tasks.workunit.client.1.smithi131.stdout:8/324: stat l18 0 2024-02-15T18:31:31.387 INFO:tasks.workunit.client.1.smithi131.stdout:5/450: mknod d18/d24/d7b/c97 0 2024-02-15T18:31:31.389 INFO:tasks.workunit.client.1.smithi131.stdout:2/285: unlink dd/f11 0 2024-02-15T18:31:31.389 INFO:tasks.workunit.client.1.smithi131.stdout:2/286: write dd/d10/d22/d2f/d38/f50 [385907,57875] 0 2024-02-15T18:31:31.390 INFO:tasks.workunit.client.1.smithi131.stdout:9/457: rmdir d4/dc/d17/d19/d32 39 2024-02-15T18:31:31.393 INFO:tasks.workunit.client.1.smithi131.stdout:3/456: unlink d2/d22/d29/db/d23/d2a/d49/f56 0 2024-02-15T18:31:31.398 INFO:tasks.workunit.client.1.smithi131.stdout:8/325: creat d22/d26/f6c x:0 0 0 2024-02-15T18:31:31.399 INFO:tasks.workunit.client.1.smithi131.stdout:5/451: mknod d18/d20/d90/c98 0 2024-02-15T18:31:31.399 INFO:tasks.workunit.client.1.smithi131.stdout:5/452: fdatasync f6 0 2024-02-15T18:31:31.399 INFO:tasks.workunit.client.1.smithi131.stdout:5/453: readlink d18/d24/d63/l65 0 2024-02-15T18:31:31.401 INFO:tasks.workunit.client.1.smithi131.stdout:9/458: mknod d4/dc/d25/d3f/d81/d72/c90 0 2024-02-15T18:31:31.401 INFO:tasks.workunit.client.1.smithi131.stdout:5/454: write f11 [1782331,118648] 0 2024-02-15T18:31:31.401 INFO:tasks.workunit.client.1.smithi131.stdout:5/455: dread - d18/d33/d73/f88 zero size 2024-02-15T18:31:31.402 INFO:tasks.workunit.client.1.smithi131.stdout:9/459: mkdir d4/dc/d17/d19/d32/d91 0 2024-02-15T18:31:31.403 INFO:tasks.workunit.client.1.smithi131.stdout:8/326: dread d22/d26/f2f [0,4194304] 0 2024-02-15T18:31:31.403 INFO:tasks.workunit.client.1.smithi131.stdout:5/456: creat d18/d24/d63/f99 x:0 0 0 2024-02-15T18:31:31.405 INFO:tasks.workunit.client.1.smithi131.stdout:9/460: creat d4/dc/d25/d3f/d81/d5b/f92 x:0 0 0 2024-02-15T18:31:31.405 INFO:tasks.workunit.client.1.smithi131.stdout:9/461: stat d4/dc/d17/d19/c7d 0 2024-02-15T18:31:31.405 INFO:tasks.workunit.client.1.smithi131.stdout:9/462: fsync d4/dc/d25/d3f/d81/f86 0 2024-02-15T18:31:31.405 INFO:tasks.workunit.client.1.smithi131.stdout:8/327: creat d22/d26/d3f/d47/f6d x:0 0 0 2024-02-15T18:31:31.405 INFO:tasks.workunit.client.1.smithi131.stdout:8/328: readlink d22/d26/l5b 0 2024-02-15T18:31:31.406 INFO:tasks.workunit.client.1.smithi131.stdout:5/457: unlink d18/d6d/d70/c80 0 2024-02-15T18:31:31.411 INFO:tasks.workunit.client.1.smithi131.stdout:8/329: link d22/d2e/f38 d22/d26/d3f/f6e 0 2024-02-15T18:31:31.413 INFO:tasks.workunit.client.1.smithi131.stdout:8/330: mkdir d22/d26/d3f/d47/d48/d5f/d6f 0 2024-02-15T18:31:31.414 INFO:tasks.workunit.client.1.smithi131.stdout:8/331: write d22/d26/f35 [867663,3030] 0 2024-02-15T18:31:31.415 INFO:tasks.workunit.client.1.smithi131.stdout:8/332: write d22/d2e/f37 [3324708,83706] 0 2024-02-15T18:31:31.415 INFO:tasks.workunit.client.1.smithi131.stdout:8/333: readlink d22/d26/l45 0 2024-02-15T18:31:31.415 INFO:tasks.workunit.client.1.smithi131.stdout:8/334: chown d22/d2e/d60 47397 1 2024-02-15T18:31:31.416 INFO:tasks.workunit.client.1.smithi131.stdout:8/335: mkdir d22/d26/d3f/d47/d48/d5f/d70 0 2024-02-15T18:31:31.417 INFO:tasks.workunit.client.1.smithi131.stdout:3/457: dread d2/d22/f72 [0,4194304] 0 2024-02-15T18:31:31.418 INFO:tasks.workunit.client.1.smithi131.stdout:8/336: mknod d22/d2e/d5e/c71 0 2024-02-15T18:31:31.419 INFO:tasks.workunit.client.1.smithi131.stdout:8/337: creat d22/d26/d3f/d47/d48/d5f/f72 x:0 0 0 2024-02-15T18:31:31.420 INFO:tasks.workunit.client.1.smithi131.stdout:8/338: dread f14 [0,4194304] 0 2024-02-15T18:31:31.420 INFO:tasks.workunit.client.1.smithi131.stdout:8/339: truncate d22/d41/f49 671498 0 2024-02-15T18:31:31.420 INFO:tasks.workunit.client.1.smithi131.stdout:8/340: stat d22/l4b 0 2024-02-15T18:31:31.420 INFO:tasks.workunit.client.1.smithi131.stdout:8/341: write d22/d26/f55 [639292,24626] 0 2024-02-15T18:31:31.420 INFO:tasks.workunit.client.1.smithi131.stdout:8/342: truncate d22/d26/d3f/f44 1333569 0 2024-02-15T18:31:31.423 INFO:tasks.workunit.client.1.smithi131.stdout:3/458: dread d2/d22/d29/db/f1e [0,4194304] 0 2024-02-15T18:31:31.423 INFO:tasks.workunit.client.1.smithi131.stdout:3/459: readlink d2/d22/d29/db/d23/d2a/l61 0 2024-02-15T18:31:31.423 INFO:tasks.workunit.client.1.smithi131.stdout:2/287: dwrite fc [0,4194304] 0 2024-02-15T18:31:31.424 INFO:tasks.workunit.client.1.smithi131.stdout:3/460: link d2/f7c d2/d22/d29/db/f90 0 2024-02-15T18:31:31.425 INFO:tasks.workunit.client.1.smithi131.stdout:3/461: rmdir d2/d22/d5e 39 2024-02-15T18:31:31.434 INFO:tasks.workunit.client.1.smithi131.stdout:9/463: dwrite d4/dc/d25/d3f/d81/d5b/f6f [0,4194304] 0 2024-02-15T18:31:31.435 INFO:tasks.workunit.client.1.smithi131.stdout:5/458: dwrite d18/d33/f5b [0,4194304] 0 2024-02-15T18:31:31.435 INFO:tasks.workunit.client.1.smithi131.stdout:5/459: chown d18/f50 79900 1 2024-02-15T18:31:31.437 INFO:tasks.workunit.client.1.smithi131.stdout:8/343: fdatasync d22/d2e/f37 0 2024-02-15T18:31:31.437 INFO:tasks.workunit.client.1.smithi131.stdout:5/460: dread d18/d20/f60 [0,4194304] 0 2024-02-15T18:31:31.447 INFO:tasks.workunit.client.1.smithi131.stdout:3/462: dwrite d2/d22/d29/f17 [0,4194304] 0 2024-02-15T18:31:31.447 INFO:tasks.workunit.client.1.smithi131.stdout:3/463: fsync d2/d22/d29/db/d1a/f68 0 2024-02-15T18:31:31.449 INFO:tasks.workunit.client.1.smithi131.stdout:2/288: dread dd/d1e/f26 [0,4194304] 0 2024-02-15T18:31:31.449 INFO:tasks.workunit.client.1.smithi131.stdout:8/344: dread d22/f23 [0,4194304] 0 2024-02-15T18:31:31.449 INFO:tasks.workunit.client.1.smithi131.stdout:8/345: chown d22/d41/c46 388246 1 2024-02-15T18:31:31.449 INFO:tasks.workunit.client.1.smithi131.stdout:3/464: dread d2/d22/d29/d20/f8b [0,4194304] 0 2024-02-15T18:31:31.460 INFO:tasks.workunit.client.1.smithi131.stdout:2/289: symlink dd/d10/d13/l5a 0 2024-02-15T18:31:31.461 INFO:tasks.workunit.client.1.smithi131.stdout:5/461: dwrite d18/d33/d73/f79 [0,4194304] 0 2024-02-15T18:31:31.463 INFO:tasks.workunit.client.1.smithi131.stdout:2/290: rename dd/l17 to dd/d14/d46/l5b 0 2024-02-15T18:31:31.463 INFO:tasks.workunit.client.1.smithi131.stdout:3/465: dread d2/d22/d29/d20/f6d [4194304,4194304] 0 2024-02-15T18:31:31.463 INFO:tasks.workunit.client.1.smithi131.stdout:3/466: write d2/d22/d29/db/d34/f3b [667131,94236] 0 2024-02-15T18:31:31.466 INFO:tasks.workunit.client.1.smithi131.stdout:5/462: mkdir d18/d20/d9a 0 2024-02-15T18:31:31.469 INFO:tasks.workunit.client.1.smithi131.stdout:2/291: creat dd/d14/f5c x:0 0 0 2024-02-15T18:31:31.476 INFO:tasks.workunit.client.1.smithi131.stdout:2/292: creat dd/d10/d13/f5d x:0 0 0 2024-02-15T18:31:31.476 INFO:tasks.workunit.client.1.smithi131.stdout:8/346: dwrite d22/d26/d3f/d47/f6a [0,4194304] 0 2024-02-15T18:31:31.477 INFO:tasks.workunit.client.1.smithi131.stdout:2/293: mknod dd/d10/d13/d2e/d4a/c5e 0 2024-02-15T18:31:31.479 INFO:tasks.workunit.client.1.smithi131.stdout:8/347: rename l19 to d22/l73 0 2024-02-15T18:31:31.482 INFO:tasks.workunit.client.1.smithi131.stdout:9/464: dwrite d4/dc/de/d1e/d1f/d2c/f4b [0,4194304] 0 2024-02-15T18:31:31.482 INFO:tasks.workunit.client.1.smithi131.stdout:8/348: mknod d22/d26/d3f/c74 0 2024-02-15T18:31:31.483 INFO:tasks.workunit.client.1.smithi131.stdout:8/349: write fb [395244,77025] 0 2024-02-15T18:31:31.483 INFO:tasks.workunit.client.1.smithi131.stdout:3/467: dwrite d2/d22/d29/db/d1a/f68 [0,4194304] 0 2024-02-15T18:31:31.488 INFO:tasks.workunit.client.1.smithi131.stdout:2/294: rename dd/d10/d22/f52 to dd/d1e/f5f 0 2024-02-15T18:31:31.488 INFO:tasks.workunit.client.1.smithi131.stdout:2/295: readlink dd/d1e/l21 0 2024-02-15T18:31:31.495 INFO:tasks.workunit.client.1.smithi131.stdout:9/465: unlink d4/dc/d25/d3f/c8e 0 2024-02-15T18:31:31.495 INFO:tasks.workunit.client.1.smithi131.stdout:9/466: dread - d4/dc/d25/d3f/d81/d5b/f87 zero size 2024-02-15T18:31:31.500 INFO:tasks.workunit.client.1.smithi131.stdout:2/296: creat dd/f60 x:0 0 0 2024-02-15T18:31:31.500 INFO:tasks.workunit.client.1.smithi131.stdout:2/297: write dd/f60 [904925,65541] 0 2024-02-15T18:31:31.500 INFO:tasks.workunit.client.1.smithi131.stdout:8/350: rename d22/d39/f58 to d22/d2e/d5e/f75 0 2024-02-15T18:31:31.505 INFO:tasks.workunit.client.1.smithi131.stdout:9/467: unlink d4/dc/de/d1e/l64 0 2024-02-15T18:31:31.505 INFO:tasks.workunit.client.1.smithi131.stdout:9/468: truncate d4/dc/d25/d3f/d81/d5b/f6f 5944259 0 2024-02-15T18:31:31.507 INFO:tasks.workunit.client.1.smithi131.stdout:2/298: creat dd/d10/d13/f61 x:0 0 0 2024-02-15T18:31:31.509 INFO:tasks.workunit.client.1.smithi131.stdout:2/299: symlink dd/d14/d1f/l62 0 2024-02-15T18:31:31.509 INFO:tasks.workunit.client.1.smithi131.stdout:2/300: write dd/d10/d13/f61 [814688,77449] 0 2024-02-15T18:31:31.510 INFO:tasks.workunit.client.1.smithi131.stdout:3/468: dwrite d2/d22/d42/f45 [0,4194304] 0 2024-02-15T18:31:31.514 INFO:tasks.workunit.client.1.smithi131.stdout:3/469: creat d2/d22/d29/f91 x:0 0 0 2024-02-15T18:31:31.516 INFO:tasks.workunit.client.1.smithi131.stdout:3/470: getdents d2/d22/d29/db 0 2024-02-15T18:31:31.517 INFO:tasks.workunit.client.1.smithi131.stdout:3/471: write d2/d22/d29/db/d1a/fe [2052546,129992] 0 2024-02-15T18:31:31.520 INFO:tasks.workunit.client.1.smithi131.stdout:2/301: dread f4 [4194304,4194304] 0 2024-02-15T18:31:31.525 INFO:tasks.workunit.client.1.smithi131.stdout:3/472: creat d2/f92 x:0 0 0 2024-02-15T18:31:31.529 INFO:tasks.workunit.client.1.smithi131.stdout:3/473: dread d2/d22/f2e [0,4194304] 0 2024-02-15T18:31:31.529 INFO:tasks.workunit.client.1.smithi131.stdout:3/474: fsync d2/d22/d29/db/d23/d2a/f2d 0 2024-02-15T18:31:31.529 INFO:tasks.workunit.client.1.smithi131.stdout:3/475: write d2/f3c [4856047,128377] 0 2024-02-15T18:31:31.530 INFO:tasks.workunit.client.1.smithi131.stdout:9/469: dwrite d4/dc/d17/d19/f82 [0,4194304] 0 2024-02-15T18:31:31.530 INFO:tasks.workunit.client.1.smithi131.stdout:9/470: write d4/dc/d25/d4e/d8a/f8d [88225,21194] 0 2024-02-15T18:31:31.530 INFO:tasks.workunit.client.1.smithi131.stdout:9/471: dread - d4/dc/de/d1e/d1f/d51/f77 zero size 2024-02-15T18:31:31.530 INFO:tasks.workunit.client.1.smithi131.stdout:3/476: mknod d2/d22/d3f/c93 0 2024-02-15T18:31:31.530 INFO:tasks.workunit.client.1.smithi131.stdout:3/477: chown d2/d22/d3a/d6c/d8d 1003 1 2024-02-15T18:31:31.532 INFO:tasks.workunit.client.1.smithi131.stdout:6/421: sync 2024-02-15T18:31:31.532 INFO:tasks.workunit.client.1.smithi131.stdout:6/422: write d2/d2b/d6e/f7c [700583,122891] 0 2024-02-15T18:31:31.532 INFO:tasks.workunit.client.1.smithi131.stdout:6/423: chown f0 5556 1 2024-02-15T18:31:31.532 INFO:tasks.workunit.client.1.smithi131.stdout:0/323: sync 2024-02-15T18:31:31.532 INFO:tasks.workunit.client.1.smithi131.stdout:7/567: sync 2024-02-15T18:31:31.532 INFO:tasks.workunit.client.1.smithi131.stdout:8/351: dwrite d22/d26/f55 [0,4194304] 0 2024-02-15T18:31:31.532 INFO:tasks.workunit.client.1.smithi131.stdout:8/352: chown d22/d26/c2c 403358 1 2024-02-15T18:31:31.532 INFO:tasks.workunit.client.1.smithi131.stdout:8/353: read - d22/d26/d3f/d47/d48/d5f/f72 zero size 2024-02-15T18:31:31.532 INFO:tasks.workunit.client.1.smithi131.stdout:1/537: sync 2024-02-15T18:31:31.534 INFO:tasks.workunit.client.1.smithi131.stdout:3/478: dread d2/d22/d29/db/d23/d2a/d49/f66 [0,4194304] 0 2024-02-15T18:31:31.534 INFO:tasks.workunit.client.1.smithi131.stdout:2/302: link dd/d10/d13/c1b dd/d14/d46/c63 0 2024-02-15T18:31:31.536 INFO:tasks.workunit.client.1.smithi131.stdout:9/472: mknod d4/dc/de/c93 0 2024-02-15T18:31:31.536 INFO:tasks.workunit.client.1.smithi131.stdout:4/544: sync 2024-02-15T18:31:31.536 INFO:tasks.workunit.client.1.smithi131.stdout:4/545: dread - d2/d7/d12/fa0 zero size 2024-02-15T18:31:31.536 INFO:tasks.workunit.client.1.smithi131.stdout:4/546: write d2/d7/d1c/f74 [848625,7748] 0 2024-02-15T18:31:31.536 INFO:tasks.workunit.client.1.smithi131.stdout:4/547: dread - d2/d7/f5c zero size 2024-02-15T18:31:31.536 INFO:tasks.workunit.client.1.smithi131.stdout:6/424: rename d2/d7/d48/f59 to d2/d7/d12/d80/f83 0 2024-02-15T18:31:31.543 INFO:tasks.workunit.client.1.smithi131.stdout:3/479: creat d2/d22/d29/db/d23/f94 x:0 0 0 2024-02-15T18:31:31.546 INFO:tasks.workunit.client.1.smithi131.stdout:9/473: symlink d4/dc/d25/l94 0 2024-02-15T18:31:31.547 INFO:tasks.workunit.client.1.smithi131.stdout:6/425: symlink d2/dc/d27/l84 0 2024-02-15T18:31:31.547 INFO:tasks.workunit.client.1.smithi131.stdout:4/548: getdents d2/d7/d12/d2e/d39 0 2024-02-15T18:31:31.547 INFO:tasks.workunit.client.1.smithi131.stdout:4/549: write d2/d7/d1c/d5d/d7a/d92/fad [653719,1697] 0 2024-02-15T18:31:31.547 INFO:tasks.workunit.client.1.smithi131.stdout:3/480: truncate d2/d22/d29/d20/f8b 156664 0 2024-02-15T18:31:31.552 INFO:tasks.workunit.client.1.smithi131.stdout:0/324: creat d5/d2f/d4b/f69 x:0 0 0 2024-02-15T18:31:31.552 INFO:tasks.workunit.client.1.smithi131.stdout:1/538: mkdir d0/d2/d4/d41/d5a/d5f/da1/db3/dc2 0 2024-02-15T18:31:31.552 INFO:tasks.workunit.client.1.smithi131.stdout:1/539: chown d0/d1/d24/d89/ca3 193914 1 2024-02-15T18:31:31.552 INFO:tasks.workunit.client.1.smithi131.stdout:6/426: creat d2/d79/f85 x:0 0 0 2024-02-15T18:31:31.552 INFO:tasks.workunit.client.1.smithi131.stdout:6/427: write d2/d2b/d6e/f6f [437986,94543] 0 2024-02-15T18:31:31.552 INFO:tasks.workunit.client.1.smithi131.stdout:9/474: creat d4/dc/d25/d3f/d81/d63/f95 x:0 0 0 2024-02-15T18:31:31.552 INFO:tasks.workunit.client.1.smithi131.stdout:9/475: fdatasync d4/dc/de/d1e/d1f/f3a 0 2024-02-15T18:31:31.558 INFO:tasks.workunit.client.1.smithi131.stdout:4/550: getdents d2/d2a/d47/d16/d43 0 2024-02-15T18:31:31.560 INFO:tasks.workunit.client.1.smithi131.stdout:3/481: mknod d2/d22/d3a/d6c/d85/c95 0 2024-02-15T18:31:31.560 INFO:tasks.workunit.client.1.smithi131.stdout:3/482: chown d2/d22/d3f/c51 3247 1 2024-02-15T18:31:31.568 INFO:tasks.workunit.client.1.smithi131.stdout:1/540: unlink d0/d2/c1d 0 2024-02-15T18:31:31.568 INFO:tasks.workunit.client.1.smithi131.stdout:0/325: getdents d5/d9/d10 0 2024-02-15T18:31:31.568 INFO:tasks.workunit.client.1.smithi131.stdout:0/326: rename d5/d9 to d5/d9/d11/d6a 22 2024-02-15T18:31:31.574 INFO:tasks.workunit.client.1.smithi131.stdout:1/541: mkdir d0/d2/d4/d41/dc3 0 2024-02-15T18:31:31.576 INFO:tasks.workunit.client.1.smithi131.stdout:1/542: symlink d0/d68/d80/lc4 0 2024-02-15T18:31:31.581 INFO:tasks.workunit.client.1.smithi131.stdout:1/543: link d0/d2/d4/c61 d0/d1/d44/d59/d42/cc5 0 2024-02-15T18:31:31.581 INFO:tasks.workunit.client.1.smithi131.stdout:8/354: dwrite d22/d26/f6c [0,4194304] 0 2024-02-15T18:31:31.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/355: creat d22/d26/f76 x:0 0 0 2024-02-15T18:31:31.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/356: write d22/f6b [174099,1421] 0 2024-02-15T18:31:31.592 INFO:tasks.workunit.client.1.smithi131.stdout:8/357: mknod d22/d41/c77 0 2024-02-15T18:31:31.593 INFO:tasks.workunit.client.1.smithi131.stdout:0/327: dread d5/fd [0,4194304] 0 2024-02-15T18:31:31.595 INFO:tasks.workunit.client.1.smithi131.stdout:8/358: rename d22/d39/l50 to d22/d26/d3f/d47/d48/d5f/d70/l78 0 2024-02-15T18:31:31.597 INFO:tasks.workunit.client.1.smithi131.stdout:0/328: symlink d5/d15/l6b 0 2024-02-15T18:31:31.597 INFO:tasks.workunit.client.1.smithi131.stdout:1/544: dread d0/d2/d7/f4c [0,4194304] 0 2024-02-15T18:31:31.597 INFO:tasks.workunit.client.1.smithi131.stdout:1/545: chown d0/d2/d31/d3d/f6a 13681916 1 2024-02-15T18:31:31.597 INFO:tasks.workunit.client.1.smithi131.stdout:1/546: write d0/d1/d16/d30/fae [749024,85854] 0 2024-02-15T18:31:31.599 INFO:tasks.workunit.client.1.smithi131.stdout:6/428: dwrite d2/d7/f54 [0,4194304] 0 2024-02-15T18:31:31.599 INFO:tasks.workunit.client.1.smithi131.stdout:7/568: dwrite d0/f88 [0,4194304] 0 2024-02-15T18:31:31.604 INFO:tasks.workunit.client.1.smithi131.stdout:4/551: dwrite d2/d2a/d68/f6b [0,4194304] 0 2024-02-15T18:31:31.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/303: dwrite dd/d10/d22/d2f/d38/f4d [0,4194304] 0 2024-02-15T18:31:31.607 INFO:tasks.workunit.client.1.smithi131.stdout:0/329: stat d5/d15/l5c 0 2024-02-15T18:31:31.611 INFO:tasks.workunit.client.1.smithi131.stdout:1/547: link d0/d2/d7/fb6 d0/d1/d44/d59/fc6 0 2024-02-15T18:31:31.611 INFO:tasks.workunit.client.1.smithi131.stdout:3/483: dwrite d2/d22/d29/db/d23/d2a/d5b/f7d [0,4194304] 0 2024-02-15T18:31:31.614 INFO:tasks.workunit.client.1.smithi131.stdout:9/476: dwrite d4/dc/d25/d4e/d6d/f88 [0,4194304] 0 2024-02-15T18:31:31.621 INFO:tasks.workunit.client.1.smithi131.stdout:6/429: symlink d2/d7/d12/d80/l86 0 2024-02-15T18:31:31.623 INFO:tasks.workunit.client.1.smithi131.stdout:4/552: rename d2/d2a/d47/d21/d9e/fae to d2/d2a/d47/d21/fca 0 2024-02-15T18:31:31.623 INFO:tasks.workunit.client.1.smithi131.stdout:0/330: rename d5 to d5/d9/d11/d6c 22 2024-02-15T18:31:31.623 INFO:tasks.workunit.client.1.smithi131.stdout:0/331: write d5/d9/d11/d3e/f59 [440084,81792] 0 2024-02-15T18:31:31.626 INFO:tasks.workunit.client.1.smithi131.stdout:1/548: dread d0/d1/d16/f43 [0,4194304] 0 2024-02-15T18:31:31.629 INFO:tasks.workunit.client.1.smithi131.stdout:2/304: creat dd/d14/f64 x:0 0 0 2024-02-15T18:31:31.631 INFO:tasks.workunit.client.1.smithi131.stdout:3/484: creat d2/d22/d29/db/d23/f96 x:0 0 0 2024-02-15T18:31:31.631 INFO:tasks.workunit.client.1.smithi131.stdout:2/305: read dd/f29 [2013993,129864] 0 2024-02-15T18:31:31.634 INFO:tasks.workunit.client.1.smithi131.stdout:9/477: creat d4/dc/de/d1e/d1f/d51/d5d/d71/f96 x:0 0 0 2024-02-15T18:31:31.635 INFO:tasks.workunit.client.1.smithi131.stdout:3/485: dread d2/d22/d29/d20/f8b [0,4194304] 0 2024-02-15T18:31:31.635 INFO:tasks.workunit.client.1.smithi131.stdout:3/486: write d2/d22/f63 [758816,5746] 0 2024-02-15T18:31:31.635 INFO:tasks.workunit.client.1.smithi131.stdout:3/487: readlink d2/d22/d29/db/d1a/l43 0 2024-02-15T18:31:31.635 INFO:tasks.workunit.client.1.smithi131.stdout:9/478: write d4/dc/f2d [2307259,103148] 0 2024-02-15T18:31:31.638 INFO:tasks.workunit.client.1.smithi131.stdout:9/479: write d4/dc/d25/d4e/d6d/f7a [1230058,33912] 0 2024-02-15T18:31:31.640 INFO:tasks.workunit.client.1.smithi131.stdout:7/569: dwrite d0/f65 [0,4194304] 0 2024-02-15T18:31:31.646 INFO:tasks.workunit.client.1.smithi131.stdout:8/359: dwrite d22/f6b [0,4194304] 0 2024-02-15T18:31:31.646 INFO:tasks.workunit.client.1.smithi131.stdout:8/360: readlink d22/d26/l45 0 2024-02-15T18:31:31.651 INFO:tasks.workunit.client.1.smithi131.stdout:4/553: write d2/d7/d1c/d5d/f7b [2283262,76738] 0 2024-02-15T18:31:31.652 INFO:tasks.workunit.client.1.smithi131.stdout:3/488: creat d2/d22/d5e/d79/f97 x:0 0 0 2024-02-15T18:31:31.653 INFO:tasks.workunit.client.1.smithi131.stdout:9/480: rename d4/dc/d25/c74 to d4/dc/d25/d4e/c97 0 2024-02-15T18:31:31.655 INFO:tasks.workunit.client.1.smithi131.stdout:7/570: mknod d0/d34/d8e/cb3 0 2024-02-15T18:31:31.659 INFO:tasks.workunit.client.1.smithi131.stdout:8/361: mknod d22/d26/d3f/d47/d48/d5f/d70/c79 0 2024-02-15T18:31:31.659 INFO:tasks.workunit.client.1.smithi131.stdout:8/362: fdatasync d22/f27 0 2024-02-15T18:31:31.663 INFO:tasks.workunit.client.1.smithi131.stdout:4/554: link d2/d7/d12/d2e/d5f/c78 d2/d7/d12/d2e/ccb 0 2024-02-15T18:31:31.663 INFO:tasks.workunit.client.1.smithi131.stdout:4/555: truncate d2/d7/d12/d53/fbb 235100 0 2024-02-15T18:31:31.664 INFO:tasks.workunit.client.1.smithi131.stdout:4/556: write d2/f1f [898791,106844] 0 2024-02-15T18:31:31.666 INFO:tasks.workunit.client.1.smithi131.stdout:3/489: creat d2/d22/d5e/d79/f98 x:0 0 0 2024-02-15T18:31:31.666 INFO:tasks.workunit.client.1.smithi131.stdout:3/490: fdatasync d2/f7c 0 2024-02-15T18:31:31.670 INFO:tasks.workunit.client.1.smithi131.stdout:7/571: rename d0/d17/d3a/d3d/d92 to d0/d17/d3a/d3d/d79/db4 0 2024-02-15T18:31:31.675 INFO:tasks.workunit.client.1.smithi131.stdout:9/481: write f1 [1926225,107126] 0 2024-02-15T18:31:31.677 INFO:tasks.workunit.client.1.smithi131.stdout:1/549: fsync d0/d1/d44/d59/fc6 0 2024-02-15T18:31:31.677 INFO:tasks.workunit.client.1.smithi131.stdout:1/550: dread - d0/d1/d44/d59/fb9 zero size 2024-02-15T18:31:31.678 INFO:tasks.workunit.client.1.smithi131.stdout:6/430: dwrite d2/d79/f85 [0,4194304] 0 2024-02-15T18:31:31.679 INFO:tasks.workunit.client.1.smithi131.stdout:0/332: dwrite d5/d9/d11/f14 [0,4194304] 0 2024-02-15T18:31:31.690 INFO:tasks.workunit.client.1.smithi131.stdout:3/491: symlink d2/d22/d29/db/d34/l99 0 2024-02-15T18:31:31.690 INFO:tasks.workunit.client.1.smithi131.stdout:3/492: chown d2/d22/d42 65419 1 2024-02-15T18:31:31.690 INFO:tasks.workunit.client.1.smithi131.stdout:4/557: dwrite d2/d7/d1c/d94/fa1 [0,4194304] 0 2024-02-15T18:31:31.690 INFO:tasks.workunit.client.1.smithi131.stdout:0/333: dread d5/f4c [0,4194304] 0 2024-02-15T18:31:31.696 INFO:tasks.workunit.client.1.smithi131.stdout:7/572: dwrite d0/fd [0,4194304] 0 2024-02-15T18:31:31.697 INFO:tasks.workunit.client.1.smithi131.stdout:1/551: rename d0/d2/d4/fa0 to d0/d68/d80/fc7 0 2024-02-15T18:31:31.697 INFO:tasks.workunit.client.1.smithi131.stdout:1/552: getdents d0/d2/d4/d41/dc3 0 2024-02-15T18:31:31.697 INFO:tasks.workunit.client.1.smithi131.stdout:1/553: chown d0/d2 102 1 2024-02-15T18:31:31.697 INFO:tasks.workunit.client.1.smithi131.stdout:9/482: link d4/dc/de/d1e/d1f/d2c/l7c d4/dc/l98 0 2024-02-15T18:31:31.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/431: creat d2/dc/d27/d78/f87 x:0 0 0 2024-02-15T18:31:31.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/432: fdatasync d2/d36/f5a 0 2024-02-15T18:31:31.702 INFO:tasks.workunit.client.1.smithi131.stdout:4/558: stat d2/f35 0 2024-02-15T18:31:31.703 INFO:tasks.workunit.client.1.smithi131.stdout:3/493: symlink d2/d22/d3a/d6c/d70/l9a 0 2024-02-15T18:31:31.703 INFO:tasks.workunit.client.1.smithi131.stdout:3/494: chown d2/d22/d3a/d6c/d8d 626478 1 2024-02-15T18:31:31.704 INFO:tasks.workunit.client.1.smithi131.stdout:0/334: mknod d5/d9/d11/d3e/c6d 0 2024-02-15T18:31:31.705 INFO:tasks.workunit.client.1.smithi131.stdout:7/573: mknod d0/d17/d3a/d3d/d79/d89/cb5 0 2024-02-15T18:31:31.706 INFO:tasks.workunit.client.1.smithi131.stdout:7/574: write d0/d17/f82 [1212471,79683] 0 2024-02-15T18:31:31.708 INFO:tasks.workunit.client.1.smithi131.stdout:7/575: getdents d0/d34/d8e 0 2024-02-15T18:31:31.708 INFO:tasks.workunit.client.1.smithi131.stdout:3/495: mknod d2/d22/d5e/d79/c9b 0 2024-02-15T18:31:31.712 INFO:tasks.workunit.client.1.smithi131.stdout:3/496: dread d2/d22/d29/db/f3e [0,4194304] 0 2024-02-15T18:31:31.716 INFO:tasks.workunit.client.1.smithi131.stdout:3/497: mknod d2/d22/c9c 0 2024-02-15T18:31:31.716 INFO:tasks.workunit.client.1.smithi131.stdout:4/559: dread d2/d2a/d68/f6b [0,4194304] 0 2024-02-15T18:31:31.716 INFO:tasks.workunit.client.1.smithi131.stdout:4/560: read - d2/d7/d12/d2e/d5f/d70/f73 zero size 2024-02-15T18:31:31.717 INFO:tasks.workunit.client.1.smithi131.stdout:7/576: read d0/d17/d3a/f63 [961408,88190] 0 2024-02-15T18:31:31.719 INFO:tasks.workunit.client.1.smithi131.stdout:1/554: dread d0/d1/d16/d19/f2e [0,4194304] 0 2024-02-15T18:31:31.719 INFO:tasks.workunit.client.1.smithi131.stdout:3/498: mkdir d2/d22/d5e/d79/d9d 0 2024-02-15T18:31:31.720 INFO:tasks.workunit.client.1.smithi131.stdout:4/561: truncate d2/d7/d1c/f63 3569786 0 2024-02-15T18:31:31.720 INFO:tasks.workunit.client.1.smithi131.stdout:9/483: write d4/dc/f2d [2692091,55230] 0 2024-02-15T18:31:31.720 INFO:tasks.workunit.client.1.smithi131.stdout:9/484: write d4/dc/de/d1e/d1f/d51/d5d/d71/f96 [292650,38053] 0 2024-02-15T18:31:31.721 INFO:tasks.workunit.client.1.smithi131.stdout:3/499: rmdir d2/d22/d29/db/d23/d2a/d5b 39 2024-02-15T18:31:31.723 INFO:tasks.workunit.client.1.smithi131.stdout:3/500: rmdir d2/d22/d29/db/d23/d2a/d5b 39 2024-02-15T18:31:31.723 INFO:tasks.workunit.client.1.smithi131.stdout:3/501: truncate d2/d22/d3a/d6c/f64 6834052 0 2024-02-15T18:31:31.723 INFO:tasks.workunit.client.1.smithi131.stdout:3/502: dread - d2/d22/d29/db/d23/d2a/f87 zero size 2024-02-15T18:31:31.723 INFO:tasks.workunit.client.1.smithi131.stdout:0/335: write f4 [1250245,59112] 0 2024-02-15T18:31:31.724 INFO:tasks.workunit.client.1.smithi131.stdout:6/433: dwrite d2/dc/f68 [0,4194304] 0 2024-02-15T18:31:31.724 INFO:tasks.workunit.client.1.smithi131.stdout:9/485: write d4/dc/de/d1e/d1f/f3a [1766874,92816] 0 2024-02-15T18:31:31.729 INFO:tasks.workunit.client.1.smithi131.stdout:1/555: write d0/d1/d16/d30/fae [537413,94496] 0 2024-02-15T18:31:31.729 INFO:tasks.workunit.client.1.smithi131.stdout:3/503: mkdir d2/d22/d29/d9e 0 2024-02-15T18:31:31.734 INFO:tasks.workunit.client.1.smithi131.stdout:6/434: rename d2/d7/d12/d4d/l6b to d2/dc/d27/d78/l88 0 2024-02-15T18:31:31.734 INFO:tasks.workunit.client.1.smithi131.stdout:4/562: dread d2/d2a/d47/d16/d43/f6c [0,4194304] 0 2024-02-15T18:31:31.734 INFO:tasks.workunit.client.1.smithi131.stdout:4/563: fdatasync d2/d7/d12/d2e/f64 0 2024-02-15T18:31:31.743 INFO:tasks.workunit.client.1.smithi131.stdout:7/577: write d0/d17/f3c [3636109,37804] 0 2024-02-15T18:31:31.747 INFO:tasks.workunit.client.1.smithi131.stdout:9/486: mknod d4/dc/d25/d4e/d8a/c99 0 2024-02-15T18:31:31.747 INFO:tasks.workunit.client.1.smithi131.stdout:3/504: mknod d2/d22/d3a/c9f 0 2024-02-15T18:31:31.747 INFO:tasks.workunit.client.1.smithi131.stdout:3/505: truncate d2/d22/d29/db/d23/d2a/d5b/f71 435774 0 2024-02-15T18:31:31.747 INFO:tasks.workunit.client.1.smithi131.stdout:4/564: mkdir d2/d7/d1c/d5d/dcc 0 2024-02-15T18:31:31.759 INFO:tasks.workunit.client.1.smithi131.stdout:9/487: rename d4/dc/d17/d19/d32/c46 to d4/dc/d17/d19/d32/d91/c9a 0 2024-02-15T18:31:31.760 INFO:tasks.workunit.client.1.smithi131.stdout:3/506: creat d2/d22/d3f/fa0 x:0 0 0 2024-02-15T18:31:31.760 INFO:tasks.workunit.client.1.smithi131.stdout:7/578: symlink d0/d34/d8b/d9a/lb6 0 2024-02-15T18:31:31.760 INFO:tasks.workunit.client.1.smithi131.stdout:4/565: mkdir d2/d2a/d47/d21/dcd 0 2024-02-15T18:31:31.761 INFO:tasks.workunit.client.1.smithi131.stdout:4/566: chown d2/d7/d1c/l20 727 1 2024-02-15T18:31:31.763 INFO:tasks.workunit.client.1.smithi131.stdout:1/556: dwrite d0/d2/f2b [4194304,4194304] 0 2024-02-15T18:31:31.763 INFO:tasks.workunit.client.1.smithi131.stdout:1/557: fsync d0/d2/f37 0 2024-02-15T18:31:31.772 INFO:tasks.workunit.client.1.smithi131.stdout:0/336: getdents d5/d9/d11/d3e 0 2024-02-15T18:31:31.772 INFO:tasks.workunit.client.1.smithi131.stdout:0/337: truncate d5/d2f/d4b/f69 299395 0 2024-02-15T18:31:31.772 INFO:tasks.workunit.client.1.smithi131.stdout:0/338: fdatasync d5/d9/f3d 0 2024-02-15T18:31:31.775 INFO:tasks.workunit.client.1.smithi131.stdout:6/435: dwrite d2/dc/f5f [0,4194304] 0 2024-02-15T18:31:31.775 INFO:tasks.workunit.client.1.smithi131.stdout:1/558: read d0/d1/d16/d19/fbe [674474,65068] 0 2024-02-15T18:31:31.781 INFO:tasks.workunit.client.1.smithi131.stdout:4/567: mknod d2/d2a/d47/cce 0 2024-02-15T18:31:31.783 INFO:tasks.workunit.client.1.smithi131.stdout:7/579: write d0/d17/d3a/f63 [1495081,105995] 0 2024-02-15T18:31:31.783 INFO:tasks.workunit.client.1.smithi131.stdout:0/339: mknod d5/d9/d11/c6e 0 2024-02-15T18:31:31.783 INFO:tasks.workunit.client.1.smithi131.stdout:0/340: chown d5/d15 0 1 2024-02-15T18:31:31.784 INFO:tasks.workunit.client.1.smithi131.stdout:1/559: write d0/d1/d44/f6c [226264,99107] 0 2024-02-15T18:31:31.787 INFO:tasks.workunit.client.1.smithi131.stdout:6/436: rename d2/d7/d12/c41 to d2/dc/d1f/c89 0 2024-02-15T18:31:31.788 INFO:tasks.workunit.client.1.smithi131.stdout:4/568: rmdir d2/d2a/d47/d16/d43 39 2024-02-15T18:31:31.788 INFO:tasks.workunit.client.1.smithi131.stdout:4/569: dread - d2/d2a/d47/d21/fca zero size 2024-02-15T18:31:31.788 INFO:tasks.workunit.client.1.smithi131.stdout:4/570: truncate d2/d2a/d47/d21/f91 404722 0 2024-02-15T18:31:31.789 INFO:tasks.workunit.client.1.smithi131.stdout:7/580: creat d0/d34/fb7 x:0 0 0 2024-02-15T18:31:31.790 INFO:tasks.workunit.client.1.smithi131.stdout:0/341: read d5/d2f/d4b/f69 [83454,105766] 0 2024-02-15T18:31:31.793 INFO:tasks.workunit.client.1.smithi131.stdout:6/437: write f0 [4745588,76339] 0 2024-02-15T18:31:31.793 INFO:tasks.workunit.client.1.smithi131.stdout:0/342: creat d5/d9/d10/d3f/f6f x:0 0 0 2024-02-15T18:31:31.794 INFO:tasks.workunit.client.1.smithi131.stdout:6/438: read d2/dc/d1f/f63 [231557,79843] 0 2024-02-15T18:31:31.795 INFO:tasks.workunit.client.1.smithi131.stdout:0/343: symlink d5/d2f/d4b/l70 0 2024-02-15T18:31:31.795 INFO:tasks.workunit.client.1.smithi131.stdout:0/344: chown d5/d2f/d45/f50 27673 1 2024-02-15T18:31:31.798 INFO:tasks.workunit.client.1.smithi131.stdout:6/439: creat d2/d2b/d6e/f8a x:0 0 0 2024-02-15T18:31:31.798 INFO:tasks.workunit.client.1.smithi131.stdout:0/345: mkdir d5/d9/d10/d71 0 2024-02-15T18:31:31.798 INFO:tasks.workunit.client.1.smithi131.stdout:0/346: chown d5/d2f/d45/c66 63265 1 2024-02-15T18:31:31.798 INFO:tasks.workunit.client.1.smithi131.stdout:0/347: readlink d5/d15/l6b 0 2024-02-15T18:31:31.801 INFO:tasks.workunit.client.1.smithi131.stdout:9/488: dwrite d4/dc/de/f58 [0,4194304] 0 2024-02-15T18:31:31.809 INFO:tasks.workunit.client.1.smithi131.stdout:7/581: fdatasync d0/d17/d3a/f63 0 2024-02-15T18:31:31.809 INFO:tasks.workunit.client.1.smithi131.stdout:7/582: chown d0/d17/d36/f8a 8 1 2024-02-15T18:31:31.809 INFO:tasks.workunit.client.1.smithi131.stdout:3/507: dwrite d2/f3c [0,4194304] 0 2024-02-15T18:31:31.813 INFO:tasks.workunit.client.1.smithi131.stdout:1/560: dwrite d0/d2/d4/f32 [0,4194304] 0 2024-02-15T18:31:31.816 INFO:tasks.workunit.client.1.smithi131.stdout:6/440: creat d2/d7/d12/d4d/f8b x:0 0 0 2024-02-15T18:31:31.816 INFO:tasks.workunit.client.1.smithi131.stdout:6/441: write d2/d2b/f56 [113987,35561] 0 2024-02-15T18:31:31.816 INFO:tasks.workunit.client.1.smithi131.stdout:9/489: rename d4/dc/d25/d4e/d6d to d4/d9b 0 2024-02-15T18:31:31.819 INFO:tasks.workunit.client.1.smithi131.stdout:3/508: link d2/d22/d42/f45 d2/d22/d3a/d6c/d70/fa1 0 2024-02-15T18:31:31.819 INFO:tasks.workunit.client.1.smithi131.stdout:3/509: chown d2/d22/d29/d20/c27 481 1 2024-02-15T18:31:31.819 INFO:tasks.workunit.client.1.smithi131.stdout:6/442: mkdir d2/d7/d48/d7f/d8c 0 2024-02-15T18:31:31.819 INFO:tasks.workunit.client.1.smithi131.stdout:9/490: creat d4/dc/d25/d4e/d8a/f9c x:0 0 0 2024-02-15T18:31:31.820 INFO:tasks.workunit.client.1.smithi131.stdout:9/491: stat d4/l21 0 2024-02-15T18:31:31.820 INFO:tasks.workunit.client.1.smithi131.stdout:3/510: creat d2/d22/d5e/d79/fa2 x:0 0 0 2024-02-15T18:31:31.822 INFO:tasks.workunit.client.1.smithi131.stdout:1/561: rmdir d0/d1/d44 39 2024-02-15T18:31:31.822 INFO:tasks.workunit.client.1.smithi131.stdout:1/562: write d0/d2/d4/d5d/f60 [1260211,115632] 0 2024-02-15T18:31:31.822 INFO:tasks.workunit.client.1.smithi131.stdout:1/563: truncate d0/d2/d7/f1e 4262278 0 2024-02-15T18:31:31.823 INFO:tasks.workunit.client.1.smithi131.stdout:6/443: link d2/dc/d27/d78/l82 d2/dc/d27/d62/l8d 0 2024-02-15T18:31:31.824 INFO:tasks.workunit.client.1.smithi131.stdout:0/348: dwrite d5/d9/d11/f31 [0,4194304] 0 2024-02-15T18:31:31.830 INFO:tasks.workunit.client.1.smithi131.stdout:6/444: write f0 [992430,23125] 0 2024-02-15T18:31:31.853 INFO:tasks.workunit.client.1.smithi131.stdout:3/511: creat d2/d22/d29/db/d23/d2a/d49/fa3 x:0 0 0 2024-02-15T18:31:31.854 INFO:tasks.workunit.client.1.smithi131.stdout:3/512: chown d2/f92 89 1 2024-02-15T18:31:31.854 INFO:tasks.workunit.client.1.smithi131.stdout:3/513: fdatasync d2/d22/d3a/d6c/d70/fa1 0 2024-02-15T18:31:31.854 INFO:tasks.workunit.client.1.smithi131.stdout:3/514: chown d2/f59 906464 1 2024-02-15T18:31:31.865 INFO:tasks.workunit.client.1.smithi131.stdout:7/583: dwrite d0/fd [4194304,4194304] 0 2024-02-15T18:31:31.866 INFO:tasks.workunit.client.1.smithi131.stdout:6/445: creat d2/dc/d1f/f8e x:0 0 0 2024-02-15T18:31:31.866 INFO:tasks.workunit.client.1.smithi131.stdout:6/446: chown d2/d7/d48/f1c 2407816 1 2024-02-15T18:31:31.866 INFO:tasks.workunit.client.1.smithi131.stdout:0/349: creat d5/d2f/f72 x:0 0 0 2024-02-15T18:31:31.866 INFO:tasks.workunit.client.1.smithi131.stdout:0/350: fsync d5/d9/f3d 0 2024-02-15T18:31:31.866 INFO:tasks.workunit.client.1.smithi131.stdout:1/564: link d0/d1/d16/db7/lbf d0/lc8 0 2024-02-15T18:31:31.868 INFO:tasks.workunit.client.1.smithi131.stdout:3/515: rename d2/d22/d3a/d6c to d2/d22/d29/db/d1a/da4 0 2024-02-15T18:31:31.868 INFO:tasks.workunit.client.1.smithi131.stdout:1/565: read d0/d2/f12 [3732368,112799] 0 2024-02-15T18:31:31.875 INFO:tasks.workunit.client.1.smithi131.stdout:9/492: dwrite d4/dc/d25/d3f/d81/d63/f95 [0,4194304] 0 2024-02-15T18:31:31.876 INFO:tasks.workunit.client.1.smithi131.stdout:7/584: mkdir d0/db8 0 2024-02-15T18:31:31.876 INFO:tasks.workunit.client.1.smithi131.stdout:0/351: mkdir d5/d9/d10/d73 0 2024-02-15T18:31:31.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/352: chown d5/d9/d10/f1e 435354319 1 2024-02-15T18:31:31.877 INFO:tasks.workunit.client.1.smithi131.stdout:1/566: symlink d0/d1/d44/lc9 0 2024-02-15T18:31:31.879 INFO:tasks.workunit.client.1.smithi131.stdout:1/567: read d0/d1/d16/d19/f1b [3498440,1741] 0 2024-02-15T18:31:31.880 INFO:tasks.workunit.client.1.smithi131.stdout:7/585: rmdir d0/da9 39 2024-02-15T18:31:31.881 INFO:tasks.workunit.client.1.smithi131.stdout:0/353: mknod d5/d9/d10/d73/c74 0 2024-02-15T18:31:31.884 INFO:tasks.workunit.client.1.smithi131.stdout:1/568: write d0/d2/d4/da/f2a [1221320,34228] 0 2024-02-15T18:31:31.884 INFO:tasks.workunit.client.1.smithi131.stdout:9/493: dread d4/dc/de/f58 [0,4194304] 0 2024-02-15T18:31:31.889 INFO:tasks.workunit.client.1.smithi131.stdout:6/447: dwrite d2/dc/d27/d78/f87 [0,4194304] 0 2024-02-15T18:31:31.889 INFO:tasks.workunit.client.1.smithi131.stdout:7/586: write d0/d17/d3a/f54 [687519,1015] 0 2024-02-15T18:31:31.889 INFO:tasks.workunit.client.1.smithi131.stdout:7/587: readlink d0/l4f 0 2024-02-15T18:31:31.895 INFO:tasks.workunit.client.1.smithi131.stdout:1/569: creat d0/d1/d16/db7/fca x:0 0 0 2024-02-15T18:31:31.895 INFO:tasks.workunit.client.1.smithi131.stdout:1/570: fdatasync d0/d1/d44/fb4 0 2024-02-15T18:31:31.898 INFO:tasks.workunit.client.1.smithi131.stdout:6/448: mkdir d2/dc/d27/d62/d8f 0 2024-02-15T18:31:31.903 INFO:tasks.workunit.client.1.smithi131.stdout:5/463: sync 2024-02-15T18:31:31.903 INFO:tasks.workunit.client.1.smithi131.stdout:5/464: fsync d18/d24/d63/f75 0 2024-02-15T18:31:31.904 INFO:tasks.workunit.client.1.smithi131.stdout:7/588: rename d0/d34/f7e to d0/d34/d8b/d9a/fb9 0 2024-02-15T18:31:31.905 INFO:tasks.workunit.client.1.smithi131.stdout:6/449: truncate d2/dc/d1f/f63 540624 0 2024-02-15T18:31:31.908 INFO:tasks.workunit.client.1.smithi131.stdout:7/589: mkdir d0/dba 0 2024-02-15T18:31:31.908 INFO:tasks.workunit.client.1.smithi131.stdout:7/590: getdents d0/dba 0 2024-02-15T18:31:31.915 INFO:tasks.workunit.client.1.smithi131.stdout:1/571: dread d0/d2/f12 [0,4194304] 0 2024-02-15T18:31:31.917 INFO:tasks.workunit.client.1.smithi131.stdout:9/494: dwrite f3 [0,4194304] 0 2024-02-15T18:31:31.917 INFO:tasks.workunit.client.1.smithi131.stdout:9/495: stat d4/dc/d17/f69 0 2024-02-15T18:31:31.918 INFO:tasks.workunit.client.1.smithi131.stdout:0/354: dwrite d5/d9/d10/f19 [4194304,4194304] 0 2024-02-15T18:31:31.921 INFO:tasks.workunit.client.1.smithi131.stdout:9/496: mkdir d4/dc/de/d1e/d1f/d51/d5d/d9d 0 2024-02-15T18:31:31.921 INFO:tasks.workunit.client.1.smithi131.stdout:1/572: creat d0/d1/d16/fcb x:0 0 0 2024-02-15T18:31:31.939 INFO:tasks.workunit.client.1.smithi131.stdout:7/591: dwrite d0/d17/d3a/d3d/fa6 [0,4194304] 0 2024-02-15T18:31:31.939 INFO:tasks.workunit.client.1.smithi131.stdout:7/592: getdents d0/dba 0 2024-02-15T18:31:31.942 INFO:tasks.workunit.client.1.smithi131.stdout:7/593: creat d0/d17/fbb x:0 0 0 2024-02-15T18:31:31.947 INFO:tasks.workunit.client.1.smithi131.stdout:7/594: creat d0/d34/fbc x:0 0 0 2024-02-15T18:31:31.948 INFO:tasks.workunit.client.1.smithi131.stdout:7/595: mknod d0/d17/d3a/d3d/cbd 0 2024-02-15T18:31:31.948 INFO:tasks.workunit.client.1.smithi131.stdout:7/596: mkdir d0/db8/dbe 0 2024-02-15T18:31:31.949 INFO:tasks.workunit.client.1.smithi131.stdout:7/597: rmdir d0/d17/d3a/d3d 39 2024-02-15T18:31:31.949 INFO:tasks.workunit.client.1.smithi131.stdout:7/598: chown d0/d17/d36/c55 0 1 2024-02-15T18:31:31.950 INFO:tasks.workunit.client.1.smithi131.stdout:7/599: mknod d0/d17/d3a/d3d/d79/d89/cbf 0 2024-02-15T18:31:31.950 INFO:tasks.workunit.client.1.smithi131.stdout:7/600: chown d0/c31 43686 1 2024-02-15T18:31:31.950 INFO:tasks.workunit.client.1.smithi131.stdout:7/601: fdatasync d0/d17/d3a/d3d/f53 0 2024-02-15T18:31:31.952 INFO:tasks.workunit.client.1.smithi131.stdout:7/602: truncate d0/fd 687458 0 2024-02-15T18:31:31.957 INFO:tasks.workunit.client.1.smithi131.stdout:6/450: dwrite d2/d36/f3c [0,4194304] 0 2024-02-15T18:31:31.957 INFO:tasks.workunit.client.1.smithi131.stdout:6/451: write d2/d7/f73 [2863,13875] 0 2024-02-15T18:31:31.960 INFO:tasks.workunit.client.1.smithi131.stdout:6/452: mkdir d2/d7/d90 0 2024-02-15T18:31:31.962 INFO:tasks.workunit.client.1.smithi131.stdout:6/453: symlink d2/d79/l91 0 2024-02-15T18:31:31.962 INFO:tasks.workunit.client.1.smithi131.stdout:0/355: dwrite d5/d9/d10/d3f/f47 [0,4194304] 0 2024-02-15T18:31:31.962 INFO:tasks.workunit.client.1.smithi131.stdout:6/454: chown d2/d7/d48/f5c 136080537 1 2024-02-15T18:31:31.963 INFO:tasks.workunit.client.1.smithi131.stdout:9/497: dwrite d4/dc/d25/d4e/d38/f44 [0,4194304] 0 2024-02-15T18:31:31.963 INFO:tasks.workunit.client.1.smithi131.stdout:6/455: stat d2/d7/d12/c60 0 2024-02-15T18:31:31.964 INFO:tasks.workunit.client.1.smithi131.stdout:0/356: rename d5/d2f/f23 to d5/d15/d1f/f75 0 2024-02-15T18:31:31.964 INFO:tasks.workunit.client.1.smithi131.stdout:0/357: stat d5/fd 0 2024-02-15T18:31:31.966 INFO:tasks.workunit.client.1.smithi131.stdout:9/498: creat d4/dc/de/d1e/f9e x:0 0 0 2024-02-15T18:31:31.970 INFO:tasks.workunit.client.1.smithi131.stdout:6/456: creat d2/d7/d12/d80/f92 x:0 0 0 2024-02-15T18:31:31.970 INFO:tasks.workunit.client.1.smithi131.stdout:6/457: chown d2/d7/d16/c4a 24501910 1 2024-02-15T18:31:31.970 INFO:tasks.workunit.client.1.smithi131.stdout:6/458: chown d2/d7/c66 6 1 2024-02-15T18:31:31.970 INFO:tasks.workunit.client.1.smithi131.stdout:0/358: creat d5/d2f/f76 x:0 0 0 2024-02-15T18:31:31.978 INFO:tasks.workunit.client.1.smithi131.stdout:7/603: dwrite d0/d34/f8d [0,4194304] 0 2024-02-15T18:31:31.982 INFO:tasks.workunit.client.1.smithi131.stdout:1/573: dwrite d0/d2/d7/fab [0,4194304] 0 2024-02-15T18:31:31.982 INFO:tasks.workunit.client.1.smithi131.stdout:1/574: readlink d0/d1/d44/l76 0 2024-02-15T18:31:31.985 INFO:tasks.workunit.client.1.smithi131.stdout:0/359: dread d5/f68 [0,4194304] 0 2024-02-15T18:31:31.985 INFO:tasks.workunit.client.1.smithi131.stdout:0/360: write d5/d2f/f72 [466978,29231] 0 2024-02-15T18:31:31.989 INFO:tasks.workunit.client.1.smithi131.stdout:9/499: dwrite d4/d9b/f88 [0,4194304] 0 2024-02-15T18:31:31.989 INFO:tasks.workunit.client.1.smithi131.stdout:9/500: write d4/d9b/f7a [5053850,115449] 0 2024-02-15T18:31:31.993 INFO:tasks.workunit.client.1.smithi131.stdout:6/459: getdents d2/d7/d12/d80 0 2024-02-15T18:31:31.995 INFO:tasks.workunit.client.1.smithi131.stdout:6/460: write d2/d7/fa [3582644,89136] 0 2024-02-15T18:31:31.995 INFO:tasks.workunit.client.1.smithi131.stdout:6/461: fdatasync d2/d7/f73 0 2024-02-15T18:31:31.996 INFO:tasks.workunit.client.1.smithi131.stdout:1/575: getdents d0/d2/d7/d72/d78 0 2024-02-15T18:31:31.998 INFO:tasks.workunit.client.1.smithi131.stdout:0/361: getdents d5/d9/d4d 0 2024-02-15T18:31:31.999 INFO:tasks.workunit.client.1.smithi131.stdout:9/501: symlink d4/dc/d25/d3f/l9f 0 2024-02-15T18:31:32.001 INFO:tasks.workunit.client.1.smithi131.stdout:9/502: write d4/dc/de/d1e/d1f/d2c/f79 [2650162,100186] 0 2024-02-15T18:31:32.003 INFO:tasks.workunit.client.1.smithi131.stdout:6/462: rmdir d2/d7/d48/d7f/d8c 0 2024-02-15T18:31:32.003 INFO:tasks.workunit.client.1.smithi131.stdout:6/463: fdatasync d2/d7/d48/f53 0 2024-02-15T18:31:32.004 INFO:tasks.workunit.client.1.smithi131.stdout:1/576: creat d0/d1/d16/d6b/fcc x:0 0 0 2024-02-15T18:31:32.004 INFO:tasks.workunit.client.1.smithi131.stdout:1/577: chown d0/d2/d7/d72/faf 102524196 1 2024-02-15T18:31:32.004 INFO:tasks.workunit.client.1.smithi131.stdout:1/578: chown d0/d2/d4/faa 412572 1 2024-02-15T18:31:32.005 INFO:tasks.workunit.client.1.smithi131.stdout:9/503: truncate d4/dc/d25/d3f/d81/d5b/f6f 2784453 0 2024-02-15T18:31:32.009 INFO:tasks.workunit.client.1.smithi131.stdout:1/579: rename d0/d1/d44/lc9 to d0/d2/d7/d72/d78/lcd 0 2024-02-15T18:31:32.010 INFO:tasks.workunit.client.1.smithi131.stdout:0/362: mkdir d5/d9/d77 0 2024-02-15T18:31:32.011 INFO:tasks.workunit.client.1.smithi131.stdout:9/504: mknod d4/dc/d17/d19/d32/ca0 0 2024-02-15T18:31:32.011 INFO:tasks.workunit.client.1.smithi131.stdout:9/505: truncate d4/dc/de/d1e/d1f/d51/d7f/f8c 93650 0 2024-02-15T18:31:32.011 INFO:tasks.workunit.client.1.smithi131.stdout:9/506: chown d4/dc/d25/d3f/c49 0 1 2024-02-15T18:31:32.011 INFO:tasks.workunit.client.1.smithi131.stdout:6/464: dread d2/d36/f4c [0,4194304] 0 2024-02-15T18:31:32.012 INFO:tasks.workunit.client.1.smithi131.stdout:1/580: symlink d0/d68/lce 0 2024-02-15T18:31:32.013 INFO:tasks.workunit.client.1.smithi131.stdout:9/507: truncate d4/dc/de/d1e/d1f/d2c/f4b 2337361 0 2024-02-15T18:31:32.014 INFO:tasks.workunit.client.1.smithi131.stdout:6/465: creat d2/dc/d1f/f93 x:0 0 0 2024-02-15T18:31:32.014 INFO:tasks.workunit.client.1.smithi131.stdout:1/581: rmdir d0/d2/d7/d72/d78 39 2024-02-15T18:31:32.015 INFO:tasks.workunit.client.1.smithi131.stdout:9/508: creat d4/d78/fa1 x:0 0 0 2024-02-15T18:31:32.016 INFO:tasks.workunit.client.1.smithi131.stdout:0/363: dread d5/d9/d10/f1e [0,4194304] 0 2024-02-15T18:31:32.017 INFO:tasks.workunit.client.1.smithi131.stdout:6/466: link d2/dc/d1f/f8e d2/d7/f94 0 2024-02-15T18:31:32.017 INFO:tasks.workunit.client.1.smithi131.stdout:6/467: dread - d2/d7/d12/d80/f92 zero size 2024-02-15T18:31:32.017 INFO:tasks.workunit.client.1.smithi131.stdout:6/468: write d2/dc/d1f/f8e [137957,35141] 0 2024-02-15T18:31:32.019 INFO:tasks.workunit.client.1.smithi131.stdout:1/582: rename d0/d2/d4/d41/d5a/d5f to d0/d1/d44/d59/d42/dcf 0 2024-02-15T18:31:32.027 INFO:tasks.workunit.client.1.smithi131.stdout:0/364: dread d5/d9/d11/f30 [0,4194304] 0 2024-02-15T18:31:32.027 INFO:tasks.workunit.client.1.smithi131.stdout:0/365: read - d5/d2f/f76 zero size 2024-02-15T18:31:32.029 INFO:tasks.workunit.client.1.smithi131.stdout:1/583: mknod d0/d2/d4/d41/d5a/cd0 0 2024-02-15T18:31:32.029 INFO:tasks.workunit.client.1.smithi131.stdout:1/584: chown d0/d2/d7/d72 404126 1 2024-02-15T18:31:32.033 INFO:tasks.workunit.client.1.smithi131.stdout:1/585: rename d0/d1/d16/d4b to d0/d1/d16/dd1 0 2024-02-15T18:31:32.033 INFO:tasks.workunit.client.1.smithi131.stdout:1/586: chown d0/lba 14440231 1 2024-02-15T18:31:32.035 INFO:tasks.workunit.client.1.smithi131.stdout:1/587: mknod d0/d2/d31/d3d/d46/cd2 0 2024-02-15T18:31:32.037 INFO:tasks.workunit.client.1.smithi131.stdout:1/588: mkdir d0/d2/d31/d3d/dd3 0 2024-02-15T18:31:32.037 INFO:tasks.workunit.client.1.smithi131.stdout:1/589: fdatasync d0/d2/d31/d3d/f6a 0 2024-02-15T18:31:32.037 INFO:tasks.workunit.client.1.smithi131.stdout:1/590: truncate d0/d1/d24/f2f 8412450 0 2024-02-15T18:31:32.040 INFO:tasks.workunit.client.1.smithi131.stdout:1/591: mknod d0/d1/d24/cd4 0 2024-02-15T18:31:32.040 INFO:tasks.workunit.client.1.smithi131.stdout:1/592: write d0/d2/d7/f53 [661125,15135] 0 2024-02-15T18:31:32.040 INFO:tasks.workunit.client.1.smithi131.stdout:1/593: stat d0/d2/d4/c94 0 2024-02-15T18:31:32.042 INFO:tasks.workunit.client.1.smithi131.stdout:9/509: rmdir d4/dc/d25 39 2024-02-15T18:31:32.046 INFO:tasks.workunit.client.1.smithi131.stdout:0/366: dwrite d5/d15/d1f/f46 [0,4194304] 0 2024-02-15T18:31:32.056 INFO:tasks.workunit.client.1.smithi131.stdout:9/510: write d4/dc/de/d1e/d1f/d2c/f4b [1133527,46985] 0 2024-02-15T18:31:32.064 INFO:tasks.workunit.client.1.smithi131.stdout:1/594: dwrite d0/d2/d7/fb6 [0,4194304] 0 2024-02-15T18:31:32.067 INFO:tasks.workunit.client.1.smithi131.stdout:1/595: dread d0/d1/d44/d59/d42/f5c [0,4194304] 0 2024-02-15T18:31:32.069 INFO:tasks.workunit.client.1.smithi131.stdout:1/596: mkdir d0/d1/d16/d9d/dd5 0 2024-02-15T18:31:32.071 INFO:tasks.workunit.client.1.smithi131.stdout:1/597: rename d0/d1/d16/d19 to d0/d2/dd6 0 2024-02-15T18:31:32.073 INFO:tasks.workunit.client.1.smithi131.stdout:9/511: dwrite d4/dc/d17/d19/d32/f48 [0,4194304] 0 2024-02-15T18:31:32.073 INFO:tasks.workunit.client.1.smithi131.stdout:9/512: mknod d4/dc/de/d1e/d1f/d51/d5d/d71/ca2 0 2024-02-15T18:31:32.074 INFO:tasks.workunit.client.1.smithi131.stdout:9/513: creat d4/d9b/fa3 x:0 0 0 2024-02-15T18:31:32.075 INFO:tasks.workunit.client.1.smithi131.stdout:1/598: write d0/d2/d4/da/f1f [7269572,47716] 0 2024-02-15T18:31:32.076 INFO:tasks.workunit.client.1.smithi131.stdout:1/599: creat d0/d1/d24/fd7 x:0 0 0 2024-02-15T18:31:32.077 INFO:tasks.workunit.client.1.smithi131.stdout:1/600: unlink d0/d2/d7/f53 0 2024-02-15T18:31:32.078 INFO:tasks.workunit.client.1.smithi131.stdout:1/601: rmdir d0/d1/d16/d9d/dd5 0 2024-02-15T18:31:32.092 INFO:tasks.workunit.client.1.smithi131.stdout:9/514: dwrite d4/dc/d25/d4e/d8a/f8d [0,4194304] 0 2024-02-15T18:31:32.099 INFO:tasks.workunit.client.1.smithi131.stdout:9/515: dread d4/dc/d17/d19/d32/f48 [0,4194304] 0 2024-02-15T18:31:32.109 INFO:tasks.workunit.client.1.smithi131.stdout:9/516: dread d4/dc/d25/d3f/f5c [0,4194304] 0 2024-02-15T18:31:32.182 INFO:tasks.workunit.client.1.smithi131.stdout:9/517: mknod d4/dc/ca4 0 2024-02-15T18:31:32.200 INFO:tasks.workunit.client.1.smithi131.stdout:9/518: dwrite d4/dc/de/d1e/f9e [0,4194304] 0 2024-02-15T18:31:32.202 INFO:tasks.workunit.client.1.smithi131.stdout:9/519: creat d4/fa5 x:0 0 0 2024-02-15T18:31:32.205 INFO:tasks.workunit.client.1.smithi131.stdout:9/520: read f1 [2418057,87135] 0 2024-02-15T18:31:32.207 INFO:tasks.workunit.client.1.smithi131.stdout:9/521: symlink d4/dc/de/d1e/d1f/d51/la6 0 2024-02-15T18:31:32.208 INFO:tasks.workunit.client.1.smithi131.stdout:9/522: rmdir d4/dc/de/d1e/d1f/d51/d5d 39 2024-02-15T18:31:32.209 INFO:tasks.workunit.client.1.smithi131.stdout:9/523: mknod d4/dc/d25/d3f/d81/d63/ca7 0 2024-02-15T18:31:32.210 INFO:tasks.workunit.client.1.smithi131.stdout:9/524: creat d4/dc/d25/d3f/d81/d72/fa8 x:0 0 0 2024-02-15T18:31:32.220 INFO:tasks.workunit.client.1.smithi131.stdout:9/525: dread f1 [0,4194304] 0 2024-02-15T18:31:32.220 INFO:tasks.workunit.client.1.smithi131.stdout:2/306: sync 2024-02-15T18:31:32.220 INFO:tasks.workunit.client.1.smithi131.stdout:2/307: write f4 [9004726,69085] 0 2024-02-15T18:31:32.222 INFO:tasks.workunit.client.1.smithi131.stdout:2/308: mkdir dd/d14/d1f/d65 0 2024-02-15T18:31:32.223 INFO:tasks.workunit.client.1.smithi131.stdout:2/309: write fb [6956214,82261] 0 2024-02-15T18:31:32.223 INFO:tasks.workunit.client.1.smithi131.stdout:2/310: chown fa 1089338 1 2024-02-15T18:31:32.224 INFO:tasks.workunit.client.1.smithi131.stdout:9/526: dread d4/dc/f2d [0,4194304] 0 2024-02-15T18:31:32.224 INFO:tasks.workunit.client.1.smithi131.stdout:9/527: fdatasync f3 0 2024-02-15T18:31:32.225 INFO:tasks.workunit.client.1.smithi131.stdout:2/311: mkdir dd/d10/d13/d2e/d66 0 2024-02-15T18:31:32.225 INFO:tasks.workunit.client.1.smithi131.stdout:2/312: dread - dd/d14/f5c zero size 2024-02-15T18:31:32.227 INFO:tasks.workunit.client.1.smithi131.stdout:9/528: mknod d4/d9b/ca9 0 2024-02-15T18:31:32.234 INFO:tasks.workunit.client.1.smithi131.stdout:9/529: dread d4/dc/d17/f69 [0,4194304] 0 2024-02-15T18:31:32.238 INFO:tasks.workunit.client.1.smithi131.stdout:2/313: dread fb [0,4194304] 0 2024-02-15T18:31:32.239 INFO:tasks.workunit.client.1.smithi131.stdout:9/530: dread d4/dc/d25/d3f/d81/d5b/f6f [0,4194304] 0 2024-02-15T18:31:32.240 INFO:tasks.workunit.client.1.smithi131.stdout:2/314: getdents dd 0 2024-02-15T18:31:32.241 INFO:tasks.workunit.client.1.smithi131.stdout:9/531: mkdir d4/dc/d25/d3f/d81/d5b/daa 0 2024-02-15T18:31:32.242 INFO:tasks.workunit.client.1.smithi131.stdout:9/532: write d4/dc/de/d1e/f37 [2962413,129881] 0 2024-02-15T18:31:32.245 INFO:tasks.workunit.client.1.smithi131.stdout:9/533: dread d4/dc/de/d1e/f61 [0,4194304] 0 2024-02-15T18:31:32.245 INFO:tasks.workunit.client.1.smithi131.stdout:9/534: fsync d4/dc/d25/d3f/f5c 0 2024-02-15T18:31:32.246 INFO:tasks.workunit.client.1.smithi131.stdout:9/535: symlink d4/dc/lab 0 2024-02-15T18:31:32.246 INFO:tasks.workunit.client.1.smithi131.stdout:9/536: write d4/dc/d25/d3f/d81/f75 [1282437,45570] 0 2024-02-15T18:31:32.248 INFO:tasks.workunit.client.1.smithi131.stdout:9/537: mknod d4/dc/de/d1e/d1f/d51/d5d/d9d/cac 0 2024-02-15T18:31:32.249 INFO:tasks.workunit.client.1.smithi131.stdout:2/315: truncate dd/f29 2320646 0 2024-02-15T18:31:32.250 INFO:tasks.workunit.client.1.smithi131.stdout:9/538: creat d4/dc/d17/d19/d32/fad x:0 0 0 2024-02-15T18:31:32.252 INFO:tasks.workunit.client.1.smithi131.stdout:9/539: getdents d4/dc/de/d1e 0 2024-02-15T18:31:32.260 INFO:tasks.workunit.client.1.smithi131.stdout:9/540: dread d4/d9b/f7a [0,4194304] 0 2024-02-15T18:31:32.262 INFO:tasks.workunit.client.1.smithi131.stdout:9/541: getdents d4/dc/de/d1e/d1f/d2c 0 2024-02-15T18:31:32.263 INFO:tasks.workunit.client.1.smithi131.stdout:9/542: truncate d4/dc/d17/d19/d32/f48 79528 0 2024-02-15T18:31:32.274 INFO:tasks.workunit.client.1.smithi131.stdout:9/543: dread d4/dc/de/f58 [0,4194304] 0 2024-02-15T18:31:32.275 INFO:tasks.workunit.client.1.smithi131.stdout:9/544: stat d4/dc/d25/d3f/d81/d5b/f6b 0 2024-02-15T18:31:32.275 INFO:tasks.workunit.client.1.smithi131.stdout:2/316: dwrite dd/d10/d22/d2a/f30 [0,4194304] 0 2024-02-15T18:31:32.304 INFO:tasks.workunit.client.1.smithi131.stdout:2/317: dwrite dd/d10/f19 [0,4194304] 0 2024-02-15T18:31:32.305 INFO:tasks.workunit.client.1.smithi131.stdout:2/318: write dd/d10/f19 [2933183,82091] 0 2024-02-15T18:31:32.306 INFO:tasks.workunit.client.1.smithi131.stdout:2/319: creat dd/d10/d13/d2e/f67 x:0 0 0 2024-02-15T18:31:32.307 INFO:tasks.workunit.client.1.smithi131.stdout:2/320: mknod dd/d14/c68 0 2024-02-15T18:31:32.307 INFO:tasks.workunit.client.1.smithi131.stdout:9/545: dwrite d4/dc/d25/f55 [0,4194304] 0 2024-02-15T18:31:32.307 INFO:tasks.workunit.client.1.smithi131.stdout:2/321: truncate dd/d1e/f39 2463026 0 2024-02-15T18:31:32.308 INFO:tasks.workunit.client.1.smithi131.stdout:2/322: chown dd/d10/d22/d2f/d38/f45 1 1 2024-02-15T18:31:32.308 INFO:tasks.workunit.client.1.smithi131.stdout:2/323: dread - dd/d14/f5c zero size 2024-02-15T18:31:32.309 INFO:tasks.workunit.client.1.smithi131.stdout:9/546: write f0 [1944664,118123] 0 2024-02-15T18:31:32.311 INFO:tasks.workunit.client.1.smithi131.stdout:9/547: creat d4/dc/de/d1e/d1f/d51/d7f/fae x:0 0 0 2024-02-15T18:31:32.311 INFO:tasks.workunit.client.1.smithi131.stdout:2/324: mkdir dd/d69 0 2024-02-15T18:31:32.311 INFO:tasks.workunit.client.1.smithi131.stdout:2/325: fdatasync dd/d14/f64 0 2024-02-15T18:31:32.312 INFO:tasks.workunit.client.1.smithi131.stdout:2/326: dread - dd/d14/f5c zero size 2024-02-15T18:31:32.312 INFO:tasks.workunit.client.1.smithi131.stdout:2/327: getdents dd/d10/d22/d2f 0 2024-02-15T18:31:32.312 INFO:tasks.workunit.client.1.smithi131.stdout:2/328: dread - dd/d1e/f5f zero size 2024-02-15T18:31:32.314 INFO:tasks.workunit.client.1.smithi131.stdout:9/548: rename d4/dc/de/d1e/d1f/c59 to d4/caf 0 2024-02-15T18:31:32.320 INFO:tasks.workunit.client.1.smithi131.stdout:2/329: rename dd/d14/d46 to dd/d10/d13/d2e/d6a 0 2024-02-15T18:31:32.322 INFO:tasks.workunit.client.1.smithi131.stdout:3/516: sync 2024-02-15T18:31:32.322 INFO:tasks.workunit.client.1.smithi131.stdout:8/363: sync 2024-02-15T18:31:32.322 INFO:tasks.workunit.client.1.smithi131.stdout:3/517: readlink d2/d22/d29/db/d23/d2a/l83 0 2024-02-15T18:31:32.322 INFO:tasks.workunit.client.1.smithi131.stdout:4/571: sync 2024-02-15T18:31:32.325 INFO:tasks.workunit.client.1.smithi131.stdout:2/330: truncate fc 198058 0 2024-02-15T18:31:32.326 INFO:tasks.workunit.client.1.smithi131.stdout:3/518: unlink d2/d22/d3f/l60 0 2024-02-15T18:31:32.326 INFO:tasks.workunit.client.1.smithi131.stdout:9/549: dread d4/d9b/f88 [0,4194304] 0 2024-02-15T18:31:32.326 INFO:tasks.workunit.client.1.smithi131.stdout:9/550: truncate d4/dc/d25/d3f/d81/d5b/f92 552471 0 2024-02-15T18:31:32.326 INFO:tasks.workunit.client.1.smithi131.stdout:8/364: mkdir d22/d26/d3f/d47/d48/d5f/d6f/d7a 0 2024-02-15T18:31:32.328 INFO:tasks.workunit.client.1.smithi131.stdout:4/572: truncate d2/d2a/d47/d16/f37 3163881 0 2024-02-15T18:31:32.329 INFO:tasks.workunit.client.1.smithi131.stdout:2/331: creat dd/d10/d13/d2e/d6a/f6b x:0 0 0 2024-02-15T18:31:32.329 INFO:tasks.workunit.client.1.smithi131.stdout:9/551: mkdir d4/dc/d17/db0 0 2024-02-15T18:31:32.330 INFO:tasks.workunit.client.1.smithi131.stdout:9/552: truncate d4/dc/d25/d3f/d81/d5b/f87 79082 0 2024-02-15T18:31:32.330 INFO:tasks.workunit.client.1.smithi131.stdout:9/553: rename d4/dc to d4/dc/d17/db0/db1 22 2024-02-15T18:31:32.335 INFO:tasks.workunit.client.1.smithi131.stdout:8/365: getdents d22/d2e 0 2024-02-15T18:31:32.335 INFO:tasks.workunit.client.1.smithi131.stdout:3/519: dread d2/f3c [0,4194304] 0 2024-02-15T18:31:32.336 INFO:tasks.workunit.client.1.smithi131.stdout:2/332: creat dd/d10/d22/f6c x:0 0 0 2024-02-15T18:31:32.336 INFO:tasks.workunit.client.1.smithi131.stdout:2/333: chown dd/d69 362936616 1 2024-02-15T18:31:32.338 INFO:tasks.workunit.client.1.smithi131.stdout:9/554: symlink d4/dc/d25/d4e/d38/lb2 0 2024-02-15T18:31:32.340 INFO:tasks.workunit.client.1.smithi131.stdout:8/366: truncate d22/d26/f55 1351023 0 2024-02-15T18:31:32.342 INFO:tasks.workunit.client.1.smithi131.stdout:3/520: creat d2/d22/d29/d9e/fa5 x:0 0 0 2024-02-15T18:31:32.342 INFO:tasks.workunit.client.1.smithi131.stdout:2/334: symlink dd/d10/d13/d2e/l6d 0 2024-02-15T18:31:32.342 INFO:tasks.workunit.client.1.smithi131.stdout:9/555: mkdir d4/dc/d17/d19/d32/d91/db3 0 2024-02-15T18:31:32.343 INFO:tasks.workunit.client.1.smithi131.stdout:8/367: getdents d22/d26/d3f/d47/d48/d5f/d70 0 2024-02-15T18:31:32.344 INFO:tasks.workunit.client.1.smithi131.stdout:8/368: getdents d22/d26/d3f/d47/d48/d5f/d6f/d7a 0 2024-02-15T18:31:32.345 INFO:tasks.workunit.client.1.smithi131.stdout:3/521: mknod d2/d22/d5e/d79/ca6 0 2024-02-15T18:31:32.346 INFO:tasks.workunit.client.1.smithi131.stdout:3/522: fsync d2/d22/d29/f17 0 2024-02-15T18:31:32.347 INFO:tasks.workunit.client.1.smithi131.stdout:9/556: mkdir d4/dc/de/db4 0 2024-02-15T18:31:32.347 INFO:tasks.workunit.client.1.smithi131.stdout:9/557: chown d4/d9b/fa3 430015 1 2024-02-15T18:31:32.348 INFO:tasks.workunit.client.1.smithi131.stdout:3/523: mknod d2/ca7 0 2024-02-15T18:31:32.348 INFO:tasks.workunit.client.1.smithi131.stdout:3/524: read d2/d22/d29/f7e [115760,23510] 0 2024-02-15T18:31:32.348 INFO:tasks.workunit.client.1.smithi131.stdout:3/525: dread - d2/d22/d29/db/d23/d2a/f87 zero size 2024-02-15T18:31:32.349 INFO:tasks.workunit.client.1.smithi131.stdout:9/558: symlink d4/dc/de/d1e/d1f/d51/lb5 0 2024-02-15T18:31:32.349 INFO:tasks.workunit.client.1.smithi131.stdout:9/559: chown d4/dc/de/d1e/d1f/d51/d5d/d9d 4 1 2024-02-15T18:31:32.350 INFO:tasks.workunit.client.1.smithi131.stdout:4/573: dwrite d2/d7/d1c/f48 [0,4194304] 0 2024-02-15T18:31:32.355 INFO:tasks.workunit.client.1.smithi131.stdout:3/526: creat d2/d22/d42/fa8 x:0 0 0 2024-02-15T18:31:32.357 INFO:tasks.workunit.client.1.smithi131.stdout:9/560: symlink d4/dc/d17/d19/d32/d91/db3/lb6 0 2024-02-15T18:31:32.362 INFO:tasks.workunit.client.1.smithi131.stdout:4/574: mknod d2/d7/d1c/d5d/ccf 0 2024-02-15T18:31:32.362 INFO:tasks.workunit.client.1.smithi131.stdout:4/575: dread - d2/d7/f5c zero size 2024-02-15T18:31:32.364 INFO:tasks.workunit.client.1.smithi131.stdout:9/561: creat d4/dc/d25/d3f/d81/d63/fb7 x:0 0 0 2024-02-15T18:31:32.364 INFO:tasks.workunit.client.1.smithi131.stdout:9/562: stat d4/dc/d25/d3f/d81/d5b/daa 0 2024-02-15T18:31:32.366 INFO:tasks.workunit.client.1.smithi131.stdout:9/563: creat d4/dc/d25/d3f/d81/d72/fb8 x:0 0 0 2024-02-15T18:31:32.368 INFO:tasks.workunit.client.1.smithi131.stdout:2/335: dwrite dd/d1e/f5f [0,4194304] 0 2024-02-15T18:31:32.378 INFO:tasks.workunit.client.1.smithi131.stdout:2/336: mknod dd/d10/d13/d2e/d4a/c6e 0 2024-02-15T18:31:32.380 INFO:tasks.workunit.client.1.smithi131.stdout:2/337: unlink dd/d10/d22/d2f/d38/f4d 0 2024-02-15T18:31:32.380 INFO:tasks.workunit.client.1.smithi131.stdout:3/527: dwrite d2/d22/d29/db/d23/f96 [0,4194304] 0 2024-02-15T18:31:32.381 INFO:tasks.workunit.client.1.smithi131.stdout:2/338: rename dd/d1e/f39 to dd/f6f 0 2024-02-15T18:31:32.381 INFO:tasks.workunit.client.1.smithi131.stdout:2/339: chown dd 3651454 1 2024-02-15T18:31:32.382 INFO:tasks.workunit.client.1.smithi131.stdout:2/340: fdatasync dd/d10/d22/d2a/f49 0 2024-02-15T18:31:32.383 INFO:tasks.workunit.client.1.smithi131.stdout:3/528: getdents d2 0 2024-02-15T18:31:32.384 INFO:tasks.workunit.client.1.smithi131.stdout:2/341: creat dd/d10/d22/d2f/d38/f70 x:0 0 0 2024-02-15T18:31:32.384 INFO:tasks.workunit.client.1.smithi131.stdout:2/342: dread - dd/d10/d22/d2f/d38/f70 zero size 2024-02-15T18:31:32.387 INFO:tasks.workunit.client.1.smithi131.stdout:2/343: creat dd/d14/d1f/d65/f71 x:0 0 0 2024-02-15T18:31:32.387 INFO:tasks.workunit.client.1.smithi131.stdout:3/529: dread d2/d22/d29/f7e [0,4194304] 0 2024-02-15T18:31:32.389 INFO:tasks.workunit.client.1.smithi131.stdout:9/564: dwrite d4/dc/d25/d4e/d38/f44 [0,4194304] 0 2024-02-15T18:31:32.389 INFO:tasks.workunit.client.1.smithi131.stdout:4/576: dwrite d2/d7/fc [4194304,4194304] 0 2024-02-15T18:31:32.390 INFO:tasks.workunit.client.1.smithi131.stdout:4/577: dread d2/d7/f10 [0,4194304] 0 2024-02-15T18:31:32.391 INFO:tasks.workunit.client.1.smithi131.stdout:4/578: read - d2/d7/d12/d2e/d5f/d70/f73 zero size 2024-02-15T18:31:32.393 INFO:tasks.workunit.client.1.smithi131.stdout:4/579: mkdir d2/d7/d12/d2e/dd0 0 2024-02-15T18:31:32.397 INFO:tasks.workunit.client.1.smithi131.stdout:4/580: unlink d2/d2a/fb2 0 2024-02-15T18:31:32.397 INFO:tasks.workunit.client.1.smithi131.stdout:4/581: readlink d2/d7/lb0 0 2024-02-15T18:31:32.404 INFO:tasks.workunit.client.1.smithi131.stdout:9/565: dwrite d4/dc/de/f80 [0,4194304] 0 2024-02-15T18:31:32.408 INFO:tasks.workunit.client.1.smithi131.stdout:9/566: rename d4/dc/d25/d3f/d81/d5b/f6f to d4/dc/d17/d19/fb9 0 2024-02-15T18:31:32.408 INFO:tasks.workunit.client.1.smithi131.stdout:9/567: fsync d4/dc/d25/d3f/d81/d72/fa8 0 2024-02-15T18:31:32.409 INFO:tasks.workunit.client.1.smithi131.stdout:9/568: creat d4/dc/d25/d3f/d81/d5b/fba x:0 0 0 2024-02-15T18:31:32.412 INFO:tasks.workunit.client.1.smithi131.stdout:9/569: rename d4/dc/de/c7e to d4/dc/de/d1e/cbb 0 2024-02-15T18:31:32.415 INFO:tasks.workunit.client.1.smithi131.stdout:9/570: rename d4/dc/d25/d3f/d81/d63 to d4/dc/d17/db0/dbc 0 2024-02-15T18:31:32.416 INFO:tasks.workunit.client.1.smithi131.stdout:9/571: truncate d4/d9b/f7a 574051 0 2024-02-15T18:31:32.417 INFO:tasks.workunit.client.1.smithi131.stdout:9/572: mknod d4/d78/cbd 0 2024-02-15T18:31:32.417 INFO:tasks.workunit.client.1.smithi131.stdout:9/573: fsync d4/dc/de/d1e/d1f/d51/d5d/d71/f96 0 2024-02-15T18:31:32.418 INFO:tasks.workunit.client.1.smithi131.stdout:9/574: mknod d4/dc/d25/d3f/d81/cbe 0 2024-02-15T18:31:32.418 INFO:tasks.workunit.client.1.smithi131.stdout:9/575: write d4/dc/de/d1e/d1f/d51/d7f/fae [83806,40509] 0 2024-02-15T18:31:32.419 INFO:tasks.workunit.client.1.smithi131.stdout:9/576: symlink d4/dc/d17/d19/d32/d91/lbf 0 2024-02-15T18:31:32.419 INFO:tasks.workunit.client.1.smithi131.stdout:9/577: fsync d4/dc/d25/d3f/d81/d5b/f6b 0 2024-02-15T18:31:32.445 INFO:tasks.workunit.client.1.smithi131.stdout:9/578: dwrite d4/dc/f56 [4194304,4194304] 0 2024-02-15T18:31:32.445 INFO:tasks.workunit.client.1.smithi131.stdout:9/579: write f1 [173731,37524] 0 2024-02-15T18:31:32.460 INFO:tasks.workunit.client.1.smithi131.stdout:9/580: dwrite d4/d78/fa1 [0,4194304] 0 2024-02-15T18:31:32.460 INFO:tasks.workunit.client.1.smithi131.stdout:9/581: fdatasync d4/dc/d25/d3f/d81/d72/fb8 0 2024-02-15T18:31:32.462 INFO:tasks.workunit.client.1.smithi131.stdout:9/582: mkdir d4/dc/de/d1e/d1f/d2c/dc0 0 2024-02-15T18:31:32.463 INFO:tasks.workunit.client.1.smithi131.stdout:9/583: getdents d4/dc/d25/d4e/d8a 0 2024-02-15T18:31:32.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/584: mkdir d4/dc/de/db4/dc1 0 2024-02-15T18:31:32.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/585: stat d4/dc/d25/d4e 0 2024-02-15T18:31:32.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/586: stat d4/dc/d25/d3f/d81/d5b/fba 0 2024-02-15T18:31:32.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/587: readlink d4/dc/de/d1e/d1f/d2c/l7c 0 2024-02-15T18:31:32.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/588: write d4/dc/f2d [3571348,11070] 0 2024-02-15T18:31:32.469 INFO:tasks.workunit.client.1.smithi131.stdout:9/589: dread d4/dc/d25/d3f/f5c [0,4194304] 0 2024-02-15T18:31:32.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/590: dwrite d4/dc/d25/d3f/d81/d5b/f87 [0,4194304] 0 2024-02-15T18:31:32.521 INFO:tasks.workunit.client.1.smithi131.stdout:9/591: dwrite d4/fa5 [0,4194304] 0 2024-02-15T18:31:32.522 INFO:tasks.workunit.client.1.smithi131.stdout:9/592: fdatasync d4/dc/d25/d3f/d81/d5b/f6b 0 2024-02-15T18:31:32.538 INFO:tasks.workunit.client.1.smithi131.stdout:9/593: dwrite d4/dc/de/d1e/d1f/d51/d5d/d71/f96 [0,4194304] 0 2024-02-15T18:31:32.540 INFO:tasks.workunit.client.1.smithi131.stdout:9/594: stat d4/dc/d17/l62 0 2024-02-15T18:31:32.542 INFO:tasks.workunit.client.1.smithi131.stdout:9/595: rename d4/d9b to d4/dc/d17/d19/d32/dc2 0 2024-02-15T18:31:32.544 INFO:tasks.workunit.client.1.smithi131.stdout:9/596: mkdir d4/dc3 0 2024-02-15T18:31:32.546 INFO:tasks.workunit.client.1.smithi131.stdout:9/597: dread d4/dc/d17/d19/d32/dc2/f7a [0,4194304] 0 2024-02-15T18:31:32.546 INFO:tasks.workunit.client.1.smithi131.stdout:9/598: read - d4/dc/d17/db0/dbc/fb7 zero size 2024-02-15T18:31:32.546 INFO:tasks.workunit.client.1.smithi131.stdout:9/599: write d4/dc/d17/d19/d32/dc2/f88 [2575006,114613] 0 2024-02-15T18:31:32.549 INFO:tasks.workunit.client.1.smithi131.stdout:9/600: symlink d4/dc/d17/d19/d32/lc4 0 2024-02-15T18:31:32.554 INFO:tasks.workunit.client.1.smithi131.stdout:9/601: dread d4/dc/f2d [0,4194304] 0 2024-02-15T18:31:32.556 INFO:tasks.workunit.client.1.smithi131.stdout:9/602: rename f1 to d4/dc/de/d1e/fc5 0 2024-02-15T18:31:32.556 INFO:tasks.workunit.client.1.smithi131.stdout:9/603: stat d4/dc/de/d1e/d1f/d51/d5d/d9d 0 2024-02-15T18:31:32.556 INFO:tasks.workunit.client.1.smithi131.stdout:9/604: dread - d4/dc/d25/d4e/d8a/f9c zero size 2024-02-15T18:31:32.557 INFO:tasks.workunit.client.1.smithi131.stdout:9/605: getdents d4/dc/de/d1e/d1f/d51/d5d 0 2024-02-15T18:31:32.557 INFO:tasks.workunit.client.1.smithi131.stdout:9/606: readlink d4/dc/d25/d3f/l9f 0 2024-02-15T18:31:32.557 INFO:tasks.workunit.client.1.smithi131.stdout:9/607: chown d4/dc/d25/d4e/d8a/c99 569 1 2024-02-15T18:31:32.558 INFO:tasks.workunit.client.1.smithi131.stdout:9/608: mknod d4/dc/de/d1e/d1f/d51/d5d/d71/cc6 0 2024-02-15T18:31:32.578 INFO:tasks.workunit.client.1.smithi131.stdout:9/609: dwrite d4/dc/d25/d3f/d81/d72/fa8 [0,4194304] 0 2024-02-15T18:31:32.578 INFO:tasks.workunit.client.1.smithi131.stdout:9/610: truncate d4/dc/d25/d3f/d81/f86 1068554 0 2024-02-15T18:31:32.581 INFO:tasks.workunit.client.1.smithi131.stdout:9/611: dread d4/dc/d17/d19/fb9 [0,4194304] 0 2024-02-15T18:31:32.601 INFO:tasks.workunit.client.1.smithi131.stdout:9/612: dwrite d4/dc/d25/d3f/f5c [0,4194304] 0 2024-02-15T18:31:32.601 INFO:tasks.workunit.client.1.smithi131.stdout:9/613: truncate d4/fa5 4222538 0 2024-02-15T18:31:32.602 INFO:tasks.workunit.client.1.smithi131.stdout:9/614: symlink d4/dc/d17/db0/dbc/lc7 0 2024-02-15T18:31:32.603 INFO:tasks.workunit.client.1.smithi131.stdout:9/615: rmdir d4/dc/d25/d4e 39 2024-02-15T18:31:32.603 INFO:tasks.workunit.client.1.smithi131.stdout:9/616: stat d4/dc/d25/d3f/d81/d72 0 2024-02-15T18:31:32.603 INFO:tasks.workunit.client.1.smithi131.stdout:9/617: write d4/dc/d25/d3f/d81/d72/fb8 [668705,65145] 0 2024-02-15T18:31:32.603 INFO:tasks.workunit.client.1.smithi131.stdout:9/618: rmdir d4/dc/d17/db0/dbc 39 2024-02-15T18:31:32.604 INFO:tasks.workunit.client.1.smithi131.stdout:9/619: mknod d4/dc/d25/d3f/d81/d5b/cc8 0 2024-02-15T18:31:32.604 INFO:tasks.workunit.client.1.smithi131.stdout:9/620: write d4/dc/de/d1e/f37 [4158935,61198] 0 2024-02-15T18:31:32.606 INFO:tasks.workunit.client.1.smithi131.stdout:9/621: rename d4/dc/de/d1e/d1f/c29 to d4/dc/d25/d3f/d81/d5b/cc9 0 2024-02-15T18:31:32.610 INFO:tasks.workunit.client.1.smithi131.stdout:7/604: sync 2024-02-15T18:31:32.610 INFO:tasks.workunit.client.1.smithi131.stdout:5/465: sync 2024-02-15T18:31:32.610 INFO:tasks.workunit.client.1.smithi131.stdout:5/466: dread - d18/d24/d63/f99 zero size 2024-02-15T18:31:32.613 INFO:tasks.workunit.client.1.smithi131.stdout:5/467: rename d18/l4f to d18/d33/d73/l9b 0 2024-02-15T18:31:32.615 INFO:tasks.workunit.client.1.smithi131.stdout:5/468: mkdir d18/d6d/d9c 0 2024-02-15T18:31:32.617 INFO:tasks.workunit.client.1.smithi131.stdout:9/622: dread d4/dc/de/d1e/d1f/d51/d5d/d71/f96 [0,4194304] 0 2024-02-15T18:31:32.617 INFO:tasks.workunit.client.1.smithi131.stdout:5/469: link d18/d23/f3a d18/d6d/f9d 0 2024-02-15T18:31:32.620 INFO:tasks.workunit.client.1.smithi131.stdout:7/605: dread d0/d17/d3a/f54 [0,4194304] 0 2024-02-15T18:31:32.621 INFO:tasks.workunit.client.1.smithi131.stdout:5/470: unlink f16 0 2024-02-15T18:31:32.630 INFO:tasks.workunit.client.1.smithi131.stdout:7/606: dread d0/d34/f35 [0,4194304] 0 2024-02-15T18:31:32.631 INFO:tasks.workunit.client.1.smithi131.stdout:7/607: stat d0/fd 0 2024-02-15T18:31:32.634 INFO:tasks.workunit.client.1.smithi131.stdout:7/608: rmdir d0/d9d 39 2024-02-15T18:31:32.636 INFO:tasks.workunit.client.1.smithi131.stdout:7/609: rename d0/d34/fbc to d0/d34/d8e/fc0 0 2024-02-15T18:31:32.636 INFO:tasks.workunit.client.1.smithi131.stdout:7/610: chown d0/c2b 18 1 2024-02-15T18:31:32.636 INFO:tasks.workunit.client.1.smithi131.stdout:7/611: readlink d0/d17/l2c 0 2024-02-15T18:31:32.645 INFO:tasks.workunit.client.1.smithi131.stdout:9/623: dwrite d4/dc/d17/d19/f82 [0,4194304] 0 2024-02-15T18:31:32.648 INFO:tasks.workunit.client.1.smithi131.stdout:9/624: read d4/dc/d17/d19/f5f [560989,54448] 0 2024-02-15T18:31:32.650 INFO:tasks.workunit.client.1.smithi131.stdout:9/625: mknod d4/dc/de/d1e/d1f/d2c/cca 0 2024-02-15T18:31:32.651 INFO:tasks.workunit.client.1.smithi131.stdout:9/626: unlink d4/dc/de/d1e/d1f/d51/d5d/d9d/cac 0 2024-02-15T18:31:32.652 INFO:tasks.workunit.client.1.smithi131.stdout:5/471: dwrite d18/d20/f71 [0,4194304] 0 2024-02-15T18:31:32.652 INFO:tasks.workunit.client.1.smithi131.stdout:5/472: chown l9 1 1 2024-02-15T18:31:32.652 INFO:tasks.workunit.client.1.smithi131.stdout:9/627: symlink d4/dc/d25/d3f/lcb 0 2024-02-15T18:31:32.653 INFO:tasks.workunit.client.1.smithi131.stdout:5/473: read d18/d24/d63/f7e [130408,18157] 0 2024-02-15T18:31:32.653 INFO:tasks.workunit.client.1.smithi131.stdout:9/628: rmdir d4/dc/d17/d19/d32/dc2 39 2024-02-15T18:31:32.654 INFO:tasks.workunit.client.1.smithi131.stdout:7/612: dwrite d0/d34/fa2 [0,4194304] 0 2024-02-15T18:31:32.656 INFO:tasks.workunit.client.1.smithi131.stdout:5/474: rename d18/d20/d90 to d18/d6d/d70/d9e 0 2024-02-15T18:31:32.658 INFO:tasks.workunit.client.1.smithi131.stdout:9/629: unlink d4/dc/d25/d3f/d81/d5b/cc8 0 2024-02-15T18:31:32.658 INFO:tasks.workunit.client.1.smithi131.stdout:9/630: chown d4/dc/d25/f40 11220744 1 2024-02-15T18:31:32.658 INFO:tasks.workunit.client.1.smithi131.stdout:9/631: stat d4/dc/d25/d3f/d81/f75 0 2024-02-15T18:31:32.660 INFO:tasks.workunit.client.1.smithi131.stdout:7/613: mknod d0/d17/d36/cc1 0 2024-02-15T18:31:32.662 INFO:tasks.workunit.client.1.smithi131.stdout:5/475: link d18/d33/f5e d18/d6d/d70/d9e/d85/f9f 0 2024-02-15T18:31:32.663 INFO:tasks.workunit.client.1.smithi131.stdout:9/632: creat d4/dc/fcc x:0 0 0 2024-02-15T18:31:32.665 INFO:tasks.workunit.client.1.smithi131.stdout:5/476: rmdir d18/d20/d8e 0 2024-02-15T18:31:32.671 INFO:tasks.workunit.client.1.smithi131.stdout:9/633: link d4/dc/de/d1e/d1f/d51/f77 d4/d78/fcd 0 2024-02-15T18:31:32.671 INFO:tasks.workunit.client.1.smithi131.stdout:9/634: truncate d4/d78/fcd 147394 0 2024-02-15T18:31:32.671 INFO:tasks.workunit.client.1.smithi131.stdout:9/635: symlink d4/dc/d17/d19/d84/lce 0 2024-02-15T18:31:32.672 INFO:tasks.workunit.client.1.smithi131.stdout:9/636: readlink d4/dc/d17/d19/d32/d91/db3/lb6 0 2024-02-15T18:31:32.683 INFO:tasks.workunit.client.1.smithi131.stdout:7/614: dwrite d0/d17/f68 [0,4194304] 0 2024-02-15T18:31:32.683 INFO:tasks.workunit.client.1.smithi131.stdout:7/615: fdatasync d0/f43 0 2024-02-15T18:31:32.690 INFO:tasks.workunit.client.1.smithi131.stdout:5/477: dwrite d18/d4e/f94 [0,4194304] 0 2024-02-15T18:31:32.692 INFO:tasks.workunit.client.1.smithi131.stdout:5/478: getdents d18/d6d 0 2024-02-15T18:31:32.692 INFO:tasks.workunit.client.1.smithi131.stdout:5/479: read - d18/d24/d63/f99 zero size 2024-02-15T18:31:32.693 INFO:tasks.workunit.client.1.smithi131.stdout:5/480: read fb [1081407,33687] 0 2024-02-15T18:31:32.693 INFO:tasks.workunit.client.1.smithi131.stdout:5/481: write d18/d24/d63/f76 [610322,5827] 0 2024-02-15T18:31:32.693 INFO:tasks.workunit.client.1.smithi131.stdout:9/637: dwrite d4/dc/d17/d19/d32/dc2/f88 [0,4194304] 0 2024-02-15T18:31:32.696 INFO:tasks.workunit.client.1.smithi131.stdout:7/616: getdents d0/d17/d36 0 2024-02-15T18:31:32.697 INFO:tasks.workunit.client.1.smithi131.stdout:7/617: write d0/d17/d3a/d3d/d79/d89/f96 [971292,83136] 0 2024-02-15T18:31:32.697 INFO:tasks.workunit.client.1.smithi131.stdout:5/482: write d18/d24/f26 [2932833,66255] 0 2024-02-15T18:31:32.697 INFO:tasks.workunit.client.1.smithi131.stdout:5/483: write d18/d4e/f6f [80862,96667] 0 2024-02-15T18:31:32.702 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-15T18:31:32.702 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-15T18:31:32.703 INFO:tasks.workunit.client.1.smithi131.stdout:5/484: symlink d18/d6d/la0 0 2024-02-15T18:31:32.703 INFO:tasks.workunit.client.1.smithi131.stdout:5/485: chown d18/d24/d63/f75 429 1 2024-02-15T18:31:32.704 INFO:tasks.workunit.client.1.smithi131.stdout:5/486: symlink d18/d24/la1 0 2024-02-15T18:31:32.725 INFO:tasks.workunit.client.1.smithi131.stdout:7/618: dwrite d0/d34/f97 [0,4194304] 0 2024-02-15T18:31:32.726 INFO:tasks.workunit.client.1.smithi131.stdout:7/619: symlink d0/db8/lc2 0 2024-02-15T18:31:32.727 INFO:tasks.workunit.client.1.smithi131.stdout:9/638: dwrite d4/dc/d17/d19/d32/fad [0,4194304] 0 2024-02-15T18:31:32.727 INFO:tasks.workunit.client.1.smithi131.stdout:5/487: dwrite fb [0,4194304] 0 2024-02-15T18:31:32.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:31.449168+0000 mgr.smithi033.apxevf (mgr.14626) 4 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.6 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-02-15T18:31:32.755 INFO:tasks.workunit.client.1.smithi131.stdout:7/620: dwrite d0/d17/f3c [0,4194304] 0 2024-02-15T18:31:32.755 INFO:tasks.workunit.client.1.smithi131.stdout:7/621: write d0/d34/fb7 [934502,45005] 0 2024-02-15T18:31:32.766 INFO:tasks.workunit.client.1.smithi131.stdout:5/488: dwrite d18/d23/f8f [0,4194304] 0 2024-02-15T18:31:32.766 INFO:tasks.workunit.client.1.smithi131.stdout:5/489: write d18/d33/f5e [954325,34150] 0 2024-02-15T18:31:32.767 INFO:tasks.workunit.client.1.smithi131.stdout:9/639: dwrite d4/dc/d17/db0/dbc/f95 [0,4194304] 0 2024-02-15T18:31:32.769 INFO:tasks.workunit.client.1.smithi131.stdout:5/490: link d18/d24/d63/l65 d18/d6d/d70/d9e/d85/la2 0 2024-02-15T18:31:32.773 INFO:tasks.workunit.client.1.smithi131.stdout:9/640: mknod d4/dc/de/d1e/d1f/d51/ccf 0 2024-02-15T18:31:32.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:31.449168+0000 mgr.smithi033.apxevf (mgr.14626) 4 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 1.6 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-02-15T18:31:32.775 INFO:tasks.workunit.client.1.smithi131.stdout:5/491: mkdir d18/d24/da3 0 2024-02-15T18:31:32.775 INFO:tasks.workunit.client.1.smithi131.stdout:5/492: stat d18/d20/f2f 0 2024-02-15T18:31:32.776 INFO:tasks.workunit.client.1.smithi131.stdout:9/641: creat d4/dc/d25/d3f/d81/d5b/fd0 x:0 0 0 2024-02-15T18:31:32.777 INFO:tasks.workunit.client.1.smithi131.stdout:9/642: creat d4/dc/de/d1e/d1f/d51/d7f/fd1 x:0 0 0 2024-02-15T18:31:32.777 INFO:tasks.workunit.client.1.smithi131.stdout:9/643: chown f0 83269 1 2024-02-15T18:31:32.777 INFO:tasks.workunit.client.1.smithi131.stdout:9/644: read - d4/dc/d25/d3f/d81/d5b/fba zero size 2024-02-15T18:31:32.780 INFO:tasks.workunit.client.1.smithi131.stdout:5/493: dread d18/d20/f2a [0,4194304] 0 2024-02-15T18:31:32.782 INFO:tasks.workunit.client.1.smithi131.stdout:5/494: creat d18/d24/fa4 x:0 0 0 2024-02-15T18:31:32.784 INFO:tasks.workunit.client.1.smithi131.stdout:5/495: unlink ce 0 2024-02-15T18:31:32.793 INFO:tasks.workunit.client.1.smithi131.stdout:9/645: dwrite d4/dc/d17/d19/d32/f48 [0,4194304] 0 2024-02-15T18:31:32.801 INFO:tasks.workunit.client.1.smithi131.stdout:5/496: dwrite d18/d24/d63/f75 [0,4194304] 0 2024-02-15T18:31:32.801 INFO:tasks.workunit.client.1.smithi131.stdout:5/497: fdatasync d18/d24/f4a 0 2024-02-15T18:31:32.805 INFO:tasks.workunit.client.1.smithi131.stdout:5/498: mknod d18/d6d/d9c/ca5 0 2024-02-15T18:31:32.805 INFO:tasks.workunit.client.1.smithi131.stdout:5/499: dread - d18/f92 zero size 2024-02-15T18:31:32.807 INFO:tasks.workunit.client.1.smithi131.stdout:5/500: dread d18/d23/f30 [0,4194304] 0 2024-02-15T18:31:32.813 INFO:tasks.workunit.client.1.smithi131.stdout:9/646: dwrite d4/dc/d25/d3f/d81/f86 [0,4194304] 0 2024-02-15T18:31:32.820 INFO:tasks.workunit.client.1.smithi131.stdout:9/647: rename d4/dc/d17/d19/d32/fad to d4/dc/d17/d19/d32/fd2 0 2024-02-15T18:31:32.824 INFO:tasks.workunit.client.1.smithi131.stdout:9/648: dread d4/dc/d25/d3f/d81/f75 [0,4194304] 0 2024-02-15T18:31:32.828 INFO:tasks.workunit.client.1.smithi131.stdout:5/501: dwrite d18/d24/d63/f7e [0,4194304] 0 2024-02-15T18:31:32.833 INFO:tasks.workunit.client.1.smithi131.stdout:9/649: dread d4/dc/d25/d3f/d81/f86 [0,4194304] 0 2024-02-15T18:31:32.833 INFO:tasks.workunit.client.1.smithi131.stdout:9/650: stat d4/dc/d25/d3f/d81/d72 0 2024-02-15T18:31:32.833 INFO:tasks.workunit.client.1.smithi131.stdout:9/651: fsync d4/dc/d17/d19/f5a 0 2024-02-15T18:31:32.833 INFO:tasks.workunit.client.1.smithi131.stdout:9/652: write d4/dc/d17/d19/d32/dc2/fa3 [950955,87930] 0 2024-02-15T18:31:32.834 INFO:tasks.workunit.client.1.smithi131.stdout:9/653: getdents d4/dc/d17/d19/d32/d91 0 2024-02-15T18:31:32.835 INFO:tasks.workunit.client.1.smithi131.stdout:9/654: getdents d4/dc/d25/d3f/d81/d5b/daa 0 2024-02-15T18:31:32.835 INFO:tasks.workunit.client.1.smithi131.stdout:5/502: dread d18/d20/f2a [0,4194304] 0 2024-02-15T18:31:32.836 INFO:tasks.workunit.client.1.smithi131.stdout:9/655: creat d4/dc/de/d1e/d1f/d51/d5d/fd3 x:0 0 0 2024-02-15T18:31:32.845 INFO:tasks.workunit.client.1.smithi131.stdout:9/656: unlink d4/dc/d17/db0/dbc/fb7 0 2024-02-15T18:31:32.847 INFO:tasks.workunit.client.1.smithi131.stdout:9/657: creat d4/dc/d25/d3f/d81/fd4 x:0 0 0 2024-02-15T18:31:32.847 INFO:tasks.workunit.client.1.smithi131.stdout:9/658: read d4/dc/de/f58 [1310840,115534] 0 2024-02-15T18:31:32.848 INFO:tasks.workunit.client.1.smithi131.stdout:9/659: symlink d4/dc/de/d1e/d1f/d51/ld5 0 2024-02-15T18:31:32.850 INFO:tasks.workunit.client.1.smithi131.stdout:9/660: creat d4/dc/de/d1e/d1f/fd6 x:0 0 0 2024-02-15T18:31:32.850 INFO:tasks.workunit.client.1.smithi131.stdout:9/661: fdatasync d4/dc/de/d1e/d1f/d2c/f79 0 2024-02-15T18:31:32.852 INFO:tasks.workunit.client.1.smithi131.stdout:9/662: mkdir d4/dc/dd7 0 2024-02-15T18:31:32.854 INFO:tasks.workunit.client.1.smithi131.stdout:9/663: truncate d4/dc/d25/d3f/d81/d72/fb8 476927 0 2024-02-15T18:31:32.855 INFO:tasks.workunit.client.1.smithi131.stdout:9/664: rmdir d4/dc/d25/d4e/d8a 39 2024-02-15T18:31:32.856 INFO:tasks.workunit.client.1.smithi131.stdout:9/665: creat d4/dc/fd8 x:0 0 0 2024-02-15T18:31:32.856 INFO:tasks.workunit.client.1.smithi131.stdout:9/666: fsync d4/dc/d17/d19/d32/dc2/f7a 0 2024-02-15T18:31:32.857 INFO:tasks.workunit.client.1.smithi131.stdout:9/667: creat d4/dc/d25/d3f/fd9 x:0 0 0 2024-02-15T18:31:32.911 INFO:tasks.workunit.client.1.smithi131.stdout:5/503: dwrite f11 [0,4194304] 0 2024-02-15T18:31:32.912 INFO:tasks.workunit.client.1.smithi131.stdout:9/668: dwrite d4/dc/d25/d3f/f66 [0,4194304] 0 2024-02-15T18:31:32.932 INFO:tasks.workunit.client.1.smithi131.stdout:5/504: dwrite d18/d23/f8f [0,4194304] 0 2024-02-15T18:31:32.932 INFO:tasks.workunit.client.1.smithi131.stdout:5/505: chown d18/d6d/d9c/ca5 272099 1 2024-02-15T18:31:32.933 INFO:tasks.workunit.client.1.smithi131.stdout:5/506: link d18/d24/d7b/f84 d18/d6d/d70/d9e/fa6 0 2024-02-15T18:31:32.952 INFO:tasks.workunit.client.1.smithi131.stdout:5/507: dwrite d18/d23/f52 [0,4194304] 0 2024-02-15T18:31:32.961 INFO:tasks.workunit.client.1.smithi131.stdout:5/508: link d18/d20/f57 d18/d4e/fa7 0 2024-02-15T18:31:32.963 INFO:tasks.workunit.client.1.smithi131.stdout:5/509: creat d18/d20/fa8 x:0 0 0 2024-02-15T18:31:32.963 INFO:tasks.workunit.client.1.smithi131.stdout:5/510: chown d18/l21 603071716 1 2024-02-15T18:31:32.964 INFO:tasks.workunit.client.1.smithi131.stdout:5/511: truncate f6 1125150 0 2024-02-15T18:31:32.964 INFO:tasks.workunit.client.1.smithi131.stdout:5/512: readlink d18/d33/l74 0 2024-02-15T18:31:32.966 INFO:tasks.workunit.client.1.smithi131.stdout:5/513: symlink d18/d6d/d70/d9e/d86/la9 0 2024-02-15T18:31:32.968 INFO:tasks.workunit.client.1.smithi131.stdout:5/514: write d18/d23/f6e [3791056,50284] 0 2024-02-15T18:31:32.971 INFO:tasks.workunit.client.1.smithi131.stdout:5/515: creat d18/d24/d7b/faa x:0 0 0 2024-02-15T18:31:32.973 INFO:tasks.workunit.client.1.smithi131.stdout:0/367: sync 2024-02-15T18:31:32.973 INFO:tasks.workunit.client.1.smithi131.stdout:6/469: sync 2024-02-15T18:31:32.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/470: fdatasync d2/d7/f39 0 2024-02-15T18:31:32.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/471: fdatasync d2/d7/f94 0 2024-02-15T18:31:32.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/472: chown d2/d7/d48/f49 58836 1 2024-02-15T18:31:32.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/473: fsync d2/d7/d48/f5c 0 2024-02-15T18:31:32.975 INFO:tasks.workunit.client.1.smithi131.stdout:5/516: rename d18/d33/d61 to d18/d6d/d70/d9e/d85/dab 0 2024-02-15T18:31:32.978 INFO:tasks.workunit.client.1.smithi131.stdout:0/368: unlink d5/d2f/d45/c66 0 2024-02-15T18:31:32.978 INFO:tasks.workunit.client.1.smithi131.stdout:0/369: write d5/d15/d1f/f75 [988525,102845] 0 2024-02-15T18:31:32.984 INFO:tasks.workunit.client.1.smithi131.stdout:6/474: symlink d2/d7/d48/d40/l95 0 2024-02-15T18:31:32.985 INFO:tasks.workunit.client.1.smithi131.stdout:5/517: unlink d18/d24/fa4 0 2024-02-15T18:31:32.985 INFO:tasks.workunit.client.1.smithi131.stdout:5/518: write d18/d24/f59 [22518,29376] 0 2024-02-15T18:31:32.988 INFO:tasks.workunit.client.1.smithi131.stdout:0/370: dread d5/d2f/d45/f51 [0,4194304] 0 2024-02-15T18:31:32.988 INFO:tasks.workunit.client.1.smithi131.stdout:5/519: getdents d18/d23 0 2024-02-15T18:31:32.988 INFO:tasks.workunit.client.1.smithi131.stdout:5/520: chown d18/d24/l36 3 1 2024-02-15T18:31:32.989 INFO:tasks.workunit.client.1.smithi131.stdout:0/371: creat d5/d2f/f78 x:0 0 0 2024-02-15T18:31:32.990 INFO:tasks.workunit.client.1.smithi131.stdout:5/521: mkdir d18/d24/d7b/dac 0 2024-02-15T18:31:32.993 INFO:tasks.workunit.client.1.smithi131.stdout:0/372: symlink d5/d9/d4d/l79 0 2024-02-15T18:31:32.993 INFO:tasks.workunit.client.1.smithi131.stdout:0/373: stat d5/d9/d10/d3f/l40 0 2024-02-15T18:31:32.994 INFO:tasks.workunit.client.1.smithi131.stdout:5/522: creat d18/d23/fad x:0 0 0 2024-02-15T18:31:32.995 INFO:tasks.workunit.client.1.smithi131.stdout:0/374: symlink d5/d2f/d4b/l7a 0 2024-02-15T18:31:32.995 INFO:tasks.workunit.client.1.smithi131.stdout:0/375: chown d5/d2f/d45/f50 135501 1 2024-02-15T18:31:32.995 INFO:tasks.workunit.client.1.smithi131.stdout:0/376: write d5/d9/d10/d3f/f61 [501427,68207] 0 2024-02-15T18:31:32.997 INFO:tasks.workunit.client.1.smithi131.stdout:5/523: symlink d18/d24/d7b/dac/lae 0 2024-02-15T18:31:32.997 INFO:tasks.workunit.client.1.smithi131.stdout:5/524: fdatasync d18/d4e/f64 0 2024-02-15T18:31:32.997 INFO:tasks.workunit.client.1.smithi131.stdout:5/525: stat d18/l6a 0 2024-02-15T18:31:32.997 INFO:tasks.workunit.client.1.smithi131.stdout:5/526: chown d18/d6d/d70/d9e/d86/la9 275431223 1 2024-02-15T18:31:32.998 INFO:tasks.workunit.client.1.smithi131.stdout:0/377: mknod d5/d2f/d45/c7b 0 2024-02-15T18:31:33.002 INFO:tasks.workunit.client.1.smithi131.stdout:5/527: dread d18/d24/d63/f76 [0,4194304] 0 2024-02-15T18:31:33.003 INFO:tasks.workunit.client.1.smithi131.stdout:5/528: truncate d18/d33/f5e 587810 0 2024-02-15T18:31:33.006 INFO:tasks.workunit.client.1.smithi131.stdout:0/378: dread d5/d9/d11/f14 [0,4194304] 0 2024-02-15T18:31:33.007 INFO:tasks.workunit.client.1.smithi131.stdout:5/529: truncate d18/f50 604260 0 2024-02-15T18:31:33.009 INFO:tasks.workunit.client.1.smithi131.stdout:5/530: write f17 [1781226,37458] 0 2024-02-15T18:31:33.009 INFO:tasks.workunit.client.1.smithi131.stdout:5/531: dread - d18/d24/f87 zero size 2024-02-15T18:31:33.010 INFO:tasks.workunit.client.1.smithi131.stdout:5/532: getdents d18/d6d 0 2024-02-15T18:31:33.010 INFO:tasks.workunit.client.1.smithi131.stdout:5/533: truncate d18/d20/f57 157380 0 2024-02-15T18:31:33.011 INFO:tasks.workunit.client.1.smithi131.stdout:5/534: mknod d18/d6d/d70/d9e/d85/d95/caf 0 2024-02-15T18:31:33.036 INFO:tasks.workunit.client.1.smithi131.stdout:0/379: dwrite d5/d15/f60 [0,4194304] 0 2024-02-15T18:31:33.044 INFO:tasks.workunit.client.1.smithi131.stdout:0/380: creat d5/d9/d4d/f7c x:0 0 0 2024-02-15T18:31:33.049 INFO:tasks.workunit.client.1.smithi131.stdout:3/530: sync 2024-02-15T18:31:33.049 INFO:tasks.workunit.client.1.smithi131.stdout:2/344: sync 2024-02-15T18:31:33.049 INFO:tasks.workunit.client.1.smithi131.stdout:8/369: sync 2024-02-15T18:31:33.049 INFO:tasks.workunit.client.1.smithi131.stdout:8/370: fdatasync f17 0 2024-02-15T18:31:33.049 INFO:tasks.workunit.client.1.smithi131.stdout:8/371: chown d22/d26/d3f/d47/d57/c67 0 1 2024-02-15T18:31:33.050 INFO:tasks.workunit.client.1.smithi131.stdout:1/602: sync 2024-02-15T18:31:33.050 INFO:tasks.workunit.client.1.smithi131.stdout:2/345: read dd/d10/d22/d2f/d38/f50 [186909,96191] 0 2024-02-15T18:31:33.056 INFO:tasks.workunit.client.1.smithi131.stdout:1/603: rename d0/d1/d44/d59/fb9 to d0/d2/d7/d72/fd8 0 2024-02-15T18:31:33.056 INFO:tasks.workunit.client.1.smithi131.stdout:8/372: getdents d22/d26/d3f/d47 0 2024-02-15T18:31:33.056 INFO:tasks.workunit.client.1.smithi131.stdout:1/604: chown d0/d1/d24/f2d 51964 1 2024-02-15T18:31:33.056 INFO:tasks.workunit.client.1.smithi131.stdout:8/373: fsync d22/d26/f6c 0 2024-02-15T18:31:33.059 INFO:tasks.workunit.client.1.smithi131.stdout:8/374: rmdir d22/d2e/d60 39 2024-02-15T18:31:33.068 INFO:tasks.workunit.client.1.smithi131.stdout:1/605: dread d0/d1/d24/f2d [0,4194304] 0 2024-02-15T18:31:33.069 INFO:tasks.workunit.client.1.smithi131.stdout:8/375: dread f1c [0,4194304] 0 2024-02-15T18:31:33.077 INFO:tasks.workunit.client.1.smithi131.stdout:0/381: dwrite d5/d2f/f5e [0,4194304] 0 2024-02-15T18:31:33.086 INFO:tasks.workunit.client.1.smithi131.stdout:3/531: dwrite d2/d22/d29/f91 [0,4194304] 0 2024-02-15T18:31:33.087 INFO:tasks.workunit.client.1.smithi131.stdout:3/532: chown d2/d22/d29/db/f1d 1149 1 2024-02-15T18:31:33.099 INFO:tasks.workunit.client.1.smithi131.stdout:8/376: dwrite d22/d2e/f38 [0,4194304] 0 2024-02-15T18:31:33.100 INFO:tasks.workunit.client.1.smithi131.stdout:8/377: write d22/d26/d3f/f4f [224656,25750] 0 2024-02-15T18:31:33.100 INFO:tasks.workunit.client.1.smithi131.stdout:8/378: fdatasync d22/f32 0 2024-02-15T18:31:33.100 INFO:tasks.workunit.client.1.smithi131.stdout:8/379: chown d22/d26/d3f/d47/d48/d5f/f72 2905 1 2024-02-15T18:31:33.100 INFO:tasks.workunit.client.1.smithi131.stdout:3/533: dread d2/d22/d29/db/d1a/f68 [0,4194304] 0 2024-02-15T18:31:33.100 INFO:tasks.workunit.client.1.smithi131.stdout:3/534: chown d2/d22/d3f/c51 2 1 2024-02-15T18:31:33.101 INFO:tasks.workunit.client.1.smithi131.stdout:2/346: dwrite dd/d10/d22/d2a/f2c [0,4194304] 0 2024-02-15T18:31:33.102 INFO:tasks.workunit.client.1.smithi131.stdout:2/347: fsync dd/d10/d13/d2e/f67 0 2024-02-15T18:31:33.102 INFO:tasks.workunit.client.1.smithi131.stdout:2/348: truncate dd/d14/f64 623286 0 2024-02-15T18:31:33.103 INFO:tasks.workunit.client.1.smithi131.stdout:8/380: creat d22/d26/f7b x:0 0 0 2024-02-15T18:31:33.105 INFO:tasks.workunit.client.1.smithi131.stdout:1/606: dwrite d0/d2/d4/d41/d5a/f7a [4194304,4194304] 0 2024-02-15T18:31:33.105 INFO:tasks.workunit.client.1.smithi131.stdout:2/349: mknod dd/d14/d1f/c72 0 2024-02-15T18:31:33.109 INFO:tasks.workunit.client.1.smithi131.stdout:0/382: dwrite d5/d9/d11/d3e/f48 [0,4194304] 0 2024-02-15T18:31:33.112 INFO:tasks.workunit.client.1.smithi131.stdout:0/383: creat d5/d15/d1f/f7d x:0 0 0 2024-02-15T18:31:33.119 INFO:tasks.workunit.client.1.smithi131.stdout:0/384: symlink d5/l7e 0 2024-02-15T18:31:33.120 INFO:tasks.workunit.client.1.smithi131.stdout:0/385: write d5/d9/d11/f14 [2995440,101703] 0 2024-02-15T18:31:33.121 INFO:tasks.workunit.client.1.smithi131.stdout:8/381: rmdir d22/d26 39 2024-02-15T18:31:33.124 INFO:tasks.workunit.client.1.smithi131.stdout:0/386: link d5/d9/d10/f19 d5/d9/d10/d3f/f7f 0 2024-02-15T18:31:33.127 INFO:tasks.workunit.client.1.smithi131.stdout:8/382: mkdir d22/d26/d3f/d7c 0 2024-02-15T18:31:33.127 INFO:tasks.workunit.client.1.smithi131.stdout:8/383: write d22/d26/f2a [2997331,22088] 0 2024-02-15T18:31:33.127 INFO:tasks.workunit.client.1.smithi131.stdout:8/384: chown d22/c25 466 1 2024-02-15T18:31:33.130 INFO:tasks.workunit.client.1.smithi131.stdout:8/385: symlink d22/d2e/d5e/l7d 0 2024-02-15T18:31:33.131 INFO:tasks.workunit.client.1.smithi131.stdout:1/607: dwrite d0/d2/d4/d41/fa5 [0,4194304] 0 2024-02-15T18:31:33.132 INFO:tasks.workunit.client.1.smithi131.stdout:8/386: mknod d22/d26/d3f/c7e 0 2024-02-15T18:31:33.133 INFO:tasks.workunit.client.1.smithi131.stdout:3/535: dwrite d2/d22/d29/db/f76 [4194304,4194304] 0 2024-02-15T18:31:33.133 INFO:tasks.workunit.client.1.smithi131.stdout:2/350: dwrite dd/f18 [0,4194304] 0 2024-02-15T18:31:33.133 INFO:tasks.workunit.client.1.smithi131.stdout:2/351: fsync dd/d10/d13/f61 0 2024-02-15T18:31:33.133 INFO:tasks.workunit.client.1.smithi131.stdout:0/387: fsync d5/d15/d1f/f7d 0 2024-02-15T18:31:33.144 INFO:tasks.workunit.client.1.smithi131.stdout:1/608: mkdir d0/d1/d16/dd1/dd9 0 2024-02-15T18:31:33.144 INFO:tasks.workunit.client.1.smithi131.stdout:1/609: write d0/d2/d4/f32 [4929363,41958] 0 2024-02-15T18:31:33.146 INFO:tasks.workunit.client.1.smithi131.stdout:8/387: symlink d22/d26/d3f/d47/d48/d5f/d6f/d7a/l7f 0 2024-02-15T18:31:33.146 INFO:tasks.workunit.client.1.smithi131.stdout:8/388: dread - d22/d41/f5d zero size 2024-02-15T18:31:33.150 INFO:tasks.workunit.client.1.smithi131.stdout:3/536: rmdir d2/d22/d29/db/d23 39 2024-02-15T18:31:33.155 INFO:tasks.workunit.client.1.smithi131.stdout:2/352: mknod dd/d14/d1f/d65/c73 0 2024-02-15T18:31:33.155 INFO:tasks.workunit.client.1.smithi131.stdout:2/353: dread - dd/d10/d22/d2f/d38/f45 zero size 2024-02-15T18:31:33.157 INFO:tasks.workunit.client.1.smithi131.stdout:0/388: creat d5/d9/f80 x:0 0 0 2024-02-15T18:31:33.157 INFO:tasks.workunit.client.1.smithi131.stdout:0/389: write f0 [3514867,87084] 0 2024-02-15T18:31:33.157 INFO:tasks.workunit.client.1.smithi131.stdout:0/390: chown d5/d9/d11/l3c 3 1 2024-02-15T18:31:33.159 INFO:tasks.workunit.client.1.smithi131.stdout:1/610: creat d0/d1/d44/d59/d42/dcf/da1/db3/dc2/fda x:0 0 0 2024-02-15T18:31:33.160 INFO:tasks.workunit.client.1.smithi131.stdout:1/611: readlink d0/d1/d16/db7/lbf 0 2024-02-15T18:31:33.163 INFO:tasks.workunit.client.1.smithi131.stdout:8/389: creat d22/d2e/d5e/f80 x:0 0 0 2024-02-15T18:31:33.164 INFO:tasks.workunit.client.1.smithi131.stdout:3/537: creat d2/d22/d29/db/fa9 x:0 0 0 2024-02-15T18:31:33.165 INFO:tasks.workunit.client.1.smithi131.stdout:0/391: dread d5/f68 [0,4194304] 0 2024-02-15T18:31:33.169 INFO:tasks.workunit.client.1.smithi131.stdout:2/354: rename dd/d10/d13 to dd/d10/d22/d2f/d38/d74 0 2024-02-15T18:31:33.170 INFO:tasks.workunit.client.1.smithi131.stdout:8/390: mknod d22/d26/d3f/c81 0 2024-02-15T18:31:33.177 INFO:tasks.workunit.client.1.smithi131.stdout:3/538: creat d2/d22/d29/db/d1a/da4/faa x:0 0 0 2024-02-15T18:31:33.177 INFO:tasks.workunit.client.1.smithi131.stdout:3/539: fsync d2/d22/d29/db/d23/d2a/d5b/f71 0 2024-02-15T18:31:33.178 INFO:tasks.workunit.client.1.smithi131.stdout:0/392: symlink d5/d9/d10/d3f/l81 0 2024-02-15T18:31:33.180 INFO:tasks.workunit.client.1.smithi131.stdout:1/612: dwrite d0/d2/d7/f4c [4194304,4194304] 0 2024-02-15T18:31:33.180 INFO:tasks.workunit.client.1.smithi131.stdout:2/355: mknod dd/d10/d22/d2f/d38/d74/d2e/d6a/c75 0 2024-02-15T18:31:33.180 INFO:tasks.workunit.client.1.smithi131.stdout:3/540: stat d2/d22/d29/c2c 0 2024-02-15T18:31:33.180 INFO:tasks.workunit.client.1.smithi131.stdout:3/541: write d2/d22/d29/db/d1a/da4/d70/fa1 [4488306,86366] 0 2024-02-15T18:31:33.181 INFO:tasks.workunit.client.1.smithi131.stdout:0/393: dread d5/d15/d1f/f57 [0,4194304] 0 2024-02-15T18:31:33.182 INFO:tasks.workunit.client.1.smithi131.stdout:0/394: chown d5/d9/d10/d73 97 1 2024-02-15T18:31:33.182 INFO:tasks.workunit.client.1.smithi131.stdout:1/613: getdents d0/d2/d31/d3d 0 2024-02-15T18:31:33.182 INFO:tasks.workunit.client.1.smithi131.stdout:1/614: read - d0/d1/d16/fcb zero size 2024-02-15T18:31:33.182 INFO:tasks.workunit.client.1.smithi131.stdout:1/615: write d0/d2/dd6/f2e [663206,107161] 0 2024-02-15T18:31:33.184 INFO:tasks.workunit.client.1.smithi131.stdout:2/356: dread fb [0,4194304] 0 2024-02-15T18:31:33.184 INFO:tasks.workunit.client.1.smithi131.stdout:3/542: link d2/d22/d3a/l5a d2/d22/d29/db/d1a/da4/d70/lab 0 2024-02-15T18:31:33.185 INFO:tasks.workunit.client.1.smithi131.stdout:1/616: truncate d0/d1/d44/d59/f6d 968600 0 2024-02-15T18:31:33.189 INFO:tasks.workunit.client.1.smithi131.stdout:1/617: creat d0/d1/d16/dd1/dd9/fdb x:0 0 0 2024-02-15T18:31:33.189 INFO:tasks.workunit.client.1.smithi131.stdout:2/357: dread f4 [0,4194304] 0 2024-02-15T18:31:33.189 INFO:tasks.workunit.client.1.smithi131.stdout:3/543: dread d2/d22/d29/db/d23/d2a/d49/f66 [0,4194304] 0 2024-02-15T18:31:33.189 INFO:tasks.workunit.client.1.smithi131.stdout:3/544: write d2/d22/d5e/d79/f98 [340904,7688] 0 2024-02-15T18:31:33.190 INFO:tasks.workunit.client.1.smithi131.stdout:2/358: write fb [868809,93407] 0 2024-02-15T18:31:33.192 INFO:tasks.workunit.client.1.smithi131.stdout:1/618: mkdir d0/d68/d80/ddc 0 2024-02-15T18:31:33.192 INFO:tasks.workunit.client.1.smithi131.stdout:1/619: write d0/d68/d80/fc7 [286429,46054] 0 2024-02-15T18:31:33.192 INFO:tasks.workunit.client.1.smithi131.stdout:8/391: dwrite d22/f30 [0,4194304] 0 2024-02-15T18:31:33.192 INFO:tasks.workunit.client.1.smithi131.stdout:8/392: readlink d22/d26/d3f/d47/d48/d5f/d70/l78 0 2024-02-15T18:31:33.193 INFO:tasks.workunit.client.1.smithi131.stdout:3/545: symlink d2/d22/d29/db/lac 0 2024-02-15T18:31:33.199 INFO:tasks.workunit.client.1.smithi131.stdout:2/359: unlink dd/d10/l4b 0 2024-02-15T18:31:33.199 INFO:tasks.workunit.client.1.smithi131.stdout:2/360: read - dd/d10/d22/d2f/d38/d74/d2e/f67 zero size 2024-02-15T18:31:33.200 INFO:tasks.workunit.client.1.smithi131.stdout:1/620: rename d0/d2/d4/da/f2c to d0/d68/fdd 0 2024-02-15T18:31:33.200 INFO:tasks.workunit.client.1.smithi131.stdout:1/621: stat d0/d2/d7/d72/d78 0 2024-02-15T18:31:33.203 INFO:tasks.workunit.client.1.smithi131.stdout:8/393: link d22/f27 d22/d26/f82 0 2024-02-15T18:31:33.203 INFO:tasks.workunit.client.1.smithi131.stdout:8/394: fsync d22/d26/f3b 0 2024-02-15T18:31:33.211 INFO:tasks.workunit.client.1.smithi131.stdout:3/546: creat d2/fad x:0 0 0 2024-02-15T18:31:33.212 INFO:tasks.workunit.client.1.smithi131.stdout:3/547: write d2/d22/d29/db/d1a/f68 [341443,90956] 0 2024-02-15T18:31:33.212 INFO:tasks.workunit.client.1.smithi131.stdout:3/548: read d2/d22/d29/d20/f8b [131137,108232] 0 2024-02-15T18:31:33.219 INFO:tasks.workunit.client.1.smithi131.stdout:2/361: link dd/d14/d1f/c42 dd/d1e/c76 0 2024-02-15T18:31:33.219 INFO:tasks.workunit.client.1.smithi131.stdout:2/362: chown dd/d10/d22/d2f/d38/d74/d2e/d6a/c63 11506 1 2024-02-15T18:31:33.222 INFO:tasks.workunit.client.1.smithi131.stdout:1/622: unlink d0/d1/d44/d59/d42/l58 0 2024-02-15T18:31:33.222 INFO:tasks.workunit.client.1.smithi131.stdout:1/623: chown d0/d1/d44/d59/fc6 469385 1 2024-02-15T18:31:33.222 INFO:tasks.workunit.client.1.smithi131.stdout:3/549: mkdir d2/d22/d29/d20/d86/dae 0 2024-02-15T18:31:33.222 INFO:tasks.workunit.client.1.smithi131.stdout:3/550: stat d2/d22/f72 0 2024-02-15T18:31:33.224 INFO:tasks.workunit.client.1.smithi131.stdout:8/395: dwrite d22/d41/f5d [0,4194304] 0 2024-02-15T18:31:33.224 INFO:tasks.workunit.client.1.smithi131.stdout:8/396: fsync d22/d41/f5d 0 2024-02-15T18:31:33.229 INFO:tasks.workunit.client.1.smithi131.stdout:3/551: link d2/d22/d3f/c5f d2/d22/d5e/caf 0 2024-02-15T18:31:33.229 INFO:tasks.workunit.client.1.smithi131.stdout:3/552: readlink d2/d22/d29/d20/l54 0 2024-02-15T18:31:33.229 INFO:tasks.workunit.client.1.smithi131.stdout:3/553: write d2/d22/d3f/fa0 [870261,6327] 0 2024-02-15T18:31:33.232 INFO:tasks.workunit.client.1.smithi131.stdout:8/397: symlink d22/d2e/d5e/l83 0 2024-02-15T18:31:33.235 INFO:tasks.workunit.client.1.smithi131.stdout:3/554: rename d2/d22/c62 to d2/d22/d29/d9e/cb0 0 2024-02-15T18:31:33.237 INFO:tasks.workunit.client.1.smithi131.stdout:8/398: mkdir d22/d26/d3f/d47/d48/d84 0 2024-02-15T18:31:33.239 INFO:tasks.workunit.client.1.smithi131.stdout:8/399: rename d22/d26/f3b to d22/d26/d3f/d47/d48/d5f/f85 0 2024-02-15T18:31:33.241 INFO:tasks.workunit.client.1.smithi131.stdout:8/400: mkdir d22/d26/d3f/d86 0 2024-02-15T18:31:33.241 INFO:tasks.workunit.client.1.smithi131.stdout:8/401: dread - d22/d2e/d60/f68 zero size 2024-02-15T18:31:33.242 INFO:tasks.workunit.client.1.smithi131.stdout:2/363: dwrite dd/d10/d22/d2a/f49 [0,4194304] 0 2024-02-15T18:31:33.243 INFO:tasks.workunit.client.1.smithi131.stdout:1/624: dwrite d0/d2/d7/f4c [0,4194304] 0 2024-02-15T18:31:33.243 INFO:tasks.workunit.client.1.smithi131.stdout:1/625: write d0/d2/dd6/f2e [1119995,46349] 0 2024-02-15T18:31:33.243 INFO:tasks.workunit.client.1.smithi131.stdout:1/626: dread - d0/d1/d44/d59/d42/dcf/da1/db3/fc1 zero size 2024-02-15T18:31:33.245 INFO:tasks.workunit.client.1.smithi131.stdout:8/402: link d22/d26/f55 d22/d2e/d60/f87 0 2024-02-15T18:31:33.245 INFO:tasks.workunit.client.1.smithi131.stdout:8/403: truncate d22/d2e/d5e/f75 693210 0 2024-02-15T18:31:33.245 INFO:tasks.workunit.client.1.smithi131.stdout:8/404: chown f17 95499 1 2024-02-15T18:31:33.251 INFO:tasks.workunit.client.1.smithi131.stdout:2/364: mkdir dd/d14/d1f/d65/d77 0 2024-02-15T18:31:33.254 INFO:tasks.workunit.client.1.smithi131.stdout:1/627: creat d0/d1/d24/d89/fde x:0 0 0 2024-02-15T18:31:33.258 INFO:tasks.workunit.client.1.smithi131.stdout:8/405: rename d22/d2e/f3a to d22/d26/d3f/d86/f88 0 2024-02-15T18:31:33.259 INFO:tasks.workunit.client.1.smithi131.stdout:3/555: dwrite d2/d22/d29/f91 [4194304,4194304] 0 2024-02-15T18:31:33.259 INFO:tasks.workunit.client.1.smithi131.stdout:3/556: chown d2/d22/d3a/c4c 3 1 2024-02-15T18:31:33.259 INFO:tasks.workunit.client.1.smithi131.stdout:3/557: fdatasync d2/f3c 0 2024-02-15T18:31:33.259 INFO:tasks.workunit.client.1.smithi131.stdout:3/558: truncate d2/d22/d5e/d79/f97 25506 0 2024-02-15T18:31:33.265 INFO:tasks.workunit.client.1.smithi131.stdout:1/628: dread d0/d2/d7/fb6 [0,4194304] 0 2024-02-15T18:31:33.275 INFO:tasks.workunit.client.1.smithi131.stdout:3/559: symlink d2/d22/d29/db/lb1 0 2024-02-15T18:31:33.281 INFO:tasks.workunit.client.1.smithi131.stdout:2/365: dwrite dd/f53 [4194304,4194304] 0 2024-02-15T18:31:33.282 INFO:tasks.workunit.client.1.smithi131.stdout:8/406: dwrite d22/f27 [4194304,4194304] 0 2024-02-15T18:31:33.283 INFO:tasks.workunit.client.1.smithi131.stdout:8/407: truncate d22/d26/d3f/f44 2228938 0 2024-02-15T18:31:33.283 INFO:tasks.workunit.client.1.smithi131.stdout:8/408: chown d22/d41/c54 1479538 1 2024-02-15T18:31:33.283 INFO:tasks.workunit.client.1.smithi131.stdout:3/560: dread d2/d22/d29/db/d1a/f11 [0,4194304] 0 2024-02-15T18:31:33.285 INFO:tasks.workunit.client.1.smithi131.stdout:1/629: dwrite d0/d1/d44/d59/d42/f5c [0,4194304] 0 2024-02-15T18:31:33.285 INFO:tasks.workunit.client.1.smithi131.stdout:1/630: chown d0/d1/d44/d59/la9 1058 1 2024-02-15T18:31:33.289 INFO:tasks.workunit.client.1.smithi131.stdout:2/366: unlink dd/d10/d22/d2f/d38/d74/d2e/c4f 0 2024-02-15T18:31:33.290 INFO:tasks.workunit.client.1.smithi131.stdout:2/367: read - dd/d10/d22/d2f/d38/d74/f5d zero size 2024-02-15T18:31:33.290 INFO:tasks.workunit.client.1.smithi131.stdout:2/368: write dd/d10/d22/d2f/d38/f70 [486988,127420] 0 2024-02-15T18:31:33.293 INFO:tasks.workunit.client.1.smithi131.stdout:2/369: dread f4 [0,4194304] 0 2024-02-15T18:31:33.294 INFO:tasks.workunit.client.1.smithi131.stdout:2/370: chown dd/d1e/c2d 0 1 2024-02-15T18:31:33.294 INFO:tasks.workunit.client.1.smithi131.stdout:3/561: creat d2/d22/d5e/fb2 x:0 0 0 2024-02-15T18:31:33.294 INFO:tasks.workunit.client.1.smithi131.stdout:2/371: write dd/d10/d22/d2f/d38/f50 [991350,90486] 0 2024-02-15T18:31:33.296 INFO:tasks.workunit.client.1.smithi131.stdout:8/409: dwrite d22/d26/d3f/d47/f6d [0,4194304] 0 2024-02-15T18:31:33.296 INFO:tasks.workunit.client.1.smithi131.stdout:8/410: write d22/d26/f4e [240181,97721] 0 2024-02-15T18:31:33.301 INFO:tasks.workunit.client.1.smithi131.stdout:1/631: creat d0/d1/d24/d89/fdf x:0 0 0 2024-02-15T18:31:33.301 INFO:tasks.workunit.client.1.smithi131.stdout:1/632: fsync d0/d2/f1c 0 2024-02-15T18:31:33.303 INFO:tasks.workunit.client.1.smithi131.stdout:3/562: getdents d2/d22/d29/d20 0 2024-02-15T18:31:33.305 INFO:tasks.workunit.client.1.smithi131.stdout:2/372: creat dd/d10/d22/d2f/d38/d74/d2e/d66/f78 x:0 0 0 2024-02-15T18:31:33.308 INFO:tasks.workunit.client.1.smithi131.stdout:8/411: creat d22/d26/d3f/d47/d48/f89 x:0 0 0 2024-02-15T18:31:33.309 INFO:tasks.workunit.client.1.smithi131.stdout:1/633: creat d0/d2/fe0 x:0 0 0 2024-02-15T18:31:33.309 INFO:tasks.workunit.client.1.smithi131.stdout:1/634: fsync d0/d2/d4/f32 0 2024-02-15T18:31:33.310 INFO:tasks.workunit.client.1.smithi131.stdout:1/635: read d0/d1/d44/d59/f6d [890613,78832] 0 2024-02-15T18:31:33.310 INFO:tasks.workunit.client.1.smithi131.stdout:1/636: readlink d0/d2/d7/d72/d78/lcd 0 2024-02-15T18:31:33.315 INFO:tasks.workunit.client.1.smithi131.stdout:3/563: getdents d2/d22/d3a 0 2024-02-15T18:31:33.315 INFO:tasks.workunit.client.1.smithi131.stdout:3/564: chown d2/d22/d29/d20/f37 23100025 1 2024-02-15T18:31:33.318 INFO:tasks.workunit.client.1.smithi131.stdout:2/373: mknod dd/d10/d22/d2a/c79 0 2024-02-15T18:31:33.320 INFO:tasks.workunit.client.1.smithi131.stdout:8/412: mknod d22/d26/d3f/c8a 0 2024-02-15T18:31:33.321 INFO:tasks.workunit.client.1.smithi131.stdout:1/637: link d0/d2/d7/d72/fd8 d0/d1/d16/fe1 0 2024-02-15T18:31:33.323 INFO:tasks.workunit.client.1.smithi131.stdout:3/565: link d2/d22/d29/db/d1a/f68 d2/d22/d3a/fb3 0 2024-02-15T18:31:33.324 INFO:tasks.workunit.client.1.smithi131.stdout:2/374: mkdir dd/d14/d1f/d65/d77/d7a 0 2024-02-15T18:31:33.325 INFO:tasks.workunit.client.1.smithi131.stdout:8/413: symlink d22/d26/d3f/d47/d48/d84/l8b 0 2024-02-15T18:31:33.325 INFO:tasks.workunit.client.1.smithi131.stdout:8/414: truncate d22/d26/f7b 785193 0 2024-02-15T18:31:33.326 INFO:tasks.workunit.client.1.smithi131.stdout:8/415: creat d22/d26/d3f/d47/d48/f8c x:0 0 0 2024-02-15T18:31:33.327 INFO:tasks.workunit.client.1.smithi131.stdout:3/566: dread d2/d22/f2e [0,4194304] 0 2024-02-15T18:31:33.329 INFO:tasks.workunit.client.1.smithi131.stdout:8/416: link d22/d26/d3f/d47/d57/c67 d22/d39/c8d 0 2024-02-15T18:31:33.329 INFO:tasks.workunit.client.1.smithi131.stdout:8/417: dread - d22/d26/d3f/d47/d48/f8c zero size 2024-02-15T18:31:33.329 INFO:tasks.workunit.client.1.smithi131.stdout:8/418: write d22/f3e [389611,76170] 0 2024-02-15T18:31:33.329 INFO:tasks.workunit.client.1.smithi131.stdout:8/419: stat d22/d26/d3f/c81 0 2024-02-15T18:31:33.330 INFO:tasks.workunit.client.1.smithi131.stdout:3/567: getdents d2/d22/d29/db/d1a 0 2024-02-15T18:31:33.332 INFO:tasks.workunit.client.1.smithi131.stdout:1/638: dread d0/d1/f38 [0,4194304] 0 2024-02-15T18:31:33.332 INFO:tasks.workunit.client.1.smithi131.stdout:8/420: truncate d22/d41/f49 1688963 0 2024-02-15T18:31:33.334 INFO:tasks.workunit.client.1.smithi131.stdout:7/622: sync 2024-02-15T18:31:33.334 INFO:tasks.workunit.client.1.smithi131.stdout:4/582: sync 2024-02-15T18:31:33.335 INFO:tasks.workunit.client.1.smithi131.stdout:7/623: write d0/d17/d3a/f63 [1088900,40660] 0 2024-02-15T18:31:33.335 INFO:tasks.workunit.client.1.smithi131.stdout:7/624: write d0/d17/d36/f81 [456370,124434] 0 2024-02-15T18:31:33.339 INFO:tasks.workunit.client.1.smithi131.stdout:3/568: creat d2/d22/d3f/fb4 x:0 0 0 2024-02-15T18:31:33.344 INFO:tasks.workunit.client.1.smithi131.stdout:4/583: mkdir d2/d7/d12/dd1 0 2024-02-15T18:31:33.344 INFO:tasks.workunit.client.1.smithi131.stdout:8/421: dread f17 [0,4194304] 0 2024-02-15T18:31:33.346 INFO:tasks.workunit.client.1.smithi131.stdout:4/584: mkdir d2/d2a/d47/d16/d5a/dd2 0 2024-02-15T18:31:33.349 INFO:tasks.workunit.client.1.smithi131.stdout:8/422: mkdir d22/d26/d3f/d47/d8e 0 2024-02-15T18:31:33.349 INFO:tasks.workunit.client.1.smithi131.stdout:8/423: fsync d22/d26/d3f/d47/d48/d5f/f72 0 2024-02-15T18:31:33.353 INFO:tasks.workunit.client.1.smithi131.stdout:4/585: symlink d2/d7/d12/d53/db9/ld3 0 2024-02-15T18:31:33.353 INFO:tasks.workunit.client.1.smithi131.stdout:4/586: chown d2/d7/d12/d2e/d5f 34553065 1 2024-02-15T18:31:33.356 INFO:tasks.workunit.client.1.smithi131.stdout:2/375: dwrite f4 [0,4194304] 0 2024-02-15T18:31:33.358 INFO:tasks.workunit.client.1.smithi131.stdout:8/424: symlink d22/d2e/d60/l8f 0 2024-02-15T18:31:33.360 INFO:tasks.workunit.client.1.smithi131.stdout:1/639: dwrite d0/d1/d16/d6b/fcc [0,4194304] 0 2024-02-15T18:31:33.361 INFO:tasks.workunit.client.1.smithi131.stdout:4/587: symlink d2/d2a/ld4 0 2024-02-15T18:31:33.361 INFO:tasks.workunit.client.1.smithi131.stdout:4/588: write d2/d7/d12/fa0 [663919,49570] 0 2024-02-15T18:31:33.362 INFO:tasks.workunit.client.1.smithi131.stdout:3/569: dwrite d2/f92 [0,4194304] 0 2024-02-15T18:31:33.363 INFO:tasks.workunit.client.1.smithi131.stdout:4/589: dread d2/d7/d12/d2e/d5f/d70/f87 [0,4194304] 0 2024-02-15T18:31:33.364 INFO:tasks.workunit.client.1.smithi131.stdout:8/425: creat d22/d2e/d60/f90 x:0 0 0 2024-02-15T18:31:33.364 INFO:tasks.workunit.client.1.smithi131.stdout:8/426: read d22/d26/d3f/d47/f6d [3329969,13908] 0 2024-02-15T18:31:33.365 INFO:tasks.workunit.client.1.smithi131.stdout:4/590: write d2/d7/d1c/f44 [3655393,97103] 0 2024-02-15T18:31:33.365 INFO:tasks.workunit.client.1.smithi131.stdout:4/591: dread - d2/d7/d12/d2e/fc1 zero size 2024-02-15T18:31:33.371 INFO:tasks.workunit.client.1.smithi131.stdout:1/640: creat d0/d2/d4/d41/fe2 x:0 0 0 2024-02-15T18:31:33.371 INFO:tasks.workunit.client.1.smithi131.stdout:1/641: fsync d0/d2/d7/f40 0 2024-02-15T18:31:33.371 INFO:tasks.workunit.client.1.smithi131.stdout:1/642: chown d0/d2/da8 166 1 2024-02-15T18:31:33.373 INFO:tasks.workunit.client.1.smithi131.stdout:3/570: creat d2/d22/d29/db/d1a/da4/d70/fb5 x:0 0 0 2024-02-15T18:31:33.376 INFO:tasks.workunit.client.1.smithi131.stdout:4/592: rename d2/d7/d12/d2e/d39/d4b/l59 to d2/d2a/d76/ld5 0 2024-02-15T18:31:33.376 INFO:tasks.workunit.client.1.smithi131.stdout:3/571: creat d2/d22/d3a/fb6 x:0 0 0 2024-02-15T18:31:33.378 INFO:tasks.workunit.client.1.smithi131.stdout:4/593: creat d2/d2a/d47/fd6 x:0 0 0 2024-02-15T18:31:33.379 INFO:tasks.workunit.client.1.smithi131.stdout:3/572: symlink d2/d22/d29/d20/d86/lb7 0 2024-02-15T18:31:33.379 INFO:tasks.workunit.client.1.smithi131.stdout:3/573: truncate d2/d22/d29/db/d23/f96 4476367 0 2024-02-15T18:31:33.379 INFO:tasks.workunit.client.1.smithi131.stdout:3/574: write d2/d22/d5e/fb2 [723662,68497] 0 2024-02-15T18:31:33.380 INFO:tasks.workunit.client.1.smithi131.stdout:4/594: symlink d2/d2a/d47/ld7 0 2024-02-15T18:31:33.385 INFO:tasks.workunit.client.1.smithi131.stdout:2/376: dwrite fc [0,4194304] 0 2024-02-15T18:31:33.385 INFO:tasks.workunit.client.1.smithi131.stdout:1/643: dread d0/d2/d7/f40 [0,4194304] 0 2024-02-15T18:31:33.386 INFO:tasks.workunit.client.1.smithi131.stdout:1/644: chown d0/d2/d7/f4c 961 1 2024-02-15T18:31:33.389 INFO:tasks.workunit.client.1.smithi131.stdout:3/575: rename d2/d22/d29/d20/l54 to d2/d22/d29/db/lb8 0 2024-02-15T18:31:33.392 INFO:tasks.workunit.client.1.smithi131.stdout:4/595: creat d2/d7/d1c/d5d/d7a/d92/fd8 x:0 0 0 2024-02-15T18:31:33.394 INFO:tasks.workunit.client.1.smithi131.stdout:2/377: truncate dd/f18 1298519 0 2024-02-15T18:31:33.394 INFO:tasks.workunit.client.1.smithi131.stdout:2/378: dread - dd/d14/f36 zero size 2024-02-15T18:31:33.394 INFO:tasks.workunit.client.1.smithi131.stdout:1/645: symlink d0/d2/d7/le3 0 2024-02-15T18:31:33.395 INFO:tasks.workunit.client.1.smithi131.stdout:1/646: truncate d0/d2/fe0 578366 0 2024-02-15T18:31:33.395 INFO:tasks.workunit.client.1.smithi131.stdout:3/576: rmdir d2/d22/d29/db/d1a 39 2024-02-15T18:31:33.395 INFO:tasks.workunit.client.1.smithi131.stdout:3/577: dread - d2/d22/d42/fa8 zero size 2024-02-15T18:31:33.396 INFO:tasks.workunit.client.1.smithi131.stdout:1/647: symlink d0/d2/d4/d41/d5a/le4 0 2024-02-15T18:31:33.400 INFO:tasks.workunit.client.1.smithi131.stdout:3/578: creat d2/d22/d29/db/d1a/da4/fb9 x:0 0 0 2024-02-15T18:31:33.405 INFO:tasks.workunit.client.1.smithi131.stdout:4/596: dread d2/d2a/d68/f6b [0,4194304] 0 2024-02-15T18:31:33.409 INFO:tasks.workunit.client.1.smithi131.stdout:3/579: truncate d2/d22/d3a/fb3 1362266 0 2024-02-15T18:31:33.410 INFO:tasks.workunit.client.1.smithi131.stdout:3/580: write d2/f3c [5509224,109291] 0 2024-02-15T18:31:33.411 INFO:tasks.workunit.client.1.smithi131.stdout:4/597: mknod d2/d7/d12/d2e/d39/d4b/cd9 0 2024-02-15T18:31:33.412 INFO:tasks.workunit.client.1.smithi131.stdout:3/581: getdents d2/d22/d29/db/d23 0 2024-02-15T18:31:33.415 INFO:tasks.workunit.client.1.smithi131.stdout:1/648: dwrite d0/d2/d4/faa [0,4194304] 0 2024-02-15T18:31:33.418 INFO:tasks.workunit.client.1.smithi131.stdout:1/649: mkdir d0/d1/d16/d6b/de5 0 2024-02-15T18:31:33.418 INFO:tasks.workunit.client.1.smithi131.stdout:1/650: write d0/d2/d7/d72/fd8 [1027394,56120] 0 2024-02-15T18:31:33.421 INFO:tasks.workunit.client.1.smithi131.stdout:2/379: dread dd/d10/f19 [0,4194304] 0 2024-02-15T18:31:33.421 INFO:tasks.workunit.client.1.smithi131.stdout:3/582: dread d2/d22/d5e/d79/f98 [0,4194304] 0 2024-02-15T18:31:33.426 INFO:tasks.workunit.client.1.smithi131.stdout:1/651: rename d0/d1/d44/d59/d42/dcf/da1 to d0/d2/db/de6 0 2024-02-15T18:31:33.429 INFO:tasks.workunit.client.1.smithi131.stdout:3/583: rmdir d2/d22/d42 39 2024-02-15T18:31:33.429 INFO:tasks.workunit.client.1.smithi131.stdout:3/584: chown d2/d22/d29/c2c 1685800 1 2024-02-15T18:31:33.434 INFO:tasks.workunit.client.1.smithi131.stdout:5/535: sync 2024-02-15T18:31:33.434 INFO:tasks.workunit.client.1.smithi131.stdout:5/536: chown d18/c25 678922 1 2024-02-15T18:31:33.436 INFO:tasks.workunit.client.1.smithi131.stdout:1/652: dread d0/d1/d24/f2f [0,4194304] 0 2024-02-15T18:31:33.439 INFO:tasks.workunit.client.1.smithi131.stdout:5/537: mknod d18/d24/d7b/cb0 0 2024-02-15T18:31:33.439 INFO:tasks.workunit.client.1.smithi131.stdout:1/653: stat d0/cd 0 2024-02-15T18:31:33.440 INFO:tasks.workunit.client.1.smithi131.stdout:1/654: rmdir d0/d2/dd6/d9b/da4 0 2024-02-15T18:31:33.440 INFO:tasks.workunit.client.1.smithi131.stdout:3/585: dread d2/d22/d29/db/f1d [0,4194304] 0 2024-02-15T18:31:33.445 INFO:tasks.workunit.client.1.smithi131.stdout:1/655: creat d0/d1/d16/dd1/fe7 x:0 0 0 2024-02-15T18:31:33.445 INFO:tasks.workunit.client.1.smithi131.stdout:3/586: getdents d2/d22 0 2024-02-15T18:31:33.446 INFO:tasks.workunit.client.1.smithi131.stdout:3/587: chown d2/d22/d29/db/d1a/da4/d70 231 1 2024-02-15T18:31:33.446 INFO:tasks.workunit.client.1.smithi131.stdout:3/588: read d2/d22/f35 [91454,127273] 0 2024-02-15T18:31:33.446 INFO:tasks.workunit.client.1.smithi131.stdout:1/656: truncate d0/d2/d31/d3d/f6a 523104 0 2024-02-15T18:31:33.448 INFO:tasks.workunit.client.1.smithi131.stdout:6/475: sync 2024-02-15T18:31:33.448 INFO:tasks.workunit.client.1.smithi131.stdout:9/669: sync 2024-02-15T18:31:33.448 INFO:tasks.workunit.client.1.smithi131.stdout:0/395: sync 2024-02-15T18:31:33.450 INFO:tasks.workunit.client.1.smithi131.stdout:3/589: rmdir d2/d22/d29/db/d23/d2a 39 2024-02-15T18:31:33.450 INFO:tasks.workunit.client.1.smithi131.stdout:1/657: rmdir d0/d2/d7/d72/dbb 39 2024-02-15T18:31:33.450 INFO:tasks.workunit.client.1.smithi131.stdout:1/658: stat d0/d1/d44/f70 0 2024-02-15T18:31:33.452 INFO:tasks.workunit.client.1.smithi131.stdout:3/590: rename d2/fad to d2/d22/d29/d9e/fba 0 2024-02-15T18:31:33.452 INFO:tasks.workunit.client.1.smithi131.stdout:3/591: fdatasync d2/d22/d29/db/d23/d2a/d5b/f71 0 2024-02-15T18:31:33.454 INFO:tasks.workunit.client.1.smithi131.stdout:1/659: creat d0/d2/d4/d41/dc3/fe8 x:0 0 0 2024-02-15T18:31:33.459 INFO:tasks.workunit.client.1.smithi131.stdout:3/592: symlink d2/d22/d29/db/d1a/da4/d70/lbb 0 2024-02-15T18:31:33.461 INFO:tasks.workunit.client.1.smithi131.stdout:3/593: rmdir d2/d22/d5e 39 2024-02-15T18:31:33.463 INFO:tasks.workunit.client.1.smithi131.stdout:3/594: symlink d2/d22/lbc 0 2024-02-15T18:31:33.464 INFO:tasks.workunit.client.1.smithi131.stdout:3/595: write d2/d22/d29/db/d1a/f68 [2396782,41492] 0 2024-02-15T18:31:33.465 INFO:tasks.workunit.client.1.smithi131.stdout:3/596: symlink d2/d22/d29/db/d23/lbd 0 2024-02-15T18:31:33.465 INFO:tasks.workunit.client.1.smithi131.stdout:3/597: chown d2/d22/d29/db/d23/d2a/f2d 5192 1 2024-02-15T18:31:33.476 INFO:tasks.workunit.client.1.smithi131.stdout:3/598: dread d2/d22/d42/f45 [0,4194304] 0 2024-02-15T18:31:33.478 INFO:tasks.workunit.client.1.smithi131.stdout:3/599: creat d2/d22/d29/db/d23/d2a/fbe x:0 0 0 2024-02-15T18:31:33.480 INFO:tasks.workunit.client.1.smithi131.stdout:3/600: rename d2/d22/d29/db/d1a/l25 to d2/d22/d29/d20/lbf 0 2024-02-15T18:31:33.482 INFO:tasks.workunit.client.1.smithi131.stdout:3/601: creat d2/d22/fc0 x:0 0 0 2024-02-15T18:31:33.484 INFO:tasks.workunit.client.1.smithi131.stdout:3/602: creat d2/d22/d29/d20/d86/fc1 x:0 0 0 2024-02-15T18:31:33.488 INFO:tasks.workunit.client.1.smithi131.stdout:3/603: dread d2/d22/d29/db/d1a/da4/d70/fa1 [0,4194304] 0 2024-02-15T18:31:33.488 INFO:tasks.workunit.client.1.smithi131.stdout:3/604: truncate d2/d22/d29/f7e 1616121 0 2024-02-15T18:31:33.488 INFO:tasks.workunit.client.1.smithi131.stdout:3/605: readlink d2/d22/l88 0 2024-02-15T18:31:33.491 INFO:tasks.workunit.client.1.smithi131.stdout:3/606: unlink d2/f3c 0 2024-02-15T18:31:33.500 INFO:tasks.workunit.client.1.smithi131.stdout:3/607: dread d2/d22/d29/db/d1a/da4/f64 [0,4194304] 0 2024-02-15T18:31:33.500 INFO:tasks.workunit.client.1.smithi131.stdout:9/670: dwrite d4/dc/de/d1e/d1f/d2c/f4b [0,4194304] 0 2024-02-15T18:31:33.500 INFO:tasks.workunit.client.1.smithi131.stdout:6/476: dwrite d2/dc/d1f/f70 [0,4194304] 0 2024-02-15T18:31:33.500 INFO:tasks.workunit.client.1.smithi131.stdout:6/477: chown d2/d7/d48/f44 1453569 1 2024-02-15T18:31:33.501 INFO:tasks.workunit.client.1.smithi131.stdout:0/396: dwrite d5/f68 [0,4194304] 0 2024-02-15T18:31:33.501 INFO:tasks.workunit.client.1.smithi131.stdout:1/660: dwrite d0/d1/d24/f2f [0,4194304] 0 2024-02-15T18:31:33.504 INFO:tasks.workunit.client.1.smithi131.stdout:3/608: write d2/d22/d29/db/f1d [741557,69751] 0 2024-02-15T18:31:33.514 INFO:tasks.workunit.client.1.smithi131.stdout:6/478: creat d2/dc/d1f/f96 x:0 0 0 2024-02-15T18:31:33.514 INFO:tasks.workunit.client.1.smithi131.stdout:6/479: chown d2/dc/d1f/l32 32331 1 2024-02-15T18:31:33.516 INFO:tasks.workunit.client.1.smithi131.stdout:0/397: getdents d5/d15/d1f 0 2024-02-15T18:31:33.519 INFO:tasks.workunit.client.1.smithi131.stdout:1/661: symlink d0/d1/d24/le9 0 2024-02-15T18:31:33.519 INFO:tasks.workunit.client.1.smithi131.stdout:1/662: fdatasync d0/d2/d4/d41/fe2 0 2024-02-15T18:31:33.520 INFO:tasks.workunit.client.1.smithi131.stdout:9/671: dwrite d4/dc/d25/d3f/d81/d5b/fba [0,4194304] 0 2024-02-15T18:31:33.520 INFO:tasks.workunit.client.1.smithi131.stdout:3/609: creat d2/d22/d3f/fc2 x:0 0 0 2024-02-15T18:31:33.520 INFO:tasks.workunit.client.1.smithi131.stdout:3/610: dread - d2/d22/d3f/fb4 zero size 2024-02-15T18:31:33.530 INFO:tasks.workunit.client.1.smithi131.stdout:6/480: unlink d2/d7/d48/d40/l50 0 2024-02-15T18:31:33.531 INFO:tasks.workunit.client.1.smithi131.stdout:1/663: creat d0/d1/d44/fea x:0 0 0 2024-02-15T18:31:33.533 INFO:tasks.workunit.client.1.smithi131.stdout:9/672: rename d4/dc/de/d1e/d1f/d51/d7f/fae to d4/dc/d25/d3f/d81/fda 0 2024-02-15T18:31:33.534 INFO:tasks.workunit.client.1.smithi131.stdout:9/673: read d4/d78/fa1 [3166993,28008] 0 2024-02-15T18:31:33.534 INFO:tasks.workunit.client.1.smithi131.stdout:9/674: truncate d4/d78/fcd 277484 0 2024-02-15T18:31:33.535 INFO:tasks.workunit.client.1.smithi131.stdout:9/675: write d4/dc/d25/d3f/f66 [4844214,100500] 0 2024-02-15T18:31:33.535 INFO:tasks.workunit.client.1.smithi131.stdout:9/676: stat d4/dc/de/d1e/d1f/d51/lb5 0 2024-02-15T18:31:33.536 INFO:tasks.workunit.client.1.smithi131.stdout:0/398: dwrite d5/d15/d1f/f57 [0,4194304] 0 2024-02-15T18:31:33.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/664: creat d0/d2/d31/d3d/feb x:0 0 0 2024-02-15T18:31:33.539 INFO:tasks.workunit.client.1.smithi131.stdout:6/481: dread d2/dc/d1f/f8e [0,4194304] 0 2024-02-15T18:31:33.539 INFO:tasks.workunit.client.1.smithi131.stdout:3/611: mkdir d2/d22/d29/db/d1a/dc3 0 2024-02-15T18:31:33.539 INFO:tasks.workunit.client.1.smithi131.stdout:3/612: fsync d2/d22/d29/db/d23/d2a/fbe 0 2024-02-15T18:31:33.539 INFO:tasks.workunit.client.1.smithi131.stdout:3/613: readlink d2/d22/d3f/l69 0 2024-02-15T18:31:33.540 INFO:tasks.workunit.client.1.smithi131.stdout:9/677: mknod d4/dc/de/d1e/d1f/d51/d5d/d71/cdb 0 2024-02-15T18:31:33.547 INFO:tasks.workunit.client.1.smithi131.stdout:0/399: mkdir d5/d2f/d4b/d82 0 2024-02-15T18:31:33.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/482: rename d2/d7/d16 to d2/dc/d27/d62/d97 0 2024-02-15T18:31:33.554 INFO:tasks.workunit.client.1.smithi131.stdout:3/614: rmdir d2/d22/d29/d20/d86/dae 0 2024-02-15T18:31:33.559 INFO:tasks.workunit.client.1.smithi131.stdout:6/483: creat d2/dc/d27/d62/d97/f98 x:0 0 0 2024-02-15T18:31:33.559 INFO:tasks.workunit.client.1.smithi131.stdout:6/484: fsync d2/f42 0 2024-02-15T18:31:33.561 INFO:tasks.workunit.client.1.smithi131.stdout:0/400: rename d5/d2f/c39 to d5/d9/d77/c83 0 2024-02-15T18:31:33.562 INFO:tasks.workunit.client.1.smithi131.stdout:3/615: link d2/d22/d29/db/d23/c48 d2/d22/d29/cc4 0 2024-02-15T18:31:33.562 INFO:tasks.workunit.client.1.smithi131.stdout:3/616: fsync d2/d22/d29/f91 0 2024-02-15T18:31:33.563 INFO:tasks.workunit.client.1.smithi131.stdout:3/617: write d2/d22/d29/db/d1a/da4/d70/fb5 [465501,10784] 0 2024-02-15T18:31:33.563 INFO:tasks.workunit.client.1.smithi131.stdout:3/618: fdatasync d2/d22/f2e 0 2024-02-15T18:31:33.564 INFO:tasks.workunit.client.1.smithi131.stdout:1/665: dwrite d0/d2/d7/d72/f97 [4194304,4194304] 0 2024-02-15T18:31:33.566 INFO:tasks.workunit.client.1.smithi131.stdout:6/485: rmdir d2/dc/d27/d62 39 2024-02-15T18:31:33.567 INFO:tasks.workunit.client.1.smithi131.stdout:9/678: dwrite d4/dc/d25/d3f/d81/f86 [0,4194304] 0 2024-02-15T18:31:33.567 INFO:tasks.workunit.client.1.smithi131.stdout:9/679: stat d4/dc/d25/d4e/d38/f44 0 2024-02-15T18:31:33.569 INFO:tasks.workunit.client.1.smithi131.stdout:0/401: creat d5/d2f/f84 x:0 0 0 2024-02-15T18:31:33.571 INFO:tasks.workunit.client.1.smithi131.stdout:3/619: mknod d2/d22/d29/db/d1a/da4/cc5 0 2024-02-15T18:31:33.571 INFO:tasks.workunit.client.1.smithi131.stdout:0/402: write d5/d9/d11/f30 [3996227,80086] 0 2024-02-15T18:31:33.580 INFO:tasks.workunit.client.1.smithi131.stdout:1/666: symlink d0/d2/d31/d3d/d46/lec 0 2024-02-15T18:31:33.582 INFO:tasks.workunit.client.1.smithi131.stdout:9/680: mkdir d4/dc/d17/d19/d32/dc2/ddc 0 2024-02-15T18:31:33.583 INFO:tasks.workunit.client.1.smithi131.stdout:6/486: truncate d2/d36/f3c 4124866 0 2024-02-15T18:31:33.586 INFO:tasks.workunit.client.1.smithi131.stdout:0/403: mknod d5/d2f/d45/c85 0 2024-02-15T18:31:33.595 INFO:tasks.workunit.client.1.smithi131.stdout:6/487: rename d2/d36/f4c to d2/dc/d27/d78/f99 0 2024-02-15T18:31:33.595 INFO:tasks.workunit.client.1.smithi131.stdout:9/681: dread d4/dc/d25/d3f/d81/d72/fa8 [0,4194304] 0 2024-02-15T18:31:33.595 INFO:tasks.workunit.client.1.smithi131.stdout:9/682: readlink d4/dc/l24 0 2024-02-15T18:31:33.597 INFO:tasks.workunit.client.1.smithi131.stdout:6/488: creat d2/d7/d12/d4d/f9a x:0 0 0 2024-02-15T18:31:33.597 INFO:tasks.workunit.client.1.smithi131.stdout:0/404: dread f0 [0,4194304] 0 2024-02-15T18:31:33.597 INFO:tasks.workunit.client.1.smithi131.stdout:0/405: write d5/d9/d10/f1e [3097984,131019] 0 2024-02-15T18:31:33.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/683: symlink d4/dc/d17/d19/d32/ldd 0 2024-02-15T18:31:33.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/684: readlink d4/dc/d25/d4e/d38/lb2 0 2024-02-15T18:31:33.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/685: fdatasync d4/d78/fcd 0 2024-02-15T18:31:33.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/686: readlink d4/dc/d25/l6c 0 2024-02-15T18:31:33.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/687: readlink d4/dc/d17/d19/d84/lce 0 2024-02-15T18:31:33.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/688: chown d4/dc/de/c93 7896 1 2024-02-15T18:31:33.600 INFO:tasks.workunit.client.1.smithi131.stdout:3/620: dwrite d2/d22/d29/d20/f6d [4194304,4194304] 0 2024-02-15T18:31:33.600 INFO:tasks.workunit.client.1.smithi131.stdout:3/621: readlink d2/d22/d29/db/d34/l99 0 2024-02-15T18:31:33.600 INFO:tasks.workunit.client.1.smithi131.stdout:3/622: fsync d2/d22/d5e/d79/fa2 0 2024-02-15T18:31:33.600 INFO:tasks.workunit.client.1.smithi131.stdout:9/689: write d4/dc/d17/db0/dbc/f95 [3310547,60706] 0 2024-02-15T18:31:33.601 INFO:tasks.workunit.client.1.smithi131.stdout:1/667: dwrite d0/d2/d4/da/f1f [4194304,4194304] 0 2024-02-15T18:31:33.615 INFO:tasks.workunit.client.1.smithi131.stdout:0/406: dread d5/d9/d10/d3f/f7f [4194304,4194304] 0 2024-02-15T18:31:33.618 INFO:tasks.workunit.client.1.smithi131.stdout:3/623: truncate d2/d22/d29/f39 1755238 0 2024-02-15T18:31:33.619 INFO:tasks.workunit.client.1.smithi131.stdout:0/407: creat d5/d9/d10/f86 x:0 0 0 2024-02-15T18:31:33.620 INFO:tasks.workunit.client.1.smithi131.stdout:0/408: truncate d5/d9/d4d/f63 783482 0 2024-02-15T18:31:33.622 INFO:tasks.workunit.client.1.smithi131.stdout:3/624: getdents d2/d22/d29/db/d1a 0 2024-02-15T18:31:33.626 INFO:tasks.workunit.client.1.smithi131.stdout:3/625: creat d2/d22/d29/d9e/fc6 x:0 0 0 2024-02-15T18:31:33.626 INFO:tasks.workunit.client.1.smithi131.stdout:3/626: fsync d2/d22/d29/f17 0 2024-02-15T18:31:33.626 INFO:tasks.workunit.client.1.smithi131.stdout:3/627: chown d2/d22/d29/db/d23/d2a 0 1 2024-02-15T18:31:33.628 INFO:tasks.workunit.client.1.smithi131.stdout:3/628: getdents d2/d22/d5e/d79 0 2024-02-15T18:31:33.629 INFO:tasks.workunit.client.1.smithi131.stdout:3/629: rmdir d2/d22/d29/d20 39 2024-02-15T18:31:33.629 INFO:tasks.workunit.client.1.smithi131.stdout:3/630: write d2/d22/d29/db/d1a/da4/faa [630187,82540] 0 2024-02-15T18:31:33.632 INFO:tasks.workunit.client.1.smithi131.stdout:3/631: creat d2/d22/d29/db/d1a/da4/d8d/fc7 x:0 0 0 2024-02-15T18:31:33.633 INFO:tasks.workunit.client.1.smithi131.stdout:3/632: getdents d2/d22/d29/d20 0 2024-02-15T18:31:33.635 INFO:tasks.workunit.client.1.smithi131.stdout:6/489: dwrite d2/dc/f5f [0,4194304] 0 2024-02-15T18:31:33.636 INFO:tasks.workunit.client.1.smithi131.stdout:3/633: symlink d2/d22/d29/db/d1a/da4/d85/lc8 0 2024-02-15T18:31:33.638 INFO:tasks.workunit.client.1.smithi131.stdout:3/634: symlink d2/d22/d5e/d79/lc9 0 2024-02-15T18:31:33.639 INFO:tasks.workunit.client.1.smithi131.stdout:3/635: creat d2/d22/d5e/fca x:0 0 0 2024-02-15T18:31:33.640 INFO:tasks.workunit.client.1.smithi131.stdout:3/636: link d2/d22/lbc d2/d22/d29/db/lcb 0 2024-02-15T18:31:33.642 INFO:tasks.workunit.client.1.smithi131.stdout:3/637: rename d2/d22/d29/d20/f6d to d2/d22/d29/d20/d86/fcc 0 2024-02-15T18:31:33.648 INFO:tasks.workunit.client.1.smithi131.stdout:1/668: dwrite d0/d1/d44/fea [0,4194304] 0 2024-02-15T18:31:33.649 INFO:tasks.workunit.client.1.smithi131.stdout:9/690: dwrite d4/dc/f56 [4194304,4194304] 0 2024-02-15T18:31:33.650 INFO:tasks.workunit.client.1.smithi131.stdout:0/409: dwrite d5/d15/d1f/f46 [0,4194304] 0 2024-02-15T18:31:33.651 INFO:tasks.workunit.client.1.smithi131.stdout:9/691: read d4/dc/de/d1e/f61 [710799,72334] 0 2024-02-15T18:31:33.651 INFO:tasks.workunit.client.1.smithi131.stdout:6/490: write d2/d7/d12/d4d/f52 [543627,114218] 0 2024-02-15T18:31:33.656 INFO:tasks.workunit.client.1.smithi131.stdout:1/669: mkdir d0/d1/d44/ded 0 2024-02-15T18:31:33.656 INFO:tasks.workunit.client.1.smithi131.stdout:1/670: rename d0 to d0/d68/d80/dee 22 2024-02-15T18:31:33.667 INFO:tasks.workunit.client.1.smithi131.stdout:0/410: dread d5/d9/d10/d3f/f47 [4194304,4194304] 0 2024-02-15T18:31:33.667 INFO:tasks.workunit.client.1.smithi131.stdout:3/638: dwrite d2/d22/d29/db/fa9 [0,4194304] 0 2024-02-15T18:31:33.670 INFO:tasks.workunit.client.1.smithi131.stdout:9/692: unlink d4/dc/de/d1e/d1f/d2c/f6a 0 2024-02-15T18:31:33.670 INFO:tasks.workunit.client.1.smithi131.stdout:9/693: fdatasync d4/dc/d25/d3f/fd9 0 2024-02-15T18:31:33.670 INFO:tasks.workunit.client.1.smithi131.stdout:6/491: truncate d2/d7/d48/f44 985863 0 2024-02-15T18:31:33.674 INFO:tasks.workunit.client.1.smithi131.stdout:1/671: creat d0/d1/d16/fef x:0 0 0 2024-02-15T18:31:33.677 INFO:tasks.workunit.client.1.smithi131.stdout:9/694: write d4/dc/d17/d19/f82 [1151584,120531] 0 2024-02-15T18:31:33.677 INFO:tasks.workunit.client.1.smithi131.stdout:9/695: truncate d4/dc/d25/d3f/d81/d5b/f87 5194347 0 2024-02-15T18:31:33.680 INFO:tasks.workunit.client.1.smithi131.stdout:6/492: creat d2/f9b x:0 0 0 2024-02-15T18:31:33.687 INFO:tasks.workunit.client.1.smithi131.stdout:9/696: truncate d4/dc/d25/d4e/d8a/f8d 1180655 0 2024-02-15T18:31:33.687 INFO:tasks.workunit.client.1.smithi131.stdout:9/697: chown d4/dc/d25/d3f/f66 36997059 1 2024-02-15T18:31:33.699 INFO:tasks.workunit.client.1.smithi131.stdout:9/698: mknod d4/dc/de/d1e/d1f/d51/d5d/cde 0 2024-02-15T18:31:33.749 INFO:tasks.workunit.client.1.smithi131.stdout:9/699: write d4/dc/d25/d3f/d81/f86 [2087456,18247] 0 2024-02-15T18:31:33.749 INFO:tasks.workunit.client.1.smithi131.stdout:9/700: creat d4/dc/d17/d19/d84/fdf x:0 0 0 2024-02-15T18:31:33.749 INFO:tasks.workunit.client.1.smithi131.stdout:9/701: chown d4/dc/d25/d4e/d8a 80 1 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/702: unlink d4/d78/fa1 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/703: read d4/dc/de/d1e/f61 [691904,113585] 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/704: symlink d4/dc/d25/d4e/d8a/le0 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/705: read d4/d78/fcd [57803,53333] 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/706: read d4/dc/de/d1e/d1f/f3a [2180479,7751] 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/707: rename d4/dc/d25/f40 to d4/dc/d17/db0/dbc/fe1 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/708: rename d4/dc/de/d1e/d1f/d51/d7f/f8c to d4/dc/d17/d19/d32/d91/db3/fe2 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/709: chown d4/dc/d17/d19/d32/dc2/f7a 88399 1 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/710: dread - d4/dc/de/d1e/d1f/d51/d5d/fd3 zero size 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/711: write d4/dc/d25/d4e/d38/f44 [2069007,116292] 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/712: truncate d4/dc/de/d1e/d1f/fd6 385247 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/713: mkdir d4/dc/de/d1e/d1f/de3 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/714: dread d4/dc/d17/d19/d32/dc2/f7a [0,4194304] 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:3/639: dwrite d2/d22/d29/db/d1a/fe [0,4194304] 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/715: dread d4/dc/de/d1e/d1f/d51/f77 [0,4194304] 0 2024-02-15T18:31:33.750 INFO:tasks.workunit.client.1.smithi131.stdout:3/640: write d2/d22/f72 [3753118,82453] 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:6/493: dwrite d2/d36/f5a [0,4194304] 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:3/641: fdatasync d2/d22/d5e/fca 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:1/672: dwrite d0/d1/d16/fe1 [0,4194304] 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:0/411: dwrite d5/d15/f60 [0,4194304] 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:0/412: write d5/d9/d11/d3e/f59 [641939,118564] 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:3/642: creat d2/d22/fcd x:0 0 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:3/643: readlink d2/d22/lbc 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:6/494: creat d2/d2b/f9c x:0 0 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:1/673: rename d0/d68/cb8 to d0/d2/db/de6/db3/cf0 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:9/716: dwrite d4/dc/d25/d4e/d8a/f9c [0,4194304] 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:9/717: chown d4/dc/de/d1e/d1f/de3 226929467 1 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:9/718: fsync d4/dc/d17/d19/d32/f48 0 2024-02-15T18:31:33.751 INFO:tasks.workunit.client.1.smithi131.stdout:1/674: read d0/d2/f1c [9596,93655] 0 2024-02-15T18:31:33.752 INFO:tasks.workunit.client.1.smithi131.stdout:0/413: creat d5/d2f/d4b/f87 x:0 0 0 2024-02-15T18:31:33.759 INFO:tasks.workunit.client.1.smithi131.stdout:3/644: creat d2/fce x:0 0 0 2024-02-15T18:31:33.759 INFO:tasks.workunit.client.1.smithi131.stdout:3/645: fsync d2/d22/d29/d9e/fc6 0 2024-02-15T18:31:33.765 INFO:tasks.workunit.client.1.smithi131.stdout:6/495: truncate d2/d2b/d6e/f7c 673758 0 2024-02-15T18:31:33.766 INFO:tasks.workunit.client.1.smithi131.stdout:1/675: link d0/d2/d7/f4c d0/d2/db/dac/ff1 0 2024-02-15T18:31:33.767 INFO:tasks.workunit.client.1.smithi131.stdout:3/646: creat d2/d22/d5e/fcf x:0 0 0 2024-02-15T18:31:33.768 INFO:tasks.workunit.client.1.smithi131.stdout:6/496: creat d2/d36/f9d x:0 0 0 2024-02-15T18:31:33.774 INFO:tasks.workunit.client.1.smithi131.stdout:7/625: sync 2024-02-15T18:31:33.774 INFO:tasks.workunit.client.1.smithi131.stdout:7/626: read d0/d17/d3a/f91 [843559,6606] 0 2024-02-15T18:31:33.778 INFO:tasks.workunit.client.1.smithi131.stdout:3/647: rename d2/d22/d29/db/c81 to d2/d22/d29/db/d1a/da4/d8d/cd0 0 2024-02-15T18:31:33.783 INFO:tasks.workunit.client.1.smithi131.stdout:7/627: dread d0/d17/d36/f4c [0,4194304] 0 2024-02-15T18:31:33.785 INFO:tasks.workunit.client.1.smithi131.stdout:7/628: symlink d0/d34/lc3 0 2024-02-15T18:31:33.788 INFO:tasks.workunit.client.1.smithi131.stdout:7/629: mknod d0/d17/d3a/cc4 0 2024-02-15T18:31:33.790 INFO:tasks.workunit.client.1.smithi131.stdout:7/630: rename d0/d17/d3a/d3d/d79/d89/cb5 to d0/d17/d3a/d3d/cc5 0 2024-02-15T18:31:33.791 INFO:tasks.workunit.client.1.smithi131.stdout:8/427: sync 2024-02-15T18:31:33.791 INFO:tasks.workunit.client.1.smithi131.stdout:5/538: sync 2024-02-15T18:31:33.791 INFO:tasks.workunit.client.1.smithi131.stdout:8/428: chown d22/d2e/l43 1783537 1 2024-02-15T18:31:33.791 INFO:tasks.workunit.client.1.smithi131.stdout:8/429: fdatasync f1d 0 2024-02-15T18:31:33.792 INFO:tasks.workunit.client.1.smithi131.stdout:2/380: sync 2024-02-15T18:31:33.792 INFO:tasks.workunit.client.1.smithi131.stdout:4/598: sync 2024-02-15T18:31:33.792 INFO:tasks.workunit.client.1.smithi131.stdout:5/539: creat d18/d6d/fb1 x:0 0 0 2024-02-15T18:31:33.792 INFO:tasks.workunit.client.1.smithi131.stdout:5/540: write d18/d24/d7b/f84 [1485381,120415] 0 2024-02-15T18:31:33.793 INFO:tasks.workunit.client.1.smithi131.stdout:8/430: creat d22/d26/d3f/d86/f91 x:0 0 0 2024-02-15T18:31:33.793 INFO:tasks.workunit.client.1.smithi131.stdout:8/431: dread - d22/d26/f76 zero size 2024-02-15T18:31:33.794 INFO:tasks.workunit.client.1.smithi131.stdout:2/381: symlink dd/d14/l7b 0 2024-02-15T18:31:33.799 INFO:tasks.workunit.client.1.smithi131.stdout:3/648: dread d2/d22/d29/db/d34/f8a [0,4194304] 0 2024-02-15T18:31:33.799 INFO:tasks.workunit.client.1.smithi131.stdout:3/649: dread - d2/d22/d5e/d79/fa2 zero size 2024-02-15T18:31:33.799 INFO:tasks.workunit.client.1.smithi131.stdout:5/541: symlink d18/d33/lb2 0 2024-02-15T18:31:33.799 INFO:tasks.workunit.client.1.smithi131.stdout:2/382: creat dd/d10/d22/d2f/d38/f7c x:0 0 0 2024-02-15T18:31:33.800 INFO:tasks.workunit.client.1.smithi131.stdout:3/650: mkdir d2/d22/d29/db/dd1 0 2024-02-15T18:31:33.802 INFO:tasks.workunit.client.1.smithi131.stdout:8/432: write d22/d26/d3f/d47/f6a [40252,117640] 0 2024-02-15T18:31:33.803 INFO:tasks.workunit.client.1.smithi131.stdout:5/542: creat d18/d6d/d70/fb3 x:0 0 0 2024-02-15T18:31:33.803 INFO:tasks.workunit.client.1.smithi131.stdout:2/383: dread - dd/d10/d22/d2f/d38/d74/d2e/f67 zero size 2024-02-15T18:31:33.803 INFO:tasks.workunit.client.1.smithi131.stdout:5/543: chown d18/d20/f2e 1365 1 2024-02-15T18:31:33.805 INFO:tasks.workunit.client.1.smithi131.stdout:7/631: dread d0/d34/f8d [0,4194304] 0 2024-02-15T18:31:33.805 INFO:tasks.workunit.client.1.smithi131.stdout:7/632: readlink d0/da9/lb0 0 2024-02-15T18:31:33.805 INFO:tasks.workunit.client.1.smithi131.stdout:3/651: link d2/d22/d29/db/d23/d2a/d49/f66 d2/d22/d29/db/d1a/dc3/fd2 0 2024-02-15T18:31:33.805 INFO:tasks.workunit.client.1.smithi131.stdout:3/652: write d2/d22/d29/db/d34/f3b [1106824,24466] 0 2024-02-15T18:31:33.805 INFO:tasks.workunit.client.1.smithi131.stdout:3/653: dread - d2/d22/d42/fa8 zero size 2024-02-15T18:31:33.806 INFO:tasks.workunit.client.1.smithi131.stdout:8/433: creat d22/d41/f92 x:0 0 0 2024-02-15T18:31:33.806 INFO:tasks.workunit.client.1.smithi131.stdout:8/434: chown d22/d26/f6c 111300 1 2024-02-15T18:31:33.808 INFO:tasks.workunit.client.1.smithi131.stdout:5/544: unlink d18/l21 0 2024-02-15T18:31:33.808 INFO:tasks.workunit.client.1.smithi131.stdout:2/384: truncate dd/d10/d22/d2f/d38/f45 275872 0 2024-02-15T18:31:33.809 INFO:tasks.workunit.client.1.smithi131.stdout:8/435: mknod d22/d2e/d60/c93 0 2024-02-15T18:31:33.809 INFO:tasks.workunit.client.1.smithi131.stdout:8/436: fdatasync d22/f32 0 2024-02-15T18:31:33.809 INFO:tasks.workunit.client.1.smithi131.stdout:7/633: write d0/f47 [5234156,23159] 0 2024-02-15T18:31:33.809 INFO:tasks.workunit.client.1.smithi131.stdout:7/634: stat d0/d17/f23 0 2024-02-15T18:31:33.810 INFO:tasks.workunit.client.1.smithi131.stdout:5/545: creat d18/d6d/d70/d9e/fb4 x:0 0 0 2024-02-15T18:31:33.812 INFO:tasks.workunit.client.1.smithi131.stdout:2/385: creat dd/d10/d22/d2f/d38/d74/d2e/d6a/f7d x:0 0 0 2024-02-15T18:31:33.812 INFO:tasks.workunit.client.1.smithi131.stdout:2/386: chown dd/d10/d22/d2f/d38/d74/d2e/d6a/f6b 960103 1 2024-02-15T18:31:33.812 INFO:tasks.workunit.client.1.smithi131.stdout:2/387: write dd/f18 [2231288,101535] 0 2024-02-15T18:31:33.812 INFO:tasks.workunit.client.1.smithi131.stdout:5/546: getdents d18/d24/d7b/dac 0 2024-02-15T18:31:33.814 INFO:tasks.workunit.client.1.smithi131.stdout:2/388: rename fb to dd/d14/d1f/d65/d77/f7e 0 2024-02-15T18:31:33.814 INFO:tasks.workunit.client.1.smithi131.stdout:5/547: symlink d18/d4e/lb5 0 2024-02-15T18:31:33.816 INFO:tasks.workunit.client.1.smithi131.stdout:5/548: mkdir d18/d4e/db6 0 2024-02-15T18:31:33.817 INFO:tasks.workunit.client.1.smithi131.stdout:3/654: dread d2/d22/d29/db/f53 [0,4194304] 0 2024-02-15T18:31:33.821 INFO:tasks.workunit.client.1.smithi131.stdout:8/437: dread fb [0,4194304] 0 2024-02-15T18:31:33.821 INFO:tasks.workunit.client.1.smithi131.stdout:8/438: chown d22/d41/c46 0 1 2024-02-15T18:31:33.823 INFO:tasks.workunit.client.1.smithi131.stdout:1/676: dwrite d0/d1/d24/fd7 [0,4194304] 0 2024-02-15T18:31:33.823 INFO:tasks.workunit.client.1.smithi131.stdout:3/655: dread d2/d22/d29/db/d23/d2a/d5b/f8c [0,4194304] 0 2024-02-15T18:31:33.823 INFO:tasks.workunit.client.1.smithi131.stdout:6/497: dwrite d2/d2b/f9c [0,4194304] 0 2024-02-15T18:31:33.823 INFO:tasks.workunit.client.1.smithi131.stdout:6/498: truncate d2/dc/d1f/f26 783658 0 2024-02-15T18:31:33.827 INFO:tasks.workunit.client.1.smithi131.stdout:3/656: mknod d2/cd3 0 2024-02-15T18:31:33.830 INFO:tasks.workunit.client.1.smithi131.stdout:6/499: mkdir d2/dc/d27/d62/d97/d9e 0 2024-02-15T18:31:33.831 INFO:tasks.workunit.client.1.smithi131.stdout:6/500: dread - d2/d7/d48/f5c zero size 2024-02-15T18:31:33.831 INFO:tasks.workunit.client.1.smithi131.stdout:6/501: fdatasync d2/d79/f85 0 2024-02-15T18:31:33.834 INFO:tasks.workunit.client.1.smithi131.stdout:4/599: dwrite d2/d7/f5c [0,4194304] 0 2024-02-15T18:31:33.835 INFO:tasks.workunit.client.1.smithi131.stdout:3/657: unlink d2/d22/d42/f45 0 2024-02-15T18:31:33.842 INFO:tasks.workunit.client.1.smithi131.stdout:4/600: symlink d2/d2a/d47/d21/d9e/lda 0 2024-02-15T18:31:33.842 INFO:tasks.workunit.client.1.smithi131.stdout:6/502: dread d2/dc/f22 [4194304,4194304] 0 2024-02-15T18:31:33.842 INFO:tasks.workunit.client.1.smithi131.stdout:4/601: chown d2/d7/d1c/d94/f95 13211493 1 2024-02-15T18:31:33.842 INFO:tasks.workunit.client.1.smithi131.stdout:3/658: rename d2/d22/d29/f17 to d2/d22/d29/db/d1a/da4/fd4 0 2024-02-15T18:31:33.846 INFO:tasks.workunit.client.1.smithi131.stdout:4/602: mkdir d2/d2a/d76/ddb 0 2024-02-15T18:31:33.847 INFO:tasks.workunit.client.1.smithi131.stdout:3/659: mknod d2/d22/d29/db/cd5 0 2024-02-15T18:31:33.847 INFO:tasks.workunit.client.1.smithi131.stdout:3/660: fsync d2/d22/d29/db/d1a/da4/faa 0 2024-02-15T18:31:33.848 INFO:tasks.workunit.client.1.smithi131.stdout:4/603: rmdir d2/d2a/d47/d16/d5a 39 2024-02-15T18:31:33.851 INFO:tasks.workunit.client.1.smithi131.stdout:3/661: truncate d2/d22/d29/db/d23/d2a/d5b/f8c 5360995 0 2024-02-15T18:31:33.858 INFO:tasks.workunit.client.1.smithi131.stdout:3/662: creat d2/d22/d29/db/dd1/fd6 x:0 0 0 2024-02-15T18:31:33.858 INFO:tasks.workunit.client.1.smithi131.stdout:3/663: write d2/d22/d5e/d79/fa2 [320959,88382] 0 2024-02-15T18:31:33.858 INFO:tasks.workunit.client.1.smithi131.stdout:3/664: stat d2/d22/d29/db/d34/f8a 0 2024-02-15T18:31:33.862 INFO:tasks.workunit.client.1.smithi131.stdout:2/389: dwrite dd/d10/d22/d2a/f49 [4194304,4194304] 0 2024-02-15T18:31:33.862 INFO:tasks.workunit.client.1.smithi131.stdout:2/390: getdents dd/d69 0 2024-02-15T18:31:33.862 INFO:tasks.workunit.client.1.smithi131.stdout:2/391: readlink dd/d14/d2b/l43 0 2024-02-15T18:31:33.864 INFO:tasks.workunit.client.1.smithi131.stdout:2/392: mkdir dd/d69/d7f 0 2024-02-15T18:31:33.865 INFO:tasks.workunit.client.1.smithi131.stdout:2/393: dread - dd/d10/d22/d2f/f40 zero size 2024-02-15T18:31:33.866 INFO:tasks.workunit.client.1.smithi131.stdout:1/677: dwrite d0/d1/d44/d59/fc6 [0,4194304] 0 2024-02-15T18:31:33.870 INFO:tasks.workunit.client.1.smithi131.stdout:2/394: rename dd/d10/d22/d2a/d48/l51 to dd/d10/d22/d2f/d38/l80 0 2024-02-15T18:31:33.874 INFO:tasks.workunit.client.1.smithi131.stdout:1/678: mkdir d0/d2/d7/d72/d78/df2 0 2024-02-15T18:31:33.874 INFO:tasks.workunit.client.1.smithi131.stdout:6/503: dwrite d2/f42 [0,4194304] 0 2024-02-15T18:31:33.877 INFO:tasks.workunit.client.1.smithi131.stdout:6/504: dread d2/dc/d27/d62/d97/f43 [4194304,4194304] 0 2024-02-15T18:31:33.877 INFO:tasks.workunit.client.1.smithi131.stdout:2/395: rename dd/d69/d7f to dd/d14/d1f/d65/d81 0 2024-02-15T18:31:33.887 INFO:tasks.workunit.client.1.smithi131.stdout:4/604: dwrite d2/d7/fc9 [0,4194304] 0 2024-02-15T18:31:33.887 INFO:tasks.workunit.client.1.smithi131.stdout:4/605: chown d2/d2a/d47/d16/d5a/dd2 1475 1 2024-02-15T18:31:33.887 INFO:tasks.workunit.client.1.smithi131.stdout:4/606: fsync d2/d7/d12/d2e/f50 0 2024-02-15T18:31:33.887 INFO:tasks.workunit.client.1.smithi131.stdout:4/607: chown d2/d23/lac 187916 1 2024-02-15T18:31:33.888 INFO:tasks.workunit.client.1.smithi131.stdout:5/549: write d18/d4e/fa7 [869794,38834] 0 2024-02-15T18:31:33.906 INFO:tasks.workunit.client.1.smithi131.stdout:1/679: mkdir d0/d1/df3 0 2024-02-15T18:31:33.908 INFO:tasks.workunit.client.1.smithi131.stdout:2/396: getdents dd/d10/d22 0 2024-02-15T18:31:33.908 INFO:tasks.workunit.client.1.smithi131.stdout:2/397: fdatasync dd/d10/d22/d2f/f40 0 2024-02-15T18:31:33.916 INFO:tasks.workunit.client.1.smithi131.stdout:5/550: creat d18/d4e/db6/fb7 x:0 0 0 2024-02-15T18:31:33.918 INFO:tasks.workunit.client.1.smithi131.stdout:3/665: unlink d2/d22/d29/d20/f37 0 2024-02-15T18:31:33.919 INFO:tasks.workunit.client.1.smithi131.stdout:3/666: chown d2/d22/d29/db/d23/d2a/d49/c5c 149597 1 2024-02-15T18:31:33.921 INFO:tasks.workunit.client.1.smithi131.stdout:1/680: mknod d0/d1/d44/d59/d42/dcf/cf4 0 2024-02-15T18:31:33.921 INFO:tasks.workunit.client.1.smithi131.stdout:1/681: write d0/d2/d4/d5d/f60 [645547,127814] 0 2024-02-15T18:31:33.925 INFO:tasks.workunit.client.1.smithi131.stdout:3/667: mkdir d2/d22/d29/dd7 0 2024-02-15T18:31:33.925 INFO:tasks.workunit.client.1.smithi131.stdout:3/668: read - d2/d22/d29/db/d23/d2a/fbe zero size 2024-02-15T18:31:33.925 INFO:tasks.workunit.client.1.smithi131.stdout:3/669: readlink d2/d22/d29/db/d23/d2a/l61 0 2024-02-15T18:31:33.925 INFO:tasks.workunit.client.1.smithi131.stdout:1/682: link d0/d1/d44/d59/d42/dcf/c66 d0/d2/d31/d3d/cf5 0 2024-02-15T18:31:33.925 INFO:tasks.workunit.client.1.smithi131.stdout:1/683: chown d0/d1/d44/d59/d42/dcf/c69 32712 1 2024-02-15T18:31:33.929 INFO:tasks.workunit.client.1.smithi131.stdout:3/670: symlink d2/d22/d42/ld8 0 2024-02-15T18:31:33.933 INFO:tasks.workunit.client.1.smithi131.stdout:3/671: creat d2/d22/d42/fd9 x:0 0 0 2024-02-15T18:31:33.935 INFO:tasks.workunit.client.1.smithi131.stdout:3/672: creat d2/d22/d29/d20/fda x:0 0 0 2024-02-15T18:31:33.935 INFO:tasks.workunit.client.1.smithi131.stdout:3/673: truncate d2/d22/d3f/fc2 768906 0 2024-02-15T18:31:33.936 INFO:tasks.workunit.client.1.smithi131.stdout:3/674: symlink d2/d22/d29/db/d34/ldb 0 2024-02-15T18:31:33.938 INFO:tasks.workunit.client.1.smithi131.stdout:3/675: rename d2/d22/d29/db/d1a/ld to d2/d22/d29/db/d1a/da4/d8d/ldc 0 2024-02-15T18:31:33.938 INFO:tasks.workunit.client.1.smithi131.stdout:3/676: fdatasync d2/d22/f72 0 2024-02-15T18:31:33.940 INFO:tasks.workunit.client.1.smithi131.stdout:3/677: mkdir d2/d22/ddd 0 2024-02-15T18:31:33.941 INFO:tasks.workunit.client.1.smithi131.stdout:3/678: mknod d2/d22/d3a/cde 0 2024-02-15T18:31:33.941 INFO:tasks.workunit.client.1.smithi131.stdout:3/679: chown d2/d22/d29/db/d34/f8a 329352 1 2024-02-15T18:31:33.964 INFO:tasks.workunit.client.1.smithi131.stdout:5/551: dwrite d18/d33/d73/f88 [0,4194304] 0 2024-02-15T18:31:33.965 INFO:tasks.workunit.client.1.smithi131.stdout:2/398: dwrite dd/d14/f5c [0,4194304] 0 2024-02-15T18:31:33.965 INFO:tasks.workunit.client.1.smithi131.stdout:1/684: dwrite d0/d2/db/de6/db3/fc1 [0,4194304] 0 2024-02-15T18:31:33.967 INFO:tasks.workunit.client.1.smithi131.stdout:2/399: write dd/f29 [62990,108357] 0 2024-02-15T18:31:33.974 INFO:tasks.workunit.client.1.smithi131.stdout:1/685: creat d0/d2/db/de6/db3/ff6 x:0 0 0 2024-02-15T18:31:33.978 INFO:tasks.workunit.client.1.smithi131.stdout:5/552: dread f17 [0,4194304] 0 2024-02-15T18:31:33.983 INFO:tasks.workunit.client.1.smithi131.stdout:1/686: write d0/d2/d4/da/f1f [490863,26689] 0 2024-02-15T18:31:33.983 INFO:tasks.workunit.client.1.smithi131.stdout:1/687: chown d0/d68/l82 20 1 2024-02-15T18:31:33.991 INFO:tasks.workunit.client.1.smithi131.stdout:2/400: truncate dd/f60 393953 0 2024-02-15T18:31:33.996 INFO:tasks.workunit.client.1.smithi131.stdout:5/553: dread d18/d24/f55 [0,4194304] 0 2024-02-15T18:31:33.997 INFO:tasks.workunit.client.1.smithi131.stdout:1/688: creat d0/d2/d4/d41/d5a/ff7 x:0 0 0 2024-02-15T18:31:33.999 INFO:tasks.workunit.client.1.smithi131.stdout:5/554: mkdir d18/d24/d7b/db8 0 2024-02-15T18:31:34.014 INFO:tasks.workunit.client.1.smithi131.stdout:1/689: truncate d0/d1/d44/d59/f6d 27690 0 2024-02-15T18:31:34.015 INFO:tasks.workunit.client.1.smithi131.stdout:2/401: dwrite dd/d10/d22/d2f/d38/d74/d2e/d6a/f6b [0,4194304] 0 2024-02-15T18:31:34.063 INFO:tasks.workunit.client.1.smithi131.stdout:5/555: creat d18/d24/d7b/db8/fb9 x:0 0 0 2024-02-15T18:31:34.077 INFO:tasks.workunit.client.1.smithi131.stdout:1/690: mknod d0/d1/d44/d59/cf8 0 2024-02-15T18:31:34.093 INFO:tasks.workunit.client.1.smithi131.stdout:2/402: link dd/d10/d22/d2f/d38/d74/d2e/l6d dd/d1e/l82 0 2024-02-15T18:31:34.093 INFO:tasks.workunit.client.1.smithi131.stdout:2/403: chown dd/d10/d22/d2a/f30 1026 1 2024-02-15T18:31:34.093 INFO:tasks.workunit.client.1.smithi131.stdout:2/404: dread - dd/d10/d22/f6c zero size 2024-02-15T18:31:34.093 INFO:tasks.workunit.client.1.smithi131.stdout:2/405: stat fa 0 2024-02-15T18:31:34.093 INFO:tasks.workunit.client.1.smithi131.stdout:2/406: fsync dd/d10/d22/d2f/d38/d74/f5d 0 2024-02-15T18:31:34.094 INFO:tasks.workunit.client.1.smithi131.stdout:2/407: read fc [604602,119348] 0 2024-02-15T18:31:34.096 INFO:tasks.workunit.client.1.smithi131.stdout:5/556: rename d18/d24 to d18/d83/d8b/dba 0 2024-02-15T18:31:34.097 INFO:tasks.workunit.client.1.smithi131.stdout:5/557: write d18/d33/f54 [2920138,122494] 0 2024-02-15T18:31:34.098 INFO:tasks.workunit.client.1.smithi131.stdout:1/691: rename d0/d2/d31/d3d/feb to d0/d1/d16/d30/ff9 0 2024-02-15T18:31:34.101 INFO:tasks.workunit.client.1.smithi131.stdout:5/558: symlink d18/d33/lbb 0 2024-02-15T18:31:34.104 INFO:tasks.workunit.client.1.smithi131.stdout:1/692: stat d0/d1/d16/dd1/l83 0 2024-02-15T18:31:34.106 INFO:tasks.workunit.client.1.smithi131.stdout:2/408: rename dd/d14/f36 to dd/d10/d22/d2a/d48/f83 0 2024-02-15T18:31:34.108 INFO:tasks.workunit.client.1.smithi131.stdout:1/693: write d0/d2/d7/f1e [903199,109770] 0 2024-02-15T18:31:34.109 INFO:tasks.workunit.client.1.smithi131.stdout:1/694: truncate d0/d1/d24/f7f 1038239 0 2024-02-15T18:31:34.111 INFO:tasks.workunit.client.1.smithi131.stdout:2/409: mknod dd/d14/d1f/d65/d77/d7a/c84 0 2024-02-15T18:31:34.115 INFO:tasks.workunit.client.1.smithi131.stdout:1/695: creat d0/d1/d16/dd1/ffa x:0 0 0 2024-02-15T18:31:34.118 INFO:tasks.workunit.client.1.smithi131.stdout:2/410: rmdir dd/d10/d22/d2f/d38/d74/d2e 39 2024-02-15T18:31:34.120 INFO:tasks.workunit.client.1.smithi131.stdout:2/411: mknod dd/d10/d22/d2a/d48/c85 0 2024-02-15T18:31:34.121 INFO:tasks.workunit.client.1.smithi131.stdout:1/696: dread d0/d68/f9c [0,4194304] 0 2024-02-15T18:31:34.121 INFO:tasks.workunit.client.1.smithi131.stdout:1/697: chown d0/d2/d31/d3d/d46/cd2 23243254 1 2024-02-15T18:31:34.123 INFO:tasks.workunit.client.1.smithi131.stdout:1/698: creat d0/d1/d44/d59/d42/dcf/ffb x:0 0 0 2024-02-15T18:31:34.124 INFO:tasks.workunit.client.1.smithi131.stdout:5/559: dwrite d18/d6d/f9d [0,4194304] 0 2024-02-15T18:31:34.124 INFO:tasks.workunit.client.1.smithi131.stdout:5/560: write d18/d83/d8b/dba/f59 [313042,1768] 0 2024-02-15T18:31:34.124 INFO:tasks.workunit.client.1.smithi131.stdout:1/699: symlink d0/d2/db/de6/db3/lfc 0 2024-02-15T18:31:34.125 INFO:tasks.workunit.client.1.smithi131.stdout:5/561: write d18/d6d/d70/d9e/d85/f9f [251084,6570] 0 2024-02-15T18:31:34.126 INFO:tasks.workunit.client.1.smithi131.stdout:5/562: symlink d18/d23/lbc 0 2024-02-15T18:31:34.127 INFO:tasks.workunit.client.1.smithi131.stdout:1/700: read d0/d2/f1c [3286405,50309] 0 2024-02-15T18:31:34.127 INFO:tasks.workunit.client.1.smithi131.stdout:1/701: chown d0/d1/d44/d59/la9 17 1 2024-02-15T18:31:34.128 INFO:tasks.workunit.client.1.smithi131.stdout:5/563: unlink d18/d6d/d70/d9e/d85/dab/f91 0 2024-02-15T18:31:34.130 INFO:tasks.workunit.client.1.smithi131.stdout:1/702: write d0/d2/d4/da/f1f [3776136,24309] 0 2024-02-15T18:31:34.132 INFO:tasks.workunit.client.1.smithi131.stdout:5/564: link d18/d33/c96 d18/d6d/d70/d9e/d85/d95/cbd 0 2024-02-15T18:31:34.134 INFO:tasks.workunit.client.1.smithi131.stdout:1/703: creat d0/d2/d7/d72/d78/df2/ffd x:0 0 0 2024-02-15T18:31:34.141 INFO:tasks.workunit.client.1.smithi131.stdout:1/704: creat d0/d68/d80/ffe x:0 0 0 2024-02-15T18:31:34.171 INFO:tasks.workunit.client.1.smithi131.stdout:2/412: dwrite f4 [0,4194304] 0 2024-02-15T18:31:34.173 INFO:tasks.workunit.client.1.smithi131.stdout:2/413: mknod dd/d10/d22/d2f/d38/d74/d2e/c86 0 2024-02-15T18:31:34.173 INFO:tasks.workunit.client.1.smithi131.stdout:2/414: chown dd/d69 3 1 2024-02-15T18:31:34.174 INFO:tasks.workunit.client.1.smithi131.stdout:5/565: dwrite d18/d23/f30 [0,4194304] 0 2024-02-15T18:31:34.174 INFO:tasks.workunit.client.1.smithi131.stdout:2/415: creat dd/d14/d1f/f87 x:0 0 0 2024-02-15T18:31:34.175 INFO:tasks.workunit.client.1.smithi131.stdout:1/705: dwrite d0/d1/d16/d6b/fcc [0,4194304] 0 2024-02-15T18:31:34.175 INFO:tasks.workunit.client.1.smithi131.stdout:1/706: chown d0/d2/d4/d41/d5a/l7d 39 1 2024-02-15T18:31:34.176 INFO:tasks.workunit.client.1.smithi131.stdout:2/416: mknod dd/d10/d22/d2f/d38/d74/c88 0 2024-02-15T18:31:34.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/707: rmdir d0/d2/d31 39 2024-02-15T18:31:34.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/708: write d0/d1/d24/d89/fdf [509362,102627] 0 2024-02-15T18:31:34.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/709: chown d0/d1/d16/dd1/dd9/fdb 0 1 2024-02-15T18:31:34.197 INFO:tasks.workunit.client.1.smithi131.stdout:1/710: unlink d0/d1/d24/f7f 0 2024-02-15T18:31:34.197 INFO:tasks.workunit.client.1.smithi131.stdout:1/711: dread - d0/d1/d24/d89/fde zero size 2024-02-15T18:31:34.197 INFO:tasks.workunit.client.1.smithi131.stdout:2/417: dwrite fa [0,4194304] 0 2024-02-15T18:31:34.197 INFO:tasks.workunit.client.1.smithi131.stdout:2/418: getdents dd/d14/d1f/d65/d81 0 2024-02-15T18:31:34.202 INFO:tasks.workunit.client.1.smithi131.stdout:1/712: link d0/d2/dd6/c65 d0/d1/d44/ded/cff 0 2024-02-15T18:31:34.206 INFO:tasks.workunit.client.1.smithi131.stdout:2/419: link dd/d10/d22/d2f/d38/l80 dd/d69/l89 0 2024-02-15T18:31:34.208 INFO:tasks.workunit.client.1.smithi131.stdout:2/420: symlink dd/d10/d22/d2f/d38/d74/d2e/l8a 0 2024-02-15T18:31:34.208 INFO:tasks.workunit.client.1.smithi131.stdout:2/421: write dd/d10/d22/d2f/f40 [7049,41697] 0 2024-02-15T18:31:34.211 INFO:tasks.workunit.client.1.smithi131.stdout:1/713: dread d0/d1/d16/fe1 [0,4194304] 0 2024-02-15T18:31:34.212 INFO:tasks.workunit.client.1.smithi131.stdout:1/714: symlink d0/d1/d16/l100 0 2024-02-15T18:31:34.224 INFO:tasks.workunit.client.1.smithi131.stdout:1/715: dread d0/d2/f5 [4194304,4194304] 0 2024-02-15T18:31:34.225 INFO:tasks.workunit.client.1.smithi131.stdout:1/716: creat d0/d2/d31/f101 x:0 0 0 2024-02-15T18:31:34.226 INFO:tasks.workunit.client.1.smithi131.stdout:1/717: mkdir d0/d1/d44/d59/d42/dcf/d102 0 2024-02-15T18:31:34.231 INFO:tasks.workunit.client.1.smithi131.stdout:2/422: dwrite dd/d10/d22/d2f/d38/f7c [0,4194304] 0 2024-02-15T18:31:34.232 INFO:tasks.workunit.client.1.smithi131.stdout:1/718: write d0/d2/f2b [3048434,52401] 0 2024-02-15T18:31:34.232 INFO:tasks.workunit.client.1.smithi131.stdout:1/719: dread - d0/d1/d16/dd1/dd9/fdb zero size 2024-02-15T18:31:34.244 INFO:tasks.workunit.client.1.smithi131.stdout:2/423: unlink dd/d14/f5c 0 2024-02-15T18:31:34.244 INFO:tasks.workunit.client.1.smithi131.stdout:2/424: readlink dd/d14/l28 0 2024-02-15T18:31:34.258 INFO:tasks.workunit.client.1.smithi131.stdout:1/720: dwrite d0/d1/d16/d30/fa2 [0,4194304] 0 2024-02-15T18:31:34.259 INFO:tasks.workunit.client.1.smithi131.stdout:2/425: rmdir dd/d14 39 2024-02-15T18:31:34.263 INFO:tasks.workunit.client.1.smithi131.stdout:2/426: dread dd/d10/d22/d2f/d38/d74/d2e/f32 [0,4194304] 0 2024-02-15T18:31:34.273 INFO:tasks.workunit.client.1.smithi131.stdout:2/427: dread dd/d1e/f26 [0,4194304] 0 2024-02-15T18:31:34.275 INFO:tasks.workunit.client.1.smithi131.stdout:2/428: mknod dd/d10/d22/d2f/d38/d74/d2e/d66/c8b 0 2024-02-15T18:31:34.277 INFO:tasks.workunit.client.1.smithi131.stdout:2/429: mknod dd/d14/d1f/d65/d77/d7a/c8c 0 2024-02-15T18:31:34.278 INFO:tasks.workunit.client.1.smithi131.stdout:1/721: dwrite d0/d68/d80/ffe [0,4194304] 0 2024-02-15T18:31:34.278 INFO:tasks.workunit.client.1.smithi131.stdout:2/430: getdents dd/d10/d22/d2f/d38/d74/d2e 0 2024-02-15T18:31:34.281 INFO:tasks.workunit.client.1.smithi131.stdout:1/722: symlink d0/d2/d4/d41/l103 0 2024-02-15T18:31:34.282 INFO:tasks.workunit.client.1.smithi131.stdout:2/431: creat dd/f8d x:0 0 0 2024-02-15T18:31:34.283 INFO:tasks.workunit.client.1.smithi131.stdout:1/723: symlink d0/d2/da8/l104 0 2024-02-15T18:31:34.285 INFO:tasks.workunit.client.1.smithi131.stdout:1/724: mkdir d0/d2/d31/d3d/dd3/d105 0 2024-02-15T18:31:34.285 INFO:tasks.workunit.client.1.smithi131.stdout:1/725: dread - d0/d1/d24/d89/fde zero size 2024-02-15T18:31:34.286 INFO:tasks.workunit.client.1.smithi131.stdout:1/726: dread d0/d68/d80/fc7 [0,4194304] 0 2024-02-15T18:31:34.287 INFO:tasks.workunit.client.1.smithi131.stdout:1/727: symlink d0/d68/d80/ddc/l106 0 2024-02-15T18:31:34.288 INFO:tasks.workunit.client.1.smithi131.stdout:1/728: dread d0/d68/d80/fc7 [0,4194304] 0 2024-02-15T18:31:34.290 INFO:tasks.workunit.client.1.smithi131.stdout:1/729: rmdir d0/d2/db/de6/db3/dc2 39 2024-02-15T18:31:34.290 INFO:tasks.workunit.client.1.smithi131.stdout:2/432: dread f4 [0,4194304] 0 2024-02-15T18:31:34.291 INFO:tasks.workunit.client.1.smithi131.stdout:1/730: unlink d0/d2/d31/d3d/cf5 0 2024-02-15T18:31:34.292 INFO:tasks.workunit.client.1.smithi131.stdout:2/433: dread dd/d10/d22/d2f/f40 [0,4194304] 0 2024-02-15T18:31:34.294 INFO:tasks.workunit.client.1.smithi131.stdout:2/434: creat dd/d10/d22/f8e x:0 0 0 2024-02-15T18:31:34.304 INFO:tasks.workunit.client.1.smithi131.stdout:2/435: dread dd/d10/d22/d2a/f30 [0,4194304] 0 2024-02-15T18:31:34.305 INFO:tasks.workunit.client.1.smithi131.stdout:2/436: mkdir dd/d8f 0 2024-02-15T18:31:34.306 INFO:tasks.workunit.client.1.smithi131.stdout:2/437: creat dd/d14/d1f/f90 x:0 0 0 2024-02-15T18:31:34.308 INFO:tasks.workunit.client.1.smithi131.stdout:2/438: unlink dd/d10/l34 0 2024-02-15T18:31:34.309 INFO:tasks.workunit.client.1.smithi131.stdout:1/731: dwrite d0/d2/db/de6/db3/fc1 [0,4194304] 0 2024-02-15T18:31:34.309 INFO:tasks.workunit.client.1.smithi131.stdout:2/439: getdents dd/d14/d1f/d65 0 2024-02-15T18:31:34.316 INFO:tasks.workunit.client.1.smithi131.stdout:1/732: creat d0/d2/d7/d72/f107 x:0 0 0 2024-02-15T18:31:34.319 INFO:tasks.workunit.client.1.smithi131.stdout:1/733: rename d0/d2/db/dac to d0/d1/d24/d108 0 2024-02-15T18:31:34.321 INFO:tasks.workunit.client.1.smithi131.stdout:2/440: symlink dd/d10/d22/d2f/d38/l91 0 2024-02-15T18:31:34.321 INFO:tasks.workunit.client.1.smithi131.stdout:2/441: write dd/d10/d22/f8e [46778,47260] 0 2024-02-15T18:31:34.321 INFO:tasks.workunit.client.1.smithi131.stdout:2/442: write dd/f60 [1373921,30308] 0 2024-02-15T18:31:34.322 INFO:tasks.workunit.client.1.smithi131.stdout:9/719: sync 2024-02-15T18:31:34.322 INFO:tasks.workunit.client.1.smithi131.stdout:9/720: fdatasync d4/dc/de/d1e/d1f/d2c/f4b 0 2024-02-15T18:31:34.322 INFO:tasks.workunit.client.1.smithi131.stdout:9/721: truncate d4/dc/d17/d19/d32/dc2/fa3 1491479 0 2024-02-15T18:31:34.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/414: sync 2024-02-15T18:31:34.322 INFO:tasks.workunit.client.1.smithi131.stdout:7/635: sync 2024-02-15T18:31:34.323 INFO:tasks.workunit.client.1.smithi131.stdout:1/734: dread d0/d2/fe0 [0,4194304] 0 2024-02-15T18:31:34.325 INFO:tasks.workunit.client.1.smithi131.stdout:0/415: write d5/d9/f2e [1436070,16356] 0 2024-02-15T18:31:34.325 INFO:tasks.workunit.client.1.smithi131.stdout:2/443: unlink dd/d10/d22/d2f/d38/d74/c88 0 2024-02-15T18:31:34.326 INFO:tasks.workunit.client.1.smithi131.stdout:9/722: mknod d4/dc/d25/d3f/d81/d5b/ce4 0 2024-02-15T18:31:34.326 INFO:tasks.workunit.client.1.smithi131.stdout:9/723: write d4/dc/d25/d3f/d81/d72/fa8 [4581915,15635] 0 2024-02-15T18:31:34.326 INFO:tasks.workunit.client.1.smithi131.stdout:9/724: truncate d4/dc/d17/d19/f5a 856536 0 2024-02-15T18:31:34.328 INFO:tasks.workunit.client.1.smithi131.stdout:7/636: mkdir d0/d34/d8e/d98/dc6 0 2024-02-15T18:31:34.331 INFO:tasks.workunit.client.1.smithi131.stdout:1/735: rename d0/d1/d16/dd1/dd9 to d0/d2/d7/d72/d78/da7/d109 0 2024-02-15T18:31:34.341 INFO:tasks.workunit.client.1.smithi131.stdout:2/444: write f8 [442411,9374] 0 2024-02-15T18:31:34.348 INFO:tasks.workunit.client.1.smithi131.stdout:9/725: mkdir d4/dc/d17/d19/d32/d91/de5 0 2024-02-15T18:31:34.349 INFO:tasks.workunit.client.1.smithi131.stdout:0/416: dwrite d5/d9/d10/d3f/f47 [8388608,4194304] 0 2024-02-15T18:31:34.349 INFO:tasks.workunit.client.1.smithi131.stdout:0/417: fdatasync d5/d9/d10/d3f/f47 0 2024-02-15T18:31:34.349 INFO:tasks.workunit.client.1.smithi131.stdout:7/637: symlink d0/d17/d3a/lc7 0 2024-02-15T18:31:34.349 INFO:tasks.workunit.client.1.smithi131.stdout:7/638: fdatasync d0/d17/d3a/d3d/d79/d89/f95 0 2024-02-15T18:31:34.349 INFO:tasks.workunit.client.1.smithi131.stdout:7/639: chown d0/d17/d36/f50 33618 1 2024-02-15T18:31:34.355 INFO:tasks.workunit.client.1.smithi131.stdout:1/736: creat d0/d2/d7/d72/d78/df2/f10a x:0 0 0 2024-02-15T18:31:34.355 INFO:tasks.workunit.client.1.smithi131.stdout:2/445: mkdir dd/d69/d92 0 2024-02-15T18:31:34.357 INFO:tasks.workunit.client.1.smithi131.stdout:0/418: getdents d5/d9/d4d 0 2024-02-15T18:31:34.358 INFO:tasks.workunit.client.1.smithi131.stdout:7/640: mkdir d0/d9d/dc8 0 2024-02-15T18:31:34.359 INFO:tasks.workunit.client.1.smithi131.stdout:7/641: read d0/d17/d36/f48 [1402049,76521] 0 2024-02-15T18:31:34.361 INFO:tasks.workunit.client.1.smithi131.stdout:1/737: rename d0/d2/db/f85 to d0/d2/db/de6/f10b 0 2024-02-15T18:31:34.361 INFO:tasks.workunit.client.1.smithi131.stdout:1/738: readlink d0/d2/d31/l95 0 2024-02-15T18:31:34.361 INFO:tasks.workunit.client.1.smithi131.stdout:1/739: chown d0/d2/d4/da/f2a 45014 1 2024-02-15T18:31:34.361 INFO:tasks.workunit.client.1.smithi131.stdout:1/740: dread - d0/d1/d44/fb4 zero size 2024-02-15T18:31:34.361 INFO:tasks.workunit.client.1.smithi131.stdout:1/741: readlink d0/lc8 0 2024-02-15T18:31:34.364 INFO:tasks.workunit.client.1.smithi131.stdout:0/419: creat d5/d9/d11/f88 x:0 0 0 2024-02-15T18:31:34.364 INFO:tasks.workunit.client.1.smithi131.stdout:1/742: unlink d0/d2/d7/d72/d78/df2/ffd 0 2024-02-15T18:31:34.366 INFO:tasks.workunit.client.1.smithi131.stdout:1/743: mkdir d0/d2/db/de6/d10c 0 2024-02-15T18:31:34.377 INFO:tasks.workunit.client.1.smithi131.stdout:1/744: dread d0/d2/d7/f40 [0,4194304] 0 2024-02-15T18:31:34.385 INFO:tasks.workunit.client.1.smithi131.stdout:9/726: dwrite d4/dc/d17/d19/f82 [0,4194304] 0 2024-02-15T18:31:34.385 INFO:tasks.workunit.client.1.smithi131.stdout:7/642: dwrite d0/d17/d3a/d3d/d79/f9c [0,4194304] 0 2024-02-15T18:31:34.387 INFO:tasks.workunit.client.1.smithi131.stdout:0/420: dwrite d5/d2f/f5e [0,4194304] 0 2024-02-15T18:31:34.389 INFO:tasks.workunit.client.1.smithi131.stdout:9/727: write d4/fa5 [3132636,79919] 0 2024-02-15T18:31:34.389 INFO:tasks.workunit.client.1.smithi131.stdout:9/728: chown d4/dc/de/d1e/d1f/d2c/f79 194924713 1 2024-02-15T18:31:34.389 INFO:tasks.workunit.client.1.smithi131.stdout:9/729: dread - d4/dc/fd8 zero size 2024-02-15T18:31:34.389 INFO:tasks.workunit.client.1.smithi131.stdout:9/730: readlink d4/dc/de/d1e/d1f/d51/lb5 0 2024-02-15T18:31:34.396 INFO:tasks.workunit.client.1.smithi131.stdout:9/731: dread d4/dc/d17/f69 [0,4194304] 0 2024-02-15T18:31:34.396 INFO:tasks.workunit.client.1.smithi131.stdout:9/732: write d4/dc/d17/d19/d32/d91/db3/fe2 [542420,44487] 0 2024-02-15T18:31:34.402 INFO:tasks.workunit.client.1.smithi131.stdout:9/733: dread d4/dc/d25/d3f/d81/f75 [0,4194304] 0 2024-02-15T18:31:34.402 INFO:tasks.workunit.client.1.smithi131.stdout:9/734: dread - d4/dc/de/d1e/d1f/d51/d5d/fd3 zero size 2024-02-15T18:31:34.404 INFO:tasks.workunit.client.1.smithi131.stdout:9/735: unlink d4/dc/d25/d3f/d81/cbe 0 2024-02-15T18:31:34.404 INFO:tasks.workunit.client.1.smithi131.stdout:9/736: chown d4/dc/d25/l31 3957286 1 2024-02-15T18:31:34.405 INFO:tasks.workunit.client.1.smithi131.stdout:9/737: creat d4/dc/de/d1e/d1f/fe6 x:0 0 0 2024-02-15T18:31:34.405 INFO:tasks.workunit.client.1.smithi131.stdout:9/738: chown d4/dc/de/d1e/d1f/d2c/f4b 26208655 1 2024-02-15T18:31:34.406 INFO:tasks.workunit.client.1.smithi131.stdout:9/739: write d4/dc/d17/d19/d32/d91/db3/fe2 [8950,9632] 0 2024-02-15T18:31:34.409 INFO:tasks.workunit.client.1.smithi131.stdout:0/421: dwrite d5/d2f/d4b/f87 [0,4194304] 0 2024-02-15T18:31:34.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/643: dwrite d0/f47 [4194304,4194304] 0 2024-02-15T18:31:34.418 INFO:tasks.workunit.client.1.smithi131.stdout:9/740: rename d4/dc/fd8 to d4/d78/fe7 0 2024-02-15T18:31:34.423 INFO:tasks.workunit.client.1.smithi131.stdout:7/644: unlink d0/d17/d36/f75 0 2024-02-15T18:31:34.425 INFO:tasks.workunit.client.1.smithi131.stdout:0/422: rename d5/d9/d10/d3f/f6f to d5/d9/d4d/f89 0 2024-02-15T18:31:34.426 INFO:tasks.workunit.client.1.smithi131.stdout:7/645: symlink d0/dba/lc9 0 2024-02-15T18:31:34.427 INFO:tasks.workunit.client.1.smithi131.stdout:6/505: sync 2024-02-15T18:31:34.427 INFO:tasks.workunit.client.1.smithi131.stdout:8/439: sync 2024-02-15T18:31:34.427 INFO:tasks.workunit.client.1.smithi131.stdout:6/506: chown d2/dc 942 1 2024-02-15T18:31:34.427 INFO:tasks.workunit.client.1.smithi131.stdout:6/507: chown d2/f23 38366836 1 2024-02-15T18:31:34.427 INFO:tasks.workunit.client.1.smithi131.stdout:8/440: readlink d22/d26/d3f/d47/l5c 0 2024-02-15T18:31:34.427 INFO:tasks.workunit.client.1.smithi131.stdout:8/441: chown d22/d26/d3f/d7c 240699335 1 2024-02-15T18:31:34.430 INFO:tasks.workunit.client.1.smithi131.stdout:0/423: creat d5/d2f/d4b/f8a x:0 0 0 2024-02-15T18:31:34.430 INFO:tasks.workunit.client.1.smithi131.stdout:0/424: write d5/f62 [201907,98229] 0 2024-02-15T18:31:34.430 INFO:tasks.workunit.client.1.smithi131.stdout:7/646: mknod d0/cca 0 2024-02-15T18:31:34.433 INFO:tasks.workunit.client.1.smithi131.stdout:9/741: dwrite d4/dc/d25/d4e/d8a/f9c [4194304,4194304] 0 2024-02-15T18:31:34.435 INFO:tasks.workunit.client.1.smithi131.stdout:9/742: write d4/dc/d25/d3f/d81/d72/fa8 [2962148,129686] 0 2024-02-15T18:31:34.435 INFO:tasks.workunit.client.1.smithi131.stdout:9/743: chown d4/dc/l98 491 1 2024-02-15T18:31:34.435 INFO:tasks.workunit.client.1.smithi131.stdout:9/744: chown d4/dc/d17/d19/d32/dc2/f7a 4703 1 2024-02-15T18:31:34.436 INFO:tasks.workunit.client.1.smithi131.stdout:8/442: rename d22/d2e/d60/c93 to d22/d2e/c94 0 2024-02-15T18:31:34.438 INFO:tasks.workunit.client.1.smithi131.stdout:0/425: mkdir d5/d9/d77/d8b 0 2024-02-15T18:31:34.440 INFO:tasks.workunit.client.1.smithi131.stdout:7/647: mkdir d0/d17/d3a/d3d/dcb 0 2024-02-15T18:31:34.444 INFO:tasks.workunit.client.1.smithi131.stdout:8/443: dread d22/f27 [4194304,4194304] 0 2024-02-15T18:31:34.454 INFO:tasks.workunit.client.1.smithi131.stdout:9/745: mknod d4/dc/d17/d19/d84/ce8 0 2024-02-15T18:31:34.455 INFO:tasks.workunit.client.1.smithi131.stdout:0/426: mkdir d5/d2f/d45/d8c 0 2024-02-15T18:31:34.455 INFO:tasks.workunit.client.1.smithi131.stdout:0/427: truncate d5/d15/d1f/f75 1420821 0 2024-02-15T18:31:34.456 INFO:tasks.workunit.client.1.smithi131.stdout:0/428: dread d5/d9/f3d [0,4194304] 0 2024-02-15T18:31:34.457 INFO:tasks.workunit.client.1.smithi131.stdout:8/444: creat d22/d26/d3f/d47/d48/d5f/f95 x:0 0 0 2024-02-15T18:31:34.459 INFO:tasks.workunit.client.1.smithi131.stdout:9/746: creat d4/dc/d17/d19/d32/dc2/ddc/fe9 x:0 0 0 2024-02-15T18:31:34.461 INFO:tasks.workunit.client.1.smithi131.stdout:8/445: rename d22/d2e/c94 to d22/d26/d3f/d47/d48/d5f/d6f/c96 0 2024-02-15T18:31:34.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/747: unlink d4/dc/d17/d19/d32/dc2/fa3 0 2024-02-15T18:31:34.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/748: dread - d4/dc/d25/d3f/d81/d5b/f6b zero size 2024-02-15T18:31:34.465 INFO:tasks.workunit.client.1.smithi131.stdout:8/446: mknod d22/d26/d3f/d7c/c97 0 2024-02-15T18:31:34.465 INFO:tasks.workunit.client.1.smithi131.stdout:0/429: dread d5/d9/f2e [0,4194304] 0 2024-02-15T18:31:34.466 INFO:tasks.workunit.client.1.smithi131.stdout:9/749: link f3 d4/dc/fea 0 2024-02-15T18:31:34.468 INFO:tasks.workunit.client.1.smithi131.stdout:0/430: creat d5/d9/d10/f8d x:0 0 0 2024-02-15T18:31:34.468 INFO:tasks.workunit.client.1.smithi131.stdout:0/431: truncate d5/f62 848747 0 2024-02-15T18:31:34.470 INFO:tasks.workunit.client.1.smithi131.stdout:9/750: creat d4/dc/de/d1e/feb x:0 0 0 2024-02-15T18:31:34.487 INFO:tasks.workunit.client.1.smithi131.stdout:0/432: dwrite d5/d2f/d4b/f8a [0,4194304] 0 2024-02-15T18:31:34.487 INFO:tasks.workunit.client.1.smithi131.stdout:8/447: dwrite f17 [4194304,4194304] 0 2024-02-15T18:31:34.493 INFO:tasks.workunit.client.1.smithi131.stdout:8/448: rename d22/d26/f2a to d22/d26/d3f/d47/d48/d84/f98 0 2024-02-15T18:31:34.495 INFO:tasks.workunit.client.1.smithi131.stdout:8/449: creat d22/d41/f99 x:0 0 0 2024-02-15T18:31:34.495 INFO:tasks.workunit.client.1.smithi131.stdout:8/450: fdatasync d22/d26/d3f/f6e 0 2024-02-15T18:31:34.499 INFO:tasks.workunit.client.1.smithi131.stdout:8/451: rename d22/d26/d3f/d47/d48/d5f/f72 to d22/d2e/f9a 0 2024-02-15T18:31:34.502 INFO:tasks.workunit.client.1.smithi131.stdout:0/433: dwrite d5/d9/d4d/f63 [0,4194304] 0 2024-02-15T18:31:34.521 INFO:tasks.workunit.client.1.smithi131.stdout:8/452: dwrite d22/d26/d3f/d47/d48/f8c [0,4194304] 0 2024-02-15T18:31:34.521 INFO:tasks.workunit.client.1.smithi131.stdout:0/434: dwrite d5/d9/ff [0,4194304] 0 2024-02-15T18:31:34.521 INFO:tasks.workunit.client.1.smithi131.stdout:0/435: dread - d5/d2f/f84 zero size 2024-02-15T18:31:34.522 INFO:tasks.workunit.client.1.smithi131.stdout:0/436: truncate d5/d9/f43 857049 0 2024-02-15T18:31:34.522 INFO:tasks.workunit.client.1.smithi131.stdout:0/437: chown d5 24980 1 2024-02-15T18:31:34.523 INFO:tasks.workunit.client.1.smithi131.stdout:0/438: dread d5/d9/d10/d3f/f61 [0,4194304] 0 2024-02-15T18:31:34.523 INFO:tasks.workunit.client.1.smithi131.stdout:8/453: write d22/d2e/f38 [3311122,79731] 0 2024-02-15T18:31:34.529 INFO:tasks.workunit.client.1.smithi131.stdout:0/439: unlink d5/d15/d1f/f46 0 2024-02-15T18:31:34.530 INFO:tasks.workunit.client.1.smithi131.stdout:8/454: creat d22/d26/d3f/d47/d48/d5f/d6f/d7a/f9b x:0 0 0 2024-02-15T18:31:34.531 INFO:tasks.workunit.client.1.smithi131.stdout:8/455: chown d22/d26/d3f/d47/d48/f5a 2874 1 2024-02-15T18:31:34.534 INFO:tasks.workunit.client.1.smithi131.stdout:8/456: getdents d22/d41 0 2024-02-15T18:31:34.536 INFO:tasks.workunit.client.1.smithi131.stdout:8/457: mknod d22/c9c 0 2024-02-15T18:31:34.537 INFO:tasks.workunit.client.1.smithi131.stdout:0/440: unlink d5/d15/d1f/c5d 0 2024-02-15T18:31:34.537 INFO:tasks.workunit.client.1.smithi131.stdout:0/441: dread - d5/d2f/f76 zero size 2024-02-15T18:31:34.549 INFO:tasks.workunit.client.1.smithi131.stdout:8/458: truncate d22/f30 2983071 0 2024-02-15T18:31:34.549 INFO:tasks.workunit.client.1.smithi131.stdout:8/459: chown d22/d26/d3f/c7e 1 1 2024-02-15T18:31:34.549 INFO:tasks.workunit.client.1.smithi131.stdout:8/460: chown d22/f30 1095900 1 2024-02-15T18:31:34.549 INFO:tasks.workunit.client.1.smithi131.stdout:8/461: chown d22/d41/f5d 2279582 1 2024-02-15T18:31:34.552 INFO:tasks.workunit.client.1.smithi131.stdout:0/442: symlink d5/d15/d1f/l8e 0 2024-02-15T18:31:34.554 INFO:tasks.workunit.client.1.smithi131.stdout:0/443: getdents d5/d2f 0 2024-02-15T18:31:34.560 INFO:tasks.workunit.client.1.smithi131.stdout:0/444: unlink d5/d9/d11/d3e/f48 0 2024-02-15T18:31:34.560 INFO:tasks.workunit.client.1.smithi131.stdout:0/445: read - d5/d9/d4d/f89 zero size 2024-02-15T18:31:34.565 INFO:tasks.workunit.client.1.smithi131.stdout:8/462: dwrite d22/d26/f6c [0,4194304] 0 2024-02-15T18:31:34.565 INFO:tasks.workunit.client.1.smithi131.stdout:0/446: dread d5/d9/d11/d3e/f59 [0,4194304] 0 2024-02-15T18:31:34.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/463: mknod d22/c9d 0 2024-02-15T18:31:34.567 INFO:tasks.workunit.client.1.smithi131.stdout:0/447: symlink d5/d2f/d4b/d82/l8f 0 2024-02-15T18:31:34.568 INFO:tasks.workunit.client.1.smithi131.stdout:0/448: dread - d5/d9/f80 zero size 2024-02-15T18:31:34.571 INFO:tasks.workunit.client.1.smithi131.stdout:8/464: mknod d22/d26/d3f/d47/d48/d84/c9e 0 2024-02-15T18:31:34.571 INFO:tasks.workunit.client.1.smithi131.stdout:8/465: write d22/d26/f76 [697738,53959] 0 2024-02-15T18:31:34.573 INFO:tasks.workunit.client.1.smithi131.stdout:8/466: mkdir d22/d26/d3f/d47/d57/d9f 0 2024-02-15T18:31:34.575 INFO:tasks.workunit.client.1.smithi131.stdout:8/467: truncate f1c 4204049 0 2024-02-15T18:31:34.576 INFO:tasks.workunit.client.1.smithi131.stdout:8/468: write d22/d26/f2f [330897,35599] 0 2024-02-15T18:31:34.580 INFO:tasks.workunit.client.1.smithi131.stdout:8/469: creat d22/d2e/fa0 x:0 0 0 2024-02-15T18:31:34.582 INFO:tasks.workunit.client.1.smithi131.stdout:8/470: mknod d22/d26/d3f/d47/d48/d5f/d6f/ca1 0 2024-02-15T18:31:34.586 INFO:tasks.workunit.client.1.smithi131.stdout:8/471: unlink d22/c25 0 2024-02-15T18:31:34.586 INFO:tasks.workunit.client.1.smithi131.stdout:8/472: truncate d22/d2e/f63 682068 0 2024-02-15T18:31:34.588 INFO:tasks.workunit.client.1.smithi131.stdout:4/608: sync 2024-02-15T18:31:34.588 INFO:tasks.workunit.client.1.smithi131.stdout:3/680: sync 2024-02-15T18:31:34.589 INFO:tasks.workunit.client.1.smithi131.stdout:3/681: write d2/d22/d5e/d79/f98 [218497,76207] 0 2024-02-15T18:31:34.589 INFO:tasks.workunit.client.1.smithi131.stdout:3/682: chown d2/d22/d42/fd9 735880 1 2024-02-15T18:31:34.589 INFO:tasks.workunit.client.1.smithi131.stdout:3/683: chown d2/d22/d29/db/lb1 49796 1 2024-02-15T18:31:34.589 INFO:tasks.workunit.client.1.smithi131.stdout:3/684: dread - d2/d22/d3a/fb6 zero size 2024-02-15T18:31:34.590 INFO:tasks.workunit.client.1.smithi131.stdout:4/609: mkdir d2/d2a/d85/da3/dbf/ddc 0 2024-02-15T18:31:34.592 INFO:tasks.workunit.client.1.smithi131.stdout:3/685: creat d2/d22/ddd/fdf x:0 0 0 2024-02-15T18:31:34.592 INFO:tasks.workunit.client.1.smithi131.stdout:8/473: dread d22/d2e/f63 [0,4194304] 0 2024-02-15T18:31:34.592 INFO:tasks.workunit.client.1.smithi131.stdout:8/474: dread - d22/d2e/d60/f90 zero size 2024-02-15T18:31:34.594 INFO:tasks.workunit.client.1.smithi131.stdout:4/610: rename d2/d7/fc9 to d2/d7/d1c/d94/fdd 0 2024-02-15T18:31:34.594 INFO:tasks.workunit.client.1.smithi131.stdout:4/611: chown d2/d7/d1c/d5d 5 1 2024-02-15T18:31:34.596 INFO:tasks.workunit.client.1.smithi131.stdout:3/686: rename d2/d22/d29/db/d1a/f6b to d2/d22/d29/db/d84/fe0 0 2024-02-15T18:31:34.598 INFO:tasks.workunit.client.1.smithi131.stdout:4/612: getdents d2/d7/d1c 0 2024-02-15T18:31:34.598 INFO:tasks.workunit.client.1.smithi131.stdout:4/613: write d2/d2a/d47/d16/d43/f61 [4248955,29573] 0 2024-02-15T18:31:34.598 INFO:tasks.workunit.client.1.smithi131.stdout:8/475: dread d22/f30 [0,4194304] 0 2024-02-15T18:31:34.598 INFO:tasks.workunit.client.1.smithi131.stdout:8/476: dread - d22/d26/d3f/d47/d48/d5f/d6f/d7a/f9b zero size 2024-02-15T18:31:34.598 INFO:tasks.workunit.client.1.smithi131.stdout:8/477: fsync d22/d26/f82 0 2024-02-15T18:31:34.599 INFO:tasks.workunit.client.1.smithi131.stdout:3/687: mkdir d2/d22/d29/db/d1a/de1 0 2024-02-15T18:31:34.599 INFO:tasks.workunit.client.1.smithi131.stdout:3/688: chown d2/d22/d29/db/d1a/c7a 63609 1 2024-02-15T18:31:34.600 INFO:tasks.workunit.client.1.smithi131.stdout:8/478: mkdir d22/d41/da2 0 2024-02-15T18:31:34.612 INFO:tasks.workunit.client.1.smithi131.stdout:8/479: write d22/d41/f5d [2755848,116363] 0 2024-02-15T18:31:34.612 INFO:tasks.workunit.client.1.smithi131.stdout:8/480: chown d22/d26/d3f/f4f 142 1 2024-02-15T18:31:34.614 INFO:tasks.workunit.client.1.smithi131.stdout:8/481: creat d22/d26/d3f/d47/d48/d5f/fa3 x:0 0 0 2024-02-15T18:31:34.616 INFO:tasks.workunit.client.1.smithi131.stdout:8/482: rename d22/d2e/f38 to d22/d26/d3f/d47/fa4 0 2024-02-15T18:31:34.617 INFO:tasks.workunit.client.1.smithi131.stdout:8/483: symlink d22/d26/d3f/d47/d48/d5f/d6f/d7a/la5 0 2024-02-15T18:31:34.619 INFO:tasks.workunit.client.1.smithi131.stdout:3/689: dwrite d2/d22/d29/d20/d86/fc1 [0,4194304] 0 2024-02-15T18:31:34.620 INFO:tasks.workunit.client.1.smithi131.stdout:3/690: write d2/d22/d5e/d79/fa2 [711642,69287] 0 2024-02-15T18:31:34.620 INFO:tasks.workunit.client.1.smithi131.stdout:3/691: chown d2/d22/d29/d20/lbf 805166 1 2024-02-15T18:31:34.620 INFO:tasks.workunit.client.1.smithi131.stdout:3/692: chown d2/d22/fcd 3301816 1 2024-02-15T18:31:34.621 INFO:tasks.workunit.client.1.smithi131.stdout:4/614: dwrite d2/f4 [0,4194304] 0 2024-02-15T18:31:34.621 INFO:tasks.workunit.client.1.smithi131.stdout:8/484: write d22/d26/d3f/d86/f88 [66907,93110] 0 2024-02-15T18:31:34.622 INFO:tasks.workunit.client.1.smithi131.stdout:8/485: write d22/d26/d3f/d47/fa4 [3248975,68490] 0 2024-02-15T18:31:34.656 INFO:tasks.workunit.client.1.smithi131.stdout:3/693: rename d2/ca7 to d2/d22/d29/db/d1a/da4/d70/ce2 0 2024-02-15T18:31:34.657 INFO:tasks.workunit.client.1.smithi131.stdout:4/615: unlink d2/d2a/d47/d16/d43/f61 0 2024-02-15T18:31:34.659 INFO:tasks.workunit.client.1.smithi131.stdout:8/486: creat d22/d41/fa6 x:0 0 0 2024-02-15T18:31:34.661 INFO:tasks.workunit.client.1.smithi131.stdout:3/694: dread d2/d22/f63 [0,4194304] 0 2024-02-15T18:31:34.661 INFO:tasks.workunit.client.1.smithi131.stdout:3/695: dread - d2/d22/d29/db/d1a/da4/fb9 zero size 2024-02-15T18:31:34.661 INFO:tasks.workunit.client.1.smithi131.stdout:3/696: read - d2/d22/d29/db/d23/f94 zero size 2024-02-15T18:31:34.661 INFO:tasks.workunit.client.1.smithi131.stdout:3/697: chown d2/cd3 3 1 2024-02-15T18:31:34.661 INFO:tasks.workunit.client.1.smithi131.stdout:3/698: write d2/d22/d29/db/d23/d2a/f87 [413019,121812] 0 2024-02-15T18:31:34.661 INFO:tasks.workunit.client.1.smithi131.stdout:3/699: chown d2/d22/d29/d20/d86 4063252 1 2024-02-15T18:31:34.661 INFO:tasks.workunit.client.1.smithi131.stdout:4/616: creat d2/d7/d12/dd1/fde x:0 0 0 2024-02-15T18:31:34.662 INFO:tasks.workunit.client.1.smithi131.stdout:8/487: rename d22/d26/d3f/d47/d48/d5f/d6f/d7a/l7f to d22/d26/d3f/d47/d57/d9f/la7 0 2024-02-15T18:31:34.674 INFO:tasks.workunit.client.1.smithi131.stdout:3/700: write d2/d22/d29/f39 [178615,258] 0 2024-02-15T18:31:34.675 INFO:tasks.workunit.client.1.smithi131.stdout:4/617: mknod d2/d7/d12/cdf 0 2024-02-15T18:31:34.675 INFO:tasks.workunit.client.1.smithi131.stdout:4/618: truncate d2/f1f 1718865 0 2024-02-15T18:31:34.681 INFO:tasks.workunit.client.1.smithi131.stdout:8/488: mknod d22/d26/d3f/d47/d48/d5f/ca8 0 2024-02-15T18:31:34.684 INFO:tasks.workunit.client.1.smithi131.stdout:3/701: mkdir d2/d22/d3f/de3 0 2024-02-15T18:31:34.684 INFO:tasks.workunit.client.1.smithi131.stdout:3/702: chown d2/d22/c4e 0 1 2024-02-15T18:31:34.684 INFO:tasks.workunit.client.1.smithi131.stdout:3/703: chown d2/d22/d29/db/d23/c48 104536682 1 2024-02-15T18:31:34.691 INFO:tasks.workunit.client.1.smithi131.stdout:4/619: creat d2/d23/fe0 x:0 0 0 2024-02-15T18:31:34.691 INFO:tasks.workunit.client.1.smithi131.stdout:4/620: truncate d2/d7/d12/d53/fbb 1125276 0 2024-02-15T18:31:34.692 INFO:tasks.workunit.client.1.smithi131.stdout:8/489: link d22/d26/d3f/d47/d48/l66 d22/d39/la9 0 2024-02-15T18:31:34.693 INFO:tasks.workunit.client.1.smithi131.stdout:3/704: getdents d2/d22/d5e/d79 0 2024-02-15T18:31:34.693 INFO:tasks.workunit.client.1.smithi131.stdout:3/705: chown d2/d22/d29/db/lb1 7951404 1 2024-02-15T18:31:34.695 INFO:tasks.workunit.client.1.smithi131.stdout:4/621: creat d2/d2a/d47/d21/dcd/fe1 x:0 0 0 2024-02-15T18:31:34.695 INFO:tasks.workunit.client.1.smithi131.stdout:4/622: readlink d2/d7/d12/d2e/d39/d4b/la8 0 2024-02-15T18:31:34.695 INFO:tasks.workunit.client.1.smithi131.stdout:8/490: mkdir d22/d41/daa 0 2024-02-15T18:31:34.698 INFO:tasks.workunit.client.1.smithi131.stdout:4/623: rename d2/d7/d12/d2e/d39/d4b/cd9 to d2/d7/d12/d53/ce2 0 2024-02-15T18:31:34.701 INFO:tasks.workunit.client.1.smithi131.stdout:8/491: getdents d22/d2e 0 2024-02-15T18:31:34.701 INFO:tasks.workunit.client.1.smithi131.stdout:4/624: mkdir d2/d2a/d85/da3/db4/de3 0 2024-02-15T18:31:34.706 INFO:tasks.workunit.client.1.smithi131.stdout:8/492: creat d22/d26/d3f/d47/d48/d5f/d6f/d7a/fab x:0 0 0 2024-02-15T18:31:34.711 INFO:tasks.workunit.client.1.smithi131.stdout:8/493: dread f1d [0,4194304] 0 2024-02-15T18:31:34.712 INFO:tasks.workunit.client.1.smithi131.stdout:8/494: link d22/d41/f5d d22/d39/fac 0 2024-02-15T18:31:34.716 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:33.449536+0000 mgr.smithi033.apxevf (mgr.14626) 5 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.6 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-02-15T18:31:34.716 INFO:tasks.workunit.client.1.smithi131.stdout:3/706: dwrite d2/d22/d29/db/f53 [0,4194304] 0 2024-02-15T18:31:34.717 INFO:tasks.workunit.client.1.smithi131.stdout:4/625: dwrite d2/d7/d1c/f74 [0,4194304] 0 2024-02-15T18:31:34.717 INFO:tasks.workunit.client.1.smithi131.stdout:4/626: fdatasync d2/d7/d1c/f51 0 2024-02-15T18:31:34.717 INFO:tasks.workunit.client.1.smithi131.stdout:4/627: stat d2/d7/d1c/d94/f95 0 2024-02-15T18:31:34.717 INFO:tasks.workunit.client.1.smithi131.stdout:3/707: creat d2/d22/d29/db/fe4 x:0 0 0 2024-02-15T18:31:34.721 INFO:tasks.workunit.client.1.smithi131.stdout:4/628: link d2/d2a/d47/d16/l65 d2/d2a/d47/d21/dcd/le4 0 2024-02-15T18:31:34.721 INFO:tasks.workunit.client.1.smithi131.stdout:4/629: chown d2/d7/d1c 65591946 1 2024-02-15T18:31:34.721 INFO:tasks.workunit.client.1.smithi131.stdout:3/708: truncate d2/d22/d29/db/d23/d2a/d49/f66 201875 0 2024-02-15T18:31:34.722 INFO:tasks.workunit.client.1.smithi131.stdout:4/630: truncate d2/d7/d1c/d94/fdd 3959105 0 2024-02-15T18:31:34.728 INFO:tasks.workunit.client.1.smithi131.stdout:4/631: mknod d2/d2a/d76/ce5 0 2024-02-15T18:31:34.728 INFO:tasks.workunit.client.1.smithi131.stdout:4/632: chown d2/d7/f10 6233542 1 2024-02-15T18:31:34.730 INFO:tasks.workunit.client.1.smithi131.stdout:3/709: rename d2/d22/d3a/l5a to d2/d22/d5e/d79/d9d/le5 0 2024-02-15T18:31:34.733 INFO:tasks.workunit.client.1.smithi131.stdout:8/495: dwrite d22/d26/d3f/d86/f91 [0,4194304] 0 2024-02-15T18:31:34.733 INFO:tasks.workunit.client.1.smithi131.stdout:8/496: write d22/d26/d3f/d47/d48/d5f/d6f/d7a/f9b [132971,8272] 0 2024-02-15T18:31:34.733 INFO:tasks.workunit.client.1.smithi131.stdout:8/497: truncate d22/d26/d3f/d47/d48/d5f/fa3 319813 0 2024-02-15T18:31:34.734 INFO:tasks.workunit.client.1.smithi131.stdout:3/710: creat d2/d22/d29/db/d1a/fe6 x:0 0 0 2024-02-15T18:31:34.734 INFO:tasks.workunit.client.1.smithi131.stdout:3/711: readlink d2/d22/d29/db/lcb 0 2024-02-15T18:31:34.740 INFO:tasks.workunit.client.1.smithi131.stdout:8/498: getdents d22/d2e/d60 0 2024-02-15T18:31:34.740 INFO:tasks.workunit.client.1.smithi131.stdout:8/499: stat d22/d2e/c61 0 2024-02-15T18:31:34.746 INFO:tasks.workunit.client.1.smithi131.stdout:8/500: creat d22/d26/d3f/fad x:0 0 0 2024-02-15T18:31:34.746 INFO:tasks.workunit.client.1.smithi131.stdout:8/501: chown d22/d26/d3f/d47/l5c 4 1 2024-02-15T18:31:34.746 INFO:tasks.workunit.client.1.smithi131.stdout:8/502: fsync d22/d2e/f37 0 2024-02-15T18:31:34.746 INFO:tasks.workunit.client.1.smithi131.stdout:3/712: mknod d2/d22/d29/db/d23/d2a/d5b/ce7 0 2024-02-15T18:31:34.748 INFO:tasks.workunit.client.1.smithi131.stdout:8/503: creat d22/d26/d3f/d47/fae x:0 0 0 2024-02-15T18:31:34.748 INFO:tasks.workunit.client.1.smithi131.stdout:8/504: fsync d22/f27 0 2024-02-15T18:31:34.748 INFO:tasks.workunit.client.1.smithi131.stdout:8/505: getdents d22/d2e/d60 0 2024-02-15T18:31:34.749 INFO:tasks.workunit.client.1.smithi131.stdout:4/633: dread d2/d2a/d47/d16/d43/f6c [0,4194304] 0 2024-02-15T18:31:34.749 INFO:tasks.workunit.client.1.smithi131.stdout:4/634: chown d2/d23/fc4 251995249 1 2024-02-15T18:31:34.749 INFO:tasks.workunit.client.1.smithi131.stdout:3/713: mknod d2/d22/d29/db/d23/d2a/ce8 0 2024-02-15T18:31:34.753 INFO:tasks.workunit.client.1.smithi131.stdout:4/635: rename d2/d7/d12/d2e/d39/d4b/la8 to d2/d7/d1c/d5d/d7a/d92/le6 0 2024-02-15T18:31:34.753 INFO:tasks.workunit.client.1.smithi131.stdout:4/636: fdatasync d2/d7/d1c/d5d/d7a/d92/fad 0 2024-02-15T18:31:34.753 INFO:tasks.workunit.client.1.smithi131.stdout:8/506: unlink d22/d26/d3f/c81 0 2024-02-15T18:31:34.754 INFO:tasks.workunit.client.1.smithi131.stdout:3/714: symlink d2/d22/d29/db/d1a/de1/le9 0 2024-02-15T18:31:34.755 INFO:tasks.workunit.client.1.smithi131.stdout:3/715: write d2/d22/d29/f4a [598992,42067] 0 2024-02-15T18:31:34.755 INFO:tasks.workunit.client.1.smithi131.stdout:4/637: creat d2/d23/fe7 x:0 0 0 2024-02-15T18:31:34.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/507: getdents d22/d26/d3f/d47/d57/d9f 0 2024-02-15T18:31:34.757 INFO:tasks.workunit.client.1.smithi131.stdout:3/716: creat d2/d22/d29/d9e/fea x:0 0 0 2024-02-15T18:31:34.758 INFO:tasks.workunit.client.1.smithi131.stdout:8/508: mkdir d22/d26/d3f/d47/d48/d84/daf 0 2024-02-15T18:31:34.758 INFO:tasks.workunit.client.1.smithi131.stdout:8/509: dread - d22/d2e/d60/f90 zero size 2024-02-15T18:31:34.759 INFO:tasks.workunit.client.1.smithi131.stdout:3/717: symlink d2/d22/d29/d9e/leb 0 2024-02-15T18:31:34.760 INFO:tasks.workunit.client.1.smithi131.stdout:8/510: mkdir d22/d26/d3f/d47/d48/d5f/d70/db0 0 2024-02-15T18:31:34.762 INFO:tasks.workunit.client.1.smithi131.stdout:3/718: rename d2/d22/d29/f58 to d2/d22/d5e/d79/fec 0 2024-02-15T18:31:34.763 INFO:tasks.workunit.client.1.smithi131.stdout:8/511: creat d22/d26/d3f/d47/d48/d84/daf/fb1 x:0 0 0 2024-02-15T18:31:34.767 INFO:tasks.workunit.client.1.smithi131.stdout:8/512: dread d22/d26/f55 [0,4194304] 0 2024-02-15T18:31:34.769 INFO:tasks.workunit.client.1.smithi131.stdout:3/719: dread d2/d22/d29/db/d1a/da4/d70/fb5 [0,4194304] 0 2024-02-15T18:31:34.769 INFO:tasks.workunit.client.1.smithi131.stdout:3/720: truncate d2/d22/fcd 242330 0 2024-02-15T18:31:34.769 INFO:tasks.workunit.client.1.smithi131.stdout:8/513: rename d22/d26/d3f/d47/d48/l53 to d22/d26/d3f/lb2 0 2024-02-15T18:31:34.772 INFO:tasks.workunit.client.1.smithi131.stdout:3/721: unlink d2/d22/d29/db/d1a/da4/d70/lbb 0 2024-02-15T18:31:34.775 INFO:tasks.workunit.client.1.smithi131.stdout:4/638: dwrite d2/d23/f72 [0,4194304] 0 2024-02-15T18:31:34.775 INFO:tasks.workunit.client.1.smithi131.stdout:4/639: write d2/d2a/d47/d16/f32 [4281410,21296] 0 2024-02-15T18:31:34.775 INFO:tasks.workunit.client.1.smithi131.stdout:4/640: chown d2/d2a/d47/d16/f30 745 1 2024-02-15T18:31:34.777 INFO:tasks.workunit.client.1.smithi131.stdout:4/641: write d2/d7/d1c/d5d/f7b [2434140,73877] 0 2024-02-15T18:31:34.777 INFO:tasks.workunit.client.1.smithi131.stdout:4/642: fdatasync d2/d23/fc4 0 2024-02-15T18:31:34.780 INFO:tasks.workunit.client.1.smithi131.stdout:4/643: unlink d2/d2a/d76/fb5 0 2024-02-15T18:31:34.786 INFO:tasks.workunit.client.1.smithi131.stdout:8/514: dwrite d22/d26/d3f/d47/fae [0,4194304] 0 2024-02-15T18:31:34.796 INFO:tasks.workunit.client.1.smithi131.stdout:4/644: symlink d2/d7/d12/le8 0 2024-02-15T18:31:34.797 INFO:tasks.workunit.client.1.smithi131.stdout:4/645: stat d2/d2a/d47/d16/l7c 0 2024-02-15T18:31:34.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:33.449536+0000 mgr.smithi033.apxevf (mgr.14626) 5 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 1.6 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail 2024-02-15T18:31:34.800 INFO:tasks.workunit.client.1.smithi131.stdout:8/515: getdents d22/d41 0 2024-02-15T18:31:34.800 INFO:tasks.workunit.client.1.smithi131.stdout:8/516: truncate d22/f32 176680 0 2024-02-15T18:31:34.801 INFO:tasks.workunit.client.1.smithi131.stdout:4/646: mknod d2/d7/ce9 0 2024-02-15T18:31:34.848 INFO:tasks.workunit.client.1.smithi131.stdout:8/517: creat d22/d26/d3f/d47/d48/d5f/d6f/fb3 x:0 0 0 2024-02-15T18:31:34.848 INFO:tasks.workunit.client.1.smithi131.stdout:8/518: stat d22/c9c 0 2024-02-15T18:31:34.848 INFO:tasks.workunit.client.1.smithi131.stdout:4/647: symlink d2/d2a/d47/lea 0 2024-02-15T18:31:34.853 INFO:tasks.workunit.client.1.smithi131.stdout:8/519: rename d22/f30 to d22/d2e/d5e/fb4 0 2024-02-15T18:31:34.855 INFO:tasks.workunit.client.1.smithi131.stdout:4/648: mknod d2/d7/d1c/d5d/d7a/ceb 0 2024-02-15T18:31:34.857 INFO:tasks.workunit.client.1.smithi131.stdout:8/520: mkdir d22/d2e/d5e/db5 0 2024-02-15T18:31:34.859 INFO:tasks.workunit.client.1.smithi131.stdout:4/649: symlink d2/d7/d96/lec 0 2024-02-15T18:31:34.862 INFO:tasks.workunit.client.1.smithi131.stdout:8/521: truncate d22/d26/f82 1246757 0 2024-02-15T18:31:34.862 INFO:tasks.workunit.client.1.smithi131.stdout:8/522: dread - d22/d2e/f9a zero size 2024-02-15T18:31:34.864 INFO:tasks.workunit.client.1.smithi131.stdout:4/650: unlink d2/d2a/d68/cb1 0 2024-02-15T18:31:34.866 INFO:tasks.workunit.client.1.smithi131.stdout:8/523: rename d22/d26/d3f/lb2 to d22/d26/d3f/lb6 0 2024-02-15T18:31:34.874 INFO:tasks.workunit.client.1.smithi131.stdout:4/651: rmdir d2/d7/d1c/d5d/d7a 39 2024-02-15T18:31:34.874 INFO:tasks.workunit.client.1.smithi131.stdout:4/652: dread - d2/d7/d12/d2e/d39/d4b/fc8 zero size 2024-02-15T18:31:34.875 INFO:tasks.workunit.client.1.smithi131.stdout:8/524: creat d22/d26/d3f/d7c/fb7 x:0 0 0 2024-02-15T18:31:34.875 INFO:tasks.workunit.client.1.smithi131.stdout:8/525: readlink d22/d26/d3f/d47/d57/d9f/la7 0 2024-02-15T18:31:34.875 INFO:tasks.workunit.client.1.smithi131.stdout:8/526: readlink d22/d2e/l31 0 2024-02-15T18:31:34.878 INFO:tasks.workunit.client.1.smithi131.stdout:8/527: symlink d22/d2e/d5e/db5/lb8 0 2024-02-15T18:31:34.886 INFO:tasks.workunit.client.1.smithi131.stdout:4/653: dread d2/d2a/d47/f19 [0,4194304] 0 2024-02-15T18:31:34.890 INFO:tasks.workunit.client.1.smithi131.stdout:4/654: mknod d2/d7/d1c/ced 0 2024-02-15T18:31:34.890 INFO:tasks.workunit.client.1.smithi131.stdout:4/655: truncate d2/d23/fe0 793446 0 2024-02-15T18:31:34.894 INFO:tasks.workunit.client.1.smithi131.stdout:4/656: rename d2/d7/d12/d2e/d5f/d70/f73 to d2/d2a/d85/da3/dba/fee 0 2024-02-15T18:31:34.899 INFO:tasks.workunit.client.1.smithi131.stdout:8/528: dwrite d22/d2e/d5e/fb4 [0,4194304] 0 2024-02-15T18:31:34.903 INFO:tasks.workunit.client.1.smithi131.stdout:8/529: rename f1c to d22/d26/d3f/d86/fb9 0 2024-02-15T18:31:34.903 INFO:tasks.workunit.client.1.smithi131.stdout:8/530: chown d22/d41/fa6 97 1 2024-02-15T18:31:34.905 INFO:tasks.workunit.client.1.smithi131.stdout:8/531: rename d22/d26/d3f/f4f to d22/d2e/fba 0 2024-02-15T18:31:34.907 INFO:tasks.workunit.client.1.smithi131.stdout:8/532: mknod d22/d26/d3f/d47/d48/d5f/cbb 0 2024-02-15T18:31:34.908 INFO:tasks.workunit.client.1.smithi131.stdout:8/533: mknod d22/d26/d3f/d47/d48/cbc 0 2024-02-15T18:31:34.913 INFO:tasks.workunit.client.1.smithi131.stdout:4/657: dwrite d2/d7/d1c/d5d/d7a/d92/fd8 [0,4194304] 0 2024-02-15T18:31:34.917 INFO:tasks.workunit.client.1.smithi131.stdout:4/658: symlink d2/d7/d1c/d84/db8/lef 0 2024-02-15T18:31:34.918 INFO:tasks.workunit.client.1.smithi131.stdout:5/566: sync 2024-02-15T18:31:34.918 INFO:tasks.workunit.client.1.smithi131.stdout:4/659: mkdir d2/d2a/d47/df0 0 2024-02-15T18:31:34.919 INFO:tasks.workunit.client.1.smithi131.stdout:5/567: write d18/d83/d8b/dba/d7b/f84 [925873,82813] 0 2024-02-15T18:31:34.927 INFO:tasks.workunit.client.1.smithi131.stdout:4/660: mkdir d2/d2a/d76/ddb/df1 0 2024-02-15T18:31:34.927 INFO:tasks.workunit.client.1.smithi131.stdout:4/661: truncate d2/d7/d12/f79 390871 0 2024-02-15T18:31:34.927 INFO:tasks.workunit.client.1.smithi131.stdout:4/662: chown d2/d7/d12/d2e/fc1 1 1 2024-02-15T18:31:34.930 INFO:tasks.workunit.client.1.smithi131.stdout:8/534: dwrite d22/d26/f4e [0,4194304] 0 2024-02-15T18:31:34.932 INFO:tasks.workunit.client.1.smithi131.stdout:5/568: rename d18/d83/d8b/dba/l51 to d18/d83/d8b/dba/d7b/db8/lbe 0 2024-02-15T18:31:34.934 INFO:tasks.workunit.client.1.smithi131.stdout:4/663: link d2/d23/fc4 d2/d7/d1c/d88/ff2 0 2024-02-15T18:31:34.937 INFO:tasks.workunit.client.1.smithi131.stdout:8/535: mknod d22/d41/da2/cbd 0 2024-02-15T18:31:34.946 INFO:tasks.workunit.client.1.smithi131.stdout:5/569: rename d18/d6d/la0 to d18/d83/d8b/dba/lbf 0 2024-02-15T18:31:34.956 INFO:tasks.workunit.client.1.smithi131.stdout:8/536: dwrite d22/d41/f59 [0,4194304] 0 2024-02-15T18:31:34.956 INFO:tasks.workunit.client.1.smithi131.stdout:8/537: chown d22/d26/d3f/d47/d48/d5f/d6f/c96 2814 1 2024-02-15T18:31:34.957 INFO:tasks.workunit.client.1.smithi131.stdout:8/538: link f14 d22/d2e/d5e/db5/fbe 0 2024-02-15T18:31:34.960 INFO:tasks.workunit.client.1.smithi131.stdout:8/539: creat d22/d26/d3f/d47/d48/d5f/d70/db0/fbf x:0 0 0 2024-02-15T18:31:34.960 INFO:tasks.workunit.client.1.smithi131.stdout:8/540: chown d22/f6b 739 1 2024-02-15T18:31:34.960 INFO:tasks.workunit.client.1.smithi131.stdout:8/541: fdatasync d22/d26/d3f/d47/d48/d84/f98 0 2024-02-15T18:31:34.960 INFO:tasks.workunit.client.1.smithi131.stdout:8/542: write d22/d2e/f37 [1956034,3758] 0 2024-02-15T18:31:34.966 INFO:tasks.workunit.client.1.smithi131.stdout:4/664: dwrite d2/f4 [4194304,4194304] 0 2024-02-15T18:31:34.979 INFO:tasks.workunit.client.1.smithi131.stdout:8/543: dwrite d22/d41/f59 [4194304,4194304] 0 2024-02-15T18:31:34.987 INFO:tasks.workunit.client.1.smithi131.stdout:5/570: dwrite d18/d6d/d70/fb3 [0,4194304] 0 2024-02-15T18:31:34.987 INFO:tasks.workunit.client.1.smithi131.stdout:4/665: dread d2/f8 [0,4194304] 0 2024-02-15T18:31:34.988 INFO:tasks.workunit.client.1.smithi131.stdout:5/571: chown d18/d83 3668 1 2024-02-15T18:31:34.988 INFO:tasks.workunit.client.1.smithi131.stdout:5/572: fdatasync d18/d20/f35 0 2024-02-15T18:31:34.989 INFO:tasks.workunit.client.1.smithi131.stdout:8/544: unlink d22/d26/d3f/d86/fb9 0 2024-02-15T18:31:34.989 INFO:tasks.workunit.client.1.smithi131.stdout:8/545: stat d22/d26/d3f/d47/d48/d84/daf/fb1 0 2024-02-15T18:31:34.991 INFO:tasks.workunit.client.1.smithi131.stdout:8/546: dread f1d [0,4194304] 0 2024-02-15T18:31:34.996 INFO:tasks.workunit.client.1.smithi131.stdout:4/666: mknod d2/cf3 0 2024-02-15T18:31:34.996 INFO:tasks.workunit.client.1.smithi131.stdout:4/667: write d2/d2a/d47/d16/d43/f7e [291293,14172] 0 2024-02-15T18:31:35.001 INFO:tasks.workunit.client.1.smithi131.stdout:5/573: unlink d18/d33/f54 0 2024-02-15T18:31:35.002 INFO:tasks.workunit.client.1.smithi131.stdout:8/547: unlink d22/d26/d3f/d47/d48/d5f/d6f/d7a/f9b 0 2024-02-15T18:31:35.004 INFO:tasks.workunit.client.1.smithi131.stdout:4/668: creat d2/d7/d12/d2e/d39/d4b/ff4 x:0 0 0 2024-02-15T18:31:35.006 INFO:tasks.workunit.client.1.smithi131.stdout:8/548: rename d22/d26/d3f/d7c/fb7 to d22/d26/d3f/d47/d48/d5f/fc0 0 2024-02-15T18:31:35.008 INFO:tasks.workunit.client.1.smithi131.stdout:4/669: rmdir d2/d7/d1c/d84 39 2024-02-15T18:31:35.009 INFO:tasks.workunit.client.1.smithi131.stdout:8/549: mkdir d22/d26/d3f/d47/d57/dc1 0 2024-02-15T18:31:35.009 INFO:tasks.workunit.client.1.smithi131.stdout:5/574: dread d18/d23/f52 [0,4194304] 0 2024-02-15T18:31:35.010 INFO:tasks.workunit.client.1.smithi131.stdout:8/550: creat d22/d26/d3f/d47/d48/d5f/d6f/fc2 x:0 0 0 2024-02-15T18:31:35.012 INFO:tasks.workunit.client.1.smithi131.stdout:5/575: rename d18/d33/f5e to d18/d6d/d70/d9e/d85/d95/fc0 0 2024-02-15T18:31:35.014 INFO:tasks.workunit.client.1.smithi131.stdout:8/551: mkdir d22/d26/d3f/d47/dc3 0 2024-02-15T18:31:35.014 INFO:tasks.workunit.client.1.smithi131.stdout:8/552: chown d22/d26/d3f/d86 65428 1 2024-02-15T18:31:35.016 INFO:tasks.workunit.client.1.smithi131.stdout:8/553: write d22/d26/d3f/d47/fa4 [391314,71024] 0 2024-02-15T18:31:35.021 INFO:tasks.workunit.client.1.smithi131.stdout:8/554: getdents d22/d26/d3f/d47/d57 0 2024-02-15T18:31:35.021 INFO:tasks.workunit.client.1.smithi131.stdout:8/555: write fb [2687988,2728] 0 2024-02-15T18:31:35.022 INFO:tasks.workunit.client.1.smithi131.stdout:8/556: write d22/d2e/d5e/f80 [133455,111003] 0 2024-02-15T18:31:35.023 INFO:tasks.workunit.client.1.smithi131.stdout:8/557: symlink d22/d2e/lc4 0 2024-02-15T18:31:35.033 INFO:tasks.workunit.client.1.smithi131.stdout:5/576: dread d18/d23/f3a [0,4194304] 0 2024-02-15T18:31:35.039 INFO:tasks.workunit.client.1.smithi131.stdout:8/558: dwrite d22/d26/d3f/d47/d48/d84/f98 [8388608,4194304] 0 2024-02-15T18:31:35.039 INFO:tasks.workunit.client.1.smithi131.stdout:8/559: write d22/f3e [15753,120727] 0 2024-02-15T18:31:35.041 INFO:tasks.workunit.client.1.smithi131.stdout:8/560: mkdir d22/d26/d3f/d47/d57/dc5 0 2024-02-15T18:31:35.041 INFO:tasks.workunit.client.1.smithi131.stdout:8/561: write fb [4036470,59429] 0 2024-02-15T18:31:35.042 INFO:tasks.workunit.client.1.smithi131.stdout:8/562: symlink d22/d41/da2/lc6 0 2024-02-15T18:31:35.042 INFO:tasks.workunit.client.1.smithi131.stdout:8/563: chown d22/d26/d3f/d47/d48/d5f/d6f/c96 2606 1 2024-02-15T18:31:35.043 INFO:tasks.workunit.client.1.smithi131.stdout:8/564: truncate d22/d26/d3f/d47/f6a 2303271 0 2024-02-15T18:31:35.043 INFO:tasks.workunit.client.1.smithi131.stdout:8/565: chown d22/d26/d3f/d47/d48 1435289 1 2024-02-15T18:31:35.043 INFO:tasks.workunit.client.1.smithi131.stdout:8/566: getdents d22/d26/d3f/d47/d57/d9f 0 2024-02-15T18:31:35.043 INFO:tasks.workunit.client.1.smithi131.stdout:8/567: read - d22/d26/d3f/d47/d48/d5f/fc0 zero size 2024-02-15T18:31:35.043 INFO:tasks.workunit.client.1.smithi131.stdout:8/568: truncate d22/f3e 1345784 0 2024-02-15T18:31:35.045 INFO:tasks.workunit.client.1.smithi131.stdout:8/569: mkdir d22/d26/d3f/d47/d48/d5f/d70/dc7 0 2024-02-15T18:31:35.049 INFO:tasks.workunit.client.1.smithi131.stdout:8/570: unlink d22/d2e/f37 0 2024-02-15T18:31:35.052 INFO:tasks.workunit.client.1.smithi131.stdout:5/577: dwrite d18/d4e/f94 [0,4194304] 0 2024-02-15T18:31:35.055 INFO:tasks.workunit.client.1.smithi131.stdout:8/571: getdents d22/d26/d3f/d47 0 2024-02-15T18:31:35.059 INFO:tasks.workunit.client.1.smithi131.stdout:5/578: rename d18/d83/d8b/dba/d63/f99 to d18/d6d/d70/d9e/d86/fc1 0 2024-02-15T18:31:35.059 INFO:tasks.workunit.client.1.smithi131.stdout:5/579: chown d18/d83/d8b/dba/d63/f72 15 1 2024-02-15T18:31:35.060 INFO:tasks.workunit.client.1.smithi131.stdout:2/446: sync 2024-02-15T18:31:35.062 INFO:tasks.workunit.client.1.smithi131.stdout:5/580: symlink d18/d33/d73/lc2 0 2024-02-15T18:31:35.062 INFO:tasks.workunit.client.1.smithi131.stdout:5/581: fdatasync d18/d83/d8b/dba/f87 0 2024-02-15T18:31:35.062 INFO:tasks.workunit.client.1.smithi131.stdout:5/582: dread - d18/d6d/d70/d9e/d86/fc1 zero size 2024-02-15T18:31:35.062 INFO:tasks.workunit.client.1.smithi131.stdout:5/583: write d18/d23/f52 [3808103,103724] 0 2024-02-15T18:31:35.064 INFO:tasks.workunit.client.1.smithi131.stdout:2/447: creat dd/d10/d22/d2a/f93 x:0 0 0 2024-02-15T18:31:35.069 INFO:tasks.workunit.client.1.smithi131.stdout:5/584: dread d18/d23/f3a [0,4194304] 0 2024-02-15T18:31:35.072 INFO:tasks.workunit.client.1.smithi131.stdout:8/572: dwrite d22/d26/d3f/d47/d48/f89 [0,4194304] 0 2024-02-15T18:31:35.075 INFO:tasks.workunit.client.1.smithi131.stdout:5/585: mknod d18/d83/cc3 0 2024-02-15T18:31:35.078 INFO:tasks.workunit.client.1.smithi131.stdout:8/573: creat d22/d26/d3f/d47/d48/d84/fc8 x:0 0 0 2024-02-15T18:31:35.079 INFO:tasks.workunit.client.1.smithi131.stdout:8/574: truncate f14 779779 0 2024-02-15T18:31:35.080 INFO:tasks.workunit.client.1.smithi131.stdout:5/586: mknod d18/d4e/cc4 0 2024-02-15T18:31:35.081 INFO:tasks.workunit.client.1.smithi131.stdout:8/575: mknod d22/d26/d3f/d47/d48/d5f/d70/dc7/cc9 0 2024-02-15T18:31:35.082 INFO:tasks.workunit.client.1.smithi131.stdout:2/448: dwrite dd/d14/d1f/f90 [0,4194304] 0 2024-02-15T18:31:35.082 INFO:tasks.workunit.client.1.smithi131.stdout:8/576: read d22/d41/f59 [2236941,30678] 0 2024-02-15T18:31:35.082 INFO:tasks.workunit.client.1.smithi131.stdout:8/577: read - d22/d2e/f9a zero size 2024-02-15T18:31:35.087 INFO:tasks.workunit.client.1.smithi131.stdout:5/587: link d18/d23/f6e d18/d33/d73/fc5 0 2024-02-15T18:31:35.100 INFO:tasks.workunit.client.1.smithi131.stdout:5/588: creat d18/d6d/d9c/fc6 x:0 0 0 2024-02-15T18:31:35.101 INFO:tasks.workunit.client.1.smithi131.stdout:5/589: mknod d18/d83/d8b/dba/d7b/cc7 0 2024-02-15T18:31:35.103 INFO:tasks.workunit.client.1.smithi131.stdout:5/590: symlink d18/d6d/d70/d9e/d86/lc8 0 2024-02-15T18:31:35.105 INFO:tasks.workunit.client.1.smithi131.stdout:5/591: dread d18/d20/f60 [0,4194304] 0 2024-02-15T18:31:35.105 INFO:tasks.workunit.client.1.smithi131.stdout:5/592: write d18/d83/d8b/dba/f87 [2933,32460] 0 2024-02-15T18:31:35.106 INFO:tasks.workunit.client.1.smithi131.stdout:5/593: creat d18/d6d/d9c/fc9 x:0 0 0 2024-02-15T18:31:35.106 INFO:tasks.workunit.client.1.smithi131.stdout:5/594: truncate d18/d6d/d70/d9e/d85/d95/fc0 1260993 0 2024-02-15T18:31:35.108 INFO:tasks.workunit.client.1.smithi131.stdout:5/595: symlink d18/d83/d89/lca 0 2024-02-15T18:31:35.110 INFO:tasks.workunit.client.1.smithi131.stdout:2/449: dwrite dd/d10/d22/d2a/f93 [0,4194304] 0 2024-02-15T18:31:35.111 INFO:tasks.workunit.client.1.smithi131.stdout:2/450: fdatasync dd/d10/d22/d2f/d38/d74/d2e/d66/f78 0 2024-02-15T18:31:35.111 INFO:tasks.workunit.client.1.smithi131.stdout:2/451: dread - dd/d10/d22/d2f/d38/d74/d2e/d6a/f7d zero size 2024-02-15T18:31:35.111 INFO:tasks.workunit.client.1.smithi131.stdout:2/452: fsync dd/d14/f64 0 2024-02-15T18:31:35.111 INFO:tasks.workunit.client.1.smithi131.stdout:2/453: chown dd/d10/d22/d2f/d38/f45 1 1 2024-02-15T18:31:35.111 INFO:tasks.workunit.client.1.smithi131.stdout:8/578: dwrite d22/d26/d3f/d86/f91 [0,4194304] 0 2024-02-15T18:31:35.114 INFO:tasks.workunit.client.1.smithi131.stdout:2/454: rename dd/d14/d2b to dd/d10/d22/d2a/d94 0 2024-02-15T18:31:35.120 INFO:tasks.workunit.client.1.smithi131.stdout:8/579: symlink d22/d26/d3f/d47/d57/dc1/lca 0 2024-02-15T18:31:35.120 INFO:tasks.workunit.client.1.smithi131.stdout:8/580: write d22/d26/d3f/d47/d48/d5f/f85 [814033,2033] 0 2024-02-15T18:31:35.121 INFO:tasks.workunit.client.1.smithi131.stdout:2/455: mkdir dd/d14/d1f/d95 0 2024-02-15T18:31:35.123 INFO:tasks.workunit.client.1.smithi131.stdout:8/581: mknod d22/d26/d3f/d47/d48/d5f/d6f/ccb 0 2024-02-15T18:31:35.125 INFO:tasks.workunit.client.1.smithi131.stdout:2/456: mknod dd/d10/c96 0 2024-02-15T18:31:35.126 INFO:tasks.workunit.client.1.smithi131.stdout:5/596: dwrite d18/d6d/d70/d9e/d86/fc1 [0,4194304] 0 2024-02-15T18:31:35.126 INFO:tasks.workunit.client.1.smithi131.stdout:5/597: dread - d18/d6d/d70/d9e/fb4 zero size 2024-02-15T18:31:35.126 INFO:tasks.workunit.client.1.smithi131.stdout:8/582: symlink d22/d26/d3f/d47/d8e/lcc 0 2024-02-15T18:31:35.126 INFO:tasks.workunit.client.1.smithi131.stdout:8/583: readlink d22/d26/l45 0 2024-02-15T18:31:35.127 INFO:tasks.workunit.client.1.smithi131.stdout:2/457: symlink dd/d1e/l97 0 2024-02-15T18:31:35.128 INFO:tasks.workunit.client.1.smithi131.stdout:2/458: fsync dd/d14/f64 0 2024-02-15T18:31:35.137 INFO:tasks.workunit.client.1.smithi131.stdout:8/584: rmdir d22/d26/d3f/d47/d8e 39 2024-02-15T18:31:35.142 INFO:tasks.workunit.client.1.smithi131.stdout:1/745: sync 2024-02-15T18:31:35.142 INFO:tasks.workunit.client.1.smithi131.stdout:6/508: sync 2024-02-15T18:31:35.142 INFO:tasks.workunit.client.1.smithi131.stdout:1/746: getdents d0/d2/d31/d3d/dd3/d105 0 2024-02-15T18:31:35.142 INFO:tasks.workunit.client.1.smithi131.stdout:1/747: stat d0/d2/dd6/f1b 0 2024-02-15T18:31:35.142 INFO:tasks.workunit.client.1.smithi131.stdout:1/748: read - d0/d1/d16/fef zero size 2024-02-15T18:31:35.148 INFO:tasks.workunit.client.1.smithi131.stdout:2/459: symlink dd/d14/d1f/d65/d77/l98 0 2024-02-15T18:31:35.152 INFO:tasks.workunit.client.1.smithi131.stdout:8/585: rename d22/d26/d3f/d47/d48/d5f/d6f/d7a/fab to d22/d26/d3f/d47/d48/d5f/d6f/d7a/fcd 0 2024-02-15T18:31:35.152 INFO:tasks.workunit.client.1.smithi131.stdout:8/586: readlink d22/d26/d3f/lb6 0 2024-02-15T18:31:35.152 INFO:tasks.workunit.client.1.smithi131.stdout:8/587: dread - d22/d41/f99 zero size 2024-02-15T18:31:35.153 INFO:tasks.workunit.client.1.smithi131.stdout:2/460: mkdir dd/d10/d22/d2f/d38/d74/d2e/d66/d99 0 2024-02-15T18:31:35.156 INFO:tasks.workunit.client.1.smithi131.stdout:8/588: link d22/f23 d22/d26/d3f/d47/d48/d5f/d6f/d7a/fce 0 2024-02-15T18:31:35.158 INFO:tasks.workunit.client.1.smithi131.stdout:8/589: read d22/d39/fac [3439169,128970] 0 2024-02-15T18:31:35.158 INFO:tasks.workunit.client.1.smithi131.stdout:8/590: fdatasync d22/d26/d3f/d47/d48/d5f/d6f/fb3 0 2024-02-15T18:31:35.158 INFO:tasks.workunit.client.1.smithi131.stdout:8/591: write d22/d26/d3f/d47/d48/d5f/d6f/fc2 [165353,52345] 0 2024-02-15T18:31:35.160 INFO:tasks.workunit.client.1.smithi131.stdout:2/461: write dd/d10/f19 [5644131,64378] 0 2024-02-15T18:31:35.166 INFO:tasks.workunit.client.1.smithi131.stdout:2/462: mknod dd/d1e/c9a 0 2024-02-15T18:31:35.166 INFO:tasks.workunit.client.1.smithi131.stdout:2/463: fsync f8 0 2024-02-15T18:31:35.168 INFO:tasks.workunit.client.1.smithi131.stdout:2/464: mkdir dd/d10/d22/d2f/d38/d74/d2e/d66/d9b 0 2024-02-15T18:31:35.172 INFO:tasks.workunit.client.1.smithi131.stdout:2/465: rename dd/d14/d1f/f87 to dd/d10/d22/d2f/d38/d74/d2e/d66/d99/f9c 0 2024-02-15T18:31:35.172 INFO:tasks.workunit.client.1.smithi131.stdout:2/466: chown fa 500130754 1 2024-02-15T18:31:35.172 INFO:tasks.workunit.client.1.smithi131.stdout:2/467: chown dd/d10/d22/d2f/l33 13318 1 2024-02-15T18:31:35.172 INFO:tasks.workunit.client.1.smithi131.stdout:1/749: dwrite d0/d2/d7/d72/d78/da7/d109/fdb [0,4194304] 0 2024-02-15T18:31:35.172 INFO:tasks.workunit.client.1.smithi131.stdout:1/750: chown d0/d1/d16/d9d 98331556 1 2024-02-15T18:31:35.173 INFO:tasks.workunit.client.1.smithi131.stdout:6/509: dwrite d2/f23 [0,4194304] 0 2024-02-15T18:31:35.175 INFO:tasks.workunit.client.1.smithi131.stdout:1/751: creat d0/d1/d16/dd1/f10d x:0 0 0 2024-02-15T18:31:35.177 INFO:tasks.workunit.client.1.smithi131.stdout:6/510: dread d2/d7/d12/d4d/f52 [0,4194304] 0 2024-02-15T18:31:35.178 INFO:tasks.workunit.client.1.smithi131.stdout:1/752: creat d0/d1/d16/dd1/f10e x:0 0 0 2024-02-15T18:31:35.180 INFO:tasks.workunit.client.1.smithi131.stdout:8/592: dwrite d22/d2e/f9a [0,4194304] 0 2024-02-15T18:31:35.180 INFO:tasks.workunit.client.1.smithi131.stdout:8/593: chown d22/d26/d3f/d86/f88 41990145 1 2024-02-15T18:31:35.180 INFO:tasks.workunit.client.1.smithi131.stdout:1/753: truncate d0/d1/f38 949002 0 2024-02-15T18:31:35.192 INFO:tasks.workunit.client.1.smithi131.stdout:2/468: dwrite dd/d14/d1f/d65/f71 [0,4194304] 0 2024-02-15T18:31:35.194 INFO:tasks.workunit.client.1.smithi131.stdout:2/469: dread dd/d10/d22/f8e [0,4194304] 0 2024-02-15T18:31:35.194 INFO:tasks.workunit.client.1.smithi131.stdout:2/470: stat dd/d1e/c2d 0 2024-02-15T18:31:35.194 INFO:tasks.workunit.client.1.smithi131.stdout:8/594: mkdir d22/d26/d3f/d86/dcf 0 2024-02-15T18:31:35.194 INFO:tasks.workunit.client.1.smithi131.stdout:8/595: fsync f17 0 2024-02-15T18:31:35.195 INFO:tasks.workunit.client.1.smithi131.stdout:1/754: symlink d0/d2/d7/d72/d78/da7/l10f 0 2024-02-15T18:31:35.195 INFO:tasks.workunit.client.1.smithi131.stdout:1/755: chown d0/d68/lce 44 1 2024-02-15T18:31:35.198 INFO:tasks.workunit.client.1.smithi131.stdout:2/471: getdents dd/d10/d22/d2f/d38/d74/d2e/d4a 0 2024-02-15T18:31:35.200 INFO:tasks.workunit.client.1.smithi131.stdout:8/596: mknod d22/d26/d3f/d47/d48/d5f/d70/db0/cd0 0 2024-02-15T18:31:35.203 INFO:tasks.workunit.client.1.smithi131.stdout:2/472: unlink dd/d10/d22/d2f/d38/d74/f61 0 2024-02-15T18:31:35.204 INFO:tasks.workunit.client.1.smithi131.stdout:8/597: truncate d22/d26/f55 717804 0 2024-02-15T18:31:35.204 INFO:tasks.workunit.client.1.smithi131.stdout:8/598: chown d22/d26/d3f/d86/dcf 794437 1 2024-02-15T18:31:35.205 INFO:tasks.workunit.client.1.smithi131.stdout:8/599: write d22/d2e/d5e/db5/fbe [162936,118540] 0 2024-02-15T18:31:35.205 INFO:tasks.workunit.client.1.smithi131.stdout:1/756: dread d0/d2/d4/da/f1f [0,4194304] 0 2024-02-15T18:31:35.207 INFO:tasks.workunit.client.1.smithi131.stdout:8/600: creat d22/d41/da2/fd1 x:0 0 0 2024-02-15T18:31:35.207 INFO:tasks.workunit.client.1.smithi131.stdout:8/601: truncate d22/d26/d3f/d47/d48/d5f/d6f/fb3 384537 0 2024-02-15T18:31:35.207 INFO:tasks.workunit.client.1.smithi131.stdout:1/757: creat d0/d1/d24/f110 x:0 0 0 2024-02-15T18:31:35.211 INFO:tasks.workunit.client.1.smithi131.stdout:1/758: rmdir d0/d1/d44/d59/d42/dcf 39 2024-02-15T18:31:35.212 INFO:tasks.workunit.client.1.smithi131.stdout:1/759: write d0/d1/d16/d30/f91 [514241,126513] 0 2024-02-15T18:31:35.216 INFO:tasks.workunit.client.1.smithi131.stdout:6/511: dwrite d2/dc/d1f/f70 [0,4194304] 0 2024-02-15T18:31:35.216 INFO:tasks.workunit.client.1.smithi131.stdout:2/473: dread dd/d14/d1f/d65/f71 [0,4194304] 0 2024-02-15T18:31:35.216 INFO:tasks.workunit.client.1.smithi131.stdout:6/512: chown d2/d7/d12/l7e 7 1 2024-02-15T18:31:35.218 INFO:tasks.workunit.client.1.smithi131.stdout:8/602: dread d22/d26/d3f/d47/f4a [0,4194304] 0 2024-02-15T18:31:35.219 INFO:tasks.workunit.client.1.smithi131.stdout:1/760: dread d0/d2/d4/da/f2a [0,4194304] 0 2024-02-15T18:31:35.225 INFO:tasks.workunit.client.1.smithi131.stdout:6/513: getdents d2/dc/d27/d62/d97 0 2024-02-15T18:31:35.227 INFO:tasks.workunit.client.1.smithi131.stdout:1/761: creat d0/d1/d24/f111 x:0 0 0 2024-02-15T18:31:35.227 INFO:tasks.workunit.client.1.smithi131.stdout:1/762: dread - d0/d2/d7/d72/faf zero size 2024-02-15T18:31:35.227 INFO:tasks.workunit.client.1.smithi131.stdout:1/763: truncate d0/d2/d7/f90 257938 0 2024-02-15T18:31:35.227 INFO:tasks.workunit.client.1.smithi131.stdout:8/603: creat d22/d26/d3f/d86/fd2 x:0 0 0 2024-02-15T18:31:35.228 INFO:tasks.workunit.client.1.smithi131.stdout:6/514: creat d2/d7/f9f x:0 0 0 2024-02-15T18:31:35.232 INFO:tasks.workunit.client.1.smithi131.stdout:1/764: rename d0/d2/d4/da/c33 to d0/d2/dd6/c112 0 2024-02-15T18:31:35.232 INFO:tasks.workunit.client.1.smithi131.stdout:1/765: dread - d0/d1/d16/dd1/ffa zero size 2024-02-15T18:31:35.233 INFO:tasks.workunit.client.1.smithi131.stdout:8/604: write d22/f23 [2191740,83696] 0 2024-02-15T18:31:35.233 INFO:tasks.workunit.client.1.smithi131.stdout:8/605: fsync f1d 0 2024-02-15T18:31:35.233 INFO:tasks.workunit.client.1.smithi131.stdout:8/606: write d22/d26/d3f/fad [664478,11645] 0 2024-02-15T18:31:35.234 INFO:tasks.workunit.client.1.smithi131.stdout:6/515: symlink d2/dc/d27/d78/la0 0 2024-02-15T18:31:35.234 INFO:tasks.workunit.client.1.smithi131.stdout:6/516: chown d2/dc/f68 1019 1 2024-02-15T18:31:35.234 INFO:tasks.workunit.client.1.smithi131.stdout:6/517: getdents d2/d6d 0 2024-02-15T18:31:35.235 INFO:tasks.workunit.client.1.smithi131.stdout:1/766: mkdir d0/d1/d16/d113 0 2024-02-15T18:31:35.235 INFO:tasks.workunit.client.1.smithi131.stdout:1/767: stat d0/d1/d44/fb4 0 2024-02-15T18:31:35.236 INFO:tasks.workunit.client.1.smithi131.stdout:8/607: symlink d22/d26/d3f/d47/d48/d5f/d70/db0/ld3 0 2024-02-15T18:31:35.237 INFO:tasks.workunit.client.1.smithi131.stdout:2/474: dwrite dd/f53 [0,4194304] 0 2024-02-15T18:31:35.241 INFO:tasks.workunit.client.1.smithi131.stdout:6/518: creat d2/dc/d27/d62/d97/fa1 x:0 0 0 2024-02-15T18:31:35.242 INFO:tasks.workunit.client.1.smithi131.stdout:1/768: mkdir d0/d1/d24/d114 0 2024-02-15T18:31:35.243 INFO:tasks.workunit.client.1.smithi131.stdout:1/769: read d0/d2/d4/d41/d5a/f96 [652358,126066] 0 2024-02-15T18:31:35.247 INFO:tasks.workunit.client.1.smithi131.stdout:8/608: symlink d22/d26/d3f/d47/d48/d5f/d70/dc7/ld4 0 2024-02-15T18:31:35.247 INFO:tasks.workunit.client.1.smithi131.stdout:8/609: read - d22/d41/f92 zero size 2024-02-15T18:31:35.249 INFO:tasks.workunit.client.1.smithi131.stdout:2/475: mknod dd/d1e/c9d 0 2024-02-15T18:31:35.249 INFO:tasks.workunit.client.1.smithi131.stdout:2/476: readlink dd/d10/d22/d2f/d38/d74/d2e/l8a 0 2024-02-15T18:31:35.249 INFO:tasks.workunit.client.1.smithi131.stdout:2/477: write f8 [1758742,103857] 0 2024-02-15T18:31:35.255 INFO:tasks.workunit.client.1.smithi131.stdout:6/519: creat d2/d7/fa2 x:0 0 0 2024-02-15T18:31:35.257 INFO:tasks.workunit.client.1.smithi131.stdout:1/770: creat d0/d1/d16/d30/f115 x:0 0 0 2024-02-15T18:31:35.257 INFO:tasks.workunit.client.1.smithi131.stdout:1/771: dread - d0/d1/d16/d9d/fb2 zero size 2024-02-15T18:31:35.260 INFO:tasks.workunit.client.1.smithi131.stdout:8/610: rename d22/d26/d3f/d47/d48/d5f/d6f/d7a/la5 to d22/d26/d3f/d47/d57/d9f/ld5 0 2024-02-15T18:31:35.260 INFO:tasks.workunit.client.1.smithi131.stdout:8/611: write d22/d2e/d5e/f80 [255683,7309] 0 2024-02-15T18:31:35.260 INFO:tasks.workunit.client.1.smithi131.stdout:8/612: chown d22/d26/d3f/d47/d48/d84/fc8 257692 1 2024-02-15T18:31:35.261 INFO:tasks.workunit.client.1.smithi131.stdout:8/613: chown d22/d39 0 1 2024-02-15T18:31:35.263 INFO:tasks.workunit.client.1.smithi131.stdout:8/614: rename d22/d26/d3f/d47/d48/d5f/d70/db0/ld3 to d22/d2e/ld6 0 2024-02-15T18:31:35.266 INFO:tasks.workunit.client.1.smithi131.stdout:8/615: rename d22/d41 to d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7 0 2024-02-15T18:31:35.268 INFO:tasks.workunit.client.1.smithi131.stdout:8/616: write fb [3742824,65822] 0 2024-02-15T18:31:35.269 INFO:tasks.workunit.client.1.smithi131.stdout:8/617: truncate d22/d26/f2d 1403522 0 2024-02-15T18:31:35.286 INFO:tasks.workunit.client.1.smithi131.stdout:2/478: dwrite dd/f29 [0,4194304] 0 2024-02-15T18:31:35.286 INFO:tasks.workunit.client.1.smithi131.stdout:1/772: dwrite d0/d1/d44/d59/d42/f5c [0,4194304] 0 2024-02-15T18:31:35.286 INFO:tasks.workunit.client.1.smithi131.stdout:1/773: readlink d0/d2/d7/d72/l8b 0 2024-02-15T18:31:35.286 INFO:tasks.workunit.client.1.smithi131.stdout:1/774: chown d0/d1/d44/d59/d42/c6e 1354874 1 2024-02-15T18:31:35.287 INFO:tasks.workunit.client.1.smithi131.stdout:6/520: dwrite d2/d7/d12/d80/f92 [0,4194304] 0 2024-02-15T18:31:35.293 INFO:tasks.workunit.client.1.smithi131.stdout:2/479: mknod dd/d10/d22/d2f/d38/d74/d2e/d66/d99/c9e 0 2024-02-15T18:31:35.294 INFO:tasks.workunit.client.1.smithi131.stdout:8/618: dwrite d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f99 [0,4194304] 0 2024-02-15T18:31:35.303 INFO:tasks.workunit.client.1.smithi131.stdout:8/619: creat d22/d2e/d5e/db5/fd8 x:0 0 0 2024-02-15T18:31:35.303 INFO:tasks.workunit.client.1.smithi131.stdout:8/620: readlink l3 0 2024-02-15T18:31:35.303 INFO:tasks.workunit.client.1.smithi131.stdout:8/621: read - d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/fa6 zero size 2024-02-15T18:31:35.303 INFO:tasks.workunit.client.1.smithi131.stdout:8/622: readlink d22/d2e/l31 0 2024-02-15T18:31:35.308 INFO:tasks.workunit.client.1.smithi131.stdout:8/623: dread d22/d26/f35 [0,4194304] 0 2024-02-15T18:31:35.324 INFO:tasks.workunit.client.1.smithi131.stdout:1/775: dwrite d0/d2/d4/da/f5e [0,4194304] 0 2024-02-15T18:31:35.325 INFO:tasks.workunit.client.1.smithi131.stdout:2/480: dwrite dd/d10/d22/f56 [4194304,4194304] 0 2024-02-15T18:31:35.327 INFO:tasks.workunit.client.1.smithi131.stdout:8/624: dwrite d22/d26/d3f/f44 [0,4194304] 0 2024-02-15T18:31:35.329 INFO:tasks.workunit.client.1.smithi131.stdout:6/521: dwrite d2/dc/d1f/f96 [0,4194304] 0 2024-02-15T18:31:35.329 INFO:tasks.workunit.client.1.smithi131.stdout:6/522: stat d2/d7/fa 0 2024-02-15T18:31:35.329 INFO:tasks.workunit.client.1.smithi131.stdout:6/523: chown d2/d7/d48/l5b 24473 1 2024-02-15T18:31:35.334 INFO:tasks.workunit.client.1.smithi131.stdout:1/776: symlink d0/d2/d31/l116 0 2024-02-15T18:31:35.335 INFO:tasks.workunit.client.1.smithi131.stdout:1/777: fdatasync d0/d2/d31/d3d/d46/f50 0 2024-02-15T18:31:35.335 INFO:tasks.workunit.client.1.smithi131.stdout:1/778: write d0/d2/d7/d72/fd8 [4922730,24570] 0 2024-02-15T18:31:35.341 INFO:tasks.workunit.client.1.smithi131.stdout:2/481: dread - dd/d10/d22/d2f/d38/f3f zero size 2024-02-15T18:31:35.343 INFO:tasks.workunit.client.1.smithi131.stdout:8/625: link d22/f42 d22/d26/d3f/d7c/fd9 0 2024-02-15T18:31:35.344 INFO:tasks.workunit.client.1.smithi131.stdout:8/626: fsync d22/d2e/f63 0 2024-02-15T18:31:35.349 INFO:tasks.workunit.client.1.smithi131.stdout:6/524: unlink d2/d7/fa2 0 2024-02-15T18:31:35.352 INFO:tasks.workunit.client.1.smithi131.stdout:1/779: rename d0/lc8 to d0/d1/d16/dd1/l117 0 2024-02-15T18:31:35.354 INFO:tasks.workunit.client.1.smithi131.stdout:1/780: write d0/d2/d4/f32 [3972671,21591] 0 2024-02-15T18:31:35.354 INFO:tasks.workunit.client.1.smithi131.stdout:8/627: rename d22/d26/d3f/d47/d48/d5f/cbb to d22/d26/d3f/d47/d48/d5f/cda 0 2024-02-15T18:31:35.354 INFO:tasks.workunit.client.1.smithi131.stdout:8/628: stat lc 0 2024-02-15T18:31:35.356 INFO:tasks.workunit.client.1.smithi131.stdout:6/525: link d2/d7/f54 d2/d7/d48/fa3 0 2024-02-15T18:31:35.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/482: mkdir dd/d10/d22/d2f/d38/d9f 0 2024-02-15T18:31:35.360 INFO:tasks.workunit.client.1.smithi131.stdout:1/781: getdents d0/d2/db/de6/db3/dc2 0 2024-02-15T18:31:35.367 INFO:tasks.workunit.client.1.smithi131.stdout:7/648: sync 2024-02-15T18:31:35.367 INFO:tasks.workunit.client.1.smithi131.stdout:9/751: sync 2024-02-15T18:31:35.368 INFO:tasks.workunit.client.1.smithi131.stdout:7/649: fsync d0/d17/d36/f48 0 2024-02-15T18:31:35.368 INFO:tasks.workunit.client.1.smithi131.stdout:1/782: write d0/d2/db/f7c [1482033,36134] 0 2024-02-15T18:31:35.368 INFO:tasks.workunit.client.1.smithi131.stdout:1/783: chown d0/d2/f5 23490584 1 2024-02-15T18:31:35.391 INFO:tasks.workunit.client.1.smithi131.stdout:1/784: dwrite d0/d1/d44/f6c [0,4194304] 0 2024-02-15T18:31:35.391 INFO:tasks.workunit.client.1.smithi131.stdout:1/785: dread - d0/d1/d16/dd1/fe7 zero size 2024-02-15T18:31:35.391 INFO:tasks.workunit.client.1.smithi131.stdout:1/786: stat d0/d1/d16/f43 0 2024-02-15T18:31:35.391 INFO:tasks.workunit.client.1.smithi131.stdout:1/787: dread - d0/d1/d16/d9d/fb2 zero size 2024-02-15T18:31:35.400 INFO:tasks.workunit.client.1.smithi131.stdout:0/449: sync 2024-02-15T18:31:35.400 INFO:tasks.workunit.client.1.smithi131.stdout:4/670: sync 2024-02-15T18:31:35.400 INFO:tasks.workunit.client.1.smithi131.stdout:3/722: sync 2024-02-15T18:31:35.402 INFO:tasks.workunit.client.1.smithi131.stdout:8/629: unlink d22/d2e/d60/f68 0 2024-02-15T18:31:35.403 INFO:tasks.workunit.client.1.smithi131.stdout:6/526: mkdir d2/d7/da4 0 2024-02-15T18:31:35.405 INFO:tasks.workunit.client.1.smithi131.stdout:2/483: symlink dd/d10/d22/d2f/d38/d74/d2e/la0 0 2024-02-15T18:31:35.412 INFO:tasks.workunit.client.1.smithi131.stdout:9/752: link d4/dc/fea d4/dc/de/d1e/d1f/d51/d5d/d71/fec 0 2024-02-15T18:31:35.414 INFO:tasks.workunit.client.1.smithi131.stdout:7/650: symlink d0/db8/dbe/lcc 0 2024-02-15T18:31:35.418 INFO:tasks.workunit.client.1.smithi131.stdout:4/671: rename d2/d2a/d68/cbc to d2/d7/d12/dd1/cf5 0 2024-02-15T18:31:35.419 INFO:tasks.workunit.client.1.smithi131.stdout:3/723: mknod d2/d22/d42/ced 0 2024-02-15T18:31:35.419 INFO:tasks.workunit.client.1.smithi131.stdout:8/630: symlink d22/d26/d3f/d47/d48/d5f/d70/db0/ldb 0 2024-02-15T18:31:35.419 INFO:tasks.workunit.client.1.smithi131.stdout:8/631: fdatasync d22/d26/f2d 0 2024-02-15T18:31:35.421 INFO:tasks.workunit.client.1.smithi131.stdout:0/450: symlink d5/d9/l90 0 2024-02-15T18:31:35.422 INFO:tasks.workunit.client.1.smithi131.stdout:4/672: mkdir d2/d7/d1c/d94/df6 0 2024-02-15T18:31:35.423 INFO:tasks.workunit.client.1.smithi131.stdout:6/527: dread d2/d2b/d6e/f47 [0,4194304] 0 2024-02-15T18:31:35.425 INFO:tasks.workunit.client.1.smithi131.stdout:9/753: creat d4/dc/d17/d19/d32/fed x:0 0 0 2024-02-15T18:31:35.429 INFO:tasks.workunit.client.1.smithi131.stdout:3/724: rename d2/d22/f72 to d2/d22/d29/db/d23/d2a/d49/fee 0 2024-02-15T18:31:35.429 INFO:tasks.workunit.client.1.smithi131.stdout:3/725: readlink d2/d22/d29/db/lb1 0 2024-02-15T18:31:35.429 INFO:tasks.workunit.client.1.smithi131.stdout:3/726: chown d2/d22/d29/db/f90 1 1 2024-02-15T18:31:35.431 INFO:tasks.workunit.client.1.smithi131.stdout:8/632: creat d22/d26/d3f/d47/d48/d5f/fdc x:0 0 0 2024-02-15T18:31:35.435 INFO:tasks.workunit.client.1.smithi131.stdout:2/484: symlink dd/d10/d22/d2f/d38/la1 0 2024-02-15T18:31:35.437 INFO:tasks.workunit.client.1.smithi131.stdout:5/598: sync 2024-02-15T18:31:35.438 INFO:tasks.workunit.client.1.smithi131.stdout:7/651: dwrite d0/d17/d36/f81 [0,4194304] 0 2024-02-15T18:31:35.449 INFO:tasks.workunit.client.1.smithi131.stdout:4/673: dwrite d2/d7/d12/f52 [0,4194304] 0 2024-02-15T18:31:35.449 INFO:tasks.workunit.client.1.smithi131.stdout:4/674: chown d2/d2a/d47/d21/dcd/fe1 0 1 2024-02-15T18:31:35.449 INFO:tasks.workunit.client.1.smithi131.stdout:4/675: fdatasync d2/d2a/d85/da3/dba/fee 0 2024-02-15T18:31:35.459 INFO:tasks.workunit.client.1.smithi131.stdout:6/528: mkdir d2/d2b/da5 0 2024-02-15T18:31:35.459 INFO:tasks.workunit.client.1.smithi131.stdout:6/529: readlink d2/d36/l3e 0 2024-02-15T18:31:35.459 INFO:tasks.workunit.client.1.smithi131.stdout:0/451: truncate d5/d2f/d4b/f87 280812 0 2024-02-15T18:31:35.461 INFO:tasks.workunit.client.1.smithi131.stdout:9/754: creat d4/dc/d17/d19/fee x:0 0 0 2024-02-15T18:31:35.461 INFO:tasks.workunit.client.1.smithi131.stdout:9/755: write d4/dc/d25/d3f/f5c [4259451,15647] 0 2024-02-15T18:31:35.462 INFO:tasks.workunit.client.1.smithi131.stdout:3/727: link d2/d22/ddd/fdf d2/d22/d29/db/d23/fef 0 2024-02-15T18:31:35.465 INFO:tasks.workunit.client.1.smithi131.stdout:5/599: creat d18/d4e/fcb x:0 0 0 2024-02-15T18:31:35.465 INFO:tasks.workunit.client.1.smithi131.stdout:3/728: read d2/f92 [1285650,112926] 0 2024-02-15T18:31:35.468 INFO:tasks.workunit.client.1.smithi131.stdout:4/676: link d2/d7/d1c/d94/fdd d2/d2a/d47/ff7 0 2024-02-15T18:31:35.469 INFO:tasks.workunit.client.1.smithi131.stdout:7/652: creat d0/db8/dbe/fcd x:0 0 0 2024-02-15T18:31:35.469 INFO:tasks.workunit.client.1.smithi131.stdout:6/530: creat d2/d7/da4/fa6 x:0 0 0 2024-02-15T18:31:35.469 INFO:tasks.workunit.client.1.smithi131.stdout:0/452: mknod d5/d9/d10/c91 0 2024-02-15T18:31:35.469 INFO:tasks.workunit.client.1.smithi131.stdout:0/453: chown d5/d9/d11/c3a 33192 1 2024-02-15T18:31:35.472 INFO:tasks.workunit.client.1.smithi131.stdout:6/531: write d2/f1a [2608625,43668] 0 2024-02-15T18:31:35.473 INFO:tasks.workunit.client.1.smithi131.stdout:9/756: creat d4/d78/fef x:0 0 0 2024-02-15T18:31:35.473 INFO:tasks.workunit.client.1.smithi131.stdout:3/729: write d2/d22/d29/f91 [4995667,45117] 0 2024-02-15T18:31:35.473 INFO:tasks.workunit.client.1.smithi131.stdout:3/730: getdents d2/d22/d29/dd7 0 2024-02-15T18:31:35.473 INFO:tasks.workunit.client.1.smithi131.stdout:3/731: dread - d2/fce zero size 2024-02-15T18:31:35.475 INFO:tasks.workunit.client.1.smithi131.stdout:7/653: mknod d0/dba/cce 0 2024-02-15T18:31:35.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/600: rmdir d18/d6d/d70/d9e 39 2024-02-15T18:31:35.476 INFO:tasks.workunit.client.1.smithi131.stdout:2/485: dwrite dd/d10/f19 [0,4194304] 0 2024-02-15T18:31:35.476 INFO:tasks.workunit.client.1.smithi131.stdout:4/677: dread d2/d7/d1c/f63 [0,4194304] 0 2024-02-15T18:31:35.476 INFO:tasks.workunit.client.1.smithi131.stdout:2/486: read - dd/d10/d22/d2f/d38/d74/d2e/f67 zero size 2024-02-15T18:31:35.476 INFO:tasks.workunit.client.1.smithi131.stdout:8/633: dwrite d22/d26/d3f/d47/d48/d84/daf/fb1 [0,4194304] 0 2024-02-15T18:31:35.478 INFO:tasks.workunit.client.1.smithi131.stdout:6/532: mknod d2/dc/d27/d62/d8f/ca7 0 2024-02-15T18:31:35.478 INFO:tasks.workunit.client.1.smithi131.stdout:6/533: readlink d2/d7/d12/l3b 0 2024-02-15T18:31:35.478 INFO:tasks.workunit.client.1.smithi131.stdout:0/454: mkdir d5/d9/d10/d71/d92 0 2024-02-15T18:31:35.478 INFO:tasks.workunit.client.1.smithi131.stdout:0/455: truncate d5/d9/d10/f8d 851296 0 2024-02-15T18:31:35.478 INFO:tasks.workunit.client.1.smithi131.stdout:0/456: fsync d5/d9/d10/f19 0 2024-02-15T18:31:35.480 INFO:tasks.workunit.client.1.smithi131.stdout:7/654: rmdir d0/da9 39 2024-02-15T18:31:35.480 INFO:tasks.workunit.client.1.smithi131.stdout:7/655: write d0/d17/d3a/d3d/f73 [822407,93712] 0 2024-02-15T18:31:35.480 INFO:tasks.workunit.client.1.smithi131.stdout:4/678: symlink d2/d7/d1c/d5d/d7a/lf8 0 2024-02-15T18:31:35.480 INFO:tasks.workunit.client.1.smithi131.stdout:1/788: dwrite d0/d1/d44/f6c [4194304,4194304] 0 2024-02-15T18:31:35.481 INFO:tasks.workunit.client.1.smithi131.stdout:6/534: symlink d2/dc/la8 0 2024-02-15T18:31:35.481 INFO:tasks.workunit.client.1.smithi131.stdout:8/634: write d22/d26/f55 [314275,111617] 0 2024-02-15T18:31:35.482 INFO:tasks.workunit.client.1.smithi131.stdout:8/635: dread - d22/d26/d3f/d47/d48/f5a zero size 2024-02-15T18:31:35.482 INFO:tasks.workunit.client.1.smithi131.stdout:9/757: creat d4/dc/d17/d19/d84/ff0 x:0 0 0 2024-02-15T18:31:35.482 INFO:tasks.workunit.client.1.smithi131.stdout:3/732: creat d2/d22/d5e/ff0 x:0 0 0 2024-02-15T18:31:35.482 INFO:tasks.workunit.client.1.smithi131.stdout:3/733: dread - d2/d22/d42/fd9 zero size 2024-02-15T18:31:35.483 INFO:tasks.workunit.client.1.smithi131.stdout:9/758: read d4/dc/d17/d19/d32/dc2/f7a [567405,29399] 0 2024-02-15T18:31:35.487 INFO:tasks.workunit.client.1.smithi131.stdout:8/636: write d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f5d [1351041,3938] 0 2024-02-15T18:31:35.490 INFO:tasks.workunit.client.1.smithi131.stdout:0/457: dread d5/d2f/d4b/f8a [0,4194304] 0 2024-02-15T18:31:35.490 INFO:tasks.workunit.client.1.smithi131.stdout:0/458: chown d5/d9/d11/c6e 131 1 2024-02-15T18:31:35.492 INFO:tasks.workunit.client.1.smithi131.stdout:2/487: write dd/d10/d22/f56 [1690969,27751] 0 2024-02-15T18:31:35.494 INFO:tasks.workunit.client.1.smithi131.stdout:4/679: dread d2/d7/d12/d2e/d39/d4b/f69 [0,4194304] 0 2024-02-15T18:31:35.494 INFO:tasks.workunit.client.1.smithi131.stdout:4/680: readlink d2/d7/d1c/d5d/d7a/d92/le6 0 2024-02-15T18:31:35.494 INFO:tasks.workunit.client.1.smithi131.stdout:9/759: mknod d4/dc/de/d1e/d1f/d51/cf1 0 2024-02-15T18:31:35.497 INFO:tasks.workunit.client.1.smithi131.stdout:1/789: truncate d0/d2/d4/da/f5e 20648 0 2024-02-15T18:31:35.498 INFO:tasks.workunit.client.1.smithi131.stdout:4/681: truncate d2/d2a/d47/f27 3132719 0 2024-02-15T18:31:35.498 INFO:tasks.workunit.client.1.smithi131.stdout:4/682: chown d2/d2a/d85/da3/dbf 1 1 2024-02-15T18:31:35.498 INFO:tasks.workunit.client.1.smithi131.stdout:0/459: creat d5/d9/d10/d71/d92/f93 x:0 0 0 2024-02-15T18:31:35.498 INFO:tasks.workunit.client.1.smithi131.stdout:0/460: fdatasync d5/f68 0 2024-02-15T18:31:35.499 INFO:tasks.workunit.client.1.smithi131.stdout:8/637: creat d22/d2e/d5e/db5/fdd x:0 0 0 2024-02-15T18:31:35.500 INFO:tasks.workunit.client.1.smithi131.stdout:3/734: unlink d2/d22/d29/db/d23/d2a/d5b/f8c 0 2024-02-15T18:31:35.501 INFO:tasks.workunit.client.1.smithi131.stdout:1/790: mknod d0/d1/d16/dd1/c118 0 2024-02-15T18:31:35.503 INFO:tasks.workunit.client.1.smithi131.stdout:9/760: creat d4/dc/d17/d19/ff2 x:0 0 0 2024-02-15T18:31:35.503 INFO:tasks.workunit.client.1.smithi131.stdout:9/761: chown d4/dc/de/d1e 317 1 2024-02-15T18:31:35.504 INFO:tasks.workunit.client.1.smithi131.stdout:9/762: fdatasync d4/dc/d25/d4e/d8a/f8b 0 2024-02-15T18:31:35.504 INFO:tasks.workunit.client.1.smithi131.stdout:6/535: dread d2/dc/f5f [0,4194304] 0 2024-02-15T18:31:35.506 INFO:tasks.workunit.client.1.smithi131.stdout:8/638: truncate d22/d26/d3f/d7c/fd9 99798 0 2024-02-15T18:31:35.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/763: rmdir d4/dc/de/d1e/d1f/d51/d5d/d71 39 2024-02-15T18:31:35.507 INFO:tasks.workunit.client.1.smithi131.stdout:4/683: truncate d2/d2a/d47/d16/d43/f89 865544 0 2024-02-15T18:31:35.509 INFO:tasks.workunit.client.1.smithi131.stdout:6/536: mknod d2/dc/d27/d62/d97/ca9 0 2024-02-15T18:31:35.509 INFO:tasks.workunit.client.1.smithi131.stdout:0/461: write d5/d15/f60 [2415359,32955] 0 2024-02-15T18:31:35.511 INFO:tasks.workunit.client.1.smithi131.stdout:9/764: symlink d4/dc/lf3 0 2024-02-15T18:31:35.516 INFO:tasks.workunit.client.1.smithi131.stdout:7/656: dwrite d0/d17/f21 [0,4194304] 0 2024-02-15T18:31:35.519 INFO:tasks.workunit.client.1.smithi131.stdout:4/684: rename d2/d7/d12/d2e/d5f/c75 to d2/d7/d1c/cf9 0 2024-02-15T18:31:35.522 INFO:tasks.workunit.client.1.smithi131.stdout:9/765: write f0 [2426967,58338] 0 2024-02-15T18:31:35.522 INFO:tasks.workunit.client.1.smithi131.stdout:8/639: dread d22/d26/d3f/d47/d48/f89 [0,4194304] 0 2024-02-15T18:31:35.526 INFO:tasks.workunit.client.1.smithi131.stdout:7/657: write d0/f88 [2527927,60293] 0 2024-02-15T18:31:35.526 INFO:tasks.workunit.client.1.smithi131.stdout:7/658: chown d0/db8/dbe 27719 1 2024-02-15T18:31:35.526 INFO:tasks.workunit.client.1.smithi131.stdout:7/659: fsync d0/d17/d3a/d3d/d79/d89/f95 0 2024-02-15T18:31:35.526 INFO:tasks.workunit.client.1.smithi131.stdout:7/660: stat d0/d34/f67 0 2024-02-15T18:31:35.526 INFO:tasks.workunit.client.1.smithi131.stdout:1/791: dread d0/d1/d16/f20 [0,4194304] 0 2024-02-15T18:31:35.529 INFO:tasks.workunit.client.1.smithi131.stdout:6/537: dread d2/f42 [0,4194304] 0 2024-02-15T18:31:35.529 INFO:tasks.workunit.client.1.smithi131.stdout:6/538: fdatasync d2/dc/d1f/f63 0 2024-02-15T18:31:35.531 INFO:tasks.workunit.client.1.smithi131.stdout:3/735: dwrite d2/d22/f35 [0,4194304] 0 2024-02-15T18:31:35.532 INFO:tasks.workunit.client.1.smithi131.stdout:2/488: dwrite dd/f29 [0,4194304] 0 2024-02-15T18:31:35.532 INFO:tasks.workunit.client.1.smithi131.stdout:0/462: rmdir d5/d9/d4d 39 2024-02-15T18:31:35.533 INFO:tasks.workunit.client.1.smithi131.stdout:9/766: creat d4/dc/de/db4/ff4 x:0 0 0 2024-02-15T18:31:35.533 INFO:tasks.workunit.client.1.smithi131.stdout:9/767: write d4/dc/fcc [1028279,31145] 0 2024-02-15T18:31:35.533 INFO:tasks.workunit.client.1.smithi131.stdout:9/768: truncate d4/dc/fcc 1119685 0 2024-02-15T18:31:35.533 INFO:tasks.workunit.client.1.smithi131.stdout:8/640: truncate d22/d26/f76 417746 0 2024-02-15T18:31:35.537 INFO:tasks.workunit.client.1.smithi131.stdout:2/489: dread dd/d14/d1f/d65/f71 [0,4194304] 0 2024-02-15T18:31:35.537 INFO:tasks.workunit.client.1.smithi131.stdout:2/490: chown fc 4189 1 2024-02-15T18:31:35.537 INFO:tasks.workunit.client.1.smithi131.stdout:2/491: read - dd/d10/d22/d2f/d38/d74/d2e/d66/d99/f9c zero size 2024-02-15T18:31:35.538 INFO:tasks.workunit.client.1.smithi131.stdout:1/792: mknod d0/d2/d7/d72/c119 0 2024-02-15T18:31:35.538 INFO:tasks.workunit.client.1.smithi131.stdout:1/793: readlink d0/d1/d44/l76 0 2024-02-15T18:31:35.538 INFO:tasks.workunit.client.1.smithi131.stdout:1/794: dread - d0/d2/d4/d41/dc3/fe8 zero size 2024-02-15T18:31:35.543 INFO:tasks.workunit.client.1.smithi131.stdout:7/661: dread d0/d34/f35 [0,4194304] 0 2024-02-15T18:31:35.543 INFO:tasks.workunit.client.1.smithi131.stdout:3/736: symlink d2/d22/ddd/lf1 0 2024-02-15T18:31:35.543 INFO:tasks.workunit.client.1.smithi131.stdout:3/737: dread - d2/d22/d29/db/fe4 zero size 2024-02-15T18:31:35.544 INFO:tasks.workunit.client.1.smithi131.stdout:3/738: read - d2/d22/d29/db/d23/d2a/fbe zero size 2024-02-15T18:31:35.548 INFO:tasks.workunit.client.1.smithi131.stdout:0/463: creat d5/d9/d10/d71/f94 x:0 0 0 2024-02-15T18:31:35.548 INFO:tasks.workunit.client.1.smithi131.stdout:0/464: readlink d5/d15/l5c 0 2024-02-15T18:31:35.557 INFO:tasks.workunit.client.1.smithi131.stdout:8/641: creat d22/d26/d3f/fde x:0 0 0 2024-02-15T18:31:35.557 INFO:tasks.workunit.client.1.smithi131.stdout:9/769: creat d4/dc/dd7/ff5 x:0 0 0 2024-02-15T18:31:35.562 INFO:tasks.workunit.client.1.smithi131.stdout:1/795: rmdir d0/d2/dd6 39 2024-02-15T18:31:35.562 INFO:tasks.workunit.client.1.smithi131.stdout:7/662: getdents d0/d34 0 2024-02-15T18:31:35.569 INFO:tasks.workunit.client.1.smithi131.stdout:0/465: write d5/d2f/d45/f51 [1267781,94510] 0 2024-02-15T18:31:35.569 INFO:tasks.workunit.client.1.smithi131.stdout:0/466: write d5/d15/f60 [4426944,29823] 0 2024-02-15T18:31:35.569 INFO:tasks.workunit.client.1.smithi131.stdout:0/467: write d5/d2f/d4b/f87 [863728,43619] 0 2024-02-15T18:31:35.570 INFO:tasks.workunit.client.1.smithi131.stdout:3/739: dwrite d2/d22/d29/db/d1a/da4/faa [0,4194304] 0 2024-02-15T18:31:35.574 INFO:tasks.workunit.client.1.smithi131.stdout:8/642: creat d22/d26/d3f/d47/dc3/fdf x:0 0 0 2024-02-15T18:31:35.581 INFO:tasks.workunit.client.1.smithi131.stdout:2/492: dwrite dd/f18 [0,4194304] 0 2024-02-15T18:31:35.581 INFO:tasks.workunit.client.1.smithi131.stdout:2/493: read - dd/d10/d22/d2f/d38/d74/d2e/d66/d99/f9c zero size 2024-02-15T18:31:35.581 INFO:tasks.workunit.client.1.smithi131.stdout:9/770: truncate d4/dc/d25/d3f/d81/d5b/fba 521149 0 2024-02-15T18:31:35.581 INFO:tasks.workunit.client.1.smithi131.stdout:7/663: symlink d0/d9d/dc8/lcf 0 2024-02-15T18:31:35.581 INFO:tasks.workunit.client.1.smithi131.stdout:7/664: write d0/d17/d36/f72 [2346839,119990] 0 2024-02-15T18:31:35.594 INFO:tasks.workunit.client.1.smithi131.stdout:8/643: mknod d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/da2/ce0 0 2024-02-15T18:31:35.594 INFO:tasks.workunit.client.1.smithi131.stdout:9/771: mkdir d4/dc/de/d1e/d1f/df6 0 2024-02-15T18:31:35.594 INFO:tasks.workunit.client.1.smithi131.stdout:7/665: mkdir d0/db8/dd0 0 2024-02-15T18:31:35.594 INFO:tasks.workunit.client.1.smithi131.stdout:7/666: fsync d0/d17/d3a/d3d/d79/d89/f95 0 2024-02-15T18:31:35.594 INFO:tasks.workunit.client.1.smithi131.stdout:7/667: chown d0/d17/d3a/d3d/d79/d89/f96 12288070 1 2024-02-15T18:31:35.595 INFO:tasks.workunit.client.1.smithi131.stdout:3/740: stat d2/d22/d5e/caf 0 2024-02-15T18:31:35.597 INFO:tasks.workunit.client.1.smithi131.stdout:9/772: mkdir d4/dc/df7 0 2024-02-15T18:31:35.599 INFO:tasks.workunit.client.1.smithi131.stdout:2/494: write dd/d14/d1f/f90 [3202690,122880] 0 2024-02-15T18:31:35.600 INFO:tasks.workunit.client.1.smithi131.stdout:7/668: mkdir d0/d9d/dc8/dd1 0 2024-02-15T18:31:35.601 INFO:tasks.workunit.client.1.smithi131.stdout:8/644: creat d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/fe1 x:0 0 0 2024-02-15T18:31:35.601 INFO:tasks.workunit.client.1.smithi131.stdout:3/741: creat d2/d22/d29/db/d84/ff2 x:0 0 0 2024-02-15T18:31:35.601 INFO:tasks.workunit.client.1.smithi131.stdout:3/742: fsync d2/d22/d29/db/fa9 0 2024-02-15T18:31:35.603 INFO:tasks.workunit.client.1.smithi131.stdout:0/468: dwrite d5/d9/d10/d71/f94 [0,4194304] 0 2024-02-15T18:31:35.603 INFO:tasks.workunit.client.1.smithi131.stdout:0/469: write d5/d2f/d4b/f87 [1757331,91032] 0 2024-02-15T18:31:35.603 INFO:tasks.workunit.client.1.smithi131.stdout:0/470: stat f0 0 2024-02-15T18:31:35.604 INFO:tasks.workunit.client.1.smithi131.stdout:9/773: truncate d4/dc/de/d1e/d1f/d2c/f79 1204695 0 2024-02-15T18:31:35.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/495: mkdir dd/d14/d1f/d65/d77/d7a/da2 0 2024-02-15T18:31:35.606 INFO:tasks.workunit.client.1.smithi131.stdout:7/669: symlink d0/d34/d8e/d98/dc6/ld2 0 2024-02-15T18:31:35.607 INFO:tasks.workunit.client.1.smithi131.stdout:1/796: dwrite d0/d68/d80/ffe [0,4194304] 0 2024-02-15T18:31:35.607 INFO:tasks.workunit.client.1.smithi131.stdout:3/743: getdents d2/d22/d29/db 0 2024-02-15T18:31:35.614 INFO:tasks.workunit.client.1.smithi131.stdout:1/797: dread d0/d2/dd6/f2e [0,4194304] 0 2024-02-15T18:31:35.616 INFO:tasks.workunit.client.1.smithi131.stdout:9/774: creat d4/dc/d17/d19/d32/d91/de5/ff8 x:0 0 0 2024-02-15T18:31:35.619 INFO:tasks.workunit.client.1.smithi131.stdout:2/496: mkdir dd/d10/d22/da3 0 2024-02-15T18:31:35.620 INFO:tasks.workunit.client.1.smithi131.stdout:2/497: write f4 [5020783,123723] 0 2024-02-15T18:31:35.620 INFO:tasks.workunit.client.1.smithi131.stdout:3/744: truncate d2/d22/d5e/fb2 425044 0 2024-02-15T18:31:35.620 INFO:tasks.workunit.client.1.smithi131.stdout:8/645: write d22/d26/d3f/f44 [2685102,28832] 0 2024-02-15T18:31:35.629 INFO:tasks.workunit.client.1.smithi131.stdout:9/775: creat d4/dc/de/d1e/d1f/de3/ff9 x:0 0 0 2024-02-15T18:31:35.629 INFO:tasks.workunit.client.1.smithi131.stdout:9/776: write d4/dc/de/d1e/fc5 [4616841,91960] 0 2024-02-15T18:31:35.629 INFO:tasks.workunit.client.1.smithi131.stdout:6/539: dwrite d2/dc/f14 [0,4194304] 0 2024-02-15T18:31:35.630 INFO:tasks.workunit.client.1.smithi131.stdout:9/777: stat d4/caf 0 2024-02-15T18:31:35.630 INFO:tasks.workunit.client.1.smithi131.stdout:8/646: rename d22/d26/d3f/d47/fa4 to d22/d26/d3f/d47/d48/d5f/d6f/fe2 0 2024-02-15T18:31:35.632 INFO:tasks.workunit.client.1.smithi131.stdout:9/778: mknod d4/dc/de/db4/cfa 0 2024-02-15T18:31:35.632 INFO:tasks.workunit.client.1.smithi131.stdout:1/798: dread d0/d2/d7/d72/f97 [0,4194304] 0 2024-02-15T18:31:35.633 INFO:tasks.workunit.client.1.smithi131.stdout:8/647: link c1e d22/d26/d3f/d47/d48/d84/ce3 0 2024-02-15T18:31:35.633 INFO:tasks.workunit.client.1.smithi131.stdout:8/648: chown fb 24 1 2024-02-15T18:31:35.634 INFO:tasks.workunit.client.1.smithi131.stdout:3/745: truncate d2/d22/d29/db/d1a/da4/d70/fa1 2506286 0 2024-02-15T18:31:35.635 INFO:tasks.workunit.client.1.smithi131.stdout:2/498: dread dd/d10/d22/d2f/d38/f7c [0,4194304] 0 2024-02-15T18:31:35.635 INFO:tasks.workunit.client.1.smithi131.stdout:2/499: write dd/d14/f64 [733381,108556] 0 2024-02-15T18:31:35.636 INFO:tasks.workunit.client.1.smithi131.stdout:9/779: rename d4/dc/de/d1e/d1f/d51/d5d/d71/cc6 to d4/dc3/cfb 0 2024-02-15T18:31:35.637 INFO:tasks.workunit.client.1.smithi131.stdout:9/780: fsync d4/dc/d17/f69 0 2024-02-15T18:31:35.637 INFO:tasks.workunit.client.1.smithi131.stdout:1/799: mkdir d0/d2/d4/d41/dc3/d11a 0 2024-02-15T18:31:35.638 INFO:tasks.workunit.client.1.smithi131.stdout:8/649: creat d22/d26/d3f/d47/d48/d5f/d6f/fe4 x:0 0 0 2024-02-15T18:31:35.639 INFO:tasks.workunit.client.1.smithi131.stdout:3/746: mkdir d2/d22/d29/db/d1a/df3 0 2024-02-15T18:31:35.641 INFO:tasks.workunit.client.1.smithi131.stdout:9/781: creat d4/dc/de/d1e/d1f/d51/d5d/ffc x:0 0 0 2024-02-15T18:31:35.641 INFO:tasks.workunit.client.1.smithi131.stdout:9/782: fsync d4/dc/de/d1e/d1f/d2c/f4b 0 2024-02-15T18:31:35.641 INFO:tasks.workunit.client.1.smithi131.stdout:1/800: mknod d0/d2/d31/d3d/d46/c11b 0 2024-02-15T18:31:35.641 INFO:tasks.workunit.client.1.smithi131.stdout:1/801: write d0/d1/d44/d59/f45 [4325907,24364] 0 2024-02-15T18:31:35.644 INFO:tasks.workunit.client.1.smithi131.stdout:8/650: symlink d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/le5 0 2024-02-15T18:31:35.645 INFO:tasks.workunit.client.1.smithi131.stdout:3/747: creat d2/d22/d5e/ff4 x:0 0 0 2024-02-15T18:31:35.645 INFO:tasks.workunit.client.1.smithi131.stdout:3/748: stat d2/d22/l88 0 2024-02-15T18:31:35.648 INFO:tasks.workunit.client.1.smithi131.stdout:0/471: dwrite d5/d9/d10/f1e [0,4194304] 0 2024-02-15T18:31:35.648 INFO:tasks.workunit.client.1.smithi131.stdout:0/472: dread - d5/d9/d10/f86 zero size 2024-02-15T18:31:35.649 INFO:tasks.workunit.client.1.smithi131.stdout:7/670: dwrite d0/d34/d8b/d9a/fb9 [4194304,4194304] 0 2024-02-15T18:31:35.661 INFO:tasks.workunit.client.1.smithi131.stdout:6/540: dwrite d2/d7/da4/fa6 [0,4194304] 0 2024-02-15T18:31:35.661 INFO:tasks.workunit.client.1.smithi131.stdout:2/500: dwrite dd/d10/d22/d2f/d38/d74/d2e/d6a/f7d [0,4194304] 0 2024-02-15T18:31:35.661 INFO:tasks.workunit.client.1.smithi131.stdout:2/501: write dd/d10/d22/d2f/d38/f3f [930180,89315] 0 2024-02-15T18:31:35.661 INFO:tasks.workunit.client.1.smithi131.stdout:8/651: creat d22/d26/d3f/d47/d48/d5f/fe6 x:0 0 0 2024-02-15T18:31:35.662 INFO:tasks.workunit.client.1.smithi131.stdout:9/783: rename d4/dc/d17/db0/dbc/ca7 to d4/dc/d25/d4e/cfd 0 2024-02-15T18:31:35.662 INFO:tasks.workunit.client.1.smithi131.stdout:3/749: creat d2/ff5 x:0 0 0 2024-02-15T18:31:35.664 INFO:tasks.workunit.client.1.smithi131.stdout:0/473: getdents d5/d9 0 2024-02-15T18:31:35.664 INFO:tasks.workunit.client.1.smithi131.stdout:0/474: write d5/d9/d11/f14 [5252220,115321] 0 2024-02-15T18:31:35.670 INFO:tasks.workunit.client.1.smithi131.stdout:7/671: getdents d0/d17/d36 0 2024-02-15T18:31:35.673 INFO:tasks.workunit.client.1.smithi131.stdout:1/802: dwrite d0/d2/db/de6/db3/ff6 [0,4194304] 0 2024-02-15T18:31:35.673 INFO:tasks.workunit.client.1.smithi131.stdout:1/803: write d0/d2/d7/d72/faf [220141,56367] 0 2024-02-15T18:31:35.673 INFO:tasks.workunit.client.1.smithi131.stdout:8/652: creat d22/d26/d3f/d86/dcf/fe7 x:0 0 0 2024-02-15T18:31:35.674 INFO:tasks.workunit.client.1.smithi131.stdout:0/475: creat d5/d2f/d45/f95 x:0 0 0 2024-02-15T18:31:35.675 INFO:tasks.workunit.client.1.smithi131.stdout:9/784: dread d4/dc/d25/d3f/d81/f75 [0,4194304] 0 2024-02-15T18:31:35.677 INFO:tasks.workunit.client.1.smithi131.stdout:2/502: dread fa [0,4194304] 0 2024-02-15T18:31:35.677 INFO:tasks.workunit.client.1.smithi131.stdout:2/503: truncate dd/d10/d22/d2f/d38/d74/d2e/d66/d99/f9c 247992 0 2024-02-15T18:31:35.682 INFO:tasks.workunit.client.1.smithi131.stdout:8/653: rename d22/d26/d3f/d47/d48/d5f/d70/db0/ldb to d22/d2e/d5e/db5/le8 0 2024-02-15T18:31:35.683 INFO:tasks.workunit.client.1.smithi131.stdout:3/750: write d2/d22/d29/db/d1a/da4/f64 [4047561,110938] 0 2024-02-15T18:31:35.683 INFO:tasks.workunit.client.1.smithi131.stdout:7/672: unlink d0/d17/d3a/d3d/cc5 0 2024-02-15T18:31:35.683 INFO:tasks.workunit.client.1.smithi131.stdout:0/476: mkdir d5/d15/d96 0 2024-02-15T18:31:35.692 INFO:tasks.workunit.client.1.smithi131.stdout:3/751: dread d2/d22/d29/db/d1a/da4/d70/fb5 [0,4194304] 0 2024-02-15T18:31:35.692 INFO:tasks.workunit.client.1.smithi131.stdout:2/504: dread dd/f6f [0,4194304] 0 2024-02-15T18:31:35.692 INFO:tasks.workunit.client.1.smithi131.stdout:0/477: symlink d5/d2f/d45/d8c/l97 0 2024-02-15T18:31:35.692 INFO:tasks.workunit.client.1.smithi131.stdout:0/478: stat d5/d9/d10/d73 0 2024-02-15T18:31:35.692 INFO:tasks.workunit.client.1.smithi131.stdout:0/479: readlink d5/d9/l54 0 2024-02-15T18:31:35.692 INFO:tasks.workunit.client.1.smithi131.stdout:0/480: stat d5/f4c 0 2024-02-15T18:31:35.694 INFO:tasks.workunit.client.1.smithi131.stdout:2/505: creat dd/d10/d22/d2f/d38/d74/d2e/d6a/fa4 x:0 0 0 2024-02-15T18:31:35.694 INFO:tasks.workunit.client.1.smithi131.stdout:7/673: getdents d0/d9d 0 2024-02-15T18:31:35.697 INFO:tasks.workunit.client.1.smithi131.stdout:0/481: rename d5/d15/d1f/f75 to d5/d9/d10/d3f/f98 0 2024-02-15T18:31:35.697 INFO:tasks.workunit.client.1.smithi131.stdout:0/482: chown d5/d9/d77/d8b 0 1 2024-02-15T18:31:35.701 INFO:tasks.workunit.client.1.smithi131.stdout:7/674: rmdir d0/d17/d3a 39 2024-02-15T18:31:35.701 INFO:tasks.workunit.client.1.smithi131.stdout:2/506: creat dd/d10/d22/d2f/d38/d74/fa5 x:0 0 0 2024-02-15T18:31:35.701 INFO:tasks.workunit.client.1.smithi131.stdout:7/675: readlink d0/d34/d8e/lb2 0 2024-02-15T18:31:35.701 INFO:tasks.workunit.client.1.smithi131.stdout:7/676: readlink d0/d9d/dc8/lcf 0 2024-02-15T18:31:35.701 INFO:tasks.workunit.client.1.smithi131.stdout:6/541: dwrite d2/d7/f94 [0,4194304] 0 2024-02-15T18:31:35.708 INFO:tasks.workunit.client.1.smithi131.stdout:1/804: dwrite d0/d1/d44/d59/fc6 [4194304,4194304] 0 2024-02-15T18:31:35.709 INFO:tasks.workunit.client.1.smithi131.stdout:2/507: rename dd/d10/d22/d2f/d38/l91 to dd/d10/d22/d2a/d94/la6 0 2024-02-15T18:31:35.710 INFO:tasks.workunit.client.1.smithi131.stdout:2/508: write dd/d10/d22/d2a/f30 [3297105,128568] 0 2024-02-15T18:31:35.712 INFO:tasks.workunit.client.1.smithi131.stdout:7/677: write d0/d17/d36/f48 [1345243,18018] 0 2024-02-15T18:31:35.712 INFO:tasks.workunit.client.1.smithi131.stdout:7/678: write d0/f14 [1304199,126205] 0 2024-02-15T18:31:35.719 INFO:tasks.workunit.client.1.smithi131.stdout:3/752: dwrite d2/d22/d3a/fb3 [0,4194304] 0 2024-02-15T18:31:35.719 INFO:tasks.workunit.client.1.smithi131.stdout:8/654: dread d22/d26/d3f/f44 [0,4194304] 0 2024-02-15T18:31:35.719 INFO:tasks.workunit.client.1.smithi131.stdout:3/753: truncate d2/d22/d29/db/d23/d2a/d49/fa3 350284 0 2024-02-15T18:31:35.719 INFO:tasks.workunit.client.1.smithi131.stdout:0/483: dwrite d5/d15/d1f/f57 [0,4194304] 0 2024-02-15T18:31:35.785 INFO:tasks.workunit.client.1.smithi131.stdout:1/805: symlink d0/d68/l11c 0 2024-02-15T18:31:35.788 INFO:tasks.workunit.client.1.smithi131.stdout:2/509: creat dd/d10/d22/d2f/d38/d74/d2e/d66/fa7 x:0 0 0 2024-02-15T18:31:35.796 INFO:tasks.workunit.client.1.smithi131.stdout:7/679: unlink d0/c2b 0 2024-02-15T18:31:35.798 INFO:tasks.workunit.client.1.smithi131.stdout:8/655: truncate d22/d26/d3f/d47/d48/d5f/fa3 206027 0 2024-02-15T18:31:35.799 INFO:tasks.workunit.client.1.smithi131.stdout:3/754: truncate d2/d22/d5e/d79/fa2 442808 0 2024-02-15T18:31:35.804 INFO:tasks.workunit.client.1.smithi131.stdout:0/484: rename d5/d9/d10/f86 to d5/d9/d10/d73/f99 0 2024-02-15T18:31:35.804 INFO:tasks.workunit.client.1.smithi131.stdout:0/485: truncate d5/d2f/d4b/f69 549994 0 2024-02-15T18:31:35.805 INFO:tasks.workunit.client.1.smithi131.stdout:1/806: mknod d0/d1/d16/db7/c11d 0 2024-02-15T18:31:35.811 INFO:tasks.workunit.client.1.smithi131.stdout:2/510: creat dd/d10/d22/d2f/d38/d74/d2e/d66/fa8 x:0 0 0 2024-02-15T18:31:35.811 INFO:tasks.workunit.client.1.smithi131.stdout:2/511: write dd/d14/d1f/d65/f71 [1034305,126255] 0 2024-02-15T18:31:35.814 INFO:tasks.workunit.client.1.smithi131.stdout:7/680: creat d0/d34/d8e/d98/dc6/fd3 x:0 0 0 2024-02-15T18:31:35.815 INFO:tasks.workunit.client.1.smithi131.stdout:3/755: creat d2/d22/d29/dd7/ff6 x:0 0 0 2024-02-15T18:31:35.815 INFO:tasks.workunit.client.1.smithi131.stdout:3/756: dread - d2/fce zero size 2024-02-15T18:31:35.815 INFO:tasks.workunit.client.1.smithi131.stdout:3/757: write d2/d22/d29/db/f1e [4783847,30711] 0 2024-02-15T18:31:35.817 INFO:tasks.workunit.client.1.smithi131.stdout:8/656: rename d22/d26/d3f/d47/d48/d5f/ca8 to d22/d26/ce9 0 2024-02-15T18:31:35.817 INFO:tasks.workunit.client.1.smithi131.stdout:8/657: truncate d22/d26/d3f/d47/d48/d5f/d6f/d7a/fce 4389870 0 2024-02-15T18:31:35.817 INFO:tasks.workunit.client.1.smithi131.stdout:8/658: write d22/d26/d3f/d47/d48/d5f/d6f/fb3 [318438,115705] 0 2024-02-15T18:31:35.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/486: getdents d5/d9/d10/d71/d92 0 2024-02-15T18:31:35.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/487: readlink d5/d2f/d45/d8c/l97 0 2024-02-15T18:31:35.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/488: chown d5/d9/d11/l5b 883841 1 2024-02-15T18:31:35.828 INFO:tasks.workunit.client.1.smithi131.stdout:1/807: creat d0/d1/d16/d6b/de5/f11e x:0 0 0 2024-02-15T18:31:35.830 INFO:tasks.workunit.client.1.smithi131.stdout:2/512: truncate dd/d10/f19 259784 0 2024-02-15T18:31:35.831 INFO:tasks.workunit.client.1.smithi131.stdout:7/681: symlink d0/d17/d36/ld4 0 2024-02-15T18:31:35.834 INFO:tasks.workunit.client.1.smithi131.stdout:0/489: creat d5/f9a x:0 0 0 2024-02-15T18:31:35.835 INFO:tasks.workunit.client.1.smithi131.stdout:1/808: getdents d0/d1/d16/dd1 0 2024-02-15T18:31:35.837 INFO:tasks.workunit.client.1.smithi131.stdout:1/809: rmdir d0/d2/d4/d41 39 2024-02-15T18:31:35.837 INFO:tasks.workunit.client.1.smithi131.stdout:1/810: readlink d0/d1/d44/d59/la9 0 2024-02-15T18:31:35.838 INFO:tasks.workunit.client.1.smithi131.stdout:2/513: link c3 dd/d14/d1f/d65/ca9 0 2024-02-15T18:31:35.841 INFO:tasks.workunit.client.1.smithi131.stdout:1/811: write d0/d1/d24/d108/ff1 [563546,8298] 0 2024-02-15T18:31:35.843 INFO:tasks.workunit.client.1.smithi131.stdout:2/514: creat dd/d10/d22/d2f/d38/d74/d2e/d66/faa x:0 0 0 2024-02-15T18:31:35.848 INFO:tasks.workunit.client.1.smithi131.stdout:7/682: dread d0/d34/fa2 [0,4194304] 0 2024-02-15T18:31:35.848 INFO:tasks.workunit.client.1.smithi131.stdout:3/758: dwrite d2/d22/d29/db/d1a/fe [4194304,4194304] 0 2024-02-15T18:31:35.849 INFO:tasks.workunit.client.1.smithi131.stdout:7/683: mknod d0/d34/d8b/cd5 0 2024-02-15T18:31:35.849 INFO:tasks.workunit.client.1.smithi131.stdout:7/684: chown d0/d17/d3a/lc7 0 1 2024-02-15T18:31:35.850 INFO:tasks.workunit.client.1.smithi131.stdout:2/515: dread dd/d10/d22/d2f/d38/f3f [0,4194304] 0 2024-02-15T18:31:35.850 INFO:tasks.workunit.client.1.smithi131.stdout:2/516: write dd/d10/d22/d2f/d38/d74/d2e/d66/f78 [104925,110965] 0 2024-02-15T18:31:35.851 INFO:tasks.workunit.client.1.smithi131.stdout:8/659: dwrite d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f5d [0,4194304] 0 2024-02-15T18:31:35.851 INFO:tasks.workunit.client.1.smithi131.stdout:8/660: stat d22/d26/d3f/d47/f4a 0 2024-02-15T18:31:35.854 INFO:tasks.workunit.client.1.smithi131.stdout:2/517: write dd/d10/d22/d2a/f2c [2334737,109974] 0 2024-02-15T18:31:35.856 INFO:tasks.workunit.client.1.smithi131.stdout:3/759: getdents d2/d22/d29/db/d1a/de1 0 2024-02-15T18:31:35.856 INFO:tasks.workunit.client.1.smithi131.stdout:3/760: fdatasync d2/d22/d3f/fb4 0 2024-02-15T18:31:35.858 INFO:tasks.workunit.client.1.smithi131.stdout:7/685: symlink d0/db8/ld6 0 2024-02-15T18:31:35.863 INFO:tasks.workunit.client.1.smithi131.stdout:1/812: dwrite d0/d1/d44/fb4 [0,4194304] 0 2024-02-15T18:31:35.865 INFO:tasks.workunit.client.1.smithi131.stdout:8/661: rmdir d22/d26/d3f 39 2024-02-15T18:31:35.868 INFO:tasks.workunit.client.1.smithi131.stdout:2/518: unlink dd/d14/l28 0 2024-02-15T18:31:35.869 INFO:tasks.workunit.client.1.smithi131.stdout:2/519: stat dd/d14/d1f/d65/d77/d7a 0 2024-02-15T18:31:35.879 INFO:tasks.workunit.client.1.smithi131.stdout:1/813: creat d0/d1/d44/f11f x:0 0 0 2024-02-15T18:31:35.880 INFO:tasks.workunit.client.1.smithi131.stdout:1/814: read d0/d2/d7/f4c [3352572,117719] 0 2024-02-15T18:31:35.888 INFO:tasks.workunit.client.1.smithi131.stdout:7/686: dwrite d0/d34/d8b/d9a/fb9 [0,4194304] 0 2024-02-15T18:31:35.889 INFO:tasks.workunit.client.1.smithi131.stdout:2/520: dwrite dd/d10/f19 [0,4194304] 0 2024-02-15T18:31:35.893 INFO:tasks.workunit.client.1.smithi131.stdout:8/662: mkdir d22/d26/d3f/d47/d48/d5f/d70/dc7/dea 0 2024-02-15T18:31:35.895 INFO:tasks.workunit.client.1.smithi131.stdout:1/815: mkdir d0/d1/d24/d108/d120 0 2024-02-15T18:31:35.895 INFO:tasks.workunit.client.1.smithi131.stdout:1/816: chown d0/d1/d16/dd1/f10d 7 1 2024-02-15T18:31:35.895 INFO:tasks.workunit.client.1.smithi131.stdout:7/687: mkdir d0/d17/d3a/d3d/d79/db4/dd7 0 2024-02-15T18:31:35.896 INFO:tasks.workunit.client.1.smithi131.stdout:2/521: symlink dd/d14/d1f/d65/lab 0 2024-02-15T18:31:35.896 INFO:tasks.workunit.client.1.smithi131.stdout:2/522: fsync dd/d10/d22/d2f/f40 0 2024-02-15T18:31:35.897 INFO:tasks.workunit.client.1.smithi131.stdout:8/663: getdents d22/d26/d3f/d47/d48/d5f/d6f 0 2024-02-15T18:31:35.897 INFO:tasks.workunit.client.1.smithi131.stdout:8/664: fdatasync d22/d26/d3f/d86/fd2 0 2024-02-15T18:31:35.901 INFO:tasks.workunit.client.1.smithi131.stdout:1/817: creat d0/d2/d4/da/f121 x:0 0 0 2024-02-15T18:31:35.902 INFO:tasks.workunit.client.1.smithi131.stdout:7/688: mkdir d0/d17/d3a/d3d/d79/db4/dd8 0 2024-02-15T18:31:35.903 INFO:tasks.workunit.client.1.smithi131.stdout:2/523: chown dd/d10/d22/d2f/d38/f50 2039755693 1 2024-02-15T18:31:35.903 INFO:tasks.workunit.client.1.smithi131.stdout:2/524: dread - dd/d10/d22/d2a/d48/f83 zero size 2024-02-15T18:31:35.903 INFO:tasks.workunit.client.1.smithi131.stdout:2/525: write dd/d10/d22/f8e [103868,73427] 0 2024-02-15T18:31:35.905 INFO:tasks.workunit.client.1.smithi131.stdout:8/665: mkdir d22/d39/deb 0 2024-02-15T18:31:35.905 INFO:tasks.workunit.client.1.smithi131.stdout:8/666: getdents d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/daa 0 2024-02-15T18:31:35.905 INFO:tasks.workunit.client.1.smithi131.stdout:8/667: chown d22/d26/d3f/d47/d57 2067481 1 2024-02-15T18:31:35.906 INFO:tasks.workunit.client.1.smithi131.stdout:1/818: creat d0/d2/dd6/f122 x:0 0 0 2024-02-15T18:31:35.906 INFO:tasks.workunit.client.1.smithi131.stdout:1/819: readlink d0/d2/dd6/l75 0 2024-02-15T18:31:35.907 INFO:tasks.workunit.client.1.smithi131.stdout:1/820: link d0/d2/d4/d5d/db1/cbc d0/d1/d44/d59/d42/c123 0 2024-02-15T18:31:35.907 INFO:tasks.workunit.client.1.smithi131.stdout:1/821: chown d0/d1/d44/d59/d42/dcf/c66 29301520 1 2024-02-15T18:31:35.913 INFO:tasks.workunit.client.1.smithi131.stdout:7/689: dread d0/d17/d3a/f63 [0,4194304] 0 2024-02-15T18:31:35.913 INFO:tasks.workunit.client.1.smithi131.stdout:2/526: dread dd/d10/d22/d2f/d38/d74/d2e/d6a/f6b [0,4194304] 0 2024-02-15T18:31:35.914 INFO:tasks.workunit.client.1.smithi131.stdout:8/668: dread d22/d2e/f9a [0,4194304] 0 2024-02-15T18:31:35.916 INFO:tasks.workunit.client.1.smithi131.stdout:7/690: creat d0/d34/d8e/fd9 x:0 0 0 2024-02-15T18:31:35.916 INFO:tasks.workunit.client.1.smithi131.stdout:7/691: read - d0/d34/d8b/fa7 zero size 2024-02-15T18:31:35.916 INFO:tasks.workunit.client.1.smithi131.stdout:7/692: chown d0/d17/d36/f85 44 1 2024-02-15T18:31:35.918 INFO:tasks.workunit.client.1.smithi131.stdout:7/693: creat d0/d34/fda x:0 0 0 2024-02-15T18:31:35.920 INFO:tasks.workunit.client.1.smithi131.stdout:2/527: dread dd/d10/d22/d2f/d38/d74/d2e/d66/d99/f9c [0,4194304] 0 2024-02-15T18:31:35.922 INFO:tasks.workunit.client.1.smithi131.stdout:7/694: creat d0/d9d/dc8/fdb x:0 0 0 2024-02-15T18:31:35.922 INFO:tasks.workunit.client.1.smithi131.stdout:7/695: chown d0/d17/laf 3431231 1 2024-02-15T18:31:35.923 INFO:tasks.workunit.client.1.smithi131.stdout:2/528: mknod dd/d14/d1f/d65/d81/cac 0 2024-02-15T18:31:35.923 INFO:tasks.workunit.client.1.smithi131.stdout:2/529: truncate dd/f6f 2639825 0 2024-02-15T18:31:35.923 INFO:tasks.workunit.client.1.smithi131.stdout:7/696: creat d0/d34/d8e/fdc x:0 0 0 2024-02-15T18:31:35.926 INFO:tasks.workunit.client.1.smithi131.stdout:2/530: rename dd/d10/d22/d2f/d38/f45 to dd/d14/d1f/d65/fad 0 2024-02-15T18:31:35.928 INFO:tasks.workunit.client.1.smithi131.stdout:7/697: mkdir d0/d17/d3a/d3d/dcb/ddd 0 2024-02-15T18:31:35.928 INFO:tasks.workunit.client.1.smithi131.stdout:7/698: fdatasync d0/f43 0 2024-02-15T18:31:35.932 INFO:tasks.workunit.client.1.smithi131.stdout:7/699: dread d0/d17/d3a/f63 [0,4194304] 0 2024-02-15T18:31:35.937 INFO:tasks.workunit.client.1.smithi131.stdout:2/531: dread dd/d10/d22/d2f/d38/f7c [0,4194304] 0 2024-02-15T18:31:35.937 INFO:tasks.workunit.client.1.smithi131.stdout:2/532: readlink dd/d14/d1f/d65/d77/l98 0 2024-02-15T18:31:35.942 INFO:tasks.workunit.client.1.smithi131.stdout:1/822: dwrite d0/d2/d7/d72/d78/df2/f10a [0,4194304] 0 2024-02-15T18:31:35.942 INFO:tasks.workunit.client.1.smithi131.stdout:1/823: write d0/d1/d24/f110 [348612,104589] 0 2024-02-15T18:31:35.943 INFO:tasks.workunit.client.1.smithi131.stdout:8/669: dwrite d22/d26/d3f/d47/d48/d84/f98 [4194304,4194304] 0 2024-02-15T18:31:35.943 INFO:tasks.workunit.client.1.smithi131.stdout:2/533: dread dd/d10/d22/d2a/f30 [0,4194304] 0 2024-02-15T18:31:35.945 INFO:tasks.workunit.client.1.smithi131.stdout:8/670: symlink d22/d26/d3f/d47/d48/d84/daf/lec 0 2024-02-15T18:31:35.945 INFO:tasks.workunit.client.1.smithi131.stdout:8/671: dread - d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/fa6 zero size 2024-02-15T18:31:35.946 INFO:tasks.workunit.client.1.smithi131.stdout:2/534: symlink dd/d10/d22/d2f/d38/d74/d2e/d66/lae 0 2024-02-15T18:31:35.946 INFO:tasks.workunit.client.1.smithi131.stdout:8/672: mknod d22/d26/d3f/d47/d57/ced 0 2024-02-15T18:31:35.946 INFO:tasks.workunit.client.1.smithi131.stdout:2/535: getdents dd/d10/d22/d2a/d48 0 2024-02-15T18:31:35.947 INFO:tasks.workunit.client.1.smithi131.stdout:8/673: mknod d22/d26/d3f/d47/d48/d5f/cee 0 2024-02-15T18:31:35.956 INFO:tasks.workunit.client.1.smithi131.stdout:7/700: dwrite d0/d17/d36/f81 [0,4194304] 0 2024-02-15T18:31:35.957 INFO:tasks.workunit.client.1.smithi131.stdout:1/824: dread d0/d2/d4/f32 [0,4194304] 0 2024-02-15T18:31:35.957 INFO:tasks.workunit.client.1.smithi131.stdout:1/825: getdents d0/d1/d24/d114 0 2024-02-15T18:31:35.958 INFO:tasks.workunit.client.1.smithi131.stdout:1/826: chown d0/d2/db/l9f 0 1 2024-02-15T18:31:35.958 INFO:tasks.workunit.client.1.smithi131.stdout:1/827: fdatasync d0/d68/f9c 0 2024-02-15T18:31:35.968 INFO:tasks.workunit.client.1.smithi131.stdout:7/701: unlink d0/d17/d36/f3f 0 2024-02-15T18:31:35.970 INFO:tasks.workunit.client.1.smithi131.stdout:2/536: dwrite dd/d10/d22/d2f/d38/d74/d2e/d66/d99/f9c [0,4194304] 0 2024-02-15T18:31:35.971 INFO:tasks.workunit.client.1.smithi131.stdout:8/674: dwrite d22/d26/f6c [0,4194304] 0 2024-02-15T18:31:35.971 INFO:tasks.workunit.client.1.smithi131.stdout:2/537: readlink dd/d14/d1f/d65/d77/l98 0 2024-02-15T18:31:35.972 INFO:tasks.workunit.client.1.smithi131.stdout:1/828: mknod d0/d1/d16/c124 0 2024-02-15T18:31:35.972 INFO:tasks.workunit.client.1.smithi131.stdout:1/829: write d0/d1/d16/db7/fca [226368,76872] 0 2024-02-15T18:31:35.972 INFO:tasks.workunit.client.1.smithi131.stdout:7/702: mkdir d0/da9/dde 0 2024-02-15T18:31:35.979 INFO:tasks.workunit.client.1.smithi131.stdout:2/538: link f8 dd/d10/d22/d2f/d38/d74/d2e/d66/d99/faf 0 2024-02-15T18:31:35.982 INFO:tasks.workunit.client.1.smithi131.stdout:1/830: symlink d0/d2/db/de6/d10c/l125 0 2024-02-15T18:31:35.983 INFO:tasks.workunit.client.1.smithi131.stdout:8/675: rmdir d22 39 2024-02-15T18:31:35.987 INFO:tasks.workunit.client.1.smithi131.stdout:7/703: rmdir d0/d17/d3a/d3d/dcb/ddd 0 2024-02-15T18:31:35.989 INFO:tasks.workunit.client.1.smithi131.stdout:2/539: symlink dd/d14/d1f/d65/d77/d7a/da2/lb0 0 2024-02-15T18:31:36.008 INFO:tasks.workunit.client.1.smithi131.stdout:7/704: dwrite d0/f47 [8388608,4194304] 0 2024-02-15T18:31:36.020 INFO:tasks.workunit.client.1.smithi131.stdout:1/831: mknod d0/d2/d4/d41/dc3/d11a/c126 0 2024-02-15T18:31:36.020 INFO:tasks.workunit.client.1.smithi131.stdout:1/832: write d0/d1/d16/fcb [682030,84287] 0 2024-02-15T18:31:36.024 INFO:tasks.workunit.client.1.smithi131.stdout:2/540: mkdir dd/d10/db1 0 2024-02-15T18:31:36.027 INFO:tasks.workunit.client.1.smithi131.stdout:2/541: read f4 [1970824,74252] 0 2024-02-15T18:31:36.029 INFO:tasks.workunit.client.1.smithi131.stdout:7/705: dwrite d0/d34/fb7 [0,4194304] 0 2024-02-15T18:31:36.029 INFO:tasks.workunit.client.1.smithi131.stdout:2/542: creat dd/d1e/fb2 x:0 0 0 2024-02-15T18:31:36.030 INFO:tasks.workunit.client.1.smithi131.stdout:7/706: read d0/d34/fb7 [3423765,23357] 0 2024-02-15T18:31:36.032 INFO:tasks.workunit.client.1.smithi131.stdout:2/543: symlink dd/d14/d1f/d65/d77/lb3 0 2024-02-15T18:31:36.038 INFO:tasks.workunit.client.1.smithi131.stdout:7/707: dread d0/d34/d8b/d9a/fb9 [0,4194304] 0 2024-02-15T18:31:36.038 INFO:tasks.workunit.client.1.smithi131.stdout:2/544: rename fc to dd/d10/fb4 0 2024-02-15T18:31:36.044 INFO:tasks.workunit.client.1.smithi131.stdout:1/833: dwrite d0/d2/d7/d72/d78/da7/d109/fdb [0,4194304] 0 2024-02-15T18:31:36.049 INFO:tasks.workunit.client.1.smithi131.stdout:2/545: rmdir dd/d10/d22/d2f/d38 39 2024-02-15T18:31:36.053 INFO:tasks.workunit.client.1.smithi131.stdout:2/546: unlink dd/d10/c1d 0 2024-02-15T18:31:36.058 INFO:tasks.workunit.client.1.smithi131.stdout:2/547: write dd/f18 [1929564,81322] 0 2024-02-15T18:31:36.058 INFO:tasks.workunit.client.1.smithi131.stdout:2/548: write dd/d10/d22/d2a/f30 [4926587,40951] 0 2024-02-15T18:31:36.061 INFO:tasks.workunit.client.1.smithi131.stdout:2/549: read dd/d10/d22/d2f/d38/f7c [2256730,57576] 0 2024-02-15T18:31:36.061 INFO:tasks.workunit.client.1.smithi131.stdout:2/550: rename dd to dd/d10/d22/d2f/d38/d74/d2e/d66/d9b/db5 22 2024-02-15T18:31:36.062 INFO:tasks.workunit.client.1.smithi131.stdout:2/551: write dd/d10/d22/d2f/d38/d74/d2e/d66/fa7 [473311,51181] 0 2024-02-15T18:31:36.064 INFO:tasks.workunit.client.1.smithi131.stdout:1/834: dwrite d0/d2/d31/d3d/f6a [0,4194304] 0 2024-02-15T18:31:36.065 INFO:tasks.workunit.client.1.smithi131.stdout:7/708: dwrite d0/d17/f68 [0,4194304] 0 2024-02-15T18:31:36.066 INFO:tasks.workunit.client.1.smithi131.stdout:1/835: symlink d0/d68/l127 0 2024-02-15T18:31:36.066 INFO:tasks.workunit.client.1.smithi131.stdout:7/709: rmdir d0/db8/dd0 0 2024-02-15T18:31:36.066 INFO:tasks.workunit.client.1.smithi131.stdout:7/710: readlink d0/d17/d3a/lc7 0 2024-02-15T18:31:36.066 INFO:tasks.workunit.client.1.smithi131.stdout:7/711: write d0/d17/d36/f85 [37489,66421] 0 2024-02-15T18:31:36.074 INFO:tasks.workunit.client.1.smithi131.stdout:2/552: dread dd/d10/fb4 [0,4194304] 0 2024-02-15T18:31:36.078 INFO:tasks.workunit.client.1.smithi131.stdout:2/553: rename dd/d1e/l82 to dd/d10/d22/d2f/d38/d9f/lb6 0 2024-02-15T18:31:36.080 INFO:tasks.workunit.client.1.smithi131.stdout:5/601: sync 2024-02-15T18:31:36.080 INFO:tasks.workunit.client.1.smithi131.stdout:5/602: chown d18/d33/d73/f79 1394374454 1 2024-02-15T18:31:36.081 INFO:tasks.workunit.client.1.smithi131.stdout:5/603: stat d18/d20/f4c 0 2024-02-15T18:31:36.086 INFO:tasks.workunit.client.1.smithi131.stdout:1/836: dwrite d0/d2/d4/da/f1f [4194304,4194304] 0 2024-02-15T18:31:36.088 INFO:tasks.workunit.client.1.smithi131.stdout:1/837: write d0/d2/d4/f32 [4908273,59003] 0 2024-02-15T18:31:36.088 INFO:tasks.workunit.client.1.smithi131.stdout:1/838: fdatasync d0/d2/d7/d72/f107 0 2024-02-15T18:31:36.088 INFO:tasks.workunit.client.1.smithi131.stdout:1/839: dread - d0/d2/d4/d41/dc3/fe8 zero size 2024-02-15T18:31:36.095 INFO:tasks.workunit.client.1.smithi131.stdout:1/840: write d0/d1/d44/fb4 [1511210,37572] 0 2024-02-15T18:31:36.100 INFO:tasks.workunit.client.1.smithi131.stdout:1/841: read d0/d1/d24/f2d [1032303,101739] 0 2024-02-15T18:31:36.101 INFO:tasks.workunit.client.1.smithi131.stdout:5/604: dwrite fb [0,4194304] 0 2024-02-15T18:31:36.101 INFO:tasks.workunit.client.1.smithi131.stdout:5/605: chown d18/f92 6933 1 2024-02-15T18:31:36.101 INFO:tasks.workunit.client.1.smithi131.stdout:1/842: creat d0/d1/d16/d9d/f128 x:0 0 0 2024-02-15T18:31:36.101 INFO:tasks.workunit.client.1.smithi131.stdout:2/554: dwrite dd/d10/d22/d2f/d38/d74/d2e/d6a/f7d [0,4194304] 0 2024-02-15T18:31:36.102 INFO:tasks.workunit.client.1.smithi131.stdout:2/555: write dd/d10/d22/d2f/d38/f50 [87238,128555] 0 2024-02-15T18:31:36.102 INFO:tasks.workunit.client.1.smithi131.stdout:2/556: readlink dd/d14/d1f/d65/d77/l98 0 2024-02-15T18:31:36.105 INFO:tasks.workunit.client.1.smithi131.stdout:5/606: unlink d18/d83/d8b/dba/d63/f76 0 2024-02-15T18:31:36.105 INFO:tasks.workunit.client.1.smithi131.stdout:5/607: truncate d18/d4e/db6/fb7 347206 0 2024-02-15T18:31:36.107 INFO:tasks.workunit.client.1.smithi131.stdout:2/557: creat dd/d10/d22/fb7 x:0 0 0 2024-02-15T18:31:36.107 INFO:tasks.workunit.client.1.smithi131.stdout:2/558: fsync dd/d10/d22/d2f/d38/d74/d2e/d66/d99/f9c 0 2024-02-15T18:31:36.110 INFO:tasks.workunit.client.1.smithi131.stdout:2/559: rename dd/d10/d22/d2f/d38/d74/d2e/d4a/c5e to dd/d14/d1f/d65/d77/d7a/da2/cb8 0 2024-02-15T18:31:36.115 INFO:tasks.workunit.client.1.smithi131.stdout:5/608: dread d18/d83/d8b/dba/f4a [0,4194304] 0 2024-02-15T18:31:36.115 INFO:tasks.workunit.client.1.smithi131.stdout:5/609: chown d18/d20/f2e 1748051178 1 2024-02-15T18:31:36.117 INFO:tasks.workunit.client.1.smithi131.stdout:5/610: creat d18/d23/fcc x:0 0 0 2024-02-15T18:31:36.117 INFO:tasks.workunit.client.1.smithi131.stdout:5/611: chown d18/d6d/d9c/fc6 1 1 2024-02-15T18:31:36.118 INFO:tasks.workunit.client.1.smithi131.stdout:1/843: dwrite d0/d2/dd6/f2e [0,4194304] 0 2024-02-15T18:31:36.119 INFO:tasks.workunit.client.1.smithi131.stdout:5/612: rmdir d18/d83/d89 39 2024-02-15T18:31:36.119 INFO:tasks.workunit.client.1.smithi131.stdout:5/613: chown d18/d20/fa8 8195363 1 2024-02-15T18:31:36.123 INFO:tasks.workunit.client.1.smithi131.stdout:2/560: dread dd/d10/d22/d2a/f93 [0,4194304] 0 2024-02-15T18:31:36.124 INFO:tasks.workunit.client.1.smithi131.stdout:2/561: write dd/d14/d1f/d65/f71 [3047286,130589] 0 2024-02-15T18:31:36.129 INFO:tasks.workunit.client.1.smithi131.stdout:5/614: dread d18/d20/f2e [0,4194304] 0 2024-02-15T18:31:36.143 INFO:tasks.workunit.client.1.smithi131.stdout:1/844: dwrite d0/d2/d4/d41/d5a/ff7 [0,4194304] 0 2024-02-15T18:31:36.147 INFO:tasks.workunit.client.1.smithi131.stdout:1/845: symlink d0/d2/d7/d72/dbb/l129 0 2024-02-15T18:31:36.147 INFO:tasks.workunit.client.1.smithi131.stdout:2/562: dwrite dd/d10/f19 [4194304,4194304] 0 2024-02-15T18:31:36.151 INFO:tasks.workunit.client.1.smithi131.stdout:2/563: link fa dd/d10/d22/d2f/d38/fb9 0 2024-02-15T18:31:36.151 INFO:tasks.workunit.client.1.smithi131.stdout:2/564: fsync dd/d10/d22/d2f/f40 0 2024-02-15T18:31:36.153 INFO:tasks.workunit.client.1.smithi131.stdout:2/565: rename dd/d10/d22/d2a/d94/l43 to dd/d10/d22/d2f/d38/d74/d2e/d66/d9b/lba 0 2024-02-15T18:31:36.155 INFO:tasks.workunit.client.1.smithi131.stdout:2/566: symlink dd/d10/d22/d2f/d38/d74/d2e/d4a/lbb 0 2024-02-15T18:31:36.155 INFO:tasks.workunit.client.1.smithi131.stdout:2/567: write dd/d10/d22/d2f/d38/d74/d2e/d66/f78 [773816,96385] 0 2024-02-15T18:31:36.155 INFO:tasks.workunit.client.1.smithi131.stdout:2/568: stat dd/d10/d22/d2f/d38/d74 0 2024-02-15T18:31:36.156 INFO:tasks.workunit.client.1.smithi131.stdout:1/846: dread d0/d2/d7/f4c [4194304,4194304] 0 2024-02-15T18:31:36.156 INFO:tasks.workunit.client.1.smithi131.stdout:5/615: dwrite d18/d23/fad [0,4194304] 0 2024-02-15T18:31:36.160 INFO:tasks.workunit.client.1.smithi131.stdout:2/569: creat dd/d14/d1f/d65/d77/fbc x:0 0 0 2024-02-15T18:31:36.160 INFO:tasks.workunit.client.1.smithi131.stdout:2/570: readlink dd/l25 0 2024-02-15T18:31:36.160 INFO:tasks.workunit.client.1.smithi131.stdout:5/616: dread d18/d20/f2e [0,4194304] 0 2024-02-15T18:31:36.163 INFO:tasks.workunit.client.1.smithi131.stdout:2/571: mkdir dd/d10/db1/dbd 0 2024-02-15T18:31:36.165 INFO:tasks.workunit.client.1.smithi131.stdout:1/847: dread d0/d1/d44/d59/fc6 [0,4194304] 0 2024-02-15T18:31:36.165 INFO:tasks.workunit.client.1.smithi131.stdout:1/848: write d0/d2/f12 [4819686,16246] 0 2024-02-15T18:31:36.166 INFO:tasks.workunit.client.1.smithi131.stdout:5/617: link d18/d6d/d70/d9e/d86/la9 d18/d6d/d70/d9e/d85/lcd 0 2024-02-15T18:31:36.166 INFO:tasks.workunit.client.1.smithi131.stdout:5/618: stat d18/d83/d8b/dba/d7b/db8/fb9 0 2024-02-15T18:31:36.167 INFO:tasks.workunit.client.1.smithi131.stdout:5/619: dread d18/d83/d8b/dba/f59 [0,4194304] 0 2024-02-15T18:31:36.168 INFO:tasks.workunit.client.1.smithi131.stdout:2/572: truncate dd/d10/d22/d2f/d38/d74/d2e/d6a/f7d 2975788 0 2024-02-15T18:31:36.185 INFO:tasks.workunit.client.1.smithi131.stdout:2/573: dwrite dd/d10/d22/d2a/f2c [0,4194304] 0 2024-02-15T18:31:36.188 INFO:tasks.workunit.client.1.smithi131.stdout:1/849: getdents d0/d2/d31/d3d/dd3 0 2024-02-15T18:31:36.188 INFO:tasks.workunit.client.1.smithi131.stdout:1/850: chown d0/lba 33071997 1 2024-02-15T18:31:36.189 INFO:tasks.workunit.client.1.smithi131.stdout:5/620: mknod d18/d4e/cce 0 2024-02-15T18:31:36.190 INFO:tasks.workunit.client.1.smithi131.stdout:2/574: creat dd/d10/d22/d2a/d48/fbe x:0 0 0 2024-02-15T18:31:36.191 INFO:tasks.workunit.client.1.smithi131.stdout:1/851: creat d0/d1/d24/d108/f12a x:0 0 0 2024-02-15T18:31:36.192 INFO:tasks.workunit.client.1.smithi131.stdout:2/575: creat dd/d69/fbf x:0 0 0 2024-02-15T18:31:36.194 INFO:tasks.workunit.client.1.smithi131.stdout:1/852: link d0/d2/d31/d3d/d46/c84 d0/d1/d44/d59/c12b 0 2024-02-15T18:31:36.195 INFO:tasks.workunit.client.1.smithi131.stdout:1/853: symlink d0/d1/l12c 0 2024-02-15T18:31:36.218 INFO:tasks.workunit.client.1.smithi131.stdout:1/854: dwrite d0/f4d [4194304,4194304] 0 2024-02-15T18:31:36.218 INFO:tasks.workunit.client.1.smithi131.stdout:1/855: fdatasync d0/d2/d4/da/f1f 0 2024-02-15T18:31:36.219 INFO:tasks.workunit.client.1.smithi131.stdout:1/856: creat d0/d2/d7/d72/f12d x:0 0 0 2024-02-15T18:31:36.219 INFO:tasks.workunit.client.1.smithi131.stdout:5/621: dwrite d18/d33/d73/f88 [0,4194304] 0 2024-02-15T18:31:36.223 INFO:tasks.workunit.client.1.smithi131.stdout:1/857: truncate d0/d2/d4/d41/fa5 3294732 0 2024-02-15T18:31:36.224 INFO:tasks.workunit.client.1.smithi131.stdout:5/622: rmdir d18/d6d/d70/d9e 39 2024-02-15T18:31:36.225 INFO:tasks.workunit.client.1.smithi131.stdout:1/858: stat d0/d2/d4/d41/l62 0 2024-02-15T18:31:36.231 INFO:tasks.workunit.client.1.smithi131.stdout:1/859: mknod d0/d2/d4/c12e 0 2024-02-15T18:31:36.234 INFO:tasks.workunit.client.1.smithi131.stdout:5/623: dread d18/d33/d73/fc5 [0,4194304] 0 2024-02-15T18:31:36.234 INFO:tasks.workunit.client.1.smithi131.stdout:5/624: getdents d18/d83/d8b/dba/d7b/dac 0 2024-02-15T18:31:36.236 INFO:tasks.workunit.client.1.smithi131.stdout:5/625: link d18/d83/d8b/dba/d63/f7e d18/d83/d8b/dba/d63/fcf 0 2024-02-15T18:31:36.236 INFO:tasks.workunit.client.1.smithi131.stdout:5/626: stat d18/c93 0 2024-02-15T18:31:36.237 INFO:tasks.workunit.client.1.smithi131.stdout:5/627: rmdir d18/d6d/d70/d9e/d85/dab 39 2024-02-15T18:31:36.239 INFO:tasks.workunit.client.1.smithi131.stdout:5/628: unlink d18/d83/l8d 0 2024-02-15T18:31:36.239 INFO:tasks.workunit.client.1.smithi131.stdout:5/629: read d18/d83/d8b/dba/f87 [16039,48369] 0 2024-02-15T18:31:36.250 INFO:tasks.workunit.client.1.smithi131.stdout:1/860: dwrite d0/d2/d4/d41/d5a/f7a [0,4194304] 0 2024-02-15T18:31:36.250 INFO:tasks.workunit.client.1.smithi131.stdout:1/861: chown d0/d68/d80/fc7 1828013 1 2024-02-15T18:31:36.250 INFO:tasks.workunit.client.1.smithi131.stdout:1/862: chown d0/d1/d44/f11f 14029510 1 2024-02-15T18:31:36.250 INFO:tasks.workunit.client.1.smithi131.stdout:1/863: chown d0/d2 586531 1 2024-02-15T18:31:36.251 INFO:tasks.workunit.client.1.smithi131.stdout:5/630: dread d18/d4e/f64 [0,4194304] 0 2024-02-15T18:31:36.252 INFO:tasks.workunit.client.1.smithi131.stdout:5/631: truncate d18/d4e/db6/fb7 1332956 0 2024-02-15T18:31:36.252 INFO:tasks.workunit.client.1.smithi131.stdout:1/864: mkdir d0/d2/d4/d41/d12f 0 2024-02-15T18:31:36.252 INFO:tasks.workunit.client.1.smithi131.stdout:1/865: write d0/d2/d7/f90 [863032,35714] 0 2024-02-15T18:31:36.253 INFO:tasks.workunit.client.1.smithi131.stdout:4/685: sync 2024-02-15T18:31:36.253 INFO:tasks.workunit.client.1.smithi131.stdout:0/490: sync 2024-02-15T18:31:36.254 INFO:tasks.workunit.client.1.smithi131.stdout:6/542: sync 2024-02-15T18:31:36.254 INFO:tasks.workunit.client.1.smithi131.stdout:9/785: sync 2024-02-15T18:31:36.255 INFO:tasks.workunit.client.1.smithi131.stdout:6/543: write d2/dc/f14 [2709122,8418] 0 2024-02-15T18:31:36.256 INFO:tasks.workunit.client.1.smithi131.stdout:5/632: creat d18/d6d/d70/d9e/d85/d95/fd0 x:0 0 0 2024-02-15T18:31:36.256 INFO:tasks.workunit.client.1.smithi131.stdout:5/633: chown d18/d83/d8b 15 1 2024-02-15T18:31:36.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/544: write d2/f42 [2856080,45926] 0 2024-02-15T18:31:36.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/545: chown d2/d7/d12/c18 16347 1 2024-02-15T18:31:36.259 INFO:tasks.workunit.client.1.smithi131.stdout:1/866: link d0/d2/dd6/fbe d0/d2/d7/d72/d78/da7/f130 0 2024-02-15T18:31:36.260 INFO:tasks.workunit.client.1.smithi131.stdout:4/686: mkdir d2/dfa 0 2024-02-15T18:31:36.263 INFO:tasks.workunit.client.1.smithi131.stdout:0/491: creat d5/d2f/d4b/f9b x:0 0 0 2024-02-15T18:31:36.263 INFO:tasks.workunit.client.1.smithi131.stdout:1/867: write d0/d2/d7/fb6 [7307706,111783] 0 2024-02-15T18:31:36.264 INFO:tasks.workunit.client.1.smithi131.stdout:5/634: creat d18/d83/d8b/dba/da3/fd1 x:0 0 0 2024-02-15T18:31:36.266 INFO:tasks.workunit.client.1.smithi131.stdout:4/687: mkdir d2/d2a/d47/d21/dcd/dfb 0 2024-02-15T18:31:36.267 INFO:tasks.workunit.client.1.smithi131.stdout:1/868: read d0/d1/d16/f43 [1451804,108980] 0 2024-02-15T18:31:36.268 INFO:tasks.workunit.client.1.smithi131.stdout:0/492: creat d5/d9/d10/d71/d92/f9c x:0 0 0 2024-02-15T18:31:36.271 INFO:tasks.workunit.client.1.smithi131.stdout:9/786: dwrite d4/dc/d25/d3f/fd9 [0,4194304] 0 2024-02-15T18:31:36.271 INFO:tasks.workunit.client.1.smithi131.stdout:5/635: rename d18/d83/d8b/dba/da3/fd1 to d18/d6d/d70/d9e/d86/fd2 0 2024-02-15T18:31:36.271 INFO:tasks.workunit.client.1.smithi131.stdout:5/636: fsync d18/d6d/d70/d9e/f7a 0 2024-02-15T18:31:36.275 INFO:tasks.workunit.client.1.smithi131.stdout:4/688: symlink d2/d2a/d85/da3/lfc 0 2024-02-15T18:31:36.275 INFO:tasks.workunit.client.1.smithi131.stdout:4/689: write d2/f8 [4501649,47393] 0 2024-02-15T18:31:36.275 INFO:tasks.workunit.client.1.smithi131.stdout:4/690: read d2/d7/d1c/d5d/d7a/d92/fad [651973,99994] 0 2024-02-15T18:31:36.275 INFO:tasks.workunit.client.1.smithi131.stdout:4/691: write d2/d7/d12/d53/f81 [4299831,16604] 0 2024-02-15T18:31:36.278 INFO:tasks.workunit.client.1.smithi131.stdout:9/787: creat d4/dc/d17/d19/ffe x:0 0 0 2024-02-15T18:31:36.281 INFO:tasks.workunit.client.1.smithi131.stdout:5/637: symlink d18/d83/d8b/dba/d63/ld3 0 2024-02-15T18:31:36.293 INFO:tasks.workunit.client.1.smithi131.stdout:0/493: dwrite d5/d9/d11/f88 [0,4194304] 0 2024-02-15T18:31:36.294 INFO:tasks.workunit.client.1.smithi131.stdout:9/788: getdents d4/dc/d17 0 2024-02-15T18:31:36.295 INFO:tasks.workunit.client.1.smithi131.stdout:6/546: dwrite d2/d7/d12/d4d/f57 [4194304,4194304] 0 2024-02-15T18:31:36.295 INFO:tasks.workunit.client.1.smithi131.stdout:6/547: dread - d2/d7/d48/f5c zero size 2024-02-15T18:31:36.296 INFO:tasks.workunit.client.1.smithi131.stdout:5/638: unlink d18/d20/f71 0 2024-02-15T18:31:36.296 INFO:tasks.workunit.client.1.smithi131.stdout:4/692: dwrite d2/d2a/d85/da3/dba/fee [0,4194304] 0 2024-02-15T18:31:36.298 INFO:tasks.workunit.client.1.smithi131.stdout:9/789: dread d4/dc/de/d1e/d1f/d2c/f79 [0,4194304] 0 2024-02-15T18:31:36.300 INFO:tasks.workunit.client.1.smithi131.stdout:0/494: creat d5/d9/d11/d3e/f9d x:0 0 0 2024-02-15T18:31:36.307 INFO:tasks.workunit.client.1.smithi131.stdout:6/548: dread d2/d7/d12/d80/f92 [0,4194304] 0 2024-02-15T18:31:36.307 INFO:tasks.workunit.client.1.smithi131.stdout:6/549: stat d2/d7/d12/d4d 0 2024-02-15T18:31:36.307 INFO:tasks.workunit.client.1.smithi131.stdout:6/550: fdatasync d2/dc/d27/d62/d97/f25 0 2024-02-15T18:31:36.307 INFO:tasks.workunit.client.1.smithi131.stdout:6/551: write d2/d7/d12/d4d/f9a [426829,101688] 0 2024-02-15T18:31:36.311 INFO:tasks.workunit.client.1.smithi131.stdout:6/552: read d2/d36/f3c [1521040,55910] 0 2024-02-15T18:31:36.311 INFO:tasks.workunit.client.1.smithi131.stdout:6/553: write d2/dc/d27/d62/d97/f98 [90636,34303] 0 2024-02-15T18:31:36.315 INFO:tasks.workunit.client.1.smithi131.stdout:9/790: rename d4/dc/d17/db0/dbc/f95 to d4/dc/d17/d19/fff 0 2024-02-15T18:31:36.317 INFO:tasks.workunit.client.1.smithi131.stdout:6/554: mkdir d2/dc/d1f/daa 0 2024-02-15T18:31:36.321 INFO:tasks.workunit.client.1.smithi131.stdout:9/791: mkdir d4/dc/d17/d19/d32/d100 0 2024-02-15T18:31:36.323 INFO:tasks.workunit.client.1.smithi131.stdout:6/555: truncate d2/d7/fa 3255976 0 2024-02-15T18:31:36.326 INFO:tasks.workunit.client.1.smithi131.stdout:6/556: getdents d2/d36 0 2024-02-15T18:31:36.327 INFO:tasks.workunit.client.1.smithi131.stdout:5/639: dwrite d18/d23/f30 [0,4194304] 0 2024-02-15T18:31:36.327 INFO:tasks.workunit.client.1.smithi131.stdout:6/557: rmdir d2/d2b/d6e 39 2024-02-15T18:31:36.328 INFO:tasks.workunit.client.1.smithi131.stdout:5/640: creat d18/d4e/db6/fd4 x:0 0 0 2024-02-15T18:31:36.328 INFO:tasks.workunit.client.1.smithi131.stdout:5/641: dread - d18/d20/fa8 zero size 2024-02-15T18:31:36.328 INFO:tasks.workunit.client.1.smithi131.stdout:0/495: dwrite d5/d15/d1f/f36 [0,4194304] 0 2024-02-15T18:31:36.329 INFO:tasks.workunit.client.1.smithi131.stdout:6/558: mknod d2/d7/cab 0 2024-02-15T18:31:36.329 INFO:tasks.workunit.client.1.smithi131.stdout:6/559: write d2/d2b/f56 [973006,27361] 0 2024-02-15T18:31:36.330 INFO:tasks.workunit.client.1.smithi131.stdout:5/642: symlink d18/d6d/d70/d9e/d85/ld5 0 2024-02-15T18:31:36.330 INFO:tasks.workunit.client.1.smithi131.stdout:5/643: chown d18/d20/d9a 214555 1 2024-02-15T18:31:36.331 INFO:tasks.workunit.client.1.smithi131.stdout:4/693: dwrite d2/d7/d12/d53/fbb [0,4194304] 0 2024-02-15T18:31:36.332 INFO:tasks.workunit.client.1.smithi131.stdout:0/496: unlink d5/d9/d10/d3f/f98 0 2024-02-15T18:31:36.335 INFO:tasks.workunit.client.1.smithi131.stdout:4/694: symlink d2/d7/d12/d2e/d5f/lfd 0 2024-02-15T18:31:36.342 INFO:tasks.workunit.client.1.smithi131.stdout:5/644: dread f17 [0,4194304] 0 2024-02-15T18:31:36.342 INFO:tasks.workunit.client.1.smithi131.stdout:5/645: readlink d18/d6d/d70/d9e/d85/dab/l6b 0 2024-02-15T18:31:36.342 INFO:tasks.workunit.client.1.smithi131.stdout:5/646: dread - d18/d4e/db6/fd4 zero size 2024-02-15T18:31:36.345 INFO:tasks.workunit.client.1.smithi131.stdout:4/695: dread d2/d7/d12/d2e/d39/f9d [0,4194304] 0 2024-02-15T18:31:36.347 INFO:tasks.workunit.client.1.smithi131.stdout:4/696: stat d2/d2a/d76/ld5 0 2024-02-15T18:31:36.349 INFO:tasks.workunit.client.1.smithi131.stdout:5/647: unlink d18/d4e/db6/fb7 0 2024-02-15T18:31:36.349 INFO:tasks.workunit.client.1.smithi131.stdout:5/648: readlink d18/d83/d89/lca 0 2024-02-15T18:31:36.350 INFO:tasks.workunit.client.1.smithi131.stdout:5/649: truncate d18/d20/f2a 408640 0 2024-02-15T18:31:36.352 INFO:tasks.workunit.client.1.smithi131.stdout:0/497: dwrite d5/d2f/d45/f95 [0,4194304] 0 2024-02-15T18:31:36.353 INFO:tasks.workunit.client.1.smithi131.stdout:5/650: getdents d18/d23 0 2024-02-15T18:31:36.353 INFO:tasks.workunit.client.1.smithi131.stdout:5/651: chown d18/d83/d8b/dba/lbf 0 1 2024-02-15T18:31:36.363 INFO:tasks.workunit.client.1.smithi131.stdout:5/652: mkdir d18/d33/dd6 0 2024-02-15T18:31:36.365 INFO:tasks.workunit.client.1.smithi131.stdout:5/653: symlink d18/d6d/d9c/ld7 0 2024-02-15T18:31:36.366 INFO:tasks.workunit.client.1.smithi131.stdout:5/654: creat d18/d4e/fd8 x:0 0 0 2024-02-15T18:31:36.368 INFO:tasks.workunit.client.1.smithi131.stdout:5/655: creat d18/d83/fd9 x:0 0 0 2024-02-15T18:31:36.368 INFO:tasks.workunit.client.1.smithi131.stdout:5/656: dread - d18/d6d/d9c/fc6 zero size 2024-02-15T18:31:36.372 INFO:tasks.workunit.client.1.smithi131.stdout:4/697: dwrite d2/f1a [0,4194304] 0 2024-02-15T18:31:36.373 INFO:tasks.workunit.client.1.smithi131.stdout:0/498: dwrite d5/d2f/d4b/f8a [0,4194304] 0 2024-02-15T18:31:36.383 INFO:tasks.workunit.client.1.smithi131.stdout:5/657: getdents d18/d83 0 2024-02-15T18:31:36.383 INFO:tasks.workunit.client.1.smithi131.stdout:5/658: fsync d18/d83/d8b/dba/f2c 0 2024-02-15T18:31:36.387 INFO:tasks.workunit.client.1.smithi131.stdout:4/698: dwrite d2/d7/d12/d2e/d39/d4b/ff4 [0,4194304] 0 2024-02-15T18:31:36.387 INFO:tasks.workunit.client.1.smithi131.stdout:4/699: readlink d2/d2a/d47/d16/l36 0 2024-02-15T18:31:36.390 INFO:tasks.workunit.client.1.smithi131.stdout:0/499: link d5/d2f/d45/d8c/l97 d5/l9e 0 2024-02-15T18:31:36.393 INFO:tasks.workunit.client.1.smithi131.stdout:5/659: dread fb [0,4194304] 0 2024-02-15T18:31:36.393 INFO:tasks.workunit.client.1.smithi131.stdout:4/700: getdents d2/d2a/d47/d16/d5a 0 2024-02-15T18:31:36.393 INFO:tasks.workunit.client.1.smithi131.stdout:4/701: fsync d2/d2a/d85/da3/dba/fee 0 2024-02-15T18:31:36.398 INFO:tasks.workunit.client.1.smithi131.stdout:5/660: rename d18/d83/d8b/dba/da3 to d18/d83/d8b/dba/dda 0 2024-02-15T18:31:36.399 INFO:tasks.workunit.client.1.smithi131.stdout:4/702: truncate d2/d2a/d47/d21/f3a 1734673 0 2024-02-15T18:31:36.399 INFO:tasks.workunit.client.1.smithi131.stdout:5/661: creat d18/d4e/fdb x:0 0 0 2024-02-15T18:31:36.402 INFO:tasks.workunit.client.1.smithi131.stdout:4/703: rename d2/d7/d1c/d5d to d2/d7/d12/d53/db9/dfe 0 2024-02-15T18:31:36.402 INFO:tasks.workunit.client.1.smithi131.stdout:4/704: write d2/d7/fab [270749,61749] 0 2024-02-15T18:31:36.402 INFO:tasks.workunit.client.1.smithi131.stdout:4/705: write d2/d7/d12/d2e/d39/f9d [615408,60003] 0 2024-02-15T18:31:36.402 INFO:tasks.workunit.client.1.smithi131.stdout:4/706: dread - d2/d7/d12/d2e/f34 zero size 2024-02-15T18:31:36.406 INFO:tasks.workunit.client.1.smithi131.stdout:5/662: link d18/d6d/d9c/ld7 d18/d33/dd6/ldc 0 2024-02-15T18:31:36.408 INFO:tasks.workunit.client.1.smithi131.stdout:0/500: dwrite d5/f62 [0,4194304] 0 2024-02-15T18:31:36.408 INFO:tasks.workunit.client.1.smithi131.stdout:0/501: chown f4 3853587 1 2024-02-15T18:31:36.411 INFO:tasks.workunit.client.1.smithi131.stdout:5/663: symlink d18/ldd 0 2024-02-15T18:31:36.413 INFO:tasks.workunit.client.1.smithi131.stdout:5/664: write d18/d20/f48 [43281,105689] 0 2024-02-15T18:31:36.415 INFO:tasks.workunit.client.1.smithi131.stdout:0/502: mkdir d5/d2f/d4b/d82/d9f 0 2024-02-15T18:31:36.418 INFO:tasks.workunit.client.1.smithi131.stdout:5/665: creat d18/fde x:0 0 0 2024-02-15T18:31:36.419 INFO:tasks.workunit.client.1.smithi131.stdout:5/666: write d18/d6d/d70/d9e/fa6 [1297989,20688] 0 2024-02-15T18:31:36.420 INFO:tasks.workunit.client.1.smithi131.stdout:0/503: mkdir d5/d2f/d4b/d82/da0 0 2024-02-15T18:31:36.420 INFO:tasks.workunit.client.1.smithi131.stdout:0/504: write d5/d9/d10/d73/f99 [891630,101990] 0 2024-02-15T18:31:36.420 INFO:tasks.workunit.client.1.smithi131.stdout:0/505: stat d5/d9/d10/d3f/l40 0 2024-02-15T18:31:36.424 INFO:tasks.workunit.client.1.smithi131.stdout:0/506: mknod d5/d2f/ca1 0 2024-02-15T18:31:36.424 INFO:tasks.workunit.client.1.smithi131.stdout:0/507: chown d5/d2f/d4b/l7a 3 1 2024-02-15T18:31:36.427 INFO:tasks.workunit.client.1.smithi131.stdout:0/508: symlink d5/d2f/la2 0 2024-02-15T18:31:36.428 INFO:tasks.workunit.client.1.smithi131.stdout:0/509: link d5/d9/d11/l5b d5/d2f/d4b/d82/d9f/la3 0 2024-02-15T18:31:36.428 INFO:tasks.workunit.client.1.smithi131.stdout:0/510: readlink d5/d9/d10/l64 0 2024-02-15T18:31:36.430 INFO:tasks.workunit.client.1.smithi131.stdout:0/511: getdents d5/d9/d10/d73 0 2024-02-15T18:31:36.431 INFO:tasks.workunit.client.1.smithi131.stdout:4/707: dwrite d2/d2a/d85/da3/fa7 [0,4194304] 0 2024-02-15T18:31:36.431 INFO:tasks.workunit.client.1.smithi131.stdout:5/667: dread d18/d83/d8b/dba/d63/fcf [0,4194304] 0 2024-02-15T18:31:36.431 INFO:tasks.workunit.client.1.smithi131.stdout:5/668: readlink d18/d33/lbb 0 2024-02-15T18:31:36.431 INFO:tasks.workunit.client.1.smithi131.stdout:0/512: symlink d5/d9/la4 0 2024-02-15T18:31:36.431 INFO:tasks.workunit.client.1.smithi131.stdout:0/513: dread - d5/d9/d11/d3e/f9d zero size 2024-02-15T18:31:36.432 INFO:tasks.workunit.client.1.smithi131.stdout:4/708: write d2/d2a/d47/d16/d43/f6c [885,114823] 0 2024-02-15T18:31:36.434 INFO:tasks.workunit.client.1.smithi131.stdout:0/514: symlink d5/d2f/d4b/d82/d9f/la5 0 2024-02-15T18:31:36.437 INFO:tasks.workunit.client.1.smithi131.stdout:0/515: mkdir d5/d9/d11/d3e/da6 0 2024-02-15T18:31:36.439 INFO:tasks.workunit.client.1.smithi131.stdout:0/516: symlink d5/d15/d1f/la7 0 2024-02-15T18:31:36.449 INFO:tasks.workunit.client.1.smithi131.stdout:3/761: sync 2024-02-15T18:31:36.449 INFO:tasks.workunit.client.1.smithi131.stdout:3/762: rmdir d2/d22/d29/db/d1a/dc3 39 2024-02-15T18:31:36.450 INFO:tasks.workunit.client.1.smithi131.stdout:3/763: rmdir d2/d22/d29/db 39 2024-02-15T18:31:36.453 INFO:tasks.workunit.client.1.smithi131.stdout:3/764: dread d2/d22/d5e/d79/f98 [0,4194304] 0 2024-02-15T18:31:36.454 INFO:tasks.workunit.client.1.smithi131.stdout:3/765: rmdir d2/d22/d29/db/dd1 39 2024-02-15T18:31:36.454 INFO:tasks.workunit.client.1.smithi131.stdout:3/766: write d2/d22/fc0 [1020142,95862] 0 2024-02-15T18:31:36.455 INFO:tasks.workunit.client.1.smithi131.stdout:4/709: dwrite d2/d2a/d47/f6f [0,4194304] 0 2024-02-15T18:31:36.455 INFO:tasks.workunit.client.1.smithi131.stdout:5/669: dwrite d18/d83/d8b/dba/f55 [4194304,4194304] 0 2024-02-15T18:31:36.455 INFO:tasks.workunit.client.1.smithi131.stdout:0/517: dread d5/f68 [0,4194304] 0 2024-02-15T18:31:36.469 INFO:tasks.workunit.client.1.smithi131.stdout:4/710: symlink d2/d2a/d47/df0/lff 0 2024-02-15T18:31:36.470 INFO:tasks.workunit.client.1.smithi131.stdout:3/767: rename d2/d22/d29/d9e/fa5 to d2/d22/d29/db/d1a/da4/d8d/ff7 0 2024-02-15T18:31:36.470 INFO:tasks.workunit.client.1.smithi131.stdout:3/768: dread - d2/d22/d29/db/d1a/fe6 zero size 2024-02-15T18:31:36.472 INFO:tasks.workunit.client.1.smithi131.stdout:0/518: mkdir d5/d9/d77/da8 0 2024-02-15T18:31:36.479 INFO:tasks.workunit.client.1.smithi131.stdout:4/711: mknod d2/dfa/c100 0 2024-02-15T18:31:36.479 INFO:tasks.workunit.client.1.smithi131.stdout:4/712: chown d2/d2a/f9f 2577 1 2024-02-15T18:31:36.479 INFO:tasks.workunit.client.1.smithi131.stdout:4/713: fsync d2/d23/fc4 0 2024-02-15T18:31:36.480 INFO:tasks.workunit.client.1.smithi131.stdout:5/670: rename d18/d6d/d70/d9e/f82 to d18/d6d/d70/d9e/d85/dab/fdf 0 2024-02-15T18:31:36.480 INFO:tasks.workunit.client.1.smithi131.stdout:5/671: dread - d18/d6d/d70/f81 zero size 2024-02-15T18:31:36.482 INFO:tasks.workunit.client.1.smithi131.stdout:3/769: creat d2/d22/d29/db/d23/d2a/d5b/ff8 x:0 0 0 2024-02-15T18:31:36.483 INFO:tasks.workunit.client.1.smithi131.stdout:0/519: truncate d5/d15/f27 80431 0 2024-02-15T18:31:36.486 INFO:tasks.workunit.client.1.smithi131.stdout:4/714: mkdir d2/d7/d1c/d84/db8/d101 0 2024-02-15T18:31:36.488 INFO:tasks.workunit.client.1.smithi131.stdout:0/520: getdents d5/d2f/d45/d8c 0 2024-02-15T18:31:36.488 INFO:tasks.workunit.client.1.smithi131.stdout:0/521: chown d5/d9/d10/f1e 7272 1 2024-02-15T18:31:36.490 INFO:tasks.workunit.client.1.smithi131.stdout:0/522: dread d5/f56 [0,4194304] 0 2024-02-15T18:31:36.491 INFO:tasks.workunit.client.1.smithi131.stdout:0/523: stat d5/d9/d4d 0 2024-02-15T18:31:36.491 INFO:tasks.workunit.client.1.smithi131.stdout:5/672: dread d18/d20/f2e [0,4194304] 0 2024-02-15T18:31:36.492 INFO:tasks.workunit.client.1.smithi131.stdout:5/673: rmdir d18/d20/d9a 0 2024-02-15T18:31:36.495 INFO:tasks.workunit.client.1.smithi131.stdout:4/715: dread d2/d2a/d47/d21/f3a [0,4194304] 0 2024-02-15T18:31:36.496 INFO:tasks.workunit.client.1.smithi131.stdout:4/716: symlink d2/d7/d12/d2e/d5f/d70/l102 0 2024-02-15T18:31:36.496 INFO:tasks.workunit.client.1.smithi131.stdout:4/717: fsync d2/d7/d12/d2e/f50 0 2024-02-15T18:31:36.498 INFO:tasks.workunit.client.1.smithi131.stdout:4/718: write d2/d7/d12/d2e/f64 [3596791,73994] 0 2024-02-15T18:31:36.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:35.165383+0000 mon.smithi033 (mon.0) 670 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:31:36.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:35.450108+0000 mgr.smithi033.apxevf (mgr.14626) 6 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 59 MiB/s rd, 112 MiB/s wr, 224 op/s 2024-02-15T18:31:36.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:35.591223+0000 mon.smithi033 (mon.0) 671 : cluster [DBG] Standby manager daemon smithi131.buibla started 2024-02-15T18:31:36.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:35.608815+0000 mon.smithi131 (mon.1) 55 : audit [DBG] from='mgr.? 172.21.15.131:0/1527552074' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/crt"}]: dispatch 2024-02-15T18:31:36.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:35.610283+0000 mon.smithi131 (mon.1) 56 : audit [DBG] from='mgr.? 172.21.15.131:0/1527552074' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:31:36.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:35.614559+0000 mon.smithi131 (mon.1) 57 : audit [DBG] from='mgr.? 172.21.15.131:0/1527552074' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/key"}]: dispatch 2024-02-15T18:31:36.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:35.620327+0000 mon.smithi131 (mon.1) 58 : audit [DBG] from='mgr.? 172.21.15.131:0/1527552074' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:31:36.499 INFO:tasks.workunit.client.1.smithi131.stdout:3/770: dwrite d2/d22/d5e/ff4 [0,4194304] 0 2024-02-15T18:31:36.500 INFO:tasks.workunit.client.1.smithi131.stdout:4/719: mkdir d2/d7/d12/d2e/d39/d103 0 2024-02-15T18:31:36.501 INFO:tasks.workunit.client.1.smithi131.stdout:5/674: dread d18/d23/f30 [0,4194304] 0 2024-02-15T18:31:36.501 INFO:tasks.workunit.client.1.smithi131.stdout:5/675: write d18/d23/f6e [4342225,25907] 0 2024-02-15T18:31:36.504 INFO:tasks.workunit.client.1.smithi131.stdout:3/771: truncate d2/d22/d29/d20/d86/fc1 1308914 0 2024-02-15T18:31:36.504 INFO:tasks.workunit.client.1.smithi131.stdout:3/772: truncate d2/d22/d3a/fb6 63819 0 2024-02-15T18:31:36.505 INFO:tasks.workunit.client.1.smithi131.stdout:3/773: write d2/d22/d29/db/d1a/da4/d70/fb5 [269237,28266] 0 2024-02-15T18:31:36.509 INFO:tasks.workunit.client.1.smithi131.stdout:4/720: rmdir d2/d2a/d85 39 2024-02-15T18:31:36.509 INFO:tasks.workunit.client.1.smithi131.stdout:4/721: fdatasync d2/d2a/d47/d21/f41 0 2024-02-15T18:31:36.515 INFO:tasks.workunit.client.1.smithi131.stdout:5/676: creat d18/d23/fe0 x:0 0 0 2024-02-15T18:31:36.515 INFO:tasks.workunit.client.1.smithi131.stdout:5/677: read - d18/d83/fd9 zero size 2024-02-15T18:31:36.520 INFO:tasks.workunit.client.1.smithi131.stdout:3/774: creat d2/d22/d29/db/d1a/dc3/ff9 x:0 0 0 2024-02-15T18:31:36.523 INFO:tasks.workunit.client.1.smithi131.stdout:4/722: mknod d2/d7/d12/d53/db9/dfe/d7a/d92/c104 0 2024-02-15T18:31:36.523 INFO:tasks.workunit.client.1.smithi131.stdout:4/723: read - d2/d2a/d47/d21/fca zero size 2024-02-15T18:31:36.526 INFO:tasks.workunit.client.1.smithi131.stdout:4/724: mkdir d2/d7/d1c/d84/db8/d101/d105 0 2024-02-15T18:31:36.527 INFO:tasks.workunit.client.1.smithi131.stdout:4/725: write d2/d7/d12/d53/db9/dfe/f7b [2232667,8911] 0 2024-02-15T18:31:36.527 INFO:tasks.workunit.client.1.smithi131.stdout:4/726: dread - d2/d2a/d47/d21/d9e/fbe zero size 2024-02-15T18:31:36.529 INFO:tasks.workunit.client.1.smithi131.stdout:4/727: symlink d2/d7/d12/d2e/dd0/l106 0 2024-02-15T18:31:36.533 INFO:tasks.workunit.client.1.smithi131.stdout:4/728: creat d2/d2a/d47/d21/dcd/dfb/f107 x:0 0 0 2024-02-15T18:31:36.539 INFO:tasks.workunit.client.1.smithi131.stdout:4/729: unlink d2/d2a/d47/d16/l4c 0 2024-02-15T18:31:36.540 INFO:tasks.workunit.client.1.smithi131.stdout:4/730: rename d2/d7/c8c to d2/d7/c108 0 2024-02-15T18:31:36.540 INFO:tasks.workunit.client.1.smithi131.stdout:4/731: fsync d2/d2a/f9f 0 2024-02-15T18:31:36.541 INFO:tasks.workunit.client.1.smithi131.stdout:4/732: symlink d2/d7/d12/d53/db9/dfe/dcc/l109 0 2024-02-15T18:31:36.544 INFO:tasks.workunit.client.1.smithi131.stdout:5/678: dwrite d18/f50 [0,4194304] 0 2024-02-15T18:31:36.544 INFO:tasks.workunit.client.1.smithi131.stdout:5/679: fdatasync d18/d6d/d9c/fc6 0 2024-02-15T18:31:36.545 INFO:tasks.workunit.client.1.smithi131.stdout:3/775: dwrite d2/d22/d29/db/f1d [0,4194304] 0 2024-02-15T18:31:36.545 INFO:tasks.workunit.client.1.smithi131.stdout:3/776: read - d2/d22/d29/db/dd1/fd6 zero size 2024-02-15T18:31:36.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:35.165383+0000 mon.smithi033 (mon.0) 670 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:31:36.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:35.450108+0000 mgr.smithi033.apxevf (mgr.14626) 6 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 59 MiB/s rd, 112 MiB/s wr, 224 op/s 2024-02-15T18:31:36.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:35.591223+0000 mon.smithi033 (mon.0) 671 : cluster [DBG] Standby manager daemon smithi131.buibla started 2024-02-15T18:31:36.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:35.608815+0000 mon.smithi131 (mon.1) 55 : audit [DBG] from='mgr.? 172.21.15.131:0/1527552074' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/crt"}]: dispatch 2024-02-15T18:31:36.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:35.610283+0000 mon.smithi131 (mon.1) 56 : audit [DBG] from='mgr.? 172.21.15.131:0/1527552074' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:31:36.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:35.614559+0000 mon.smithi131 (mon.1) 57 : audit [DBG] from='mgr.? 172.21.15.131:0/1527552074' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/key"}]: dispatch 2024-02-15T18:31:36.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:35.620327+0000 mon.smithi131 (mon.1) 58 : audit [DBG] from='mgr.? 172.21.15.131:0/1527552074' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:31:36.558 INFO:tasks.workunit.client.1.smithi131.stdout:3/777: symlink d2/d22/d29/db/d1a/da4/d70/lfa 0 2024-02-15T18:31:36.558 INFO:tasks.workunit.client.1.smithi131.stdout:3/778: chown d2/d22/d42/fa8 1446 1 2024-02-15T18:31:36.559 INFO:tasks.workunit.client.1.smithi131.stdout:3/779: symlink d2/d22/d29/dd7/lfb 0 2024-02-15T18:31:36.560 INFO:tasks.workunit.client.1.smithi131.stdout:3/780: chown d2/d22/d3a/fb6 919910002 1 2024-02-15T18:31:36.560 INFO:tasks.workunit.client.1.smithi131.stdout:3/781: write d2/d22/d42/fa8 [836404,7271] 0 2024-02-15T18:31:36.560 INFO:tasks.workunit.client.1.smithi131.stdout:5/680: dwrite d18/d83/d8b/dba/f2c [0,4194304] 0 2024-02-15T18:31:36.561 INFO:tasks.workunit.client.1.smithi131.stdout:3/782: symlink d2/d22/d29/db/d84/lfc 0 2024-02-15T18:31:36.561 INFO:tasks.workunit.client.1.smithi131.stdout:3/783: write d2/d22/d29/db/d34/f3b [516855,40282] 0 2024-02-15T18:31:36.567 INFO:tasks.workunit.client.1.smithi131.stdout:3/784: unlink d2/d22/d29/db/d1a/da4/d70/fb5 0 2024-02-15T18:31:36.569 INFO:tasks.workunit.client.1.smithi131.stdout:3/785: rename d2/cd3 to d2/d22/d29/db/d23/cfd 0 2024-02-15T18:31:36.569 INFO:tasks.workunit.client.1.smithi131.stdout:3/786: read d2/d22/d29/db/d1a/dc3/fd2 [2149,4995] 0 2024-02-15T18:31:36.569 INFO:tasks.workunit.client.1.smithi131.stdout:3/787: chown d2/d22/d3f/c80 126134 1 2024-02-15T18:31:36.571 INFO:tasks.workunit.client.1.smithi131.stdout:5/681: truncate d18/f50 3277360 0 2024-02-15T18:31:36.577 INFO:tasks.workunit.client.1.smithi131.stdout:5/682: symlink d18/d6d/d70/d9e/le1 0 2024-02-15T18:31:36.578 INFO:tasks.workunit.client.1.smithi131.stdout:3/788: creat d2/d22/d29/db/d1a/da4/d85/ffe x:0 0 0 2024-02-15T18:31:36.578 INFO:tasks.workunit.client.1.smithi131.stdout:3/789: fdatasync d2/d22/d29/db/d84/fe0 0 2024-02-15T18:31:36.581 INFO:tasks.workunit.client.1.smithi131.stdout:5/683: rename d18/d23/f6e to d18/d6d/d70/d9e/d85/d95/fe2 0 2024-02-15T18:31:36.591 INFO:tasks.workunit.client.1.smithi131.stdout:3/790: dread d2/f59 [0,4194304] 0 2024-02-15T18:31:36.591 INFO:tasks.workunit.client.1.smithi131.stdout:3/791: readlink d2/d22/ddd/lf1 0 2024-02-15T18:31:36.591 INFO:tasks.workunit.client.1.smithi131.stdout:3/792: fsync d2/d22/d29/db/d23/d2a/f2d 0 2024-02-15T18:31:36.593 INFO:tasks.workunit.client.1.smithi131.stdout:7/712: sync 2024-02-15T18:31:36.593 INFO:tasks.workunit.client.1.smithi131.stdout:8/676: sync 2024-02-15T18:31:36.593 INFO:tasks.workunit.client.1.smithi131.stdout:8/677: rename d22/d26/d3f/d47/dc3 to d22/d26/d3f/d47/dc3/def 22 2024-02-15T18:31:36.597 INFO:tasks.workunit.client.1.smithi131.stdout:7/713: creat d0/d34/d8b/d9a/fdf x:0 0 0 2024-02-15T18:31:36.599 INFO:tasks.workunit.client.1.smithi131.stdout:8/678: write d22/d26/d3f/d47/fae [299410,22088] 0 2024-02-15T18:31:36.599 INFO:tasks.workunit.client.1.smithi131.stdout:8/679: stat d22/d26/d3f/d47/d48/d5f/d70/l78 0 2024-02-15T18:31:36.599 INFO:tasks.workunit.client.1.smithi131.stdout:5/684: dwrite f17 [0,4194304] 0 2024-02-15T18:31:36.599 INFO:tasks.workunit.client.1.smithi131.stdout:3/793: dread d2/d22/d29/db/d1a/da4/d70/fa1 [0,4194304] 0 2024-02-15T18:31:36.599 INFO:tasks.workunit.client.1.smithi131.stdout:5/685: fdatasync d18/d23/f30 0 2024-02-15T18:31:36.602 INFO:tasks.workunit.client.1.smithi131.stdout:5/686: creat d18/d33/d73/fe3 x:0 0 0 2024-02-15T18:31:36.602 INFO:tasks.workunit.client.1.smithi131.stdout:5/687: chown d18/d23/l45 13386 1 2024-02-15T18:31:36.602 INFO:tasks.workunit.client.1.smithi131.stdout:3/794: creat d2/d22/d29/db/fff x:0 0 0 2024-02-15T18:31:36.602 INFO:tasks.workunit.client.1.smithi131.stdout:3/795: truncate d2/d22/d29/f7e 1860267 0 2024-02-15T18:31:36.604 INFO:tasks.workunit.client.1.smithi131.stdout:3/796: write d2/d22/d29/db/d1a/fe [3046880,65089] 0 2024-02-15T18:31:36.604 INFO:tasks.workunit.client.1.smithi131.stdout:3/797: read d2/d22/d42/fa8 [95452,2743] 0 2024-02-15T18:31:36.604 INFO:tasks.workunit.client.1.smithi131.stdout:3/798: readlink d2/d22/d29/db/d1a/da4/d8d/ldc 0 2024-02-15T18:31:36.605 INFO:tasks.workunit.client.1.smithi131.stdout:3/799: chown d2/d22/d29/db/d34/f8a 1 1 2024-02-15T18:31:36.605 INFO:tasks.workunit.client.1.smithi131.stdout:3/800: mknod d2/d22/d29/d20/d86/c100 0 2024-02-15T18:31:36.608 INFO:tasks.workunit.client.1.smithi131.stdout:3/801: rename d2/d22/d5e/d79/d9d/le5 to d2/d22/d29/db/d1a/da4/d8d/l101 0 2024-02-15T18:31:36.610 INFO:tasks.workunit.client.1.smithi131.stdout:3/802: symlink d2/d22/ddd/l102 0 2024-02-15T18:31:36.611 INFO:tasks.workunit.client.1.smithi131.stdout:3/803: getdents d2/d22/d29/db/d23/d2a/d49 0 2024-02-15T18:31:36.613 INFO:tasks.workunit.client.1.smithi131.stdout:3/804: mkdir d2/d22/d29/db/d1a/da4/d85/d103 0 2024-02-15T18:31:36.615 INFO:tasks.workunit.client.1.smithi131.stdout:3/805: mknod d2/d22/d29/db/d1a/df3/c104 0 2024-02-15T18:31:36.615 INFO:tasks.workunit.client.1.smithi131.stdout:3/806: truncate d2/d22/d29/db/d1a/da4/d8d/fc7 689908 0 2024-02-15T18:31:36.615 INFO:tasks.workunit.client.1.smithi131.stdout:3/807: truncate d2/d22/f2e 1688567 0 2024-02-15T18:31:36.615 INFO:tasks.workunit.client.1.smithi131.stdout:3/808: chown d2/d22/d29/d20/c46 497498653 1 2024-02-15T18:31:36.615 INFO:tasks.workunit.client.1.smithi131.stdout:3/809: read - d2/d22/d29/db/dd1/fd6 zero size 2024-02-15T18:31:36.616 INFO:tasks.workunit.client.1.smithi131.stdout:3/810: mknod d2/d22/d29/db/d1a/da4/d85/c105 0 2024-02-15T18:31:36.616 INFO:tasks.workunit.client.1.smithi131.stdout:3/811: fdatasync d2/d22/d29/db/d1a/da4/d85/ffe 0 2024-02-15T18:31:36.616 INFO:tasks.workunit.client.1.smithi131.stdout:3/812: truncate d2/fce 66151 0 2024-02-15T18:31:36.616 INFO:tasks.workunit.client.1.smithi131.stdout:8/680: dwrite d22/d26/d3f/d47/d48/f5a [0,4194304] 0 2024-02-15T18:31:36.616 INFO:tasks.workunit.client.1.smithi131.stdout:8/681: truncate fb 4558172 0 2024-02-15T18:31:36.619 INFO:tasks.workunit.client.1.smithi131.stdout:8/682: mknod d22/d26/d3f/d47/d48/d5f/d6f/cf0 0 2024-02-15T18:31:36.619 INFO:tasks.workunit.client.1.smithi131.stdout:3/813: dread d2/d22/fcd [0,4194304] 0 2024-02-15T18:31:36.629 INFO:tasks.workunit.client.1.smithi131.stdout:3/814: dread d2/d22/d29/db/d23/d2a/d49/fee [0,4194304] 0 2024-02-15T18:31:36.633 INFO:tasks.workunit.client.1.smithi131.stdout:3/815: rename d2/d22/d29/d9e/fc6 to d2/d22/d29/d9e/f106 0 2024-02-15T18:31:36.633 INFO:tasks.workunit.client.1.smithi131.stdout:3/816: dread - d2/f7c zero size 2024-02-15T18:31:36.639 INFO:tasks.workunit.client.1.smithi131.stdout:8/683: dwrite d22/d26/d3f/d47/d48/d84/fc8 [0,4194304] 0 2024-02-15T18:31:36.639 INFO:tasks.workunit.client.1.smithi131.stdout:8/684: chown d22/d26/d3f/d47/d48/d5f/d6f/ca1 192 1 2024-02-15T18:31:36.640 INFO:tasks.workunit.client.1.smithi131.stdout:8/685: mknod d22/d26/d3f/d47/d48/d5f/d6f/cf1 0 2024-02-15T18:31:36.659 INFO:tasks.workunit.client.1.smithi131.stdout:8/686: dwrite d22/d26/d3f/d86/f91 [0,4194304] 0 2024-02-15T18:31:36.659 INFO:tasks.workunit.client.1.smithi131.stdout:8/687: write d22/d26/d3f/d47/d48/d5f/d6f/d7a/fcd [418071,12994] 0 2024-02-15T18:31:36.659 INFO:tasks.workunit.client.1.smithi131.stdout:8/688: read - d22/d26/d3f/d47/d48/d5f/fc0 zero size 2024-02-15T18:31:36.675 INFO:tasks.workunit.client.1.smithi131.stdout:8/689: dwrite d22/f32 [0,4194304] 0 2024-02-15T18:31:36.696 INFO:tasks.workunit.client.1.smithi131.stdout:8/690: dwrite d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f99 [0,4194304] 0 2024-02-15T18:31:36.780 INFO:tasks.workunit.client.1.smithi131.stdout:8/691: link d22/d26/f55 d22/d26/d3f/d47/d57/d9f/ff2 0 2024-02-15T18:31:36.782 INFO:tasks.workunit.client.1.smithi131.stdout:8/692: dread d22/d26/d3f/d47/d48/d5f/d6f/fb3 [0,4194304] 0 2024-02-15T18:31:36.782 INFO:tasks.workunit.client.1.smithi131.stdout:8/693: write d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/da2/fd1 [180201,72374] 0 2024-02-15T18:31:36.785 INFO:tasks.workunit.client.1.smithi131.stdout:8/694: link c1e d22/d26/d3f/d47/dc3/cf3 0 2024-02-15T18:31:36.785 INFO:tasks.workunit.client.1.smithi131.stdout:8/695: write d22/d26/d3f/d86/dcf/fe7 [51600,3159] 0 2024-02-15T18:31:36.786 INFO:tasks.workunit.client.1.smithi131.stdout:8/696: symlink d22/d26/lf4 0 2024-02-15T18:31:36.786 INFO:tasks.workunit.client.1.smithi131.stdout:8/697: truncate d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/fe1 820788 0 2024-02-15T18:31:36.786 INFO:tasks.workunit.client.1.smithi131.stdout:8/698: chown d22/d26/d3f/d7c 2267271 1 2024-02-15T18:31:36.787 INFO:tasks.workunit.client.1.smithi131.stdout:8/699: write f17 [3603459,90862] 0 2024-02-15T18:31:36.788 INFO:tasks.workunit.client.1.smithi131.stdout:8/700: mkdir d22/d26/d3f/d47/d48/df5 0 2024-02-15T18:31:36.791 INFO:tasks.workunit.client.1.smithi131.stdout:8/701: rename lc to d22/d26/d3f/d47/dc3/lf6 0 2024-02-15T18:31:36.793 INFO:tasks.workunit.client.1.smithi131.stdout:8/702: rmdir d22/d39/deb 0 2024-02-15T18:31:36.794 INFO:tasks.workunit.client.1.smithi131.stdout:8/703: creat d22/d26/d3f/d47/dc3/ff7 x:0 0 0 2024-02-15T18:31:36.808 INFO:tasks.workunit.client.1.smithi131.stdout:8/704: dwrite d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/fa6 [0,4194304] 0 2024-02-15T18:31:36.828 INFO:tasks.workunit.client.1.smithi131.stdout:6/560: sync 2024-02-15T18:31:36.828 INFO:tasks.workunit.client.1.smithi131.stdout:1/869: sync 2024-02-15T18:31:36.828 INFO:tasks.workunit.client.1.smithi131.stdout:9/792: sync 2024-02-15T18:31:36.828 INFO:tasks.workunit.client.1.smithi131.stdout:6/561: fdatasync d2/dc/d27/d62/d97/f1e 0 2024-02-15T18:31:36.828 INFO:tasks.workunit.client.1.smithi131.stdout:2/576: sync 2024-02-15T18:31:36.833 INFO:tasks.workunit.client.1.smithi131.stdout:9/793: rename d4/dc/d25/d3f/d81 to d4/dc/de/d1e/d1f/d101 0 2024-02-15T18:31:36.834 INFO:tasks.workunit.client.1.smithi131.stdout:1/870: creat d0/d2/d7/d72/d78/da7/d109/f131 x:0 0 0 2024-02-15T18:31:36.834 INFO:tasks.workunit.client.1.smithi131.stdout:1/871: dread - d0/d2/d7/d72/d78/da7/d109/f131 zero size 2024-02-15T18:31:36.836 INFO:tasks.workunit.client.1.smithi131.stdout:6/562: truncate d2/d7/d12/d80/f92 3219489 0 2024-02-15T18:31:36.842 INFO:tasks.workunit.client.1.smithi131.stdout:9/794: mknod d4/dc/d25/d4e/d8a/c102 0 2024-02-15T18:31:36.843 INFO:tasks.workunit.client.1.smithi131.stdout:1/872: mknod d0/d2/d4/da/c132 0 2024-02-15T18:31:36.843 INFO:tasks.workunit.client.1.smithi131.stdout:1/873: stat d0/d2/d4/d5d/f60 0 2024-02-15T18:31:36.844 INFO:tasks.workunit.client.1.smithi131.stdout:1/874: mknod d0/d2/d7/d72/d78/da7/c133 0 2024-02-15T18:31:36.847 INFO:tasks.workunit.client.1.smithi131.stdout:2/577: dwrite dd/d10/d22/d2f/d38/d74/d2e/d66/f78 [0,4194304] 0 2024-02-15T18:31:36.847 INFO:tasks.workunit.client.1.smithi131.stdout:1/875: rename d0/d2/d7/d72/d78/da7/f130 to d0/d2/d4/d5d/db1/f134 0 2024-02-15T18:31:36.849 INFO:tasks.workunit.client.1.smithi131.stdout:2/578: rmdir dd/d14/d1f/d65/d81 39 2024-02-15T18:31:36.850 INFO:tasks.workunit.client.1.smithi131.stdout:1/876: mkdir d0/d1/d44/d135 0 2024-02-15T18:31:36.852 INFO:tasks.workunit.client.1.smithi131.stdout:2/579: mkdir dd/d10/d22/d2f/d38/d74/d2e/d6a/dc0 0 2024-02-15T18:31:36.854 INFO:tasks.workunit.client.1.smithi131.stdout:2/580: unlink dd/l25 0 2024-02-15T18:31:36.854 INFO:tasks.workunit.client.1.smithi131.stdout:2/581: fdatasync dd/d10/d22/d2f/d38/d74/d2e/d6a/fa4 0 2024-02-15T18:31:36.860 INFO:tasks.workunit.client.1.smithi131.stdout:6/563: dwrite d2/dc/d27/d78/f99 [0,4194304] 0 2024-02-15T18:31:36.863 INFO:tasks.workunit.client.1.smithi131.stdout:6/564: write d2/d7/f54 [2022997,58854] 0 2024-02-15T18:31:36.864 INFO:tasks.workunit.client.1.smithi131.stdout:9/795: dwrite d4/dc/d17/d19/f82 [0,4194304] 0 2024-02-15T18:31:36.864 INFO:tasks.workunit.client.1.smithi131.stdout:9/796: fdatasync f3 0 2024-02-15T18:31:36.864 INFO:tasks.workunit.client.1.smithi131.stdout:9/797: write d4/dc/d17/d19/d32/dc2/f7a [858417,22243] 0 2024-02-15T18:31:36.868 INFO:tasks.workunit.client.1.smithi131.stdout:9/798: creat d4/dc/de/d1e/d1f/d51/d5d/f103 x:0 0 0 2024-02-15T18:31:36.868 INFO:tasks.workunit.client.1.smithi131.stdout:9/799: chown d4/dc/de/d1e/d1f/d51/d5d/d71/f96 1754 1 2024-02-15T18:31:36.885 INFO:tasks.workunit.client.1.smithi131.stdout:2/582: dwrite dd/f60 [0,4194304] 0 2024-02-15T18:31:36.886 INFO:tasks.workunit.client.1.smithi131.stdout:6/565: dwrite d2/d7/d12/d4d/f8b [0,4194304] 0 2024-02-15T18:31:36.893 INFO:tasks.workunit.client.1.smithi131.stdout:6/566: symlink d2/d7/d12/d4d/lac 0 2024-02-15T18:31:36.893 INFO:tasks.workunit.client.1.smithi131.stdout:6/567: fsync d2/d7/f9f 0 2024-02-15T18:31:36.902 INFO:tasks.workunit.client.1.smithi131.stdout:9/800: dwrite d4/dc/d17/d19/fff [0,4194304] 0 2024-02-15T18:31:36.902 INFO:tasks.workunit.client.1.smithi131.stdout:9/801: chown d4/dc/d25/d4e/d8a/f8b 854006935 1 2024-02-15T18:31:36.902 INFO:tasks.workunit.client.1.smithi131.stdout:9/802: write d4/dc/d25/d3f/f66 [5753550,69895] 0 2024-02-15T18:31:36.903 INFO:tasks.workunit.client.1.smithi131.stdout:2/583: dwrite dd/d10/d22/d2f/d38/d74/d2e/f67 [0,4194304] 0 2024-02-15T18:31:36.909 INFO:tasks.workunit.client.1.smithi131.stdout:9/803: rename d4/dc/d17/d19/f5f to d4/dc/de/d1e/d1f/d101/f104 0 2024-02-15T18:31:36.911 INFO:tasks.workunit.client.1.smithi131.stdout:6/568: dwrite d2/d2b/d6e/f6f [0,4194304] 0 2024-02-15T18:31:36.911 INFO:tasks.workunit.client.1.smithi131.stdout:2/584: creat dd/d14/d1f/d65/d77/fc1 x:0 0 0 2024-02-15T18:31:36.913 INFO:tasks.workunit.client.1.smithi131.stdout:6/569: mkdir d2/d79/dad 0 2024-02-15T18:31:36.913 INFO:tasks.workunit.client.1.smithi131.stdout:2/585: fsync dd/d10/d22/d2f/d38/f70 0 2024-02-15T18:31:36.915 INFO:tasks.workunit.client.1.smithi131.stdout:6/570: creat d2/d6d/fae x:0 0 0 2024-02-15T18:31:36.915 INFO:tasks.workunit.client.1.smithi131.stdout:6/571: read - d2/dc/d1f/f93 zero size 2024-02-15T18:31:36.915 INFO:tasks.workunit.client.1.smithi131.stdout:6/572: stat d2/c7d 0 2024-02-15T18:31:36.916 INFO:tasks.workunit.client.1.smithi131.stdout:6/573: write d2/d7/d48/f5c [508024,84290] 0 2024-02-15T18:31:36.916 INFO:tasks.workunit.client.1.smithi131.stdout:2/586: rmdir dd/d10/d22/d2f/d38/d9f 39 2024-02-15T18:31:36.916 INFO:tasks.workunit.client.1.smithi131.stdout:2/587: readlink dd/d1e/l21 0 2024-02-15T18:31:36.916 INFO:tasks.workunit.client.1.smithi131.stdout:2/588: write dd/d14/d1f/d65/d77/fbc [567823,19706] 0 2024-02-15T18:31:36.922 INFO:tasks.workunit.client.1.smithi131.stdout:6/574: rename d2/f9b to d2/dc/d27/d62/faf 0 2024-02-15T18:31:36.922 INFO:tasks.workunit.client.1.smithi131.stdout:6/575: write d2/d7/f73 [1060176,97861] 0 2024-02-15T18:31:36.922 INFO:tasks.workunit.client.1.smithi131.stdout:6/576: read - d2/d36/f9d zero size 2024-02-15T18:31:36.928 INFO:tasks.workunit.client.1.smithi131.stdout:2/589: rename dd/d10/d22/d2f/d38/d74/d2e/c86 to dd/d10/db1/dbd/cc2 0 2024-02-15T18:31:36.930 INFO:tasks.workunit.client.1.smithi131.stdout:6/577: rename d2/d36 to d2/dc/d27/d62/db0 0 2024-02-15T18:31:36.931 INFO:tasks.workunit.client.1.smithi131.stdout:2/590: truncate dd/d1e/f5f 2485321 0 2024-02-15T18:31:36.931 INFO:tasks.workunit.client.1.smithi131.stdout:2/591: write dd/d10/d22/f6c [767314,96063] 0 2024-02-15T18:31:36.931 INFO:tasks.workunit.client.1.smithi131.stdout:6/578: symlink d2/d7/d12/d4d/lb1 0 2024-02-15T18:31:36.933 INFO:tasks.workunit.client.1.smithi131.stdout:2/592: mknod dd/d1e/cc3 0 2024-02-15T18:31:36.934 INFO:tasks.workunit.client.1.smithi131.stdout:6/579: rename d2/dc/d27/c72 to d2/dc/cb2 0 2024-02-15T18:31:36.938 INFO:tasks.workunit.client.1.smithi131.stdout:6/580: symlink d2/dc/d27/d74/lb3 0 2024-02-15T18:31:36.939 INFO:tasks.workunit.client.1.smithi131.stdout:6/581: creat d2/dc/d27/d62/d97/fb4 x:0 0 0 2024-02-15T18:31:36.943 INFO:tasks.workunit.client.1.smithi131.stdout:6/582: dread d2/f45 [0,4194304] 0 2024-02-15T18:31:36.949 INFO:tasks.workunit.client.1.smithi131.stdout:2/593: dread dd/d1e/f5f [0,4194304] 0 2024-02-15T18:31:36.963 INFO:tasks.workunit.client.1.smithi131.stdout:6/583: dwrite d2/dc/d27/d62/d97/f98 [0,4194304] 0 2024-02-15T18:31:36.967 INFO:tasks.workunit.client.1.smithi131.stdout:6/584: creat d2/d2b/d6e/fb5 x:0 0 0 2024-02-15T18:31:36.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/585: mkdir d2/d7/d48/d7f/db6 0 2024-02-15T18:31:36.975 INFO:tasks.workunit.client.1.smithi131.stdout:6/586: read d2/d7/f39 [3174959,94552] 0 2024-02-15T18:31:36.975 INFO:tasks.workunit.client.1.smithi131.stdout:6/587: readlink d2/dc/d27/d62/l8d 0 2024-02-15T18:31:36.975 INFO:tasks.workunit.client.1.smithi131.stdout:6/588: truncate d2/d2b/d6e/f8a 183203 0 2024-02-15T18:31:36.984 INFO:tasks.workunit.client.1.smithi131.stdout:6/589: dread d2/dc/d27/d62/d97/f43 [0,4194304] 0 2024-02-15T18:31:36.985 INFO:tasks.workunit.client.1.smithi131.stdout:6/590: creat d2/dc/d27/d74/d75/fb7 x:0 0 0 2024-02-15T18:31:36.986 INFO:tasks.workunit.client.1.smithi131.stdout:6/591: truncate d2/d7/d48/f49 298646 0 2024-02-15T18:31:36.989 INFO:tasks.workunit.client.1.smithi131.stdout:6/592: symlink d2/d2b/d6e/lb8 0 2024-02-15T18:31:36.989 INFO:tasks.workunit.client.1.smithi131.stdout:6/593: dread - d2/dc/d27/d62/d97/fb4 zero size 2024-02-15T18:31:37.014 INFO:tasks.workunit.client.1.smithi131.stdout:6/594: dwrite f0 [0,4194304] 0 2024-02-15T18:31:37.045 INFO:tasks.workunit.client.1.smithi131.stdout:0/524: sync 2024-02-15T18:31:37.045 INFO:tasks.workunit.client.1.smithi131.stdout:0/525: write d5/d2f/d45/f50 [368792,30057] 0 2024-02-15T18:31:37.045 INFO:tasks.workunit.client.1.smithi131.stdout:0/526: fsync d5/d9/d10/d71/d92/f93 0 2024-02-15T18:31:37.048 INFO:tasks.workunit.client.1.smithi131.stdout:0/527: creat d5/d2f/d4b/d82/fa9 x:0 0 0 2024-02-15T18:31:37.053 INFO:tasks.workunit.client.1.smithi131.stdout:0/528: rmdir d5/d15 39 2024-02-15T18:31:37.055 INFO:tasks.workunit.client.1.smithi131.stdout:0/529: link d5/d2f/d4b/l7a d5/d9/laa 0 2024-02-15T18:31:37.055 INFO:tasks.workunit.client.1.smithi131.stdout:0/530: chown d5/d2f/la2 17704 1 2024-02-15T18:31:37.056 INFO:tasks.workunit.client.1.smithi131.stdout:0/531: creat d5/d9/d77/da8/fab x:0 0 0 2024-02-15T18:31:37.058 INFO:tasks.workunit.client.1.smithi131.stdout:0/532: truncate d5/fa 4112595 0 2024-02-15T18:31:37.058 INFO:tasks.workunit.client.1.smithi131.stdout:0/533: chown d5/d9/d11/d3e/f9d 3092212 1 2024-02-15T18:31:37.058 INFO:tasks.workunit.client.1.smithi131.stdout:0/534: dread - d5/d15/d1f/f7d zero size 2024-02-15T18:31:37.059 INFO:tasks.workunit.client.1.smithi131.stdout:0/535: dread d5/d9/f3d [0,4194304] 0 2024-02-15T18:31:37.060 INFO:tasks.workunit.client.1.smithi131.stdout:0/536: getdents d5/d2f/d4b/d82 0 2024-02-15T18:31:37.066 INFO:tasks.workunit.client.1.smithi131.stdout:0/537: write d5/fa [1507720,97872] 0 2024-02-15T18:31:37.068 INFO:tasks.workunit.client.1.smithi131.stdout:0/538: creat d5/d2f/d4b/d82/fac x:0 0 0 2024-02-15T18:31:37.082 INFO:tasks.workunit.client.1.smithi131.stdout:0/539: dwrite d5/d2f/d4b/f69 [0,4194304] 0 2024-02-15T18:31:37.085 INFO:tasks.workunit.client.1.smithi131.stdout:0/540: mkdir d5/d9/d77/da8/dad 0 2024-02-15T18:31:37.086 INFO:tasks.workunit.client.1.smithi131.stdout:0/541: mkdir d5/d2f/d4b/d82/dae 0 2024-02-15T18:31:37.086 INFO:tasks.workunit.client.1.smithi131.stdout:0/542: write d5/d2f/d4b/f87 [2568378,54406] 0 2024-02-15T18:31:37.087 INFO:tasks.workunit.client.1.smithi131.stdout:4/733: sync 2024-02-15T18:31:37.092 INFO:tasks.workunit.client.1.smithi131.stdout:0/543: symlink d5/d9/d77/laf 0 2024-02-15T18:31:37.092 INFO:tasks.workunit.client.1.smithi131.stdout:0/544: chown d5/d9/d77/da8/fab 596219 1 2024-02-15T18:31:37.109 INFO:tasks.workunit.client.1.smithi131.stdout:4/734: dwrite d2/d2a/d47/d21/dcd/fe1 [0,4194304] 0 2024-02-15T18:31:37.110 INFO:tasks.workunit.client.1.smithi131.stdout:0/545: dwrite d5/d9/d10/d71/d92/f9c [0,4194304] 0 2024-02-15T18:31:37.114 INFO:tasks.workunit.client.1.smithi131.stdout:4/735: symlink d2/d7/d12/d2e/d5f/d70/l10a 0 2024-02-15T18:31:37.114 INFO:tasks.workunit.client.1.smithi131.stdout:4/736: chown d2/d7/d1c/d84/db8/d101/d105 245455912 1 2024-02-15T18:31:37.121 INFO:tasks.workunit.client.1.smithi131.stdout:0/546: symlink d5/lb0 0 2024-02-15T18:31:37.122 INFO:tasks.workunit.client.1.smithi131.stdout:0/547: mknod d5/d9/d10/d71/cb1 0 2024-02-15T18:31:37.123 INFO:tasks.workunit.client.1.smithi131.stdout:0/548: dread d5/d9/d11/d3e/f59 [0,4194304] 0 2024-02-15T18:31:37.125 INFO:tasks.workunit.client.1.smithi131.stdout:0/549: dread d5/d9/f3d [0,4194304] 0 2024-02-15T18:31:37.134 INFO:tasks.workunit.client.1.smithi131.stdout:4/737: dwrite d2/d2a/d47/d21/fca [0,4194304] 0 2024-02-15T18:31:37.134 INFO:tasks.workunit.client.1.smithi131.stdout:0/550: dread d5/d15/d1f/f57 [0,4194304] 0 2024-02-15T18:31:37.134 INFO:tasks.workunit.client.1.smithi131.stdout:0/551: fsync d5/d2f/f76 0 2024-02-15T18:31:37.139 INFO:tasks.workunit.client.1.smithi131.stdout:4/738: creat d2/d2a/d47/d16/d5a/f10b x:0 0 0 2024-02-15T18:31:37.139 INFO:tasks.workunit.client.1.smithi131.stdout:0/552: mknod d5/d9/d11/cb2 0 2024-02-15T18:31:37.142 INFO:tasks.workunit.client.1.smithi131.stdout:4/739: creat d2/dfa/f10c x:0 0 0 2024-02-15T18:31:37.142 INFO:tasks.workunit.client.1.smithi131.stdout:4/740: readlink d2/d7/d12/d2e/d5f/d70/la5 0 2024-02-15T18:31:37.142 INFO:tasks.workunit.client.1.smithi131.stdout:0/553: rmdir d5/d15 39 2024-02-15T18:31:37.143 INFO:tasks.workunit.client.1.smithi131.stdout:4/741: creat d2/d7/d12/d53/db9/dfe/dcc/f10d x:0 0 0 2024-02-15T18:31:37.144 INFO:tasks.workunit.client.1.smithi131.stdout:4/742: read d2/d7/d12/d53/f81 [1050333,2855] 0 2024-02-15T18:31:37.144 INFO:tasks.workunit.client.1.smithi131.stdout:0/554: symlink d5/d2f/d4b/d82/da0/lb3 0 2024-02-15T18:31:37.144 INFO:tasks.workunit.client.1.smithi131.stdout:0/555: truncate d5/d9/f80 19362 0 2024-02-15T18:31:37.144 INFO:tasks.workunit.client.1.smithi131.stdout:0/556: read d5/f4c [145480,4730] 0 2024-02-15T18:31:37.145 INFO:tasks.workunit.client.1.smithi131.stdout:4/743: symlink d2/d2a/d47/d21/l10e 0 2024-02-15T18:31:37.145 INFO:tasks.workunit.client.1.smithi131.stdout:4/744: chown d2/d2a/d76/ld5 104924 1 2024-02-15T18:31:37.146 INFO:tasks.workunit.client.1.smithi131.stdout:0/557: mkdir d5/d9/d77/da8/db4 0 2024-02-15T18:31:37.147 INFO:tasks.workunit.client.1.smithi131.stdout:4/745: symlink d2/d7/d12/d2e/d5f/d70/l10f 0 2024-02-15T18:31:37.147 INFO:tasks.workunit.client.1.smithi131.stdout:4/746: write d2/d2a/d47/d16/d43/fb3 [932998,26119] 0 2024-02-15T18:31:37.149 INFO:tasks.workunit.client.1.smithi131.stdout:0/558: unlink d5/l9e 0 2024-02-15T18:31:37.151 INFO:tasks.workunit.client.1.smithi131.stdout:0/559: truncate d5/d9/f43 504688 0 2024-02-15T18:31:37.156 INFO:tasks.workunit.client.1.smithi131.stdout:4/747: rename d2/d7/d12 to d2/d2a/d47/d21/dcd/dfb/d110 0 2024-02-15T18:31:37.158 INFO:tasks.workunit.client.1.smithi131.stdout:0/560: creat d5/d2f/d45/d8c/fb5 x:0 0 0 2024-02-15T18:31:37.159 INFO:tasks.workunit.client.1.smithi131.stdout:0/561: chown d5/d9/f43 666039 1 2024-02-15T18:31:37.159 INFO:tasks.workunit.client.1.smithi131.stdout:0/562: write d5/d2f/d4b/f69 [4217178,100492] 0 2024-02-15T18:31:37.159 INFO:tasks.workunit.client.1.smithi131.stdout:4/748: mkdir d2/d2a/d47/d21/d9e/d111 0 2024-02-15T18:31:37.161 INFO:tasks.workunit.client.1.smithi131.stdout:0/563: creat d5/d9/d4d/fb6 x:0 0 0 2024-02-15T18:31:37.163 INFO:tasks.workunit.client.1.smithi131.stdout:4/749: rename d2/d2a/d47/d21/dcd/dfb/d110/d2e/d5f/d70/la5 to d2/d2a/d85/da3/dba/l112 0 2024-02-15T18:31:37.164 INFO:tasks.workunit.client.1.smithi131.stdout:0/564: mkdir d5/d9/d10/db7 0 2024-02-15T18:31:37.165 INFO:tasks.workunit.client.1.smithi131.stdout:4/750: truncate d2/d2a/d85/da3/dba/fee 3746952 0 2024-02-15T18:31:37.165 INFO:tasks.workunit.client.1.smithi131.stdout:4/751: chown d2/d2a/d47/d21/dcd/dfb/d110 48109 1 2024-02-15T18:31:37.166 INFO:tasks.workunit.client.1.smithi131.stdout:4/752: write d2/d2a/d47/d21/f41 [164838,97523] 0 2024-02-15T18:31:37.168 INFO:tasks.workunit.client.1.smithi131.stdout:4/753: creat d2/d2a/d47/f113 x:0 0 0 2024-02-15T18:31:37.172 INFO:tasks.workunit.client.1.smithi131.stdout:4/754: rename d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d103 to d2/d2a/d85/da3/dbf/ddc/d114 0 2024-02-15T18:31:37.173 INFO:tasks.workunit.client.1.smithi131.stdout:4/755: mknod d2/d7/c115 0 2024-02-15T18:31:37.176 INFO:tasks.workunit.client.1.smithi131.stdout:4/756: rename d2/d2a/d47/d16/d43/f89 to d2/d2a/d47/d21/dcd/dfb/d110/d2e/d5f/d70/f116 0 2024-02-15T18:31:37.182 INFO:tasks.workunit.client.1.smithi131.stdout:0/565: dwrite d5/d9/d11/f31 [0,4194304] 0 2024-02-15T18:31:37.182 INFO:tasks.workunit.client.1.smithi131.stdout:0/566: write d5/f68 [4743486,4635] 0 2024-02-15T18:31:37.182 INFO:tasks.workunit.client.1.smithi131.stdout:0/567: chown d5/d2f/d4b/f9b 63 1 2024-02-15T18:31:37.183 INFO:tasks.workunit.client.1.smithi131.stdout:0/568: getdents d5/d9/d10/d71/d92 0 2024-02-15T18:31:37.183 INFO:tasks.workunit.client.1.smithi131.stdout:0/569: stat d5/d15/d1f/f7d 0 2024-02-15T18:31:37.186 INFO:tasks.workunit.client.1.smithi131.stdout:0/570: mkdir d5/d9/d11/d3e/db8 0 2024-02-15T18:31:37.187 INFO:tasks.workunit.client.1.smithi131.stdout:0/571: chown d5/d9/d10/d73/f99 44976 1 2024-02-15T18:31:37.189 INFO:tasks.workunit.client.1.smithi131.stdout:0/572: mknod d5/d9/d11/d3e/db8/cb9 0 2024-02-15T18:31:37.191 INFO:tasks.workunit.client.1.smithi131.stdout:4/757: dwrite d2/d7/d1c/f63 [0,4194304] 0 2024-02-15T18:31:37.191 INFO:tasks.workunit.client.1.smithi131.stdout:4/758: fsync d2/d2a/d47/fd6 0 2024-02-15T18:31:37.213 INFO:tasks.workunit.client.1.smithi131.stdout:4/759: dwrite d2/d2a/d47/d21/dcd/fe1 [0,4194304] 0 2024-02-15T18:31:37.213 INFO:tasks.workunit.client.1.smithi131.stdout:4/760: write d2/d7/fab [317805,92384] 0 2024-02-15T18:31:37.214 INFO:tasks.workunit.client.1.smithi131.stdout:4/761: write d2/d23/fc4 [592556,111880] 0 2024-02-15T18:31:37.214 INFO:tasks.workunit.client.1.smithi131.stdout:4/762: stat d2/d7/d1c/d94/df6 0 2024-02-15T18:31:37.215 INFO:tasks.workunit.client.1.smithi131.stdout:4/763: symlink d2/d2a/d47/d21/d9e/d111/l117 0 2024-02-15T18:31:37.216 INFO:tasks.workunit.client.1.smithi131.stdout:4/764: rename d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/dcc to d2/d2a/d85/da3/dba/d118 0 2024-02-15T18:31:37.219 INFO:tasks.workunit.client.1.smithi131.stdout:4/765: unlink d2/d2a/d47/d21/dcd/dfb/d110/dd1/fde 0 2024-02-15T18:31:37.220 INFO:tasks.workunit.client.1.smithi131.stdout:4/766: creat d2/d7/f119 x:0 0 0 2024-02-15T18:31:37.224 INFO:tasks.workunit.client.1.smithi131.stdout:0/573: dwrite d5/d9/d10/d71/f94 [4194304,4194304] 0 2024-02-15T18:31:37.224 INFO:tasks.workunit.client.1.smithi131.stdout:0/574: readlink d5/d2f/d4b/l7a 0 2024-02-15T18:31:37.224 INFO:tasks.workunit.client.1.smithi131.stdout:0/575: readlink d5/d2f/d4b/l70 0 2024-02-15T18:31:37.224 INFO:tasks.workunit.client.1.smithi131.stdout:4/767: creat d2/d2a/d47/d21/dcd/dfb/d110/d2e/f11a x:0 0 0 2024-02-15T18:31:37.243 INFO:tasks.workunit.client.1.smithi131.stdout:0/576: symlink d5/d9/d10/d3f/lba 0 2024-02-15T18:31:37.243 INFO:tasks.workunit.client.1.smithi131.stdout:7/714: sync 2024-02-15T18:31:37.244 INFO:tasks.workunit.client.1.smithi131.stdout:7/715: readlink d0/d17/d3a/d3d/la3 0 2024-02-15T18:31:37.244 INFO:tasks.workunit.client.1.smithi131.stdout:7/716: write d0/d17/d3a/f91 [127071,63407] 0 2024-02-15T18:31:37.244 INFO:tasks.workunit.client.1.smithi131.stdout:4/768: symlink d2/d2a/d47/d21/dcd/dfb/d110/d2e/d5f/d70/l11b 0 2024-02-15T18:31:37.244 INFO:tasks.workunit.client.1.smithi131.stdout:4/769: chown d2/d2a/d47/d21/l10e 235 1 2024-02-15T18:31:37.250 INFO:tasks.workunit.client.1.smithi131.stdout:0/577: dread d5/f68 [0,4194304] 0 2024-02-15T18:31:37.250 INFO:tasks.workunit.client.1.smithi131.stdout:0/578: write d5/d9/d4d/f7c [443058,98241] 0 2024-02-15T18:31:37.250 INFO:tasks.workunit.client.1.smithi131.stdout:0/579: dread - d5/d15/d1f/f7d zero size 2024-02-15T18:31:37.251 INFO:tasks.workunit.client.1.smithi131.stdout:0/580: write d5/f56 [410349,124387] 0 2024-02-15T18:31:37.321 INFO:tasks.workunit.client.1.smithi131.stdout:7/717: creat d0/d17/d3a/fe0 x:0 0 0 2024-02-15T18:31:37.321 INFO:tasks.workunit.client.1.smithi131.stdout:7/718: dread - d0/d34/d8e/d98/dc6/fd3 zero size 2024-02-15T18:31:37.323 INFO:tasks.workunit.client.1.smithi131.stdout:4/770: mkdir d2/d7/d1c/d11c 0 2024-02-15T18:31:37.323 INFO:tasks.workunit.client.1.smithi131.stdout:4/771: chown d2/d2a/d47/df0 434860 1 2024-02-15T18:31:37.325 INFO:tasks.workunit.client.1.smithi131.stdout:0/581: creat d5/d9/d10/db7/fbb x:0 0 0 2024-02-15T18:31:37.325 INFO:tasks.workunit.client.1.smithi131.stdout:7/719: mkdir d0/d17/de1 0 2024-02-15T18:31:37.328 INFO:tasks.workunit.client.1.smithi131.stdout:7/720: dread d0/d17/d3a/f91 [0,4194304] 0 2024-02-15T18:31:37.328 INFO:tasks.workunit.client.1.smithi131.stdout:7/721: readlink d0/l86 0 2024-02-15T18:31:37.333 INFO:tasks.workunit.client.1.smithi131.stdout:4/772: creat d2/d7/d1c/d11c/f11d x:0 0 0 2024-02-15T18:31:37.348 INFO:tasks.workunit.client.1.smithi131.stdout:0/582: truncate d5/d15/d1f/f57 145284 0 2024-02-15T18:31:37.348 INFO:tasks.workunit.client.1.smithi131.stdout:0/583: fdatasync d5/d2f/d45/d8c/fb5 0 2024-02-15T18:31:37.351 INFO:tasks.workunit.client.1.smithi131.stdout:7/722: creat d0/d17/d36/fe2 x:0 0 0 2024-02-15T18:31:37.351 INFO:tasks.workunit.client.1.smithi131.stdout:7/723: readlink d0/d17/d3a/lc7 0 2024-02-15T18:31:37.351 INFO:tasks.workunit.client.1.smithi131.stdout:4/773: dwrite d2/d2a/d85/fb7 [0,4194304] 0 2024-02-15T18:31:37.353 INFO:tasks.workunit.client.1.smithi131.stdout:0/584: unlink d5/d2f/d45/c85 0 2024-02-15T18:31:37.353 INFO:tasks.workunit.client.1.smithi131.stdout:0/585: chown d5/d9/d10/d71/d92/f93 2699 1 2024-02-15T18:31:37.355 INFO:tasks.workunit.client.1.smithi131.stdout:7/724: unlink d0/d17/d3a/d3d/f7a 0 2024-02-15T18:31:37.370 INFO:tasks.workunit.client.1.smithi131.stdout:4/774: dwrite d2/d7/d1c/d11c/f11d [0,4194304] 0 2024-02-15T18:31:37.371 INFO:tasks.workunit.client.1.smithi131.stdout:4/775: write d2/d2a/d47/f6f [1788227,70555] 0 2024-02-15T18:31:37.380 INFO:tasks.workunit.client.1.smithi131.stdout:0/586: read d5/d9/f80 [12057,90077] 0 2024-02-15T18:31:37.380 INFO:tasks.workunit.client.1.smithi131.stdout:0/587: stat d5/d9/d10 0 2024-02-15T18:31:37.385 INFO:tasks.workunit.client.1.smithi131.stdout:7/725: mknod d0/d17/d3a/ce3 0 2024-02-15T18:31:37.390 INFO:tasks.workunit.client.1.smithi131.stdout:0/588: creat d5/d9/d11/fbc x:0 0 0 2024-02-15T18:31:37.394 INFO:tasks.workunit.client.1.smithi131.stdout:0/589: link d5/d9/ff d5/d2f/d4b/d82/dae/fbd 0 2024-02-15T18:31:37.394 INFO:tasks.workunit.client.1.smithi131.stdout:0/590: getdents d5/d15/d96 0 2024-02-15T18:31:37.395 INFO:tasks.workunit.client.1.smithi131.stdout:4/776: dwrite d2/d2a/d47/d21/dcd/dfb/d110/d53/f81 [0,4194304] 0 2024-02-15T18:31:37.400 INFO:tasks.workunit.client.1.smithi131.stdout:4/777: mknod d2/dfa/c11e 0 2024-02-15T18:31:37.403 INFO:tasks.workunit.client.1.smithi131.stdout:4/778: unlink d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/d7a/ceb 0 2024-02-15T18:31:37.403 INFO:tasks.workunit.client.1.smithi131.stdout:4/779: write d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/fc8 [34003,89455] 0 2024-02-15T18:31:37.403 INFO:tasks.workunit.client.1.smithi131.stdout:4/780: write d2/d7/f10 [735826,51021] 0 2024-02-15T18:31:37.403 INFO:tasks.workunit.client.1.smithi131.stdout:4/781: truncate d2/d2a/d47/fd6 410571 0 2024-02-15T18:31:37.405 INFO:tasks.workunit.client.1.smithi131.stdout:4/782: creat d2/d2a/f11f x:0 0 0 2024-02-15T18:31:37.405 INFO:tasks.workunit.client.1.smithi131.stdout:4/783: chown d2/d7/d1c/d88/ff2 195 1 2024-02-15T18:31:37.406 INFO:tasks.workunit.client.1.smithi131.stdout:0/591: dread d5/fd [0,4194304] 0 2024-02-15T18:31:37.406 INFO:tasks.workunit.client.1.smithi131.stdout:0/592: dread - d5/f9a zero size 2024-02-15T18:31:37.406 INFO:tasks.workunit.client.1.smithi131.stdout:0/593: truncate d5/d9/ff 4557758 0 2024-02-15T18:31:37.406 INFO:tasks.workunit.client.1.smithi131.stdout:0/594: dread - d5/d2f/d4b/d82/fa9 zero size 2024-02-15T18:31:37.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/726: dwrite d0/d17/d3a/f62 [0,4194304] 0 2024-02-15T18:31:37.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/727: readlink d0/d9d/dc8/lcf 0 2024-02-15T18:31:37.414 INFO:tasks.workunit.client.1.smithi131.stdout:0/595: creat d5/d2f/d4b/fbe x:0 0 0 2024-02-15T18:31:37.442 INFO:tasks.workunit.client.1.smithi131.stdout:7/728: dwrite d0/d17/d36/f3b [0,4194304] 0 2024-02-15T18:31:37.442 INFO:tasks.workunit.client.1.smithi131.stdout:0/596: dwrite d5/d2f/d4b/d82/fa9 [0,4194304] 0 2024-02-15T18:31:37.446 INFO:tasks.workunit.client.1.smithi131.stdout:7/729: mkdir d0/da9/de4 0 2024-02-15T18:31:37.446 INFO:tasks.workunit.client.1.smithi131.stdout:4/784: dwrite d2/d2a/d47/f27 [0,4194304] 0 2024-02-15T18:31:37.447 INFO:tasks.workunit.client.1.smithi131.stdout:0/597: mkdir d5/d2f/d4b/dbf 0 2024-02-15T18:31:37.447 INFO:tasks.workunit.client.1.smithi131.stdout:7/730: rmdir d0/db8 39 2024-02-15T18:31:37.448 INFO:tasks.workunit.client.1.smithi131.stdout:4/785: mkdir d2/d23/d120 0 2024-02-15T18:31:37.449 INFO:tasks.workunit.client.1.smithi131.stdout:0/598: creat d5/fc0 x:0 0 0 2024-02-15T18:31:37.450 INFO:tasks.workunit.client.1.smithi131.stdout:4/786: symlink d2/d2a/d76/l121 0 2024-02-15T18:31:37.453 INFO:tasks.workunit.client.1.smithi131.stdout:0/599: symlink d5/d9/d77/da8/lc1 0 2024-02-15T18:31:37.453 INFO:tasks.workunit.client.1.smithi131.stdout:0/600: readlink d5/d2f/la2 0 2024-02-15T18:31:37.453 INFO:tasks.workunit.client.1.smithi131.stdout:4/787: mknod d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/d7a/c122 0 2024-02-15T18:31:37.456 INFO:tasks.workunit.client.1.smithi131.stdout:4/788: rename d2/dfa to d2/d2a/d47/d21/dcd/dfb/d110/d2e/d5f/d123 0 2024-02-15T18:31:37.466 INFO:tasks.workunit.client.1.smithi131.stdout:4/789: symlink d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/l124 0 2024-02-15T18:31:37.468 INFO:tasks.workunit.client.1.smithi131.stdout:4/790: creat d2/d2a/d85/da3/dba/f125 x:0 0 0 2024-02-15T18:31:37.469 INFO:tasks.workunit.client.1.smithi131.stdout:4/791: link d2/d2a/d47/d21/dcd/dfb/d110/d53/fbb d2/d2a/d47/d21/dcd/dfb/d110/d2e/f126 0 2024-02-15T18:31:37.473 INFO:tasks.workunit.client.1.smithi131.stdout:0/601: dwrite d5/d9/d11/f14 [4194304,4194304] 0 2024-02-15T18:31:37.474 INFO:tasks.workunit.client.1.smithi131.stdout:0/602: rename d5/d9/d11/d3e/f9d to d5/d9/d77/d8b/fc2 0 2024-02-15T18:31:37.485 INFO:tasks.workunit.client.1.smithi131.stdout:5/688: sync 2024-02-15T18:31:37.486 INFO:tasks.workunit.client.1.smithi131.stdout:5/689: creat d18/d83/d8b/dba/dda/fe4 x:0 0 0 2024-02-15T18:31:37.486 INFO:tasks.workunit.client.1.smithi131.stdout:5/690: chown d18/d20/c44 3177171 1 2024-02-15T18:31:37.487 INFO:tasks.workunit.client.1.smithi131.stdout:5/691: mknod d18/d4e/ce5 0 2024-02-15T18:31:37.487 INFO:tasks.workunit.client.1.smithi131.stdout:5/692: stat d18/d6d/d70/d9e/le1 0 2024-02-15T18:31:37.488 INFO:tasks.workunit.client.1.smithi131.stdout:5/693: unlink d18/d33/d73/f88 0 2024-02-15T18:31:37.488 INFO:tasks.workunit.client.1.smithi131.stdout:5/694: dread - d18/d6d/d70/f81 zero size 2024-02-15T18:31:37.491 INFO:tasks.workunit.client.1.smithi131.stdout:0/603: read d5/d2f/f5e [2616612,108568] 0 2024-02-15T18:31:37.493 INFO:tasks.workunit.client.1.smithi131.stdout:0/604: write d5/d9/d11/f88 [4189908,74005] 0 2024-02-15T18:31:37.498 INFO:tasks.workunit.client.1.smithi131.stdout:0/605: symlink d5/d9/d10/d71/lc3 0 2024-02-15T18:31:37.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:36.170119+0000 mon.smithi033 (mon.0) 672 : cluster [DBG] mgrmap e27: smithi033.apxevf(active, since 9s), standbys: smithi131.buibla 2024-02-15T18:31:37.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:36.170478+0000 mon.smithi033 (mon.0) 673 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi131.buibla", "id": "smithi131.buibla"}]: dispatch 2024-02-15T18:31:37.501 INFO:tasks.workunit.client.1.smithi131.stdout:0/606: creat d5/d2f/d45/d8c/fc4 x:0 0 0 2024-02-15T18:31:37.510 INFO:tasks.workunit.client.1.smithi131.stdout:0/607: rmdir d5/d9/d77/da8/db4 0 2024-02-15T18:31:37.510 INFO:tasks.workunit.client.1.smithi131.stdout:5/695: dwrite d18/d83/d8b/dba/f4a [4194304,4194304] 0 2024-02-15T18:31:37.512 INFO:tasks.workunit.client.1.smithi131.stdout:0/608: creat d5/d9/d11/fc5 x:0 0 0 2024-02-15T18:31:37.513 INFO:tasks.workunit.client.1.smithi131.stdout:4/792: dwrite d2/d2a/d85/da3/dba/fee [4194304,4194304] 0 2024-02-15T18:31:37.513 INFO:tasks.workunit.client.1.smithi131.stdout:4/793: dread - d2/d2a/d85/da3/dba/d118/f10d zero size 2024-02-15T18:31:37.513 INFO:tasks.workunit.client.1.smithi131.stdout:5/696: mknod d18/d6d/d70/d9e/d86/ce6 0 2024-02-15T18:31:37.513 INFO:tasks.workunit.client.1.smithi131.stdout:5/697: chown d18/d83/d8b/dba/d63/l65 3278856 1 2024-02-15T18:31:37.516 INFO:tasks.workunit.client.1.smithi131.stdout:0/609: unlink d5/d2f/ca1 0 2024-02-15T18:31:37.526 INFO:tasks.workunit.client.1.smithi131.stdout:4/794: rename d2/d7/d1c/d94/df6 to d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/d127 0 2024-02-15T18:31:37.528 INFO:tasks.workunit.client.1.smithi131.stdout:5/698: mknod d18/d6d/ce7 0 2024-02-15T18:31:37.530 INFO:tasks.workunit.client.1.smithi131.stdout:0/610: symlink d5/d9/d10/d71/d92/lc6 0 2024-02-15T18:31:37.534 INFO:tasks.workunit.client.1.smithi131.stdout:4/795: mknod d2/d7/d1c/d84/db8/d101/d105/c128 0 2024-02-15T18:31:37.538 INFO:tasks.workunit.client.1.smithi131.stdout:0/611: mknod d5/d2f/d4b/d82/da0/cc7 0 2024-02-15T18:31:37.538 INFO:tasks.workunit.client.1.smithi131.stdout:0/612: write d5/d9/d10/db7/fbb [299465,33427] 0 2024-02-15T18:31:37.547 INFO:tasks.workunit.client.1.smithi131.stdout:5/699: rename d18/d6d/d70/d9e to d18/d33/d73/de8 0 2024-02-15T18:31:37.547 INFO:tasks.workunit.client.1.smithi131.stdout:5/700: fdatasync d18/d6d/d9c/fc9 0 2024-02-15T18:31:37.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:36.170119+0000 mon.smithi033 (mon.0) 672 : cluster [DBG] mgrmap e27: smithi033.apxevf(active, since 9s), standbys: smithi131.buibla 2024-02-15T18:31:37.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:36.170478+0000 mon.smithi033 (mon.0) 673 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr metadata", "who": "smithi131.buibla", "id": "smithi131.buibla"}]: dispatch 2024-02-15T18:31:37.549 INFO:tasks.workunit.client.1.smithi131.stdout:8/705: sync 2024-02-15T18:31:37.549 INFO:tasks.workunit.client.1.smithi131.stdout:3/817: sync 2024-02-15T18:31:37.549 INFO:tasks.workunit.client.1.smithi131.stdout:1/877: sync 2024-02-15T18:31:37.549 INFO:tasks.workunit.client.1.smithi131.stdout:3/818: chown d2/d22/d3f/fa0 3830 1 2024-02-15T18:31:37.549 INFO:tasks.workunit.client.1.smithi131.stdout:8/706: write d22/d26/d3f/d7c/fd9 [326867,56679] 0 2024-02-15T18:31:37.549 INFO:tasks.workunit.client.1.smithi131.stdout:8/707: stat d22/d2e/d5e/db5/lb8 0 2024-02-15T18:31:37.550 INFO:tasks.workunit.client.1.smithi131.stdout:8/708: fdatasync d22/d26/d3f/d47/f6a 0 2024-02-15T18:31:37.550 INFO:tasks.workunit.client.1.smithi131.stdout:8/709: write d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f59 [7536308,42843] 0 2024-02-15T18:31:37.550 INFO:tasks.workunit.client.1.smithi131.stdout:8/710: write d22/d26/d3f/d47/d48/d5f/fa3 [992838,81746] 0 2024-02-15T18:31:37.556 INFO:tasks.workunit.client.1.smithi131.stdout:4/796: creat d2/d2a/d85/da3/dbf/ddc/d114/f129 x:0 0 0 2024-02-15T18:31:37.558 INFO:tasks.workunit.client.1.smithi131.stdout:4/797: dread d2/d2a/d47/d21/f3a [0,4194304] 0 2024-02-15T18:31:37.558 INFO:tasks.workunit.client.1.smithi131.stdout:8/711: dread d22/d26/d3f/d47/d48/d84/fc8 [0,4194304] 0 2024-02-15T18:31:37.558 INFO:tasks.workunit.client.1.smithi131.stdout:8/712: readlink d22/d26/d3f/d47/d8e/lcc 0 2024-02-15T18:31:37.560 INFO:tasks.workunit.client.1.smithi131.stdout:0/613: link d5/d15/d1f/l67 d5/d9/d11/d3e/lc8 0 2024-02-15T18:31:37.560 INFO:tasks.workunit.client.1.smithi131.stdout:0/614: fsync d5/d9/d77/da8/fab 0 2024-02-15T18:31:37.561 INFO:tasks.workunit.client.1.smithi131.stdout:5/701: getdents d18/d33/d73 0 2024-02-15T18:31:37.563 INFO:tasks.workunit.client.1.smithi131.stdout:5/702: dread d18/d20/f2f [4194304,4194304] 0 2024-02-15T18:31:37.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/878: link d0/d2/d4/d41/d5a/f96 d0/d2/d31/d3d/f136 0 2024-02-15T18:31:37.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/879: dread - d0/d1/d16/d9d/f128 zero size 2024-02-15T18:31:37.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/880: fsync d0/d1/d16/fe1 0 2024-02-15T18:31:37.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/881: write d0/d2/d4/da/f121 [879741,107035] 0 2024-02-15T18:31:37.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/882: fsync d0/d1/d16/d30/f91 0 2024-02-15T18:31:37.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/883: write d0/d2/d7/d72/d78/df2/f10a [1087026,16155] 0 2024-02-15T18:31:37.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/884: readlink d0/d2/d4/d41/l62 0 2024-02-15T18:31:37.566 INFO:tasks.workunit.client.1.smithi131.stdout:3/819: truncate d2/d22/d29/d20/d86/fcc 1632412 0 2024-02-15T18:31:37.566 INFO:tasks.workunit.client.1.smithi131.stdout:1/885: write d0/d2/d7/fab [2483063,58436] 0 2024-02-15T18:31:37.567 INFO:tasks.workunit.client.1.smithi131.stdout:4/798: mknod d2/d2a/d47/d21/dcd/dfb/d110/dd1/c12a 0 2024-02-15T18:31:37.568 INFO:tasks.workunit.client.1.smithi131.stdout:8/713: symlink d22/d26/d3f/d47/d48/df5/lf8 0 2024-02-15T18:31:37.576 INFO:tasks.workunit.client.1.smithi131.stdout:0/615: symlink d5/d2f/d4b/d82/dae/lc9 0 2024-02-15T18:31:37.576 INFO:tasks.workunit.client.1.smithi131.stdout:5/703: stat d18/d83/d8b/dba/c3f 0 2024-02-15T18:31:37.576 INFO:tasks.workunit.client.1.smithi131.stdout:0/616: chown d5/d15/c42 0 1 2024-02-15T18:31:37.577 INFO:tasks.workunit.client.1.smithi131.stdout:3/820: getdents d2/d22/d29 0 2024-02-15T18:31:37.580 INFO:tasks.workunit.client.1.smithi131.stdout:1/886: rmdir d0/d2/d7/d72/d78/da7 39 2024-02-15T18:31:37.580 INFO:tasks.workunit.client.1.smithi131.stdout:1/887: chown d0/d2/dd6/fbe 1417754 1 2024-02-15T18:31:37.582 INFO:tasks.workunit.client.1.smithi131.stdout:4/799: mknod d2/d2a/d85/da3/dbf/c12b 0 2024-02-15T18:31:37.583 INFO:tasks.workunit.client.1.smithi131.stdout:0/617: unlink d5/d15/c42 0 2024-02-15T18:31:37.586 INFO:tasks.workunit.client.1.smithi131.stdout:5/704: mkdir d18/d83/d8b/dba/dda/de9 0 2024-02-15T18:31:37.587 INFO:tasks.workunit.client.1.smithi131.stdout:3/821: rename d2/d22/d29/db/fa9 to d2/d22/d29/d9e/f107 0 2024-02-15T18:31:37.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/714: dwrite d22/d26/d3f/d47/d48/d84/fc8 [0,4194304] 0 2024-02-15T18:31:37.589 INFO:tasks.workunit.client.1.smithi131.stdout:8/715: rename d22/d26 to d22/d26/d3f/d47/d48/df9 22 2024-02-15T18:31:37.589 INFO:tasks.workunit.client.1.smithi131.stdout:8/716: fdatasync d22/d26/d3f/f44 0 2024-02-15T18:31:37.589 INFO:tasks.workunit.client.1.smithi131.stdout:8/717: write d22/d26/d3f/d47/d48/d5f/f85 [1135317,106514] 0 2024-02-15T18:31:37.592 INFO:tasks.workunit.client.1.smithi131.stdout:8/718: write d22/d26/d3f/f44 [1778596,26532] 0 2024-02-15T18:31:37.608 INFO:tasks.workunit.client.1.smithi131.stdout:5/705: dwrite d18/d33/f5b [0,4194304] 0 2024-02-15T18:31:37.608 INFO:tasks.workunit.client.1.smithi131.stdout:5/706: dread - d18/d20/fa8 zero size 2024-02-15T18:31:37.613 INFO:tasks.workunit.client.1.smithi131.stdout:5/707: dread d18/d33/d73/fc5 [0,4194304] 0 2024-02-15T18:31:37.613 INFO:tasks.workunit.client.1.smithi131.stdout:5/708: readlink d18/d33/lb2 0 2024-02-15T18:31:37.617 INFO:tasks.workunit.client.1.smithi131.stdout:8/719: dwrite d22/d2e/d5e/fb4 [0,4194304] 0 2024-02-15T18:31:37.618 INFO:tasks.workunit.client.1.smithi131.stdout:8/720: chown d22/d26/d3f/lb6 1296 1 2024-02-15T18:31:37.618 INFO:tasks.workunit.client.1.smithi131.stdout:8/721: chown d22/d26/d3f/d47/dc3/ff7 185 1 2024-02-15T18:31:37.618 INFO:tasks.workunit.client.1.smithi131.stdout:8/722: stat d22/d2e/d60/f87 0 2024-02-15T18:31:37.623 INFO:tasks.workunit.client.1.smithi131.stdout:1/888: getdents d0/d2/dd6 0 2024-02-15T18:31:37.628 INFO:tasks.workunit.client.1.smithi131.stdout:0/618: symlink d5/d9/d10/d73/lca 0 2024-02-15T18:31:37.629 INFO:tasks.workunit.client.1.smithi131.stdout:0/619: write d5/d9/d10/d3f/f61 [371833,75091] 0 2024-02-15T18:31:37.629 INFO:tasks.workunit.client.1.smithi131.stdout:3/822: truncate d2/d22/d29/db/d23/f96 665796 0 2024-02-15T18:31:37.643 INFO:tasks.workunit.client.1.smithi131.stdout:8/723: symlink d22/d2e/d60/lfa 0 2024-02-15T18:31:37.647 INFO:tasks.workunit.client.1.smithi131.stdout:8/724: getdents d22/d26/d3f/d86/dcf 0 2024-02-15T18:31:37.649 INFO:tasks.workunit.client.1.smithi131.stdout:1/889: rename d0/f27 to d0/d2/db/de6/f137 0 2024-02-15T18:31:37.650 INFO:tasks.workunit.client.1.smithi131.stdout:3/823: mknod d2/d22/d29/db/d1a/da4/c108 0 2024-02-15T18:31:37.654 INFO:tasks.workunit.client.1.smithi131.stdout:1/890: rename d0/d2/d7 to d0/d2/db/de6/d138 0 2024-02-15T18:31:37.655 INFO:tasks.workunit.client.1.smithi131.stdout:0/620: dwrite d5/d2f/f78 [0,4194304] 0 2024-02-15T18:31:37.655 INFO:tasks.workunit.client.1.smithi131.stdout:3/824: symlink d2/d22/d5e/d79/d9d/l109 0 2024-02-15T18:31:37.669 INFO:tasks.workunit.client.1.smithi131.stdout:0/621: unlink d5/d9/d10/d71/d92/lc6 0 2024-02-15T18:31:37.669 INFO:tasks.workunit.client.1.smithi131.stdout:0/622: write d5/d9/d11/f31 [3443840,89374] 0 2024-02-15T18:31:37.670 INFO:tasks.workunit.client.1.smithi131.stdout:3/825: link d2/d22/d3f/c5f d2/d22/d29/db/dd1/c10a 0 2024-02-15T18:31:37.671 INFO:tasks.workunit.client.1.smithi131.stdout:0/623: write d5/fa [836170,49803] 0 2024-02-15T18:31:37.672 INFO:tasks.workunit.client.1.smithi131.stdout:0/624: write d5/d2f/d4b/d82/dae/fbd [4971017,18121] 0 2024-02-15T18:31:37.672 INFO:tasks.workunit.client.1.smithi131.stdout:1/891: dwrite d0/d2/db/de6/d138/f1e [0,4194304] 0 2024-02-15T18:31:37.674 INFO:tasks.workunit.client.1.smithi131.stdout:3/826: getdents d2 0 2024-02-15T18:31:37.674 INFO:tasks.workunit.client.1.smithi131.stdout:3/827: write d2/d22/d29/db/dd1/fd6 [371779,105833] 0 2024-02-15T18:31:37.675 INFO:tasks.workunit.client.1.smithi131.stdout:0/625: dread d5/f56 [0,4194304] 0 2024-02-15T18:31:37.676 INFO:tasks.workunit.client.1.smithi131.stdout:3/828: rename d2/d22/d29/d9e/fea to d2/d22/d5e/d79/d9d/f10b 0 2024-02-15T18:31:37.681 INFO:tasks.workunit.client.1.smithi131.stdout:0/626: creat d5/d2f/d45/fcb x:0 0 0 2024-02-15T18:31:37.681 INFO:tasks.workunit.client.1.smithi131.stdout:1/892: dread d0/d68/d80/ffe [0,4194304] 0 2024-02-15T18:31:37.682 INFO:tasks.workunit.client.1.smithi131.stdout:0/627: chown d5/d2f/d4b/d82/l8f 601441 1 2024-02-15T18:31:37.683 INFO:tasks.workunit.client.1.smithi131.stdout:0/628: mknod d5/d9/d10/db7/ccc 0 2024-02-15T18:31:37.685 INFO:tasks.workunit.client.1.smithi131.stdout:1/893: unlink d0/d2/d31/l95 0 2024-02-15T18:31:37.685 INFO:tasks.workunit.client.1.smithi131.stdout:1/894: chown d0/d2/d31/d3d/d46/c84 20 1 2024-02-15T18:31:37.685 INFO:tasks.workunit.client.1.smithi131.stdout:1/895: write d0/d68/f9c [964158,15046] 0 2024-02-15T18:31:37.686 INFO:tasks.workunit.client.1.smithi131.stdout:3/829: dread d2/d22/d29/db/d23/d2a/d49/fa3 [0,4194304] 0 2024-02-15T18:31:37.690 INFO:tasks.workunit.client.1.smithi131.stdout:0/629: mknod d5/d2f/d4b/d82/d9f/ccd 0 2024-02-15T18:31:37.692 INFO:tasks.workunit.client.1.smithi131.stdout:1/896: rmdir d0/d2/db/de6/d138 39 2024-02-15T18:31:37.699 INFO:tasks.workunit.client.1.smithi131.stdout:0/630: dread d5/fa [0,4194304] 0 2024-02-15T18:31:37.700 INFO:tasks.workunit.client.1.smithi131.stdout:0/631: readlink d5/d2f/l5a 0 2024-02-15T18:31:37.773 INFO:tasks.workunit.client.1.smithi131.stdout:6/595: sync 2024-02-15T18:31:37.773 INFO:tasks.workunit.client.1.smithi131.stdout:9/804: sync 2024-02-15T18:31:37.773 INFO:tasks.workunit.client.1.smithi131.stdout:2/594: sync 2024-02-15T18:31:37.773 INFO:tasks.workunit.client.1.smithi131.stdout:2/595: readlink dd/d10/d22/d2f/d38/d74/l35 0 2024-02-15T18:31:37.775 INFO:tasks.workunit.client.1.smithi131.stdout:1/897: mkdir d0/d2/d31/d3d/dd3/d105/d139 0 2024-02-15T18:31:37.779 INFO:tasks.workunit.client.1.smithi131.stdout:0/632: getdents d5 0 2024-02-15T18:31:37.779 INFO:tasks.workunit.client.1.smithi131.stdout:0/633: fdatasync d5/d15/d1f/f57 0 2024-02-15T18:31:37.786 INFO:tasks.workunit.client.1.smithi131.stdout:0/634: dread d5/d9/d10/d3f/f7f [4194304,4194304] 0 2024-02-15T18:31:37.788 INFO:tasks.workunit.client.1.smithi131.stdout:0/635: rmdir d5/d2f/d45/d8c 39 2024-02-15T18:31:37.791 INFO:tasks.workunit.client.1.smithi131.stdout:3/830: dwrite d2/d22/d29/db/d23/d2a/d5b/f7d [0,4194304] 0 2024-02-15T18:31:37.792 INFO:tasks.workunit.client.1.smithi131.stdout:3/831: write d2/d22/d29/db/f1e [5304872,60252] 0 2024-02-15T18:31:37.792 INFO:tasks.workunit.client.1.smithi131.stdout:2/596: dwrite dd/d10/d22/d2a/d48/fbe [0,4194304] 0 2024-02-15T18:31:37.792 INFO:tasks.workunit.client.1.smithi131.stdout:0/636: unlink d5/d2f/d4b/d82/fa9 0 2024-02-15T18:31:37.801 INFO:tasks.workunit.client.1.smithi131.stdout:2/597: dread dd/f29 [0,4194304] 0 2024-02-15T18:31:37.804 INFO:tasks.workunit.client.1.smithi131.stdout:3/832: mknod d2/d22/d29/db/d1a/df3/c10c 0 2024-02-15T18:31:37.804 INFO:tasks.workunit.client.1.smithi131.stdout:3/833: fsync d2/f92 0 2024-02-15T18:31:37.805 INFO:tasks.workunit.client.1.smithi131.stdout:0/637: rmdir d5/d15 39 2024-02-15T18:31:37.806 INFO:tasks.workunit.client.1.smithi131.stdout:2/598: creat dd/d14/d1f/fc4 x:0 0 0 2024-02-15T18:31:37.807 INFO:tasks.workunit.client.1.smithi131.stdout:2/599: dread - dd/d10/d22/d2a/d48/f83 zero size 2024-02-15T18:31:37.809 INFO:tasks.workunit.client.1.smithi131.stdout:0/638: creat d5/d9/d10/db7/fce x:0 0 0 2024-02-15T18:31:37.810 INFO:tasks.workunit.client.1.smithi131.stdout:3/834: rename d2/d22/d29/db/d23/d2a/d5b/f71 to d2/d22/d29/db/d84/f10d 0 2024-02-15T18:31:37.811 INFO:tasks.workunit.client.1.smithi131.stdout:0/639: symlink d5/d9/d77/da8/dad/lcf 0 2024-02-15T18:31:37.812 INFO:tasks.workunit.client.1.smithi131.stdout:3/835: dread d2/d22/d29/db/d23/d2a/d49/f66 [0,4194304] 0 2024-02-15T18:31:37.812 INFO:tasks.workunit.client.1.smithi131.stdout:3/836: chown d2/d22/d29/db/d1a/da4/d8d/ldc 281 1 2024-02-15T18:31:37.813 INFO:tasks.workunit.client.1.smithi131.stdout:2/600: rename dd/d10/d22/d2f/d38/d74/d2e/d66/d99/f9c to dd/d10/d22/da3/fc5 0 2024-02-15T18:31:37.821 INFO:tasks.workunit.client.1.smithi131.stdout:2/601: write f8 [1635777,4925] 0 2024-02-15T18:31:37.821 INFO:tasks.workunit.client.1.smithi131.stdout:2/602: fsync dd/d14/d1f/d65/f71 0 2024-02-15T18:31:37.825 INFO:tasks.workunit.client.1.smithi131.stdout:2/603: creat dd/d14/d1f/d65/d77/d7a/da2/fc6 x:0 0 0 2024-02-15T18:31:37.825 INFO:tasks.workunit.client.1.smithi131.stdout:2/604: write dd/d10/d22/d2f/d38/d74/d2e/d6a/fa4 [351754,77310] 0 2024-02-15T18:31:37.844 INFO:tasks.workunit.client.1.smithi131.stdout:0/640: dwrite d5/d9/d11/f14 [4194304,4194304] 0 2024-02-15T18:31:37.845 INFO:tasks.workunit.client.1.smithi131.stdout:3/837: dwrite d2/d22/d5e/d79/f98 [0,4194304] 0 2024-02-15T18:31:37.845 INFO:tasks.workunit.client.1.smithi131.stdout:2/605: dwrite dd/f18 [0,4194304] 0 2024-02-15T18:31:37.846 INFO:tasks.workunit.client.1.smithi131.stdout:0/641: symlink d5/d15/ld0 0 2024-02-15T18:31:37.846 INFO:tasks.workunit.client.1.smithi131.stdout:0/642: truncate d5/d2f/d4b/fbe 466532 0 2024-02-15T18:31:37.851 INFO:tasks.workunit.client.1.smithi131.stdout:0/643: read d5/d9/d4d/f7c [229994,110158] 0 2024-02-15T18:31:37.856 INFO:tasks.workunit.client.1.smithi131.stdout:2/606: rename dd/d14/d1f/d65/ca9 to dd/d10/d22/d2f/d38/d74/cc7 0 2024-02-15T18:31:37.856 INFO:tasks.workunit.client.1.smithi131.stdout:2/607: dread - dd/d10/d22/d2f/d38/d74/d2e/d66/fa8 zero size 2024-02-15T18:31:37.856 INFO:tasks.workunit.client.1.smithi131.stdout:2/608: chown dd/d8f 9729299 1 2024-02-15T18:31:37.856 INFO:tasks.workunit.client.1.smithi131.stdout:2/609: chown dd/d10/d22/d2a/f49 17204 1 2024-02-15T18:31:37.858 INFO:tasks.workunit.client.1.smithi131.stdout:0/644: creat d5/d9/d10/fd1 x:0 0 0 2024-02-15T18:31:37.859 INFO:tasks.workunit.client.1.smithi131.stdout:2/610: creat dd/d10/d22/d2f/d38/d74/d2e/d4a/fc8 x:0 0 0 2024-02-15T18:31:37.860 INFO:tasks.workunit.client.1.smithi131.stdout:2/611: fsync dd/d10/d22/d2f/d38/f50 0 2024-02-15T18:31:37.861 INFO:tasks.workunit.client.1.smithi131.stdout:0/645: link d5/d2f/f84 d5/d9/d4d/fd2 0 2024-02-15T18:31:37.863 INFO:tasks.workunit.client.1.smithi131.stdout:2/612: link dd/d14/d1f/l62 dd/d10/d22/d2f/d38/lc9 0 2024-02-15T18:31:37.866 INFO:tasks.workunit.client.1.smithi131.stdout:3/838: dwrite d2/d22/d42/fa8 [0,4194304] 0 2024-02-15T18:31:37.866 INFO:tasks.workunit.client.1.smithi131.stdout:3/839: dread - d2/d22/d29/db/d1a/fe6 zero size 2024-02-15T18:31:37.866 INFO:tasks.workunit.client.1.smithi131.stdout:2/613: truncate dd/d10/d22/d2f/d38/d74/d2e/f67 1096444 0 2024-02-15T18:31:37.872 INFO:tasks.workunit.client.1.smithi131.stdout:3/840: creat d2/d22/d29/db/d1a/da4/d85/f10e x:0 0 0 2024-02-15T18:31:37.872 INFO:tasks.workunit.client.1.smithi131.stdout:3/841: dread - d2/d22/d5e/fca zero size 2024-02-15T18:31:37.872 INFO:tasks.workunit.client.1.smithi131.stdout:2/614: mkdir dd/d10/d22/d2f/d38/d9f/dca 0 2024-02-15T18:31:37.873 INFO:tasks.workunit.client.1.smithi131.stdout:3/842: write d2/d22/d29/db/d1a/da4/fb9 [25089,85716] 0 2024-02-15T18:31:37.877 INFO:tasks.workunit.client.1.smithi131.stdout:3/843: write d2/d22/d29/db/d1a/da4/faa [3073656,13424] 0 2024-02-15T18:31:37.877 INFO:tasks.workunit.client.1.smithi131.stdout:3/844: fsync d2/d22/d29/db/d1a/da4/d8d/ff7 0 2024-02-15T18:31:37.877 INFO:tasks.workunit.client.1.smithi131.stdout:3/845: chown d2/d22/d29/db/f3e 0 1 2024-02-15T18:31:37.878 INFO:tasks.workunit.client.1.smithi131.stdout:3/846: unlink d2/d22/d29/db/d1a/da4/d85/c95 0 2024-02-15T18:31:37.878 INFO:tasks.workunit.client.1.smithi131.stdout:3/847: fsync d2/d22/d29/db/d1a/da4/d8d/ff7 0 2024-02-15T18:31:37.880 INFO:tasks.workunit.client.1.smithi131.stdout:3/848: mknod d2/d22/d29/db/d1a/dc3/c10f 0 2024-02-15T18:31:37.880 INFO:tasks.workunit.client.1.smithi131.stdout:3/849: read d2/d22/d29/db/d23/d2a/d49/f66 [20978,57032] 0 2024-02-15T18:31:37.881 INFO:tasks.workunit.client.1.smithi131.stdout:0/646: dwrite d5/fc0 [0,4194304] 0 2024-02-15T18:31:37.881 INFO:tasks.workunit.client.1.smithi131.stdout:0/647: write d5/d9/d10/db7/fbb [617945,112013] 0 2024-02-15T18:31:37.881 INFO:tasks.workunit.client.1.smithi131.stdout:3/850: read d2/d22/d29/db/f76 [1981672,95510] 0 2024-02-15T18:31:37.881 INFO:tasks.workunit.client.1.smithi131.stdout:3/851: fsync d2/f92 0 2024-02-15T18:31:37.883 INFO:tasks.workunit.client.1.smithi131.stdout:2/615: dread dd/d10/d22/d2f/d38/d74/d2e/d66/f78 [0,4194304] 0 2024-02-15T18:31:37.889 INFO:tasks.workunit.client.1.smithi131.stdout:0/648: creat d5/d2f/d4b/d82/d9f/fd3 x:0 0 0 2024-02-15T18:31:37.890 INFO:tasks.workunit.client.1.smithi131.stdout:3/852: mkdir d2/d22/d29/db/d1a/d110 0 2024-02-15T18:31:37.890 INFO:tasks.workunit.client.1.smithi131.stdout:3/853: chown d2/d22/d29/f7e 788 1 2024-02-15T18:31:37.894 INFO:tasks.workunit.client.1.smithi131.stdout:2/616: mkdir dd/d10/d22/d2f/d38/d9f/dcb 0 2024-02-15T18:31:37.899 INFO:tasks.workunit.client.1.smithi131.stdout:7/731: sync 2024-02-15T18:31:37.900 INFO:tasks.workunit.client.1.smithi131.stdout:2/617: dread dd/d1e/f5f [0,4194304] 0 2024-02-15T18:31:37.900 INFO:tasks.workunit.client.1.smithi131.stdout:2/618: chown dd/d10/d22/d2f/d38/f70 6272801 1 2024-02-15T18:31:37.901 INFO:tasks.workunit.client.1.smithi131.stdout:7/732: creat d0/d17/d3a/d3d/fe5 x:0 0 0 2024-02-15T18:31:37.903 INFO:tasks.workunit.client.1.smithi131.stdout:2/619: write dd/f60 [777698,130736] 0 2024-02-15T18:31:37.903 INFO:tasks.workunit.client.1.smithi131.stdout:0/649: dwrite d5/d15/d1f/f57 [0,4194304] 0 2024-02-15T18:31:37.905 INFO:tasks.workunit.client.1.smithi131.stdout:2/620: mkdir dd/d1e/dcc 0 2024-02-15T18:31:37.906 INFO:tasks.workunit.client.1.smithi131.stdout:7/733: write d0/d17/f21 [4105130,34248] 0 2024-02-15T18:31:37.906 INFO:tasks.workunit.client.1.smithi131.stdout:7/734: stat d0/d17/d3a 0 2024-02-15T18:31:37.906 INFO:tasks.workunit.client.1.smithi131.stdout:0/650: creat d5/fd4 x:0 0 0 2024-02-15T18:31:37.907 INFO:tasks.workunit.client.1.smithi131.stdout:2/621: mknod dd/d10/d22/d2f/d38/d74/d2e/d66/d9b/ccd 0 2024-02-15T18:31:37.911 INFO:tasks.workunit.client.1.smithi131.stdout:7/735: creat d0/d17/d3a/d3d/d79/d89/fe6 x:0 0 0 2024-02-15T18:31:37.911 INFO:tasks.workunit.client.1.smithi131.stdout:2/622: symlink dd/d10/lce 0 2024-02-15T18:31:37.911 INFO:tasks.workunit.client.1.smithi131.stdout:2/623: readlink dd/d10/d22/d2f/d38/d74/d2e/d6a/l5b 0 2024-02-15T18:31:37.913 INFO:tasks.workunit.client.1.smithi131.stdout:7/736: getdents d0/d34/d8b/d9a 0 2024-02-15T18:31:37.914 INFO:tasks.workunit.client.1.smithi131.stdout:2/624: getdents dd/d14/d1f/d65 0 2024-02-15T18:31:37.916 INFO:tasks.workunit.client.1.smithi131.stdout:7/737: creat d0/d9d/dc8/fe7 x:0 0 0 2024-02-15T18:31:37.918 INFO:tasks.workunit.client.1.smithi131.stdout:2/625: link dd/d10/d22/d2f/d38/c55 dd/d14/d1f/d65/ccf 0 2024-02-15T18:31:37.919 INFO:tasks.workunit.client.1.smithi131.stdout:2/626: mknod dd/d10/d22/d2a/d94/cd0 0 2024-02-15T18:31:37.934 INFO:tasks.workunit.client.1.smithi131.stdout:0/651: dwrite d5/d15/f60 [0,4194304] 0 2024-02-15T18:31:37.952 INFO:tasks.workunit.client.1.smithi131.stdout:2/627: dwrite dd/f18 [0,4194304] 0 2024-02-15T18:31:37.953 INFO:tasks.workunit.client.1.smithi131.stdout:7/738: dwrite d0/d17/f21 [4194304,4194304] 0 2024-02-15T18:31:37.953 INFO:tasks.workunit.client.1.smithi131.stdout:7/739: stat d0/d17/d36/c6f 0 2024-02-15T18:31:37.954 INFO:tasks.workunit.client.1.smithi131.stdout:2/628: mkdir dd/d14/d1f/d65/dd1 0 2024-02-15T18:31:37.955 INFO:tasks.workunit.client.1.smithi131.stdout:0/652: dwrite d5/d2f/d45/f50 [0,4194304] 0 2024-02-15T18:31:37.959 INFO:tasks.workunit.client.1.smithi131.stdout:7/740: dread d0/d17/d36/f48 [0,4194304] 0 2024-02-15T18:31:37.965 INFO:tasks.workunit.client.1.smithi131.stdout:7/741: mknod d0/db8/ce8 0 2024-02-15T18:31:37.968 INFO:tasks.workunit.client.1.smithi131.stdout:2/629: dread dd/d10/f19 [4194304,4194304] 0 2024-02-15T18:31:37.968 INFO:tasks.workunit.client.1.smithi131.stdout:2/630: chown dd/d10/d22/d2f/d38/f50 70 1 2024-02-15T18:31:37.972 INFO:tasks.workunit.client.1.smithi131.stdout:7/742: symlink d0/d9d/dc8/le9 0 2024-02-15T18:31:37.972 INFO:tasks.workunit.client.1.smithi131.stdout:7/743: write d0/d17/d3a/d3d/fe5 [270898,4122] 0 2024-02-15T18:31:37.974 INFO:tasks.workunit.client.1.smithi131.stdout:2/631: rename dd/d10/d22/d2f/d38/d74/d2e/d4a/lbb to dd/d10/d22/d2f/d38/d74/d2e/d4a/ld2 0 2024-02-15T18:31:37.975 INFO:tasks.workunit.client.1.smithi131.stdout:2/632: fsync dd/d10/d22/d2f/d38/d74/f5d 0 2024-02-15T18:31:37.976 INFO:tasks.workunit.client.1.smithi131.stdout:4/800: sync 2024-02-15T18:31:37.977 INFO:tasks.workunit.client.1.smithi131.stdout:0/653: dwrite d5/d9/d77/da8/fab [0,4194304] 0 2024-02-15T18:31:37.979 INFO:tasks.workunit.client.1.smithi131.stdout:7/744: rename d0/l4d to d0/da9/de4/lea 0 2024-02-15T18:31:37.997 INFO:tasks.workunit.client.1.smithi131.stdout:4/801: dwrite d2/d2a/d85/da3/dba/f125 [0,4194304] 0 2024-02-15T18:31:37.998 INFO:tasks.workunit.client.1.smithi131.stdout:0/654: dwrite d5/d9/ff [0,4194304] 0 2024-02-15T18:31:38.048 INFO:tasks.workunit.client.1.smithi131.stdout:2/633: symlink dd/d10/d22/d2f/ld3 0 2024-02-15T18:31:38.055 INFO:tasks.workunit.client.1.smithi131.stdout:2/634: dread dd/d10/fb4 [0,4194304] 0 2024-02-15T18:31:38.055 INFO:tasks.workunit.client.1.smithi131.stdout:4/802: creat d2/d2a/d85/da3/dbf/f12c x:0 0 0 2024-02-15T18:31:38.060 INFO:tasks.workunit.client.1.smithi131.stdout:0/655: mknod d5/d9/cd5 0 2024-02-15T18:31:38.063 INFO:tasks.workunit.client.1.smithi131.stdout:2/635: rename dd/d14/d1f/d65/f71 to dd/d10/d22/d2f/d38/d74/d2e/d6a/dc0/fd4 0 2024-02-15T18:31:38.064 INFO:tasks.workunit.client.1.smithi131.stdout:4/803: mkdir d2/d2a/d85/da3/dba/d118/d12d 0 2024-02-15T18:31:38.066 INFO:tasks.workunit.client.1.smithi131.stdout:0/656: dread f0 [0,4194304] 0 2024-02-15T18:31:38.068 INFO:tasks.workunit.client.1.smithi131.stdout:2/636: dread dd/f29 [0,4194304] 0 2024-02-15T18:31:38.068 INFO:tasks.workunit.client.1.smithi131.stdout:4/804: link d2/d2a/d76/l121 d2/d2a/d47/d21/dcd/dfb/d110/dd1/l12e 0 2024-02-15T18:31:38.068 INFO:tasks.workunit.client.1.smithi131.stdout:4/805: chown d2/d7/d1c/d94/c99 99 1 2024-02-15T18:31:38.071 INFO:tasks.workunit.client.1.smithi131.stdout:0/657: mknod d5/d2f/d4b/cd6 0 2024-02-15T18:31:38.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/806: rmdir d2/d2a/d76/ddb 39 2024-02-15T18:31:38.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/807: chown d2/d7/d1c/d84/db8/lef 902679 1 2024-02-15T18:31:38.074 INFO:tasks.workunit.client.1.smithi131.stdout:4/808: creat d2/d2a/d76/ddb/df1/f12f x:0 0 0 2024-02-15T18:31:38.075 INFO:tasks.workunit.client.1.smithi131.stdout:4/809: mknod d2/d2a/d47/d16/d5a/dd2/c130 0 2024-02-15T18:31:38.076 INFO:tasks.workunit.client.1.smithi131.stdout:4/810: dread d2/d2a/d47/d21/dcd/dfb/d110/f79 [0,4194304] 0 2024-02-15T18:31:38.077 INFO:tasks.workunit.client.1.smithi131.stdout:4/811: symlink d2/d2a/d47/l131 0 2024-02-15T18:31:38.084 INFO:tasks.workunit.client.1.smithi131.stdout:4/812: dread d2/d2a/f42 [0,4194304] 0 2024-02-15T18:31:38.085 INFO:tasks.workunit.client.1.smithi131.stdout:4/813: truncate d2/d2a/d85/da3/dba/d118/f10d 990502 0 2024-02-15T18:31:38.085 INFO:tasks.workunit.client.1.smithi131.stdout:4/814: chown d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/l124 184969 1 2024-02-15T18:31:38.085 INFO:tasks.workunit.client.1.smithi131.stdout:4/815: stat d2/d7/ff 0 2024-02-15T18:31:38.087 INFO:tasks.workunit.client.1.smithi131.stdout:4/816: rename d2/d2a/d47/d21/dcd/dfb/d110/f79 to d2/d23/f132 0 2024-02-15T18:31:38.088 INFO:tasks.workunit.client.1.smithi131.stdout:2/637: dwrite fa [0,4194304] 0 2024-02-15T18:31:38.090 INFO:tasks.workunit.client.1.smithi131.stdout:2/638: creat dd/d14/fd5 x:0 0 0 2024-02-15T18:31:38.095 INFO:tasks.workunit.client.1.smithi131.stdout:2/639: dread f4 [0,4194304] 0 2024-02-15T18:31:38.117 INFO:tasks.workunit.client.1.smithi131.stdout:2/640: symlink dd/d10/db1/dbd/ld6 0 2024-02-15T18:31:38.119 INFO:tasks.workunit.client.1.smithi131.stdout:2/641: mknod dd/d1e/cd7 0 2024-02-15T18:31:38.119 INFO:tasks.workunit.client.1.smithi131.stdout:2/642: chown dd/d10/d22/d2f/d38/f3f 72257778 1 2024-02-15T18:31:38.132 INFO:tasks.workunit.client.1.smithi131.stdout:5/709: sync 2024-02-15T18:31:38.134 INFO:tasks.workunit.client.1.smithi131.stdout:2/643: dwrite dd/f8d [0,4194304] 0 2024-02-15T18:31:38.134 INFO:tasks.workunit.client.1.smithi131.stdout:2/644: write dd/d14/d1f/fc4 [768036,107082] 0 2024-02-15T18:31:38.134 INFO:tasks.workunit.client.1.smithi131.stdout:5/710: rmdir d18/d6d 39 2024-02-15T18:31:38.134 INFO:tasks.workunit.client.1.smithi131.stdout:5/711: fdatasync f17 0 2024-02-15T18:31:38.134 INFO:tasks.workunit.client.1.smithi131.stdout:5/712: readlink l4 0 2024-02-15T18:31:38.134 INFO:tasks.workunit.client.1.smithi131.stdout:5/713: readlink d18/d33/d73/de8/d85/dab/l6b 0 2024-02-15T18:31:38.134 INFO:tasks.workunit.client.1.smithi131.stdout:5/714: dread - d18/d83/d89/f8a zero size 2024-02-15T18:31:38.134 INFO:tasks.workunit.client.1.smithi131.stdout:5/715: dread - d18/d4e/fdb zero size 2024-02-15T18:31:38.136 INFO:tasks.workunit.client.1.smithi131.stdout:2/645: write dd/d10/d22/d2f/d38/f7c [3406096,93699] 0 2024-02-15T18:31:38.137 INFO:tasks.workunit.client.1.smithi131.stdout:5/716: creat d18/d33/d73/de8/d86/fea x:0 0 0 2024-02-15T18:31:38.137 INFO:tasks.workunit.client.1.smithi131.stdout:5/717: readlink d18/d33/d73/de8/d85/dab/l6b 0 2024-02-15T18:31:38.141 INFO:tasks.workunit.client.1.smithi131.stdout:2/646: unlink dd/d10/d22/fb7 0 2024-02-15T18:31:38.143 INFO:tasks.workunit.client.1.smithi131.stdout:4/817: dwrite d2/d2a/d47/d21/f3a [0,4194304] 0 2024-02-15T18:31:38.143 INFO:tasks.workunit.client.1.smithi131.stdout:4/818: write d2/d23/f132 [439922,111601] 0 2024-02-15T18:31:38.143 INFO:tasks.workunit.client.1.smithi131.stdout:4/819: read d2/d2a/d47/d21/dcd/dfb/d110/f9c [83519,42829] 0 2024-02-15T18:31:38.143 INFO:tasks.workunit.client.1.smithi131.stdout:5/718: mkdir d18/d83/d8b/dba/d7b/deb 0 2024-02-15T18:31:38.148 INFO:tasks.workunit.client.1.smithi131.stdout:2/647: rename dd/d1e/c4c to dd/d10/d22/d2f/cd8 0 2024-02-15T18:31:38.151 INFO:tasks.workunit.client.1.smithi131.stdout:4/820: getdents d2/d7/d96 0 2024-02-15T18:31:38.151 INFO:tasks.workunit.client.1.smithi131.stdout:4/821: write d2/d2a/d47/d21/dcd/dfb/f107 [562332,13498] 0 2024-02-15T18:31:38.152 INFO:tasks.workunit.client.1.smithi131.stdout:5/719: symlink d18/d83/d8b/dba/dda/lec 0 2024-02-15T18:31:38.152 INFO:tasks.workunit.client.1.smithi131.stdout:5/720: chown d18/d33/d73/de8 686 1 2024-02-15T18:31:38.153 INFO:tasks.workunit.client.1.smithi131.stdout:5/721: write d18/d33/d73/de8/d86/fc1 [2604395,38521] 0 2024-02-15T18:31:38.153 INFO:tasks.workunit.client.1.smithi131.stdout:5/722: write f6 [1781434,113648] 0 2024-02-15T18:31:38.153 INFO:tasks.workunit.client.1.smithi131.stdout:4/822: rmdir d2/d2a/d85 39 2024-02-15T18:31:38.157 INFO:tasks.workunit.client.1.smithi131.stdout:2/648: dread dd/d10/d22/da3/fc5 [0,4194304] 0 2024-02-15T18:31:38.159 INFO:tasks.workunit.client.1.smithi131.stdout:5/723: creat d18/d83/d8b/dba/dda/fed x:0 0 0 2024-02-15T18:31:38.160 INFO:tasks.workunit.client.1.smithi131.stdout:4/823: mkdir d2/d2a/d85/da3/dba/d118/d12d/d133 0 2024-02-15T18:31:38.161 INFO:tasks.workunit.client.1.smithi131.stdout:4/824: chown d2/d23/fe0 2749893 1 2024-02-15T18:31:38.163 INFO:tasks.workunit.client.1.smithi131.stdout:2/649: rename dd/d14/fd5 to dd/d10/db1/dbd/fd9 0 2024-02-15T18:31:38.163 INFO:tasks.workunit.client.1.smithi131.stdout:2/650: fsync f4 0 2024-02-15T18:31:38.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/724: fsync f6 0 2024-02-15T18:31:38.163 INFO:tasks.workunit.client.1.smithi131.stdout:4/825: creat d2/d2a/d85/da3/db4/de3/f134 x:0 0 0 2024-02-15T18:31:38.165 INFO:tasks.workunit.client.1.smithi131.stdout:2/651: rename dd/d10/d22/d2f/d38/d74/d2e/d6a/l5b to dd/d10/d22/d2a/d48/lda 0 2024-02-15T18:31:38.167 INFO:tasks.workunit.client.1.smithi131.stdout:5/725: mkdir d18/d83/d8b/dba/d7b/dee 0 2024-02-15T18:31:38.173 INFO:tasks.workunit.client.1.smithi131.stdout:4/826: rename d2/d23/f7f to d2/d2a/d47/d21/dcd/dfb/d110/d53/f135 0 2024-02-15T18:31:38.173 INFO:tasks.workunit.client.1.smithi131.stdout:4/827: chown d2/d2a/d47/d21/dcd/dfb/d110/d2e/d5f/d123/c11e 5270140 1 2024-02-15T18:31:38.173 INFO:tasks.workunit.client.1.smithi131.stdout:4/828: dread - d2/d2a/d47/d21/d9e/fbe zero size 2024-02-15T18:31:38.173 INFO:tasks.workunit.client.1.smithi131.stdout:2/652: link dd/d1e/fb2 dd/fdb 0 2024-02-15T18:31:38.173 INFO:tasks.workunit.client.1.smithi131.stdout:2/653: dread - dd/d10/d22/d2f/d38/d74/fa5 zero size 2024-02-15T18:31:38.173 INFO:tasks.workunit.client.1.smithi131.stdout:2/654: truncate dd/f6f 2928972 0 2024-02-15T18:31:38.173 INFO:tasks.workunit.client.1.smithi131.stdout:2/655: fdatasync dd/f29 0 2024-02-15T18:31:38.173 INFO:tasks.workunit.client.1.smithi131.stdout:4/829: dread d2/d2a/d47/f19 [0,4194304] 0 2024-02-15T18:31:38.181 INFO:tasks.workunit.client.1.smithi131.stdout:5/726: truncate d18/d20/f60 264976 0 2024-02-15T18:31:38.181 INFO:tasks.workunit.client.1.smithi131.stdout:5/727: dread - d18/d6d/d9c/fc6 zero size 2024-02-15T18:31:38.183 INFO:tasks.workunit.client.1.smithi131.stdout:4/830: link d2/d2a/d85/fb7 d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/d7a/d92/f136 0 2024-02-15T18:31:38.185 INFO:tasks.workunit.client.1.smithi131.stdout:4/831: link d2/d7/fc d2/d7/f137 0 2024-02-15T18:31:38.189 INFO:tasks.workunit.client.1.smithi131.stdout:2/656: dwrite dd/d10/d22/d2f/d38/d74/d2e/f67 [0,4194304] 0 2024-02-15T18:31:38.190 INFO:tasks.workunit.client.1.smithi131.stdout:4/832: mknod d2/d2a/d47/d16/d5a/dd2/c138 0 2024-02-15T18:31:38.194 INFO:tasks.workunit.client.1.smithi131.stdout:2/657: dread dd/d10/f19 [4194304,4194304] 0 2024-02-15T18:31:38.200 INFO:tasks.workunit.client.1.smithi131.stdout:4/833: mkdir d2/d2a/d85/d139 0 2024-02-15T18:31:38.205 INFO:tasks.workunit.client.1.smithi131.stdout:2/658: creat dd/d10/d22/d2a/fdc x:0 0 0 2024-02-15T18:31:38.205 INFO:tasks.workunit.client.1.smithi131.stdout:8/725: sync 2024-02-15T18:31:38.205 INFO:tasks.workunit.client.1.smithi131.stdout:6/596: sync 2024-02-15T18:31:38.207 INFO:tasks.workunit.client.1.smithi131.stdout:6/597: write d2/d7/d48/f44 [743422,13930] 0 2024-02-15T18:31:38.207 INFO:tasks.workunit.client.1.smithi131.stdout:4/834: truncate d2/d2a/d85/da3/fa7 2350942 0 2024-02-15T18:31:38.207 INFO:tasks.workunit.client.1.smithi131.stdout:4/835: write d2/d2a/d47/d21/dcd/dfb/d110/d2e/f64 [3808561,77934] 0 2024-02-15T18:31:38.208 INFO:tasks.workunit.client.1.smithi131.stdout:4/836: fsync d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/f7b 0 2024-02-15T18:31:38.209 INFO:tasks.workunit.client.1.smithi131.stdout:2/659: mkdir dd/d14/d1f/d65/d81/ddd 0 2024-02-15T18:31:38.209 INFO:tasks.workunit.client.1.smithi131.stdout:2/660: chown dd/d1e/cd7 3349022 1 2024-02-15T18:31:38.212 INFO:tasks.workunit.client.1.smithi131.stdout:8/726: mknod d22/d26/d3f/d47/d8e/cfb 0 2024-02-15T18:31:38.212 INFO:tasks.workunit.client.1.smithi131.stdout:8/727: chown d22/d2e/d5e/f75 11011765 1 2024-02-15T18:31:38.216 INFO:tasks.workunit.client.1.smithi131.stdout:6/598: rename d2/d7 to d2/d6d/db9 0 2024-02-15T18:31:38.219 INFO:tasks.workunit.client.1.smithi131.stdout:2/661: creat dd/d10/db1/fde x:0 0 0 2024-02-15T18:31:38.220 INFO:tasks.workunit.client.1.smithi131.stdout:6/599: creat d2/d6d/db9/d12/d4d/fba x:0 0 0 2024-02-15T18:31:38.222 INFO:tasks.workunit.client.1.smithi131.stdout:2/662: unlink f4 0 2024-02-15T18:31:38.222 INFO:tasks.workunit.client.1.smithi131.stdout:6/600: getdents d2/d6d/db9/d48/d40 0 2024-02-15T18:31:38.224 INFO:tasks.workunit.client.1.smithi131.stdout:2/663: mknod dd/d14/d1f/d65/d81/cdf 0 2024-02-15T18:31:38.224 INFO:tasks.workunit.client.1.smithi131.stdout:2/664: chown dd/d10/d22/d2f/d38/l80 6 1 2024-02-15T18:31:38.225 INFO:tasks.workunit.client.1.smithi131.stdout:6/601: mkdir d2/d6d/db9/d48/d7f/db6/dbb 0 2024-02-15T18:31:38.236 INFO:tasks.workunit.client.1.smithi131.stdout:2/665: dread dd/f18 [0,4194304] 0 2024-02-15T18:31:38.237 INFO:tasks.workunit.client.1.smithi131.stdout:4/837: dwrite d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/fc8 [0,4194304] 0 2024-02-15T18:31:38.237 INFO:tasks.workunit.client.1.smithi131.stdout:4/838: truncate d2/d2a/d47/d21/dcd/dfb/d110/d53/f135 1014045 0 2024-02-15T18:31:38.237 INFO:tasks.workunit.client.1.smithi131.stdout:8/728: dwrite d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f99 [0,4194304] 0 2024-02-15T18:31:38.238 INFO:tasks.workunit.client.1.smithi131.stdout:4/839: read d2/d2a/d47/d21/dcd/dfb/d110/f52 [3282146,96015] 0 2024-02-15T18:31:38.238 INFO:tasks.workunit.client.1.smithi131.stdout:4/840: chown d2/d2a/d47/d16/d5a 356 1 2024-02-15T18:31:38.244 INFO:tasks.workunit.client.1.smithi131.stdout:2/666: dread dd/d14/d1f/f90 [0,4194304] 0 2024-02-15T18:31:38.245 INFO:tasks.workunit.client.1.smithi131.stdout:6/602: rename d2/d6d/db9/d48/d7f to d2/dc/d1f/dbc 0 2024-02-15T18:31:38.245 INFO:tasks.workunit.client.1.smithi131.stdout:6/603: fsync d2/d2b/d6e/f7c 0 2024-02-15T18:31:38.249 INFO:tasks.workunit.client.1.smithi131.stdout:8/729: link d22/d2e/lc4 d22/d26/d3f/d47/d57/dc1/lfc 0 2024-02-15T18:31:38.251 INFO:tasks.workunit.client.1.smithi131.stdout:4/841: symlink d2/d7/d1c/l13a 0 2024-02-15T18:31:38.251 INFO:tasks.workunit.client.1.smithi131.stdout:4/842: stat d2/d2a/d47/l131 0 2024-02-15T18:31:38.258 INFO:tasks.workunit.client.1.smithi131.stdout:4/843: rmdir d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/d7a 39 2024-02-15T18:31:38.263 INFO:tasks.workunit.client.1.smithi131.stdout:4/844: creat d2/d2a/d47/d21/dcd/dfb/d110/d2e/dd0/f13b x:0 0 0 2024-02-15T18:31:38.263 INFO:tasks.workunit.client.1.smithi131.stdout:4/845: write d2/d7/f119 [535799,57726] 0 2024-02-15T18:31:38.265 INFO:tasks.workunit.client.1.smithi131.stdout:8/730: dread d22/d26/d3f/d47/d48/d84/daf/fb1 [0,4194304] 0 2024-02-15T18:31:38.266 INFO:tasks.workunit.client.1.smithi131.stdout:4/846: truncate d2/d2a/d68/f6b 2263504 0 2024-02-15T18:31:38.266 INFO:tasks.workunit.client.1.smithi131.stdout:4/847: fdatasync d2/d7/d96/faf 0 2024-02-15T18:31:38.269 INFO:tasks.workunit.client.1.smithi131.stdout:8/731: mknod d22/d26/d3f/d47/d48/cfd 0 2024-02-15T18:31:38.269 INFO:tasks.workunit.client.1.smithi131.stdout:8/732: chown d22/d26/d3f/d47/d57/d9f 54946619 1 2024-02-15T18:31:38.270 INFO:tasks.workunit.client.1.smithi131.stdout:2/667: dwrite dd/d10/d22/d2f/f40 [0,4194304] 0 2024-02-15T18:31:38.271 INFO:tasks.workunit.client.1.smithi131.stdout:6/604: dwrite d2/d2b/d6e/f7c [0,4194304] 0 2024-02-15T18:31:38.273 INFO:tasks.workunit.client.1.smithi131.stdout:4/848: rename d2/d7/d1c/d94/f83 to d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/f13c 0 2024-02-15T18:31:38.273 INFO:tasks.workunit.client.1.smithi131.stdout:4/849: stat d2/d2a/d47/d21/dcd/dfb/f107 0 2024-02-15T18:31:38.274 INFO:tasks.workunit.client.1.smithi131.stdout:4/850: write d2/d2a/d47/d21/dcd/dfb/d110/d2e/f64 [550753,85788] 0 2024-02-15T18:31:38.274 INFO:tasks.workunit.client.1.smithi131.stdout:4/851: dread - d2/d2a/d85/da3/dbf/ddc/d114/f129 zero size 2024-02-15T18:31:38.281 INFO:tasks.workunit.client.1.smithi131.stdout:2/668: write dd/d10/d22/d2a/fdc [548521,115638] 0 2024-02-15T18:31:38.285 INFO:tasks.workunit.client.1.smithi131.stdout:8/733: dwrite d22/f42 [0,4194304] 0 2024-02-15T18:31:38.288 INFO:tasks.workunit.client.1.smithi131.stdout:4/852: rename d2/d2a/d85/da3/db4/de3 to d2/d2a/d47/d21/d9e/d111/d13d 0 2024-02-15T18:31:38.290 INFO:tasks.workunit.client.1.smithi131.stdout:4/853: write d2/f4 [4389982,19103] 0 2024-02-15T18:31:38.290 INFO:tasks.workunit.client.1.smithi131.stdout:4/854: fdatasync d2/d2a/d47/d21/f3e 0 2024-02-15T18:31:38.290 INFO:tasks.workunit.client.1.smithi131.stdout:4/855: chown d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/f69 777 1 2024-02-15T18:31:38.290 INFO:tasks.workunit.client.1.smithi131.stdout:4/856: write d2/d2a/d76/ddb/df1/f12f [232969,51043] 0 2024-02-15T18:31:38.291 INFO:tasks.workunit.client.1.smithi131.stdout:2/669: stat dd/d14/d1f/d65/d77/l98 0 2024-02-15T18:31:38.291 INFO:tasks.workunit.client.1.smithi131.stdout:2/670: getdents dd/d14/d1f/d65/dd1 0 2024-02-15T18:31:38.304 INFO:tasks.workunit.client.1.smithi131.stdout:4/857: dwrite d2/d23/fe0 [0,4194304] 0 2024-02-15T18:31:38.307 INFO:tasks.workunit.client.1.smithi131.stdout:8/734: creat d22/d26/d3f/ffe x:0 0 0 2024-02-15T18:31:38.308 INFO:tasks.workunit.client.1.smithi131.stdout:2/671: symlink dd/d10/d22/d2f/d38/d74/d2e/d66/le0 0 2024-02-15T18:31:38.308 INFO:tasks.workunit.client.1.smithi131.stdout:8/735: write d22/d26/f2d [614993,43070] 0 2024-02-15T18:31:38.308 INFO:tasks.workunit.client.1.smithi131.stdout:8/736: fdatasync d22/d26/d3f/fad 0 2024-02-15T18:31:38.316 INFO:tasks.workunit.client.1.smithi131.stdout:4/858: link d2/d23/f72 d2/d7/d1c/d84/db8/d101/f13e 0 2024-02-15T18:31:38.316 INFO:tasks.workunit.client.1.smithi131.stdout:4/859: fdatasync d2/d2a/d47/d21/dcd/dfb/d110/d2e/f126 0 2024-02-15T18:31:38.316 INFO:tasks.workunit.client.1.smithi131.stdout:6/605: dwrite d2/dc/d1f/f26 [0,4194304] 0 2024-02-15T18:31:38.319 INFO:tasks.workunit.client.1.smithi131.stdout:8/737: rmdir d22/d26/d3f/d47/d48/d5f/d70/dc7/dea 0 2024-02-15T18:31:38.328 INFO:tasks.workunit.client.1.smithi131.stdout:9/805: sync 2024-02-15T18:31:38.328 INFO:tasks.workunit.client.1.smithi131.stdout:1/898: sync 2024-02-15T18:31:38.328 INFO:tasks.workunit.client.1.smithi131.stdout:1/899: truncate d0/d1/d24/f110 1058725 0 2024-02-15T18:31:38.337 INFO:tasks.workunit.client.1.smithi131.stdout:9/806: read d4/dc/d17/d19/f5a [201705,42868] 0 2024-02-15T18:31:38.343 INFO:tasks.workunit.client.1.smithi131.stdout:1/900: mkdir d0/d1/d44/d135/d13a 0 2024-02-15T18:31:38.348 INFO:tasks.workunit.client.1.smithi131.stdout:9/807: creat d4/dc3/f105 x:0 0 0 2024-02-15T18:31:38.348 INFO:tasks.workunit.client.1.smithi131.stdout:9/808: write d4/dc/d17/d19/fff [4463065,129562] 0 2024-02-15T18:31:38.348 INFO:tasks.workunit.client.1.smithi131.stdout:9/809: chown d4/dc/de/d1e/d1f/d51/ld5 218080 1 2024-02-15T18:31:38.349 INFO:tasks.workunit.client.1.smithi131.stdout:6/606: dread d2/d2b/d6e/f8a [0,4194304] 0 2024-02-15T18:31:38.350 INFO:tasks.workunit.client.1.smithi131.stdout:1/901: mkdir d0/d2/db/de6/d138/d72/d78/df2/d13b 0 2024-02-15T18:31:38.351 INFO:tasks.workunit.client.1.smithi131.stdout:9/810: dread d4/dc/de/d1e/d1f/d101/fda [0,4194304] 0 2024-02-15T18:31:38.351 INFO:tasks.workunit.client.1.smithi131.stdout:9/811: write d4/dc/d17/d19/d84/ff0 [184566,124082] 0 2024-02-15T18:31:38.351 INFO:tasks.workunit.client.1.smithi131.stdout:9/812: fsync d4/dc/de/d1e/d1f/d101/d5b/f92 0 2024-02-15T18:31:38.351 INFO:tasks.workunit.client.1.smithi131.stdout:9/813: chown d4/dc/f2d 30421 1 2024-02-15T18:31:38.353 INFO:tasks.workunit.client.1.smithi131.stdout:6/607: creat d2/d6d/db9/d48/d40/fbd x:0 0 0 2024-02-15T18:31:38.355 INFO:tasks.workunit.client.1.smithi131.stdout:1/902: unlink d0/d2/f5 0 2024-02-15T18:31:38.356 INFO:tasks.workunit.client.1.smithi131.stdout:1/903: chown d0/d1/f38 130491022 1 2024-02-15T18:31:38.356 INFO:tasks.workunit.client.1.smithi131.stdout:1/904: chown d0/d1/d16/d30/fa2 2757260 1 2024-02-15T18:31:38.358 INFO:tasks.workunit.client.1.smithi131.stdout:9/814: creat d4/dc/df7/f106 x:0 0 0 2024-02-15T18:31:38.360 INFO:tasks.workunit.client.1.smithi131.stdout:6/608: rmdir d2/d2b/da5 0 2024-02-15T18:31:38.360 INFO:tasks.workunit.client.1.smithi131.stdout:9/815: getdents d4/dc/d17/d19/d32/d91 0 2024-02-15T18:31:38.373 INFO:tasks.workunit.client.1.smithi131.stdout:9/816: dread d4/d78/fcd [0,4194304] 0 2024-02-15T18:31:38.373 INFO:tasks.workunit.client.1.smithi131.stdout:9/817: chown d4/d78/cbd 3128 1 2024-02-15T18:31:38.375 INFO:tasks.workunit.client.1.smithi131.stdout:9/818: write d4/dc/de/d1e/f37 [2879383,96541] 0 2024-02-15T18:31:38.375 INFO:tasks.workunit.client.1.smithi131.stdout:9/819: stat d4/dc/de/d1e/d1f/d101/d5b/f6b 0 2024-02-15T18:31:38.375 INFO:tasks.workunit.client.1.smithi131.stdout:9/820: chown d4/dc/de/d1e/d1f/d101/d5b/f92 0 1 2024-02-15T18:31:38.375 INFO:tasks.workunit.client.1.smithi131.stdout:9/821: dread - d4/dc/de/d1e/d1f/d51/d5d/f103 zero size 2024-02-15T18:31:38.380 INFO:tasks.workunit.client.1.smithi131.stdout:1/905: dwrite d0/d1/d24/f110 [0,4194304] 0 2024-02-15T18:31:38.381 INFO:tasks.workunit.client.1.smithi131.stdout:9/822: mknod d4/dc/de/d1e/d1f/d2c/dc0/c107 0 2024-02-15T18:31:38.392 INFO:tasks.workunit.client.1.smithi131.stdout:1/906: creat d0/d2/d4/da/f13c x:0 0 0 2024-02-15T18:31:38.392 INFO:tasks.workunit.client.1.smithi131.stdout:1/907: truncate d0/d2/d4/da/f121 1524655 0 2024-02-15T18:31:38.396 INFO:tasks.workunit.client.1.smithi131.stdout:9/823: rename d4/dc/de/d1e/d1f/d101/d72/c90 to d4/dc/d17/db0/dbc/c108 0 2024-02-15T18:31:38.398 INFO:tasks.workunit.client.1.smithi131.stdout:8/738: dwrite d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f49 [0,4194304] 0 2024-02-15T18:31:38.398 INFO:tasks.workunit.client.1.smithi131.stdout:1/908: creat d0/d1/d44/d59/f13d x:0 0 0 2024-02-15T18:31:38.398 INFO:tasks.workunit.client.1.smithi131.stdout:1/909: chown d0/d1/d16/d6b/de5/f11e 60200 1 2024-02-15T18:31:38.400 INFO:tasks.workunit.client.1.smithi131.stdout:8/739: creat d22/d26/d3f/d47/d48/d84/fff x:0 0 0 2024-02-15T18:31:38.401 INFO:tasks.workunit.client.1.smithi131.stdout:8/740: read f1d [382725,125003] 0 2024-02-15T18:31:38.401 INFO:tasks.workunit.client.1.smithi131.stdout:8/741: write d22/d26/f76 [586124,11491] 0 2024-02-15T18:31:38.402 INFO:tasks.workunit.client.1.smithi131.stdout:1/910: symlink d0/d1/d44/l13e 0 2024-02-15T18:31:38.403 INFO:tasks.workunit.client.1.smithi131.stdout:8/742: dread d22/d26/f35 [0,4194304] 0 2024-02-15T18:31:38.407 INFO:tasks.workunit.client.1.smithi131.stdout:1/911: getdents d0/d2/d31/d3d/dd3/d105 0 2024-02-15T18:31:38.409 INFO:tasks.workunit.client.1.smithi131.stdout:8/743: unlink l18 0 2024-02-15T18:31:38.411 INFO:tasks.workunit.client.1.smithi131.stdout:6/609: dwrite d2/d2b/d6e/f8a [0,4194304] 0 2024-02-15T18:31:38.413 INFO:tasks.workunit.client.1.smithi131.stdout:1/912: mknod d0/d1/df3/c13f 0 2024-02-15T18:31:38.413 INFO:tasks.workunit.client.1.smithi131.stdout:1/913: write d0/d1/d16/d30/f91 [1299679,89587] 0 2024-02-15T18:31:38.423 INFO:tasks.workunit.client.1.smithi131.stdout:8/744: dread d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f49 [0,4194304] 0 2024-02-15T18:31:38.428 INFO:tasks.workunit.client.1.smithi131.stdout:8/745: creat d22/d26/d3f/d86/f100 x:0 0 0 2024-02-15T18:31:38.428 INFO:tasks.workunit.client.1.smithi131.stdout:8/746: dread d22/f23 [4194304,4194304] 0 2024-02-15T18:31:38.431 INFO:tasks.workunit.client.1.smithi131.stdout:8/747: rename d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f49 to d22/d26/d3f/d47/d57/dc1/f101 0 2024-02-15T18:31:38.436 INFO:tasks.workunit.client.1.smithi131.stdout:1/914: dwrite d0/d2/dd6/f122 [0,4194304] 0 2024-02-15T18:31:38.442 INFO:tasks.workunit.client.1.smithi131.stdout:6/610: dwrite d2/d6d/db9/d12/d4d/fba [0,4194304] 0 2024-02-15T18:31:38.443 INFO:tasks.workunit.client.1.smithi131.stdout:3/854: sync 2024-02-15T18:31:38.443 INFO:tasks.workunit.client.1.smithi131.stdout:7/745: sync 2024-02-15T18:31:38.443 INFO:tasks.workunit.client.1.smithi131.stdout:0/658: sync 2024-02-15T18:31:38.444 INFO:tasks.workunit.client.1.smithi131.stdout:5/728: sync 2024-02-15T18:31:38.444 INFO:tasks.workunit.client.1.smithi131.stdout:5/729: chown d18/d33/d73/de8/d86/lc8 455354404 1 2024-02-15T18:31:38.448 INFO:tasks.workunit.client.1.smithi131.stdout:1/915: dread d0/d2/db/de6/d138/f4c [0,4194304] 0 2024-02-15T18:31:38.449 INFO:tasks.workunit.client.1.smithi131.stdout:7/746: truncate d0/f14 221367 0 2024-02-15T18:31:38.449 INFO:tasks.workunit.client.1.smithi131.stdout:3/855: getdents d2/d22/d5e/d79/d9d 0 2024-02-15T18:31:38.451 INFO:tasks.workunit.client.1.smithi131.stdout:8/748: dwrite d22/d26/d3f/d47/d48/d84/f98 [0,4194304] 0 2024-02-15T18:31:38.451 INFO:tasks.workunit.client.1.smithi131.stdout:8/749: chown d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7 972 1 2024-02-15T18:31:38.451 INFO:tasks.workunit.client.1.smithi131.stdout:5/730: mkdir d18/d33/d73/de8/d85/def 0 2024-02-15T18:31:38.451 INFO:tasks.workunit.client.1.smithi131.stdout:5/731: truncate d18/d6d/d9c/fc6 289359 0 2024-02-15T18:31:38.455 INFO:tasks.workunit.client.1.smithi131.stdout:1/916: creat d0/d1/d16/d113/f140 x:0 0 0 2024-02-15T18:31:38.456 INFO:tasks.workunit.client.1.smithi131.stdout:7/747: getdents d0/db8/dbe 0 2024-02-15T18:31:38.460 INFO:tasks.workunit.client.1.smithi131.stdout:6/611: dread d2/dc/d1f/f96 [0,4194304] 0 2024-02-15T18:31:38.460 INFO:tasks.workunit.client.1.smithi131.stdout:6/612: dread - d2/dc/d1f/f93 zero size 2024-02-15T18:31:38.461 INFO:tasks.workunit.client.1.smithi131.stdout:3/856: dread d2/d22/d29/db/d23/d2a/f2d [0,4194304] 0 2024-02-15T18:31:38.463 INFO:tasks.workunit.client.1.smithi131.stdout:0/659: dwrite d5/d15/d1f/f36 [0,4194304] 0 2024-02-15T18:31:38.466 INFO:tasks.workunit.client.1.smithi131.stdout:8/750: creat d22/d26/d3f/d47/d48/d5f/d70/db0/f102 x:0 0 0 2024-02-15T18:31:38.466 INFO:tasks.workunit.client.1.smithi131.stdout:8/751: stat d22/d26/d3f/d47/d48/d5f/cee 0 2024-02-15T18:31:38.466 INFO:tasks.workunit.client.1.smithi131.stdout:8/752: stat d22/d26/d3f/d47/d48 0 2024-02-15T18:31:38.466 INFO:tasks.workunit.client.1.smithi131.stdout:5/732: creat d18/d83/d8b/dba/ff0 x:0 0 0 2024-02-15T18:31:38.467 INFO:tasks.workunit.client.1.smithi131.stdout:8/753: write d22/d26/f82 [194263,11523] 0 2024-02-15T18:31:38.468 INFO:tasks.workunit.client.1.smithi131.stdout:1/917: symlink d0/d1/d44/ded/l141 0 2024-02-15T18:31:38.468 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:37.450440+0000 mgr.smithi033.apxevf (mgr.14626) 7 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 46 MiB/s rd, 87 MiB/s wr, 174 op/s 2024-02-15T18:31:38.470 INFO:tasks.workunit.client.1.smithi131.stdout:7/748: symlink d0/d17/d3a/d3d/d79/db4/dd7/leb 0 2024-02-15T18:31:38.471 INFO:tasks.workunit.client.1.smithi131.stdout:7/749: dread - d0/d17/d3a/d3d/d79/db4/f9e zero size 2024-02-15T18:31:38.471 INFO:tasks.workunit.client.1.smithi131.stdout:7/750: dread - d0/d17/d3a/d3d/d79/db4/f9e zero size 2024-02-15T18:31:38.471 INFO:tasks.workunit.client.1.smithi131.stdout:6/613: mkdir d2/d6d/dbe 0 2024-02-15T18:31:38.473 INFO:tasks.workunit.client.1.smithi131.stdout:3/857: creat d2/d22/d29/f111 x:0 0 0 2024-02-15T18:31:38.475 INFO:tasks.workunit.client.1.smithi131.stdout:3/858: dread d2/d22/d29/db/d1a/da4/fb9 [0,4194304] 0 2024-02-15T18:31:38.480 INFO:tasks.workunit.client.1.smithi131.stdout:0/660: mkdir d5/d9/d77/da8/dad/dd7 0 2024-02-15T18:31:38.480 INFO:tasks.workunit.client.1.smithi131.stdout:5/733: creat d18/d83/d8b/dba/dda/de9/ff1 x:0 0 0 2024-02-15T18:31:38.480 INFO:tasks.workunit.client.1.smithi131.stdout:5/734: stat d18/d6d/fb1 0 2024-02-15T18:31:38.481 INFO:tasks.workunit.client.1.smithi131.stdout:8/754: rmdir d22/d26/d3f/d47/d48 39 2024-02-15T18:31:38.484 INFO:tasks.workunit.client.1.smithi131.stdout:1/918: symlink d0/d1/d44/ded/l142 0 2024-02-15T18:31:38.484 INFO:tasks.workunit.client.1.smithi131.stdout:1/919: chown d0/d2/d4/d5d/f67 92761234 1 2024-02-15T18:31:38.485 INFO:tasks.workunit.client.1.smithi131.stdout:7/751: getdents d0/d17/d3a 0 2024-02-15T18:31:38.487 INFO:tasks.workunit.client.1.smithi131.stdout:6/614: mknod d2/d6d/db9/cbf 0 2024-02-15T18:31:38.491 INFO:tasks.workunit.client.1.smithi131.stdout:0/661: rename d5/d9/d11/d3e/db8/cb9 to d5/d9/d77/da8/dad/cd8 0 2024-02-15T18:31:38.491 INFO:tasks.workunit.client.1.smithi131.stdout:1/920: creat d0/d2/db/de6/db3/dc2/f143 x:0 0 0 2024-02-15T18:31:38.491 INFO:tasks.workunit.client.1.smithi131.stdout:1/921: truncate d0/d1/d16/db7/fca 521703 0 2024-02-15T18:31:38.491 INFO:tasks.workunit.client.1.smithi131.stdout:1/922: getdents d0/d1/d16/dd1 0 2024-02-15T18:31:38.491 INFO:tasks.workunit.client.1.smithi131.stdout:7/752: symlink d0/d17/d3a/lec 0 2024-02-15T18:31:38.494 INFO:tasks.workunit.client.1.smithi131.stdout:6/615: write d2/f28 [1363052,76169] 0 2024-02-15T18:31:38.501 INFO:tasks.workunit.client.1.smithi131.stdout:3/859: dwrite d2/d22/fcd [0,4194304] 0 2024-02-15T18:31:38.501 INFO:tasks.workunit.client.1.smithi131.stdout:8/755: dread fb [0,4194304] 0 2024-02-15T18:31:38.501 INFO:tasks.workunit.client.1.smithi131.stdout:8/756: chown d22/d26/f35 584878 1 2024-02-15T18:31:38.501 INFO:tasks.workunit.client.1.smithi131.stdout:8/757: fsync d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f59 0 2024-02-15T18:31:38.502 INFO:tasks.workunit.client.1.smithi131.stdout:1/923: creat d0/d2/f144 x:0 0 0 2024-02-15T18:31:38.502 INFO:tasks.workunit.client.1.smithi131.stdout:1/924: fsync d0/d1/d24/d108/ff1 0 2024-02-15T18:31:38.504 INFO:tasks.workunit.client.1.smithi131.stdout:5/735: dwrite d18/d20/f2f [0,4194304] 0 2024-02-15T18:31:38.504 INFO:tasks.workunit.client.1.smithi131.stdout:5/736: fdatasync d18/d83/d8b/dba/dda/fed 0 2024-02-15T18:31:38.504 INFO:tasks.workunit.client.1.smithi131.stdout:6/616: mkdir d2/dc/d27/d74/d75/dc0 0 2024-02-15T18:31:38.508 INFO:tasks.workunit.client.1.smithi131.stdout:7/753: dread d0/d17/d3a/d3d/d79/d89/f95 [0,4194304] 0 2024-02-15T18:31:38.508 INFO:tasks.workunit.client.1.smithi131.stdout:1/925: truncate d0/d2/d4/d41/d5a/f96 2641940 0 2024-02-15T18:31:38.508 INFO:tasks.workunit.client.1.smithi131.stdout:1/926: readlink d0/d1/d24/le9 0 2024-02-15T18:31:38.509 INFO:tasks.workunit.client.1.smithi131.stdout:1/927: write d0/d1/d16/d30/fa2 [4688808,122223] 0 2024-02-15T18:31:38.512 INFO:tasks.workunit.client.1.smithi131.stdout:0/662: rename d5/d9 to d5/d2f/d4b/dd9 0 2024-02-15T18:31:38.513 INFO:tasks.workunit.client.1.smithi131.stdout:0/663: readlink d5/d2f/d4b/d82/d9f/la5 0 2024-02-15T18:31:38.514 INFO:tasks.workunit.client.1.smithi131.stdout:5/737: symlink d18/d33/d73/de8/d85/lf2 0 2024-02-15T18:31:38.516 INFO:tasks.workunit.client.1.smithi131.stdout:3/860: symlink d2/d22/d29/db/d1a/da4/d70/l112 0 2024-02-15T18:31:38.520 INFO:tasks.workunit.client.1.smithi131.stdout:7/754: creat d0/d17/d3a/d3d/d79/d89/fed x:0 0 0 2024-02-15T18:31:38.520 INFO:tasks.workunit.client.1.smithi131.stdout:7/755: stat d0/d17/d36/l87 0 2024-02-15T18:31:38.522 INFO:tasks.workunit.client.1.smithi131.stdout:1/928: creat d0/d2/db/de6/d138/d72/d78/f145 x:0 0 0 2024-02-15T18:31:38.522 INFO:tasks.workunit.client.1.smithi131.stdout:8/758: dwrite d22/f6b [0,4194304] 0 2024-02-15T18:31:38.522 INFO:tasks.workunit.client.1.smithi131.stdout:7/756: write d0/d17/d3a/d3d/fa6 [1586752,76580] 0 2024-02-15T18:31:38.526 INFO:tasks.workunit.client.1.smithi131.stdout:0/664: creat d5/d15/fda x:0 0 0 2024-02-15T18:31:38.528 INFO:tasks.workunit.client.1.smithi131.stdout:0/665: read d5/fc0 [2297077,119974] 0 2024-02-15T18:31:38.528 INFO:tasks.workunit.client.1.smithi131.stdout:5/738: symlink d18/d83/d8b/dba/d7b/db8/lf3 0 2024-02-15T18:31:38.530 INFO:tasks.workunit.client.1.smithi131.stdout:0/666: dread d5/d2f/d4b/dd9/d10/d73/f99 [0,4194304] 0 2024-02-15T18:31:38.532 INFO:tasks.workunit.client.1.smithi131.stdout:3/861: truncate d2/d22/d42/fa8 2010730 0 2024-02-15T18:31:38.532 INFO:tasks.workunit.client.1.smithi131.stdout:3/862: readlink d2/d22/d29/d20/lbf 0 2024-02-15T18:31:38.532 INFO:tasks.workunit.client.1.smithi131.stdout:3/863: write d2/d22/d29/db/d1a/dc3/ff9 [909612,60954] 0 2024-02-15T18:31:38.533 INFO:tasks.workunit.client.1.smithi131.stdout:3/864: write d2/d22/d29/d20/d86/fcc [2277844,28790] 0 2024-02-15T18:31:38.534 INFO:tasks.workunit.client.1.smithi131.stdout:1/929: mkdir d0/d2/db/de6/d138/d146 0 2024-02-15T18:31:38.535 INFO:tasks.workunit.client.1.smithi131.stdout:1/930: chown d0/d1/d16/db7/c11d 0 1 2024-02-15T18:31:38.535 INFO:tasks.workunit.client.1.smithi131.stdout:1/931: write d0/d2/db/de6/d138/d72/fd8 [4995385,7967] 0 2024-02-15T18:31:38.536 INFO:tasks.workunit.client.1.smithi131.stdout:8/759: rmdir d22/d26/d3f/d47/d48/d5f/d70/db0 39 2024-02-15T18:31:38.538 INFO:tasks.workunit.client.1.smithi131.stdout:7/757: link d0/d17/f3c d0/fee 0 2024-02-15T18:31:38.539 INFO:tasks.workunit.client.1.smithi131.stdout:5/739: mknod d18/d83/d8b/dba/d7b/dee/cf4 0 2024-02-15T18:31:38.539 INFO:tasks.workunit.client.1.smithi131.stdout:5/740: stat d18/d83/d8b/dba/f55 0 2024-02-15T18:31:38.539 INFO:tasks.workunit.client.1.smithi131.stdout:5/741: dread - d18/d83/d8b/dba/dda/fed zero size 2024-02-15T18:31:38.545 INFO:tasks.workunit.client.1.smithi131.stdout:1/932: rename d0/d1/d44/d59/d42/dcf/c69 to d0/d2/db/de6/d138/d72/d78/df2/d13b/c147 0 2024-02-15T18:31:38.547 INFO:tasks.workunit.client.1.smithi131.stdout:8/760: creat d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/da2/f103 x:0 0 0 2024-02-15T18:31:38.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:37.450440+0000 mgr.smithi033.apxevf (mgr.14626) 7 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 1.5 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 46 MiB/s rd, 87 MiB/s wr, 174 op/s 2024-02-15T18:31:38.549 INFO:tasks.workunit.client.1.smithi131.stdout:8/761: dread d22/d26/d3f/fad [0,4194304] 0 2024-02-15T18:31:38.552 INFO:tasks.workunit.client.1.smithi131.stdout:5/742: mkdir d18/d33/dd6/df5 0 2024-02-15T18:31:38.552 INFO:tasks.workunit.client.1.smithi131.stdout:5/743: chown d18/d83/d8b/dba/l36 1 1 2024-02-15T18:31:38.557 INFO:tasks.workunit.client.1.smithi131.stdout:3/865: mkdir d2/d22/d29/db/d1a/da4/d113 0 2024-02-15T18:31:38.557 INFO:tasks.workunit.client.1.smithi131.stdout:3/866: readlink d2/d22/d29/d9e/leb 0 2024-02-15T18:31:38.559 INFO:tasks.workunit.client.1.smithi131.stdout:7/758: write d0/d17/d3a/f54 [3839920,106109] 0 2024-02-15T18:31:38.560 INFO:tasks.workunit.client.1.smithi131.stdout:1/933: mkdir d0/d2/db/de6/d138/d72/d78/df2/d13b/d148 0 2024-02-15T18:31:38.561 INFO:tasks.workunit.client.1.smithi131.stdout:5/744: symlink d18/d33/d73/de8/d85/def/lf6 0 2024-02-15T18:31:38.565 INFO:tasks.workunit.client.1.smithi131.stdout:7/759: rename d0/d17/d36/f72 to d0/d17/d36/fef 0 2024-02-15T18:31:38.565 INFO:tasks.workunit.client.1.smithi131.stdout:7/760: dread - d0/f57 zero size 2024-02-15T18:31:38.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/934: creat d0/d1/d16/f149 x:0 0 0 2024-02-15T18:31:38.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/762: dwrite d22/f23 [4194304,4194304] 0 2024-02-15T18:31:38.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/763: write d22/d26/d3f/fad [1463368,107177] 0 2024-02-15T18:31:38.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/764: write d22/d26/d3f/d47/fae [4519393,20496] 0 2024-02-15T18:31:38.567 INFO:tasks.workunit.client.1.smithi131.stdout:7/761: chown d0/d17/d3a/l3e 550942973 1 2024-02-15T18:31:38.567 INFO:tasks.workunit.client.1.smithi131.stdout:1/935: dread d0/d68/d80/fc7 [0,4194304] 0 2024-02-15T18:31:38.571 INFO:tasks.workunit.client.1.smithi131.stdout:5/745: dread d18/d20/f48 [0,4194304] 0 2024-02-15T18:31:38.571 INFO:tasks.workunit.client.1.smithi131.stdout:8/765: creat d22/d26/d3f/d47/d48/f104 x:0 0 0 2024-02-15T18:31:38.573 INFO:tasks.workunit.client.1.smithi131.stdout:7/762: rename d0/d17/d3a/d3d/d79/d89/f8c to d0/d34/d8b/ff0 0 2024-02-15T18:31:38.647 INFO:tasks.workunit.client.1.smithi131.stdout:1/936: mknod d0/d2/d4/d5d/c14a 0 2024-02-15T18:31:38.647 INFO:tasks.workunit.client.1.smithi131.stdout:1/937: chown d0/d1/d16/dd1/ffa 55639021 1 2024-02-15T18:31:38.647 INFO:tasks.workunit.client.1.smithi131.stdout:5/746: creat d18/d4e/db6/ff7 x:0 0 0 2024-02-15T18:31:38.648 INFO:tasks.workunit.client.1.smithi131.stdout:8/766: mkdir d22/d26/d3f/d47/d57/dc1/d105 0 2024-02-15T18:31:38.649 INFO:tasks.workunit.client.1.smithi131.stdout:8/767: readlink d22/d26/l5b 0 2024-02-15T18:31:38.649 INFO:tasks.workunit.client.1.smithi131.stdout:8/768: write d22/d26/d3f/d47/d48/d5f/d6f/fe2 [2116650,16799] 0 2024-02-15T18:31:38.651 INFO:tasks.workunit.client.1.smithi131.stdout:7/763: truncate d0/d17/f3c 3581700 0 2024-02-15T18:31:38.651 INFO:tasks.workunit.client.1.smithi131.stdout:7/764: write d0/d17/f21 [9329183,118286] 0 2024-02-15T18:31:38.651 INFO:tasks.workunit.client.1.smithi131.stdout:7/765: stat d0/d17/d3a/l3e 0 2024-02-15T18:31:38.659 INFO:tasks.workunit.client.1.smithi131.stdout:1/938: getdents d0/d1/d16/db7 0 2024-02-15T18:31:38.661 INFO:tasks.workunit.client.1.smithi131.stdout:5/747: mknod d18/cf8 0 2024-02-15T18:31:38.662 INFO:tasks.workunit.client.1.smithi131.stdout:8/769: mknod d22/d26/d3f/d86/c106 0 2024-02-15T18:31:38.673 INFO:tasks.workunit.client.1.smithi131.stdout:8/770: dread d22/d26/d3f/d47/d48/f5a [0,4194304] 0 2024-02-15T18:31:38.676 INFO:tasks.workunit.client.1.smithi131.stdout:8/771: write d22/d26/d3f/d47/d48/d84/f98 [11332049,100147] 0 2024-02-15T18:31:38.676 INFO:tasks.workunit.client.1.smithi131.stdout:5/748: dwrite d18/d33/d73/de8/d85/dab/fdf [0,4194304] 0 2024-02-15T18:31:38.676 INFO:tasks.workunit.client.1.smithi131.stdout:7/766: getdents d0/d17/d3a/d3d/d79/db4/dd7 0 2024-02-15T18:31:38.679 INFO:tasks.workunit.client.1.smithi131.stdout:1/939: truncate d0/d2/d4/d41/d5a/ff7 2510920 0 2024-02-15T18:31:38.679 INFO:tasks.workunit.client.1.smithi131.stdout:1/940: fsync d0/d2/dd6/f122 0 2024-02-15T18:31:38.684 INFO:tasks.workunit.client.1.smithi131.stdout:8/772: link d22/d2e/d60/lfa d22/d26/d3f/d47/dc3/l107 0 2024-02-15T18:31:38.689 INFO:tasks.workunit.client.1.smithi131.stdout:5/749: creat d18/ff9 x:0 0 0 2024-02-15T18:31:38.689 INFO:tasks.workunit.client.1.smithi131.stdout:5/750: fdatasync d18/d83/d8b/dba/ff0 0 2024-02-15T18:31:38.689 INFO:tasks.workunit.client.1.smithi131.stdout:5/751: dread - d18/d20/fa8 zero size 2024-02-15T18:31:38.691 INFO:tasks.workunit.client.1.smithi131.stdout:7/767: symlink d0/d34/d8e/d98/lf1 0 2024-02-15T18:31:38.691 INFO:tasks.workunit.client.1.smithi131.stdout:7/768: dread - d0/d34/d8e/fdc zero size 2024-02-15T18:31:38.692 INFO:tasks.workunit.client.1.smithi131.stdout:2/672: sync 2024-02-15T18:31:38.692 INFO:tasks.workunit.client.1.smithi131.stdout:4/860: sync 2024-02-15T18:31:38.692 INFO:tasks.workunit.client.1.smithi131.stdout:9/824: sync 2024-02-15T18:31:38.692 INFO:tasks.workunit.client.1.smithi131.stdout:1/941: rename d0/d2/d4/d41/fe2 to d0/d2/d4/d41/f14b 0 2024-02-15T18:31:38.694 INFO:tasks.workunit.client.1.smithi131.stdout:8/773: creat d22/d26/d3f/d47/d48/d5f/d6f/f108 x:0 0 0 2024-02-15T18:31:38.695 INFO:tasks.workunit.client.1.smithi131.stdout:5/752: unlink d18/d20/l37 0 2024-02-15T18:31:38.696 INFO:tasks.workunit.client.1.smithi131.stdout:5/753: write f6 [2578148,10558] 0 2024-02-15T18:31:38.699 INFO:tasks.workunit.client.1.smithi131.stdout:7/769: creat d0/da9/de4/ff2 x:0 0 0 2024-02-15T18:31:38.700 INFO:tasks.workunit.client.1.smithi131.stdout:4/861: mkdir d2/d2a/d47/d21/dcd/d13f 0 2024-02-15T18:31:38.700 INFO:tasks.workunit.client.1.smithi131.stdout:4/862: readlink d2/d2a/d47/d16/l36 0 2024-02-15T18:31:38.702 INFO:tasks.workunit.client.1.smithi131.stdout:2/673: rename dd/d10/d22/d2f/d38/d74/d2e/d66/faa to dd/d14/d1f/d65/d81/fe1 0 2024-02-15T18:31:38.704 INFO:tasks.workunit.client.1.smithi131.stdout:9/825: symlink d4/dc/d17/d19/d32/d91/l109 0 2024-02-15T18:31:38.704 INFO:tasks.workunit.client.1.smithi131.stdout:9/826: truncate d4/dc/de/d1e/d1f/d101/fd4 833371 0 2024-02-15T18:31:38.706 INFO:tasks.workunit.client.1.smithi131.stdout:1/942: rmdir d0/d1/d16/dd1 39 2024-02-15T18:31:38.706 INFO:tasks.workunit.client.1.smithi131.stdout:1/943: chown d0/d2/d31/d3d/d46/c11b 151487781 1 2024-02-15T18:31:38.708 INFO:tasks.workunit.client.1.smithi131.stdout:8/774: creat d22/d26/f109 x:0 0 0 2024-02-15T18:31:38.708 INFO:tasks.workunit.client.1.smithi131.stdout:8/775: chown d22/d26/c29 10060931 1 2024-02-15T18:31:38.717 INFO:tasks.workunit.client.1.smithi131.stdout:5/754: symlink d18/d83/d8b/dba/d7b/lfa 0 2024-02-15T18:31:38.717 INFO:tasks.workunit.client.1.smithi131.stdout:1/944: dread d0/d2/db/de6/d138/f4c [4194304,4194304] 0 2024-02-15T18:31:38.717 INFO:tasks.workunit.client.1.smithi131.stdout:7/770: creat d0/d9d/dc8/ff3 x:0 0 0 2024-02-15T18:31:38.719 INFO:tasks.workunit.client.1.smithi131.stdout:4/863: rmdir d2/d7/d1c/d94 39 2024-02-15T18:31:38.720 INFO:tasks.workunit.client.1.smithi131.stdout:2/674: dwrite dd/d10/d22/d2f/d38/d74/d2e/f32 [0,4194304] 0 2024-02-15T18:31:38.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/827: mkdir d4/d78/d10a 0 2024-02-15T18:31:38.722 INFO:tasks.workunit.client.1.smithi131.stdout:8/776: truncate d22/d26/d3f/d47/f4a 2583242 0 2024-02-15T18:31:38.730 INFO:tasks.workunit.client.1.smithi131.stdout:5/755: creat d18/d83/ffb x:0 0 0 2024-02-15T18:31:38.731 INFO:tasks.workunit.client.1.smithi131.stdout:1/945: mkdir d0/d2/d4/d5d/db1/d14c 0 2024-02-15T18:31:38.731 INFO:tasks.workunit.client.1.smithi131.stdout:1/946: write d0/d1/d16/dd1/f10e [882977,44357] 0 2024-02-15T18:31:38.732 INFO:tasks.workunit.client.1.smithi131.stdout:1/947: write d0/d2/f144 [681216,115058] 0 2024-02-15T18:31:38.732 INFO:tasks.workunit.client.1.smithi131.stdout:1/948: readlink d0/d2/d4/d41/d5a/le4 0 2024-02-15T18:31:38.732 INFO:tasks.workunit.client.1.smithi131.stdout:1/949: read - d0/d1/d16/d30/ff9 zero size 2024-02-15T18:31:38.736 INFO:tasks.workunit.client.1.smithi131.stdout:7/771: mkdir d0/d17/d3a/d3d/df4 0 2024-02-15T18:31:38.738 INFO:tasks.workunit.client.1.smithi131.stdout:2/675: creat dd/d10/db1/fe2 x:0 0 0 2024-02-15T18:31:38.739 INFO:tasks.workunit.client.1.smithi131.stdout:2/676: truncate dd/d14/d1f/d65/d77/fc1 309479 0 2024-02-15T18:31:38.739 INFO:tasks.workunit.client.1.smithi131.stdout:2/677: write dd/d10/d22/d2f/d38/f7c [1084491,105954] 0 2024-02-15T18:31:38.740 INFO:tasks.workunit.client.1.smithi131.stdout:9/828: creat d4/dc/de/d1e/d1f/d2c/dc0/f10b x:0 0 0 2024-02-15T18:31:38.741 INFO:tasks.workunit.client.1.smithi131.stdout:8/777: creat d22/d26/d3f/d47/d48/df5/f10a x:0 0 0 2024-02-15T18:31:38.742 INFO:tasks.workunit.client.1.smithi131.stdout:5/756: creat d18/d83/d8b/dba/d7b/db8/ffc x:0 0 0 2024-02-15T18:31:38.744 INFO:tasks.workunit.client.1.smithi131.stdout:5/757: read d18/d23/f3a [3533689,19557] 0 2024-02-15T18:31:38.744 INFO:tasks.workunit.client.1.smithi131.stdout:1/950: mkdir d0/d2/db/de6/d138/d72/d78/da7/d14d 0 2024-02-15T18:31:38.744 INFO:tasks.workunit.client.1.smithi131.stdout:1/951: stat d0/d2/d4/da/c132 0 2024-02-15T18:31:38.747 INFO:tasks.workunit.client.1.smithi131.stdout:4/864: dwrite d2/d2a/d47/d21/d9e/fbe [0,4194304] 0 2024-02-15T18:31:38.748 INFO:tasks.workunit.client.1.smithi131.stdout:7/772: dread d0/d17/f4b [0,4194304] 0 2024-02-15T18:31:38.748 INFO:tasks.workunit.client.1.smithi131.stdout:7/773: truncate d0/d34/f41 4547700 0 2024-02-15T18:31:38.750 INFO:tasks.workunit.client.1.smithi131.stdout:5/758: mkdir d18/d83/d8b/dfd 0 2024-02-15T18:31:38.751 INFO:tasks.workunit.client.1.smithi131.stdout:1/952: rmdir d0/d68/d80 39 2024-02-15T18:31:38.751 INFO:tasks.workunit.client.1.smithi131.stdout:1/953: write d0/d2/db/de6/db3/dc2/fda [619891,61822] 0 2024-02-15T18:31:38.752 INFO:tasks.workunit.client.1.smithi131.stdout:1/954: write d0/d1/d24/d108/ff1 [1775366,7792] 0 2024-02-15T18:31:38.752 INFO:tasks.workunit.client.1.smithi131.stdout:1/955: chown d0/d2/db/de6/db3/dc2/fda 767833 1 2024-02-15T18:31:38.752 INFO:tasks.workunit.client.1.smithi131.stdout:1/956: chown d0/d2/db/lb0 6303769 1 2024-02-15T18:31:38.755 INFO:tasks.workunit.client.1.smithi131.stdout:2/678: dread dd/d14/d1f/d65/d77/f7e [0,4194304] 0 2024-02-15T18:31:38.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/778: dread d22/d39/fac [0,4194304] 0 2024-02-15T18:31:38.755 INFO:tasks.workunit.client.1.smithi131.stdout:2/679: readlink dd/d10/d22/d2a/d94/la6 0 2024-02-15T18:31:38.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/779: dread - d22/d26/d3f/d47/d48/df5/f10a zero size 2024-02-15T18:31:38.757 INFO:tasks.workunit.client.1.smithi131.stdout:4/865: dread d2/d7/d1c/f51 [0,4194304] 0 2024-02-15T18:31:38.761 INFO:tasks.workunit.client.1.smithi131.stdout:7/774: mkdir d0/d34/d8e/df5 0 2024-02-15T18:31:38.766 INFO:tasks.workunit.client.1.smithi131.stdout:5/759: unlink d18/d4e/db6/fd4 0 2024-02-15T18:31:38.768 INFO:tasks.workunit.client.1.smithi131.stdout:8/780: mkdir d22/d26/d3f/d47/d48/d5f/d6f/d7a/d10b 0 2024-02-15T18:31:38.770 INFO:tasks.workunit.client.1.smithi131.stdout:9/829: rmdir d4/dc/de/d1e/d1f/d51/d5d/d9d 0 2024-02-15T18:31:38.772 INFO:tasks.workunit.client.1.smithi131.stdout:7/775: creat d0/da9/de4/ff6 x:0 0 0 2024-02-15T18:31:38.773 INFO:tasks.workunit.client.1.smithi131.stdout:1/957: dwrite d0/d2/db/de6/f137 [0,4194304] 0 2024-02-15T18:31:38.778 INFO:tasks.workunit.client.1.smithi131.stdout:5/760: creat d18/d33/dd6/df5/ffe x:0 0 0 2024-02-15T18:31:38.780 INFO:tasks.workunit.client.1.smithi131.stdout:7/776: creat d0/d17/d3a/d3d/d79/d89/ff7 x:0 0 0 2024-02-15T18:31:38.780 INFO:tasks.workunit.client.1.smithi131.stdout:8/781: dread f14 [0,4194304] 0 2024-02-15T18:31:38.787 INFO:tasks.workunit.client.1.smithi131.stdout:5/761: creat d18/d4e/fff x:0 0 0 2024-02-15T18:31:38.789 INFO:tasks.workunit.client.1.smithi131.stdout:7/777: creat d0/d34/d8e/d98/dc6/ff8 x:0 0 0 2024-02-15T18:31:38.790 INFO:tasks.workunit.client.1.smithi131.stdout:1/958: dwrite d0/d2/d4/d5d/f88 [0,4194304] 0 2024-02-15T18:31:38.791 INFO:tasks.workunit.client.1.smithi131.stdout:8/782: creat d22/d39/f10c x:0 0 0 2024-02-15T18:31:38.793 INFO:tasks.workunit.client.1.smithi131.stdout:8/783: write d22/f42 [2318242,79759] 0 2024-02-15T18:31:38.793 INFO:tasks.workunit.client.1.smithi131.stdout:8/784: chown d22/d26/d3f/fde 346602513 1 2024-02-15T18:31:38.793 INFO:tasks.workunit.client.1.smithi131.stdout:5/762: mkdir d18/d33/d73/de8/d85/d95/d100 0 2024-02-15T18:31:38.793 INFO:tasks.workunit.client.1.smithi131.stdout:5/763: chown d18/d33/d73/de8/le1 5300 1 2024-02-15T18:31:38.795 INFO:tasks.workunit.client.1.smithi131.stdout:7/778: rename d0/f70 to d0/da9/de4/ff9 0 2024-02-15T18:31:38.797 INFO:tasks.workunit.client.1.smithi131.stdout:1/959: dread d0/d2/dd6/fbe [4194304,4194304] 0 2024-02-15T18:31:38.797 INFO:tasks.workunit.client.1.smithi131.stdout:1/960: fdatasync d0/d2/f12 0 2024-02-15T18:31:38.797 INFO:tasks.workunit.client.1.smithi131.stdout:1/961: dread - d0/d1/d44/d59/d42/dcf/ffb zero size 2024-02-15T18:31:38.812 INFO:tasks.workunit.client.1.smithi131.stdout:5/764: unlink d18/c43 0 2024-02-15T18:31:38.812 INFO:tasks.workunit.client.1.smithi131.stdout:5/765: chown d18/d6d/d70/fb3 2 1 2024-02-15T18:31:38.813 INFO:tasks.workunit.client.1.smithi131.stdout:5/766: read d18/d23/f8f [1131111,44223] 0 2024-02-15T18:31:38.813 INFO:tasks.workunit.client.1.smithi131.stdout:5/767: fdatasync d18/d4e/f6f 0 2024-02-15T18:31:38.817 INFO:tasks.workunit.client.1.smithi131.stdout:7/779: getdents d0/d17/d3a/d3d/d79/d89 0 2024-02-15T18:31:38.818 INFO:tasks.workunit.client.1.smithi131.stdout:7/780: chown d0/d17/d3a/d3d/f73 1 1 2024-02-15T18:31:38.818 INFO:tasks.workunit.client.1.smithi131.stdout:7/781: write d0/d17/f68 [4578605,30633] 0 2024-02-15T18:31:38.818 INFO:tasks.workunit.client.1.smithi131.stdout:7/782: dread - d0/d34/fda zero size 2024-02-15T18:31:38.819 INFO:tasks.workunit.client.1.smithi131.stdout:1/962: symlink d0/d2/db/de6/d138/d72/d78/df2/d13b/l14e 0 2024-02-15T18:31:38.820 INFO:tasks.workunit.client.1.smithi131.stdout:1/963: truncate d0/d1/d16/d9d/fb2 881173 0 2024-02-15T18:31:38.820 INFO:tasks.workunit.client.1.smithi131.stdout:5/768: getdents d18/d33/d73/de8/d85/def 0 2024-02-15T18:31:38.820 INFO:tasks.workunit.client.1.smithi131.stdout:5/769: write d18/d83/d8b/dba/f4a [9252668,98012] 0 2024-02-15T18:31:38.822 INFO:tasks.workunit.client.1.smithi131.stdout:5/770: read d18/d23/f3a [3153923,80019] 0 2024-02-15T18:31:38.825 INFO:tasks.workunit.client.1.smithi131.stdout:7/783: mkdir d0/da9/dfa 0 2024-02-15T18:31:38.828 INFO:tasks.workunit.client.1.smithi131.stdout:5/771: mkdir d18/d33/dd6/df5/d101 0 2024-02-15T18:31:38.830 INFO:tasks.workunit.client.1.smithi131.stdout:5/772: rename d18/d33/d73/de8/d85/def/lf6 to d18/d33/d73/de8/d85/def/l102 0 2024-02-15T18:31:38.833 INFO:tasks.workunit.client.1.smithi131.stdout:5/773: unlink d18/d33/d73/de8/d85/ld5 0 2024-02-15T18:31:38.833 INFO:tasks.workunit.client.1.smithi131.stdout:5/774: read d18/d20/f57 [621621,58455] 0 2024-02-15T18:31:38.834 INFO:tasks.workunit.client.1.smithi131.stdout:1/964: dwrite d0/d2/db/de6/db3/dc2/fda [0,4194304] 0 2024-02-15T18:31:38.836 INFO:tasks.workunit.client.1.smithi131.stdout:5/775: mkdir d18/d83/d8b/dba/d7b/deb/d103 0 2024-02-15T18:31:38.836 INFO:tasks.workunit.client.1.smithi131.stdout:5/776: fdatasync d18/d4e/f6f 0 2024-02-15T18:31:38.839 INFO:tasks.workunit.client.1.smithi131.stdout:5/777: symlink d18/d6d/l104 0 2024-02-15T18:31:38.840 INFO:tasks.workunit.client.1.smithi131.stdout:5/778: write d18/d23/f52 [1235344,113129] 0 2024-02-15T18:31:38.844 INFO:tasks.workunit.client.1.smithi131.stdout:1/965: dread d0/d68/d80/ffe [0,4194304] 0 2024-02-15T18:31:38.844 INFO:tasks.workunit.client.1.smithi131.stdout:1/966: write d0/d2/d4/da/f13c [6685,112170] 0 2024-02-15T18:31:38.844 INFO:tasks.workunit.client.1.smithi131.stdout:1/967: chown d0/d1/d16/d6b 127516 1 2024-02-15T18:31:38.844 INFO:tasks.workunit.client.1.smithi131.stdout:1/968: fsync d0/d1/d16/dd1/f10d 0 2024-02-15T18:31:38.847 INFO:tasks.workunit.client.1.smithi131.stdout:5/779: getdents d18/d83/d8b/dba/d7b/db8 0 2024-02-15T18:31:38.848 INFO:tasks.workunit.client.1.smithi131.stdout:5/780: chown d18/d4e/fdb 741570 1 2024-02-15T18:31:38.848 INFO:tasks.workunit.client.1.smithi131.stdout:5/781: chown d18/d83/d8b/dba/d63/fcf 3 1 2024-02-15T18:31:38.849 INFO:tasks.workunit.client.1.smithi131.stdout:5/782: mknod d18/d33/dd6/df5/d101/c105 0 2024-02-15T18:31:38.849 INFO:tasks.workunit.client.1.smithi131.stdout:5/783: chown d18/d33/dd6/df5/d101 238671 1 2024-02-15T18:31:38.849 INFO:tasks.workunit.client.1.smithi131.stdout:5/784: dread - d18/d33/d73/de8/d86/fea zero size 2024-02-15T18:31:38.851 INFO:tasks.workunit.client.1.smithi131.stdout:5/785: link d18/d20/c44 d18/d83/d8b/dfd/c106 0 2024-02-15T18:31:38.851 INFO:tasks.workunit.client.1.smithi131.stdout:5/786: truncate d18/d6d/d70/fb3 4667376 0 2024-02-15T18:31:38.851 INFO:tasks.workunit.client.1.smithi131.stdout:5/787: read f6 [2057597,80176] 0 2024-02-15T18:31:38.853 INFO:tasks.workunit.client.1.smithi131.stdout:1/969: dread d0/d2/db/de6/db3/ff6 [0,4194304] 0 2024-02-15T18:31:38.855 INFO:tasks.workunit.client.1.smithi131.stdout:1/970: unlink d0/d1/d16/d6b/de5/f11e 0 2024-02-15T18:31:38.856 INFO:tasks.workunit.client.1.smithi131.stdout:1/971: write d0/d2/d4/d41/dc3/fe8 [136890,82736] 0 2024-02-15T18:31:38.920 INFO:tasks.workunit.client.1.smithi131.stdout:1/972: dwrite d0/d2/fe0 [0,4194304] 0 2024-02-15T18:31:38.921 INFO:tasks.workunit.client.1.smithi131.stdout:5/788: dwrite d18/f92 [0,4194304] 0 2024-02-15T18:31:38.922 INFO:tasks.workunit.client.1.smithi131.stdout:1/973: mkdir d0/d68/d80/d14f 0 2024-02-15T18:31:38.940 INFO:tasks.workunit.client.1.smithi131.stdout:5/789: mknod d18/d83/d8b/dba/dda/c107 0 2024-02-15T18:31:38.941 INFO:tasks.workunit.client.1.smithi131.stdout:5/790: mkdir d18/d33/d73/de8/d108 0 2024-02-15T18:31:38.943 INFO:tasks.workunit.client.1.smithi131.stdout:1/974: dwrite d0/d2/dd6/fbe [0,4194304] 0 2024-02-15T18:31:38.944 INFO:tasks.workunit.client.1.smithi131.stdout:5/791: mkdir d18/d33/d73/de8/d86/d109 0 2024-02-15T18:31:38.950 INFO:tasks.workunit.client.1.smithi131.stdout:5/792: dread f11 [0,4194304] 0 2024-02-15T18:31:38.954 INFO:tasks.workunit.client.1.smithi131.stdout:1/975: dread d0/d2/f2b [4194304,4194304] 0 2024-02-15T18:31:38.954 INFO:tasks.workunit.client.1.smithi131.stdout:1/976: readlink d0/d68/l82 0 2024-02-15T18:31:38.955 INFO:tasks.workunit.client.1.smithi131.stdout:5/793: creat d18/d83/d8b/dfd/f10a x:0 0 0 2024-02-15T18:31:38.957 INFO:tasks.workunit.client.1.smithi131.stdout:1/977: getdents d0/d2/d31 0 2024-02-15T18:31:38.960 INFO:tasks.workunit.client.1.smithi131.stdout:1/978: creat d0/d2/d31/f150 x:0 0 0 2024-02-15T18:31:38.970 INFO:tasks.workunit.client.1.smithi131.stdout:5/794: dwrite d18/d23/f30 [0,4194304] 0 2024-02-15T18:31:38.972 INFO:tasks.workunit.client.1.smithi131.stdout:5/795: rename d18/d23 to d18/d33/d73/de8/d85/def/d10b 0 2024-02-15T18:31:38.981 INFO:tasks.workunit.client.1.smithi131.stdout:1/979: dwrite d0/d1/d16/d30/fa2 [4194304,4194304] 0 2024-02-15T18:31:38.985 INFO:tasks.workunit.client.1.smithi131.stdout:5/796: dread d18/d33/f5a [0,4194304] 0 2024-02-15T18:31:38.986 INFO:tasks.workunit.client.1.smithi131.stdout:5/797: mkdir d18/d83/d8b/dba/dda/d10c 0 2024-02-15T18:31:38.988 INFO:tasks.workunit.client.1.smithi131.stdout:1/980: dread d0/d2/d4/d41/d5a/ff7 [0,4194304] 0 2024-02-15T18:31:38.989 INFO:tasks.workunit.client.1.smithi131.stdout:5/798: creat d18/d83/d8b/dba/d7b/db8/f10d x:0 0 0 2024-02-15T18:31:38.989 INFO:tasks.workunit.client.1.smithi131.stdout:5/799: truncate d18/d33/d73/de8/d86/fd2 479960 0 2024-02-15T18:31:38.991 INFO:tasks.workunit.client.1.smithi131.stdout:1/981: unlink d0/d2/d4/d5d/f60 0 2024-02-15T18:31:38.991 INFO:tasks.workunit.client.1.smithi131.stdout:1/982: truncate d0/d2/d4/d41/f14b 557702 0 2024-02-15T18:31:38.992 INFO:tasks.workunit.client.1.smithi131.stdout:5/800: creat d18/d6d/f10e x:0 0 0 2024-02-15T18:31:38.993 INFO:tasks.workunit.client.1.smithi131.stdout:1/983: unlink d0/d1/d44/f70 0 2024-02-15T18:31:38.994 INFO:tasks.workunit.client.1.smithi131.stdout:5/801: symlink d18/d83/d8b/dba/d7b/dee/l10f 0 2024-02-15T18:31:38.996 INFO:tasks.workunit.client.1.smithi131.stdout:1/984: rename d0/d1/d44/f11f to d0/d1/d44/d59/d42/dcf/d102/f151 0 2024-02-15T18:31:38.997 INFO:tasks.workunit.client.1.smithi131.stdout:5/802: dread d18/d33/d73/de8/fa6 [0,4194304] 0 2024-02-15T18:31:38.999 INFO:tasks.workunit.client.1.smithi131.stdout:5/803: getdents d18/d20 0 2024-02-15T18:31:39.005 INFO:tasks.workunit.client.1.smithi131.stdout:1/985: dread d0/d1/d16/d6b/f87 [0,4194304] 0 2024-02-15T18:31:39.005 INFO:tasks.workunit.client.1.smithi131.stdout:1/986: fdatasync d0/d2/d4/d5d/f88 0 2024-02-15T18:31:39.015 INFO:tasks.workunit.client.1.smithi131.stdout:6/617: sync 2024-02-15T18:31:39.015 INFO:tasks.workunit.client.1.smithi131.stdout:0/667: sync 2024-02-15T18:31:39.024 INFO:tasks.workunit.client.1.smithi131.stdout:6/618: dread d2/d6d/db9/fa [0,4194304] 0 2024-02-15T18:31:39.033 INFO:tasks.workunit.client.1.smithi131.stdout:1/987: dwrite d0/d2/db/f7c [0,4194304] 0 2024-02-15T18:31:39.035 INFO:tasks.workunit.client.1.smithi131.stdout:0/668: dwrite d5/d2f/d4b/dd9/d11/f31 [0,4194304] 0 2024-02-15T18:31:39.036 INFO:tasks.workunit.client.1.smithi131.stdout:0/669: truncate d5/d2f/d4b/dd9/d10/d71/d92/f93 428405 0 2024-02-15T18:31:39.036 INFO:tasks.workunit.client.1.smithi131.stdout:0/670: fdatasync d5/d2f/d45/f95 0 2024-02-15T18:31:39.046 INFO:tasks.workunit.client.1.smithi131.stdout:0/671: dread d5/fc0 [0,4194304] 0 2024-02-15T18:31:39.057 INFO:tasks.workunit.client.1.smithi131.stdout:5/804: mkdir d18/d83/d8b/dfd/d110 0 2024-02-15T18:31:39.058 INFO:tasks.workunit.client.1.smithi131.stdout:5/805: write d18/d33/d73/de8/d86/fd2 [1030058,14752] 0 2024-02-15T18:31:39.064 INFO:tasks.workunit.client.1.smithi131.stdout:6/619: unlink d2/dc/d27/d78/l82 0 2024-02-15T18:31:39.068 INFO:tasks.workunit.client.1.smithi131.stdout:0/672: dwrite d5/d15/d1f/f7d [0,4194304] 0 2024-02-15T18:31:39.140 INFO:tasks.workunit.client.1.smithi131.stdout:1/988: symlink d0/d1/d44/d59/d42/dcf/d102/l152 0 2024-02-15T18:31:39.144 INFO:tasks.workunit.client.1.smithi131.stdout:5/806: mknod d18/d83/d8b/dfd/c111 0 2024-02-15T18:31:39.145 INFO:tasks.workunit.client.1.smithi131.stdout:6/620: creat d2/dc/d27/d74/fc1 x:0 0 0 2024-02-15T18:31:39.145 INFO:tasks.workunit.client.1.smithi131.stdout:6/621: chown d2/d2b/f37 0 1 2024-02-15T18:31:39.145 INFO:tasks.workunit.client.1.smithi131.stdout:6/622: chown d2/dc/d27/d78/f87 15617082 1 2024-02-15T18:31:39.145 INFO:tasks.workunit.client.1.smithi131.stdout:6/623: chown d2/d6d/db9/c71 9074 1 2024-02-15T18:31:39.152 INFO:tasks.workunit.client.1.smithi131.stdout:0/673: rename d5/d2f/d4b/dd9/f2e to d5/d2f/d4b/dd9/d77/da8/dad/fdb 0 2024-02-15T18:31:39.174 INFO:tasks.workunit.client.1.smithi131.stdout:5/807: mkdir d18/d83/d8b/dba/d7b/d112 0 2024-02-15T18:31:39.175 INFO:tasks.workunit.client.1.smithi131.stdout:3/867: sync 2024-02-15T18:31:39.175 INFO:tasks.workunit.client.1.smithi131.stdout:3/868: dread - d2/d22/d29/db/d84/ff2 zero size 2024-02-15T18:31:39.365 INFO:tasks.workunit.client.1.smithi131.stdout:6/624: truncate d2/d6d/db9/d12/d4d/f8b 4112936 0 2024-02-15T18:31:39.368 INFO:tasks.workunit.client.1.smithi131.stdout:6/625: dread d2/d6d/db9/d12/d80/f92 [0,4194304] 0 2024-02-15T18:31:39.375 INFO:tasks.workunit.client.1.smithi131.stdout:0/674: truncate d5/d2f/d4b/dd9/d4d/f7c 321319 0 2024-02-15T18:31:39.375 INFO:tasks.workunit.client.1.smithi131.stdout:0/675: chown d5/d2f/d4b/dd9/d10/c91 6 1 2024-02-15T18:31:39.375 INFO:tasks.workunit.client.1.smithi131.stdout:5/808: creat d18/d4e/db6/f113 x:0 0 0 2024-02-15T18:31:39.376 INFO:tasks.workunit.client.1.smithi131.stdout:5/809: chown d18/d83/cc3 1 1 2024-02-15T18:31:39.376 INFO:tasks.workunit.client.1.smithi131.stdout:5/810: chown d18/d33/d73/de8/fa6 1648 1 2024-02-15T18:31:39.377 INFO:tasks.workunit.client.1.smithi131.stdout:3/869: unlink d2/d22/d29/c14 0 2024-02-15T18:31:39.383 INFO:tasks.workunit.client.1.smithi131.stdout:0/676: symlink d5/d2f/d4b/d82/ldc 0 2024-02-15T18:31:39.384 INFO:tasks.workunit.client.1.smithi131.stdout:5/811: rename d18/d6d/d9c/fc6 to d18/d20/f114 0 2024-02-15T18:31:39.384 INFO:tasks.workunit.client.1.smithi131.stdout:3/870: mkdir d2/d22/d29/db/d1a/d110/d114 0 2024-02-15T18:31:39.385 INFO:tasks.workunit.client.1.smithi131.stdout:3/871: stat d2/d22/d29/db/d84/ff2 0 2024-02-15T18:31:39.385 INFO:tasks.workunit.client.1.smithi131.stdout:0/677: mkdir d5/d2f/d4b/dd9/d10/d71/d92/ddd 0 2024-02-15T18:31:39.385 INFO:tasks.workunit.client.1.smithi131.stdout:0/678: write d5/d2f/d4b/dd9/d10/d3f/f61 [1349474,70739] 0 2024-02-15T18:31:39.386 INFO:tasks.workunit.client.1.smithi131.stdout:3/872: write d2/d22/d5e/d79/fa2 [94538,47493] 0 2024-02-15T18:31:39.386 INFO:tasks.workunit.client.1.smithi131.stdout:5/812: truncate d18/d83/d8b/dba/f38 335726 0 2024-02-15T18:31:39.387 INFO:tasks.workunit.client.1.smithi131.stdout:5/813: chown d18/d33/d73/de8/d85/def/d10b/fad 358 1 2024-02-15T18:31:39.387 INFO:tasks.workunit.client.1.smithi131.stdout:5/814: fdatasync d18/d83/d8b/dba/d7b/db8/fb9 0 2024-02-15T18:31:39.387 INFO:tasks.workunit.client.1.smithi131.stdout:5/815: fdatasync d18/d83/d8b/dba/d63/fcf 0 2024-02-15T18:31:39.387 INFO:tasks.workunit.client.1.smithi131.stdout:0/679: symlink d5/d2f/d45/lde 0 2024-02-15T18:31:39.395 INFO:tasks.workunit.client.1.smithi131.stdout:3/873: dread d2/d22/d29/f91 [0,4194304] 0 2024-02-15T18:31:39.409 INFO:tasks.workunit.client.1.smithi131.stdout:5/816: mkdir d18/d33/d73/de8/d85/dab/d115 0 2024-02-15T18:31:39.410 INFO:tasks.workunit.client.1.smithi131.stdout:0/680: link d5/d2f/d4b/d82/l8f d5/d2f/d4b/dd9/d4d/ldf 0 2024-02-15T18:31:39.410 INFO:tasks.workunit.client.1.smithi131.stdout:5/817: mkdir d18/d33/d73/de8/d85/def/d10b/d116 0 2024-02-15T18:31:39.415 INFO:tasks.workunit.client.1.smithi131.stdout:5/818: symlink d18/d83/d8b/dba/d7b/db8/l117 0 2024-02-15T18:31:39.415 INFO:tasks.workunit.client.1.smithi131.stdout:5/819: fdatasync d18/d6d/d70/f81 0 2024-02-15T18:31:39.415 INFO:tasks.workunit.client.1.smithi131.stdout:5/820: fsync d18/d6d/f9d 0 2024-02-15T18:31:39.428 INFO:tasks.workunit.client.1.smithi131.stdout:3/874: dwrite d2/fce [0,4194304] 0 2024-02-15T18:31:39.433 INFO:tasks.workunit.client.1.smithi131.stdout:3/875: rename d2/d22/d5e/d79/f97 to d2/d22/d29/db/d23/f115 0 2024-02-15T18:31:39.438 INFO:tasks.workunit.client.1.smithi131.stdout:3/876: rename d2/d22/d42 to d2/d22/d5e/d79/d116 0 2024-02-15T18:31:39.440 INFO:tasks.workunit.client.1.smithi131.stdout:3/877: link d2/d22/lbc d2/d22/d29/db/d1a/l117 0 2024-02-15T18:31:39.440 INFO:tasks.workunit.client.1.smithi131.stdout:3/878: readlink d2/d22/d29/db/d1a/da4/d85/lc8 0 2024-02-15T18:31:39.440 INFO:tasks.workunit.client.1.smithi131.stdout:0/681: dwrite d5/d2f/d4b/dd9/d10/f19 [4194304,4194304] 0 2024-02-15T18:31:39.442 INFO:tasks.workunit.client.1.smithi131.stdout:5/821: dwrite d18/d6d/d9c/fc9 [0,4194304] 0 2024-02-15T18:31:39.442 INFO:tasks.workunit.client.1.smithi131.stdout:3/879: write d2/d22/d29/db/f76 [5959738,58122] 0 2024-02-15T18:31:39.442 INFO:tasks.workunit.client.1.smithi131.stdout:3/880: dread - d2/f7c zero size 2024-02-15T18:31:39.442 INFO:tasks.workunit.client.1.smithi131.stdout:0/682: symlink d5/d2f/d4b/dd9/d10/db7/le0 0 2024-02-15T18:31:39.461 INFO:tasks.workunit.client.1.smithi131.stdout:0/683: dread d5/d2f/d4b/d82/dae/fbd [0,4194304] 0 2024-02-15T18:31:39.463 INFO:tasks.workunit.client.1.smithi131.stdout:3/881: symlink d2/d22/d3f/de3/l118 0 2024-02-15T18:31:39.463 INFO:tasks.workunit.client.1.smithi131.stdout:5/822: creat d18/d33/d73/de8/f118 x:0 0 0 2024-02-15T18:31:39.463 INFO:tasks.workunit.client.1.smithi131.stdout:5/823: fsync d18/d33/d73/de8/d86/fea 0 2024-02-15T18:31:39.467 INFO:tasks.workunit.client.1.smithi131.stdout:0/684: mknod d5/d2f/d4b/dd9/d11/d3e/db8/ce1 0 2024-02-15T18:31:39.469 INFO:tasks.workunit.client.1.smithi131.stdout:5/824: dread d18/d33/d73/de8/d85/def/d10b/f3a [0,4194304] 0 2024-02-15T18:31:39.473 INFO:tasks.workunit.client.1.smithi131.stdout:3/882: rmdir d2/d22/ddd 39 2024-02-15T18:31:39.473 INFO:tasks.workunit.client.1.smithi131.stdout:3/883: getdents d2/d22/d5e/d79/d9d 0 2024-02-15T18:31:39.473 INFO:tasks.workunit.client.1.smithi131.stdout:3/884: write d2/d22/d29/d9e/fba [507145,73879] 0 2024-02-15T18:31:39.473 INFO:tasks.workunit.client.1.smithi131.stdout:3/885: chown d2/d22/d29/db/lcb 8 1 2024-02-15T18:31:39.474 INFO:tasks.workunit.client.1.smithi131.stdout:0/685: rename d5/d2f/d4b/dd9/d10/d71/f94 to d5/d2f/d4b/dd9/d11/d3e/fe2 0 2024-02-15T18:31:39.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/825: unlink d18/d33/d73/de8/d85/def/d10b/c4d 0 2024-02-15T18:31:39.477 INFO:tasks.workunit.client.1.smithi131.stdout:3/886: mkdir d2/d22/d5e/d119 0 2024-02-15T18:31:39.477 INFO:tasks.workunit.client.1.smithi131.stdout:3/887: chown d2/d22/d29/db/d23/lbd 387232 1 2024-02-15T18:31:39.478 INFO:tasks.workunit.client.1.smithi131.stdout:9/830: sync 2024-02-15T18:31:39.478 INFO:tasks.workunit.client.1.smithi131.stdout:9/831: chown d4/dc/d17/d19/d32/ca0 5 1 2024-02-15T18:31:39.479 INFO:tasks.workunit.client.1.smithi131.stdout:0/686: unlink d5/f56 0 2024-02-15T18:31:39.479 INFO:tasks.workunit.client.1.smithi131.stdout:0/687: chown d5/d2f/d4b/dd9/d11/fc5 14753 1 2024-02-15T18:31:39.479 INFO:tasks.workunit.client.1.smithi131.stdout:0/688: chown d5 35440 1 2024-02-15T18:31:39.479 INFO:tasks.workunit.client.1.smithi131.stdout:0/689: readlink d5/d2f/d4b/dd9/d4d/ldf 0 2024-02-15T18:31:39.479 INFO:tasks.workunit.client.1.smithi131.stdout:0/690: chown d5/d2f/d4b/dd9/d77/d8b/fc2 9 1 2024-02-15T18:31:39.479 INFO:tasks.workunit.client.1.smithi131.stdout:0/691: fdatasync d5/d2f/d4b/fbe 0 2024-02-15T18:31:39.479 INFO:tasks.workunit.client.1.smithi131.stdout:0/692: stat d5/d2f/d4b/d82 0 2024-02-15T18:31:39.479 INFO:tasks.workunit.client.1.smithi131.stdout:0/693: readlink d5/lb0 0 2024-02-15T18:31:39.482 INFO:tasks.workunit.client.1.smithi131.stdout:9/832: rename d4/dc/l33 to d4/dc/de/l10c 0 2024-02-15T18:31:39.484 INFO:tasks.workunit.client.1.smithi131.stdout:9/833: write d4/dc/de/d1e/f37 [2067769,5988] 0 2024-02-15T18:31:39.485 INFO:tasks.workunit.client.1.smithi131.stdout:0/694: rename d5/d2f/d4b/dd9/d11/l5b to d5/d2f/d4b/le3 0 2024-02-15T18:31:39.485 INFO:tasks.workunit.client.1.smithi131.stdout:0/695: dread - d5/d2f/d4b/dd9/d4d/f89 zero size 2024-02-15T18:31:39.507 INFO:tasks.workunit.client.1.smithi131.stdout:9/834: dwrite d4/dc/de/d1e/d1f/d51/d5d/d71/f96 [4194304,4194304] 0 2024-02-15T18:31:39.516 INFO:tasks.workunit.client.1.smithi131.stdout:8/785: sync 2024-02-15T18:31:39.516 INFO:tasks.workunit.client.1.smithi131.stdout:7/784: sync 2024-02-15T18:31:39.516 INFO:tasks.workunit.client.1.smithi131.stdout:2/680: sync 2024-02-15T18:31:39.516 INFO:tasks.workunit.client.1.smithi131.stdout:4/866: sync 2024-02-15T18:31:39.520 INFO:tasks.workunit.client.1.smithi131.stdout:9/835: dread d4/dc/d17/d19/fb9 [0,4194304] 0 2024-02-15T18:31:39.520 INFO:tasks.workunit.client.1.smithi131.stdout:9/836: stat d4/dc/de/d1e/f61 0 2024-02-15T18:31:39.523 INFO:tasks.workunit.client.1.smithi131.stdout:0/696: rename d5/d2f/d4b/f87 to d5/d2f/d4b/d82/dae/fe4 0 2024-02-15T18:31:39.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/786: creat d22/d26/d3f/d47/d48/d84/daf/f10d x:0 0 0 2024-02-15T18:31:39.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/787: stat d22/d2e/d5e/f75 0 2024-02-15T18:31:39.527 INFO:tasks.workunit.client.1.smithi131.stdout:2/681: getdents dd/d10/d22/d2f/d38/d9f 0 2024-02-15T18:31:39.527 INFO:tasks.workunit.client.1.smithi131.stdout:7/785: link d0/da9/de4/ff9 d0/d17/d36/ffb 0 2024-02-15T18:31:39.528 INFO:tasks.workunit.client.1.smithi131.stdout:4/867: mkdir d2/d2a/d47/d21/d9e/d111/d13d/d140 0 2024-02-15T18:31:39.529 INFO:tasks.workunit.client.1.smithi131.stdout:3/888: dwrite d2/d22/d3f/fc2 [0,4194304] 0 2024-02-15T18:31:39.529 INFO:tasks.workunit.client.1.smithi131.stdout:9/837: mknod d4/d78/d10a/c10d 0 2024-02-15T18:31:39.530 INFO:tasks.workunit.client.1.smithi131.stdout:0/697: symlink d5/d2f/d4b/dd9/d11/le5 0 2024-02-15T18:31:39.533 INFO:tasks.workunit.client.1.smithi131.stdout:8/788: creat d22/d2e/d60/f10e x:0 0 0 2024-02-15T18:31:39.534 INFO:tasks.workunit.client.1.smithi131.stdout:2/682: creat dd/d14/d1f/d65/d81/ddd/fe3 x:0 0 0 2024-02-15T18:31:39.535 INFO:tasks.workunit.client.1.smithi131.stdout:2/683: chown dd/d10/d22/d2a/d48/f83 33 1 2024-02-15T18:31:39.535 INFO:tasks.workunit.client.1.smithi131.stdout:2/684: truncate dd/d14/d1f/d65/fad 924819 0 2024-02-15T18:31:39.535 INFO:tasks.workunit.client.1.smithi131.stdout:2/685: dread - dd/d10/d22/d2f/d38/d74/fa5 zero size 2024-02-15T18:31:39.535 INFO:tasks.workunit.client.1.smithi131.stdout:7/786: write d0/d17/d3a/f63 [2302954,119560] 0 2024-02-15T18:31:39.539 INFO:tasks.workunit.client.1.smithi131.stdout:4/868: rename d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/d7a/d92/le6 to d2/d2a/d85/da3/dba/l141 0 2024-02-15T18:31:39.540 INFO:tasks.workunit.client.1.smithi131.stdout:3/889: symlink d2/d22/l11a 0 2024-02-15T18:31:39.541 INFO:tasks.workunit.client.1.smithi131.stdout:9/838: mkdir d4/dc/d25/d4e/d8a/d10e 0 2024-02-15T18:31:39.543 INFO:tasks.workunit.client.1.smithi131.stdout:8/789: getdents d22/d26/d3f/d47/d48 0 2024-02-15T18:31:39.544 INFO:tasks.workunit.client.1.smithi131.stdout:9/839: read d4/dc/de/d1e/d1f/d101/d72/fa8 [1753942,128642] 0 2024-02-15T18:31:39.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/787: creat d0/d17/d3a/d3d/d79/db4/dd7/ffc x:0 0 0 2024-02-15T18:31:39.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/788: chown d0/da9/dde 58 1 2024-02-15T18:31:39.546 INFO:tasks.workunit.client.1.smithi131.stdout:7/789: write d0/d17/d3a/f54 [701805,23801] 0 2024-02-15T18:31:39.546 INFO:tasks.workunit.client.1.smithi131.stdout:2/686: dread dd/d10/d22/d2f/d38/fb9 [0,4194304] 0 2024-02-15T18:31:39.546 INFO:tasks.workunit.client.1.smithi131.stdout:3/890: creat d2/d22/d29/db/d1a/df3/f11b x:0 0 0 2024-02-15T18:31:39.547 INFO:tasks.workunit.client.1.smithi131.stdout:3/891: write d2/d22/d29/db/d23/f115 [104803,19077] 0 2024-02-15T18:31:39.547 INFO:tasks.workunit.client.1.smithi131.stdout:3/892: chown d2/d22/d3f/c93 95733245 1 2024-02-15T18:31:39.550 INFO:tasks.workunit.client.1.smithi131.stdout:4/869: dread d2/d2a/d47/d21/dcd/dfb/d110/d2e/f126 [0,4194304] 0 2024-02-15T18:31:39.551 INFO:tasks.workunit.client.1.smithi131.stdout:9/840: symlink d4/dc/de/d1e/d1f/d101/d5b/l10f 0 2024-02-15T18:31:39.551 INFO:tasks.workunit.client.1.smithi131.stdout:8/790: creat d22/d26/f10f x:0 0 0 2024-02-15T18:31:39.551 INFO:tasks.workunit.client.1.smithi131.stdout:8/791: write d22/d26/d3f/d47/d48/f104 [298541,22246] 0 2024-02-15T18:31:39.554 INFO:tasks.workunit.client.1.smithi131.stdout:7/790: rmdir d0/d9d/dc8 39 2024-02-15T18:31:39.556 INFO:tasks.workunit.client.1.smithi131.stdout:3/893: creat d2/d22/d29/db/d1a/da4/f11c x:0 0 0 2024-02-15T18:31:39.556 INFO:tasks.workunit.client.1.smithi131.stdout:3/894: dread - d2/d22/d29/db/d84/ff2 zero size 2024-02-15T18:31:39.558 INFO:tasks.workunit.client.1.smithi131.stdout:4/870: unlink d2/d2a/d47/d21/dcd/dfb/d110/dd1/c12a 0 2024-02-15T18:31:39.559 INFO:tasks.workunit.client.1.smithi131.stdout:8/792: mkdir d22/d26/d3f/d47/d57/dc5/d110 0 2024-02-15T18:31:39.559 INFO:tasks.workunit.client.1.smithi131.stdout:8/793: dread - d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f92 zero size 2024-02-15T18:31:39.559 INFO:tasks.workunit.client.1.smithi131.stdout:8/794: chown l3 1374798291 1 2024-02-15T18:31:39.562 INFO:tasks.workunit.client.1.smithi131.stdout:5/826: truncate d18/d6d/d9c/fc9 3238712 0 2024-02-15T18:31:39.562 INFO:tasks.workunit.client.1.smithi131.stdout:5/827: fsync d18/d33/d73/de8/d85/dab/fdf 0 2024-02-15T18:31:39.562 INFO:tasks.workunit.client.1.smithi131.stdout:5/828: write d18/d4e/fff [247919,50840] 0 2024-02-15T18:31:39.563 INFO:tasks.workunit.client.1.smithi131.stdout:2/687: write dd/d1e/f26 [2454849,45133] 0 2024-02-15T18:31:39.568 INFO:tasks.workunit.client.1.smithi131.stdout:3/895: mknod d2/d22/d29/dd7/c11d 0 2024-02-15T18:31:39.569 INFO:tasks.workunit.client.1.smithi131.stdout:8/795: write d22/d26/f6c [3524115,111988] 0 2024-02-15T18:31:39.572 INFO:tasks.workunit.client.1.smithi131.stdout:4/871: creat d2/d2a/d85/da3/f142 x:0 0 0 2024-02-15T18:31:39.572 INFO:tasks.workunit.client.1.smithi131.stdout:4/872: dread - d2/d2a/d47/d21/dcd/dfb/d110/d2e/f34 zero size 2024-02-15T18:31:39.576 INFO:tasks.workunit.client.1.smithi131.stdout:8/796: symlink d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/daa/l111 0 2024-02-15T18:31:39.576 INFO:tasks.workunit.client.1.smithi131.stdout:8/797: truncate d22/d2e/d5e/db5/fbe 4942767 0 2024-02-15T18:31:39.578 INFO:tasks.workunit.client.1.smithi131.stdout:4/873: read d2/d2a/d85/da3/dba/fee [5545810,89446] 0 2024-02-15T18:31:39.586 INFO:tasks.workunit.client.1.smithi131.stdout:3/896: dread d2/d22/d29/db/d1a/fe [0,4194304] 0 2024-02-15T18:31:39.586 INFO:tasks.workunit.client.1.smithi131.stdout:3/897: chown d2/f7c 8 1 2024-02-15T18:31:39.589 INFO:tasks.workunit.client.1.smithi131.stdout:9/841: dwrite d4/dc/d17/d19/d32/d91/de5/ff8 [0,4194304] 0 2024-02-15T18:31:39.589 INFO:tasks.workunit.client.1.smithi131.stdout:8/798: mkdir d22/d26/d112 0 2024-02-15T18:31:39.591 INFO:tasks.workunit.client.1.smithi131.stdout:4/874: symlink d2/d7/d96/l143 0 2024-02-15T18:31:39.591 INFO:tasks.workunit.client.1.smithi131.stdout:4/875: chown d2/d2a/d47/d21/dcd/dfb/d110/d2e/lc7 1073873 1 2024-02-15T18:31:39.591 INFO:tasks.workunit.client.1.smithi131.stdout:4/876: readlink d2/d7/d96/lec 0 2024-02-15T18:31:39.593 INFO:tasks.workunit.client.1.smithi131.stdout:8/799: write d22/d26/f35 [327760,55900] 0 2024-02-15T18:31:39.593 INFO:tasks.workunit.client.1.smithi131.stdout:8/800: read - d22/d26/d3f/d47/dc3/fdf zero size 2024-02-15T18:31:39.593 INFO:tasks.workunit.client.1.smithi131.stdout:7/791: dwrite d0/d17/d36/f8a [0,4194304] 0 2024-02-15T18:31:39.594 INFO:tasks.workunit.client.1.smithi131.stdout:3/898: creat d2/d22/d29/db/d23/f11e x:0 0 0 2024-02-15T18:31:39.594 INFO:tasks.workunit.client.1.smithi131.stdout:5/829: dwrite d18/d33/d73/de8/d85/d95/fe2 [0,4194304] 0 2024-02-15T18:31:39.600 INFO:tasks.workunit.client.1.smithi131.stdout:9/842: mknod d4/dc/dd7/c110 0 2024-02-15T18:31:39.602 INFO:tasks.workunit.client.1.smithi131.stdout:7/792: getdents d0/d34/d8e/d98 0 2024-02-15T18:31:39.603 INFO:tasks.workunit.client.1.smithi131.stdout:4/877: creat d2/d2a/d47/d21/dcd/dfb/d110/d53/f144 x:0 0 0 2024-02-15T18:31:39.607 INFO:tasks.workunit.client.1.smithi131.stdout:3/899: unlink d2/d22/d29/db/d1a/da4/d85/lc8 0 2024-02-15T18:31:39.608 INFO:tasks.workunit.client.1.smithi131.stdout:5/830: link d18/d33/d73/de8/d85/def/d10b/l45 d18/l119 0 2024-02-15T18:31:39.608 INFO:tasks.workunit.client.1.smithi131.stdout:9/843: link d4/dc/d25/d4e/d8a/c102 d4/dc/d17/d19/d32/c111 0 2024-02-15T18:31:39.611 INFO:tasks.workunit.client.1.smithi131.stdout:3/900: rename d2/d22/d29/db/d34/c8f to d2/d22/c11f 0 2024-02-15T18:31:39.612 INFO:tasks.workunit.client.1.smithi131.stdout:5/831: truncate d18/d83/d8b/dba/f55 3389363 0 2024-02-15T18:31:39.614 INFO:tasks.workunit.client.1.smithi131.stdout:5/832: creat d18/d33/d73/de8/d85/def/d10b/f11a x:0 0 0 2024-02-15T18:31:39.614 INFO:tasks.workunit.client.1.smithi131.stdout:5/833: chown d18/f92 101 1 2024-02-15T18:31:39.616 INFO:tasks.workunit.client.1.smithi131.stdout:8/801: dwrite d22/d26/d3f/d47/d48/d84/daf/f10d [0,4194304] 0 2024-02-15T18:31:39.616 INFO:tasks.workunit.client.1.smithi131.stdout:5/834: mkdir d18/d33/d73/de8/d108/d11b 0 2024-02-15T18:31:39.616 INFO:tasks.workunit.client.1.smithi131.stdout:5/835: write d18/d83/d8b/dba/ff0 [54016,36760] 0 2024-02-15T18:31:39.616 INFO:tasks.workunit.client.1.smithi131.stdout:5/836: fdatasync d18/d20/f60 0 2024-02-15T18:31:39.618 INFO:tasks.workunit.client.1.smithi131.stdout:9/844: dread d4/dc/d25/d4e/d38/f50 [0,4194304] 0 2024-02-15T18:31:39.619 INFO:tasks.workunit.client.1.smithi131.stdout:9/845: stat d4/dc/de/d1e/d1f/f3a 0 2024-02-15T18:31:39.629 INFO:tasks.workunit.client.1.smithi131.stdout:7/793: dwrite d0/d17/f82 [0,4194304] 0 2024-02-15T18:31:39.633 INFO:tasks.workunit.client.1.smithi131.stdout:9/846: dread d4/dc/d17/d19/d32/f48 [0,4194304] 0 2024-02-15T18:31:39.633 INFO:tasks.workunit.client.1.smithi131.stdout:9/847: chown d4/dc/d25/d4e/d38/l83 1895700268 1 2024-02-15T18:31:39.641 INFO:tasks.workunit.client.1.smithi131.stdout:3/901: dwrite d2/d22/d29/d9e/f106 [0,4194304] 0 2024-02-15T18:31:39.644 INFO:tasks.workunit.client.1.smithi131.stdout:4/878: getdents d2/d2a/d47/d21/dcd/dfb/d110/d53 0 2024-02-15T18:31:39.649 INFO:tasks.workunit.client.1.smithi131.stdout:3/902: getdents d2/d22/d3f 0 2024-02-15T18:31:39.649 INFO:tasks.workunit.client.1.smithi131.stdout:4/879: rename d2/d2a/d47/d16/d5a/dd2/c138 to d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/c145 0 2024-02-15T18:31:39.649 INFO:tasks.workunit.client.1.smithi131.stdout:3/903: write d2/d22/d29/db/d1a/dc3/ff9 [1791388,125064] 0 2024-02-15T18:31:39.649 INFO:tasks.workunit.client.1.smithi131.stdout:3/904: dread - d2/d22/d29/db/fff zero size 2024-02-15T18:31:39.651 INFO:tasks.workunit.client.1.smithi131.stdout:4/880: unlink d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/cb6 0 2024-02-15T18:31:39.651 INFO:tasks.workunit.client.1.smithi131.stdout:9/848: dread d4/dc/d17/db0/dbc/fe1 [0,4194304] 0 2024-02-15T18:31:39.652 INFO:tasks.workunit.client.1.smithi131.stdout:3/905: creat d2/d22/d29/db/d23/d2a/f120 x:0 0 0 2024-02-15T18:31:39.654 INFO:tasks.workunit.client.1.smithi131.stdout:4/881: mknod d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/c146 0 2024-02-15T18:31:39.656 INFO:tasks.workunit.client.1.smithi131.stdout:3/906: getdents d2/d22/d29/db/d23 0 2024-02-15T18:31:39.656 INFO:tasks.workunit.client.1.smithi131.stdout:3/907: fdatasync d2/d22/d5e/d79/d9d/f10b 0 2024-02-15T18:31:39.656 INFO:tasks.workunit.client.1.smithi131.stdout:3/908: write d2/d22/d29/db/dd1/fd6 [509670,21523] 0 2024-02-15T18:31:39.656 INFO:tasks.workunit.client.1.smithi131.stdout:7/794: dwrite d0/d9d/dc8/fdb [0,4194304] 0 2024-02-15T18:31:39.656 INFO:tasks.workunit.client.1.smithi131.stdout:7/795: truncate d0/d17/d3a/d3d/d79/db4/dd7/ffc 512379 0 2024-02-15T18:31:39.656 INFO:tasks.workunit.client.1.smithi131.stdout:7/796: write d0/d17/f82 [427271,41943] 0 2024-02-15T18:31:39.674 INFO:tasks.workunit.client.1.smithi131.stdout:7/797: truncate d0/d17/f82 3954121 0 2024-02-15T18:31:39.676 INFO:tasks.workunit.client.1.smithi131.stdout:7/798: rmdir d0/dba 39 2024-02-15T18:31:39.677 INFO:tasks.workunit.client.1.smithi131.stdout:7/799: mkdir d0/d34/d8b/dfd 0 2024-02-15T18:31:39.677 INFO:tasks.workunit.client.1.smithi131.stdout:7/800: chown d0/d17/d3a/d3d/d79/db4/dd7/leb 5390004 1 2024-02-15T18:31:39.678 INFO:tasks.workunit.client.1.smithi131.stdout:7/801: rmdir d0/d9d 39 2024-02-15T18:31:39.679 INFO:tasks.workunit.client.1.smithi131.stdout:7/802: creat d0/d34/d8b/d9a/ffe x:0 0 0 2024-02-15T18:31:39.680 INFO:tasks.workunit.client.1.smithi131.stdout:3/909: dwrite d2/d22/d29/db/dd1/fd6 [0,4194304] 0 2024-02-15T18:31:39.683 INFO:tasks.workunit.client.1.smithi131.stdout:3/910: truncate d2/d22/d29/db/d23/d2a/d49/fee 1238007 0 2024-02-15T18:31:39.694 INFO:tasks.workunit.client.1.smithi131.stdout:3/911: dread d2/d22/d29/d9e/f106 [0,4194304] 0 2024-02-15T18:31:39.695 INFO:tasks.workunit.client.1.smithi131.stdout:3/912: symlink d2/d22/d29/db/d1a/da4/d113/l121 0 2024-02-15T18:31:39.709 INFO:tasks.workunit.client.1.smithi131.stdout:3/913: dwrite d2/d22/d29/db/d1a/da4/d85/ffe [0,4194304] 0 2024-02-15T18:31:39.709 INFO:tasks.workunit.client.1.smithi131.stdout:3/914: chown d2/d22/d29/db/d1a/da4/d8d 31213 1 2024-02-15T18:31:39.711 INFO:tasks.workunit.client.1.smithi131.stdout:3/915: stat d2/d22/d29/db/d1a/da4/d70/ce2 0 2024-02-15T18:31:39.712 INFO:tasks.workunit.client.1.smithi131.stdout:3/916: mknod d2/d22/c122 0 2024-02-15T18:31:39.712 INFO:tasks.workunit.client.1.smithi131.stdout:3/917: write d2/d22/d29/d20/d86/fcc [2892162,78893] 0 2024-02-15T18:31:39.714 INFO:tasks.workunit.client.1.smithi131.stdout:3/918: link d2/d22/d29/db/d23/d2a/f2d d2/d22/f123 0 2024-02-15T18:31:39.714 INFO:tasks.workunit.client.1.smithi131.stdout:3/919: stat d2/d22/d29/db/d1a/c7a 0 2024-02-15T18:31:39.715 INFO:tasks.workunit.client.1.smithi131.stdout:3/920: creat d2/d22/d3f/de3/f124 x:0 0 0 2024-02-15T18:31:39.715 INFO:tasks.workunit.client.1.smithi131.stdout:3/921: write d2/d22/d29/db/d84/ff2 [39462,71127] 0 2024-02-15T18:31:39.715 INFO:tasks.workunit.client.1.smithi131.stdout:3/922: fsync d2/d22/d29/db/d23/d2a/d49/fee 0 2024-02-15T18:31:39.716 INFO:tasks.workunit.client.1.smithi131.stdout:3/923: mkdir d2/d22/d5e/d79/d116/d125 0 2024-02-15T18:31:39.716 INFO:tasks.workunit.client.1.smithi131.stdout:3/924: getdents d2/d22/d29/db/d1a/d110/d114 0 2024-02-15T18:31:39.716 INFO:tasks.workunit.client.1.smithi131.stdout:3/925: write d2/d22/d29/db/f3e [1172783,25819] 0 2024-02-15T18:31:39.740 INFO:tasks.workunit.client.1.smithi131.stdout:3/926: dwrite d2/d22/d29/db/d84/ff2 [0,4194304] 0 2024-02-15T18:31:39.741 INFO:tasks.workunit.client.1.smithi131.stdout:3/927: mknod d2/d22/d29/db/d34/c126 0 2024-02-15T18:31:39.742 INFO:tasks.workunit.client.1.smithi131.stdout:3/928: write d2/d22/f123 [1464523,118353] 0 2024-02-15T18:31:39.744 INFO:tasks.workunit.client.1.smithi131.stdout:3/929: dread d2/d22/d29/db/d23/d2a/f87 [0,4194304] 0 2024-02-15T18:31:39.745 INFO:tasks.workunit.client.1.smithi131.stdout:3/930: readlink d2/d22/d29/db/d23/l77 0 2024-02-15T18:31:39.745 INFO:tasks.workunit.client.1.smithi131.stdout:3/931: dread - d2/d22/d3f/de3/f124 zero size 2024-02-15T18:31:39.747 INFO:tasks.workunit.client.1.smithi131.stdout:3/932: symlink d2/l127 0 2024-02-15T18:31:39.747 INFO:tasks.workunit.client.1.smithi131.stdout:3/933: dread - d2/d22/d29/db/d1a/df3/f11b zero size 2024-02-15T18:31:39.747 INFO:tasks.workunit.client.1.smithi131.stdout:3/934: fdatasync d2/d22/d29/db/d1a/dc3/fd2 0 2024-02-15T18:31:39.764 INFO:tasks.workunit.client.1.smithi131.stdout:3/935: dwrite d2/d22/d29/db/d23/d2a/fbe [0,4194304] 0 2024-02-15T18:31:39.764 INFO:tasks.workunit.client.1.smithi131.stdout:3/936: readlink d2/d22/d3f/de3/l118 0 2024-02-15T18:31:39.766 INFO:tasks.workunit.client.1.smithi131.stdout:3/937: mknod d2/d22/d5e/d79/d9d/c128 0 2024-02-15T18:31:39.767 INFO:tasks.workunit.client.1.smithi131.stdout:3/938: write d2/d22/d29/db/d1a/da4/fd4 [4720623,42422] 0 2024-02-15T18:31:39.767 INFO:tasks.workunit.client.1.smithi131.stdout:3/939: chown d2/d22/f63 24158 1 2024-02-15T18:31:39.781 INFO:tasks.workunit.client.1.smithi131.stdout:3/940: dwrite d2/d22/d29/db/d1a/dc3/ff9 [0,4194304] 0 2024-02-15T18:31:39.793 INFO:tasks.workunit.client.1.smithi131.stdout:3/941: dread d2/d22/d29/db/d1a/da4/faa [0,4194304] 0 2024-02-15T18:31:39.793 INFO:tasks.workunit.client.1.smithi131.stdout:3/942: chown d2/d22/d3f/c51 3 1 2024-02-15T18:31:39.794 INFO:tasks.workunit.client.1.smithi131.stdout:3/943: truncate d2/d22/d29/db/dd1/fd6 1717828 0 2024-02-15T18:31:39.794 INFO:tasks.workunit.client.1.smithi131.stdout:3/944: dread - d2/d22/d29/f111 zero size 2024-02-15T18:31:39.794 INFO:tasks.workunit.client.1.smithi131.stdout:3/945: truncate d2/d22/d5e/d79/fa2 1294617 0 2024-02-15T18:31:39.794 INFO:tasks.workunit.client.1.smithi131.stdout:3/946: write d2/d22/d29/db/d1a/da4/d85/f10e [763082,94987] 0 2024-02-15T18:31:39.795 INFO:tasks.workunit.client.1.smithi131.stdout:3/947: symlink d2/d22/d29/db/d1a/df3/l129 0 2024-02-15T18:31:39.795 INFO:tasks.workunit.client.1.smithi131.stdout:3/948: write d2/d22/d3a/fb6 [855861,100414] 0 2024-02-15T18:31:39.796 INFO:tasks.workunit.client.1.smithi131.stdout:3/949: creat d2/d22/d29/db/d1a/f12a x:0 0 0 2024-02-15T18:31:39.797 INFO:tasks.workunit.client.1.smithi131.stdout:3/950: creat d2/d22/d29/db/d23/d2a/f12b x:0 0 0 2024-02-15T18:31:39.798 INFO:tasks.workunit.client.1.smithi131.stdout:3/951: chown d2/d22/c7b 6230106 1 2024-02-15T18:31:39.799 INFO:tasks.workunit.client.1.smithi131.stdout:3/952: symlink d2/d22/d29/db/dd1/l12c 0 2024-02-15T18:31:39.799 INFO:tasks.workunit.client.1.smithi131.stdout:3/953: chown d2/d22/d5e/d79/f98 165 1 2024-02-15T18:31:39.800 INFO:tasks.workunit.client.1.smithi131.stdout:3/954: mkdir d2/d22/d29/db/d1a/dc3/d12d 0 2024-02-15T18:31:39.802 INFO:tasks.workunit.client.1.smithi131.stdout:3/955: rename d2/d22/d29/d20/d86/c100 to d2/d22/d29/db/d1a/de1/c12e 0 2024-02-15T18:31:39.803 INFO:tasks.workunit.client.1.smithi131.stdout:3/956: write d2/d22/d29/f7e [1695902,112598] 0 2024-02-15T18:31:39.805 INFO:tasks.workunit.client.1.smithi131.stdout:3/957: rename d2/d22/d29/db/d1a/da4/d70/ce2 to d2/d22/d29/db/d23/d2a/d5b/c12f 0 2024-02-15T18:31:39.806 INFO:tasks.workunit.client.1.smithi131.stdout:3/958: symlink d2/l130 0 2024-02-15T18:31:39.811 INFO:tasks.workunit.client.1.smithi131.stdout:3/959: mknod d2/d22/d29/db/d23/d2a/d49/c131 0 2024-02-15T18:31:39.813 INFO:tasks.workunit.client.1.smithi131.stdout:3/960: rename d2/d22/d5e/d79/d9d/l109 to d2/d22/d3f/l132 0 2024-02-15T18:31:39.813 INFO:tasks.workunit.client.1.smithi131.stdout:3/961: read - d2/d22/d5e/fcf zero size 2024-02-15T18:31:39.815 INFO:tasks.workunit.client.1.smithi131.stdout:3/962: dread d2/d22/d29/db/d1a/da4/d8d/fc7 [0,4194304] 0 2024-02-15T18:31:39.833 INFO:tasks.workunit.client.1.smithi131.stdout:3/963: dwrite d2/d22/f2e [0,4194304] 0 2024-02-15T18:31:39.851 INFO:tasks.workunit.client.1.smithi131.stdout:3/964: dwrite d2/d22/d29/db/d23/d2a/f120 [0,4194304] 0 2024-02-15T18:31:39.851 INFO:tasks.workunit.client.1.smithi131.stdout:3/965: truncate d2/d22/d29/db/d84/f10d 1021118 0 2024-02-15T18:31:39.859 INFO:tasks.workunit.client.1.smithi131.stdout:3/966: dread d2/d22/d29/db/d84/ff2 [0,4194304] 0 2024-02-15T18:31:39.859 INFO:tasks.workunit.client.1.smithi131.stdout:3/967: dread - d2/d22/d5e/d79/d9d/f10b zero size 2024-02-15T18:31:39.859 INFO:tasks.workunit.client.1.smithi131.stdout:3/968: write d2/d22/d29/db/d1a/f12a [67121,51876] 0 2024-02-15T18:31:39.866 INFO:tasks.workunit.client.1.smithi131.stdout:3/969: dread d2/d22/d29/db/d1a/dc3/ff9 [0,4194304] 0 2024-02-15T18:31:39.866 INFO:tasks.workunit.client.1.smithi131.stdout:3/970: readlink d2/d22/d29/db/d1a/da4/d70/l112 0 2024-02-15T18:31:39.866 INFO:tasks.workunit.client.1.smithi131.stdout:3/971: fdatasync d2/d22/d5e/fb2 0 2024-02-15T18:31:39.866 INFO:tasks.workunit.client.1.smithi131.stdout:3/972: getdents d2/d22/d29/db/d23 0 2024-02-15T18:31:39.868 INFO:tasks.workunit.client.1.smithi131.stdout:3/973: unlink d2/d22/d3a/c9f 0 2024-02-15T18:31:40.374 INFO:tasks.workunit.client.1.smithi131.stdout:6/626: sync 2024-02-15T18:31:40.374 INFO:tasks.workunit.client.1.smithi131.stdout:6/627: write d2/f42 [4213901,101253] 0 2024-02-15T18:31:40.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:39.450933+0000 mgr.smithi033.apxevf (mgr.14626) 8 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.8 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 82 MiB/s rd, 163 MiB/s wr, 325 op/s 2024-02-15T18:31:40.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:39.450933+0000 mgr.smithi033.apxevf (mgr.14626) 8 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 1.8 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 82 MiB/s rd, 163 MiB/s wr, 325 op/s 2024-02-15T18:31:41.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 -- 172.21.15.33:0/2315616981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 msgr2=0x7fdd4c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 --2- 172.21.15.33:0/2315616981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 0x7fdd4c0f5850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fdd3c004660 tx=0x7fdd3c009b30).stop 2024-02-15T18:31:41.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 -- 172.21.15.33:0/2315616981 shutdown_connections 2024-02-15T18:31:41.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 --2- 172.21.15.33:0/2315616981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0f66d0 0x7fdd4c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 --2- 172.21.15.33:0/2315616981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 0x7fdd4c0f5850 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 -- 172.21.15.33:0/2315616981 >> 172.21.15.33:0/2315616981 conn(0x7fdd4c0f0b90 msgr2=0x7fdd4c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 -- 172.21.15.33:0/2315616981 shutdown_connections 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 -- 172.21.15.33:0/2315616981 wait complete. 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 Processor -- start 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.076+0000 7fdd50b9f700 1 -- start start 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd50b9f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 0x7fdd4c105d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd50b9f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0f66d0 0x7fdd4c106280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd50b9f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c106880 con 0x7fdd4c0f5430 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd50b9f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c107090 con 0x7fdd4c0f66d0 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd4b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 0x7fdd4c105d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd4b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 0x7fdd4c105d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55844/0 (socket says 172.21.15.33:55844) 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd4b7fe700 1 -- 172.21.15.33:0/3167888854 learned_addr learned my addr 172.21.15.33:0/3167888854 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd4affd700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0f66d0 0x7fdd4c106280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:41.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd4b7fe700 1 -- 172.21.15.33:0/3167888854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0f66d0 msgr2=0x7fdd4c106280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd4b7fe700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0f66d0 0x7fdd4c106280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd4b7fe700 1 -- 172.21.15.33:0/3167888854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c005040 con 0x7fdd4c0f5430 2024-02-15T18:31:41.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd4b7fe700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 0x7fdd4c105d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fdd3c004e30 tx=0x7fdd3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:41.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd43fff700 1 -- 172.21.15.33:0/3167888854 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3c018070 con 0x7fdd4c0f5430 2024-02-15T18:31:41.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c1072b0 con 0x7fdd4c0f5430 2024-02-15T18:31:41.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd43fff700 1 -- 172.21.15.33:0/3167888854 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fdd3c007ba0 con 0x7fdd4c0f5430 2024-02-15T18:31:41.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd43fff700 1 -- 172.21.15.33:0/3167888854 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3c01c3c0 con 0x7fdd4c0f5430 2024-02-15T18:31:41.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.077+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c107790 con 0x7fdd4c0f5430 2024-02-15T18:31:41.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.078+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c059100 con 0x7fdd4c0f5430 2024-02-15T18:31:41.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.079+0000 7fdd43fff700 1 -- 172.21.15.33:0/3167888854 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 27) v1 ==== 77194+0+0 (secure 0 0 0) 0x7fdd3c01d420 con 0x7fdd4c0f5430 2024-02-15T18:31:41.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.079+0000 7fdd43fff700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fdd38061000 0x7fdd380634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:41.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.079+0000 7fdd43fff700 1 -- 172.21.15.33:0/3167888854 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fdd3c07ddd0 con 0x7fdd4c0f5430 2024-02-15T18:31:41.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.079+0000 7fdd4affd700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fdd38061000 0x7fdd380634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:41.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.080+0000 7fdd4affd700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fdd38061000 0x7fdd380634c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fdd34004ce0 tx=0x7fdd3400b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:41.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.084+0000 7fdd43fff700 1 -- 172.21.15.33:0/3167888854 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7fdd3c04e230 con 0x7fdd4c0f5430 2024-02-15T18:31:41.242 INFO:tasks.workunit.client.1.smithi131.stdout:1/989: stat d0/d2/dd6 0 2024-02-15T18:31:41.242 INFO:tasks.workunit.client.1.smithi131.stdout:1/990: fdatasync d0/d2/d4/d5d/db1/f134 0 2024-02-15T18:31:41.253 INFO:tasks.workunit.client.1.smithi131.stdout:6/628: unlink d2/f42 0 2024-02-15T18:31:41.267 INFO:tasks.workunit.client.1.smithi131.stdout:6/629: mknod d2/dc/d27/d74/d75/cc2 0 2024-02-15T18:31:41.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.279+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd4c0008d0 con 0x7fdd38061000 2024-02-15T18:31:41.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.281+0000 7fdd43fff700 1 -- 172.21.15.33:0/3167888854 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fdd4c0008d0 con 0x7fdd38061000 2024-02-15T18:31:41.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.283+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fdd38061000 msgr2=0x7fdd380634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.283+0000 7fdd50b9f700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fdd38061000 0x7fdd380634c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fdd34004ce0 tx=0x7fdd3400b040).stop 2024-02-15T18:31:41.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.283+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 msgr2=0x7fdd4c105d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.283+0000 7fdd50b9f700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 0x7fdd4c105d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fdd3c004e30 tx=0x7fdd3c009b30).stop 2024-02-15T18:31:41.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.284+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 shutdown_connections 2024-02-15T18:31:41.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.284+0000 7fdd50b9f700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fdd38061000 0x7fdd380634c0 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0x7fdd34004ce0 tx=0x7fdd3400b040).stop 2024-02-15T18:31:41.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.284+0000 7fdd50b9f700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4c0f5430 0x7fdd4c105d90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.284+0000 7fdd50b9f700 1 --2- 172.21.15.33:0/3167888854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0f66d0 0x7fdd4c106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.284+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 >> 172.21.15.33:0/3167888854 conn(0x7fdd4c0f0b90 msgr2=0x7fdd4c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:41.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.284+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 shutdown_connections 2024-02-15T18:31:41.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.285+0000 7fdd50b9f700 1 -- 172.21.15.33:0/3167888854 wait complete. 2024-02-15T18:31:41.284 INFO:tasks.workunit.client.1.smithi131.stdout:6/630: read d2/dc/d27/d62/d97/f1e [1168325,127543] 0 2024-02-15T18:31:41.285 INFO:tasks.workunit.client.1.smithi131.stdout:6/631: rmdir d2/dc/d1f/dbc/db6 39 2024-02-15T18:31:41.285 INFO:tasks.workunit.client.1.smithi131.stdout:6/632: truncate d2/d2b/f9c 4771410 0 2024-02-15T18:31:41.287 INFO:tasks.workunit.client.1.smithi131.stdout:6/633: creat d2/dc/d1f/dbc/db6/fc3 x:0 0 0 2024-02-15T18:31:41.290 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:31:41.313 INFO:tasks.workunit.client.1.smithi131.stdout:6/634: dwrite d2/f1a [0,4194304] 0 2024-02-15T18:31:41.316 INFO:tasks.workunit.client.1.smithi131.stdout:6/635: write d2/d6d/db9/da4/fa6 [1927498,123146] 0 2024-02-15T18:31:41.327 INFO:tasks.workunit.client.1.smithi131.stdout:6/636: dread d2/d6d/db9/f54 [0,4194304] 0 2024-02-15T18:31:41.331 INFO:tasks.workunit.client.1.smithi131.stdout:6/637: write d2/f23 [2700153,56416] 0 2024-02-15T18:31:41.351 INFO:tasks.workunit.client.1.smithi131.stdout:6/638: dwrite d2/d6d/db9/d48/f53 [0,4194304] 0 2024-02-15T18:31:41.356 INFO:tasks.workunit.client.1.smithi131.stdout:6/639: mknod d2/d2b/cc4 0 2024-02-15T18:31:41.360 INFO:tasks.workunit.client.1.smithi131.stdout:6/640: dread d2/dc/d27/d62/d97/f25 [0,4194304] 0 2024-02-15T18:31:41.360 INFO:tasks.workunit.client.1.smithi131.stdout:6/641: write d2/d6d/db9/d12/d80/f83 [457484,125923] 0 2024-02-15T18:31:41.360 INFO:tasks.workunit.client.1.smithi131.stdout:6/642: dread - d2/dc/d27/d74/d75/fb7 zero size 2024-02-15T18:31:41.363 INFO:tasks.workunit.client.1.smithi131.stdout:0/698: sync 2024-02-15T18:31:41.363 INFO:tasks.workunit.client.1.smithi131.stdout:2/688: sync 2024-02-15T18:31:41.363 INFO:tasks.workunit.client.1.smithi131.stdout:8/802: sync 2024-02-15T18:31:41.363 INFO:tasks.workunit.client.1.smithi131.stdout:4/882: sync 2024-02-15T18:31:41.364 INFO:tasks.workunit.client.1.smithi131.stdout:7/803: sync 2024-02-15T18:31:41.364 INFO:tasks.workunit.client.1.smithi131.stdout:3/974: sync 2024-02-15T18:31:41.364 INFO:tasks.workunit.client.1.smithi131.stdout:3/975: fsync d2/d22/d5e/ff0 0 2024-02-15T18:31:41.364 INFO:tasks.workunit.client.1.smithi131.stdout:9/849: sync 2024-02-15T18:31:41.364 INFO:tasks.workunit.client.1.smithi131.stdout:5/837: sync 2024-02-15T18:31:41.364 INFO:tasks.workunit.client.1.smithi131.stdout:5/838: stat d18/d33/d73/de8/d85/def/d10b/fcc 0 2024-02-15T18:31:41.370 INFO:tasks.workunit.client.1.smithi131.stdout:2/689: write dd/f6f [1677260,42509] 0 2024-02-15T18:31:41.372 INFO:tasks.workunit.client.1.smithi131.stdout:3/976: mknod d2/d22/d29/db/d1a/da4/d85/d103/c133 0 2024-02-15T18:31:41.377 INFO:tasks.workunit.client.1.smithi131.stdout:5/839: stat c12 0 2024-02-15T18:31:41.378 INFO:tasks.workunit.client.1.smithi131.stdout:9/850: creat d4/dc/d17/d19/d84/f112 x:0 0 0 2024-02-15T18:31:41.378 INFO:tasks.workunit.client.1.smithi131.stdout:9/851: chown d4/dc/d17/d19/c1c 3323 1 2024-02-15T18:31:41.378 INFO:tasks.workunit.client.1.smithi131.stdout:7/804: rename d0/d34/d8e/cb3 to d0/d17/d3a/cff 0 2024-02-15T18:31:41.378 INFO:tasks.workunit.client.1.smithi131.stdout:7/805: stat d0/da9/de4/ff2 0 2024-02-15T18:31:41.379 INFO:tasks.workunit.client.1.smithi131.stdout:7/806: write d0/d17/d36/f48 [1389208,48705] 0 2024-02-15T18:31:41.381 INFO:tasks.workunit.client.1.smithi131.stdout:2/690: mknod dd/d10/d22/d2a/d48/ce4 0 2024-02-15T18:31:41.381 INFO:tasks.workunit.client.1.smithi131.stdout:3/977: link d2/d22/d29/db/d1a/da4/d85/ffe d2/d22/d5e/d79/d116/d125/f134 0 2024-02-15T18:31:41.381 INFO:tasks.workunit.client.1.smithi131.stdout:3/978: write d2/d22/d29/db/d1a/da4/f11c [512023,89510] 0 2024-02-15T18:31:41.382 INFO:tasks.workunit.client.1.smithi131.stdout:2/691: write dd/d14/d1f/d65/d77/f7e [2592594,55631] 0 2024-02-15T18:31:41.382 INFO:tasks.workunit.client.1.smithi131.stdout:9/852: mkdir d4/dc/d17/d19/d84/d113 0 2024-02-15T18:31:41.385 INFO:tasks.workunit.client.1.smithi131.stdout:3/979: symlink d2/l135 0 2024-02-15T18:31:41.387 INFO:tasks.workunit.client.1.smithi131.stdout:9/853: getdents d4/dc/d25/d3f 0 2024-02-15T18:31:41.387 INFO:tasks.workunit.client.1.smithi131.stdout:9/854: truncate d4/dc/d25/d4e/d8a/f8d 1997619 0 2024-02-15T18:31:41.387 INFO:tasks.workunit.client.1.smithi131.stdout:9/855: fsync d4/dc/de/d1e/fc5 0 2024-02-15T18:31:41.387 INFO:tasks.workunit.client.1.smithi131.stdout:9/856: dread - d4/dc/d17/d19/d32/dc2/ddc/fe9 zero size 2024-02-15T18:31:41.387 INFO:tasks.workunit.client.1.smithi131.stdout:9/857: stat d4/dc/d25/f55 0 2024-02-15T18:31:41.388 INFO:tasks.workunit.client.1.smithi131.stdout:3/980: link d2/d22/d3f/de3/f124 d2/d22/d29/db/d1a/df3/f136 0 2024-02-15T18:31:41.389 INFO:tasks.workunit.client.1.smithi131.stdout:9/858: mknod d4/dc/d17/d19/d32/d91/c114 0 2024-02-15T18:31:41.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/807: dwrite d0/d34/f67 [0,4194304] 0 2024-02-15T18:31:41.410 INFO:tasks.workunit.client.1.smithi131.stdout:7/808: write d0/d17/d3a/f54 [3096058,65744] 0 2024-02-15T18:31:41.411 INFO:tasks.workunit.client.1.smithi131.stdout:7/809: write d0/d34/d8e/d98/dc6/ff8 [878006,112561] 0 2024-02-15T18:31:41.411 INFO:tasks.workunit.client.1.smithi131.stdout:7/810: fsync d0/f43 0 2024-02-15T18:31:41.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.420+0000 7fa87653c700 1 -- 172.21.15.33:0/2100644306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8700f96a0 msgr2=0x7fa8700fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.420+0000 7fa87653c700 1 --2- 172.21.15.33:0/2100644306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8700f96a0 0x7fa8700fbaf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fa860004660 tx=0x7fa860009b30).stop 2024-02-15T18:31:41.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.420+0000 7fa87653c700 1 -- 172.21.15.33:0/2100644306 shutdown_connections 2024-02-15T18:31:41.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.420+0000 7fa87653c700 1 --2- 172.21.15.33:0/2100644306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8700f96a0 0x7fa8700fbaf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.420+0000 7fa87653c700 1 --2- 172.21.15.33:0/2100644306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa870060310 0x7fa8700f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.420+0000 7fa87653c700 1 -- 172.21.15.33:0/2100644306 >> 172.21.15.33:0/2100644306 conn(0x7fa8700f0ba0 msgr2=0x7fa8700f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:41.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.420+0000 7fa87653c700 1 -- 172.21.15.33:0/2100644306 shutdown_connections 2024-02-15T18:31:41.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.420+0000 7fa87653c700 1 -- 172.21.15.33:0/2100644306 wait complete. 2024-02-15T18:31:41.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87653c700 1 Processor -- start 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87653c700 1 -- start start 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87653c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870060310 0x7fa870106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87653c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8700f96a0 0x7fa870107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87653c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870107910 con 0x7fa870060310 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87653c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870108120 con 0x7fa8700f96a0 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87553a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870060310 0x7fa870106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87553a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870060310 0x7fa870106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55864/0 (socket says 172.21.15.33:55864) 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87553a700 1 -- 172.21.15.33:0/683355376 learned_addr learned my addr 172.21.15.33:0/683355376 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa874d39700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8700f96a0 0x7fa870107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87553a700 1 -- 172.21.15.33:0/683355376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8700f96a0 msgr2=0x7fa870107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87553a700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8700f96a0 0x7fa870107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa87553a700 1 -- 172.21.15.33:0/683355376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa860005040 con 0x7fa870060310 2024-02-15T18:31:41.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.421+0000 7fa874d39700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8700f96a0 0x7fa870107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:31:41.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.422+0000 7fa87553a700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870060310 0x7fa870106e20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fa86c0026d0 tx=0x7fa86c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:41.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.422+0000 7fa865ffb700 1 -- 172.21.15.33:0/683355376 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa86c009320 con 0x7fa870060310 2024-02-15T18:31:41.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.422+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8701083a0 con 0x7fa870060310 2024-02-15T18:31:41.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.422+0000 7fa865ffb700 1 -- 172.21.15.33:0/683355376 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa86c00f040 con 0x7fa870060310 2024-02-15T18:31:41.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.422+0000 7fa865ffb700 1 -- 172.21.15.33:0/683355376 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa86c0149b0 con 0x7fa870060310 2024-02-15T18:31:41.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.422+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa870108960 con 0x7fa870060310 2024-02-15T18:31:41.418 INFO:tasks.workunit.client.1.smithi131.stdout:7/811: creat d0/d34/f100 x:0 0 0 2024-02-15T18:31:41.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.423+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa870059100 con 0x7fa870060310 2024-02-15T18:31:41.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.424+0000 7fa865ffb700 1 -- 172.21.15.33:0/683355376 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 27) v1 ==== 77194+0+0 (secure 0 0 0) 0x7fa86c009480 con 0x7fa870060310 2024-02-15T18:31:41.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.424+0000 7fa865ffb700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa85c061000 0x7fa85c0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:41.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.424+0000 7fa865ffb700 1 -- 172.21.15.33:0/683355376 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa86c07c850 con 0x7fa870060310 2024-02-15T18:31:41.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.424+0000 7fa874d39700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa85c061000 0x7fa85c0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:41.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.424+0000 7fa874d39700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa85c061000 0x7fa85c0634c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa860004e30 tx=0x7fa860009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:41.420 INFO:tasks.workunit.client.1.smithi131.stdout:7/812: link d0/f65 d0/d17/d3a/d3d/d79/db4/dd7/f101 0 2024-02-15T18:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.428+0000 7fa865ffb700 1 -- 172.21.15.33:0/683355376 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7fa86c04cb80 con 0x7fa870060310 2024-02-15T18:31:41.425 INFO:tasks.workunit.client.1.smithi131.stdout:9/859: dwrite d4/dc/f56 [4194304,4194304] 0 2024-02-15T18:31:41.425 INFO:tasks.workunit.client.1.smithi131.stdout:6/643: dwrite d2/d6d/db9/d48/f49 [0,4194304] 0 2024-02-15T18:31:41.425 INFO:tasks.workunit.client.1.smithi131.stdout:9/860: fdatasync f0 0 2024-02-15T18:31:41.425 INFO:tasks.workunit.client.1.smithi131.stdout:2/692: dwrite dd/f18 [4194304,4194304] 0 2024-02-15T18:31:41.426 INFO:tasks.workunit.client.1.smithi131.stdout:5/840: dwrite d18/d83/d8b/dba/d7b/db8/ffc [0,4194304] 0 2024-02-15T18:31:41.426 INFO:tasks.workunit.client.1.smithi131.stdout:5/841: chown d18/d83/d8b/dba/d7b/deb 7 1 2024-02-15T18:31:41.426 INFO:tasks.workunit.client.1.smithi131.stdout:2/693: write dd/d10/d22/d2a/d48/fbe [1789404,102532] 0 2024-02-15T18:31:41.440 INFO:tasks.workunit.client.1.smithi131.stdout:6/644: rmdir d2/d6d 39 2024-02-15T18:31:41.444 INFO:tasks.workunit.client.1.smithi131.stdout:9/861: creat d4/dc/d17/db0/dbc/f115 x:0 0 0 2024-02-15T18:31:41.450 INFO:tasks.workunit.client.1.smithi131.stdout:9/862: mknod d4/dc/d25/d4e/d8a/c116 0 2024-02-15T18:31:41.451 INFO:tasks.workunit.client.1.smithi131.stdout:2/694: read dd/d14/d1f/d65/fad [603328,4930] 0 2024-02-15T18:31:41.451 INFO:tasks.workunit.client.1.smithi131.stdout:6/645: mknod d2/dc/d1f/daa/cc5 0 2024-02-15T18:31:41.453 INFO:tasks.workunit.client.1.smithi131.stdout:9/863: rmdir d4/dc/d17/d19/d32/dc2 39 2024-02-15T18:31:41.455 INFO:tasks.workunit.client.1.smithi131.stdout:2/695: mknod dd/d14/d1f/ce5 0 2024-02-15T18:31:41.455 INFO:tasks.workunit.client.1.smithi131.stdout:2/696: write dd/d14/f64 [1699300,24583] 0 2024-02-15T18:31:41.457 INFO:tasks.workunit.client.1.smithi131.stdout:9/864: mkdir d4/dc/de/d1e/d1f/d101/d5b/daa/d117 0 2024-02-15T18:31:41.457 INFO:tasks.workunit.client.1.smithi131.stdout:9/865: dread - d4/d78/fe7 zero size 2024-02-15T18:31:41.457 INFO:tasks.workunit.client.1.smithi131.stdout:9/866: chown d4/dc/d17/l42 0 1 2024-02-15T18:31:41.458 INFO:tasks.workunit.client.1.smithi131.stdout:2/697: creat dd/d14/d1f/d65/d77/d7a/da2/fe6 x:0 0 0 2024-02-15T18:31:41.459 INFO:tasks.workunit.client.1.smithi131.stdout:7/813: dwrite d0/d17/fbb [0,4194304] 0 2024-02-15T18:31:41.459 INFO:tasks.workunit.client.1.smithi131.stdout:7/814: chown d0/d17/d36/fef 2109435753 1 2024-02-15T18:31:41.462 INFO:tasks.workunit.client.1.smithi131.stdout:5/842: dwrite d18/d4e/fa7 [0,4194304] 0 2024-02-15T18:31:41.463 INFO:tasks.workunit.client.1.smithi131.stdout:6/646: rename d2/d2b/f37 to d2/d79/fc6 0 2024-02-15T18:31:41.465 INFO:tasks.workunit.client.1.smithi131.stdout:9/867: mknod d4/d78/d10a/c118 0 2024-02-15T18:31:41.468 INFO:tasks.workunit.client.1.smithi131.stdout:2/698: truncate dd/d10/d22/d2f/d38/d74/d2e/d6a/dc0/fd4 53059 0 2024-02-15T18:31:41.475 INFO:tasks.workunit.client.1.smithi131.stdout:6/647: symlink d2/d6d/db9/lc7 0 2024-02-15T18:31:41.475 INFO:tasks.workunit.client.1.smithi131.stdout:2/699: creat dd/d10/d22/d2f/d38/d74/d2e/d4a/fe7 x:0 0 0 2024-02-15T18:31:41.475 INFO:tasks.workunit.client.1.smithi131.stdout:5/843: creat d18/d33/d73/de8/d85/def/f11c x:0 0 0 2024-02-15T18:31:41.475 INFO:tasks.workunit.client.1.smithi131.stdout:5/844: chown d18/d6d/fb1 367228230 1 2024-02-15T18:31:41.477 INFO:tasks.workunit.client.1.smithi131.stdout:5/845: creat d18/d83/d8b/dba/d7b/dac/f11d x:0 0 0 2024-02-15T18:31:41.477 INFO:tasks.workunit.client.1.smithi131.stdout:5/846: chown d18/d33/dd6/ldc 471569302 1 2024-02-15T18:31:41.479 INFO:tasks.workunit.client.1.smithi131.stdout:5/847: rename d18/d4e/cc4 to d18/d83/d8b/dba/c11e 0 2024-02-15T18:31:41.479 INFO:tasks.workunit.client.1.smithi131.stdout:5/848: fdatasync d18/d33/d73/de8/d85/def/d10b/f32 0 2024-02-15T18:31:41.482 INFO:tasks.workunit.client.1.smithi131.stdout:5/849: read d18/d33/d73/de8/d86/fc1 [847192,117996] 0 2024-02-15T18:31:41.482 INFO:tasks.workunit.client.1.smithi131.stdout:5/850: write d18/d83/d8b/dba/f87 [498692,10864] 0 2024-02-15T18:31:41.487 INFO:tasks.workunit.client.1.smithi131.stdout:9/868: dwrite d4/dc/de/d1e/d1f/fd6 [0,4194304] 0 2024-02-15T18:31:41.490 INFO:tasks.workunit.client.1.smithi131.stdout:2/700: dread dd/d1e/f26 [0,4194304] 0 2024-02-15T18:31:41.490 INFO:tasks.workunit.client.1.smithi131.stdout:2/701: read - dd/d14/d1f/d65/d81/ddd/fe3 zero size 2024-02-15T18:31:41.491 INFO:tasks.workunit.client.1.smithi131.stdout:9/869: rename d4/dc/f56 to d4/dc/d17/d19/d32/dc2/ddc/f119 0 2024-02-15T18:31:41.493 INFO:tasks.workunit.client.1.smithi131.stdout:5/851: dread d18/d33/d73/de8/f7a [0,4194304] 0 2024-02-15T18:31:41.493 INFO:tasks.workunit.client.1.smithi131.stdout:5/852: chown d18/d4e/db6/f113 754 1 2024-02-15T18:31:41.493 INFO:tasks.workunit.client.1.smithi131.stdout:9/870: rename d4/dc/d25/d4e/c3b to d4/d78/c11a 0 2024-02-15T18:31:41.494 INFO:tasks.workunit.client.1.smithi131.stdout:5/853: creat d18/d83/d8b/dba/dda/f11f x:0 0 0 2024-02-15T18:31:41.495 INFO:tasks.workunit.client.1.smithi131.stdout:9/871: truncate f3 1324855 0 2024-02-15T18:31:41.497 INFO:tasks.workunit.client.1.smithi131.stdout:5/854: rmdir d18/d83/d8b/dba/dda/d10c 0 2024-02-15T18:31:41.497 INFO:tasks.workunit.client.1.smithi131.stdout:5/855: dread - d18/d33/d73/de8/d85/def/d10b/fcc zero size 2024-02-15T18:31:41.499 INFO:tasks.workunit.client.1.smithi131.stdout:9/872: creat d4/dc/de/d1e/d1f/d101/d5b/daa/f11b x:0 0 0 2024-02-15T18:31:41.499 INFO:tasks.workunit.client.1.smithi131.stdout:2/702: dread dd/d1e/f5f [0,4194304] 0 2024-02-15T18:31:41.500 INFO:tasks.workunit.client.1.smithi131.stdout:5/856: rmdir d18/d33/d73/de8/d108 39 2024-02-15T18:31:41.501 INFO:tasks.workunit.client.1.smithi131.stdout:9/873: mknod d4/dc/de/d1e/d1f/d101/d72/c11c 0 2024-02-15T18:31:41.504 INFO:tasks.workunit.client.1.smithi131.stdout:9/874: mkdir d4/dc/d17/d19/d32/d91/de5/d11d 0 2024-02-15T18:31:41.511 INFO:tasks.workunit.client.1.smithi131.stdout:9/875: rename d4/dc/d17/db0/dbc/lc7 to d4/dc/de/d1e/d1f/d101/d72/l11e 0 2024-02-15T18:31:41.511 INFO:tasks.workunit.client.1.smithi131.stdout:9/876: write d4/dc/de/d1e/d1f/d2c/dc0/f10b [540185,107948] 0 2024-02-15T18:31:41.515 INFO:tasks.workunit.client.1.smithi131.stdout:2/703: write dd/d14/d1f/d65/fad [131756,47959] 0 2024-02-15T18:31:41.517 INFO:tasks.workunit.client.1.smithi131.stdout:9/877: rename d4/dc/de/d1e/d1f/fe6 to d4/dc/d25/d4e/d38/f11f 0 2024-02-15T18:31:41.519 INFO:tasks.workunit.client.1.smithi131.stdout:9/878: creat d4/dc/de/d1e/d1f/d51/d5d/f120 x:0 0 0 2024-02-15T18:31:41.522 INFO:tasks.workunit.client.1.smithi131.stdout:1/991: mkdir d0/d1/d44/d59/d42/d153 0 2024-02-15T18:31:41.532 INFO:tasks.workunit.client.1.smithi131.stdout:5/857: dwrite d18/d6d/d9c/fc9 [0,4194304] 0 2024-02-15T18:31:41.536 INFO:tasks.workunit.client.1.smithi131.stdout:5/858: creat d18/d83/d8b/f120 x:0 0 0 2024-02-15T18:31:41.538 INFO:tasks.workunit.client.1.smithi131.stdout:9/879: truncate d4/dc/d25/d4e/d8a/f8d 1188000 0 2024-02-15T18:31:41.543 INFO:tasks.workunit.client.1.smithi131.stdout:1/992: dwrite d0/d2/d31/d3d/d46/f50 [0,4194304] 0 2024-02-15T18:31:41.544 INFO:tasks.workunit.client.1.smithi131.stdout:1/993: write d0/d2/db/de6/d138/f4c [7822508,85030] 0 2024-02-15T18:31:41.552 INFO:tasks.workunit.client.1.smithi131.stdout:1/994: getdents d0/d2/db/de6/d138 0 2024-02-15T18:31:41.552 INFO:tasks.workunit.client.1.smithi131.stdout:1/995: readlink d0/d2/db/de6/d138/d72/l9e 0 2024-02-15T18:31:41.552 INFO:tasks.workunit.client.1.smithi131.stdout:1/996: stat d0/d1/d44/d59/f45 0 2024-02-15T18:31:41.552 INFO:tasks.workunit.client.1.smithi131.stdout:5/859: rmdir d18/d83/d8b/dba/d7b/deb 39 2024-02-15T18:31:41.553 INFO:tasks.workunit.client.1.smithi131.stdout:5/860: write d18/d33/d73/de8/d86/fea [30659,93628] 0 2024-02-15T18:31:41.554 INFO:tasks.workunit.client.1.smithi131.stdout:9/880: getdents d4/dc/d17/db0/dbc 0 2024-02-15T18:31:41.555 INFO:tasks.workunit.client.1.smithi131.stdout:1/997: rename d0/d1/f38 to d0/d1/d16/d6b/f154 0 2024-02-15T18:31:41.555 INFO:tasks.workunit.client.1.smithi131.stdout:1/998: fsync d0/d1/d44/d59/f13d 0 2024-02-15T18:31:41.557 INFO:tasks.workunit.client.1.smithi131.stdout:9/881: creat d4/d78/d10a/f121 x:0 0 0 2024-02-15T18:31:41.558 INFO:tasks.workunit.client.1.smithi131.stdout:5/861: rename d18/d83/d8b/dba/d63/ld3 to d18/d83/d8b/dfd/l121 0 2024-02-15T18:31:41.558 INFO:tasks.workunit.client.1.smithi131.stdout:5/862: read - d18/d83/d8b/dba/dda/f11f zero size 2024-02-15T18:31:41.579 INFO:tasks.workunit.client.1.smithi131.stdout:1/999: mknod d0/d2/dd6/c155 0 2024-02-15T18:31:41.583 INFO:tasks.workunit.client.1.smithi131.stdout:5/863: dwrite d18/d83/d8b/dba/dda/f11f [0,4194304] 0 2024-02-15T18:31:41.583 INFO:tasks.workunit.client.1.smithi131.stdout:9/882: dwrite f3 [0,4194304] 0 2024-02-15T18:31:41.586 INFO:tasks.workunit.client.1.smithi131.stdout:5/864: read d18/d83/d8b/dba/d63/fcf [1216429,16009] 0 2024-02-15T18:31:41.616 INFO:tasks.workunit.client.1.smithi131.stdout:9/883: mknod d4/dc/d17/d19/d32/d100/c122 0 2024-02-15T18:31:41.620 INFO:tasks.workunit.client.1.smithi131.stdout:5/865: rmdir d18/d33/d73/de8/d85/def/d10b 39 2024-02-15T18:31:41.620 INFO:tasks.workunit.client.1.smithi131.stdout:9/884: creat d4/dc/d17/d19/f123 x:0 0 0 2024-02-15T18:31:41.621 INFO:tasks.workunit.client.1.smithi131.stdout:8/803: creat d22/d26/d3f/d47/d57/dc1/f113 x:0 0 0 2024-02-15T18:31:41.621 INFO:tasks.workunit.client.1.smithi131.stdout:8/804: chown d22/d2e/d60/lfa 7193001 1 2024-02-15T18:31:41.635 INFO:tasks.workunit.client.1.smithi131.stdout:8/805: read d22/d2e/f9a [2982553,100907] 0 2024-02-15T18:31:41.638 INFO:tasks.workunit.client.1.smithi131.stdout:5/866: dwrite d18/d83/d8b/dba/d63/f7e [0,4194304] 0 2024-02-15T18:31:41.645 INFO:tasks.workunit.client.1.smithi131.stdout:8/806: mkdir d22/d26/d3f/d47/d48/d5f/d70/db0/d114 0 2024-02-15T18:31:41.645 INFO:tasks.workunit.client.1.smithi131.stdout:8/807: truncate d22/d26/d3f/d47/d48/d5f/d6f/fc2 334640 0 2024-02-15T18:31:41.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.654+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8700feef0 con 0x7fa85c061000 2024-02-15T18:31:41.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.655+0000 7fa865ffb700 1 -- 172.21.15.33:0/683355376 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fa8700feef0 con 0x7fa85c061000 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa85c061000 msgr2=0x7fa85c0634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa85c061000 0x7fa85c0634c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa860004e30 tx=0x7fa860009b30).stop 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870060310 msgr2=0x7fa870106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870060310 0x7fa870106e20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fa86c0026d0 tx=0x7fa86c009de0).stop 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 shutdown_connections 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa85c061000 0x7fa85c0634c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa870060310 0x7fa870106e20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 --2- 172.21.15.33:0/683355376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8700f96a0 0x7fa870107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 >> 172.21.15.33:0/683355376 conn(0x7fa8700f0ba0 msgr2=0x7fa8700f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 shutdown_connections 2024-02-15T18:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.657+0000 7fa87653c700 1 -- 172.21.15.33:0/683355376 wait complete. 2024-02-15T18:31:41.651 INFO:tasks.workunit.client.1.smithi131.stdout:8/808: chown fb 95643 1 2024-02-15T18:31:41.651 INFO:tasks.workunit.client.1.smithi131.stdout:8/809: truncate d22/d26/d3f/d47/d48/f104 1124537 0 2024-02-15T18:31:41.653 INFO:tasks.workunit.client.1.smithi131.stdout:8/810: dread d22/d26/d3f/d47/d48/d5f/fa3 [0,4194304] 0 2024-02-15T18:31:41.655 INFO:tasks.workunit.client.1.smithi131.stdout:8/811: creat d22/d26/d112/f115 x:0 0 0 2024-02-15T18:31:41.656 INFO:tasks.workunit.client.1.smithi131.stdout:8/812: write d22/d26/d3f/d47/d48/f5a [1744388,21455] 0 2024-02-15T18:31:41.659 INFO:tasks.workunit.client.1.smithi131.stdout:5/867: mkdir d18/d83/d8b/dba/d7b/d112/d122 0 2024-02-15T18:31:41.660 INFO:tasks.workunit.client.1.smithi131.stdout:5/868: write d18/d33/d73/de8/d85/d95/fe2 [979534,80349] 0 2024-02-15T18:31:41.660 INFO:tasks.workunit.client.1.smithi131.stdout:5/869: write d18/d83/d8b/dba/dda/de9/ff1 [1006243,48231] 0 2024-02-15T18:31:41.666 INFO:tasks.workunit.client.1.smithi131.stdout:5/870: dread f11 [0,4194304] 0 2024-02-15T18:31:41.667 INFO:tasks.workunit.client.1.smithi131.stdout:8/813: creat d22/d26/d3f/d47/d48/d5f/d6f/f116 x:0 0 0 2024-02-15T18:31:41.667 INFO:tasks.workunit.client.1.smithi131.stdout:8/814: chown d22/d2e/d60/f10e 75 1 2024-02-15T18:31:41.667 INFO:tasks.workunit.client.1.smithi131.stdout:8/815: dread - d22/d26/d3f/d47/d48/d5f/fe6 zero size 2024-02-15T18:31:41.673 INFO:tasks.workunit.client.1.smithi131.stdout:4/883: dwrite d2/d7/fab [0,4194304] 0 2024-02-15T18:31:41.674 INFO:tasks.workunit.client.1.smithi131.stdout:8/816: fdatasync d22/d26/d3f/d47/d48/f5a 0 2024-02-15T18:31:41.676 INFO:tasks.workunit.client.1.smithi131.stdout:4/884: truncate d2/d2a/d47/d16/f32 4491447 0 2024-02-15T18:31:41.677 INFO:tasks.workunit.client.1.smithi131.stdout:8/817: dread d22/d26/d3f/d47/d48/d5f/fa3 [0,4194304] 0 2024-02-15T18:31:41.686 INFO:tasks.workunit.client.1.smithi131.stdout:4/885: dread d2/d7/d1c/f48 [0,4194304] 0 2024-02-15T18:31:41.688 INFO:tasks.workunit.client.1.smithi131.stdout:5/871: dwrite d18/d20/f2f [4194304,4194304] 0 2024-02-15T18:31:41.691 INFO:tasks.workunit.client.1.smithi131.stdout:4/886: write d2/d2a/d47/d21/f3e [106691,11564] 0 2024-02-15T18:31:41.691 INFO:tasks.workunit.client.1.smithi131.stdout:5/872: write d18/d6d/f9d [631104,44908] 0 2024-02-15T18:31:41.691 INFO:tasks.workunit.client.1.smithi131.stdout:5/873: chown d18/d33/d73/de8/d85/d95/fc0 1 1 2024-02-15T18:31:41.691 INFO:tasks.workunit.client.1.smithi131.stdout:5/874: truncate d18/d83/d89/f8a 577782 0 2024-02-15T18:31:41.691 INFO:tasks.workunit.client.1.smithi131.stdout:5/875: chown d18/d33/dd6 133842 1 2024-02-15T18:31:41.693 INFO:tasks.workunit.client.1.smithi131.stdout:5/876: creat d18/d83/d8b/dba/d7b/deb/f123 x:0 0 0 2024-02-15T18:31:41.693 INFO:tasks.workunit.client.1.smithi131.stdout:5/877: creat d18/d6d/f124 x:0 0 0 2024-02-15T18:31:41.695 INFO:tasks.workunit.client.1.smithi131.stdout:5/878: unlink d18/d83/d8b/dba/c3f 0 2024-02-15T18:31:41.697 INFO:tasks.workunit.client.1.smithi131.stdout:8/818: dwrite d22/d26/d3f/d47/d48/f8c [0,4194304] 0 2024-02-15T18:31:41.697 INFO:tasks.workunit.client.1.smithi131.stdout:8/819: write d22/d26/d3f/d47/d48/d5f/d6f/fc2 [670453,6444] 0 2024-02-15T18:31:41.697 INFO:tasks.workunit.client.1.smithi131.stdout:5/879: creat d18/d33/d73/de8/d85/dab/d115/f125 x:0 0 0 2024-02-15T18:31:41.702 INFO:tasks.workunit.client.1.smithi131.stdout:5/880: rmdir d18/d83/d8b/dba/d7b/deb 39 2024-02-15T18:31:41.705 INFO:tasks.workunit.client.1.smithi131.stdout:5/881: symlink d18/d4e/db6/l126 0 2024-02-15T18:31:41.707 INFO:tasks.workunit.client.1.smithi131.stdout:5/882: rmdir d18/d33/d73/de8/d85/def/d10b/d116 0 2024-02-15T18:31:41.709 INFO:tasks.workunit.client.1.smithi131.stdout:5/883: creat d18/d83/d8b/dba/d7b/deb/f127 x:0 0 0 2024-02-15T18:31:41.711 INFO:tasks.workunit.client.1.smithi131.stdout:8/820: truncate d22/d26/d3f/d47/d48/d5f/d6f/fb3 424399 0 2024-02-15T18:31:41.711 INFO:tasks.workunit.client.1.smithi131.stdout:8/821: chown d22/d26/d3f/d47/d48/d84/c9e 26776 1 2024-02-15T18:31:41.711 INFO:tasks.workunit.client.1.smithi131.stdout:5/884: rmdir d18/d33/d73/de8/d108/d11b 0 2024-02-15T18:31:41.712 INFO:tasks.workunit.client.1.smithi131.stdout:5/885: creat d18/d6d/d9c/f128 x:0 0 0 2024-02-15T18:31:41.712 INFO:tasks.workunit.client.1.smithi131.stdout:5/886: chown d18/d33/d73/de8/d85/dab 813413 1 2024-02-15T18:31:41.713 INFO:tasks.workunit.client.1.smithi131.stdout:5/887: creat d18/d33/d73/de8/d85/d95/f129 x:0 0 0 2024-02-15T18:31:41.713 INFO:tasks.workunit.client.1.smithi131.stdout:4/887: write d2/d2a/d47/d16/f32 [2578160,62775] 0 2024-02-15T18:31:41.714 INFO:tasks.workunit.client.1.smithi131.stdout:5/888: mknod d18/d83/d8b/dba/dda/de9/c12a 0 2024-02-15T18:31:41.714 INFO:tasks.workunit.client.1.smithi131.stdout:4/888: write d2/d7/d1c/d88/ff2 [447798,104211] 0 2024-02-15T18:31:41.715 INFO:tasks.workunit.client.1.smithi131.stdout:4/889: read d2/d2a/d47/d21/dcd/dfb/d110/d2e/d5f/d70/f116 [150857,70811] 0 2024-02-15T18:31:41.715 INFO:tasks.workunit.client.1.smithi131.stdout:4/890: readlink d2/d2a/d47/la2 0 2024-02-15T18:31:41.715 INFO:tasks.workunit.client.1.smithi131.stdout:5/889: symlink d18/d6d/l12b 0 2024-02-15T18:31:41.715 INFO:tasks.workunit.client.1.smithi131.stdout:5/890: fdatasync d18/d4e/fff 0 2024-02-15T18:31:41.715 INFO:tasks.workunit.client.1.smithi131.stdout:5/891: chown d18/d33/d73/de8/d85/def/d10b/f30 1626 1 2024-02-15T18:31:41.715 INFO:tasks.workunit.client.1.smithi131.stdout:5/892: fdatasync d18/d33/d73/de8/d85/def/d10b/f52 0 2024-02-15T18:31:41.719 INFO:tasks.workunit.client.1.smithi131.stdout:8/822: rename d22/d26/d3f/d47/d48/d84/l8b to d22/d26/d3f/d47/d48/d5f/d70/db0/l117 0 2024-02-15T18:31:41.720 INFO:tasks.workunit.client.1.smithi131.stdout:8/823: write d22/d26/f4e [3592663,116689] 0 2024-02-15T18:31:41.721 INFO:tasks.workunit.client.1.smithi131.stdout:8/824: write d22/f6b [5128445,84006] 0 2024-02-15T18:31:41.721 INFO:tasks.workunit.client.1.smithi131.stdout:8/825: chown d22/d2e/d5e/db5/fdd 3456362 1 2024-02-15T18:31:41.721 INFO:tasks.workunit.client.1.smithi131.stdout:8/826: chown d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7 118944 1 2024-02-15T18:31:41.721 INFO:tasks.workunit.client.1.smithi131.stdout:8/827: read d22/d26/d3f/d47/d57/dc1/f101 [2706067,58670] 0 2024-02-15T18:31:41.721 INFO:tasks.workunit.client.1.smithi131.stdout:8/828: stat d22/d2e/l3d 0 2024-02-15T18:31:41.724 INFO:tasks.workunit.client.1.smithi131.stdout:4/891: mknod d2/d7/d1c/d84/db8/d101/d105/c147 0 2024-02-15T18:31:41.724 INFO:tasks.workunit.client.1.smithi131.stdout:4/892: readlink d2/d2a/d47/lea 0 2024-02-15T18:31:41.724 INFO:tasks.workunit.client.1.smithi131.stdout:4/893: write d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/ff4 [4788368,42070] 0 2024-02-15T18:31:41.726 INFO:tasks.workunit.client.1.smithi131.stdout:8/829: creat d22/d26/d3f/d86/f118 x:0 0 0 2024-02-15T18:31:41.731 INFO:tasks.workunit.client.1.smithi131.stdout:5/893: dwrite d18/d4e/fcb [0,4194304] 0 2024-02-15T18:31:41.731 INFO:tasks.workunit.client.1.smithi131.stdout:5/894: chown d18/d83/d8b/dba/d7b/deb/f123 242989553 1 2024-02-15T18:31:41.731 INFO:tasks.workunit.client.1.smithi131.stdout:5/895: stat d18/d83/d8b/dba/d63/fcf 0 2024-02-15T18:31:41.731 INFO:tasks.workunit.client.1.smithi131.stdout:4/894: symlink d2/d2a/d47/d16/d43/l148 0 2024-02-15T18:31:41.731 INFO:tasks.workunit.client.1.smithi131.stdout:4/895: chown d2/d2a/d85/da3/f142 1908112 1 2024-02-15T18:31:41.734 INFO:tasks.workunit.client.1.smithi131.stdout:4/896: rename d2/l58 to d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/l149 0 2024-02-15T18:31:41.735 INFO:tasks.workunit.client.1.smithi131.stdout:4/897: mknod d2/d2a/d85/da3/c14a 0 2024-02-15T18:31:41.736 INFO:tasks.workunit.client.1.smithi131.stdout:4/898: rmdir d2/d7/d1c/d84/db8/d101 39 2024-02-15T18:31:41.736 INFO:tasks.workunit.client.1.smithi131.stdout:4/899: chown d2/f4 28 1 2024-02-15T18:31:41.736 INFO:tasks.workunit.client.1.smithi131.stdout:4/900: dread - d2/d7/d96/faf zero size 2024-02-15T18:31:41.738 INFO:tasks.workunit.client.1.smithi131.stdout:4/901: link d2/d7/d96/lec d2/d2a/d47/l14b 0 2024-02-15T18:31:41.739 INFO:tasks.workunit.client.1.smithi131.stdout:5/896: dread d18/d33/d73/de8/d85/def/d10b/f30 [0,4194304] 0 2024-02-15T18:31:41.739 INFO:tasks.workunit.client.1.smithi131.stdout:5/897: fdatasync d18/d83/d89/f8a 0 2024-02-15T18:31:41.742 INFO:tasks.workunit.client.1.smithi131.stdout:5/898: read f6 [1266704,121988] 0 2024-02-15T18:31:41.742 INFO:tasks.workunit.client.1.smithi131.stdout:5/899: chown d18/d33/d73/de8/d85/def/d10b/fad 130539 1 2024-02-15T18:31:41.743 INFO:tasks.workunit.client.1.smithi131.stdout:5/900: mkdir d18/d83/d8b/dfd/d12c 0 2024-02-15T18:31:41.744 INFO:tasks.workunit.client.1.smithi131.stdout:5/901: creat d18/d33/d73/de8/d85/def/f12d x:0 0 0 2024-02-15T18:31:41.745 INFO:tasks.workunit.client.1.smithi131.stdout:4/902: dread d2/d2a/d85/da3/dba/d118/f10d [0,4194304] 0 2024-02-15T18:31:41.746 INFO:tasks.workunit.client.1.smithi131.stdout:5/902: link d18/d33/d73/de8/d85/dab/d115/f125 d18/d33/f12e 0 2024-02-15T18:31:41.747 INFO:tasks.workunit.client.1.smithi131.stdout:8/830: dwrite d22/d26/d3f/d86/f100 [0,4194304] 0 2024-02-15T18:31:41.747 INFO:tasks.workunit.client.1.smithi131.stdout:8/831: chown d22/d26/d3f/d7c/fd9 135 1 2024-02-15T18:31:41.748 INFO:tasks.workunit.client.1.smithi131.stdout:5/903: dread d18/d33/d73/de8/d85/f9f [0,4194304] 0 2024-02-15T18:31:41.751 INFO:tasks.workunit.client.1.smithi131.stdout:8/832: stat d22/d26/d3f/d47/dc3/cf3 0 2024-02-15T18:31:41.751 INFO:tasks.workunit.client.1.smithi131.stdout:8/833: truncate d22/d26/d3f/d47/d48/d5f/d6f/f108 1029375 0 2024-02-15T18:31:41.751 INFO:tasks.workunit.client.1.smithi131.stdout:5/904: link d18/d83/d8b/dba/c3d d18/d33/d73/de8/d85/d95/d100/c12f 0 2024-02-15T18:31:41.754 INFO:tasks.workunit.client.1.smithi131.stdout:5/905: getdents d18/d83/d8b/dba 0 2024-02-15T18:31:41.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/834: mkdir d22/d119 0 2024-02-15T18:31:41.756 INFO:tasks.workunit.client.1.smithi131.stdout:8/835: mknod d22/d26/d3f/d47/d48/d5f/d70/dc7/c11a 0 2024-02-15T18:31:41.757 INFO:tasks.workunit.client.1.smithi131.stdout:8/836: truncate d22/d26/d3f/d47/fae 457412 0 2024-02-15T18:31:41.766 INFO:tasks.workunit.client.1.smithi131.stdout:4/903: dwrite d2/d7/d1c/f44 [0,4194304] 0 2024-02-15T18:31:41.768 INFO:tasks.workunit.client.1.smithi131.stdout:4/904: rename d2/f8 to d2/d2a/d85/da3/dba/d118/d12d/d133/f14c 0 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.779+0000 7f6b5181a700 1 -- 172.21.15.33:0/2022811493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f6860 msgr2=0x7f6b4c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.779+0000 7f6b5181a700 1 --2- 172.21.15.33:0/2022811493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f6860 0x7f6b4c0f6cc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f6b40004660 tx=0x7f6b40009b30).stop 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.779+0000 7f6b5181a700 1 -- 172.21.15.33:0/2022811493 shutdown_connections 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.779+0000 7f6b5181a700 1 --2- 172.21.15.33:0/2022811493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f6860 0x7f6b4c0f6cc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.779+0000 7f6b5181a700 1 --2- 172.21.15.33:0/2022811493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b4c0f55c0 0x7f6b4c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.779+0000 7f6b5181a700 1 -- 172.21.15.33:0/2022811493 >> 172.21.15.33:0/2022811493 conn(0x7f6b4c0f0d40 msgr2=0x7f6b4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.779+0000 7f6b5181a700 1 -- 172.21.15.33:0/2022811493 shutdown_connections 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.779+0000 7f6b5181a700 1 -- 172.21.15.33:0/2022811493 wait complete. 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.780+0000 7f6b5181a700 1 Processor -- start 2024-02-15T18:31:41.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.780+0000 7f6b5181a700 1 -- start start 2024-02-15T18:31:41.774 INFO:tasks.workunit.client.1.smithi131.stdout:4/905: dread d2/d2a/d47/d21/f41 [0,4194304] 0 2024-02-15T18:31:41.774 INFO:tasks.workunit.client.1.smithi131.stdout:4/906: read - d2/d2a/d47/d21/dcd/dfb/d110/d2e/d5f/d123/f10c zero size 2024-02-15T18:31:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b5181a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f55c0 0x7f6b4c105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b5181a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b4c0f6860 0x7f6b4c1063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b5181a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c106950 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b5181a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c106a90 con 0x7f6b4c0f6860 2024-02-15T18:31:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b4affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f55c0 0x7f6b4c105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b4affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f55c0 0x7f6b4c105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55874/0 (socket says 172.21.15.33:55874) 2024-02-15T18:31:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b4affd700 1 -- 172.21.15.33:0/755974335 learned_addr learned my addr 172.21.15.33:0/755974335 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:41.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b4a7fc700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b4c0f6860 0x7f6b4c1063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b4affd700 1 -- 172.21.15.33:0/755974335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b4c0f6860 msgr2=0x7f6b4c1063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b4affd700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b4c0f6860 0x7f6b4c1063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b4affd700 1 -- 172.21.15.33:0/755974335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40005040 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.781+0000 7f6b4affd700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f55c0 0x7f6b4c105eb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f6b3c00e7c0 tx=0x7f6b3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.782+0000 7f6b337fe700 1 -- 172.21.15.33:0/755974335 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b3c0092e0 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.782+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c107430 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.782+0000 7f6b337fe700 1 -- 172.21.15.33:0/755974335 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f6b3c00f040 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.782+0000 7f6b337fe700 1 -- 172.21.15.33:0/755974335 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b3c014880 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.782+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c1079f0 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.783+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c045ad0 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.783+0000 7f6b337fe700 1 -- 172.21.15.33:0/755974335 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 27) v1 ==== 77194+0+0 (secure 0 0 0) 0x7f6b3c01b030 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.784+0000 7f6b337fe700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6b34061000 0x7f6b340634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.784+0000 7f6b337fe700 1 -- 172.21.15.33:0/755974335 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6b3c07c2b0 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.784+0000 7f6b4a7fc700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6b34061000 0x7f6b340634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:41.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.784+0000 7f6b4a7fc700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6b34061000 0x7f6b340634c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6b40009720 tx=0x7f6b4000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:41.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:41.791+0000 7f6b337fe700 1 -- 172.21.15.33:0/755974335 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f6b3c0500d0 con 0x7f6b4c0f55c0 2024-02-15T18:31:41.793 INFO:tasks.workunit.client.1.smithi131.stdout:5/906: dwrite d18/d33/d73/de8/d85/dab/d115/f125 [0,4194304] 0 2024-02-15T18:31:41.793 INFO:tasks.workunit.client.1.smithi131.stdout:8/837: dwrite d22/d26/f35 [0,4194304] 0 2024-02-15T18:31:41.794 INFO:tasks.workunit.client.1.smithi131.stdout:4/907: dwrite d2/d2a/d47/f113 [0,4194304] 0 2024-02-15T18:31:41.796 INFO:tasks.workunit.client.1.smithi131.stdout:5/907: rename d18/d6d/fb1 to d18/d83/f130 0 2024-02-15T18:31:41.797 INFO:tasks.workunit.client.1.smithi131.stdout:5/908: mkdir d18/d33/d73/de8/d85/dab/d131 0 2024-02-15T18:31:41.798 INFO:tasks.workunit.client.1.smithi131.stdout:5/909: mkdir d18/d33/d73/de8/d108/d132 0 2024-02-15T18:31:41.859 INFO:tasks.workunit.client.1.smithi131.stdout:8/838: rename d22/d26/d3f/c52 to d22/d26/d3f/d47/d48/d84/daf/c11b 0 2024-02-15T18:31:41.859 INFO:tasks.workunit.client.1.smithi131.stdout:8/839: stat d22/f6b 0 2024-02-15T18:31:41.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/910: dwrite fb [0,4194304] 0 2024-02-15T18:31:41.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/911: fdatasync d18/d4e/fdb 0 2024-02-15T18:31:41.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/912: dread - d18/d33/d73/de8/d85/def/f12d zero size 2024-02-15T18:31:41.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/913: dread - d18/d83/d8b/dba/d7b/dac/f11d zero size 2024-02-15T18:31:41.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/914: chown d18/d33/d73/de8/d86/fd2 7940 1 2024-02-15T18:31:41.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/915: write d18/d6d/d70/f81 [745360,59460] 0 2024-02-15T18:31:41.864 INFO:tasks.workunit.client.1.smithi131.stdout:5/916: mkdir d18/d83/d133 0 2024-02-15T18:31:41.865 INFO:tasks.workunit.client.1.smithi131.stdout:4/908: rename d2/d2a/d47/df0/lff to d2/d2a/d47/d21/dcd/l14d 0 2024-02-15T18:31:41.867 INFO:tasks.workunit.client.1.smithi131.stdout:8/840: symlink d22/d26/d3f/d47/d48/d5f/d6f/l11c 0 2024-02-15T18:31:41.869 INFO:tasks.workunit.client.1.smithi131.stdout:4/909: truncate d2/d7/fab 281495 0 2024-02-15T18:31:41.872 INFO:tasks.workunit.client.1.smithi131.stdout:4/910: mkdir d2/d2a/d85/da3/dba/d14e 0 2024-02-15T18:31:41.872 INFO:tasks.workunit.client.1.smithi131.stdout:4/911: readlink d2/d7/lb0 0 2024-02-15T18:31:41.887 INFO:tasks.workunit.client.1.smithi131.stdout:5/917: dwrite d18/d33/d73/de8/d85/dab/d115/f125 [4194304,4194304] 0 2024-02-15T18:31:41.888 INFO:tasks.workunit.client.1.smithi131.stdout:5/918: read d18/d83/d8b/dba/f87 [487025,40540] 0 2024-02-15T18:31:41.891 INFO:tasks.workunit.client.1.smithi131.stdout:4/912: dwrite d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/f7b [0,4194304] 0 2024-02-15T18:31:41.891 INFO:tasks.workunit.client.1.smithi131.stdout:4/913: dread - d2/d2a/d85/da3/dbf/f12c zero size 2024-02-15T18:31:41.894 INFO:tasks.workunit.client.1.smithi131.stdout:4/914: dread d2/d2a/d47/d16/d43/fb3 [0,4194304] 0 2024-02-15T18:31:41.894 INFO:tasks.workunit.client.1.smithi131.stdout:4/915: fdatasync d2/d2a/d85/da3/dbf/f12c 0 2024-02-15T18:31:41.894 INFO:tasks.workunit.client.1.smithi131.stdout:4/916: chown d2/d7/ce9 94911 1 2024-02-15T18:31:41.896 INFO:tasks.workunit.client.1.smithi131.stdout:4/917: creat d2/d7/d1c/f14f x:0 0 0 2024-02-15T18:31:41.907 INFO:tasks.workunit.client.1.smithi131.stdout:4/918: dread d2/d7/d1c/d94/fdd [0,4194304] 0 2024-02-15T18:31:41.907 INFO:tasks.workunit.client.1.smithi131.stdout:5/919: dwrite d18/f1e [8388608,4194304] 0 2024-02-15T18:31:41.908 INFO:tasks.workunit.client.1.smithi131.stdout:5/920: write d18/d4e/db6/ff7 [757485,48883] 0 2024-02-15T18:31:41.908 INFO:tasks.workunit.client.1.smithi131.stdout:5/921: dread d18/d6d/d70/fb3 [4194304,4194304] 0 2024-02-15T18:31:41.909 INFO:tasks.workunit.client.1.smithi131.stdout:4/919: rmdir d2/d2a/d47/d21/d9e/d111/d13d 39 2024-02-15T18:31:41.909 INFO:tasks.workunit.client.1.smithi131.stdout:5/922: write d18/d4e/fa7 [3558177,27889] 0 2024-02-15T18:31:41.911 INFO:tasks.workunit.client.1.smithi131.stdout:4/920: creat d2/d2a/d85/da3/dba/f150 x:0 0 0 2024-02-15T18:31:41.914 INFO:tasks.workunit.client.1.smithi131.stdout:4/921: dread d2/d2a/d47/d21/dcd/dfb/d110/fa0 [0,4194304] 0 2024-02-15T18:31:41.915 INFO:tasks.workunit.client.1.smithi131.stdout:4/922: write d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/f69 [4066953,81107] 0 2024-02-15T18:31:41.917 INFO:tasks.workunit.client.1.smithi131.stdout:4/923: mknod d2/d2a/d47/d16/d5a/dd2/c151 0 2024-02-15T18:31:41.924 INFO:tasks.workunit.client.1.smithi131.stdout:5/923: dwrite d18/d33/d73/de8/f7a [0,4194304] 0 2024-02-15T18:31:41.925 INFO:tasks.workunit.client.1.smithi131.stdout:5/924: creat d18/d6d/d70/f134 x:0 0 0 2024-02-15T18:31:41.926 INFO:tasks.workunit.client.1.smithi131.stdout:4/924: dread d2/d2a/d47/d21/dcd/dfb/d110/f9c [0,4194304] 0 2024-02-15T18:31:41.926 INFO:tasks.workunit.client.1.smithi131.stdout:5/925: truncate d18/f92 610441 0 2024-02-15T18:31:41.929 INFO:tasks.workunit.client.1.smithi131.stdout:4/925: rmdir d2/d2a/d85/d139 0 2024-02-15T18:31:41.930 INFO:tasks.workunit.client.1.smithi131.stdout:4/926: mknod d2/d2a/d47/d21/dcd/c152 0 2024-02-15T18:31:41.931 INFO:tasks.workunit.client.1.smithi131.stdout:4/927: read d2/d7/f137 [2443277,53530] 0 2024-02-15T18:31:41.931 INFO:tasks.workunit.client.1.smithi131.stdout:4/928: fdatasync d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/fc8 0 2024-02-15T18:31:41.933 INFO:tasks.workunit.client.1.smithi131.stdout:4/929: rename d2/d2a/d85/da3/dba/l112 to d2/d23/d120/l153 0 2024-02-15T18:31:41.934 INFO:tasks.workunit.client.1.smithi131.stdout:4/930: write d2/d2a/f42 [3768332,27945] 0 2024-02-15T18:31:41.935 INFO:tasks.workunit.client.1.smithi131.stdout:5/926: dread d18/d83/d8b/dba/f2c [0,4194304] 0 2024-02-15T18:31:41.935 INFO:tasks.workunit.client.1.smithi131.stdout:5/927: fsync d18/d33/d73/de8/d85/d95/f129 0 2024-02-15T18:31:41.936 INFO:tasks.workunit.client.1.smithi131.stdout:5/928: dread d18/d83/d8b/dba/f87 [0,4194304] 0 2024-02-15T18:31:41.937 INFO:tasks.workunit.client.1.smithi131.stdout:4/931: creat d2/d7/d1c/d84/db8/d101/d105/f154 x:0 0 0 2024-02-15T18:31:41.937 INFO:tasks.workunit.client.1.smithi131.stdout:4/932: fsync d2/d2a/d47/d21/dcd/fe1 0 2024-02-15T18:31:41.937 INFO:tasks.workunit.client.1.smithi131.stdout:5/929: symlink d18/d33/d73/de8/d86/d109/l135 0 2024-02-15T18:31:41.938 INFO:tasks.workunit.client.1.smithi131.stdout:4/933: symlink d2/d7/d1c/l155 0 2024-02-15T18:31:41.939 INFO:tasks.workunit.client.1.smithi131.stdout:5/930: link d18/d83/d8b/dba/dda/de9/c12a d18/d33/d73/de8/d85/dab/c136 0 2024-02-15T18:31:41.939 INFO:tasks.workunit.client.1.smithi131.stdout:5/931: chown d18/d83/d8b/dba/d7b/dee/l10f 14152481 1 2024-02-15T18:31:41.940 INFO:tasks.workunit.client.1.smithi131.stdout:5/932: fdatasync d18/f19 0 2024-02-15T18:31:41.941 INFO:tasks.workunit.client.1.smithi131.stdout:5/933: creat d18/d83/f137 x:0 0 0 2024-02-15T18:31:41.942 INFO:tasks.workunit.client.1.smithi131.stdout:5/934: mkdir d18/d83/d8b/dba/d7b/d112/d138 0 2024-02-15T18:31:41.944 INFO:tasks.workunit.client.1.smithi131.stdout:5/935: mkdir d18/d33/d73/de8/d85/d139 0 2024-02-15T18:31:41.950 INFO:tasks.workunit.client.1.smithi131.stdout:5/936: dread f6 [0,4194304] 0 2024-02-15T18:31:41.950 INFO:tasks.workunit.client.1.smithi131.stdout:5/937: dread - d18/d83/f137 zero size 2024-02-15T18:31:41.956 INFO:tasks.workunit.client.1.smithi131.stdout:4/934: rename d2/d7/d1c/d84 to d2/d2a/d47/d21/d156 0 2024-02-15T18:31:41.958 INFO:tasks.workunit.client.1.smithi131.stdout:4/935: mkdir d2/d2a/d47/d21/dcd/dfb/d110/d157 0 2024-02-15T18:31:41.958 INFO:tasks.workunit.client.1.smithi131.stdout:5/938: rename d18/d33/d73/de8/f7a to d18/d83/d8b/dba/d7b/d112/d138/f13a 0 2024-02-15T18:31:41.958 INFO:tasks.workunit.client.1.smithi131.stdout:5/939: write d18/d83/d8b/dba/d7b/db8/fb9 [104652,31731] 0 2024-02-15T18:31:41.960 INFO:tasks.workunit.client.1.smithi131.stdout:4/936: dread d2/d2a/d76/ddb/df1/f12f [0,4194304] 0 2024-02-15T18:31:41.960 INFO:tasks.workunit.client.1.smithi131.stdout:4/937: stat d2/d7/d1c/c8b 0 2024-02-15T18:31:41.962 INFO:tasks.workunit.client.1.smithi131.stdout:4/938: read d2/d7/d1c/d94/fa1 [2291429,66077] 0 2024-02-15T18:31:41.963 INFO:tasks.workunit.client.1.smithi131.stdout:4/939: truncate d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/f7b 104852 0 2024-02-15T18:31:41.963 INFO:tasks.workunit.client.1.smithi131.stdout:4/940: dread - d2/d2a/f9f zero size 2024-02-15T18:31:41.965 INFO:tasks.workunit.client.1.smithi131.stdout:4/941: creat d2/d2a/d76/ddb/df1/f158 x:0 0 0 2024-02-15T18:31:41.972 INFO:tasks.workunit.client.1.smithi131.stdout:4/942: write d2/d2a/d47/d21/dcd/dfb/d110/d2e/f126 [2224215,33936] 0 2024-02-15T18:31:41.972 INFO:tasks.workunit.client.1.smithi131.stdout:5/940: dwrite d18/d33/d73/de8/d85/def/d10b/f11a [0,4194304] 0 2024-02-15T18:31:41.975 INFO:tasks.workunit.client.1.smithi131.stdout:5/941: getdents d18/d33/dd6 0 2024-02-15T18:31:41.975 INFO:tasks.workunit.client.1.smithi131.stdout:5/942: dread - d18/d20/fa8 zero size 2024-02-15T18:31:41.975 INFO:tasks.workunit.client.1.smithi131.stdout:5/943: creat d18/d33/d73/de8/d85/def/f13b x:0 0 0 2024-02-15T18:31:41.977 INFO:tasks.workunit.client.1.smithi131.stdout:4/943: unlink d2/d2a/d47/d21/dcd/le4 0 2024-02-15T18:31:41.978 INFO:tasks.workunit.client.1.smithi131.stdout:4/944: write d2/d2a/d47/d21/f3a [2318114,99505] 0 2024-02-15T18:31:41.980 INFO:tasks.workunit.client.1.smithi131.stdout:4/945: creat d2/d23/f159 x:0 0 0 2024-02-15T18:31:41.982 INFO:tasks.workunit.client.1.smithi131.stdout:4/946: symlink d2/d7/d96/l15a 0 2024-02-15T18:31:41.984 INFO:tasks.workunit.client.1.smithi131.stdout:4/947: rename d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/fc8 to d2/d2a/d47/d16/f15b 0 2024-02-15T18:31:41.984 INFO:tasks.workunit.client.1.smithi131.stdout:4/948: dread - d2/d2a/d76/ddb/df1/f158 zero size 2024-02-15T18:31:41.985 INFO:tasks.workunit.client.1.smithi131.stdout:4/949: write d2/d2a/d47/d21/f41 [1934013,5241] 0 2024-02-15T18:31:41.985 INFO:tasks.workunit.client.1.smithi131.stdout:4/950: dread - d2/d2a/d47/d21/dcd/dfb/d110/d2e/d5f/d123/f10c zero size 2024-02-15T18:31:41.986 INFO:tasks.workunit.client.1.smithi131.stdout:4/951: write d2/d7/d1c/d94/f95 [1873029,85430] 0 2024-02-15T18:31:41.986 INFO:tasks.workunit.client.1.smithi131.stdout:4/952: write d2/d7/f8a [342523,71919] 0 2024-02-15T18:31:41.993 INFO:tasks.workunit.client.1.smithi131.stdout:5/944: dwrite d18/f19 [0,4194304] 0 2024-02-15T18:31:41.993 INFO:tasks.workunit.client.1.smithi131.stdout:5/945: dread - d18/d33/d73/de8/d85/d95/f129 zero size 2024-02-15T18:31:41.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.002+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b4c107c10 con 0x7f6b34061000 2024-02-15T18:31:41.997 INFO:tasks.workunit.client.1.smithi131.stdout:5/946: read d18/f92 [11272,105970] 0 2024-02-15T18:31:41.998 INFO:tasks.workunit.client.1.smithi131.stdout:5/947: mknod d18/d33/d73/de8/d86/c13c 0 2024-02-15T18:31:41.998 INFO:tasks.workunit.client.1.smithi131.stdout:5/948: fsync d18/d83/d8b/dba/d63/f75 0 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.015+0000 7f6b337fe700 1 -- 172.21.15.33:0/755974335 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f6b4c107c10 con 0x7f6b34061000 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (6m) 6s ago 8m 15.8M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (8m) 6s ago 8m 6391k - 16.2.4 8d91d370c2b8 6deae8bbd6c5 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (7m) 61s ago 7m 6395k - 16.2.4 8d91d370c2b8 e45b11308af7 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (6m) 6s ago 8m 34.0M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (2m) 6s ago 2m 15.9M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (2m) 6s ago 2m 11.6M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (2m) 61s ago 2m 46.7M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:31:42.009 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (3m) 61s ago 3m 120M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (23s) 6s ago 9m 409M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (74s) 61s ago 7m 413M - 16.2.14-521-g0e714d9a 1fbc92c859dc 220e23710038 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (9m) 6s ago 9m 53.4M 2048M 16.2.4 8d91d370c2b8 04c43c0cba21 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (7m) 61s ago 7m 42.3M 2048M 16.2.4 8d91d370c2b8 710ae4544ec3 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (7m) 6s ago 7m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (6m) 61s ago 6m 17.0M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (6m) 6s ago 6m 309M 4096M 16.2.4 8d91d370c2b8 8fd8ca242c54 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (6m) 6s ago 6m 334M 4096M 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (5m) 6s ago 5m 304M 4096M 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (5m) 61s ago 5m 77.5M 4096M 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (5m) 61s ago 5m 73.6M 4096M 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (4m) 61s ago 4m 83.2M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:31:42.010 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (29s) 6s ago 7m 44.0M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:31:42.011 INFO:tasks.workunit.client.1.smithi131.stdout:4/953: dwrite d2/d7/d1c/d11c/f11d [0,4194304] 0 2024-02-15T18:31:42.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6b34061000 msgr2=0x7f6b340634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6b34061000 0x7f6b340634c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6b40009720 tx=0x7f6b4000b040).stop 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f55c0 msgr2=0x7f6b4c105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f55c0 0x7f6b4c105eb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f6b3c00e7c0 tx=0x7f6b3c00b040).stop 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 shutdown_connections 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6b34061000 0x7f6b340634c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0f55c0 0x7f6b4c105eb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 --2- 172.21.15.33:0/755974335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b4c0f6860 0x7f6b4c1063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 >> 172.21.15.33:0/755974335 conn(0x7f6b4c0f0d40 msgr2=0x7f6b4c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 shutdown_connections 2024-02-15T18:31:42.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.017+0000 7f6b5181a700 1 -- 172.21.15.33:0/755974335 wait complete. 2024-02-15T18:31:42.018 INFO:tasks.workunit.client.1.smithi131.stdout:4/954: dread d2/d2a/d47/d21/dcd/fe1 [0,4194304] 0 2024-02-15T18:31:42.020 INFO:tasks.workunit.client.1.smithi131.stdout:4/955: creat d2/d2a/d47/d21/dcd/dfb/d110/d2e/f15c x:0 0 0 2024-02-15T18:31:42.020 INFO:tasks.workunit.client.1.smithi131.stdout:4/956: chown d2/d2a/d47/d21/d156/db8/d101 86 1 2024-02-15T18:31:42.023 INFO:tasks.workunit.client.1.smithi131.stdout:4/957: dread d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/f7b [0,4194304] 0 2024-02-15T18:31:42.024 INFO:tasks.workunit.client.1.smithi131.stdout:4/958: write d2/d7/fc [3020728,4242] 0 2024-02-15T18:31:42.026 INFO:tasks.workunit.client.1.smithi131.stdout:4/959: creat d2/f15d x:0 0 0 2024-02-15T18:31:42.027 INFO:tasks.workunit.client.1.smithi131.stdout:4/960: truncate d2/d7/f8a 938745 0 2024-02-15T18:31:42.041 INFO:tasks.workunit.client.1.smithi131.stdout:4/961: dwrite d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/d7a/d92/fad [0,4194304] 0 2024-02-15T18:31:42.042 INFO:tasks.workunit.client.1.smithi131.stdout:4/962: write d2/d7/d1c/d88/ff2 [124059,95490] 0 2024-02-15T18:31:42.060 INFO:tasks.workunit.client.1.smithi131.stdout:4/963: dwrite d2/d2a/f9f [0,4194304] 0 2024-02-15T18:31:42.079 INFO:tasks.workunit.client.1.smithi131.stdout:4/964: dwrite d2/d7/d1c/d88/ff2 [0,4194304] 0 2024-02-15T18:31:42.094 INFO:tasks.workunit.client.1.smithi131.stdout:4/965: dwrite d2/d2a/d47/d21/dcd/dfb/d110/d53/f144 [0,4194304] 0 2024-02-15T18:31:42.094 INFO:tasks.workunit.client.1.smithi131.stdout:4/966: fsync d2/d2a/d47/d21/dcd/dfb/d110/d2e/f34 0 2024-02-15T18:31:42.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/967: mkdir d2/d2a/d15e 0 2024-02-15T18:31:42.100 INFO:tasks.workunit.client.1.smithi131.stdout:4/968: dread d2/d2a/d47/d21/dcd/fe1 [0,4194304] 0 2024-02-15T18:31:42.101 INFO:tasks.workunit.client.1.smithi131.stdout:4/969: write d2/d2a/d76/ddb/df1/f158 [512158,66478] 0 2024-02-15T18:31:42.102 INFO:tasks.workunit.client.1.smithi131.stdout:4/970: read d2/d2a/d47/d21/f3a [89651,58878] 0 2024-02-15T18:31:42.102 INFO:tasks.workunit.client.1.smithi131.stdout:4/971: chown d2/d2a/d85/da3/dba 7 1 2024-02-15T18:31:42.102 INFO:tasks.workunit.client.1.smithi131.stdout:4/972: fdatasync d2/d7/f8a 0 2024-02-15T18:31:42.102 INFO:tasks.workunit.client.1.smithi131.stdout:4/973: write d2/d23/fc4 [4644376,112005] 0 2024-02-15T18:31:42.119 INFO:tasks.workunit.client.1.smithi131.stdout:4/974: dwrite d2/d2a/d47/d16/d43/fb3 [0,4194304] 0 2024-02-15T18:31:42.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.127+0000 7f67cac5c700 1 -- 172.21.15.33:0/3419543924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f4bc0 msgr2=0x7f67c40f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.127+0000 7f67cac5c700 1 --2- 172.21.15.33:0/3419543924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f4bc0 0x7f67c40f4fe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f67c0004770 tx=0x7f67c000ac40).stop 2024-02-15T18:31:42.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.127+0000 7f67cac5c700 1 -- 172.21.15.33:0/3419543924 shutdown_connections 2024-02-15T18:31:42.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.127+0000 7f67cac5c700 1 --2- 172.21.15.33:0/3419543924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67c40f5e60 0x7f67c40f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.127+0000 7f67cac5c700 1 --2- 172.21.15.33:0/3419543924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f4bc0 0x7f67c40f4fe0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.127+0000 7f67cac5c700 1 -- 172.21.15.33:0/3419543924 >> 172.21.15.33:0/3419543924 conn(0x7f67c40f0320 msgr2=0x7f67c40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:42.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.128+0000 7f67cac5c700 1 -- 172.21.15.33:0/3419543924 shutdown_connections 2024-02-15T18:31:42.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.128+0000 7f67cac5c700 1 -- 172.21.15.33:0/3419543924 wait complete. 2024-02-15T18:31:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.129+0000 7f67cac5c700 1 Processor -- start 2024-02-15T18:31:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.129+0000 7f67cac5c700 1 -- start start 2024-02-15T18:31:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.129+0000 7f67cac5c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67c40f4bc0 0x7f67c4106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.129+0000 7f67cac5c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f5e60 0x7f67c41073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.129+0000 7f67cac5c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4107950 con 0x7f67c40f5e60 2024-02-15T18:31:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.129+0000 7f67cac5c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4108150 con 0x7f67c40f4bc0 2024-02-15T18:31:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.129+0000 7f67c9459700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f5e60 0x7f67c41073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.129+0000 7f67c9459700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f5e60 0x7f67c41073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55888/0 (socket says 172.21.15.33:55888) 2024-02-15T18:31:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.129+0000 7f67c9459700 1 -- 172.21.15.33:0/2978182624 learned_addr learned my addr 172.21.15.33:0/2978182624 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67c9c5a700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67c40f4bc0 0x7f67c4106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67c9459700 1 -- 172.21.15.33:0/2978182624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67c40f4bc0 msgr2=0x7f67c4106eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67c9459700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67c40f4bc0 0x7f67c4106eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67c9459700 1 -- 172.21.15.33:0/2978182624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c0005040 con 0x7f67c40f5e60 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67c9c5a700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67c40f4bc0 0x7f67c4106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67c9459700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f5e60 0x7f67c41073a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f67b4002700 tx=0x7f67b4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67ba7fc700 1 -- 172.21.15.33:0/2978182624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67b4009320 con 0x7f67c40f5e60 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67ba7fc700 1 -- 172.21.15.33:0/2978182624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f67b400f040 con 0x7f67c40f5e60 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c4108430 con 0x7f67c40f5e60 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67ba7fc700 1 -- 172.21.15.33:0/2978182624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67b4014970 con 0x7f67c40f5e60 2024-02-15T18:31:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.130+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c41089f0 con 0x7f67c40f5e60 2024-02-15T18:31:42.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.131+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c4059100 con 0x7f67c40f5e60 2024-02-15T18:31:42.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.132+0000 7f67ba7fc700 1 -- 172.21.15.33:0/2978182624 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 27) v1 ==== 77194+0+0 (secure 0 0 0) 0x7f67b40077b0 con 0x7f67c40f5e60 2024-02-15T18:31:42.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.132+0000 7f67ba7fc700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f67b0061000 0x7f67b00634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:42.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.132+0000 7f67ba7fc700 1 -- 172.21.15.33:0/2978182624 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f67b407c560 con 0x7f67c40f5e60 2024-02-15T18:31:42.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.132+0000 7f67c9c5a700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f67b0061000 0x7f67b00634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:42.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.133+0000 7f67c9c5a700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f67b0061000 0x7f67b00634c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f67c00043d0 tx=0x7f67c000ac40).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:42.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.137+0000 7f67ba7fc700 1 -- 172.21.15.33:0/2978182624 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f67b4050320 con 0x7f67c40f5e60 2024-02-15T18:31:42.133 INFO:tasks.workunit.client.1.smithi131.stdout:4/975: dwrite d2/d2a/d85/fb7 [0,4194304] 0 2024-02-15T18:31:42.133 INFO:tasks.workunit.client.1.smithi131.stdout:4/976: fdatasync d2/d2a/d47/d21/dcd/dfb/d110/d2e/d5f/d70/f87 0 2024-02-15T18:31:42.135 INFO:tasks.workunit.client.1.smithi131.stdout:4/977: mknod d2/d2a/d76/ddb/c15f 0 2024-02-15T18:31:42.135 INFO:tasks.workunit.client.1.smithi131.stdout:4/978: stat d2/d2a/d47/d21/dcd/dfb/d110/f9c 0 2024-02-15T18:31:42.150 INFO:tasks.workunit.client.1.smithi131.stdout:4/979: dwrite d2/d7/d1c/f74 [0,4194304] 0 2024-02-15T18:31:42.152 INFO:tasks.workunit.client.1.smithi131.stdout:4/980: rmdir d2/d2a/d47/d21/dcd/dfb/d110/d157 0 2024-02-15T18:31:42.155 INFO:tasks.workunit.client.1.smithi131.stdout:4/981: link d2/d2a/d47/d21/dcd/c152 d2/d2a/d47/d21/d9e/d111/d13d/c160 0 2024-02-15T18:31:42.155 INFO:tasks.workunit.client.1.smithi131.stdout:4/982: fsync d2/d2a/d47/d21/d9e/d111/d13d/f134 0 2024-02-15T18:31:42.156 INFO:tasks.workunit.client.1.smithi131.stdout:4/983: mkdir d2/d2a/d85/d161 0 2024-02-15T18:31:42.158 INFO:tasks.workunit.client.1.smithi131.stdout:4/984: mkdir d2/d2a/d85/d162 0 2024-02-15T18:31:42.159 INFO:tasks.workunit.client.1.smithi131.stdout:4/985: mknod d2/d2a/c163 0 2024-02-15T18:31:42.160 INFO:tasks.workunit.client.1.smithi131.stdout:4/986: write d2/d2a/d47/f19 [1825486,59833] 0 2024-02-15T18:31:42.167 INFO:tasks.workunit.client.1.smithi131.stdout:4/987: dread d2/d2a/d47/d21/dcd/dfb/d110/d2e/d39/d4b/ff4 [0,4194304] 0 2024-02-15T18:31:42.169 INFO:tasks.workunit.client.1.smithi131.stdout:4/988: creat d2/d2a/d47/d21/dcd/dfb/d110/dd1/f164 x:0 0 0 2024-02-15T18:31:42.169 INFO:tasks.workunit.client.1.smithi131.stdout:4/989: stat d2/d2a/d47/d21/dcd/dfb/d110/d2e/f34 0 2024-02-15T18:31:42.171 INFO:tasks.workunit.client.1.smithi131.stdout:4/990: unlink d2/d2a/d47/d21/dcd/dfb/d110/d53/fbb 0 2024-02-15T18:31:42.173 INFO:tasks.workunit.client.1.smithi131.stdout:4/991: rename d2/d2a/d47/d16/d43/l148 to d2/d2a/d85/d161/l165 0 2024-02-15T18:31:42.180 INFO:tasks.workunit.client.1.smithi131.stdout:4/992: dread d2/d2a/d47/d21/dcd/dfb/d110/d53/db9/dfe/d7a/d92/fad [0,4194304] 0 2024-02-15T18:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.389+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f67c4045ad0 con 0x7f67c40f5e60 2024-02-15T18:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.390+0000 7f67ba7fc700 1 -- 172.21.15.33:0/2978182624 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+697 (secure 0 0 0) 0x7f67b404ff10 con 0x7f67c40f5e60 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:31:42.384 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:31:42.385 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2, 2024-02-15T18:31:42.385 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12 2024-02-15T18:31:42.385 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:31:42.385 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:31:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.391+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f67b0061000 msgr2=0x7f67b00634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.391+0000 7f67cac5c700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f67b0061000 0x7f67b00634c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f67c00043d0 tx=0x7f67c000ac40).stop 2024-02-15T18:31:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.391+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f5e60 msgr2=0x7f67c41073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.391+0000 7f67cac5c700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f5e60 0x7f67c41073a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f67b4002700 tx=0x7f67b4009e00).stop 2024-02-15T18:31:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.391+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 shutdown_connections 2024-02-15T18:31:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.391+0000 7f67cac5c700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f67b0061000 0x7f67b00634c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.391+0000 7f67cac5c700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67c40f4bc0 0x7f67c4106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.391+0000 7f67cac5c700 1 --2- 172.21.15.33:0/2978182624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c40f5e60 0x7f67c41073a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.392+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 >> 172.21.15.33:0/2978182624 conn(0x7f67c40f0320 msgr2=0x7f67c40f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.392+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 shutdown_connections 2024-02-15T18:31:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.392+0000 7f67cac5c700 1 -- 172.21.15.33:0/2978182624 wait complete. 2024-02-15T18:31:42.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.495+0000 7fcc97718700 1 -- 172.21.15.33:0/4241931248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90060310 msgr2=0x7fcc900f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.495+0000 7fcc97718700 1 --2- 172.21.15.33:0/4241931248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90060310 0x7fcc900f92a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fcc8c004660 tx=0x7fcc8c009b30).stop 2024-02-15T18:31:42.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.495+0000 7fcc97718700 1 -- 172.21.15.33:0/4241931248 shutdown_connections 2024-02-15T18:31:42.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.495+0000 7fcc97718700 1 --2- 172.21.15.33:0/4241931248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc900f9820 0x7fcc900fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.495+0000 7fcc97718700 1 --2- 172.21.15.33:0/4241931248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90060310 0x7fcc900f92a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.495+0000 7fcc97718700 1 -- 172.21.15.33:0/4241931248 >> 172.21.15.33:0/4241931248 conn(0x7fcc900f0d40 msgr2=0x7fcc900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:42.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.495+0000 7fcc97718700 1 -- 172.21.15.33:0/4241931248 shutdown_connections 2024-02-15T18:31:42.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.495+0000 7fcc97718700 1 -- 172.21.15.33:0/4241931248 wait complete. 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc97718700 1 Processor -- start 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc97718700 1 -- start start 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc97718700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc90060310 0x7fcc900f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc97718700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc900f9820 0x7fcc900f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc97718700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900f5700 con 0x7fcc900f9820 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc97718700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900f5840 con 0x7fcc90060310 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc94cb3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc900f9820 0x7fcc900f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc954b4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc90060310 0x7fcc900f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc94cb3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc900f9820 0x7fcc900f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55906/0 (socket says 172.21.15.33:55906) 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc94cb3700 1 -- 172.21.15.33:0/2281832065 learned_addr learned my addr 172.21.15.33:0/2281832065 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc94cb3700 1 -- 172.21.15.33:0/2281832065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc90060310 msgr2=0x7fcc900f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc94cb3700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc90060310 0x7fcc900f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc94cb3700 1 -- 172.21.15.33:0/2281832065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c005040 con 0x7fcc900f9820 2024-02-15T18:31:42.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc954b4700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc90060310 0x7fcc900f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:31:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.496+0000 7fcc94cb3700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc900f9820 0x7fcc900f51a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fcc8000e7c0 tx=0x7fcc8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.497+0000 7fcc85ffb700 1 -- 172.21.15.33:0/2281832065 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc800092e0 con 0x7fcc900f9820 2024-02-15T18:31:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.497+0000 7fcc85ffb700 1 -- 172.21.15.33:0/2281832065 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fcc8000f040 con 0x7fcc900f9820 2024-02-15T18:31:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.497+0000 7fcc85ffb700 1 -- 172.21.15.33:0/2281832065 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc80014920 con 0x7fcc900f9820 2024-02-15T18:31:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.497+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc900f5b20 con 0x7fcc900f9820 2024-02-15T18:31:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.497+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9010eff0 con 0x7fcc900f9820 2024-02-15T18:31:42.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.498+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc90045ad0 con 0x7fcc900f9820 2024-02-15T18:31:42.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.498+0000 7fcc85ffb700 1 -- 172.21.15.33:0/2281832065 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 27) v1 ==== 77194+0+0 (secure 0 0 0) 0x7fcc80009440 con 0x7fcc900f9820 2024-02-15T18:31:42.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.498+0000 7fcc85ffb700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc7c060fb0 0x7fcc7c063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:42.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.499+0000 7fcc85ffb700 1 -- 172.21.15.33:0/2281832065 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fcc8007c450 con 0x7fcc900f9820 2024-02-15T18:31:42.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.499+0000 7fcc954b4700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc7c060fb0 0x7fcc7c063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:42.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.499+0000 7fcc954b4700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc7c060fb0 0x7fcc7c063470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcc8c005010 tx=0x7fcc8c016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.503+0000 7fcc85ffb700 1 -- 172.21.15.33:0/2281832065 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7fcc8004c8c0 con 0x7fcc900f9820 2024-02-15T18:31:42.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.729+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc900ff0b0 con 0x7fcc900f9820 2024-02-15T18:31:42.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.729+0000 7fcc85ffb700 1 -- 172.21.15.33:0/2281832065 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1707 (secure 0 0 0) 0x7fcc8004fee0 con 0x7fcc900f9820 2024-02-15T18:31:42.723 INFO:teuthology.orchestra.run.smithi033.stdout:e19 2024-02-15T18:31:42.723 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:31:42.723 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:31:42.723 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:31:42.723 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:31:42.723 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:31:42.723 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 19 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:31:16.192509+0000 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:31:42.724 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707]] 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411]] 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613]] 2024-02-15T18:31:42.725 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278]] 2024-02-15T18:31:42.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.731+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc7c060fb0 msgr2=0x7fcc7c063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.731+0000 7fcc97718700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc7c060fb0 0x7fcc7c063470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcc8c005010 tx=0x7fcc8c016040).stop 2024-02-15T18:31:42.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.731+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc900f9820 msgr2=0x7fcc900f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.731+0000 7fcc97718700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc900f9820 0x7fcc900f51a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fcc8000e7c0 tx=0x7fcc8000b040).stop 2024-02-15T18:31:42.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.731+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 shutdown_connections 2024-02-15T18:31:42.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.732+0000 7fcc97718700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc7c060fb0 0x7fcc7c063470 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.732+0000 7fcc97718700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc90060310 0x7fcc900f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.732+0000 7fcc97718700 1 --2- 172.21.15.33:0/2281832065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc900f9820 0x7fcc900f51a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.732+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 >> 172.21.15.33:0/2281832065 conn(0x7fcc900f0d40 msgr2=0x7fcc900f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:42.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.732+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 shutdown_connections 2024-02-15T18:31:42.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.732+0000 7fcc97718700 1 -- 172.21.15.33:0/2281832065 wait complete. 2024-02-15T18:31:42.727 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-02-15T18:31:42.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:41.281438+0000 mgr.smithi033.apxevf (mgr.14626) 9 : audit [DBG] from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:42.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:41.451253+0000 mgr.smithi033.apxevf (mgr.14626) 10 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.8 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 72 MiB/s rd, 143 MiB/s wr, 284 op/s 2024-02-15T18:31:42.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:42.391515+0000 mon.smithi033 (mon.0) 674 : audit [DBG] from='client.? 172.21.15.33:0/2978182624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.835+0000 7f4b0cd29700 1 -- 172.21.15.33:0/1236921491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f6810 msgr2=0x7f4b080f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.835+0000 7f4b0cd29700 1 --2- 172.21.15.33:0/1236921491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f6810 0x7f4b080f6c70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f4af0004660 tx=0x7f4af0009b30).stop 2024-02-15T18:31:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.835+0000 7f4b0cd29700 1 -- 172.21.15.33:0/1236921491 shutdown_connections 2024-02-15T18:31:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.835+0000 7f4b0cd29700 1 --2- 172.21.15.33:0/1236921491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f6810 0x7f4b080f6c70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.835+0000 7f4b0cd29700 1 --2- 172.21.15.33:0/1236921491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b080f5570 0x7f4b080f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:31:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.835+0000 7f4b0cd29700 1 -- 172.21.15.33:0/1236921491 >> 172.21.15.33:0/1236921491 conn(0x7f4b080f0cd0 msgr2=0x7f4b080f30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.835+0000 7f4b0cd29700 1 -- 172.21.15.33:0/1236921491 shutdown_connections 2024-02-15T18:31:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.835+0000 7f4b0cd29700 1 -- 172.21.15.33:0/1236921491 wait complete. 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.836+0000 7f4b0cd29700 1 Processor -- start 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.836+0000 7f4b0cd29700 1 -- start start 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.836+0000 7f4b0cd29700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f5570 0x7f4b08106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.836+0000 7f4b0cd29700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b080f6810 0x7f4b081074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.836+0000 7f4b0cd29700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08107af0 con 0x7f4b080f5570 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.836+0000 7f4b0cd29700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b081083a0 con 0x7f4b080f6810 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.836+0000 7f4b0659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f5570 0x7f4b08106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.836+0000 7f4b0659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f5570 0x7f4b08106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55938/0 (socket says 172.21.15.33:55938) 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.836+0000 7f4b0659c700 1 -- 172.21.15.33:0/961597306 learned_addr learned my addr 172.21.15.33:0/961597306 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4b05d9b700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b080f6810 0x7f4b081074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4b0659c700 1 -- 172.21.15.33:0/961597306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b080f6810 msgr2=0x7f4b081074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4b0659c700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b080f6810 0x7f4b081074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4b0659c700 1 -- 172.21.15.33:0/961597306 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0005040 con 0x7f4b080f5570 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4b0659c700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f5570 0x7f4b08106fc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f4af80093f0 tx=0x7f4af8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4afeffd700 1 -- 172.21.15.33:0/961597306 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af8009ea0 con 0x7f4b080f5570 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4afeffd700 1 -- 172.21.15.33:0/961597306 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f4af8013b30 con 0x7f4b080f5570 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b08108680 con 0x7f4b080f5570 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4afeffd700 1 -- 172.21.15.33:0/961597306 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af800dc60 con 0x7f4b080f5570 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.837+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b08108bc0 con 0x7f4b080f5570 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.838+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b080f4960 con 0x7f4b080f5570 2024-02-15T18:31:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.838+0000 7f4afeffd700 1 -- 172.21.15.33:0/961597306 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 27) v1 ==== 77194+0+0 (secure 0 0 0) 0x7f4af801a060 con 0x7f4b080f5570 2024-02-15T18:31:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.839+0000 7f4afeffd700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4af4061000 0x7f4af40634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:31:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.839+0000 7f4afeffd700 1 -- 172.21.15.33:0/961597306 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4af807c120 con 0x7f4b080f5570 2024-02-15T18:31:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.839+0000 7f4b05d9b700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4af4061000 0x7f4af40634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:31:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.839+0000 7f4b05d9b700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4af4061000 0x7f4af40634c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4af0004e30 tx=0x7f4af0009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:31:42.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:42.843+0000 7f4afeffd700 1 -- 172.21.15.33:0/961597306 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162484 (secure 0 0 0) 0x7f4af804ffc0 con 0x7f4b080f5570 2024-02-15T18:31:42.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:41.281438+0000 mgr.smithi033.apxevf (mgr.14626) 9 : audit [DBG] from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:42.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:41.451253+0000 mgr.smithi033.apxevf (mgr.14626) 10 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 1.8 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 72 MiB/s rd, 143 MiB/s wr, 284 op/s 2024-02-15T18:31:42.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:42.391515+0000 mon.smithi033 (mon.0) 674 : audit [DBG] from='client.? 172.21.15.33:0/2978182624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:31:43.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.080+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b080ff0d0 con 0x7f4af4061000 2024-02-15T18:31:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.081+0000 7f4afeffd700 1 -- 172.21.15.33:0/961597306 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f4b080ff0d0 con 0x7f4af4061000 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr" 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "2/21 daemons upgraded", 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "", 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:31:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:31:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4af4061000 msgr2=0x7f4af40634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4af4061000 0x7f4af40634c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4af0004e30 tx=0x7f4af0009b30).stop 2024-02-15T18:31:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f5570 msgr2=0x7f4b08106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:31:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f5570 0x7f4b08106fc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f4af80093f0 tx=0x7f4af8006ec0).stop 2024-02-15T18:31:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 shutdown_connections 2024-02-15T18:31:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4af4061000 0x7f4af40634c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b080f5570 0x7f4b08106fc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 --2- 172.21.15.33:0/961597306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b080f6810 0x7f4b081074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:31:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 >> 172.21.15.33:0/961597306 conn(0x7f4b080f0cd0 msgr2=0x7f4b080fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:31:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 shutdown_connections 2024-02-15T18:31:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:31:43.083+0000 7f4b0cd29700 1 -- 172.21.15.33:0/961597306 wait complete. 2024-02-15T18:31:43.114 INFO:tasks.workunit.client.1.smithi131.stdout:3/981: sync 2024-02-15T18:31:43.114 INFO:tasks.workunit.client.1.smithi131.stdout:0/699: sync 2024-02-15T18:31:43.115 INFO:tasks.workunit.client.1.smithi131.stdout:0/700: creat d5/d15/d96/fe6 x:0 0 0 2024-02-15T18:31:43.116 INFO:tasks.workunit.client.1.smithi131.stdout:0/701: stat d5/d2f/d4b/dd9/d10/d3f/l40 0 2024-02-15T18:31:43.116 INFO:tasks.workunit.client.1.smithi131.stdout:0/702: chown d5/d2f/d45/f95 582883 1 2024-02-15T18:31:43.117 INFO:tasks.workunit.client.1.smithi131.stdout:0/703: symlink d5/d2f/d4b/dd9/d10/d71/le7 0 2024-02-15T18:31:43.120 INFO:tasks.workunit.client.1.smithi131.stdout:0/704: stat d5/d2f/d4b/le3 0 2024-02-15T18:31:43.121 INFO:tasks.workunit.client.1.smithi131.stdout:0/705: creat d5/d2f/d4b/dd9/d10/d73/fe8 x:0 0 0 2024-02-15T18:31:43.122 INFO:tasks.workunit.client.1.smithi131.stdout:0/706: creat d5/d2f/d4b/dbf/fe9 x:0 0 0 2024-02-15T18:31:43.124 INFO:tasks.workunit.client.1.smithi131.stdout:0/707: rename d5/d15/d1f/f7d to d5/d15/d1f/fea 0 2024-02-15T18:31:43.125 INFO:tasks.workunit.client.1.smithi131.stdout:0/708: unlink d5/d2f/d4b/l70 0 2024-02-15T18:31:43.131 INFO:tasks.workunit.client.1.smithi131.stdout:3/982: dwrite d2/d22/d29/f4a [0,4194304] 0 2024-02-15T18:31:43.136 INFO:tasks.workunit.client.1.smithi131.stdout:3/983: dread d2/d22/d29/db/d23/d2a/f87 [0,4194304] 0 2024-02-15T18:31:43.136 INFO:tasks.workunit.client.1.smithi131.stdout:3/984: write d2/d22/d29/db/d23/d2a/f120 [5108542,40277] 0 2024-02-15T18:31:43.138 INFO:tasks.workunit.client.1.smithi131.stdout:3/985: symlink d2/d22/d29/db/l137 0 2024-02-15T18:31:43.141 INFO:tasks.workunit.client.1.smithi131.stdout:3/986: rename d2/d22/d29/d9e to d2/d22/d29/db/d1a/df3/d138 0 2024-02-15T18:31:43.141 INFO:tasks.workunit.client.1.smithi131.stdout:3/987: chown d2/d22/d29/c2c 1790312 1 2024-02-15T18:31:43.143 INFO:tasks.workunit.client.1.smithi131.stdout:3/988: symlink d2/d22/d29/db/d1a/d110/d114/l139 0 2024-02-15T18:31:43.146 INFO:tasks.workunit.client.1.smithi131.stdout:0/709: dwrite d5/d2f/d45/d8c/fc4 [0,4194304] 0 2024-02-15T18:31:43.152 INFO:tasks.workunit.client.1.smithi131.stdout:0/710: symlink d5/d2f/d4b/d82/leb 0 2024-02-15T18:31:43.162 INFO:tasks.workunit.client.1.smithi131.stdout:3/989: dwrite d2/d22/d29/d20/d86/fcc [0,4194304] 0 2024-02-15T18:31:43.164 INFO:tasks.workunit.client.1.smithi131.stdout:3/990: unlink d2/d22/c122 0 2024-02-15T18:31:43.165 INFO:tasks.workunit.client.1.smithi131.stdout:3/991: getdents d2/d22/d29/db/d1a/df3/d138 0 2024-02-15T18:31:43.167 INFO:tasks.workunit.client.1.smithi131.stdout:3/992: rename d2/d22/d29/db/d1a/da4/f64 to d2/d22/d29/db/d34/f13a 0 2024-02-15T18:31:43.169 INFO:tasks.workunit.client.1.smithi131.stdout:3/993: rename d2/d22/d29/db/d1a/c7a to d2/d22/d29/db/d1a/da4/d113/c13b 0 2024-02-15T18:31:43.169 INFO:tasks.workunit.client.1.smithi131.stdout:0/711: dwrite d5/d15/d1f/fea [4194304,4194304] 0 2024-02-15T18:31:43.170 INFO:tasks.workunit.client.1.smithi131.stdout:3/994: write d2/d22/d29/db/d84/ff2 [1835203,110031] 0 2024-02-15T18:31:43.174 INFO:tasks.workunit.client.1.smithi131.stdout:0/712: rename d5/d2f/d4b/dd9/d10/l3b to d5/d2f/d45/lec 0 2024-02-15T18:31:43.174 INFO:tasks.workunit.client.1.smithi131.stdout:3/995: symlink d2/d22/d5e/l13c 0 2024-02-15T18:31:43.176 INFO:tasks.workunit.client.1.smithi131.stdout:3/996: truncate d2/d22/d5e/d79/fa2 184924 0 2024-02-15T18:31:43.178 INFO:tasks.workunit.client.1.smithi131.stdout:3/997: dread d2/d22/d29/f39 [0,4194304] 0 2024-02-15T18:31:43.178 INFO:tasks.workunit.client.1.smithi131.stdout:3/998: chown d2/d22/d5e/d119 77 1 2024-02-15T18:31:43.179 INFO:tasks.workunit.client.1.smithi131.stdout:3/999: fdatasync d2/d22/d29/db/d1a/da4/d8d/fc7 0 2024-02-15T18:31:43.188 INFO:tasks.workunit.client.1.smithi131.stdout:7/815: sync 2024-02-15T18:31:43.188 INFO:tasks.workunit.client.1.smithi131.stdout:5/949: sync 2024-02-15T18:31:43.188 INFO:tasks.workunit.client.1.smithi131.stdout:6/648: sync 2024-02-15T18:31:43.188 INFO:tasks.workunit.client.1.smithi131.stdout:7/816: chown d0/d17/d3a/d3d/fe5 11453380 1 2024-02-15T18:31:43.189 INFO:tasks.workunit.client.1.smithi131.stdout:5/950: readlink d18/d33/d73/de8/d86/d109/l135 0 2024-02-15T18:31:43.189 INFO:tasks.workunit.client.1.smithi131.stdout:9/885: sync 2024-02-15T18:31:43.189 INFO:tasks.workunit.client.1.smithi131.stdout:8/841: sync 2024-02-15T18:31:43.189 INFO:tasks.workunit.client.1.smithi131.stdout:4/993: sync 2024-02-15T18:31:43.190 INFO:tasks.workunit.client.1.smithi131.stdout:2/704: sync 2024-02-15T18:31:43.190 INFO:tasks.workunit.client.1.smithi131.stdout:8/842: fdatasync d22/d26/f10f 0 2024-02-15T18:31:43.190 INFO:tasks.workunit.client.1.smithi131.stdout:4/994: write d2/d2a/d47/d16/d5a/f10b [356966,110036] 0 2024-02-15T18:31:43.190 INFO:tasks.workunit.client.1.smithi131.stdout:8/843: write d22/d26/d3f/d86/fd2 [128078,76910] 0 2024-02-15T18:31:43.190 INFO:tasks.workunit.client.1.smithi131.stdout:8/844: chown d22/d26/d3f/d47/d57/dc1 405 1 2024-02-15T18:31:43.190 INFO:tasks.workunit.client.1.smithi131.stdout:0/713: dwrite d5/d2f/f5e [0,4194304] 0 2024-02-15T18:31:43.191 INFO:tasks.workunit.client.1.smithi131.stdout:6/649: chown d2/dc/d27/d62/db0/l3e 11 1 2024-02-15T18:31:43.191 INFO:tasks.workunit.client.1.smithi131.stdout:4/995: mkdir d2/d2a/d85/da3/dbf/d166 0 2024-02-15T18:31:43.192 INFO:tasks.workunit.client.1.smithi131.stdout:5/951: creat d18/d83/d8b/dba/d7b/d112/d138/f13d x:0 0 0 2024-02-15T18:31:43.192 INFO:tasks.workunit.client.1.smithi131.stdout:5/952: write d18/d33/d73/de8/d85/def/f11c [601224,68250] 0 2024-02-15T18:31:43.194 INFO:tasks.workunit.client.1.smithi131.stdout:4/996: mknod d2/d2a/d47/df0/c167 0 2024-02-15T18:31:43.195 INFO:tasks.workunit.client.1.smithi131.stdout:7/817: symlink d0/d17/d3a/d3d/d79/l102 0 2024-02-15T18:31:43.195 INFO:tasks.workunit.client.1.smithi131.stdout:7/818: fdatasync d0/d17/d3a/d3d/d79/db4/f9e 0 2024-02-15T18:31:43.195 INFO:tasks.workunit.client.1.smithi131.stdout:7/819: chown d0/l6d 425 1 2024-02-15T18:31:43.196 INFO:tasks.workunit.client.1.smithi131.stdout:9/886: rename d4/dc/de/d1e/d1f/d51/d7f/fd1 to d4/dc/df7/f124 0 2024-02-15T18:31:43.198 INFO:tasks.workunit.client.1.smithi131.stdout:9/887: dread d4/dc/de/d1e/d1f/d101/fda [0,4194304] 0 2024-02-15T18:31:43.198 INFO:tasks.workunit.client.1.smithi131.stdout:0/714: getdents d5/d2f/d4b/dd9/d4d 0 2024-02-15T18:31:43.200 INFO:tasks.workunit.client.1.smithi131.stdout:7/820: mknod d0/da9/de4/c103 0 2024-02-15T18:31:43.202 INFO:tasks.workunit.client.1.smithi131.stdout:2/705: rename dd/d10/d22/d2f/d38/d74/d2e/d66/f78 to dd/d10/d22/d2f/d38/d74/d2e/d6a/dc0/fe8 0 2024-02-15T18:31:43.206 INFO:tasks.workunit.client.1.smithi131.stdout:9/888: rmdir d4/dc/d17 39 2024-02-15T18:31:43.208 INFO:tasks.workunit.client.1.smithi131.stdout:0/715: unlink d5/d2f/d4b/dd9/f80 0 2024-02-15T18:31:43.209 INFO:tasks.workunit.client.1.smithi131.stdout:7/821: unlink d0/d17/d3a/lec 0 2024-02-15T18:31:43.209 INFO:tasks.workunit.client.1.smithi131.stdout:7/822: write d0/d17/d3a/d3d/d79/d89/fed [118383,69434] 0 2024-02-15T18:31:43.210 INFO:tasks.workunit.client.1.smithi131.stdout:7/823: chown d0/d34/d8e 289417937 1 2024-02-15T18:31:43.210 INFO:tasks.workunit.client.1.smithi131.stdout:7/824: readlink d0/l11 0 2024-02-15T18:31:43.210 INFO:tasks.workunit.client.1.smithi131.stdout:7/825: mkdir d0/da9/de4/d104 0 2024-02-15T18:31:43.210 INFO:tasks.workunit.client.1.smithi131.stdout:7/826: fsync d0/fee 0 2024-02-15T18:31:43.213 INFO:tasks.workunit.client.1.smithi131.stdout:7/827: symlink d0/d17/l105 0 2024-02-15T18:31:43.215 INFO:tasks.workunit.client.1.smithi131.stdout:7/828: mknod d0/d34/d8e/d98/dc6/c106 0 2024-02-15T18:31:43.215 INFO:tasks.workunit.client.1.smithi131.stdout:7/829: dread - d0/db8/dbe/fcd zero size 2024-02-15T18:31:43.223 INFO:tasks.workunit.client.1.smithi131.stdout:0/716: dwrite d5/fd [0,4194304] 0 2024-02-15T18:31:43.225 INFO:tasks.workunit.client.1.smithi131.stdout:0/717: truncate d5/d15/f60 2922893 0 2024-02-15T18:31:43.243 INFO:tasks.workunit.client.1.smithi131.stdout:7/830: dwrite d0/d17/f4b [0,4194304] 0 2024-02-15T18:31:43.243 INFO:tasks.workunit.client.1.smithi131.stdout:7/831: chown d0/d34/f35 10857145 1 2024-02-15T18:31:43.243 INFO:tasks.workunit.client.1.smithi131.stdout:7/832: chown d0/fb 244636455 1 2024-02-15T18:31:43.243 INFO:tasks.workunit.client.1.smithi131.stdout:7/833: readlink d0/l6d 0 2024-02-15T18:31:43.243 INFO:tasks.workunit.client.1.smithi131.stdout:7/834: read - d0/d34/d8b/fa7 zero size 2024-02-15T18:31:43.244 INFO:tasks.workunit.client.1.smithi131.stdout:7/835: creat d0/d34/d8b/d9a/f107 x:0 0 0 2024-02-15T18:31:43.244 INFO:tasks.workunit.client.1.smithi131.stdout:7/836: getdents d0/d34/d8b/dfd 0 2024-02-15T18:31:43.244 INFO:tasks.workunit.client.1.smithi131.stdout:7/837: chown d0/d17/c90 7663 1 2024-02-15T18:31:43.244 INFO:tasks.workunit.client.1.smithi131.stdout:7/838: stat d0/f47 0 2024-02-15T18:31:43.245 INFO:tasks.workunit.client.1.smithi131.stdout:0/718: dwrite d5/d15/d96/fe6 [0,4194304] 0 2024-02-15T18:31:43.245 INFO:tasks.workunit.client.1.smithi131.stdout:0/719: fdatasync d5/d2f/d4b/dd9/d77/d8b/fc2 0 2024-02-15T18:31:43.245 INFO:tasks.workunit.client.1.smithi131.stdout:7/839: creat d0/f108 x:0 0 0 2024-02-15T18:31:43.247 INFO:tasks.workunit.client.1.smithi131.stdout:7/840: truncate d0/d17/d3a/d3d/fa6 2647831 0 2024-02-15T18:31:43.267 INFO:tasks.workunit.client.1.smithi131.stdout:7/841: dwrite d0/f47 [8388608,4194304] 0 2024-02-15T18:31:43.268 INFO:tasks.workunit.client.1.smithi131.stdout:7/842: rmdir d0/d9d 39 2024-02-15T18:31:43.269 INFO:tasks.workunit.client.1.smithi131.stdout:7/843: write d0/d34/f67 [350300,18680] 0 2024-02-15T18:31:43.269 INFO:tasks.workunit.client.1.smithi131.stdout:7/844: chown d0/da9 188899563 1 2024-02-15T18:31:43.275 INFO:tasks.workunit.client.1.smithi131.stdout:7/845: dread d0/d17/d3a/d3d/d79/f9c [0,4194304] 0 2024-02-15T18:31:43.299 INFO:tasks.workunit.client.1.smithi131.stdout:7/846: dwrite d0/d17/d36/f85 [0,4194304] 0 2024-02-15T18:31:43.301 INFO:tasks.workunit.client.1.smithi131.stdout:7/847: creat d0/db8/f109 x:0 0 0 2024-02-15T18:31:43.314 INFO:tasks.workunit.client.1.smithi131.stdout:4/997: symlink d2/l168 0 2024-02-15T18:31:43.318 INFO:tasks.workunit.client.1.smithi131.stdout:7/848: dwrite d0/f14 [0,4194304] 0 2024-02-15T18:31:43.319 INFO:tasks.workunit.client.1.smithi131.stdout:7/849: stat d0/d34/d8e/d98/fa8 0 2024-02-15T18:31:43.319 INFO:tasks.workunit.client.1.smithi131.stdout:8/845: rename d22/d26/d3f/d47/d8e to d22/d26/d3f/d47/d48/d84/d11d 0 2024-02-15T18:31:43.321 INFO:tasks.workunit.client.1.smithi131.stdout:6/650: rename d2/dc/d27/d62/db0/l67 to d2/d6d/dbe/lc8 0 2024-02-15T18:31:43.322 INFO:tasks.workunit.client.1.smithi131.stdout:6/651: read d2/d79/fc6 [55849,124194] 0 2024-02-15T18:31:43.323 INFO:tasks.workunit.client.1.smithi131.stdout:2/706: rename dd/d10/d22/d2a/d48/fbe to dd/d14/d1f/d65/d81/ddd/fe9 0 2024-02-15T18:31:43.326 INFO:tasks.workunit.client.1.smithi131.stdout:0/720: rename d5/d2f/d4b/dd9/d10/l64 to d5/d2f/d4b/dd9/d77/da8/dad/led 0 2024-02-15T18:31:43.328 INFO:tasks.workunit.client.1.smithi131.stdout:2/707: mkdir dd/d10/d22/d2f/d38/dea 0 2024-02-15T18:31:43.328 INFO:tasks.workunit.client.1.smithi131.stdout:2/708: write dd/d10/d22/d2f/d38/f3f [1666591,2510] 0 2024-02-15T18:31:43.328 INFO:tasks.workunit.client.1.smithi131.stdout:2/709: readlink dd/d10/d22/d2a/d48/lda 0 2024-02-15T18:31:43.330 INFO:tasks.workunit.client.1.smithi131.stdout:6/652: dread d2/d6d/db9/d12/d4d/fba [0,4194304] 0 2024-02-15T18:31:43.331 INFO:tasks.workunit.client.1.smithi131.stdout:8/846: rename d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f99 to d22/d26/d3f/f11e 0 2024-02-15T18:31:43.332 INFO:tasks.workunit.client.1.smithi131.stdout:6/653: mknod d2/d79/cc9 0 2024-02-15T18:31:43.335 INFO:tasks.workunit.client.1.smithi131.stdout:6/654: dread d2/d6d/db9/d12/d4d/f9a [0,4194304] 0 2024-02-15T18:31:43.335 INFO:tasks.workunit.client.1.smithi131.stdout:6/655: chown d2/d6d/db9/f73 20 1 2024-02-15T18:31:43.338 INFO:tasks.workunit.client.1.smithi131.stdout:6/656: mkdir d2/d6d/db9/dca 0 2024-02-15T18:31:43.338 INFO:tasks.workunit.client.1.smithi131.stdout:6/657: chown d2/dc/d27/d62/db0/c3f 6711 1 2024-02-15T18:31:43.340 INFO:tasks.workunit.client.1.smithi131.stdout:6/658: chown d2/dc/d27/d62/l8d 60 1 2024-02-15T18:31:43.342 INFO:tasks.workunit.client.1.smithi131.stdout:6/659: creat d2/dc/d27/d62/db0/fcb x:0 0 0 2024-02-15T18:31:43.342 INFO:tasks.workunit.client.1.smithi131.stdout:6/660: chown d2/dc/d1f/dbc/db6 9798364 1 2024-02-15T18:31:43.344 INFO:tasks.workunit.client.1.smithi131.stdout:6/661: mkdir d2/d79/dad/dcc 0 2024-02-15T18:31:43.344 INFO:tasks.workunit.client.1.smithi131.stdout:6/662: readlink d2/d6d/db9/d12/d80/l86 0 2024-02-15T18:31:43.344 INFO:tasks.workunit.client.1.smithi131.stdout:6/663: creat d2/d79/fcd x:0 0 0 2024-02-15T18:31:43.345 INFO:tasks.workunit.client.1.smithi131.stdout:6/664: dread - d2/d6d/db9/d48/d40/fbd zero size 2024-02-15T18:31:43.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/710: dwrite dd/d10/d22/d2f/d38/d74/d2e/f67 [0,4194304] 0 2024-02-15T18:31:43.359 INFO:tasks.workunit.client.1.smithi131.stdout:0/721: dwrite d5/d2f/d4b/dd9/d4d/fb6 [0,4194304] 0 2024-02-15T18:31:43.360 INFO:tasks.workunit.client.1.smithi131.stdout:8/847: dwrite d22/d26/f109 [0,4194304] 0 2024-02-15T18:31:43.361 INFO:tasks.workunit.client.1.smithi131.stdout:6/665: dwrite d2/dc/d1f/f93 [0,4194304] 0 2024-02-15T18:31:43.361 INFO:tasks.workunit.client.1.smithi131.stdout:6/666: readlink d2/d6d/db9/d12/d4d/lac 0 2024-02-15T18:31:43.361 INFO:tasks.workunit.client.1.smithi131.stdout:6/667: fsync d2/d6d/db9/d48/fa3 0 2024-02-15T18:31:43.362 INFO:tasks.workunit.client.1.smithi131.stdout:0/722: mkdir d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee 0 2024-02-15T18:31:43.363 INFO:tasks.workunit.client.1.smithi131.stdout:2/711: link dd/d10/d22/d2f/d38/d74/d2e/f32 dd/d10/d22/da3/feb 0 2024-02-15T18:31:43.366 INFO:tasks.workunit.client.1.smithi131.stdout:6/668: write d2/dc/f22 [4431088,90847] 0 2024-02-15T18:31:43.367 INFO:tasks.workunit.client.1.smithi131.stdout:0/723: link d5/d2f/d4b/dd9/d4d/ldf d5/d2f/d4b/dd9/d10/lef 0 2024-02-15T18:31:43.367 INFO:tasks.workunit.client.1.smithi131.stdout:0/724: chown d5/d2f/d4b/dd9/d11/c37 0 1 2024-02-15T18:31:43.369 INFO:tasks.workunit.client.1.smithi131.stdout:6/669: rmdir d2/d6d/dbe 39 2024-02-15T18:31:43.369 INFO:tasks.workunit.client.1.smithi131.stdout:8/848: link d22/d26/f7b d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/daa/f11f 0 2024-02-15T18:31:43.370 INFO:tasks.workunit.client.1.smithi131.stdout:0/725: mknod d5/d2f/d45/cf0 0 2024-02-15T18:31:43.380 INFO:tasks.workunit.client.1.smithi131.stdout:6/670: rename d2/dc/d1f/f70 to d2/d6d/db9/d90/fce 0 2024-02-15T18:31:43.381 INFO:tasks.workunit.client.1.smithi131.stdout:0/726: mkdir d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/df1 0 2024-02-15T18:31:43.382 INFO:tasks.workunit.client.1.smithi131.stdout:0/727: readlink d5/d2f/d4b/dd9/d10/d3f/l40 0 2024-02-15T18:31:43.382 INFO:tasks.workunit.client.1.smithi131.stdout:0/728: write d5/d2f/d45/d8c/fb5 [663720,88073] 0 2024-02-15T18:31:43.382 INFO:tasks.workunit.client.1.smithi131.stdout:0/729: stat d5/d2f/d45/lde 0 2024-02-15T18:31:43.383 INFO:tasks.workunit.client.1.smithi131.stdout:6/671: rmdir d2/d2b/d6e 39 2024-02-15T18:31:43.383 INFO:tasks.workunit.client.1.smithi131.stdout:6/672: write d2/d2b/d6e/fb5 [204588,72336] 0 2024-02-15T18:31:43.384 INFO:tasks.workunit.client.1.smithi131.stdout:6/673: write d2/f45 [591271,9741] 0 2024-02-15T18:31:43.384 INFO:tasks.workunit.client.1.smithi131.stdout:6/674: dread - d2/dc/d27/d62/db0/f9d zero size 2024-02-15T18:31:43.384 INFO:tasks.workunit.client.1.smithi131.stdout:6/675: truncate d2/d6d/db9/f46 5160092 0 2024-02-15T18:31:43.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/712: dwrite dd/f53 [4194304,4194304] 0 2024-02-15T18:31:43.387 INFO:tasks.workunit.client.1.smithi131.stdout:8/849: read f17 [3150834,27829] 0 2024-02-15T18:31:43.388 INFO:tasks.workunit.client.1.smithi131.stdout:8/850: chown d22/d26/d3f/fde 7 1 2024-02-15T18:31:43.388 INFO:tasks.workunit.client.1.smithi131.stdout:6/676: mkdir d2/d6d/db9/d48/dcf 0 2024-02-15T18:31:43.395 INFO:tasks.workunit.client.1.smithi131.stdout:2/713: symlink dd/d14/d1f/d65/d77/d7a/da2/lec 0 2024-02-15T18:31:43.395 INFO:tasks.workunit.client.1.smithi131.stdout:6/677: creat d2/dc/fd0 x:0 0 0 2024-02-15T18:31:43.395 INFO:tasks.workunit.client.1.smithi131.stdout:2/714: fsync dd/d10/d22/d2a/f93 0 2024-02-15T18:31:43.399 INFO:tasks.workunit.client.1.smithi131.stdout:2/715: read dd/f60 [3726882,106062] 0 2024-02-15T18:31:43.399 INFO:tasks.workunit.client.1.smithi131.stdout:2/716: write dd/d14/d1f/d65/fad [646395,53213] 0 2024-02-15T18:31:43.400 INFO:tasks.workunit.client.1.smithi131.stdout:2/717: symlink dd/d10/db1/dbd/led 0 2024-02-15T18:31:43.402 INFO:tasks.workunit.client.1.smithi131.stdout:2/718: symlink dd/d10/d22/d2f/d38/d74/d2e/d66/d9b/lee 0 2024-02-15T18:31:43.402 INFO:tasks.workunit.client.1.smithi131.stdout:2/719: stat dd/d14/d1f/d65/d77/d7a/da2/fc6 0 2024-02-15T18:31:43.402 INFO:tasks.workunit.client.1.smithi131.stdout:2/720: write dd/d14/f64 [349747,46980] 0 2024-02-15T18:31:43.402 INFO:tasks.workunit.client.1.smithi131.stdout:2/721: fsync dd/d10/d22/d2f/d38/fb9 0 2024-02-15T18:31:43.403 INFO:tasks.workunit.client.1.smithi131.stdout:2/722: creat dd/d10/d22/d2f/d38/fef x:0 0 0 2024-02-15T18:31:43.405 INFO:tasks.workunit.client.1.smithi131.stdout:2/723: rmdir dd/d10/d22/d2f/d38/d9f/dcb 0 2024-02-15T18:31:43.407 INFO:tasks.workunit.client.1.smithi131.stdout:0/730: dwrite d5/d2f/d4b/dd9/d10/fd1 [0,4194304] 0 2024-02-15T18:31:43.407 INFO:tasks.workunit.client.1.smithi131.stdout:0/731: fdatasync d5/d2f/d4b/dd9/d11/fc5 0 2024-02-15T18:31:43.409 INFO:tasks.workunit.client.1.smithi131.stdout:8/851: dwrite d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f92 [0,4194304] 0 2024-02-15T18:31:43.409 INFO:tasks.workunit.client.1.smithi131.stdout:8/852: write d22/d2e/fa0 [189199,45766] 0 2024-02-15T18:31:43.409 INFO:tasks.workunit.client.1.smithi131.stdout:0/732: symlink d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/lf2 0 2024-02-15T18:31:43.410 INFO:tasks.workunit.client.1.smithi131.stdout:6/678: dread d2/dc/d1f/f93 [0,4194304] 0 2024-02-15T18:31:43.412 INFO:tasks.workunit.client.1.smithi131.stdout:6/679: symlink d2/dc/d27/d62/d97/d9e/ld1 0 2024-02-15T18:31:43.413 INFO:tasks.workunit.client.1.smithi131.stdout:6/680: readlink d2/dc/d27/l30 0 2024-02-15T18:31:43.413 INFO:tasks.workunit.client.1.smithi131.stdout:0/733: unlink d5/d15/f27 0 2024-02-15T18:31:43.413 INFO:tasks.workunit.client.1.smithi131.stdout:8/853: rename d22/d2e/c61 to d22/d26/d3f/d47/d57/dc1/d105/c120 0 2024-02-15T18:31:43.434 INFO:tasks.workunit.client.1.smithi131.stdout:2/724: dwrite dd/d1e/f5f [0,4194304] 0 2024-02-15T18:31:43.437 INFO:tasks.workunit.client.1.smithi131.stdout:2/725: rename dd/d10/f19 to dd/d14/d1f/d65/d77/d7a/da2/ff0 0 2024-02-15T18:31:43.437 INFO:tasks.workunit.client.1.smithi131.stdout:2/726: truncate dd/d14/d1f/fc4 984720 0 2024-02-15T18:31:43.437 INFO:tasks.workunit.client.1.smithi131.stdout:2/727: chown dd/d1e/f26 12916 1 2024-02-15T18:31:43.438 INFO:tasks.workunit.client.1.smithi131.stdout:2/728: read dd/d14/d1f/d65/d77/f7e [183651,70754] 0 2024-02-15T18:31:43.438 INFO:tasks.workunit.client.1.smithi131.stdout:2/729: stat dd/f53 0 2024-02-15T18:31:43.443 INFO:tasks.workunit.client.1.smithi131.stdout:2/730: creat dd/d14/d1f/d65/d81/ddd/ff1 x:0 0 0 2024-02-15T18:31:43.445 INFO:tasks.workunit.client.1.smithi131.stdout:2/731: unlink dd/d69/l89 0 2024-02-15T18:31:43.447 INFO:tasks.workunit.client.1.smithi131.stdout:2/732: mkdir dd/d10/d22/df2 0 2024-02-15T18:31:43.448 INFO:tasks.workunit.client.1.smithi131.stdout:6/681: dwrite d2/f28 [0,4194304] 0 2024-02-15T18:31:43.449 INFO:tasks.workunit.client.1.smithi131.stdout:8/854: dwrite d22/d26/f2d [0,4194304] 0 2024-02-15T18:31:43.449 INFO:tasks.workunit.client.1.smithi131.stdout:0/734: dwrite d5/f62 [0,4194304] 0 2024-02-15T18:31:43.452 INFO:tasks.workunit.client.1.smithi131.stdout:2/733: rmdir dd/d10/d22/d2f/d38/d74/d2e/d6a 39 2024-02-15T18:31:43.452 INFO:tasks.workunit.client.1.smithi131.stdout:0/735: write d5/d2f/d4b/f8a [3296024,420] 0 2024-02-15T18:31:43.455 INFO:tasks.workunit.client.1.smithi131.stdout:6/682: link d2/d6d/db9/d12/d4d/f9a d2/d6d/fd2 0 2024-02-15T18:31:43.455 INFO:tasks.workunit.client.1.smithi131.stdout:8/855: symlink d22/d26/d3f/d7c/l121 0 2024-02-15T18:31:43.455 INFO:tasks.workunit.client.1.smithi131.stdout:8/856: read d22/d26/d3f/d86/fd2 [194359,19049] 0 2024-02-15T18:31:43.455 INFO:tasks.workunit.client.1.smithi131.stdout:8/857: stat d22/d2e/d5e/l7d 0 2024-02-15T18:31:43.456 INFO:tasks.workunit.client.1.smithi131.stdout:8/858: rmdir d22/d2e/d60 39 2024-02-15T18:31:43.457 INFO:tasks.workunit.client.1.smithi131.stdout:2/734: unlink dd/d14/d1f/d65/d81/cdf 0 2024-02-15T18:31:43.457 INFO:tasks.workunit.client.1.smithi131.stdout:2/735: fsync dd/d10/d22/f56 0 2024-02-15T18:31:43.457 INFO:tasks.workunit.client.1.smithi131.stdout:2/736: truncate dd/f18 8805417 0 2024-02-15T18:31:43.458 INFO:tasks.workunit.client.1.smithi131.stdout:0/736: mkdir d5/d2f/d4b/dd9/d11/df3 0 2024-02-15T18:31:43.458 INFO:tasks.workunit.client.1.smithi131.stdout:0/737: dread - d5/d2f/d4b/dd9/d77/d8b/fc2 zero size 2024-02-15T18:31:43.458 INFO:tasks.workunit.client.1.smithi131.stdout:0/738: readlink d5/d2f/d4b/dd9/d10/d73/lca 0 2024-02-15T18:31:43.459 INFO:tasks.workunit.client.1.smithi131.stdout:0/739: readlink d5/d15/d1f/l8e 0 2024-02-15T18:31:43.460 INFO:tasks.workunit.client.1.smithi131.stdout:8/859: mknod d22/d26/d3f/d47/d48/d5f/d70/db0/d114/c122 0 2024-02-15T18:31:43.460 INFO:tasks.workunit.client.1.smithi131.stdout:8/860: stat d22/d2e/l33 0 2024-02-15T18:31:43.460 INFO:tasks.workunit.client.1.smithi131.stdout:8/861: stat d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/c77 0 2024-02-15T18:31:43.461 INFO:tasks.workunit.client.1.smithi131.stdout:2/737: rename dd/d10/d22/d2f/d38/dea to dd/d14/d1f/d65/d77/d7a/df3 0 2024-02-15T18:31:43.462 INFO:tasks.workunit.client.1.smithi131.stdout:0/740: mknod d5/d2f/d4b/cf4 0 2024-02-15T18:31:43.463 INFO:tasks.workunit.client.1.smithi131.stdout:2/738: symlink dd/d10/d22/d2f/d38/d74/d2e/d66/d99/lf4 0 2024-02-15T18:31:43.464 INFO:tasks.workunit.client.1.smithi131.stdout:0/741: getdents d5/d2f/d4b/d82 0 2024-02-15T18:31:43.467 INFO:tasks.workunit.client.1.smithi131.stdout:2/739: creat dd/d1e/dcc/ff5 x:0 0 0 2024-02-15T18:31:43.467 INFO:tasks.workunit.client.1.smithi131.stdout:0/742: read d5/d2f/d4b/fbe [324505,95816] 0 2024-02-15T18:31:43.467 INFO:tasks.workunit.client.1.smithi131.stdout:0/743: chown d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/df1 426 1 2024-02-15T18:31:43.467 INFO:tasks.workunit.client.1.smithi131.stdout:0/744: readlink d5/d2f/d4b/dd9/d4d/l79 0 2024-02-15T18:31:43.467 INFO:tasks.workunit.client.1.smithi131.stdout:2/740: creat dd/d10/d22/d2f/d38/d74/d2e/d66/d99/ff6 x:0 0 0 2024-02-15T18:31:43.467 INFO:tasks.workunit.client.1.smithi131.stdout:0/745: mkdir d5/d15/d1f/df5 0 2024-02-15T18:31:43.468 INFO:tasks.workunit.client.1.smithi131.stdout:0/746: chown d5/d2f/d4b/dd9/d4d 678 1 2024-02-15T18:31:43.468 INFO:tasks.workunit.client.1.smithi131.stdout:0/747: dread - d5/fd4 zero size 2024-02-15T18:31:43.469 INFO:tasks.workunit.client.1.smithi131.stdout:2/741: unlink dd/d14/d1f/c42 0 2024-02-15T18:31:43.471 INFO:tasks.workunit.client.1.smithi131.stdout:0/748: rename d5/d2f/d4b/d82/dae to d5/d2f/d4b/dd9/d10/d71/d92/df6 0 2024-02-15T18:31:43.472 INFO:tasks.workunit.client.1.smithi131.stdout:6/683: dwrite d2/d6d/db9/d12/d4d/fba [0,4194304] 0 2024-02-15T18:31:43.473 INFO:tasks.workunit.client.1.smithi131.stdout:2/742: symlink dd/d14/lf7 0 2024-02-15T18:31:43.473 INFO:tasks.workunit.client.1.smithi131.stdout:2/743: write dd/d69/fbf [10334,2993] 0 2024-02-15T18:31:43.473 INFO:tasks.workunit.client.1.smithi131.stdout:0/749: mknod d5/d2f/d4b/dd9/d77/da8/dad/cf7 0 2024-02-15T18:31:43.479 INFO:tasks.workunit.client.1.smithi131.stdout:6/684: symlink d2/d79/dad/ld3 0 2024-02-15T18:31:43.479 INFO:tasks.workunit.client.1.smithi131.stdout:6/685: readlink d2/d2b/d6e/lb8 0 2024-02-15T18:31:43.480 INFO:tasks.workunit.client.1.smithi131.stdout:2/744: link dd/d10/d22/d2f/d38/d74/d2e/f32 dd/d10/d22/d2a/ff8 0 2024-02-15T18:31:43.481 INFO:tasks.workunit.client.1.smithi131.stdout:8/862: dwrite d22/d26/d3f/d47/d48/d84/daf/fb1 [4194304,4194304] 0 2024-02-15T18:31:43.481 INFO:tasks.workunit.client.1.smithi131.stdout:0/750: mknod d5/d2f/d4b/dd9/d11/df3/cf8 0 2024-02-15T18:31:43.484 INFO:tasks.workunit.client.1.smithi131.stdout:8/863: mknod d22/d26/d3f/d47/d48/d5f/d6f/d7a/c123 0 2024-02-15T18:31:43.507 INFO:tasks.workunit.client.1.smithi131.stdout:2/745: dwrite dd/d10/d22/d2f/d38/fef [0,4194304] 0 2024-02-15T18:31:43.508 INFO:tasks.workunit.client.1.smithi131.stdout:6/686: dwrite d2/dc/d1f/dbc/db6/fc3 [0,4194304] 0 2024-02-15T18:31:43.508 INFO:tasks.workunit.client.1.smithi131.stdout:6/687: readlink d2/dc/d27/d62/l8d 0 2024-02-15T18:31:43.509 INFO:tasks.workunit.client.1.smithi131.stdout:8/864: dwrite d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/daa/f11f [0,4194304] 0 2024-02-15T18:31:43.509 INFO:tasks.workunit.client.1.smithi131.stdout:2/746: creat dd/d10/d22/d2f/d38/d74/d2e/d66/d99/ff9 x:0 0 0 2024-02-15T18:31:43.512 INFO:tasks.workunit.client.1.smithi131.stdout:6/688: creat d2/dc/d1f/dbc/fd4 x:0 0 0 2024-02-15T18:31:43.513 INFO:tasks.workunit.client.1.smithi131.stdout:2/747: mkdir dd/d10/dfa 0 2024-02-15T18:31:43.515 INFO:tasks.workunit.client.1.smithi131.stdout:6/689: mknod d2/dc/d1f/dbc/db6/dbb/cd5 0 2024-02-15T18:31:43.515 INFO:tasks.workunit.client.1.smithi131.stdout:6/690: chown d2/dc/f22 163 1 2024-02-15T18:31:43.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/865: truncate d22/d26/d3f/d47/f6d 2900755 0 2024-02-15T18:31:43.531 INFO:tasks.workunit.client.1.smithi131.stdout:8/866: dread d22/d26/f55 [0,4194304] 0 2024-02-15T18:31:43.533 INFO:tasks.workunit.client.1.smithi131.stdout:6/691: dread d2/dc/d27/d78/f87 [0,4194304] 0 2024-02-15T18:31:43.534 INFO:tasks.workunit.client.1.smithi131.stdout:6/692: mknod d2/d6d/db9/dca/cd6 0 2024-02-15T18:31:43.534 INFO:tasks.workunit.client.1.smithi131.stdout:6/693: truncate d2/d6d/db9/d12/d4d/f9a 1347686 0 2024-02-15T18:31:43.542 INFO:tasks.workunit.client.1.smithi131.stdout:6/694: rename d2/dc/d27/d74/lb3 to d2/d6d/db9/d48/dcf/ld7 0 2024-02-15T18:31:43.542 INFO:tasks.workunit.client.1.smithi131.stdout:6/695: dread d2/dc/d27/d62/d97/f25 [0,4194304] 0 2024-02-15T18:31:43.543 INFO:tasks.workunit.client.1.smithi131.stdout:2/748: dwrite dd/d10/d22/d2a/f49 [0,4194304] 0 2024-02-15T18:31:43.543 INFO:tasks.workunit.client.1.smithi131.stdout:2/749: chown dd/d10/db1/dbd 188 1 2024-02-15T18:31:43.544 INFO:tasks.workunit.client.1.smithi131.stdout:2/750: symlink dd/d14/d1f/d65/d77/d7a/df3/lfb 0 2024-02-15T18:31:43.546 INFO:tasks.workunit.client.1.smithi131.stdout:2/751: creat dd/d10/ffc x:0 0 0 2024-02-15T18:31:43.547 INFO:tasks.workunit.client.1.smithi131.stdout:2/752: creat dd/d10/db1/ffd x:0 0 0 2024-02-15T18:31:43.547 INFO:tasks.workunit.client.1.smithi131.stdout:2/753: fsync dd/d14/d1f/d65/d81/ddd/fe3 0 2024-02-15T18:31:43.548 INFO:tasks.workunit.client.1.smithi131.stdout:2/754: write dd/d10/db1/ffd [743981,58284] 0 2024-02-15T18:31:43.548 INFO:tasks.workunit.client.1.smithi131.stdout:2/755: mknod dd/d10/d22/d2a/d48/cfe 0 2024-02-15T18:31:43.549 INFO:tasks.workunit.client.1.smithi131.stdout:8/867: dwrite f14 [4194304,4194304] 0 2024-02-15T18:31:43.550 INFO:tasks.workunit.client.1.smithi131.stdout:2/756: symlink dd/d10/d22/d2f/d38/d74/d2e/d6a/lff 0 2024-02-15T18:31:43.553 INFO:tasks.workunit.client.1.smithi131.stdout:2/757: rmdir dd/d69 39 2024-02-15T18:31:43.558 INFO:tasks.workunit.client.1.smithi131.stdout:6/696: dwrite d2/dc/d27/d62/faf [0,4194304] 0 2024-02-15T18:31:43.563 INFO:tasks.workunit.client.1.smithi131.stdout:6/697: write d2/d6d/db9/d12/d4d/fba [3694078,122464] 0 2024-02-15T18:31:43.563 INFO:tasks.workunit.client.1.smithi131.stdout:6/698: getdents d2/d79/dad/dcc 0 2024-02-15T18:31:43.567 INFO:tasks.workunit.client.1.smithi131.stdout:6/699: creat d2/dc/d27/d74/d75/fd8 x:0 0 0 2024-02-15T18:31:43.567 INFO:tasks.workunit.client.1.smithi131.stdout:6/700: write d2/dc/d27/d62/db0/f9d [397848,8894] 0 2024-02-15T18:31:43.568 INFO:tasks.workunit.client.1.smithi131.stdout:6/701: symlink d2/dc/d27/d62/d97/ld9 0 2024-02-15T18:31:43.575 INFO:tasks.workunit.client.1.smithi131.stdout:6/702: read d2/d6d/db9/d90/fce [3833253,109099] 0 2024-02-15T18:31:43.588 INFO:tasks.workunit.client.1.smithi131.stdout:6/703: dread d2/d6d/db9/d48/f1c [0,4194304] 0 2024-02-15T18:31:43.589 INFO:tasks.workunit.client.1.smithi131.stdout:8/868: dwrite d22/d2e/d5e/db5/fdd [0,4194304] 0 2024-02-15T18:31:43.596 INFO:tasks.workunit.client.1.smithi131.stdout:8/869: rename d22/d26/d3f/d47/d48/d5f/f95 to d22/d26/d3f/d47/d48/d5f/d70/f124 0 2024-02-15T18:31:43.596 INFO:tasks.workunit.client.1.smithi131.stdout:8/870: write d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/fe1 [882773,5357] 0 2024-02-15T18:31:43.596 INFO:tasks.workunit.client.1.smithi131.stdout:8/871: chown d22/d26/d3f/d47/d57/dc5 29 1 2024-02-15T18:31:43.596 INFO:tasks.workunit.client.1.smithi131.stdout:2/758: dwrite dd/d10/d22/d2f/d38/f50 [0,4194304] 0 2024-02-15T18:31:43.601 INFO:tasks.workunit.client.1.smithi131.stdout:2/759: truncate dd/f8d 1083396 0 2024-02-15T18:31:43.602 INFO:tasks.workunit.client.1.smithi131.stdout:2/760: creat dd/d14/d1f/f100 x:0 0 0 2024-02-15T18:31:43.603 INFO:tasks.workunit.client.1.smithi131.stdout:2/761: read dd/d10/d22/d2a/ff8 [2132798,34866] 0 2024-02-15T18:31:43.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/762: stat dd/f29 0 2024-02-15T18:31:43.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/763: read dd/d10/d22/d2a/fdc [563448,113687] 0 2024-02-15T18:31:43.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/764: chown dd/d10/db1/dbd/ld6 3814 1 2024-02-15T18:31:43.605 INFO:tasks.workunit.client.1.smithi131.stdout:2/765: symlink dd/d10/d22/d2a/d48/l101 0 2024-02-15T18:31:43.606 INFO:tasks.workunit.client.1.smithi131.stdout:2/766: creat dd/d10/d22/d2f/d38/d9f/f102 x:0 0 0 2024-02-15T18:31:43.610 INFO:tasks.workunit.client.1.smithi131.stdout:2/767: rename dd/d10/d22/d2f/d38/d74/d2e/d66/d99 to dd/d10/dfa/d103 0 2024-02-15T18:31:43.610 INFO:tasks.workunit.client.1.smithi131.stdout:2/768: fsync dd/d10/d22/d2a/ff8 0 2024-02-15T18:31:43.612 INFO:tasks.workunit.client.1.smithi131.stdout:8/872: dwrite d22/d2e/d5e/db5/fd8 [0,4194304] 0 2024-02-15T18:31:43.616 INFO:tasks.workunit.client.1.smithi131.stdout:6/704: dwrite d2/dc/d27/d62/d97/fa1 [0,4194304] 0 2024-02-15T18:31:43.617 INFO:tasks.workunit.client.1.smithi131.stdout:8/873: truncate d22/d26/d3f/d47/d57/d9f/ff2 285754 0 2024-02-15T18:31:43.617 INFO:tasks.workunit.client.1.smithi131.stdout:8/874: write d22/d26/d3f/d47/d48/d5f/d70/db0/fbf [953152,37712] 0 2024-02-15T18:31:43.619 INFO:tasks.workunit.client.1.smithi131.stdout:6/705: symlink d2/dc/d27/d74/lda 0 2024-02-15T18:31:43.619 INFO:tasks.workunit.client.1.smithi131.stdout:8/875: symlink d22/d26/d3f/d47/d48/d5f/l125 0 2024-02-15T18:31:43.621 INFO:tasks.workunit.client.1.smithi131.stdout:6/706: rmdir d2/dc/d1f/dbc 39 2024-02-15T18:31:43.621 INFO:tasks.workunit.client.1.smithi131.stdout:6/707: chown d2/dc/d27/d62/faf 127318692 1 2024-02-15T18:31:43.622 INFO:tasks.workunit.client.1.smithi131.stdout:6/708: rmdir d2/d6d/db9/d12 39 2024-02-15T18:31:43.623 INFO:tasks.workunit.client.1.smithi131.stdout:8/876: mknod d22/d26/d3f/d47/d57/dc1/c126 0 2024-02-15T18:31:43.623 INFO:tasks.workunit.client.1.smithi131.stdout:6/709: mkdir d2/d6d/db9/d12/d4d/ddb 0 2024-02-15T18:31:43.625 INFO:tasks.workunit.client.1.smithi131.stdout:6/710: symlink d2/d6d/db9/d12/d4d/ddb/ldc 0 2024-02-15T18:31:43.626 INFO:tasks.workunit.client.1.smithi131.stdout:2/769: dwrite dd/d1e/fb2 [0,4194304] 0 2024-02-15T18:31:43.636 INFO:tasks.workunit.client.1.smithi131.stdout:2/770: fdatasync dd/d10/db1/ffd 0 2024-02-15T18:31:43.637 INFO:tasks.workunit.client.1.smithi131.stdout:8/877: dread d22/d26/f55 [0,4194304] 0 2024-02-15T18:31:43.637 INFO:tasks.workunit.client.1.smithi131.stdout:8/878: fdatasync d22/d26/d3f/d47/d48/d5f/d6f/f116 0 2024-02-15T18:31:43.637 INFO:tasks.workunit.client.1.smithi131.stdout:2/771: read dd/d10/d22/d2f/d38/f3f [867270,125580] 0 2024-02-15T18:31:43.639 INFO:tasks.workunit.client.1.smithi131.stdout:2/772: unlink dd/f8d 0 2024-02-15T18:31:43.640 INFO:tasks.workunit.client.1.smithi131.stdout:8/879: rename d22/f6b to d22/f127 0 2024-02-15T18:31:43.641 INFO:tasks.workunit.client.1.smithi131.stdout:2/773: mknod dd/d10/d22/d2a/d48/c104 0 2024-02-15T18:31:43.642 INFO:tasks.workunit.client.1.smithi131.stdout:6/711: dwrite d2/d6d/db9/d12/d80/f92 [0,4194304] 0 2024-02-15T18:31:43.642 INFO:tasks.workunit.client.1.smithi131.stdout:8/880: creat d22/d26/d3f/d47/d48/f128 x:0 0 0 2024-02-15T18:31:43.645 INFO:tasks.workunit.client.1.smithi131.stdout:2/774: link dd/d1e/f5f dd/d10/f105 0 2024-02-15T18:31:43.645 INFO:tasks.workunit.client.1.smithi131.stdout:8/881: mknod d22/d26/d3f/d47/d57/d9f/c129 0 2024-02-15T18:31:43.650 INFO:tasks.workunit.client.1.smithi131.stdout:6/712: link f0 d2/d79/fdd 0 2024-02-15T18:31:43.651 INFO:tasks.workunit.client.1.smithi131.stdout:8/882: write f1d [1034703,62730] 0 2024-02-15T18:31:43.653 INFO:tasks.workunit.client.1.smithi131.stdout:6/713: rename d2/d6d/db9/d12/d80/f83 to d2/d6d/db9/fde 0 2024-02-15T18:31:43.653 INFO:tasks.workunit.client.1.smithi131.stdout:6/714: fdatasync d2/d79/fdd 0 2024-02-15T18:31:43.655 INFO:tasks.workunit.client.1.smithi131.stdout:6/715: unlink d2/dc/fd0 0 2024-02-15T18:31:43.655 INFO:tasks.workunit.client.1.smithi131.stdout:8/883: rename d22/d26/d3f/d47/d48/d84/daf/fb1 to d22/d26/d3f/d47/d57/dc1/d105/f12a 0 2024-02-15T18:31:43.657 INFO:tasks.workunit.client.1.smithi131.stdout:8/884: rename d22/d26/d3f/d47/d48/d5f/d70/db0/fbf to d22/d26/d3f/d47/d48/d5f/d70/db0/f12b 0 2024-02-15T18:31:43.660 INFO:tasks.workunit.client.1.smithi131.stdout:8/885: truncate d22/d2e/d5e/f80 227659 0 2024-02-15T18:31:43.661 INFO:tasks.workunit.client.1.smithi131.stdout:2/775: dwrite dd/d10/d22/d2a/d48/f83 [0,4194304] 0 2024-02-15T18:31:43.663 INFO:tasks.workunit.client.1.smithi131.stdout:2/776: read dd/d10/d22/da3/feb [514964,53695] 0 2024-02-15T18:31:43.663 INFO:tasks.workunit.client.1.smithi131.stdout:2/777: fsync dd/d10/d22/d2f/d38/f7c 0 2024-02-15T18:31:43.664 INFO:tasks.workunit.client.1.smithi131.stdout:8/886: mkdir d22/d26/d3f/d47/d48/d84/d11d/d12c 0 2024-02-15T18:31:43.672 INFO:tasks.workunit.client.1.smithi131.stdout:6/716: dwrite d2/d79/fc6 [0,4194304] 0 2024-02-15T18:31:43.678 INFO:tasks.workunit.client.1.smithi131.stdout:8/887: dwrite d22/d2e/d5e/db5/fd8 [0,4194304] 0 2024-02-15T18:31:43.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/778: creat dd/d14/d1f/d65/dd1/f106 x:0 0 0 2024-02-15T18:31:43.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/779: dread - dd/d10/d22/d2f/d38/d74/fa5 zero size 2024-02-15T18:31:43.698 INFO:tasks.workunit.client.1.smithi131.stdout:2/780: dread fa [0,4194304] 0 2024-02-15T18:31:43.699 INFO:tasks.workunit.client.1.smithi131.stdout:2/781: creat dd/d14/d1f/d95/f107 x:0 0 0 2024-02-15T18:31:43.701 INFO:tasks.workunit.client.1.smithi131.stdout:2/782: mknod dd/d10/d22/da3/c108 0 2024-02-15T18:31:43.702 INFO:tasks.workunit.client.1.smithi131.stdout:2/783: rename dd/d10/d22/d2f/d38/d74/l5a to dd/d10/db1/dbd/l109 0 2024-02-15T18:31:43.702 INFO:tasks.workunit.client.1.smithi131.stdout:2/784: truncate dd/d14/d1f/d65/fad 1340203 0 2024-02-15T18:31:43.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:41.655896+0000 mgr.smithi033.apxevf (mgr.14626) 11 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:43.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:42.005081+0000 mgr.smithi033.apxevf (mgr.14626) 12 : audit [DBG] from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:43.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:42.731427+0000 mon.smithi033 (mon.0) 675 : audit [DBG] from='client.? 172.21.15.33:0/2281832065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:31:43.930 INFO:tasks.workunit.client.1.smithi131.stdout:9/889: sync 2024-02-15T18:31:43.930 INFO:tasks.workunit.client.1.smithi131.stdout:5/953: sync 2024-02-15T18:31:43.934 INFO:tasks.workunit.client.1.smithi131.stdout:9/890: rename d4/dc/d25/d4e/d8a/c116 to d4/dc/de/d1e/d1f/d51/d5d/c125 0 2024-02-15T18:31:43.936 INFO:tasks.workunit.client.1.smithi131.stdout:5/954: mknod d18/d83/c13e 0 2024-02-15T18:31:43.937 INFO:tasks.workunit.client.1.smithi131.stdout:9/891: mknod d4/dc/de/d1e/d1f/df6/c126 0 2024-02-15T18:31:43.937 INFO:tasks.workunit.client.1.smithi131.stdout:9/892: chown d4/dc/d17/c8f 64 1 2024-02-15T18:31:43.937 INFO:tasks.workunit.client.1.smithi131.stdout:9/893: getdents d4/dc/d17/db0/dbc 0 2024-02-15T18:31:43.938 INFO:tasks.workunit.client.1.smithi131.stdout:9/894: creat d4/dc3/f127 x:0 0 0 2024-02-15T18:31:43.938 INFO:tasks.workunit.client.1.smithi131.stdout:9/895: read d4/dc/d17/d19/d84/ff0 [273842,81037] 0 2024-02-15T18:31:43.939 INFO:tasks.workunit.client.1.smithi131.stdout:9/896: symlink d4/dc/d17/d19/d32/d91/de5/d11d/l128 0 2024-02-15T18:31:43.939 INFO:tasks.workunit.client.1.smithi131.stdout:9/897: write d4/dc/d17/d19/d32/d91/de5/ff8 [4401653,22104] 0 2024-02-15T18:31:43.941 INFO:tasks.workunit.client.1.smithi131.stdout:9/898: link d4/dc/de/d1e/d1f/d51/d5d/f120 d4/dc/d17/d19/d32/d100/f129 0 2024-02-15T18:31:43.942 INFO:tasks.workunit.client.1.smithi131.stdout:9/899: dread - d4/dc/df7/f124 zero size 2024-02-15T18:31:43.944 INFO:tasks.workunit.client.1.smithi131.stdout:9/900: rename d4/dc/de/d1e/d1f/d101/d5b/f6b to d4/dc/d17/d19/d32/dc2/ddc/f12a 0 2024-02-15T18:31:43.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/901: write f0 [4848525,128506] 0 2024-02-15T18:31:43.949 INFO:tasks.workunit.client.1.smithi131.stdout:9/902: creat d4/dc/d17/f12b x:0 0 0 2024-02-15T18:31:43.949 INFO:tasks.workunit.client.1.smithi131.stdout:9/903: write d4/dc/df7/f106 [392435,119866] 0 2024-02-15T18:31:43.952 INFO:tasks.workunit.client.1.smithi131.stdout:9/904: creat d4/dc/d17/d19/d32/d100/f12c x:0 0 0 2024-02-15T18:31:43.954 INFO:tasks.workunit.client.1.smithi131.stdout:9/905: creat d4/dc/df7/f12d x:0 0 0 2024-02-15T18:31:43.956 INFO:tasks.workunit.client.1.smithi131.stdout:9/906: creat d4/dc/f12e x:0 0 0 2024-02-15T18:31:43.957 INFO:tasks.workunit.client.1.smithi131.stdout:9/907: link d4/dc/de/d1e/cbb d4/dc/d25/d4e/d38/c12f 0 2024-02-15T18:31:43.960 INFO:tasks.workunit.client.1.smithi131.stdout:9/908: rename d4/dc/de/d1e/d1f/d2c/dc0 to d4/dc/de/d130 0 2024-02-15T18:31:43.960 INFO:tasks.workunit.client.1.smithi131.stdout:5/955: dwrite d18/d83/f137 [0,4194304] 0 2024-02-15T18:31:43.963 INFO:tasks.workunit.client.1.smithi131.stdout:5/956: mkdir d18/d83/d8b/dba/d7b/d112/d13f 0 2024-02-15T18:31:43.963 INFO:tasks.workunit.client.1.smithi131.stdout:5/957: chown f6 31 1 2024-02-15T18:31:43.963 INFO:tasks.workunit.client.1.smithi131.stdout:5/958: fsync d18/d6d/d9c/fc9 0 2024-02-15T18:31:43.964 INFO:tasks.workunit.client.1.smithi131.stdout:5/959: write d18/d83/d8b/dba/d63/fcf [4824724,72110] 0 2024-02-15T18:31:43.965 INFO:tasks.workunit.client.1.smithi131.stdout:5/960: rename d18/d6d/f124 to d18/d6d/d9c/f140 0 2024-02-15T18:31:43.966 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:41.655896+0000 mgr.smithi033.apxevf (mgr.14626) 11 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:43.966 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:42.005081+0000 mgr.smithi033.apxevf (mgr.14626) 12 : audit [DBG] from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:43.967 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:42.731427+0000 mon.smithi033 (mon.0) 675 : audit [DBG] from='client.? 172.21.15.33:0/2281832065' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:31:43.972 INFO:tasks.workunit.client.1.smithi131.stdout:9/909: dread d4/dc/d25/d3f/f5c [0,4194304] 0 2024-02-15T18:31:43.973 INFO:tasks.workunit.client.1.smithi131.stdout:5/961: unlink d18/d6d/d9c/f128 0 2024-02-15T18:31:43.983 INFO:tasks.workunit.client.1.smithi131.stdout:9/910: dread d4/dc/d17/d19/d32/fd2 [0,4194304] 0 2024-02-15T18:31:43.983 INFO:tasks.workunit.client.1.smithi131.stdout:9/911: fsync d4/dc/d17/db0/dbc/fe1 0 2024-02-15T18:31:43.987 INFO:tasks.workunit.client.1.smithi131.stdout:9/912: link d4/dc/de/db4/ff4 d4/dc/de/d1e/d1f/d101/d72/f131 0 2024-02-15T18:31:43.987 INFO:tasks.workunit.client.1.smithi131.stdout:9/913: fsync d4/dc/d17/db0/dbc/f115 0 2024-02-15T18:31:43.987 INFO:tasks.workunit.client.1.smithi131.stdout:9/914: getdents d4/dc/d17/db0/dbc 0 2024-02-15T18:31:43.996 INFO:tasks.workunit.client.1.smithi131.stdout:5/962: dread d18/f1e [8388608,4194304] 0 2024-02-15T18:31:44.015 INFO:tasks.workunit.client.1.smithi131.stdout:5/963: dread d18/d83/d8b/dba/d63/fcf [0,4194304] 0 2024-02-15T18:31:44.015 INFO:tasks.workunit.client.1.smithi131.stdout:5/964: fdatasync d18/d83/d8b/dba/dda/fe4 0 2024-02-15T18:31:44.015 INFO:tasks.workunit.client.1.smithi131.stdout:5/965: write f6 [3082648,56864] 0 2024-02-15T18:31:44.015 INFO:tasks.workunit.client.1.smithi131.stdout:5/966: truncate d18/d83/d8b/dba/d63/f7e 5004084 0 2024-02-15T18:31:44.015 INFO:tasks.workunit.client.1.smithi131.stdout:5/967: chown d18/d33/d73/de8/d85/def/d10b/f3a 256530533 1 2024-02-15T18:31:44.055 INFO:tasks.workunit.client.1.smithi131.stdout:5/968: mknod d18/d33/d73/de8/d85/c141 0 2024-02-15T18:31:44.055 INFO:tasks.workunit.client.1.smithi131.stdout:5/969: getdents d18/d83/d89 0 2024-02-15T18:31:44.067 INFO:tasks.workunit.client.1.smithi131.stdout:4/998: sync 2024-02-15T18:31:44.075 INFO:tasks.workunit.client.1.smithi131.stdout:4/999: write d2/d2a/d47/f19 [844647,30195] 0 2024-02-15T18:31:44.079 INFO:tasks.workunit.client.1.smithi131.stdout:5/970: dwrite d18/d83/d8b/dba/d7b/dac/f11d [0,4194304] 0 2024-02-15T18:31:44.079 INFO:tasks.workunit.client.1.smithi131.stdout:5/971: chown d18 0 1 2024-02-15T18:31:44.196 INFO:tasks.workunit.client.1.smithi131.stdout:5/972: link d18/d20/f2f d18/d83/d8b/dba/d7b/d112/d13f/f142 0 2024-02-15T18:31:44.199 INFO:tasks.workunit.client.1.smithi131.stdout:5/973: unlink d18/d20/l3e 0 2024-02-15T18:31:44.201 INFO:tasks.workunit.client.1.smithi131.stdout:5/974: unlink d18/d33/d73/de8/d85/d95/cbd 0 2024-02-15T18:31:44.205 INFO:tasks.workunit.client.1.smithi131.stdout:5/975: rename d18/d83/cc3 to d18/d33/d73/de8/c143 0 2024-02-15T18:31:44.205 INFO:tasks.workunit.client.1.smithi131.stdout:5/976: dread - d18/d83/d8b/dba/d7b/deb/f123 zero size 2024-02-15T18:31:44.208 INFO:tasks.workunit.client.1.smithi131.stdout:7/850: sync 2024-02-15T18:31:44.210 INFO:tasks.workunit.client.1.smithi131.stdout:7/851: creat d0/d34/d8b/dfd/f10a x:0 0 0 2024-02-15T18:31:44.211 INFO:tasks.workunit.client.1.smithi131.stdout:5/977: dread f11 [0,4194304] 0 2024-02-15T18:31:44.213 INFO:tasks.workunit.client.1.smithi131.stdout:5/978: mkdir d18/d83/d8b/dba/d63/d144 0 2024-02-15T18:31:44.213 INFO:tasks.workunit.client.1.smithi131.stdout:5/979: chown d18/d83/d8b/dba/ff0 6688797 1 2024-02-15T18:31:44.213 INFO:tasks.workunit.client.1.smithi131.stdout:5/980: chown d18/d33/d73/de8/d85/def/f11c 220 1 2024-02-15T18:31:44.214 INFO:tasks.workunit.client.1.smithi131.stdout:5/981: symlink d18/d83/d8b/dba/dda/l145 0 2024-02-15T18:31:44.217 INFO:tasks.workunit.client.1.smithi131.stdout:5/982: creat d18/d83/d8b/dba/d7b/d112/d122/f146 x:0 0 0 2024-02-15T18:31:44.219 INFO:tasks.workunit.client.1.smithi131.stdout:7/852: dread d0/d17/f3c [0,4194304] 0 2024-02-15T18:31:44.219 INFO:tasks.workunit.client.1.smithi131.stdout:5/983: creat d18/d33/dd6/df5/d101/f147 x:0 0 0 2024-02-15T18:31:44.236 INFO:tasks.workunit.client.1.smithi131.stdout:7/853: dwrite d0/d17/d36/fe2 [0,4194304] 0 2024-02-15T18:31:44.239 INFO:tasks.workunit.client.1.smithi131.stdout:7/854: write d0/fd [3290901,47742] 0 2024-02-15T18:31:44.241 INFO:tasks.workunit.client.1.smithi131.stdout:5/984: rename d18/d83/d8b/dba to d18/d33/d73/de8/d86/d109/d148 0 2024-02-15T18:31:44.241 INFO:tasks.workunit.client.1.smithi131.stdout:7/855: read d0/d17/d3a/d3d/d79/d89/f95 [137490,34635] 0 2024-02-15T18:31:44.241 INFO:tasks.workunit.client.1.smithi131.stdout:7/856: dread - d0/d34/d8b/fa7 zero size 2024-02-15T18:31:44.241 INFO:tasks.workunit.client.1.smithi131.stdout:7/857: chown d0/d17/d3a/d3d/d79/db4 268 1 2024-02-15T18:31:44.243 INFO:tasks.workunit.client.1.smithi131.stdout:5/985: creat d18/d33/dd6/f149 x:0 0 0 2024-02-15T18:31:44.244 INFO:tasks.workunit.client.1.smithi131.stdout:7/858: symlink d0/d34/d8e/d98/l10b 0 2024-02-15T18:31:44.248 INFO:tasks.workunit.client.1.smithi131.stdout:7/859: rename d0/d34/d8e/d98/dc6/ld2 to d0/d34/l10c 0 2024-02-15T18:31:44.254 INFO:tasks.workunit.client.1.smithi131.stdout:7/860: mknod d0/d17/d36/c10d 0 2024-02-15T18:31:44.267 INFO:tasks.workunit.client.1.smithi131.stdout:5/986: dwrite d18/ff9 [0,4194304] 0 2024-02-15T18:31:44.267 INFO:tasks.workunit.client.1.smithi131.stdout:5/987: stat d18/d20/c40 0 2024-02-15T18:31:44.272 INFO:tasks.workunit.client.1.smithi131.stdout:5/988: write d18/d20/f4c [3471316,29044] 0 2024-02-15T18:31:44.272 INFO:tasks.workunit.client.1.smithi131.stdout:5/989: truncate d18/d33/d73/de8/d85/d95/fd0 377979 0 2024-02-15T18:31:44.274 INFO:tasks.workunit.client.1.smithi131.stdout:5/990: getdents d18/d33/d73/de8/d86/d109/d148/d63 0 2024-02-15T18:31:44.274 INFO:tasks.workunit.client.1.smithi131.stdout:5/991: write d18/d33/d73/de8/d85/def/f12d [398551,122648] 0 2024-02-15T18:31:44.276 INFO:tasks.workunit.client.1.smithi131.stdout:5/992: rename d18/d6d/ce7 to d18/d33/dd6/c14a 0 2024-02-15T18:31:44.279 INFO:tasks.workunit.client.1.smithi131.stdout:7/861: dwrite d0/d34/f74 [0,4194304] 0 2024-02-15T18:31:44.286 INFO:tasks.workunit.client.1.smithi131.stdout:7/862: dread d0/d17/d3a/d3d/f53 [0,4194304] 0 2024-02-15T18:31:44.286 INFO:tasks.workunit.client.1.smithi131.stdout:7/863: chown d0/d34/la1 9 1 2024-02-15T18:31:44.290 INFO:tasks.workunit.client.1.smithi131.stdout:7/864: creat d0/db8/f10e x:0 0 0 2024-02-15T18:31:44.291 INFO:tasks.workunit.client.1.smithi131.stdout:7/865: link d0/l4f d0/dba/l10f 0 2024-02-15T18:31:44.300 INFO:tasks.workunit.client.1.smithi131.stdout:7/866: dread d0/d34/f8d [0,4194304] 0 2024-02-15T18:31:44.300 INFO:tasks.workunit.client.1.smithi131.stdout:7/867: fdatasync d0/d9d/dc8/fdb 0 2024-02-15T18:31:44.301 INFO:tasks.workunit.client.1.smithi131.stdout:7/868: truncate d0/db8/f10e 1038005 0 2024-02-15T18:31:44.301 INFO:tasks.workunit.client.1.smithi131.stdout:7/869: dread - d0/d34/d8b/fab zero size 2024-02-15T18:31:44.301 INFO:tasks.workunit.client.1.smithi131.stdout:7/870: write d0/d17/d3a/d3d/d79/d89/fe6 [998178,66828] 0 2024-02-15T18:31:44.302 INFO:tasks.workunit.client.1.smithi131.stdout:7/871: creat d0/d17/d3a/d3d/df4/f110 x:0 0 0 2024-02-15T18:31:44.305 INFO:tasks.workunit.client.1.smithi131.stdout:7/872: link d0/da9/de4/ff6 d0/d34/d8e/f111 0 2024-02-15T18:31:44.305 INFO:tasks.workunit.client.1.smithi131.stdout:7/873: stat d0/d34/d8e 0 2024-02-15T18:31:44.306 INFO:tasks.workunit.client.1.smithi131.stdout:7/874: creat d0/d17/de1/f112 x:0 0 0 2024-02-15T18:31:44.308 INFO:tasks.workunit.client.1.smithi131.stdout:7/875: rename d0/d34/d8b/fa7 to d0/d17/d3a/d3d/df4/f113 0 2024-02-15T18:31:44.308 INFO:tasks.workunit.client.1.smithi131.stdout:7/876: chown d0/d17/d3a/d3d/d79/d89/fb1 955 1 2024-02-15T18:31:44.309 INFO:tasks.workunit.client.1.smithi131.stdout:5/993: dwrite d18/d33/d73/de8/d85/def/d10b/f3a [0,4194304] 0 2024-02-15T18:31:44.316 INFO:tasks.workunit.client.1.smithi131.stdout:5/994: symlink d18/d33/d73/de8/d86/d109/d148/d7b/l14b 0 2024-02-15T18:31:44.317 INFO:tasks.workunit.client.1.smithi131.stdout:5/995: rmdir d18/d33/d73/de8/d85/d95/d100 39 2024-02-15T18:31:44.318 INFO:tasks.workunit.client.1.smithi131.stdout:5/996: creat d18/d6d/d9c/f14c x:0 0 0 2024-02-15T18:31:44.318 INFO:tasks.workunit.client.1.smithi131.stdout:5/997: write d18/d33/d73/de8/d86/d109/d148/dda/de9/ff1 [2062735,38631] 0 2024-02-15T18:31:44.339 INFO:tasks.workunit.client.1.smithi131.stdout:7/877: dwrite d0/d34/f100 [0,4194304] 0 2024-02-15T18:31:44.340 INFO:tasks.workunit.client.1.smithi131.stdout:0/751: sync 2024-02-15T18:31:44.340 INFO:tasks.workunit.client.1.smithi131.stdout:7/878: fdatasync d0/da9/de4/ff2 0 2024-02-15T18:31:44.340 INFO:tasks.workunit.client.1.smithi131.stdout:7/879: fsync d0/d17/f6c 0 2024-02-15T18:31:44.340 INFO:tasks.workunit.client.1.smithi131.stdout:8/888: sync 2024-02-15T18:31:44.340 INFO:tasks.workunit.client.1.smithi131.stdout:8/889: write d22/d26/d3f/d47/d48/d5f/d6f/d7a/fcd [757586,44072] 0 2024-02-15T18:31:44.341 INFO:tasks.workunit.client.1.smithi131.stdout:8/890: truncate f17 1170306 0 2024-02-15T18:31:44.341 INFO:tasks.workunit.client.1.smithi131.stdout:8/891: chown d22/d26/d3f/d7c/fd9 11 1 2024-02-15T18:31:44.341 INFO:tasks.workunit.client.1.smithi131.stdout:2/785: sync 2024-02-15T18:31:44.341 INFO:tasks.workunit.client.1.smithi131.stdout:6/717: sync 2024-02-15T18:31:44.345 INFO:tasks.workunit.client.1.smithi131.stdout:2/786: unlink dd/d14/d1f/d65/c73 0 2024-02-15T18:31:44.345 INFO:tasks.workunit.client.1.smithi131.stdout:6/718: read d2/dc/d27/d62/db0/f3c [229408,19215] 0 2024-02-15T18:31:44.346 INFO:tasks.workunit.client.1.smithi131.stdout:5/998: dwrite d18/d33/d73/de8/d86/d109/d148/f59 [0,4194304] 0 2024-02-15T18:31:44.346 INFO:tasks.workunit.client.1.smithi131.stdout:0/752: read d5/d2f/d4b/dd9/d11/f88 [563465,80235] 0 2024-02-15T18:31:44.347 INFO:tasks.workunit.client.1.smithi131.stdout:0/753: write d5/d2f/d4b/dd9/d4d/f63 [4129518,130673] 0 2024-02-15T18:31:44.358 INFO:tasks.workunit.client.1.smithi131.stdout:7/880: rename d0/d17/d3a/c77 to d0/da9/dfa/c114 0 2024-02-15T18:31:44.358 INFO:tasks.workunit.client.1.smithi131.stdout:6/719: mknod d2/dc/d1f/daa/cdf 0 2024-02-15T18:31:44.358 INFO:tasks.workunit.client.1.smithi131.stdout:7/881: read d0/d34/fa2 [702736,32063] 0 2024-02-15T18:31:44.358 INFO:tasks.workunit.client.1.smithi131.stdout:5/999: creat d18/d33/dd6/df5/d101/f14d x:0 0 0 2024-02-15T18:31:44.358 INFO:tasks.workunit.client.1.smithi131.stdout:6/720: unlink d2/dc/la8 0 2024-02-15T18:31:44.358 INFO:tasks.workunit.client.1.smithi131.stdout:7/882: creat d0/d9d/dc8/dd1/f115 x:0 0 0 2024-02-15T18:31:44.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/787: dread dd/d10/d22/d2f/d38/d74/d2e/d66/fa7 [0,4194304] 0 2024-02-15T18:31:44.361 INFO:tasks.workunit.client.1.smithi131.stdout:6/721: rename d2/d6d/db9/d90 to d2/dc/d1f/dbc/de0 0 2024-02-15T18:31:44.361 INFO:tasks.workunit.client.1.smithi131.stdout:0/754: dread d5/d2f/d45/f95 [0,4194304] 0 2024-02-15T18:31:44.361 INFO:tasks.workunit.client.1.smithi131.stdout:0/755: read d5/d2f/d4b/dd9/d11/d3e/f59 [489509,9982] 0 2024-02-15T18:31:44.373 INFO:tasks.workunit.client.1.smithi131.stdout:6/722: creat d2/dc/d27/d62/fe1 x:0 0 0 2024-02-15T18:31:44.373 INFO:tasks.workunit.client.1.smithi131.stdout:6/723: read d2/d6d/db9/f54 [2557753,34327] 0 2024-02-15T18:31:44.373 INFO:tasks.workunit.client.1.smithi131.stdout:2/788: read dd/d14/d1f/f90 [3889677,35219] 0 2024-02-15T18:31:44.373 INFO:tasks.workunit.client.1.smithi131.stdout:6/724: write d2/dc/d1f/f93 [3970737,5865] 0 2024-02-15T18:31:44.373 INFO:tasks.workunit.client.1.smithi131.stdout:6/725: stat d2/d79/cc9 0 2024-02-15T18:31:44.373 INFO:tasks.workunit.client.1.smithi131.stdout:0/756: link d5/d2f/d4b/d82/d9f/fd3 d5/d2f/d4b/dd9/d10/d71/d92/df6/ff9 0 2024-02-15T18:31:44.373 INFO:tasks.workunit.client.1.smithi131.stdout:6/726: rename d2/d79/fdd to d2/d6d/db9/d48/d40/fe2 0 2024-02-15T18:31:44.375 INFO:tasks.workunit.client.1.smithi131.stdout:0/757: read d5/d2f/d4b/dd9/d10/db7/fbb [135122,98350] 0 2024-02-15T18:31:44.376 INFO:tasks.workunit.client.1.smithi131.stdout:2/789: write dd/d10/d22/d2a/d48/f83 [1585012,32810] 0 2024-02-15T18:31:44.376 INFO:tasks.workunit.client.1.smithi131.stdout:0/758: creat d5/d2f/d4b/dd9/d10/d71/ffa x:0 0 0 2024-02-15T18:31:44.376 INFO:tasks.workunit.client.1.smithi131.stdout:0/759: stat d5/d2f/d4b/dd9/d10/f1e 0 2024-02-15T18:31:44.378 INFO:tasks.workunit.client.1.smithi131.stdout:2/790: write dd/d1e/fb2 [1172596,39745] 0 2024-02-15T18:31:44.380 INFO:tasks.workunit.client.1.smithi131.stdout:8/892: dwrite d22/d39/f10c [0,4194304] 0 2024-02-15T18:31:44.382 INFO:tasks.workunit.client.1.smithi131.stdout:7/883: dwrite d0/d17/d3a/f54 [4194304,4194304] 0 2024-02-15T18:31:44.384 INFO:tasks.workunit.client.1.smithi131.stdout:8/893: write d22/d26/d3f/d47/d48/d5f/fa3 [638288,50084] 0 2024-02-15T18:31:44.387 INFO:tasks.workunit.client.1.smithi131.stdout:0/760: creat d5/d2f/d4b/dd9/d77/da8/dad/ffb x:0 0 0 2024-02-15T18:31:44.391 INFO:tasks.workunit.client.1.smithi131.stdout:0/761: rename d5/d2f/d4b/dd9/d11/d3e/lc8 to d5/d2f/d4b/dd9/d11/d3e/lfc 0 2024-02-15T18:31:44.391 INFO:tasks.workunit.client.1.smithi131.stdout:6/727: dread d2/dc/f22 [4194304,4194304] 0 2024-02-15T18:31:44.391 INFO:tasks.workunit.client.1.smithi131.stdout:7/884: dread d0/d9d/dc8/fdb [0,4194304] 0 2024-02-15T18:31:44.394 INFO:tasks.workunit.client.1.smithi131.stdout:9/915: sync 2024-02-15T18:31:44.394 INFO:tasks.workunit.client.1.smithi131.stdout:9/916: write d4/dc/d17/d19/fb9 [3311053,21773] 0 2024-02-15T18:31:44.394 INFO:tasks.workunit.client.1.smithi131.stdout:9/917: dread - d4/dc/d17/db0/dbc/f115 zero size 2024-02-15T18:31:44.394 INFO:tasks.workunit.client.1.smithi131.stdout:9/918: write d4/d78/fef [170047,38170] 0 2024-02-15T18:31:44.394 INFO:tasks.workunit.client.1.smithi131.stdout:8/894: mkdir d22/d26/d3f/d47/d48/d84/d11d/d12c/d12d 0 2024-02-15T18:31:44.395 INFO:tasks.workunit.client.1.smithi131.stdout:6/728: unlink d2/d6d/db9/lc7 0 2024-02-15T18:31:44.395 INFO:tasks.workunit.client.1.smithi131.stdout:7/885: creat d0/da9/de4/d104/f116 x:0 0 0 2024-02-15T18:31:44.398 INFO:tasks.workunit.client.1.smithi131.stdout:7/886: creat d0/d34/d8b/dfd/f117 x:0 0 0 2024-02-15T18:31:44.398 INFO:tasks.workunit.client.1.smithi131.stdout:6/729: rmdir d2/dc/d27/d62/db0 39 2024-02-15T18:31:44.401 INFO:tasks.workunit.client.1.smithi131.stdout:0/762: dread d5/d2f/d4b/f8a [0,4194304] 0 2024-02-15T18:31:44.402 INFO:tasks.workunit.client.1.smithi131.stdout:8/895: truncate d22/d26/f35 1079325 0 2024-02-15T18:31:44.402 INFO:tasks.workunit.client.1.smithi131.stdout:0/763: read d5/d2f/d4b/dd9/d10/d71/d92/df6/fe4 [301046,5846] 0 2024-02-15T18:31:44.403 INFO:tasks.workunit.client.1.smithi131.stdout:0/764: creat d5/d2f/d4b/dd9/d10/d71/ffd x:0 0 0 2024-02-15T18:31:44.404 INFO:tasks.workunit.client.1.smithi131.stdout:0/765: fsync d5/d2f/d4b/dd9/d10/d3f/f61 0 2024-02-15T18:31:44.405 INFO:tasks.workunit.client.1.smithi131.stdout:8/896: rmdir d22/d26/d3f/d47/d48/d5f/d6f/d7a/d10b 0 2024-02-15T18:31:44.408 INFO:tasks.workunit.client.1.smithi131.stdout:2/791: dwrite dd/d14/d1f/f100 [0,4194304] 0 2024-02-15T18:31:44.408 INFO:tasks.workunit.client.1.smithi131.stdout:2/792: write dd/d14/d1f/d65/dd1/f106 [463248,28543] 0 2024-02-15T18:31:44.418 INFO:tasks.workunit.client.1.smithi131.stdout:7/887: dread d0/d17/d3a/d3d/f84 [8388608,4194304] 0 2024-02-15T18:31:44.418 INFO:tasks.workunit.client.1.smithi131.stdout:7/888: chown d0/d34/lc3 2 1 2024-02-15T18:31:44.418 INFO:tasks.workunit.client.1.smithi131.stdout:6/730: dread f0 [0,4194304] 0 2024-02-15T18:31:44.418 INFO:tasks.workunit.client.1.smithi131.stdout:8/897: creat d22/d26/d3f/d47/d48/d84/f12e x:0 0 0 2024-02-15T18:31:44.418 INFO:tasks.workunit.client.1.smithi131.stdout:7/889: mkdir d0/d17/d3a/d3d/df4/d118 0 2024-02-15T18:31:44.420 INFO:tasks.workunit.client.1.smithi131.stdout:8/898: truncate d22/d2e/d5e/db5/fd8 1196031 0 2024-02-15T18:31:44.422 INFO:tasks.workunit.client.1.smithi131.stdout:6/731: symlink d2/d79/dad/le3 0 2024-02-15T18:31:44.422 INFO:tasks.workunit.client.1.smithi131.stdout:7/890: write d0/d17/d3a/f91 [1092244,87199] 0 2024-02-15T18:31:44.423 INFO:tasks.workunit.client.1.smithi131.stdout:8/899: mknod d22/d26/d3f/d47/d57/dc1/d105/c12f 0 2024-02-15T18:31:44.424 INFO:tasks.workunit.client.1.smithi131.stdout:8/900: truncate d22/d26/d3f/ffe 715788 0 2024-02-15T18:31:44.425 INFO:tasks.workunit.client.1.smithi131.stdout:8/901: creat d22/d119/f130 x:0 0 0 2024-02-15T18:31:44.425 INFO:tasks.workunit.client.1.smithi131.stdout:8/902: truncate d22/d26/d3f/d47/d57/dc1/f113 1019358 0 2024-02-15T18:31:44.426 INFO:tasks.workunit.client.1.smithi131.stdout:9/919: dwrite d4/dc/d25/d3f/f5c [0,4194304] 0 2024-02-15T18:31:44.429 INFO:tasks.workunit.client.1.smithi131.stdout:8/903: truncate d22/d26/d3f/d47/f4a 646716 0 2024-02-15T18:31:44.435 INFO:tasks.workunit.client.1.smithi131.stdout:8/904: truncate d22/f23 2641069 0 2024-02-15T18:31:44.438 INFO:tasks.workunit.client.1.smithi131.stdout:8/905: rename d22/d2e/d5e/db5/lb8 to d22/d26/d3f/d47/dc3/l131 0 2024-02-15T18:31:44.441 INFO:tasks.workunit.client.1.smithi131.stdout:2/793: dwrite dd/d14/d1f/d65/d77/d7a/da2/fe6 [0,4194304] 0 2024-02-15T18:31:44.441 INFO:tasks.workunit.client.1.smithi131.stdout:0/766: dwrite d5/d2f/d4b/dd9/d11/f14 [4194304,4194304] 0 2024-02-15T18:31:44.446 INFO:tasks.workunit.client.1.smithi131.stdout:0/767: unlink d5/d2f/d4b/dd9/l90 0 2024-02-15T18:31:44.447 INFO:tasks.workunit.client.1.smithi131.stdout:8/906: creat d22/d26/d3f/d47/d48/d84/d11d/d12c/d12d/f132 x:0 0 0 2024-02-15T18:31:44.447 INFO:tasks.workunit.client.1.smithi131.stdout:8/907: fdatasync d22/d26/d3f/d47/d48/d84/fc8 0 2024-02-15T18:31:44.448 INFO:tasks.workunit.client.1.smithi131.stdout:8/908: dread - d22/d26/d3f/d86/f118 zero size 2024-02-15T18:31:44.448 INFO:tasks.workunit.client.1.smithi131.stdout:0/768: truncate d5/d2f/d4b/f69 4065506 0 2024-02-15T18:31:44.449 INFO:tasks.workunit.client.1.smithi131.stdout:8/909: dread d22/d26/d3f/ffe [0,4194304] 0 2024-02-15T18:31:44.450 INFO:tasks.workunit.client.1.smithi131.stdout:7/891: dwrite d0/d34/fb7 [0,4194304] 0 2024-02-15T18:31:44.450 INFO:tasks.workunit.client.1.smithi131.stdout:7/892: stat d0/c46 0 2024-02-15T18:31:44.450 INFO:tasks.workunit.client.1.smithi131.stdout:7/893: fdatasync d0/f57 0 2024-02-15T18:31:44.450 INFO:tasks.workunit.client.1.smithi131.stdout:9/920: write d4/dc/d25/d4e/d8a/f8d [2196246,117186] 0 2024-02-15T18:31:44.450 INFO:tasks.workunit.client.1.smithi131.stdout:6/732: dwrite d2/dc/d27/d62/db0/f9d [0,4194304] 0 2024-02-15T18:31:44.451 INFO:tasks.workunit.client.1.smithi131.stdout:8/910: unlink d22/d26/d3f/d47/d48/d5f/d6f/l11c 0 2024-02-15T18:31:44.453 INFO:tasks.workunit.client.1.smithi131.stdout:8/911: creat d22/d26/d3f/d47/d57/dc5/f133 x:0 0 0 2024-02-15T18:31:44.454 INFO:tasks.workunit.client.1.smithi131.stdout:8/912: chown d22/d26/d3f/d47/d48/d5f/d70/db0/f102 0 1 2024-02-15T18:31:44.454 INFO:tasks.workunit.client.1.smithi131.stdout:8/913: chown f17 53 1 2024-02-15T18:31:44.454 INFO:tasks.workunit.client.1.smithi131.stdout:8/914: fsync d22/d26/f82 0 2024-02-15T18:31:44.454 INFO:tasks.workunit.client.1.smithi131.stdout:7/894: creat d0/d17/d3a/d3d/d79/d89/f119 x:0 0 0 2024-02-15T18:31:44.455 INFO:tasks.workunit.client.1.smithi131.stdout:6/733: creat d2/dc/d1f/dbc/db6/dbb/fe4 x:0 0 0 2024-02-15T18:31:44.460 INFO:tasks.workunit.client.1.smithi131.stdout:0/769: dread f4 [0,4194304] 0 2024-02-15T18:31:44.463 INFO:tasks.workunit.client.1.smithi131.stdout:6/734: rmdir d2/dc/d27/d74 39 2024-02-15T18:31:44.463 INFO:tasks.workunit.client.1.smithi131.stdout:0/770: getdents d5/d2f 0 2024-02-15T18:31:44.467 INFO:tasks.workunit.client.1.smithi131.stdout:6/735: getdents d2/d6d/db9/d12 0 2024-02-15T18:31:44.468 INFO:tasks.workunit.client.1.smithi131.stdout:0/771: creat d5/d2f/d4b/dd9/d11/df3/ffe x:0 0 0 2024-02-15T18:31:44.469 INFO:tasks.workunit.client.1.smithi131.stdout:6/736: rmdir d2/d2b/d6e 39 2024-02-15T18:31:44.469 INFO:tasks.workunit.client.1.smithi131.stdout:0/772: mknod d5/d2f/d4b/dd9/d11/cff 0 2024-02-15T18:31:44.474 INFO:tasks.workunit.client.1.smithi131.stdout:0/773: link d5/d2f/d4b/dd9/d4d/f89 d5/d2f/d4b/dd9/d10/d71/d92/ddd/f100 0 2024-02-15T18:31:44.476 INFO:tasks.workunit.client.1.smithi131.stdout:2/794: dwrite dd/d10/d22/d2f/d38/d74/d2e/f32 [4194304,4194304] 0 2024-02-15T18:31:44.476 INFO:tasks.workunit.client.1.smithi131.stdout:2/795: write dd/d14/d1f/d65/d77/f7e [5530488,13733] 0 2024-02-15T18:31:44.476 INFO:tasks.workunit.client.1.smithi131.stdout:2/796: chown dd/d10/d22/d2f/d38/d74/d2e/la0 991958479 1 2024-02-15T18:31:44.476 INFO:tasks.workunit.client.1.smithi131.stdout:2/797: readlink dd/d10/d22/d2f/ld3 0 2024-02-15T18:31:44.477 INFO:tasks.workunit.client.1.smithi131.stdout:2/798: write dd/d14/d1f/d65/dd1/f106 [1150499,94195] 0 2024-02-15T18:31:44.477 INFO:tasks.workunit.client.1.smithi131.stdout:0/774: creat d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/df1/f101 x:0 0 0 2024-02-15T18:31:44.477 INFO:tasks.workunit.client.1.smithi131.stdout:0/775: chown d5/d15/d1f/f57 1387 1 2024-02-15T18:31:44.479 INFO:tasks.workunit.client.1.smithi131.stdout:2/799: symlink dd/d10/d22/l10a 0 2024-02-15T18:31:44.480 INFO:tasks.workunit.client.1.smithi131.stdout:0/776: creat d5/d2f/d4b/dd9/f102 x:0 0 0 2024-02-15T18:31:44.482 INFO:tasks.workunit.client.1.smithi131.stdout:2/800: symlink dd/d14/l10b 0 2024-02-15T18:31:44.483 INFO:tasks.workunit.client.1.smithi131.stdout:9/921: dwrite d4/dc/f2d [0,4194304] 0 2024-02-15T18:31:44.483 INFO:tasks.workunit.client.1.smithi131.stdout:9/922: write d4/dc/de/d1e/d1f/d51/d5d/ffc [1007054,56952] 0 2024-02-15T18:31:44.483 INFO:tasks.workunit.client.1.smithi131.stdout:9/923: dread - d4/dc/d17/d19/d84/fdf zero size 2024-02-15T18:31:44.483 INFO:tasks.workunit.client.1.smithi131.stdout:9/924: dread - d4/dc/d17/d19/f123 zero size 2024-02-15T18:31:44.485 INFO:tasks.workunit.client.1.smithi131.stdout:7/895: dwrite d0/d34/d8e/fd9 [0,4194304] 0 2024-02-15T18:31:44.486 INFO:tasks.workunit.client.1.smithi131.stdout:0/777: mknod d5/d2f/d4b/dd9/d77/d8b/c103 0 2024-02-15T18:31:44.486 INFO:tasks.workunit.client.1.smithi131.stdout:0/778: truncate d5/d2f/d4b/f9b 1004660 0 2024-02-15T18:31:44.494 INFO:tasks.workunit.client.1.smithi131.stdout:2/801: dread dd/d10/fb4 [0,4194304] 0 2024-02-15T18:31:44.496 INFO:tasks.workunit.client.1.smithi131.stdout:6/737: dwrite d2/dc/d27/d62/db0/f5a [0,4194304] 0 2024-02-15T18:31:44.498 INFO:tasks.workunit.client.1.smithi131.stdout:2/802: rmdir dd/d10/d22/d2f/d38/d74/d2e/d6a/dc0 39 2024-02-15T18:31:44.499 INFO:tasks.workunit.client.1.smithi131.stdout:2/803: write dd/d14/d1f/d65/d77/d7a/da2/fc6 [774074,77571] 0 2024-02-15T18:31:44.501 INFO:tasks.workunit.client.1.smithi131.stdout:0/779: dread d5/f68 [0,4194304] 0 2024-02-15T18:31:44.501 INFO:tasks.workunit.client.1.smithi131.stdout:0/780: chown d5/d2f/d4b/d82/d9f/fd3 0 1 2024-02-15T18:31:44.501 INFO:tasks.workunit.client.1.smithi131.stdout:6/738: mknod d2/dc/d27/d74/d75/ce5 0 2024-02-15T18:31:44.501 INFO:tasks.workunit.client.1.smithi131.stdout:6/739: write d2/dc/d27/d62/d97/f25 [1815725,31651] 0 2024-02-15T18:31:44.501 INFO:tasks.workunit.client.1.smithi131.stdout:6/740: fsync d2/dc/d1f/f26 0 2024-02-15T18:31:44.501 INFO:tasks.workunit.client.1.smithi131.stdout:6/741: truncate d2/d6d/db9/d12/d4d/f65 936003 0 2024-02-15T18:31:44.503 INFO:tasks.workunit.client.1.smithi131.stdout:0/781: rename d5/d2f/d45/f95 to d5/d2f/d4b/dd9/d77/da8/f104 0 2024-02-15T18:31:44.503 INFO:tasks.workunit.client.1.smithi131.stdout:0/782: dread - d5/d2f/d4b/d82/fac zero size 2024-02-15T18:31:44.515 INFO:tasks.workunit.client.1.smithi131.stdout:6/742: dread d2/dc/f68 [0,4194304] 0 2024-02-15T18:31:44.516 INFO:tasks.workunit.client.1.smithi131.stdout:6/743: creat d2/d6d/db9/dca/fe6 x:0 0 0 2024-02-15T18:31:44.518 INFO:tasks.workunit.client.1.smithi131.stdout:6/744: getdents d2/dc 0 2024-02-15T18:31:44.520 INFO:tasks.workunit.client.1.smithi131.stdout:6/745: write d2/d6d/db9/d48/fa3 [1259033,73385] 0 2024-02-15T18:31:44.521 INFO:tasks.workunit.client.1.smithi131.stdout:9/925: dwrite d4/dc/de/d1e/d1f/d101/d72/fb8 [0,4194304] 0 2024-02-15T18:31:44.521 INFO:tasks.workunit.client.1.smithi131.stdout:6/746: write d2/f28 [4155958,121230] 0 2024-02-15T18:31:44.525 INFO:tasks.workunit.client.1.smithi131.stdout:7/896: dwrite d0/d17/d36/fef [0,4194304] 0 2024-02-15T18:31:44.528 INFO:tasks.workunit.client.1.smithi131.stdout:2/804: dwrite dd/d1e/fb2 [0,4194304] 0 2024-02-15T18:31:44.528 INFO:tasks.workunit.client.1.smithi131.stdout:2/805: fsync dd/d14/d1f/d65/d77/d7a/da2/fc6 0 2024-02-15T18:31:44.530 INFO:tasks.workunit.client.1.smithi131.stdout:2/806: rename dd/d14/d1f/l62 to dd/d10/d22/d2f/d38/d9f/l10c 0 2024-02-15T18:31:44.532 INFO:tasks.workunit.client.1.smithi131.stdout:2/807: mkdir dd/d69/d92/d10d 0 2024-02-15T18:31:44.532 INFO:tasks.workunit.client.1.smithi131.stdout:2/808: chown dd/d69/d92/d10d 19 1 2024-02-15T18:31:44.533 INFO:tasks.workunit.client.1.smithi131.stdout:2/809: symlink dd/d69/l10e 0 2024-02-15T18:31:44.533 INFO:tasks.workunit.client.1.smithi131.stdout:6/747: dread d2/dc/d27/d62/db0/f3c [0,4194304] 0 2024-02-15T18:31:44.533 INFO:tasks.workunit.client.1.smithi131.stdout:6/748: chown d2/dc/d1f/dbc/db6/dbb 50582 1 2024-02-15T18:31:44.534 INFO:tasks.workunit.client.1.smithi131.stdout:2/810: symlink dd/d14/d1f/d65/d81/ddd/l10f 0 2024-02-15T18:31:44.536 INFO:tasks.workunit.client.1.smithi131.stdout:6/749: creat d2/d6d/db9/d12/d80/fe7 x:0 0 0 2024-02-15T18:31:44.540 INFO:tasks.workunit.client.1.smithi131.stdout:2/811: truncate dd/f18 3125978 0 2024-02-15T18:31:44.541 INFO:tasks.workunit.client.1.smithi131.stdout:6/750: mkdir d2/d6d/de8 0 2024-02-15T18:31:44.543 INFO:tasks.workunit.client.1.smithi131.stdout:7/897: dwrite d0/d17/d3a/d3d/d79/d89/fed [0,4194304] 0 2024-02-15T18:31:44.543 INFO:tasks.workunit.client.1.smithi131.stdout:7/898: fdatasync d0/f47 0 2024-02-15T18:31:44.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/899: read - d0/d17/d3a/d3d/d79/d89/f119 zero size 2024-02-15T18:31:44.546 INFO:tasks.workunit.client.1.smithi131.stdout:2/812: dread dd/d14/d1f/d65/fad [0,4194304] 0 2024-02-15T18:31:44.546 INFO:tasks.workunit.client.1.smithi131.stdout:2/813: fsync dd/d14/d1f/d95/f107 0 2024-02-15T18:31:44.547 INFO:tasks.workunit.client.1.smithi131.stdout:6/751: fsync d2/dc/d27/d62/db0/f5a 0 2024-02-15T18:31:44.547 INFO:tasks.workunit.client.1.smithi131.stdout:7/900: dread d0/d34/f8d [0,4194304] 0 2024-02-15T18:31:44.547 INFO:tasks.workunit.client.1.smithi131.stdout:9/926: dwrite d4/dc/d17/f69 [0,4194304] 0 2024-02-15T18:31:44.548 INFO:tasks.workunit.client.1.smithi131.stdout:7/901: chown d0/d34/d8e/fd9 47270 1 2024-02-15T18:31:44.548 INFO:tasks.workunit.client.1.smithi131.stdout:9/927: dread - d4/dc/d17/d19/d32/dc2/ddc/f12a zero size 2024-02-15T18:31:44.549 INFO:tasks.workunit.client.1.smithi131.stdout:6/752: mknod d2/d6d/db9/d48/d40/ce9 0 2024-02-15T18:31:44.549 INFO:tasks.workunit.client.1.smithi131.stdout:2/814: read dd/d10/d22/d2f/d38/f50 [2840643,119926] 0 2024-02-15T18:31:44.549 INFO:tasks.workunit.client.1.smithi131.stdout:7/902: getdents d0/d34/d8b/dfd 0 2024-02-15T18:31:44.551 INFO:tasks.workunit.client.1.smithi131.stdout:9/928: mkdir d4/dc/d17/d19/d32/d91/de5/d11d/d132 0 2024-02-15T18:31:44.552 INFO:tasks.workunit.client.1.smithi131.stdout:7/903: creat d0/d34/d8e/df5/f11a x:0 0 0 2024-02-15T18:31:44.552 INFO:tasks.workunit.client.1.smithi131.stdout:7/904: write d0/d17/d3a/d3d/f53 [1615167,83679] 0 2024-02-15T18:31:44.552 INFO:tasks.workunit.client.1.smithi131.stdout:9/929: creat d4/dc/de/d1e/d1f/d101/d5b/daa/f133 x:0 0 0 2024-02-15T18:31:44.552 INFO:tasks.workunit.client.1.smithi131.stdout:9/930: chown d4/dc/de/d1e/d1f/d101/d5b/f87 5490 1 2024-02-15T18:31:44.620 INFO:tasks.workunit.client.1.smithi131.stdout:2/815: dread dd/d14/d1f/f90 [0,4194304] 0 2024-02-15T18:31:44.620 INFO:tasks.workunit.client.1.smithi131.stdout:7/905: mkdir d0/da9/de4/d11b 0 2024-02-15T18:31:44.620 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:43.082499+0000 mgr.smithi033.apxevf (mgr.14626) 13 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:44.621 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:43.451576+0000 mgr.smithi033.apxevf (mgr.14626) 14 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 1.8 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 72 MiB/s rd, 143 MiB/s wr, 284 op/s 2024-02-15T18:31:44.623 INFO:tasks.workunit.client.1.smithi131.stdout:2/816: rename dd/d14/d1f/d65/dd1 to dd/d10/d22/d2a/d110 0 2024-02-15T18:31:44.624 INFO:tasks.workunit.client.1.smithi131.stdout:7/906: mkdir d0/d17/d3a/d3d/d79/db4/dd7/d11c 0 2024-02-15T18:31:44.626 INFO:tasks.workunit.client.1.smithi131.stdout:7/907: creat d0/da9/dfa/f11d x:0 0 0 2024-02-15T18:31:44.626 INFO:tasks.workunit.client.1.smithi131.stdout:7/908: write d0/d17/d3a/d3d/d79/d89/f95 [957001,44719] 0 2024-02-15T18:31:44.627 INFO:tasks.workunit.client.1.smithi131.stdout:6/753: dwrite d2/dc/d27/d62/d97/f25 [0,4194304] 0 2024-02-15T18:31:44.627 INFO:tasks.workunit.client.1.smithi131.stdout:6/754: readlink d2/d6d/db9/d48/l5b 0 2024-02-15T18:31:44.628 INFO:tasks.workunit.client.1.smithi131.stdout:7/909: mknod d0/d17/de1/c11e 0 2024-02-15T18:31:44.629 INFO:tasks.workunit.client.1.smithi131.stdout:6/755: creat d2/dc/d27/d74/d75/dc0/fea x:0 0 0 2024-02-15T18:31:44.630 INFO:tasks.workunit.client.1.smithi131.stdout:6/756: truncate d2/d6d/db9/da4/fa6 4642599 0 2024-02-15T18:31:44.630 INFO:tasks.workunit.client.1.smithi131.stdout:6/757: dread - d2/dc/d27/d74/fc1 zero size 2024-02-15T18:31:44.631 INFO:tasks.workunit.client.1.smithi131.stdout:7/910: rmdir d0/d34/d8b/d9a 39 2024-02-15T18:31:44.634 INFO:tasks.workunit.client.1.smithi131.stdout:7/911: write d0/f4a [2230833,11127] 0 2024-02-15T18:31:44.634 INFO:tasks.workunit.client.1.smithi131.stdout:7/912: dread - d0/d34/d8b/d9a/ffe zero size 2024-02-15T18:31:44.635 INFO:tasks.workunit.client.1.smithi131.stdout:7/913: read d0/d17/f23 [1280851,101003] 0 2024-02-15T18:31:44.635 INFO:tasks.workunit.client.1.smithi131.stdout:7/914: fdatasync d0/d34/d8b/fab 0 2024-02-15T18:31:44.638 INFO:tasks.workunit.client.1.smithi131.stdout:7/915: rename d0/d17/l18 to d0/d34/d8e/d98/l11f 0 2024-02-15T18:31:44.638 INFO:tasks.workunit.client.1.smithi131.stdout:7/916: stat d0/da9/dfa/f11d 0 2024-02-15T18:31:44.638 INFO:tasks.workunit.client.1.smithi131.stdout:7/917: stat d0/d17/d3a/d3d/c40 0 2024-02-15T18:31:44.641 INFO:tasks.workunit.client.1.smithi131.stdout:7/918: mknod d0/d34/d8e/d98/dc6/c120 0 2024-02-15T18:31:44.642 INFO:tasks.workunit.client.1.smithi131.stdout:7/919: write d0/d17/f5c [1824044,33023] 0 2024-02-15T18:31:44.642 INFO:tasks.workunit.client.1.smithi131.stdout:7/920: fdatasync d0/d34/d8b/d9a/f107 0 2024-02-15T18:31:44.644 INFO:tasks.workunit.client.1.smithi131.stdout:7/921: rename d0/d9d/dc8/ff3 to d0/d17/d3a/d3d/df4/d118/f121 0 2024-02-15T18:31:44.647 INFO:tasks.workunit.client.1.smithi131.stdout:2/817: dwrite dd/d10/d22/f6c [0,4194304] 0 2024-02-15T18:31:44.647 INFO:tasks.workunit.client.1.smithi131.stdout:2/818: dread - dd/d10/db1/fde zero size 2024-02-15T18:31:44.647 INFO:tasks.workunit.client.1.smithi131.stdout:2/819: dread - dd/d10/d22/d2f/d38/d74/d2e/d4a/fc8 zero size 2024-02-15T18:31:44.647 INFO:tasks.workunit.client.1.smithi131.stdout:2/820: chown dd/d10/d22/d2f/d38/d74/d2e/d66 44708794 1 2024-02-15T18:31:44.647 INFO:tasks.workunit.client.1.smithi131.stdout:2/821: chown dd/d14/d1f/d95 576907 1 2024-02-15T18:31:44.650 INFO:tasks.workunit.client.1.smithi131.stdout:6/758: dwrite d2/d2b/f69 [0,4194304] 0 2024-02-15T18:31:44.652 INFO:tasks.workunit.client.1.smithi131.stdout:6/759: mkdir d2/dc/deb 0 2024-02-15T18:31:44.653 INFO:tasks.workunit.client.1.smithi131.stdout:2/822: dread dd/d10/db1/ffd [0,4194304] 0 2024-02-15T18:31:44.654 INFO:tasks.workunit.client.1.smithi131.stdout:2/823: mknod dd/d10/d22/d2f/d38/d9f/c111 0 2024-02-15T18:31:44.655 INFO:tasks.workunit.client.1.smithi131.stdout:6/760: write d2/dc/d1f/f26 [3653376,104303] 0 2024-02-15T18:31:44.657 INFO:tasks.workunit.client.1.smithi131.stdout:6/761: rmdir d2/dc/d27/d78 39 2024-02-15T18:31:44.659 INFO:tasks.workunit.client.1.smithi131.stdout:2/824: unlink dd/d10/d22/d2f/d38/d9f/f102 0 2024-02-15T18:31:44.661 INFO:tasks.workunit.client.1.smithi131.stdout:6/762: rename d2/d6d/db9/d12/d4d/f57 to d2/dc/d27/d74/d75/dc0/fec 0 2024-02-15T18:31:44.663 INFO:tasks.workunit.client.1.smithi131.stdout:2/825: truncate dd/d10/d22/d2a/f2c 2017904 0 2024-02-15T18:31:44.663 INFO:tasks.workunit.client.1.smithi131.stdout:2/826: readlink dd/d10/d22/d2f/d38/d74/d2e/d66/lae 0 2024-02-15T18:31:44.663 INFO:tasks.workunit.client.1.smithi131.stdout:2/827: readlink dd/d14/d1f/d65/d81/ddd/l10f 0 2024-02-15T18:31:44.664 INFO:tasks.workunit.client.1.smithi131.stdout:7/922: dwrite d0/d17/f23 [0,4194304] 0 2024-02-15T18:31:44.667 INFO:tasks.workunit.client.1.smithi131.stdout:6/763: mkdir d2/d2b/d6e/ded 0 2024-02-15T18:31:44.669 INFO:tasks.workunit.client.1.smithi131.stdout:2/828: creat dd/d10/d22/d2a/d48/f112 x:0 0 0 2024-02-15T18:31:44.669 INFO:tasks.workunit.client.1.smithi131.stdout:7/923: creat d0/da9/de4/f122 x:0 0 0 2024-02-15T18:31:44.670 INFO:tasks.workunit.client.1.smithi131.stdout:6/764: mkdir d2/dc/d27/d74/dee 0 2024-02-15T18:31:44.671 INFO:tasks.workunit.client.1.smithi131.stdout:2/829: creat dd/d14/d1f/d65/d77/d7a/df3/f113 x:0 0 0 2024-02-15T18:31:44.672 INFO:tasks.workunit.client.1.smithi131.stdout:7/924: creat d0/d17/d36/f123 x:0 0 0 2024-02-15T18:31:44.672 INFO:tasks.workunit.client.1.smithi131.stdout:7/925: readlink d0/l86 0 2024-02-15T18:31:44.672 INFO:tasks.workunit.client.1.smithi131.stdout:7/926: getdents d0/d17/d3a/d3d/d79/db4/dd7/d11c 0 2024-02-15T18:31:44.673 INFO:tasks.workunit.client.1.smithi131.stdout:7/927: write d0/d9d/dc8/fdb [1867874,28293] 0 2024-02-15T18:31:44.673 INFO:tasks.workunit.client.1.smithi131.stdout:7/928: dread - d0/db8/f109 zero size 2024-02-15T18:31:44.673 INFO:tasks.workunit.client.1.smithi131.stdout:6/765: creat d2/d6d/db9/fef x:0 0 0 2024-02-15T18:31:44.673 INFO:tasks.workunit.client.1.smithi131.stdout:2/830: rmdir dd/d10/d22 39 2024-02-15T18:31:44.674 INFO:tasks.workunit.client.1.smithi131.stdout:7/929: symlink d0/d9d/dc8/dd1/l124 0 2024-02-15T18:31:44.675 INFO:tasks.workunit.client.1.smithi131.stdout:6/766: creat d2/d6d/db9/ff0 x:0 0 0 2024-02-15T18:31:44.676 INFO:tasks.workunit.client.1.smithi131.stdout:7/930: creat d0/d17/d3a/d3d/d79/db4/f125 x:0 0 0 2024-02-15T18:31:44.678 INFO:tasks.workunit.client.1.smithi131.stdout:6/767: mknod d2/dc/d27/d78/cf1 0 2024-02-15T18:31:44.679 INFO:tasks.workunit.client.1.smithi131.stdout:6/768: rmdir d2/dc/d1f/daa 39 2024-02-15T18:31:44.681 INFO:tasks.workunit.client.1.smithi131.stdout:6/769: mknod d2/d79/dad/cf2 0 2024-02-15T18:31:44.682 INFO:tasks.workunit.client.1.smithi131.stdout:6/770: symlink d2/d6d/db9/d12/d80/lf3 0 2024-02-15T18:31:44.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/831: dwrite dd/f60 [4194304,4194304] 0 2024-02-15T18:31:44.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/832: rename dd/d10/d22 to dd/d10/d22/d2f/d114 22 2024-02-15T18:31:44.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/833: write dd/d14/d1f/d65/d81/ddd/ff1 [336647,98087] 0 2024-02-15T18:31:44.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/834: write dd/d10/db1/dbd/fd9 [186386,75695] 0 2024-02-15T18:31:44.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/771: rmdir d2/d6d/db9/d12/d80 39 2024-02-15T18:31:44.700 INFO:tasks.workunit.client.1.smithi131.stdout:2/835: creat dd/d14/d1f/d65/d77/f115 x:0 0 0 2024-02-15T18:31:44.700 INFO:tasks.workunit.client.1.smithi131.stdout:2/836: stat dd/d14/lf7 0 2024-02-15T18:31:44.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:43.082499+0000 mgr.smithi033.apxevf (mgr.14626) 13 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:31:44.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:43.451576+0000 mgr.smithi033.apxevf (mgr.14626) 14 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 1.8 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 72 MiB/s rd, 143 MiB/s wr, 284 op/s 2024-02-15T18:31:45.070 INFO:tasks.workunit.client.1.smithi131.stdout:0/783: sync 2024-02-15T18:31:45.071 INFO:tasks.workunit.client.1.smithi131.stdout:8/915: sync 2024-02-15T18:31:45.071 INFO:tasks.workunit.client.1.smithi131.stdout:0/784: readlink d5/d2f/d4b/dd9/d77/da8/lc1 0 2024-02-15T18:31:45.071 INFO:tasks.workunit.client.1.smithi131.stdout:0/785: mknod d5/d2f/d4b/dbf/c105 0 2024-02-15T18:31:45.071 INFO:tasks.workunit.client.1.smithi131.stdout:8/916: write d22/d26/d3f/d47/d48/d5f/d70/db0/f12b [274373,2176] 0 2024-02-15T18:31:45.071 INFO:tasks.workunit.client.1.smithi131.stdout:8/917: read - d22/d26/f10f zero size 2024-02-15T18:31:45.072 INFO:tasks.workunit.client.1.smithi131.stdout:8/918: chown d22/d26/d3f/d47/d48/d5f/d70/l78 22867 1 2024-02-15T18:31:45.072 INFO:tasks.workunit.client.1.smithi131.stdout:0/786: getdents d5/d2f/d4b/dd9/d10/d73 0 2024-02-15T18:31:45.075 INFO:tasks.workunit.client.1.smithi131.stdout:8/919: dread d22/f27 [0,4194304] 0 2024-02-15T18:31:45.090 INFO:tasks.workunit.client.1.smithi131.stdout:0/787: dwrite d5/f9a [0,4194304] 0 2024-02-15T18:31:45.092 INFO:tasks.workunit.client.1.smithi131.stdout:0/788: link d5/d2f/d4b/dd9/d77/da8/f104 d5/d2f/d4b/dd9/d10/d71/d92/f106 0 2024-02-15T18:31:45.093 INFO:tasks.workunit.client.1.smithi131.stdout:0/789: mknod d5/d2f/d4b/c107 0 2024-02-15T18:31:45.094 INFO:tasks.workunit.client.1.smithi131.stdout:0/790: dread d5/d2f/d4b/dd9/d10/d71/d92/f93 [0,4194304] 0 2024-02-15T18:31:45.103 INFO:tasks.workunit.client.1.smithi131.stdout:8/920: mknod d22/d26/d3f/c134 0 2024-02-15T18:31:45.110 INFO:tasks.workunit.client.1.smithi131.stdout:8/921: write d22/d26/d3f/d47/f6d [2476017,71935] 0 2024-02-15T18:31:45.110 INFO:tasks.workunit.client.1.smithi131.stdout:8/922: write d22/d26/d3f/d47/d48/d5f/d6f/f116 [978191,116122] 0 2024-02-15T18:31:45.112 INFO:tasks.workunit.client.1.smithi131.stdout:8/923: mkdir d22/d2e/d60/d135 0 2024-02-15T18:31:45.114 INFO:tasks.workunit.client.1.smithi131.stdout:8/924: rename d22/d26/d3f/ffe to d22/d26/d3f/d47/d48/d84/d11d/f136 0 2024-02-15T18:31:45.116 INFO:tasks.workunit.client.1.smithi131.stdout:8/925: mknod d22/d26/d3f/d47/c137 0 2024-02-15T18:31:45.116 INFO:tasks.workunit.client.1.smithi131.stdout:8/926: write d22/d26/d3f/d47/d57/d9f/ff2 [393022,67216] 0 2024-02-15T18:31:45.131 INFO:tasks.workunit.client.1.smithi131.stdout:8/927: dwrite d22/d26/f6c [0,4194304] 0 2024-02-15T18:31:45.139 INFO:tasks.workunit.client.1.smithi131.stdout:8/928: mkdir d22/d26/d3f/d47/d57/dc1/d138 0 2024-02-15T18:31:45.145 INFO:tasks.workunit.client.1.smithi131.stdout:8/929: dread d22/d26/d3f/d47/d48/d5f/d6f/f116 [0,4194304] 0 2024-02-15T18:31:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:45.452179+0000 mgr.smithi033.apxevf (mgr.14626) 15 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 90 MiB/s rd, 178 MiB/s wr, 382 op/s 2024-02-15T18:31:46.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:45.452179+0000 mgr.smithi033.apxevf (mgr.14626) 15 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 90 MiB/s rd, 178 MiB/s wr, 382 op/s 2024-02-15T18:31:47.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:46.549562+0000 mon.smithi033 (mon.0) 676 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:31:47.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:46.861735+0000 mon.smithi033 (mon.0) 677 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:47.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:46.862473+0000 mon.smithi033 (mon.0) 678 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:47.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:46.866714+0000 mon.smithi033 (mon.0) 679 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:31:47.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:46.871734+0000 mon.smithi033 (mon.0) 680 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:47.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:46.549562+0000 mon.smithi033 (mon.0) 676 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:31:47.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:46.861735+0000 mon.smithi033 (mon.0) 677 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:47.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:46.862473+0000 mon.smithi033 (mon.0) 678 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:31:47.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:46.866714+0000 mon.smithi033 (mon.0) 679 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:31:47.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:46.871734+0000 mon.smithi033 (mon.0) 680 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:48.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:31:46.863255+0000 mgr.smithi033.apxevf (mgr.14626) 16 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:48.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:47.452643+0000 mgr.smithi033.apxevf (mgr.14626) 17 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 56 MiB/s rd, 113 MiB/s wr, 252 op/s 2024-02-15T18:31:48.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:31:46.863255+0000 mgr.smithi033.apxevf (mgr.14626) 16 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:31:48.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:47.452643+0000 mgr.smithi033.apxevf (mgr.14626) 17 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 56 MiB/s rd, 113 MiB/s wr, 252 op/s 2024-02-15T18:31:49.147 INFO:tasks.workunit.client.1.smithi131.stdout:9/931: sync 2024-02-15T18:31:49.147 INFO:tasks.workunit.client.1.smithi131.stdout:8/930: sync 2024-02-15T18:31:49.147 INFO:tasks.workunit.client.1.smithi131.stdout:7/931: sync 2024-02-15T18:31:49.148 INFO:tasks.workunit.client.1.smithi131.stdout:6/772: sync 2024-02-15T18:31:49.148 INFO:tasks.workunit.client.1.smithi131.stdout:6/773: fsync d2/d2b/f69 0 2024-02-15T18:31:49.150 INFO:tasks.workunit.client.1.smithi131.stdout:0/791: sync 2024-02-15T18:31:49.150 INFO:tasks.workunit.client.1.smithi131.stdout:0/792: chown d5/d2f/d4b/dd9/d10/d71/d92 0 1 2024-02-15T18:31:49.150 INFO:tasks.workunit.client.1.smithi131.stdout:2/837: sync 2024-02-15T18:31:49.152 INFO:tasks.workunit.client.1.smithi131.stdout:7/932: write d0/d17/d3a/f63 [1766454,54487] 0 2024-02-15T18:31:49.153 INFO:tasks.workunit.client.1.smithi131.stdout:7/933: fdatasync d0/d17/fbb 0 2024-02-15T18:31:49.153 INFO:tasks.workunit.client.1.smithi131.stdout:9/932: mkdir d4/dc/de/d1e/d1f/d51/d134 0 2024-02-15T18:31:49.153 INFO:tasks.workunit.client.1.smithi131.stdout:9/933: dread - d4/dc/d17/d19/d84/f112 zero size 2024-02-15T18:31:49.153 INFO:tasks.workunit.client.1.smithi131.stdout:9/934: truncate d4/dc/de/d1e/feb 779355 0 2024-02-15T18:31:49.153 INFO:tasks.workunit.client.1.smithi131.stdout:2/838: creat dd/d14/d1f/d65/d81/ddd/f116 x:0 0 0 2024-02-15T18:31:49.154 INFO:tasks.workunit.client.1.smithi131.stdout:7/934: creat d0/d34/d8b/dfd/f126 x:0 0 0 2024-02-15T18:31:49.156 INFO:tasks.workunit.client.1.smithi131.stdout:6/774: dread d2/d6d/db9/d12/d4d/f52 [0,4194304] 0 2024-02-15T18:31:49.156 INFO:tasks.workunit.client.1.smithi131.stdout:9/935: rename d4/dc/d17/d19/d32/dc2/ddc to d4/dc/d17/d19/d32/d91/db3/d135 0 2024-02-15T18:31:49.156 INFO:tasks.workunit.client.1.smithi131.stdout:6/775: readlink d2/dc/d27/d78/l88 0 2024-02-15T18:31:49.156 INFO:tasks.workunit.client.1.smithi131.stdout:6/776: stat d2/dc/d1f/dbc/db6/dbb 0 2024-02-15T18:31:49.158 INFO:tasks.workunit.client.1.smithi131.stdout:2/839: mkdir dd/d10/d22/d2a/d117 0 2024-02-15T18:31:49.159 INFO:tasks.workunit.client.1.smithi131.stdout:8/931: write d22/d26/f2f [1107703,111863] 0 2024-02-15T18:31:49.164 INFO:tasks.workunit.client.1.smithi131.stdout:7/935: mknod d0/da9/de4/c127 0 2024-02-15T18:31:49.164 INFO:tasks.workunit.client.1.smithi131.stdout:7/936: readlink d0/db8/dbe/lcc 0 2024-02-15T18:31:49.165 INFO:tasks.workunit.client.1.smithi131.stdout:8/932: mkdir d22/d26/d3f/d139 0 2024-02-15T18:31:49.171 INFO:tasks.workunit.client.1.smithi131.stdout:8/933: unlink d22/d2e/d60/l8f 0 2024-02-15T18:31:49.173 INFO:tasks.workunit.client.1.smithi131.stdout:8/934: write d22/d26/d3f/d47/d57/dc1/d105/f12a [2311762,68316] 0 2024-02-15T18:31:49.174 INFO:tasks.workunit.client.1.smithi131.stdout:6/777: dread d2/d2b/f9c [0,4194304] 0 2024-02-15T18:31:49.178 INFO:tasks.workunit.client.1.smithi131.stdout:8/935: mknod d22/d26/d3f/c13a 0 2024-02-15T18:31:49.178 INFO:tasks.workunit.client.1.smithi131.stdout:6/778: write d2/d6d/db9/d12/d4d/f52 [124609,45195] 0 2024-02-15T18:31:49.179 INFO:tasks.workunit.client.1.smithi131.stdout:0/793: dwrite d5/d2f/d4b/dd9/d11/f88 [0,4194304] 0 2024-02-15T18:31:49.188 INFO:tasks.workunit.client.1.smithi131.stdout:7/937: rmdir d0/d34/d8b/dfd 39 2024-02-15T18:31:49.188 INFO:tasks.workunit.client.1.smithi131.stdout:7/938: truncate d0/d17/d3a/d3d/df4/f110 470822 0 2024-02-15T18:31:49.188 INFO:tasks.workunit.client.1.smithi131.stdout:7/939: rmdir d0 39 2024-02-15T18:31:49.191 INFO:tasks.workunit.client.1.smithi131.stdout:7/940: rename d0/d17/d3a/d3d/fe5 to d0/d17/d36/f128 0 2024-02-15T18:31:49.192 INFO:tasks.workunit.client.1.smithi131.stdout:7/941: getdents d0/da9 0 2024-02-15T18:31:49.195 INFO:tasks.workunit.client.1.smithi131.stdout:8/936: getdents d22/d26/d3f/d47/d48/df5 0 2024-02-15T18:31:49.197 INFO:tasks.workunit.client.1.smithi131.stdout:2/840: dwrite f8 [0,4194304] 0 2024-02-15T18:31:49.197 INFO:tasks.workunit.client.1.smithi131.stdout:2/841: dread - dd/d10/d22/d2a/d48/f112 zero size 2024-02-15T18:31:49.199 INFO:tasks.workunit.client.1.smithi131.stdout:8/937: write f1d [579595,40708] 0 2024-02-15T18:31:49.206 INFO:tasks.workunit.client.1.smithi131.stdout:8/938: rename d22/d26/d3f/d47/d48/d84/c9e to d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/da2/c13b 0 2024-02-15T18:31:49.207 INFO:tasks.workunit.client.1.smithi131.stdout:0/794: dwrite d5/d2f/d4b/dd9/d11/d3e/fe2 [0,4194304] 0 2024-02-15T18:31:49.209 INFO:tasks.workunit.client.1.smithi131.stdout:8/939: write d22/d39/fac [3050199,130850] 0 2024-02-15T18:31:49.209 INFO:tasks.workunit.client.1.smithi131.stdout:0/795: mknod d5/d2f/d4b/dd9/d10/db7/c108 0 2024-02-15T18:31:49.210 INFO:tasks.workunit.client.1.smithi131.stdout:8/940: mknod d22/d26/d3f/d47/c13c 0 2024-02-15T18:31:49.210 INFO:tasks.workunit.client.1.smithi131.stdout:0/796: creat d5/d2f/d4b/dd9/d4d/f109 x:0 0 0 2024-02-15T18:31:49.211 INFO:tasks.workunit.client.1.smithi131.stdout:6/779: dwrite d2/dc/d1f/dbc/db6/fc3 [0,4194304] 0 2024-02-15T18:31:49.211 INFO:tasks.workunit.client.1.smithi131.stdout:0/797: write d5/d2f/f72 [221153,27209] 0 2024-02-15T18:31:49.212 INFO:tasks.workunit.client.1.smithi131.stdout:6/780: rmdir d2/d6d/db9/d12/d4d/ddb 39 2024-02-15T18:31:49.212 INFO:tasks.workunit.client.1.smithi131.stdout:6/781: readlink d2/dc/d1f/l77 0 2024-02-15T18:31:49.212 INFO:tasks.workunit.client.1.smithi131.stdout:8/941: mkdir d22/d26/d3f/d86/d13d 0 2024-02-15T18:31:49.212 INFO:tasks.workunit.client.1.smithi131.stdout:0/798: write d5/d2f/d4b/dd9/d10/d73/f99 [572986,4273] 0 2024-02-15T18:31:49.215 INFO:tasks.workunit.client.1.smithi131.stdout:0/799: read d5/d2f/d4b/dd9/d11/f14 [543346,71607] 0 2024-02-15T18:31:49.216 INFO:tasks.workunit.client.1.smithi131.stdout:8/942: creat d22/d26/d3f/d47/d48/d5f/d70/db0/f13e x:0 0 0 2024-02-15T18:31:49.218 INFO:tasks.workunit.client.1.smithi131.stdout:8/943: symlink d22/d26/d3f/d86/dcf/l13f 0 2024-02-15T18:31:49.220 INFO:tasks.workunit.client.1.smithi131.stdout:8/944: symlink d22/d26/l140 0 2024-02-15T18:31:49.220 INFO:tasks.workunit.client.1.smithi131.stdout:8/945: fsync d22/d26/d3f/d47/d57/dc1/f113 0 2024-02-15T18:31:49.220 INFO:tasks.workunit.client.1.smithi131.stdout:8/946: chown d22/d26/d3f/d7c/c97 5 1 2024-02-15T18:31:49.223 INFO:tasks.workunit.client.1.smithi131.stdout:8/947: rename d22/d26/d3f/d47/fae to d22/d26/d3f/d47/d57/dc1/d105/f141 0 2024-02-15T18:31:49.223 INFO:tasks.workunit.client.1.smithi131.stdout:8/948: chown d22/d2e/d5e/f75 7764918 1 2024-02-15T18:31:49.225 INFO:tasks.workunit.client.1.smithi131.stdout:2/842: dwrite dd/d10/d22/d2f/d38/d74/fa5 [0,4194304] 0 2024-02-15T18:31:49.225 INFO:tasks.workunit.client.1.smithi131.stdout:2/843: fsync dd/d10/dfa/d103/ff9 0 2024-02-15T18:31:49.225 INFO:tasks.workunit.client.1.smithi131.stdout:2/844: chown dd/d10/d22/d2f/cd8 2016 1 2024-02-15T18:31:49.225 INFO:tasks.workunit.client.1.smithi131.stdout:6/782: dread d2/d6d/db9/d12/d4d/f8b [0,4194304] 0 2024-02-15T18:31:49.226 INFO:tasks.workunit.client.1.smithi131.stdout:6/783: stat d2/dc/d1f/l77 0 2024-02-15T18:31:49.226 INFO:tasks.workunit.client.1.smithi131.stdout:6/784: fsync d2/d6d/db9/d12/d4d/f52 0 2024-02-15T18:31:49.226 INFO:tasks.workunit.client.1.smithi131.stdout:6/785: write d2/dc/d1f/dbc/db6/dbb/fe4 [717224,84145] 0 2024-02-15T18:31:49.226 INFO:tasks.workunit.client.1.smithi131.stdout:6/786: chown d2/dc/f68 46 1 2024-02-15T18:31:49.226 INFO:tasks.workunit.client.1.smithi131.stdout:8/949: stat l3 0 2024-02-15T18:31:49.229 INFO:tasks.workunit.client.1.smithi131.stdout:6/787: mkdir d2/dc/d1f/dbc/de0/df4 0 2024-02-15T18:31:49.232 INFO:tasks.workunit.client.1.smithi131.stdout:6/788: symlink d2/dc/d27/d62/d97/lf5 0 2024-02-15T18:31:49.232 INFO:tasks.workunit.client.1.smithi131.stdout:6/789: readlink d2/dc/d1f/l4b 0 2024-02-15T18:31:49.233 INFO:tasks.workunit.client.1.smithi131.stdout:8/950: creat d22/d119/f142 x:0 0 0 2024-02-15T18:31:49.234 INFO:tasks.workunit.client.1.smithi131.stdout:8/951: fdatasync f14 0 2024-02-15T18:31:49.235 INFO:tasks.workunit.client.1.smithi131.stdout:8/952: mknod d22/d26/d3f/d47/d57/dc1/d138/c143 0 2024-02-15T18:31:49.246 INFO:tasks.workunit.client.1.smithi131.stdout:2/845: dwrite dd/d14/d1f/d65/d81/ddd/ff1 [0,4194304] 0 2024-02-15T18:31:49.267 INFO:tasks.workunit.client.1.smithi131.stdout:2/846: dwrite dd/d10/d22/d2f/d38/d74/d2e/d4a/fc8 [0,4194304] 0 2024-02-15T18:31:49.270 INFO:tasks.workunit.client.1.smithi131.stdout:2/847: truncate dd/d10/d22/d2f/d38/d74/d2e/d6a/f7d 200445 0 2024-02-15T18:31:49.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:48.744568+0000 mon.smithi033 (mon.0) 681 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.buibla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:31:49.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:48.745356+0000 mon.smithi033 (mon.0) 682 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:31:49.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:48.746063+0000 mon.smithi033 (mon.0) 683 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:49.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:48.744568+0000 mon.smithi033 (mon.0) 681 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.buibla", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-15T18:31:49.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:48.745356+0000 mon.smithi033 (mon.0) 682 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-15T18:31:49.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:48.746063+0000 mon.smithi033 (mon.0) 683 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:31:50.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:31:48.744198+0000 mgr.smithi033.apxevf (mgr.14626) 18 : cephadm [INF] Upgrade: Updating mgr.smithi131.buibla 2024-02-15T18:31:50.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:31:48.746606+0000 mgr.smithi033.apxevf (mgr.14626) 19 : cephadm [INF] Deploying daemon mgr.smithi131.buibla on smithi131 2024-02-15T18:31:50.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:49.453091+0000 mgr.smithi033.apxevf (mgr.14626) 20 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 64 MiB/s rd, 130 MiB/s wr, 399 op/s 2024-02-15T18:31:50.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:31:48.744198+0000 mgr.smithi033.apxevf (mgr.14626) 18 : cephadm [INF] Upgrade: Updating mgr.smithi131.buibla 2024-02-15T18:31:50.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:31:48.746606+0000 mgr.smithi033.apxevf (mgr.14626) 19 : cephadm [INF] Deploying daemon mgr.smithi131.buibla on smithi131 2024-02-15T18:31:50.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:49.453091+0000 mgr.smithi033.apxevf (mgr.14626) 20 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 64 MiB/s rd, 130 MiB/s wr, 399 op/s 2024-02-15T18:31:51.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:51.453470+0000 mgr.smithi033.apxevf (mgr.14626) 21 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 26 MiB/s rd, 52 MiB/s wr, 244 op/s 2024-02-15T18:31:52.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:51.453470+0000 mgr.smithi033.apxevf (mgr.14626) 21 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 26 MiB/s rd, 52 MiB/s wr, 244 op/s 2024-02-15T18:31:52.561 INFO:tasks.workunit.client.1.smithi131.stdout:9/936: sync 2024-02-15T18:31:52.561 INFO:tasks.workunit.client.1.smithi131.stdout:6/790: sync 2024-02-15T18:31:52.561 INFO:tasks.workunit.client.1.smithi131.stdout:7/942: sync 2024-02-15T18:31:52.561 INFO:tasks.workunit.client.1.smithi131.stdout:2/848: sync 2024-02-15T18:31:52.561 INFO:tasks.workunit.client.1.smithi131.stdout:6/791: read - d2/dc/d27/d74/d75/dc0/fea zero size 2024-02-15T18:31:52.561 INFO:tasks.workunit.client.1.smithi131.stdout:2/849: read - dd/d14/d1f/d65/d81/fe1 zero size 2024-02-15T18:31:52.562 INFO:tasks.workunit.client.1.smithi131.stdout:0/800: sync 2024-02-15T18:31:52.563 INFO:tasks.workunit.client.1.smithi131.stdout:9/937: creat d4/dc/d17/d19/d32/d100/f136 x:0 0 0 2024-02-15T18:31:52.563 INFO:tasks.workunit.client.1.smithi131.stdout:8/953: sync 2024-02-15T18:31:52.569 INFO:tasks.workunit.client.1.smithi131.stdout:8/954: creat d22/d26/d3f/d47/d57/dc1/d105/f144 x:0 0 0 2024-02-15T18:31:52.572 INFO:tasks.workunit.client.1.smithi131.stdout:8/955: mkdir d22/d26/d3f/d47/d48/d5f/d6f/d7a/d145 0 2024-02-15T18:31:52.575 INFO:tasks.workunit.client.1.smithi131.stdout:8/956: link d22/d26/d3f/d47/d48/d5f/d6f/cf0 d22/d26/d3f/d47/d57/dc1/d138/c146 0 2024-02-15T18:31:52.576 INFO:tasks.workunit.client.1.smithi131.stdout:2/850: dread dd/d10/d22/d2f/d38/d74/d2e/f67 [0,4194304] 0 2024-02-15T18:31:52.576 INFO:tasks.workunit.client.1.smithi131.stdout:2/851: fsync dd/d10/fb4 0 2024-02-15T18:31:52.579 INFO:tasks.workunit.client.1.smithi131.stdout:2/852: unlink dd/d10/f105 0 2024-02-15T18:31:52.583 INFO:tasks.workunit.client.1.smithi131.stdout:8/957: write f14 [2592082,73659] 0 2024-02-15T18:31:52.583 INFO:tasks.workunit.client.1.smithi131.stdout:8/958: readlink l3 0 2024-02-15T18:31:52.583 INFO:tasks.workunit.client.1.smithi131.stdout:8/959: dread - d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/da2/f103 zero size 2024-02-15T18:31:52.583 INFO:tasks.workunit.client.1.smithi131.stdout:2/853: link dd/d10/d22/d2f/d38/d74/d2e/d4a/fc8 dd/d10/d22/d2f/d38/f118 0 2024-02-15T18:31:52.584 INFO:tasks.workunit.client.1.smithi131.stdout:8/960: creat d22/f147 x:0 0 0 2024-02-15T18:31:52.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/961: write d22/d26/f2d [3725360,124239] 0 2024-02-15T18:31:52.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/962: chown d22/d26/d3f/d47/d48/d84/d11d/d12c/d12d 2677702 1 2024-02-15T18:31:52.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/963: chown f17 65869705 1 2024-02-15T18:31:52.589 INFO:tasks.workunit.client.1.smithi131.stdout:8/964: read - d22/d26/d3f/d47/d48/d5f/d6f/fe4 zero size 2024-02-15T18:31:52.589 INFO:tasks.workunit.client.1.smithi131.stdout:8/965: dread - d22/d2e/d60/f90 zero size 2024-02-15T18:31:52.591 INFO:tasks.workunit.client.1.smithi131.stdout:8/966: unlink d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/f59 0 2024-02-15T18:31:52.591 INFO:tasks.workunit.client.1.smithi131.stdout:8/967: chown d22/d26/d3f/d47/d48/f128 1580755 1 2024-02-15T18:31:52.593 INFO:tasks.workunit.client.1.smithi131.stdout:8/968: link d22/d2e/f63 d22/d26/d3f/d47/d48/d5f/d70/db0/f148 0 2024-02-15T18:31:52.594 INFO:tasks.workunit.client.1.smithi131.stdout:8/969: link d22/d26/d3f/d47/d48/d5f/d70/dc7/dd7/da2/f103 d22/d26/d3f/d47/d48/d5f/d70/db0/d114/f149 0 2024-02-15T18:31:52.603 INFO:tasks.workunit.client.1.smithi131.stdout:7/943: dwrite d0/d17/d3a/d3d/d79/d89/ff7 [0,4194304] 0 2024-02-15T18:31:52.607 INFO:tasks.workunit.client.1.smithi131.stdout:7/944: dread d0/d17/f3c [0,4194304] 0 2024-02-15T18:31:52.607 INFO:tasks.workunit.client.1.smithi131.stdout:7/945: readlink d0/d34/l10c 0 2024-02-15T18:31:52.607 INFO:tasks.workunit.client.1.smithi131.stdout:7/946: write d0/d34/d8e/d98/dc6/ff8 [373826,29166] 0 2024-02-15T18:31:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:9/938: dwrite d4/dc/de/d130/f10b [0,4194304] 0 2024-02-15T18:31:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:9/939: read - d4/dc/d17/d19/d32/d100/f12c zero size 2024-02-15T18:31:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:2/854: dwrite dd/d10/dfa/d103/ff6 [0,4194304] 0 2024-02-15T18:31:52.613 INFO:tasks.workunit.client.1.smithi131.stdout:6/792: dwrite d2/dc/d27/d62/d97/f1e [0,4194304] 0 2024-02-15T18:31:52.615 INFO:tasks.workunit.client.1.smithi131.stdout:9/940: rmdir d4/dc/d17/d19/d84 39 2024-02-15T18:31:52.615 INFO:tasks.workunit.client.1.smithi131.stdout:9/941: fsync d4/dc/df7/f106 0 2024-02-15T18:31:52.615 INFO:tasks.workunit.client.1.smithi131.stdout:0/801: dwrite d5/fa [0,4194304] 0 2024-02-15T18:31:52.615 INFO:tasks.workunit.client.1.smithi131.stdout:0/802: write d5/d2f/d4b/dd9/d4d/f7c [1275250,84444] 0 2024-02-15T18:31:52.618 INFO:tasks.workunit.client.1.smithi131.stdout:8/970: dwrite d22/f147 [0,4194304] 0 2024-02-15T18:31:52.618 INFO:tasks.workunit.client.1.smithi131.stdout:6/793: mkdir d2/d6d/db9/d12/df6 0 2024-02-15T18:31:52.618 INFO:tasks.workunit.client.1.smithi131.stdout:6/794: chown d2/d6d/db9/d12/d80/fe7 20097 1 2024-02-15T18:31:52.618 INFO:tasks.workunit.client.1.smithi131.stdout:6/795: fdatasync d2/dc/d27/d78/f87 0 2024-02-15T18:31:52.618 INFO:tasks.workunit.client.1.smithi131.stdout:6/796: chown d2/d6d/db9/ff0 123 1 2024-02-15T18:31:52.622 INFO:tasks.workunit.client.1.smithi131.stdout:8/971: write d22/d39/fac [1943748,73845] 0 2024-02-15T18:31:52.622 INFO:tasks.workunit.client.1.smithi131.stdout:9/942: symlink d4/dc/d17/d19/d32/d100/l137 0 2024-02-15T18:31:52.622 INFO:tasks.workunit.client.1.smithi131.stdout:0/803: stat d5/d15/d1f/l67 0 2024-02-15T18:31:52.622 INFO:tasks.workunit.client.1.smithi131.stdout:0/804: stat d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/df1/f101 0 2024-02-15T18:31:52.625 INFO:tasks.workunit.client.1.smithi131.stdout:8/972: mknod d22/d26/d3f/d47/dc3/c14a 0 2024-02-15T18:31:52.627 INFO:tasks.workunit.client.1.smithi131.stdout:8/973: rename d22/d26/d3f/d47/d48/l66 to d22/d119/l14b 0 2024-02-15T18:31:52.629 INFO:tasks.workunit.client.1.smithi131.stdout:9/943: mknod d4/dc/d17/d19/d84/c138 0 2024-02-15T18:31:52.632 INFO:tasks.workunit.client.1.smithi131.stdout:0/805: unlink d5/d2f/d4b/dd9/d10/d71/d92/f93 0 2024-02-15T18:31:52.634 INFO:tasks.workunit.client.1.smithi131.stdout:0/806: unlink d5/d2f/d4b/dd9/cd5 0 2024-02-15T18:31:52.637 INFO:tasks.workunit.client.1.smithi131.stdout:0/807: truncate d5/d2f/d4b/f69 1647364 0 2024-02-15T18:31:52.638 INFO:tasks.workunit.client.1.smithi131.stdout:0/808: mkdir d5/d2f/d4b/dd9/d77/d10a 0 2024-02-15T18:31:52.640 INFO:tasks.workunit.client.1.smithi131.stdout:0/809: creat d5/d2f/d4b/dd9/d10/d73/f10b x:0 0 0 2024-02-15T18:31:52.645 INFO:tasks.workunit.client.1.smithi131.stdout:2/855: dread dd/d14/d1f/d65/d77/f7e [0,4194304] 0 2024-02-15T18:31:52.645 INFO:tasks.workunit.client.1.smithi131.stdout:7/947: dwrite d0/d34/f67 [4194304,4194304] 0 2024-02-15T18:31:52.647 INFO:tasks.workunit.client.1.smithi131.stdout:7/948: symlink d0/d17/l129 0 2024-02-15T18:31:52.647 INFO:tasks.workunit.client.1.smithi131.stdout:7/949: getdents d0/d17/d3a/d3d 0 2024-02-15T18:31:52.649 INFO:tasks.workunit.client.1.smithi131.stdout:7/950: truncate d0/d17/f68 1677257 0 2024-02-15T18:31:52.649 INFO:tasks.workunit.client.1.smithi131.stdout:7/951: chown d0/d34/d8b/fab 0 1 2024-02-15T18:31:52.651 INFO:tasks.workunit.client.1.smithi131.stdout:7/952: creat d0/d34/d8e/d98/f12a x:0 0 0 2024-02-15T18:31:52.652 INFO:tasks.workunit.client.1.smithi131.stdout:7/953: creat d0/d9d/dc8/f12b x:0 0 0 2024-02-15T18:31:52.652 INFO:tasks.workunit.client.1.smithi131.stdout:7/954: chown d0/da9/dde 1613689 1 2024-02-15T18:31:52.652 INFO:tasks.workunit.client.1.smithi131.stdout:7/955: chown d0/dba/l10f 10 1 2024-02-15T18:31:52.653 INFO:tasks.workunit.client.1.smithi131.stdout:7/956: truncate d0/d17/d36/f128 121596 0 2024-02-15T18:31:52.653 INFO:tasks.workunit.client.1.smithi131.stdout:7/957: chown d0/l4f 322910024 1 2024-02-15T18:31:52.654 INFO:tasks.workunit.client.1.smithi131.stdout:8/974: dwrite d22/d119/f130 [0,4194304] 0 2024-02-15T18:31:52.654 INFO:tasks.workunit.client.1.smithi131.stdout:8/975: stat d22/d26/d3f/d47/dc3 0 2024-02-15T18:31:52.654 INFO:tasks.workunit.client.1.smithi131.stdout:8/976: dread - d22/d26/d112/f115 zero size 2024-02-15T18:31:52.654 INFO:tasks.workunit.client.1.smithi131.stdout:8/977: dread - d22/d26/d3f/d47/d48/d84/fff zero size 2024-02-15T18:31:52.654 INFO:tasks.workunit.client.1.smithi131.stdout:9/944: dread d4/dc/d17/d19/fff [0,4194304] 0 2024-02-15T18:31:52.655 INFO:tasks.workunit.client.1.smithi131.stdout:2/856: write dd/d10/d22/d2f/d38/d74/d2e/f32 [3608026,92296] 0 2024-02-15T18:31:52.656 INFO:tasks.workunit.client.1.smithi131.stdout:7/958: rename d0/d17/d3a/d3d/d79/db4 to d0/db8/d12c 0 2024-02-15T18:31:52.657 INFO:tasks.workunit.client.1.smithi131.stdout:7/959: dread - d0/d17/d3a/d3d/d79/d89/fb1 zero size 2024-02-15T18:31:52.658 INFO:tasks.workunit.client.1.smithi131.stdout:8/978: mknod d22/d26/d3f/d47/d48/d84/d11d/d12c/c14c 0 2024-02-15T18:31:52.658 INFO:tasks.workunit.client.1.smithi131.stdout:8/979: truncate d22/d26/d3f/d47/d48/d5f/d70/db0/d114/f149 838210 0 2024-02-15T18:31:52.658 INFO:tasks.workunit.client.1.smithi131.stdout:8/980: fdatasync d22/d26/d3f/d47/d48/d5f/d6f/d7a/fce 0 2024-02-15T18:31:52.660 INFO:tasks.workunit.client.1.smithi131.stdout:9/945: mknod d4/dc/de/d1e/c139 0 2024-02-15T18:31:52.660 INFO:tasks.workunit.client.1.smithi131.stdout:9/946: dread - d4/dc/d17/d19/d32/d100/f12c zero size 2024-02-15T18:31:52.660 INFO:tasks.workunit.client.1.smithi131.stdout:9/947: symlink d4/dc/de/d1e/d1f/d101/l13a 0 2024-02-15T18:31:52.662 INFO:tasks.workunit.client.1.smithi131.stdout:7/960: write d0/d34/fb7 [1453942,126015] 0 2024-02-15T18:31:52.665 INFO:tasks.workunit.client.1.smithi131.stdout:8/981: rename d22/d26/d3f/d47/dc3/ff7 to d22/d26/d3f/d47/d48/d5f/d70/dc7/f14d 0 2024-02-15T18:31:52.665 INFO:tasks.workunit.client.1.smithi131.stdout:0/810: dwrite d5/d2f/d4b/dd9/d77/da8/dad/fdb [0,4194304] 0 2024-02-15T18:31:52.666 INFO:tasks.workunit.client.1.smithi131.stdout:8/982: creat d22/d26/d3f/d47/d57/f14e x:0 0 0 2024-02-15T18:31:52.668 INFO:tasks.workunit.client.1.smithi131.stdout:8/983: creat d22/d26/d3f/d47/d48/df5/f14f x:0 0 0 2024-02-15T18:31:52.670 INFO:tasks.workunit.client.1.smithi131.stdout:0/811: write d5/d2f/d4b/dd9/d10/d71/d92/f9c [3647885,34450] 0 2024-02-15T18:31:52.670 INFO:tasks.workunit.client.1.smithi131.stdout:7/961: link d0/d34/d8e/df5/f11a d0/db8/dbe/f12d 0 2024-02-15T18:31:52.696 INFO:tasks.workunit.client.1.smithi131.stdout:9/948: dwrite d4/dc/d17/d19/d32/d100/f12c [0,4194304] 0 2024-02-15T18:31:52.696 INFO:tasks.workunit.client.1.smithi131.stdout:9/949: dread - d4/dc/de/d1e/d1f/d101/d5b/fd0 zero size 2024-02-15T18:31:52.696 INFO:tasks.workunit.client.1.smithi131.stdout:9/950: chown d4/dc/d25/d4e/d38/c12f 472515 1 2024-02-15T18:31:52.697 INFO:tasks.workunit.client.1.smithi131.stdout:7/962: dwrite d0/d17/d36/f50 [0,4194304] 0 2024-02-15T18:31:52.697 INFO:tasks.workunit.client.1.smithi131.stdout:7/963: write d0/d34/f8d [482852,91610] 0 2024-02-15T18:31:52.698 INFO:tasks.workunit.client.1.smithi131.stdout:0/812: dwrite f0 [4194304,4194304] 0 2024-02-15T18:31:52.699 INFO:tasks.workunit.client.1.smithi131.stdout:9/951: dread d4/d78/fcd [0,4194304] 0 2024-02-15T18:31:52.699 INFO:tasks.workunit.client.1.smithi131.stdout:9/952: write d4/dc/d17/d19/d32/d91/db3/d135/f12a [1043899,20859] 0 2024-02-15T18:31:52.701 INFO:tasks.workunit.client.1.smithi131.stdout:7/964: rename d0/d17/d3a/d3d/d79/f9c to d0/f12e 0 2024-02-15T18:31:52.703 INFO:tasks.workunit.client.1.smithi131.stdout:7/965: mknod d0/c12f 0 2024-02-15T18:31:52.706 INFO:tasks.workunit.client.1.smithi131.stdout:7/966: rmdir d0/d17/d36 39 2024-02-15T18:31:52.709 INFO:tasks.workunit.client.1.smithi131.stdout:7/967: dread d0/fee [0,4194304] 0 2024-02-15T18:31:52.710 INFO:tasks.workunit.client.1.smithi131.stdout:7/968: chown d0/db8/d12c/caa 5 1 2024-02-15T18:31:52.712 INFO:tasks.workunit.client.1.smithi131.stdout:7/969: link d0/d17/f82 d0/da9/f130 0 2024-02-15T18:31:52.714 INFO:tasks.workunit.client.1.smithi131.stdout:0/813: dread d5/d2f/d4b/dd9/d10/f1e [0,4194304] 0 2024-02-15T18:31:52.719 INFO:tasks.workunit.client.1.smithi131.stdout:7/970: rmdir d0/d34/d8b/d9a 39 2024-02-15T18:31:52.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/953: dwrite d4/dc/dd7/ff5 [0,4194304] 0 2024-02-15T18:31:52.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/954: readlink d4/dc/de/d1e/d1f/d51/ld5 0 2024-02-15T18:31:52.722 INFO:tasks.workunit.client.1.smithi131.stdout:7/971: symlink d0/da9/de4/d11b/l131 0 2024-02-15T18:31:52.725 INFO:tasks.workunit.client.1.smithi131.stdout:7/972: write d0/d17/d3a/f91 [498057,31975] 0 2024-02-15T18:31:52.728 INFO:tasks.workunit.client.1.smithi131.stdout:7/973: unlink d0/d34/la1 0 2024-02-15T18:31:52.729 INFO:tasks.workunit.client.1.smithi131.stdout:7/974: mkdir d0/da9/de4/d11b/d132 0 2024-02-15T18:31:52.733 INFO:tasks.workunit.client.1.smithi131.stdout:9/955: dread d4/dc/dd7/ff5 [0,4194304] 0 2024-02-15T18:31:52.733 INFO:tasks.workunit.client.1.smithi131.stdout:9/956: truncate d4/dc/df7/f124 578849 0 2024-02-15T18:31:52.733 INFO:tasks.workunit.client.1.smithi131.stdout:0/814: dwrite d5/d2f/d4b/dd9/d4d/f63 [0,4194304] 0 2024-02-15T18:31:52.734 INFO:tasks.workunit.client.1.smithi131.stdout:9/957: symlink d4/dc/de/d1e/d1f/d51/d5d/l13b 0 2024-02-15T18:31:52.735 INFO:tasks.workunit.client.1.smithi131.stdout:9/958: stat d4/dc/de/d1e/d1f/l89 0 2024-02-15T18:31:52.739 INFO:tasks.workunit.client.1.smithi131.stdout:9/959: link d4/dc/d17/db0/dbc/c108 d4/d78/c13c 0 2024-02-15T18:31:52.740 INFO:tasks.workunit.client.1.smithi131.stdout:0/815: unlink d5/d2f/d4b/dd9/d10/c12 0 2024-02-15T18:31:52.742 INFO:tasks.workunit.client.1.smithi131.stdout:9/960: getdents d4/dc/de/d1e/d1f/df6 0 2024-02-15T18:31:52.744 INFO:tasks.workunit.client.1.smithi131.stdout:0/816: rename d5/d2f/d4b/dd9/d11/cff to d5/d2f/d4b/dd9/d77/da8/dad/dd7/c10c 0 2024-02-15T18:31:52.744 INFO:tasks.workunit.client.1.smithi131.stdout:0/817: write d5/d2f/d4b/d82/d9f/fd3 [580513,73786] 0 2024-02-15T18:31:52.745 INFO:tasks.workunit.client.1.smithi131.stdout:9/961: read d4/dc/de/d1e/d1f/d101/f86 [2173134,127621] 0 2024-02-15T18:31:52.746 INFO:tasks.workunit.client.1.smithi131.stdout:9/962: dread - d4/dc/d17/d19/d32/d100/f136 zero size 2024-02-15T18:31:52.746 INFO:tasks.workunit.client.1.smithi131.stdout:9/963: chown d4/dc/de/d1e/feb 0 1 2024-02-15T18:31:52.746 INFO:tasks.workunit.client.1.smithi131.stdout:9/964: dread - d4/dc/de/d1e/d1f/d51/d5d/fd3 zero size 2024-02-15T18:31:52.746 INFO:tasks.workunit.client.1.smithi131.stdout:9/965: stat d4/dc/de/d1e/d1f/d51/d5d/c125 0 2024-02-15T18:31:52.746 INFO:tasks.workunit.client.1.smithi131.stdout:0/818: write d5/d2f/d4b/dd9/d77/da8/dad/fdb [1335957,110275] 0 2024-02-15T18:31:52.746 INFO:tasks.workunit.client.1.smithi131.stdout:0/819: truncate d5/d2f/d4b/dd9/d11/fc5 460131 0 2024-02-15T18:31:52.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/966: link d4/dc/d17/d19/c1c d4/dc/d17/d19/d32/c13d 0 2024-02-15T18:31:52.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/967: chown d4/dc3/cfb 693469 1 2024-02-15T18:31:52.751 INFO:tasks.workunit.client.1.smithi131.stdout:9/968: write d4/dc/de/d1e/f37 [5164122,102430] 0 2024-02-15T18:31:52.751 INFO:tasks.workunit.client.1.smithi131.stdout:0/820: mkdir d5/d15/d96/d10d 0 2024-02-15T18:31:52.753 INFO:tasks.workunit.client.1.smithi131.stdout:0/821: link d5/d2f/d4b/dd9/d10/d3f/f61 d5/d2f/d4b/f10e 0 2024-02-15T18:31:52.755 INFO:tasks.workunit.client.1.smithi131.stdout:0/822: link d5/d2f/d4b/dd9/d11/c3a d5/c10f 0 2024-02-15T18:31:52.755 INFO:tasks.workunit.client.1.smithi131.stdout:0/823: chown d5/d15/l5c 16021310 1 2024-02-15T18:31:52.756 INFO:tasks.workunit.client.1.smithi131.stdout:0/824: write d5/d15/fda [732184,124424] 0 2024-02-15T18:31:52.757 INFO:tasks.workunit.client.1.smithi131.stdout:0/825: link d5/d2f/d4b/dd9/d10/f8d d5/d2f/d4b/dd9/d10/d71/d92/f110 0 2024-02-15T18:31:52.757 INFO:tasks.workunit.client.1.smithi131.stdout:0/826: write d5/d2f/d4b/dd9/d10/d71/ffa [961065,104248] 0 2024-02-15T18:31:52.759 INFO:tasks.workunit.client.1.smithi131.stdout:0/827: mknod d5/c111 0 2024-02-15T18:31:52.759 INFO:tasks.workunit.client.1.smithi131.stdout:0/828: fdatasync d5/d2f/d4b/dd9/d10/d3f/f47 0 2024-02-15T18:31:52.759 INFO:tasks.workunit.client.1.smithi131.stdout:0/829: write d5/d2f/d4b/dd9/d10/d71/d92/ddd/f100 [1025143,6853] 0 2024-02-15T18:31:52.761 INFO:tasks.workunit.client.1.smithi131.stdout:0/830: creat d5/d2f/d4b/dd9/d77/da8/dad/dd7/f112 x:0 0 0 2024-02-15T18:31:52.761 INFO:tasks.workunit.client.1.smithi131.stdout:0/831: read d5/d2f/d4b/dd9/d4d/f89 [741281,6821] 0 2024-02-15T18:31:52.761 INFO:tasks.workunit.client.1.smithi131.stdout:0/832: getdents d5/d15/d1f/df5 0 2024-02-15T18:31:52.761 INFO:tasks.workunit.client.1.smithi131.stdout:0/833: dread - d5/fd4 zero size 2024-02-15T18:31:52.763 INFO:tasks.workunit.client.1.smithi131.stdout:0/834: creat d5/d2f/d4b/dd9/d10/d71/d92/df6/f113 x:0 0 0 2024-02-15T18:31:52.765 INFO:tasks.workunit.client.1.smithi131.stdout:0/835: rename d5/d15/d96/d10d to d5/d2f/d4b/dd9/d10/d71/d92/df6/d114 0 2024-02-15T18:31:52.765 INFO:tasks.workunit.client.1.smithi131.stdout:0/836: chown d5/f4c 93325 1 2024-02-15T18:31:52.765 INFO:tasks.workunit.client.1.smithi131.stdout:0/837: fsync d5/d2f/d45/d8c/fc4 0 2024-02-15T18:31:52.765 INFO:tasks.workunit.client.1.smithi131.stdout:0/838: readlink d5/d2f/d4b/dd9/d77/laf 0 2024-02-15T18:31:52.765 INFO:tasks.workunit.client.1.smithi131.stdout:0/839: readlink d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/lf2 0 2024-02-15T18:31:52.767 INFO:tasks.workunit.client.1.smithi131.stdout:0/840: rename d5/d2f/d4b/dd9/d10/d71/d92/ddd to d5/d2f/d4b/dd9/d10/d115 0 2024-02-15T18:31:52.770 INFO:tasks.workunit.client.1.smithi131.stdout:9/969: dwrite d4/dc/de/d1e/f9e [4194304,4194304] 0 2024-02-15T18:31:52.772 INFO:tasks.workunit.client.1.smithi131.stdout:9/970: getdents d4/d78/d10a 0 2024-02-15T18:31:52.772 INFO:tasks.workunit.client.1.smithi131.stdout:9/971: truncate d4/dc/d17/d19/f5a 1265017 0 2024-02-15T18:31:52.774 INFO:tasks.workunit.client.1.smithi131.stdout:9/972: link d4/dc/d17/d19/d32/fd2 d4/dc/de/d1e/d1f/f13e 0 2024-02-15T18:31:52.783 INFO:tasks.workunit.client.1.smithi131.stdout:0/841: dwrite d5/d2f/d4b/dd9/d10/d71/ffd [0,4194304] 0 2024-02-15T18:31:52.786 INFO:tasks.workunit.client.1.smithi131.stdout:0/842: creat d5/d2f/d4b/d82/d9f/f116 x:0 0 0 2024-02-15T18:31:52.789 INFO:tasks.workunit.client.1.smithi131.stdout:0/843: creat d5/d2f/d4b/d82/f117 x:0 0 0 2024-02-15T18:31:52.789 INFO:tasks.workunit.client.1.smithi131.stdout:0/844: write d5/d2f/d4b/dd9/d10/d71/d92/f110 [1358505,64382] 0 2024-02-15T18:31:53.122 INFO:tasks.workunit.client.1.smithi131.stdout:2/857: sync 2024-02-15T18:31:53.122 INFO:tasks.workunit.client.1.smithi131.stdout:6/797: sync 2024-02-15T18:31:53.123 INFO:tasks.workunit.client.1.smithi131.stdout:8/984: sync 2024-02-15T18:31:53.123 INFO:tasks.workunit.client.1.smithi131.stdout:6/798: mknod d2/d79/dad/dcc/cf7 0 2024-02-15T18:31:53.125 INFO:tasks.workunit.client.1.smithi131.stdout:6/799: creat d2/d6d/db9/d48/dcf/ff8 x:0 0 0 2024-02-15T18:31:53.125 INFO:tasks.workunit.client.1.smithi131.stdout:6/800: chown d2/d2b/d6e/f47 5602 1 2024-02-15T18:31:53.127 INFO:tasks.workunit.client.1.smithi131.stdout:6/801: read d2/d6d/db9/f54 [1895230,94349] 0 2024-02-15T18:31:53.129 INFO:tasks.workunit.client.1.smithi131.stdout:6/802: mkdir d2/d6d/db9/d12/df6/df9 0 2024-02-15T18:31:53.130 INFO:tasks.workunit.client.1.smithi131.stdout:6/803: dread d2/d2b/d6e/fb5 [0,4194304] 0 2024-02-15T18:31:53.131 INFO:tasks.workunit.client.1.smithi131.stdout:6/804: write d2/d6d/db9/d12/d4d/fba [4189523,67003] 0 2024-02-15T18:31:53.132 INFO:tasks.workunit.client.1.smithi131.stdout:6/805: creat d2/d6d/db9/d48/ffa x:0 0 0 2024-02-15T18:31:53.140 INFO:tasks.workunit.client.1.smithi131.stdout:2/858: dwrite dd/d10/d22/d2f/d38/d74/d2e/d6a/dc0/fd4 [0,4194304] 0 2024-02-15T18:31:53.158 INFO:tasks.workunit.client.1.smithi131.stdout:8/985: creat d22/d26/d3f/d47/d57/d9f/f150 x:0 0 0 2024-02-15T18:31:53.161 INFO:tasks.workunit.client.1.smithi131.stdout:6/806: dwrite d2/d6d/db9/d48/f49 [0,4194304] 0 2024-02-15T18:31:53.161 INFO:tasks.workunit.client.1.smithi131.stdout:6/807: write d2/dc/d27/d74/d75/dc0/fea [676333,107728] 0 2024-02-15T18:31:53.161 INFO:tasks.workunit.client.1.smithi131.stdout:2/859: dwrite dd/d69/fbf [0,4194304] 0 2024-02-15T18:31:53.161 INFO:tasks.workunit.client.1.smithi131.stdout:2/860: write dd/d10/d22/d2f/d38/d74/d2e/d66/fa7 [1535897,113414] 0 2024-02-15T18:31:53.163 INFO:tasks.workunit.client.1.smithi131.stdout:6/808: rename d2/dc/d27/d62/d97/d9e/ld1 to d2/dc/d27/d74/d75/lfb 0 2024-02-15T18:31:53.165 INFO:tasks.workunit.client.1.smithi131.stdout:2/861: getdents dd/d10/d22/d2f 0 2024-02-15T18:31:53.167 INFO:tasks.workunit.client.1.smithi131.stdout:6/809: symlink d2/dc/deb/lfc 0 2024-02-15T18:31:53.167 INFO:tasks.workunit.client.1.smithi131.stdout:6/810: truncate d2/d2b/d6e/fb5 1034591 0 2024-02-15T18:31:53.169 INFO:tasks.workunit.client.1.smithi131.stdout:2/862: creat dd/f119 x:0 0 0 2024-02-15T18:31:53.171 INFO:tasks.workunit.client.1.smithi131.stdout:2/863: creat dd/d10/d22/d2f/d38/d9f/dca/f11a x:0 0 0 2024-02-15T18:31:53.174 INFO:tasks.workunit.client.1.smithi131.stdout:2/864: mkdir dd/d14/d1f/d65/d77/d7a/d11b 0 2024-02-15T18:31:53.177 INFO:tasks.workunit.client.1.smithi131.stdout:2/865: link dd/d10/d22/d2f/d38/d74/l35 dd/d14/d1f/d65/l11c 0 2024-02-15T18:31:53.182 INFO:tasks.workunit.client.1.smithi131.stdout:2/866: symlink dd/d10/d22/d2a/d48/l11d 0 2024-02-15T18:31:53.185 INFO:tasks.workunit.client.1.smithi131.stdout:8/986: dwrite d22/d39/f10c [0,4194304] 0 2024-02-15T18:31:53.185 INFO:tasks.workunit.client.1.smithi131.stdout:8/987: fsync d22/f32 0 2024-02-15T18:31:53.201 INFO:tasks.workunit.client.1.smithi131.stdout:6/811: dwrite d2/f1a [0,4194304] 0 2024-02-15T18:31:53.201 INFO:tasks.workunit.client.1.smithi131.stdout:6/812: write d2/d79/fc6 [4438780,9983] 0 2024-02-15T18:31:53.201 INFO:tasks.workunit.client.1.smithi131.stdout:6/813: readlink d2/dc/d27/d78/l88 0 2024-02-15T18:31:53.201 INFO:tasks.workunit.client.1.smithi131.stdout:2/867: dwrite dd/d14/d1f/d65/d77/d7a/df3/f113 [0,4194304] 0 2024-02-15T18:31:53.202 INFO:tasks.workunit.client.1.smithi131.stdout:6/814: readlink d2/d79/l91 0 2024-02-15T18:31:53.206 INFO:tasks.workunit.client.1.smithi131.stdout:2/868: link dd/d10/d22/d2a/c54 dd/d69/d92/c11e 0 2024-02-15T18:31:53.208 INFO:tasks.workunit.client.1.smithi131.stdout:6/815: symlink d2/d6d/db9/dca/lfd 0 2024-02-15T18:31:53.213 INFO:tasks.workunit.client.1.smithi131.stdout:6/816: creat d2/d6d/ffe x:0 0 0 2024-02-15T18:31:53.213 INFO:tasks.workunit.client.1.smithi131.stdout:6/817: mknod d2/d6d/db9/d48/d40/cff 0 2024-02-15T18:31:53.214 INFO:tasks.workunit.client.1.smithi131.stdout:6/818: mknod d2/dc/d27/d74/d75/dc0/c100 0 2024-02-15T18:31:53.216 INFO:tasks.workunit.client.1.smithi131.stdout:6/819: mknod d2/dc/d27/d62/db0/c101 0 2024-02-15T18:31:53.228 INFO:tasks.workunit.client.1.smithi131.stdout:2/869: dwrite dd/f6f [0,4194304] 0 2024-02-15T18:31:53.228 INFO:tasks.workunit.client.1.smithi131.stdout:6/820: dread d2/d6d/db9/fa [0,4194304] 0 2024-02-15T18:31:53.229 INFO:tasks.workunit.client.1.smithi131.stdout:2/870: write dd/d10/d22/d2f/d38/d74/d2e/d4a/fc8 [3118015,8937] 0 2024-02-15T18:31:53.250 INFO:tasks.workunit.client.1.smithi131.stdout:6/821: dwrite d2/d2b/d6e/f8a [0,4194304] 0 2024-02-15T18:31:53.250 INFO:tasks.workunit.client.1.smithi131.stdout:6/822: fsync d2/d6d/db9/d48/f44 0 2024-02-15T18:31:53.250 INFO:tasks.workunit.client.1.smithi131.stdout:6/823: readlink d2/dc/d1f/l33 0 2024-02-15T18:31:53.254 INFO:tasks.workunit.client.1.smithi131.stdout:6/824: mknod d2/dc/d27/d62/d8f/c102 0 2024-02-15T18:31:53.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/825: mknod d2/dc/d27/d74/d75/c103 0 2024-02-15T18:31:53.270 INFO:tasks.workunit.client.1.smithi131.stdout:2/871: unlink dd/d10/db1/dbd/cc2 0 2024-02-15T18:31:53.271 INFO:tasks.workunit.client.1.smithi131.stdout:6/826: unlink d2/d6d/db9/c66 0 2024-02-15T18:31:53.274 INFO:tasks.workunit.client.1.smithi131.stdout:2/872: dread dd/d10/d22/d2f/d38/d74/d2e/d6a/fa4 [0,4194304] 0 2024-02-15T18:31:53.294 INFO:tasks.workunit.client.1.smithi131.stdout:6/827: dwrite d2/dc/d1f/dbc/db6/dbb/fe4 [0,4194304] 0 2024-02-15T18:31:53.301 INFO:tasks.workunit.client.1.smithi131.stdout:6/828: dread d2/d6d/db9/f46 [4194304,4194304] 0 2024-02-15T18:31:53.304 INFO:tasks.workunit.client.1.smithi131.stdout:6/829: rename d2/d6d/db9/d12/d4d/f52 to d2/dc/d27/d62/f104 0 2024-02-15T18:31:53.314 INFO:tasks.workunit.client.1.smithi131.stdout:6/830: dread d2/dc/d27/d62/db0/f3c [0,4194304] 0 2024-02-15T18:31:53.317 INFO:tasks.workunit.client.1.smithi131.stdout:6/831: read d2/d6d/db9/d12/d4d/f65 [333027,63027] 0 2024-02-15T18:31:53.319 INFO:tasks.workunit.client.1.smithi131.stdout:2/873: dwrite dd/d14/d1f/d65/d77/f7e [0,4194304] 0 2024-02-15T18:31:53.350 INFO:tasks.workunit.client.1.smithi131.stdout:2/874: dwrite fa [0,4194304] 0 2024-02-15T18:31:53.351 INFO:tasks.workunit.client.1.smithi131.stdout:2/875: fdatasync dd/d10/d22/d2f/d38/d74/f5d 0 2024-02-15T18:31:53.351 INFO:tasks.workunit.client.1.smithi131.stdout:6/832: dwrite d2/d6d/db9/d48/ffa [0,4194304] 0 2024-02-15T18:31:53.356 INFO:tasks.workunit.client.1.smithi131.stdout:6/833: symlink d2/dc/d27/d62/d97/d9e/l105 0 2024-02-15T18:31:53.356 INFO:tasks.workunit.client.1.smithi131.stdout:6/834: truncate d2/dc/d1f/dbc/fd4 925761 0 2024-02-15T18:31:53.358 INFO:tasks.workunit.client.1.smithi131.stdout:6/835: symlink d2/d79/dad/l106 0 2024-02-15T18:31:53.362 INFO:tasks.workunit.client.1.smithi131.stdout:2/876: unlink dd/d1e/f26 0 2024-02-15T18:31:53.362 INFO:tasks.workunit.client.1.smithi131.stdout:6/836: creat d2/d6d/de8/f107 x:0 0 0 2024-02-15T18:31:53.362 INFO:tasks.workunit.client.1.smithi131.stdout:6/837: stat d2/dc/d27/d62/l8d 0 2024-02-15T18:31:53.363 INFO:tasks.workunit.client.1.smithi131.stdout:2/877: unlink dd/d14/d1f/d65/l11c 0 2024-02-15T18:31:53.365 INFO:tasks.workunit.client.1.smithi131.stdout:6/838: symlink d2/dc/d1f/dbc/de0/df4/l108 0 2024-02-15T18:31:53.365 INFO:tasks.workunit.client.1.smithi131.stdout:6/839: write d2/d6d/ffe [73441,40678] 0 2024-02-15T18:31:53.372 INFO:tasks.workunit.client.1.smithi131.stdout:6/840: unlink d2/dc/d1f/daa/cdf 0 2024-02-15T18:31:53.375 INFO:tasks.workunit.client.1.smithi131.stdout:6/841: link d2/d6d/db9/fde d2/dc/d27/d62/d97/f109 0 2024-02-15T18:31:53.377 INFO:tasks.workunit.client.1.smithi131.stdout:6/842: creat d2/d6d/db9/d12/f10a x:0 0 0 2024-02-15T18:31:53.379 INFO:tasks.workunit.client.1.smithi131.stdout:6/843: symlink d2/d6d/db9/d48/dcf/l10b 0 2024-02-15T18:31:53.381 INFO:tasks.workunit.client.1.smithi131.stdout:6/844: write d2/dc/d27/d62/db0/f9d [1002854,120087] 0 2024-02-15T18:31:53.384 INFO:tasks.workunit.client.1.smithi131.stdout:2/878: rmdir dd 39 2024-02-15T18:31:53.385 INFO:tasks.workunit.client.1.smithi131.stdout:6/845: mkdir d2/d6d/dbe/d10c 0 2024-02-15T18:31:53.385 INFO:tasks.workunit.client.1.smithi131.stdout:6/846: dread - d2/dc/d27/d62/d97/fb4 zero size 2024-02-15T18:31:53.385 INFO:tasks.workunit.client.1.smithi131.stdout:6/847: write d2/d6d/db9/f54 [4579708,126196] 0 2024-02-15T18:31:53.385 INFO:tasks.workunit.client.1.smithi131.stdout:6/848: chown d2/d6d/db9/d48/d40 225942 1 2024-02-15T18:31:53.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/879: write dd/f6f [2534804,28601] 0 2024-02-15T18:31:53.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/880: fdatasync dd/d14/d1f/d65/d77/d7a/da2/fc6 0 2024-02-15T18:31:53.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/881: read - dd/d10/d22/d2f/d38/d74/d2e/d4a/fe7 zero size 2024-02-15T18:31:53.392 INFO:tasks.workunit.client.1.smithi131.stdout:2/882: write dd/d10/d22/d2f/d38/f3f [115056,113980] 0 2024-02-15T18:31:53.394 INFO:tasks.workunit.client.1.smithi131.stdout:2/883: creat dd/d10/d22/d2f/d38/d74/d2e/d66/f11f x:0 0 0 2024-02-15T18:31:53.394 INFO:tasks.workunit.client.1.smithi131.stdout:2/884: write dd/d14/d1f/f90 [5229317,17729] 0 2024-02-15T18:31:53.394 INFO:tasks.workunit.client.1.smithi131.stdout:2/885: stat dd/d10/d22/d2f/l33 0 2024-02-15T18:31:53.394 INFO:tasks.workunit.client.1.smithi131.stdout:2/886: getdents dd/d69/d92/d10d 0 2024-02-15T18:31:53.398 INFO:tasks.workunit.client.1.smithi131.stdout:2/887: dread dd/d10/d22/d2f/d38/d74/d2e/d6a/f7d [0,4194304] 0 2024-02-15T18:31:53.400 INFO:tasks.workunit.client.1.smithi131.stdout:2/888: mkdir dd/d14/d1f/d120 0 2024-02-15T18:31:53.402 INFO:tasks.workunit.client.1.smithi131.stdout:2/889: unlink dd/d10/d22/da3/c108 0 2024-02-15T18:31:53.403 INFO:tasks.workunit.client.1.smithi131.stdout:2/890: write dd/d10/fb4 [3755739,32260] 0 2024-02-15T18:31:53.403 INFO:tasks.workunit.client.1.smithi131.stdout:2/891: rmdir dd/d10/dfa/d103 39 2024-02-15T18:31:53.406 INFO:tasks.workunit.client.1.smithi131.stdout:2/892: read dd/d14/d1f/d65/d81/ddd/fe9 [2742713,49893] 0 2024-02-15T18:31:53.407 INFO:tasks.workunit.client.1.smithi131.stdout:2/893: symlink dd/d14/d1f/d65/d81/ddd/l121 0 2024-02-15T18:31:53.409 INFO:tasks.workunit.client.1.smithi131.stdout:9/973: sync 2024-02-15T18:31:53.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/975: sync 2024-02-15T18:31:53.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/976: chown d0/d34/d8e/df5 16 1 2024-02-15T18:31:53.409 INFO:tasks.workunit.client.1.smithi131.stdout:0/845: sync 2024-02-15T18:31:53.412 INFO:tasks.workunit.client.1.smithi131.stdout:9/974: symlink d4/dc/de/d1e/d1f/d51/d5d/l13f 0 2024-02-15T18:31:53.412 INFO:tasks.workunit.client.1.smithi131.stdout:9/975: dread - d4/dc/d17/d19/ff2 zero size 2024-02-15T18:31:53.412 INFO:tasks.workunit.client.1.smithi131.stdout:7/977: mknod d0/d34/d8b/dfd/c133 0 2024-02-15T18:31:53.414 INFO:tasks.workunit.client.1.smithi131.stdout:9/976: symlink d4/dc/dd7/l140 0 2024-02-15T18:31:53.425 INFO:tasks.workunit.client.1.smithi131.stdout:0/846: dread d5/d2f/d4b/dd9/d11/f30 [0,4194304] 0 2024-02-15T18:31:53.429 INFO:tasks.workunit.client.1.smithi131.stdout:0/847: mkdir d5/d2f/d4b/dbf/d118 0 2024-02-15T18:31:53.441 INFO:tasks.workunit.client.1.smithi131.stdout:2/894: dwrite dd/d14/d1f/d65/d81/fe1 [0,4194304] 0 2024-02-15T18:31:53.442 INFO:tasks.workunit.client.1.smithi131.stdout:7/978: dwrite d0/d34/d8e/fd9 [0,4194304] 0 2024-02-15T18:31:53.444 INFO:tasks.workunit.client.1.smithi131.stdout:2/895: mknod dd/d14/d1f/d120/c122 0 2024-02-15T18:31:53.446 INFO:tasks.workunit.client.1.smithi131.stdout:7/979: dread d0/fee [0,4194304] 0 2024-02-15T18:31:53.447 INFO:tasks.workunit.client.1.smithi131.stdout:9/977: dwrite d4/dc/de/d1e/d1f/d51/d5d/fd3 [0,4194304] 0 2024-02-15T18:31:53.450 INFO:tasks.workunit.client.1.smithi131.stdout:2/896: creat dd/d10/f123 x:0 0 0 2024-02-15T18:31:53.450 INFO:tasks.workunit.client.1.smithi131.stdout:2/897: chown dd/d10/d22/d2f/d38/d9f 181 1 2024-02-15T18:31:53.450 INFO:tasks.workunit.client.1.smithi131.stdout:2/898: chown dd/d10/d22/d2a/f49 20 1 2024-02-15T18:31:53.452 INFO:tasks.workunit.client.1.smithi131.stdout:7/980: write d0/d17/d36/fe2 [938468,96691] 0 2024-02-15T18:31:53.452 INFO:tasks.workunit.client.1.smithi131.stdout:7/981: truncate d0/d9d/dc8/fe7 214940 0 2024-02-15T18:31:53.452 INFO:tasks.workunit.client.1.smithi131.stdout:7/982: truncate d0/f16 644246 0 2024-02-15T18:31:53.452 INFO:tasks.workunit.client.1.smithi131.stdout:7/983: chown d0/d17/d36/c10d 23037110 1 2024-02-15T18:31:53.453 INFO:tasks.workunit.client.1.smithi131.stdout:7/984: write d0/d17/d3a/d3d/d79/d89/f119 [952381,87480] 0 2024-02-15T18:31:53.453 INFO:tasks.workunit.client.1.smithi131.stdout:7/985: stat d0/d34/d8b/fab 0 2024-02-15T18:31:53.454 INFO:tasks.workunit.client.1.smithi131.stdout:0/848: dwrite d5/d2f/d4b/dd9/d10/d3f/f55 [0,4194304] 0 2024-02-15T18:31:53.454 INFO:tasks.workunit.client.1.smithi131.stdout:9/978: symlink d4/dc/de/d130/l141 0 2024-02-15T18:31:53.461 INFO:tasks.workunit.client.1.smithi131.stdout:7/986: rename d0/d34/d8e to d0/da9/d134 0 2024-02-15T18:31:53.461 INFO:tasks.workunit.client.1.smithi131.stdout:7/987: write d0/d17/de1/f112 [627278,41897] 0 2024-02-15T18:31:53.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/979: mkdir d4/dc/d17/d19/d32/dc2/d142 0 2024-02-15T18:31:53.473 INFO:tasks.workunit.client.1.smithi131.stdout:2/899: dwrite dd/d10/d22/d2f/d38/f118 [0,4194304] 0 2024-02-15T18:31:53.476 INFO:tasks.workunit.client.1.smithi131.stdout:2/900: read dd/f6f [1110743,3142] 0 2024-02-15T18:31:53.476 INFO:tasks.workunit.client.1.smithi131.stdout:2/901: stat dd/d14/d1f/d65/d81 0 2024-02-15T18:31:53.483 INFO:tasks.workunit.client.1.smithi131.stdout:7/988: creat d0/d34/d8b/f135 x:0 0 0 2024-02-15T18:31:53.484 INFO:tasks.workunit.client.1.smithi131.stdout:9/980: rmdir d4/dc/dd7 39 2024-02-15T18:31:53.485 INFO:tasks.workunit.client.1.smithi131.stdout:2/902: mknod dd/d10/d22/c124 0 2024-02-15T18:31:53.486 INFO:tasks.workunit.client.1.smithi131.stdout:7/989: mknod d0/d17/d3a/d3d/d79/c136 0 2024-02-15T18:31:53.490 INFO:tasks.workunit.client.1.smithi131.stdout:9/981: mkdir d4/dc/de/d1e/d1f/d51/d5d/d71/d143 0 2024-02-15T18:31:53.490 INFO:tasks.workunit.client.1.smithi131.stdout:2/903: creat dd/d69/d92/d10d/f125 x:0 0 0 2024-02-15T18:31:53.490 INFO:tasks.workunit.client.1.smithi131.stdout:9/982: fdatasync d4/dc/de/d1e/d1f/d101/fda 0 2024-02-15T18:31:53.490 INFO:tasks.workunit.client.1.smithi131.stdout:2/904: write dd/d14/d1f/d65/d77/d7a/da2/fe6 [4877597,119082] 0 2024-02-15T18:31:53.492 INFO:tasks.workunit.client.1.smithi131.stdout:2/905: read dd/d14/d1f/d65/d77/d7a/da2/ff0 [4866828,5428] 0 2024-02-15T18:31:53.492 INFO:tasks.workunit.client.1.smithi131.stdout:2/906: stat dd/d10 0 2024-02-15T18:31:53.492 INFO:tasks.workunit.client.1.smithi131.stdout:2/907: chown dd/d10/d22/d2f/d38/d9f/lb6 0 1 2024-02-15T18:31:53.492 INFO:tasks.workunit.client.1.smithi131.stdout:2/908: chown dd/d14/d1f/d65/fad 128255053 1 2024-02-15T18:31:53.492 INFO:tasks.workunit.client.1.smithi131.stdout:9/983: creat d4/dc3/f144 x:0 0 0 2024-02-15T18:31:53.495 INFO:tasks.workunit.client.1.smithi131.stdout:9/984: creat d4/dc/de/d1e/d1f/d51/d134/f145 x:0 0 0 2024-02-15T18:31:53.500 INFO:tasks.workunit.client.1.smithi131.stdout:9/985: write d4/dc/d17/d19/d32/d91/de5/ff8 [1211202,60812] 0 2024-02-15T18:31:53.524 INFO:tasks.workunit.client.1.smithi131.stdout:2/909: dwrite dd/d14/d1f/d65/d81/ddd/fe3 [0,4194304] 0 2024-02-15T18:31:53.524 INFO:tasks.workunit.client.1.smithi131.stdout:2/910: write dd/f119 [740719,110608] 0 2024-02-15T18:31:53.524 INFO:tasks.workunit.client.1.smithi131.stdout:2/911: stat dd/d14 0 2024-02-15T18:31:53.525 INFO:tasks.workunit.client.1.smithi131.stdout:0/849: dwrite d5/d15/f60 [0,4194304] 0 2024-02-15T18:31:53.527 INFO:tasks.workunit.client.1.smithi131.stdout:2/912: dread dd/d10/db1/ffd [0,4194304] 0 2024-02-15T18:31:53.528 INFO:tasks.workunit.client.1.smithi131.stdout:2/913: symlink dd/d14/d1f/d65/d77/d7a/l126 0 2024-02-15T18:31:53.530 INFO:tasks.workunit.client.1.smithi131.stdout:9/986: dwrite d4/dc/d17/d19/d32/f48 [0,4194304] 0 2024-02-15T18:31:53.531 INFO:tasks.workunit.client.1.smithi131.stdout:2/914: rename dd/d10/d22/d2a/ff8 to dd/d10/db1/f127 0 2024-02-15T18:31:53.533 INFO:tasks.workunit.client.1.smithi131.stdout:2/915: rmdir dd/d10/d22/d2f/d38/d74/d2e/d6a/dc0 39 2024-02-15T18:31:53.535 INFO:tasks.workunit.client.1.smithi131.stdout:9/987: unlink d4/dc/de/d1e/d1f/d101/d72/fa8 0 2024-02-15T18:31:53.537 INFO:tasks.workunit.client.1.smithi131.stdout:2/916: mknod dd/d8f/c128 0 2024-02-15T18:31:53.538 INFO:tasks.workunit.client.1.smithi131.stdout:9/988: unlink d4/dc/d17/d19/d84/f112 0 2024-02-15T18:31:53.538 INFO:tasks.workunit.client.1.smithi131.stdout:9/989: dread - d4/dc/de/d1e/d1f/d101/d5b/fd0 zero size 2024-02-15T18:31:53.539 INFO:tasks.workunit.client.1.smithi131.stdout:9/990: symlink d4/dc/de/db4/l146 0 2024-02-15T18:31:53.553 INFO:tasks.workunit.client.1.smithi131.stdout:0/850: dwrite d5/d2f/d4b/dd9/d11/df3/ffe [0,4194304] 0 2024-02-15T18:31:53.555 INFO:tasks.workunit.client.1.smithi131.stdout:9/991: dread d4/dc/d17/f69 [0,4194304] 0 2024-02-15T18:31:53.555 INFO:tasks.workunit.client.1.smithi131.stdout:9/992: write d4/dc/de/d1e/d1f/d51/d5d/d71/fec [4706931,115961] 0 2024-02-15T18:31:53.555 INFO:tasks.workunit.client.1.smithi131.stdout:9/993: chown d4/dc/de/d1e/d1f/d51/d5d/l13f 47 1 2024-02-15T18:31:53.560 INFO:tasks.workunit.client.1.smithi131.stdout:9/994: mknod d4/dc/de/c147 0 2024-02-15T18:31:53.560 INFO:tasks.workunit.client.1.smithi131.stdout:2/917: dread dd/d10/db1/f127 [0,4194304] 0 2024-02-15T18:31:53.563 INFO:tasks.workunit.client.1.smithi131.stdout:9/995: unlink d4/dc/d17/d19/c1c 0 2024-02-15T18:31:53.564 INFO:tasks.workunit.client.1.smithi131.stdout:9/996: chown d4/dc/d25/d4e/d8a/f8d 1 1 2024-02-15T18:31:53.567 INFO:tasks.workunit.client.1.smithi131.stdout:2/918: symlink dd/d14/d1f/d65/d77/l129 0 2024-02-15T18:31:53.575 INFO:tasks.workunit.client.1.smithi131.stdout:2/919: write dd/d14/d1f/d65/d77/d7a/da2/ff0 [2939363,4205] 0 2024-02-15T18:31:53.582 INFO:tasks.workunit.client.1.smithi131.stdout:0/851: dwrite d5/d2f/d4b/dd9/d77/da8/dad/fdb [0,4194304] 0 2024-02-15T18:31:53.593 INFO:tasks.workunit.client.1.smithi131.stdout:9/997: dwrite d4/dc/de/d1e/f9e [8388608,4194304] 0 2024-02-15T18:31:53.594 INFO:tasks.workunit.client.1.smithi131.stdout:0/852: dread d5/d2f/d4b/dd9/d11/d3e/fe2 [4194304,4194304] 0 2024-02-15T18:31:53.594 INFO:tasks.workunit.client.1.smithi131.stdout:9/998: write d4/d78/fe7 [634223,45422] 0 2024-02-15T18:31:53.596 INFO:tasks.workunit.client.1.smithi131.stdout:2/920: dwrite dd/d14/d1f/d95/f107 [0,4194304] 0 2024-02-15T18:31:53.596 INFO:tasks.workunit.client.1.smithi131.stdout:2/921: fdatasync dd/f60 0 2024-02-15T18:31:53.596 INFO:tasks.workunit.client.1.smithi131.stdout:2/922: write dd/d10/db1/fe2 [885304,46328] 0 2024-02-15T18:31:53.596 INFO:tasks.workunit.client.1.smithi131.stdout:9/999: link d4/dc/d25/d4e/d38/c45 d4/dc/d17/d19/d32/d100/c148 0 2024-02-15T18:31:53.600 INFO:tasks.workunit.client.1.smithi131.stdout:2/923: dread dd/d14/d1f/d65/d77/f7e [4194304,4194304] 0 2024-02-15T18:31:53.602 INFO:tasks.workunit.client.1.smithi131.stdout:0/853: dread d5/d2f/d4b/dd9/d10/d71/d92/f106 [0,4194304] 0 2024-02-15T18:31:53.605 INFO:tasks.workunit.client.1.smithi131.stdout:2/924: mkdir dd/d14/d1f/d65/d81/d12a 0 2024-02-15T18:31:53.605 INFO:tasks.workunit.client.1.smithi131.stdout:2/925: read - dd/d10/d22/d2f/d38/d74/f5d zero size 2024-02-15T18:31:53.606 INFO:tasks.workunit.client.1.smithi131.stdout:0/854: creat d5/d2f/d4b/dd9/d10/db7/f119 x:0 0 0 2024-02-15T18:31:53.606 INFO:tasks.workunit.client.1.smithi131.stdout:0/855: write d5/d2f/d4b/dd9/d11/fbc [812150,84580] 0 2024-02-15T18:31:53.606 INFO:tasks.workunit.client.1.smithi131.stdout:0/856: dread - d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/df1/f101 zero size 2024-02-15T18:31:53.608 INFO:tasks.workunit.client.1.smithi131.stdout:0/857: mkdir d5/d2f/d4b/dd9/d10/d73/d11a 0 2024-02-15T18:31:53.608 INFO:tasks.workunit.client.1.smithi131.stdout:0/858: readlink d5/d2f/d4b/dd9/d10/d71/d92/df6/lc9 0 2024-02-15T18:31:53.608 INFO:tasks.workunit.client.1.smithi131.stdout:2/926: mknod dd/d14/d1f/d65/d77/d7a/df3/c12b 0 2024-02-15T18:31:53.609 INFO:tasks.workunit.client.1.smithi131.stdout:2/927: write dd/d10/d22/d2f/d38/fb9 [4936973,65164] 0 2024-02-15T18:31:53.609 INFO:tasks.workunit.client.1.smithi131.stdout:2/928: read - dd/d69/d92/d10d/f125 zero size 2024-02-15T18:31:53.609 INFO:tasks.workunit.client.1.smithi131.stdout:0/859: symlink d5/d2f/d4b/dd9/l11b 0 2024-02-15T18:31:53.613 INFO:tasks.workunit.client.1.smithi131.stdout:0/860: creat d5/d2f/d4b/dd9/d10/d73/d11a/f11c x:0 0 0 2024-02-15T18:31:53.613 INFO:tasks.workunit.client.1.smithi131.stdout:2/929: read dd/fdb [3052454,73709] 0 2024-02-15T18:31:53.635 INFO:tasks.workunit.client.1.smithi131.stdout:0/861: dwrite d5/d2f/d45/f51 [0,4194304] 0 2024-02-15T18:31:53.652 INFO:tasks.workunit.client.1.smithi131.stdout:0/862: dwrite d5/d2f/d4b/dd9/d10/d3f/f7f [0,4194304] 0 2024-02-15T18:31:53.665 INFO:tasks.workunit.client.1.smithi131.stdout:0/863: dwrite d5/d2f/d4b/d82/fac [0,4194304] 0 2024-02-15T18:31:53.668 INFO:tasks.workunit.client.1.smithi131.stdout:0/864: creat d5/d2f/d4b/dd9/d77/d10a/f11d x:0 0 0 2024-02-15T18:31:53.668 INFO:tasks.workunit.client.1.smithi131.stdout:0/865: dread - d5/d2f/d4b/dd9/d77/da8/dad/ffb zero size 2024-02-15T18:31:53.669 INFO:tasks.workunit.client.1.smithi131.stdout:0/866: symlink d5/d2f/d4b/dd9/d77/d8b/l11e 0 2024-02-15T18:31:53.675 INFO:tasks.workunit.client.1.smithi131.stdout:0/867: write d5/d2f/d4b/dd9/f43 [134008,43354] 0 2024-02-15T18:31:53.694 INFO:tasks.workunit.client.1.smithi131.stdout:0/868: dwrite d5/fa [4194304,4194304] 0 2024-02-15T18:31:53.694 INFO:tasks.workunit.client.1.smithi131.stdout:0/869: write d5/d2f/d4b/dd9/d10/db7/f119 [632411,88935] 0 2024-02-15T18:31:53.703 INFO:tasks.workunit.client.1.smithi131.stdout:0/870: dread d5/d15/d1f/fea [0,4194304] 0 2024-02-15T18:31:53.704 INFO:tasks.workunit.client.1.smithi131.stdout:0/871: creat d5/d2f/d4b/dd9/d10/d71/d92/df6/d114/f11f x:0 0 0 2024-02-15T18:31:53.709 INFO:tasks.workunit.client.1.smithi131.stdout:0/872: dread d5/d2f/d4b/dd9/d11/f30 [0,4194304] 0 2024-02-15T18:31:53.710 INFO:tasks.workunit.client.1.smithi131.stdout:0/873: truncate d5/d15/d1f/f57 3889974 0 2024-02-15T18:31:53.711 INFO:tasks.workunit.client.1.smithi131.stdout:0/874: mkdir d5/d2f/d4b/d82/d9f/d120 0 2024-02-15T18:31:53.713 INFO:tasks.workunit.client.1.smithi131.stdout:0/875: unlink d5/d2f/d4b/dd9/d77/d8b/fc2 0 2024-02-15T18:31:53.759 INFO:tasks.workunit.client.1.smithi131.stdout:6/849: sync 2024-02-15T18:31:53.760 INFO:tasks.workunit.client.1.smithi131.stdout:8/988: sync 2024-02-15T18:31:53.760 INFO:tasks.workunit.client.1.smithi131.stdout:6/850: write d2/d6d/ffe [716882,106035] 0 2024-02-15T18:31:53.778 INFO:tasks.workunit.client.1.smithi131.stdout:6/851: dwrite d2/d6d/db9/fde [0,4194304] 0 2024-02-15T18:31:53.778 INFO:tasks.workunit.client.1.smithi131.stdout:6/852: dread - d2/dc/d27/d74/fc1 zero size 2024-02-15T18:31:53.778 INFO:tasks.workunit.client.1.smithi131.stdout:6/853: fdatasync d2/d6d/db9/d12/d4d/f65 0 2024-02-15T18:31:53.781 INFO:tasks.workunit.client.1.smithi131.stdout:6/854: truncate d2/d6d/db9/f39 2899566 0 2024-02-15T18:31:53.805 INFO:tasks.workunit.client.1.smithi131.stdout:6/855: unlink d2/d6d/de8/f107 0 2024-02-15T18:31:53.805 INFO:tasks.workunit.client.1.smithi131.stdout:6/856: read - d2/d6d/db9/d48/dcf/ff8 zero size 2024-02-15T18:31:53.812 INFO:tasks.workunit.client.1.smithi131.stdout:6/857: dread d2/d6d/db9/f46 [0,4194304] 0 2024-02-15T18:31:53.813 INFO:tasks.workunit.client.1.smithi131.stdout:6/858: creat d2/d6d/db9/dca/f10d x:0 0 0 2024-02-15T18:31:53.814 INFO:tasks.workunit.client.1.smithi131.stdout:6/859: mknod d2/dc/d27/d74/d75/dc0/c10e 0 2024-02-15T18:31:53.821 INFO:tasks.workunit.client.1.smithi131.stdout:6/860: dread d2/d6d/db9/d48/ffa [0,4194304] 0 2024-02-15T18:31:53.822 INFO:tasks.workunit.client.1.smithi131.stdout:6/861: read d2/d6d/db9/d12/d80/f92 [676392,110436] 0 2024-02-15T18:31:53.823 INFO:tasks.workunit.client.1.smithi131.stdout:6/862: creat d2/d6d/db9/f10f x:0 0 0 2024-02-15T18:31:53.837 INFO:tasks.workunit.client.1.smithi131.stdout:6/863: dwrite d2/dc/d27/d74/d75/fb7 [0,4194304] 0 2024-02-15T18:31:53.839 INFO:tasks.workunit.client.1.smithi131.stdout:6/864: creat d2/d6d/db9/d12/d4d/f110 x:0 0 0 2024-02-15T18:31:53.841 INFO:tasks.workunit.client.1.smithi131.stdout:6/865: read d2/d2b/d6e/f7c [446834,29549] 0 2024-02-15T18:31:53.843 INFO:tasks.workunit.client.1.smithi131.stdout:6/866: rename d2/d6d/db9/cab to d2/d79/dad/dcc/c111 0 2024-02-15T18:31:53.847 INFO:tasks.workunit.client.1.smithi131.stdout:6/867: mkdir d2/dc/d27/d62/db0/d112 0 2024-02-15T18:31:53.856 INFO:tasks.workunit.client.1.smithi131.stdout:6/868: dread d2/dc/d1f/f96 [0,4194304] 0 2024-02-15T18:31:53.857 INFO:tasks.workunit.client.1.smithi131.stdout:6/869: symlink d2/dc/d1f/daa/l113 0 2024-02-15T18:31:53.901 INFO:tasks.workunit.client.1.smithi131.stdout:7/990: sync 2024-02-15T18:31:53.910 INFO:tasks.workunit.client.1.smithi131.stdout:7/991: dread d0/db8/d12c/dd7/f101 [0,4194304] 0 2024-02-15T18:31:53.910 INFO:tasks.workunit.client.1.smithi131.stdout:7/992: write d0/d17/d36/f48 [1305640,49825] 0 2024-02-15T18:31:53.912 INFO:tasks.workunit.client.1.smithi131.stdout:7/993: mkdir d0/d17/d3a/d3d/d137 0 2024-02-15T18:31:53.927 INFO:tasks.workunit.client.1.smithi131.stdout:7/994: dwrite d0/d34/d8b/dfd/f10a [0,4194304] 0 2024-02-15T18:31:53.927 INFO:tasks.workunit.client.1.smithi131.stdout:7/995: truncate d0/d17/d36/f6b 1152441 0 2024-02-15T18:31:53.931 INFO:tasks.workunit.client.1.smithi131.stdout:7/996: rmdir d0/d17/d3a/d3d/df4 39 2024-02-15T18:31:53.934 INFO:tasks.workunit.client.1.smithi131.stdout:7/997: rename d0/da9/de4/f122 to d0/d34/f138 0 2024-02-15T18:31:53.936 INFO:tasks.workunit.client.1.smithi131.stdout:7/998: rename d0/dba/lc9 to d0/da9/dfa/l139 0 2024-02-15T18:31:53.937 INFO:tasks.workunit.client.1.smithi131.stdout:7/999: getdents d0/d17/d3a 0 2024-02-15T18:31:54.014 INFO:tasks.workunit.client.1.smithi131.stdout:2/930: sync 2024-02-15T18:31:54.058 INFO:tasks.workunit.client.1.smithi131.stdout:2/931: rmdir dd/d10 39 2024-02-15T18:31:54.064 INFO:tasks.workunit.client.1.smithi131.stdout:2/932: mkdir dd/d12c 0 2024-02-15T18:31:54.068 INFO:tasks.workunit.client.1.smithi131.stdout:2/933: write dd/d10/d22/d2f/d38/f50 [3689844,93904] 0 2024-02-15T18:31:54.075 INFO:tasks.workunit.client.1.smithi131.stdout:2/934: unlink dd/d10/d22/d2f/d38/d74/d2e/d66/d9b/lee 0 2024-02-15T18:31:54.077 INFO:tasks.workunit.client.1.smithi131.stdout:2/935: creat dd/d14/d1f/d65/d81/d12a/f12d x:0 0 0 2024-02-15T18:31:54.077 INFO:tasks.workunit.client.1.smithi131.stdout:2/936: readlink dd/d10/lce 0 2024-02-15T18:31:54.080 INFO:tasks.workunit.client.1.smithi131.stdout:2/937: rename dd/d14/d1f/d65/d77/d7a/df3/c12b to dd/d10/d22/d2a/d94/c12e 0 2024-02-15T18:31:54.084 INFO:tasks.workunit.client.1.smithi131.stdout:2/938: mkdir dd/d10/d22/d2f/d38/d74/d2e/d12f 0 2024-02-15T18:31:54.087 INFO:tasks.workunit.client.1.smithi131.stdout:2/939: rmdir dd/d14/d1f/d65 39 2024-02-15T18:31:54.092 INFO:tasks.workunit.client.1.smithi131.stdout:0/876: sync 2024-02-15T18:31:54.093 INFO:tasks.workunit.client.1.smithi131.stdout:8/989: sync 2024-02-15T18:31:54.093 INFO:tasks.workunit.client.1.smithi131.stdout:8/990: stat d22/d26/c2c 0 2024-02-15T18:31:54.094 INFO:tasks.workunit.client.1.smithi131.stdout:8/991: chown d22/d26/f82 31316 1 2024-02-15T18:31:54.094 INFO:tasks.workunit.client.1.smithi131.stdout:6/870: sync 2024-02-15T18:31:54.094 INFO:tasks.workunit.client.1.smithi131.stdout:6/871: fsync d2/dc/d1f/f26 0 2024-02-15T18:31:54.095 INFO:tasks.workunit.client.1.smithi131.stdout:8/992: mkdir d22/d39/d151 0 2024-02-15T18:31:54.096 INFO:tasks.workunit.client.1.smithi131.stdout:8/993: write d22/d26/d3f/d47/d48/d5f/d70/db0/f12b [838040,10576] 0 2024-02-15T18:31:54.100 INFO:tasks.workunit.client.1.smithi131.stdout:6/872: getdents d2/dc/d27/d74/d75/dc0 0 2024-02-15T18:31:54.100 INFO:tasks.workunit.client.1.smithi131.stdout:6/873: fdatasync d2/d6d/db9/d48/ffa 0 2024-02-15T18:31:54.103 INFO:tasks.workunit.client.1.smithi131.stdout:6/874: mknod d2/d6d/de8/c114 0 2024-02-15T18:31:54.103 INFO:tasks.workunit.client.1.smithi131.stdout:6/875: fdatasync d2/d6d/db9/f9f 0 2024-02-15T18:31:54.103 INFO:tasks.workunit.client.1.smithi131.stdout:6/876: truncate d2/dc/d1f/f63 1489581 0 2024-02-15T18:31:54.104 INFO:tasks.workunit.client.1.smithi131.stdout:6/877: mknod d2/d6d/db9/d12/df6/df9/c115 0 2024-02-15T18:31:54.104 INFO:tasks.workunit.client.1.smithi131.stdout:6/878: chown d2/d6d 201 1 2024-02-15T18:31:54.104 INFO:tasks.workunit.client.1.smithi131.stdout:6/879: write d2/d6d/db9/d48/f49 [4464201,89085] 0 2024-02-15T18:31:54.104 INFO:tasks.workunit.client.1.smithi131.stdout:6/880: fdatasync d2/f1a 0 2024-02-15T18:31:54.104 INFO:tasks.workunit.client.1.smithi131.stdout:2/940: dwrite dd/d14/d1f/d65/d77/d7a/df3/f113 [0,4194304] 0 2024-02-15T18:31:54.104 INFO:tasks.workunit.client.1.smithi131.stdout:2/941: stat dd/d10/d22/d2a/f2c 0 2024-02-15T18:31:54.105 INFO:tasks.workunit.client.1.smithi131.stdout:2/942: rmdir dd/d10/dfa/d103 39 2024-02-15T18:31:54.105 INFO:tasks.workunit.client.1.smithi131.stdout:6/881: write d2/f28 [2409630,119510] 0 2024-02-15T18:31:54.105 INFO:tasks.workunit.client.1.smithi131.stdout:6/882: write d2/dc/d27/d62/f104 [1340442,44716] 0 2024-02-15T18:31:54.105 INFO:tasks.workunit.client.1.smithi131.stdout:2/943: truncate dd/d10/d22/d2f/f40 694981 0 2024-02-15T18:31:54.106 INFO:tasks.workunit.client.1.smithi131.stdout:2/944: chown dd/d14/d1f/d65/d77/f7e 88217 1 2024-02-15T18:31:54.106 INFO:tasks.workunit.client.1.smithi131.stdout:2/945: write dd/d10/d22/d2f/d38/d9f/dca/f11a [190505,5080] 0 2024-02-15T18:31:54.108 INFO:tasks.workunit.client.1.smithi131.stdout:6/883: truncate d2/d2b/d6e/f7c 3914559 0 2024-02-15T18:31:54.108 INFO:tasks.workunit.client.1.smithi131.stdout:6/884: chown d2/d6d/db9/d12 1616 1 2024-02-15T18:31:54.108 INFO:tasks.workunit.client.1.smithi131.stdout:8/994: creat d22/d26/d3f/d47/d48/d5f/d6f/d7a/f152 x:0 0 0 2024-02-15T18:31:54.109 INFO:tasks.workunit.client.1.smithi131.stdout:6/885: dread d2/d6d/db9/f46 [4194304,4194304] 0 2024-02-15T18:31:54.110 INFO:tasks.workunit.client.1.smithi131.stdout:2/946: rename dd/d10/d22/d2f/d38/f3f to dd/d10/d22/df2/f130 0 2024-02-15T18:31:54.110 INFO:tasks.workunit.client.1.smithi131.stdout:2/947: truncate dd/d10/dfa/d103/ff6 4942105 0 2024-02-15T18:31:54.111 INFO:tasks.workunit.client.1.smithi131.stdout:8/995: creat d22/d119/f153 x:0 0 0 2024-02-15T18:31:54.111 INFO:tasks.workunit.client.1.smithi131.stdout:8/996: write d22/d26/f109 [4282092,2197] 0 2024-02-15T18:31:54.112 INFO:tasks.workunit.client.1.smithi131.stdout:2/948: creat dd/d69/d92/f131 x:0 0 0 2024-02-15T18:31:54.112 INFO:tasks.workunit.client.1.smithi131.stdout:2/949: stat dd/f29 0 2024-02-15T18:31:54.114 INFO:tasks.workunit.client.1.smithi131.stdout:2/950: write dd/d10/d22/d2f/d38/f50 [2148919,68705] 0 2024-02-15T18:31:54.114 INFO:tasks.workunit.client.1.smithi131.stdout:8/997: unlink d22/d26/d3f/d47/d48/f5a 0 2024-02-15T18:31:54.114 INFO:tasks.workunit.client.1.smithi131.stdout:6/886: rename d2/d6d/db9/d48/f5c to d2/dc/d27/d62/db0/d112/f116 0 2024-02-15T18:31:54.114 INFO:tasks.workunit.client.1.smithi131.stdout:6/887: chown d2/dc/c1d 2002531 1 2024-02-15T18:31:54.116 INFO:tasks.workunit.client.1.smithi131.stdout:6/888: rmdir d2/dc/d1f/daa 39 2024-02-15T18:31:54.121 INFO:tasks.workunit.client.1.smithi131.stdout:2/951: dread dd/d14/d1f/d65/d77/d7a/df3/f113 [0,4194304] 0 2024-02-15T18:31:54.123 INFO:tasks.workunit.client.1.smithi131.stdout:2/952: creat dd/d10/db1/dbd/f132 x:0 0 0 2024-02-15T18:31:54.125 INFO:tasks.workunit.client.1.smithi131.stdout:2/953: symlink dd/d10/d22/d2a/l133 0 2024-02-15T18:31:54.127 INFO:tasks.workunit.client.1.smithi131.stdout:2/954: getdents dd/d69 0 2024-02-15T18:31:54.132 INFO:tasks.workunit.client.1.smithi131.stdout:6/889: dread d2/dc/f14 [0,4194304] 0 2024-02-15T18:31:54.132 INFO:tasks.workunit.client.1.smithi131.stdout:2/955: read dd/d10/d22/d2f/d38/f118 [6279,54754] 0 2024-02-15T18:31:54.135 INFO:tasks.workunit.client.1.smithi131.stdout:8/998: dwrite d22/d26/d3f/d47/d48/d84/d11d/f136 [0,4194304] 0 2024-02-15T18:31:54.135 INFO:tasks.workunit.client.1.smithi131.stdout:8/999: dread - d22/d26/d3f/d47/d48/d5f/d6f/fe4 zero size 2024-02-15T18:31:54.136 INFO:tasks.workunit.client.1.smithi131.stdout:2/956: creat dd/d14/f134 x:0 0 0 2024-02-15T18:31:54.138 INFO:tasks.workunit.client.1.smithi131.stdout:6/890: dread d2/dc/d1f/f96 [0,4194304] 0 2024-02-15T18:31:54.139 INFO:tasks.workunit.client.1.smithi131.stdout:6/891: creat d2/f117 x:0 0 0 2024-02-15T18:31:54.139 INFO:tasks.workunit.client.1.smithi131.stdout:6/892: dread - d2/d6d/db9/d48/dcf/ff8 zero size 2024-02-15T18:31:54.141 INFO:tasks.workunit.client.1.smithi131.stdout:6/893: creat d2/d6d/db9/da4/f118 x:0 0 0 2024-02-15T18:31:54.162 INFO:tasks.workunit.client.1.smithi131.stdout:2/957: dwrite dd/d69/d92/f131 [0,4194304] 0 2024-02-15T18:31:54.167 INFO:tasks.workunit.client.1.smithi131.stdout:6/894: dwrite d2/dc/d1f/f26 [0,4194304] 0 2024-02-15T18:31:54.183 INFO:tasks.workunit.client.1.smithi131.stdout:2/958: rename dd/d10/d22/d2a/d48/ce4 to dd/d14/d1f/d65/d81/ddd/c135 0 2024-02-15T18:31:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:6/895: dwrite d2/dc/d1f/f96 [0,4194304] 0 2024-02-15T18:31:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:0/877: symlink d5/d2f/d4b/l121 0 2024-02-15T18:31:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:6/896: dread d2/dc/f68 [0,4194304] 0 2024-02-15T18:31:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:0/878: unlink d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/lf2 0 2024-02-15T18:31:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:0/879: fdatasync d5/d2f/d4b/dd9/d10/d73/d11a/f11c 0 2024-02-15T18:31:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:6/897: dwrite d2/d79/fcd [0,4194304] 0 2024-02-15T18:31:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:6/898: rename d2/d6d/db9/d48/ffa to d2/d79/dad/dcc/f119 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/899: creat d2/d6d/db9/d12/df6/df9/f11a x:0 0 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/900: write d2/d2b/f69 [404344,64507] 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/901: getdents d2/dc/d27/d74/d75 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/902: readlink d2/d6d/db9/d48/dcf/l10b 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/903: write d2/dc/d1f/f8e [2636305,10142] 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:0/880: rmdir d5/d2f/d4b/dd9/d77/da8 39 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/904: unlink d2/dc/d27/l30 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/905: readlink d2/dc/d1f/l4b 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:0/881: creat d5/d2f/d4b/dd9/d77/d8b/f122 x:0 0 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:6/906: mkdir d2/dc/d1f/dbc/db6/dbb/d11b 0 2024-02-15T18:31:54.256 INFO:tasks.workunit.client.1.smithi131.stdout:0/882: unlink d5/d2f/d4b/dd9/d10/d71/d92/f106 0 2024-02-15T18:31:54.258 INFO:tasks.workunit.client.1.smithi131.stdout:0/883: dread d5/d2f/d4b/dd9/d11/fc5 [0,4194304] 0 2024-02-15T18:31:54.260 INFO:tasks.workunit.client.1.smithi131.stdout:0/884: mknod d5/d15/c123 0 2024-02-15T18:31:54.285 INFO:tasks.workunit.client.1.smithi131.stdout:0/885: dwrite d5/d2f/d4b/d82/d9f/fd3 [0,4194304] 0 2024-02-15T18:31:54.285 INFO:tasks.workunit.client.1.smithi131.stdout:0/886: chown d5/d2f/d45/f51 4650 1 2024-02-15T18:31:54.288 INFO:tasks.workunit.client.1.smithi131.stdout:6/907: dwrite d2/dc/d1f/f8e [4194304,4194304] 0 2024-02-15T18:31:54.288 INFO:tasks.workunit.client.1.smithi131.stdout:0/887: creat d5/f124 x:0 0 0 2024-02-15T18:31:54.289 INFO:tasks.workunit.client.1.smithi131.stdout:6/908: stat d2/dc/d1f/l4b 0 2024-02-15T18:31:54.289 INFO:tasks.workunit.client.1.smithi131.stdout:6/909: truncate d2/d6d/db9/dca/f10d 242071 0 2024-02-15T18:31:54.289 INFO:tasks.workunit.client.1.smithi131.stdout:6/910: truncate d2/d6d/db9/d12/d80/fe7 73759 0 2024-02-15T18:31:54.290 INFO:tasks.workunit.client.1.smithi131.stdout:6/911: link d2/d6d/db9/d48/d40/ce9 d2/d6d/dbe/d10c/c11c 0 2024-02-15T18:31:54.298 INFO:tasks.workunit.client.1.smithi131.stdout:0/888: creat d5/d2f/d4b/dd9/d11/f125 x:0 0 0 2024-02-15T18:31:54.298 INFO:tasks.workunit.client.1.smithi131.stdout:0/889: fdatasync d5/d2f/d4b/dd9/d10/d73/fe8 0 2024-02-15T18:31:54.300 INFO:tasks.workunit.client.1.smithi131.stdout:0/890: mkdir d5/d2f/d4b/dd9/d10/d73/d126 0 2024-02-15T18:31:54.300 INFO:tasks.workunit.client.1.smithi131.stdout:0/891: write d5/d2f/d4b/dd9/d11/f88 [3109329,208] 0 2024-02-15T18:31:54.393 INFO:tasks.workunit.client.1.smithi131.stdout:0/892: stat d5/d2f/d4b/l7a 0 2024-02-15T18:31:54.396 INFO:tasks.workunit.client.1.smithi131.stdout:0/893: rename d5/d15/d1f/l41 to d5/d2f/d4b/dd9/d10/d71/d92/df6/d114/l127 0 2024-02-15T18:31:54.400 INFO:tasks.workunit.client.1.smithi131.stdout:0/894: mkdir d5/d2f/d4b/dd9/d4d/d128 0 2024-02-15T18:31:54.406 INFO:tasks.workunit.client.1.smithi131.stdout:0/895: dread f4 [0,4194304] 0 2024-02-15T18:31:54.413 INFO:tasks.workunit.client.1.smithi131.stdout:0/896: symlink d5/d2f/d4b/dd9/d10/d71/d92/df6/l129 0 2024-02-15T18:31:54.416 INFO:tasks.workunit.client.1.smithi131.stdout:0/897: creat d5/d2f/d4b/dd9/d11/d3e/f12a x:0 0 0 2024-02-15T18:31:54.416 INFO:tasks.workunit.client.1.smithi131.stdout:0/898: chown d5/d2f/d4b/f10e 893 1 2024-02-15T18:31:54.420 INFO:tasks.workunit.client.1.smithi131.stdout:0/899: write d5/d2f/d45/f50 [1881969,42439] 0 2024-02-15T18:31:54.424 INFO:tasks.workunit.client.1.smithi131.stdout:0/900: unlink d5/d2f/d4b/dd9/d10/d3f/l40 0 2024-02-15T18:31:54.447 INFO:tasks.workunit.client.1.smithi131.stdout:0/901: dwrite d5/d2f/d4b/f10e [0,4194304] 0 2024-02-15T18:31:54.453 INFO:tasks.workunit.client.1.smithi131.stdout:0/902: unlink d5/d15/ld0 0 2024-02-15T18:31:54.461 INFO:tasks.workunit.client.1.smithi131.stdout:0/903: rename d5/d2f/f5e to d5/d2f/d4b/dd9/d4d/d128/f12b 0 2024-02-15T18:31:54.462 INFO:tasks.workunit.client.1.smithi131.stdout:0/904: readlink d5/d2f/d45/lec 0 2024-02-15T18:31:54.464 INFO:tasks.workunit.client.1.smithi131.stdout:0/905: link d5/d15/d1f/c4e d5/d2f/d4b/dd9/d10/d73/c12c 0 2024-02-15T18:31:54.465 INFO:tasks.workunit.client.1.smithi131.stdout:0/906: write d5/d2f/d45/d8c/fc4 [4084826,23832] 0 2024-02-15T18:31:54.466 INFO:tasks.workunit.client.1.smithi131.stdout:0/907: symlink d5/d2f/d45/l12d 0 2024-02-15T18:31:54.469 INFO:tasks.workunit.client.1.smithi131.stdout:0/908: rename d5/f62 to d5/d2f/d45/d8c/f12e 0 2024-02-15T18:31:54.470 INFO:tasks.workunit.client.1.smithi131.stdout:0/909: mknod d5/d2f/d4b/dbf/d118/c12f 0 2024-02-15T18:31:54.471 INFO:tasks.workunit.client.1.smithi131.stdout:0/910: mkdir d5/d2f/d4b/dd9/d10/d73/d11a/d130 0 2024-02-15T18:31:54.475 INFO:tasks.workunit.client.1.smithi131.stdout:0/911: creat d5/d2f/d4b/dd9/d77/da8/dad/f131 x:0 0 0 2024-02-15T18:31:54.477 INFO:tasks.workunit.client.1.smithi131.stdout:0/912: mknod d5/d2f/d4b/dd9/d11/c132 0 2024-02-15T18:31:54.477 INFO:tasks.workunit.client.1.smithi131.stdout:0/913: readlink d5/d2f/d4b/dd9/d77/d8b/l11e 0 2024-02-15T18:31:54.477 INFO:tasks.workunit.client.1.smithi131.stdout:0/914: mknod d5/d2f/d4b/dd9/d10/d71/d92/c133 0 2024-02-15T18:31:54.480 INFO:tasks.workunit.client.1.smithi131.stdout:0/915: rename d5/d2f/d4b/dd9/d10/d71/d92/f110 to d5/d2f/d4b/d82/da0/f134 0 2024-02-15T18:31:54.489 INFO:tasks.workunit.client.1.smithi131.stdout:0/916: dread d5/d2f/d4b/dd9/d4d/fb6 [0,4194304] 0 2024-02-15T18:31:54.489 INFO:tasks.workunit.client.1.smithi131.stdout:0/917: dread - d5/d2f/d4b/dbf/fe9 zero size 2024-02-15T18:31:54.508 INFO:tasks.workunit.client.1.smithi131.stdout:0/918: dwrite d5/d2f/d4b/f9b [0,4194304] 0 2024-02-15T18:31:54.510 INFO:tasks.workunit.client.1.smithi131.stdout:0/919: mknod d5/d2f/d4b/dd9/d10/d73/c135 0 2024-02-15T18:31:54.516 INFO:tasks.workunit.client.1.smithi131.stdout:0/920: link d5/fd4 d5/d2f/d4b/f136 0 2024-02-15T18:31:54.516 INFO:tasks.workunit.client.1.smithi131.stdout:0/921: dread - d5/d2f/d4b/dd9/d11/d3e/f12a zero size 2024-02-15T18:31:54.517 INFO:tasks.workunit.client.1.smithi131.stdout:0/922: write d5/d2f/d4b/dd9/d10/d71/d92/f9c [1902127,118058] 0 2024-02-15T18:31:54.519 INFO:tasks.workunit.client.1.smithi131.stdout:0/923: mkdir d5/d2f/d45/d137 0 2024-02-15T18:31:54.519 INFO:tasks.workunit.client.1.smithi131.stdout:0/924: chown d5/d15/d1f/df5 92093 1 2024-02-15T18:31:54.520 INFO:tasks.workunit.client.1.smithi131.stdout:0/925: truncate d5/d2f/d4b/dd9/d10/d3f/f47 2595742 0 2024-02-15T18:31:54.520 INFO:tasks.workunit.client.1.smithi131.stdout:0/926: chown d5/d2f/d4b/dd9/d11/d3e/c6d 105 1 2024-02-15T18:31:54.520 INFO:tasks.workunit.client.1.smithi131.stdout:0/927: getdents d5/d2f/d4b/dd9/d10/d73/d11a/d130 0 2024-02-15T18:31:54.521 INFO:tasks.workunit.client.1.smithi131.stdout:0/928: creat d5/d2f/d4b/dd9/d77/f138 x:0 0 0 2024-02-15T18:31:54.524 INFO:tasks.workunit.client.1.smithi131.stdout:0/929: dread d5/d2f/d45/d8c/fb5 [0,4194304] 0 2024-02-15T18:31:54.526 INFO:tasks.workunit.client.1.smithi131.stdout:0/930: dread d5/d2f/d4b/dd9/d11/fbc [0,4194304] 0 2024-02-15T18:31:54.526 INFO:tasks.workunit.client.1.smithi131.stdout:0/931: dread - d5/d2f/d4b/dd9/d77/d8b/f122 zero size 2024-02-15T18:31:54.637 INFO:tasks.workunit.client.1.smithi131.stdout:2/959: sync 2024-02-15T18:31:54.637 INFO:tasks.workunit.client.1.smithi131.stdout:6/912: sync 2024-02-15T18:31:54.639 INFO:tasks.workunit.client.1.smithi131.stdout:2/960: creat dd/d10/d22/d2f/d38/d74/d2e/d6a/f136 x:0 0 0 2024-02-15T18:31:54.640 INFO:tasks.workunit.client.1.smithi131.stdout:6/913: mknod d2/d79/c11d 0 2024-02-15T18:31:54.641 INFO:tasks.workunit.client.1.smithi131.stdout:2/961: mkdir dd/d69/d92/d10d/d137 0 2024-02-15T18:31:54.650 INFO:tasks.workunit.client.1.smithi131.stdout:2/962: dread dd/d10/fb4 [0,4194304] 0 2024-02-15T18:31:54.651 INFO:tasks.workunit.client.1.smithi131.stdout:6/914: dread d2/dc/d1f/dbc/de0/fce [0,4194304] 0 2024-02-15T18:31:54.652 INFO:tasks.workunit.client.1.smithi131.stdout:2/963: mknod dd/d14/c138 0 2024-02-15T18:31:54.654 INFO:tasks.workunit.client.1.smithi131.stdout:2/964: write fa [3372301,91874] 0 2024-02-15T18:31:54.654 INFO:tasks.workunit.client.1.smithi131.stdout:2/965: chown dd/d10/d22/d2a/d94/c12e 65158338 1 2024-02-15T18:31:54.655 INFO:tasks.workunit.client.1.smithi131.stdout:2/966: chown dd/d1e/cc3 589 1 2024-02-15T18:31:54.655 INFO:tasks.workunit.client.1.smithi131.stdout:2/967: dread - dd/d10/d22/d2f/d38/d74/d2e/d66/f11f zero size 2024-02-15T18:31:54.655 INFO:tasks.workunit.client.1.smithi131.stdout:2/968: readlink dd/d10/d22/d2f/d38/d9f/l10c 0 2024-02-15T18:31:54.655 INFO:tasks.workunit.client.1.smithi131.stdout:2/969: truncate dd/d10/d22/d2f/d38/fef 4935524 0 2024-02-15T18:31:54.655 INFO:tasks.workunit.client.1.smithi131.stdout:2/970: dread - dd/d10/ffc zero size 2024-02-15T18:31:54.672 INFO:tasks.workunit.client.1.smithi131.stdout:6/915: dwrite d2/d2b/d6e/f7c [0,4194304] 0 2024-02-15T18:31:54.673 INFO:tasks.workunit.client.1.smithi131.stdout:2/971: dwrite dd/d14/d1f/d65/d77/f115 [0,4194304] 0 2024-02-15T18:31:54.673 INFO:tasks.workunit.client.1.smithi131.stdout:6/916: mknod d2/dc/d27/d62/db0/d112/c11e 0 2024-02-15T18:31:54.676 INFO:tasks.workunit.client.1.smithi131.stdout:2/972: mknod dd/d10/d22/d2a/c139 0 2024-02-15T18:31:54.676 INFO:tasks.workunit.client.1.smithi131.stdout:2/973: chown dd/d10/d22/d2a/f49 221 1 2024-02-15T18:31:54.680 INFO:tasks.workunit.client.1.smithi131.stdout:2/974: symlink dd/d69/l13a 0 2024-02-15T18:31:54.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/975: dread dd/d10/d22/d2a/f2c [0,4194304] 0 2024-02-15T18:31:54.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/976: rename dd to dd/d14/d1f/d13b 22 2024-02-15T18:31:54.690 INFO:tasks.workunit.client.1.smithi131.stdout:6/917: dwrite d2/d6d/ffe [0,4194304] 0 2024-02-15T18:31:54.693 INFO:tasks.workunit.client.1.smithi131.stdout:2/977: rename dd/d10/d22/d2f/d38/d74/d2e/f67 to dd/d10/dfa/f13c 0 2024-02-15T18:31:54.695 INFO:tasks.workunit.client.1.smithi131.stdout:6/918: creat d2/dc/d1f/daa/f11f x:0 0 0 2024-02-15T18:31:54.695 INFO:tasks.workunit.client.1.smithi131.stdout:6/919: fsync d2/dc/f5f 0 2024-02-15T18:31:54.696 INFO:tasks.workunit.client.1.smithi131.stdout:2/978: mkdir dd/d14/d1f/d120/d13d 0 2024-02-15T18:31:54.697 INFO:tasks.workunit.client.1.smithi131.stdout:6/920: mkdir d2/d6d/db9/dca/d120 0 2024-02-15T18:31:54.698 INFO:tasks.workunit.client.1.smithi131.stdout:2/979: mkdir dd/d69/d92/d10d/d137/d13e 0 2024-02-15T18:31:54.698 INFO:tasks.workunit.client.1.smithi131.stdout:2/980: write dd/d10/ffc [840299,79853] 0 2024-02-15T18:31:54.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/921: creat d2/dc/d27/d74/d75/f121 x:0 0 0 2024-02-15T18:31:54.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/922: chown d2/dc/d1f/dbc/fd4 30 1 2024-02-15T18:31:54.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/923: write d2/f117 [1019444,96104] 0 2024-02-15T18:31:54.699 INFO:tasks.workunit.client.1.smithi131.stdout:6/924: readlink d2/d6d/db9/d12/d4d/l6c 0 2024-02-15T18:31:54.700 INFO:tasks.workunit.client.1.smithi131.stdout:2/981: chown dd/d1e/c9d 19057 1 2024-02-15T18:31:54.701 INFO:tasks.workunit.client.1.smithi131.stdout:2/982: creat dd/f13f x:0 0 0 2024-02-15T18:31:54.702 INFO:tasks.workunit.client.1.smithi131.stdout:6/925: truncate d2/dc/d27/d78/f99 2923085 0 2024-02-15T18:31:54.702 INFO:tasks.workunit.client.1.smithi131.stdout:2/983: creat dd/d69/d92/f140 x:0 0 0 2024-02-15T18:31:54.703 INFO:tasks.workunit.client.1.smithi131.stdout:6/926: creat d2/dc/d27/d62/f122 x:0 0 0 2024-02-15T18:31:54.703 INFO:tasks.workunit.client.1.smithi131.stdout:6/927: readlink d2/dc/d1f/l77 0 2024-02-15T18:31:54.704 INFO:tasks.workunit.client.1.smithi131.stdout:6/928: mknod d2/dc/d1f/dbc/db6/dbb/c123 0 2024-02-15T18:31:54.714 INFO:tasks.workunit.client.1.smithi131.stdout:2/984: unlink dd/d10/d22/d2a/d48/l101 0 2024-02-15T18:31:54.716 INFO:tasks.workunit.client.1.smithi131.stdout:2/985: creat dd/d1e/f141 x:0 0 0 2024-02-15T18:31:54.724 INFO:tasks.workunit.client.1.smithi131.stdout:2/986: dread dd/d69/d92/f131 [0,4194304] 0 2024-02-15T18:31:54.725 INFO:tasks.workunit.client.1.smithi131.stdout:2/987: mkdir dd/d14/d1f/d65/d77/d7a/df3/d142 0 2024-02-15T18:31:54.726 INFO:tasks.workunit.client.1.smithi131.stdout:6/929: dwrite d2/dc/d27/d62/db0/f3c [0,4194304] 0 2024-02-15T18:31:54.726 INFO:tasks.workunit.client.1.smithi131.stdout:6/930: chown d2/dc/d1f/daa/f11f 432812 1 2024-02-15T18:31:54.728 INFO:tasks.workunit.client.1.smithi131.stdout:6/931: creat d2/dc/d27/d78/f124 x:0 0 0 2024-02-15T18:31:54.730 INFO:tasks.workunit.client.1.smithi131.stdout:6/932: mknod d2/dc/d27/d62/c125 0 2024-02-15T18:31:54.730 INFO:tasks.workunit.client.1.smithi131.stdout:6/933: write d2/dc/d27/d62/f104 [1997778,48605] 0 2024-02-15T18:31:54.732 INFO:tasks.workunit.client.1.smithi131.stdout:6/934: write d2/d6d/db9/d48/f44 [1694424,100691] 0 2024-02-15T18:31:54.738 INFO:tasks.workunit.client.1.smithi131.stdout:6/935: write d2/dc/d1f/f93 [4032324,67324] 0 2024-02-15T18:31:54.739 INFO:tasks.workunit.client.1.smithi131.stdout:6/936: truncate d2/dc/d27/d78/f87 29817 0 2024-02-15T18:31:54.741 INFO:tasks.workunit.client.1.smithi131.stdout:6/937: truncate d2/d6d/db9/d48/fa3 2175547 0 2024-02-15T18:31:54.742 INFO:tasks.workunit.client.1.smithi131.stdout:6/938: mkdir d2/dc/d27/d62/d8f/d126 0 2024-02-15T18:31:54.743 INFO:tasks.workunit.client.1.smithi131.stdout:2/988: dwrite dd/d1e/fb2 [0,4194304] 0 2024-02-15T18:31:54.745 INFO:tasks.workunit.client.1.smithi131.stdout:2/989: mkdir dd/d10/d22/d2a/d110/d143 0 2024-02-15T18:31:54.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:53.453857+0000 mgr.smithi033.apxevf (mgr.14626) 22 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 26 MiB/s rd, 52 MiB/s wr, 244 op/s 2024-02-15T18:31:54.762 INFO:tasks.workunit.client.1.smithi131.stdout:6/939: dwrite d2/dc/f22 [0,4194304] 0 2024-02-15T18:31:54.765 INFO:tasks.workunit.client.1.smithi131.stdout:6/940: rename d2/dc/d27/d74/d75/dc0/fea to d2/d6d/db9/dca/d120/f127 0 2024-02-15T18:31:54.766 INFO:tasks.workunit.client.1.smithi131.stdout:6/941: symlink d2/dc/d27/d74/d75/dc0/l128 0 2024-02-15T18:31:54.766 INFO:tasks.workunit.client.1.smithi131.stdout:6/942: fdatasync d2/f28 0 2024-02-15T18:31:54.772 INFO:tasks.workunit.client.1.smithi131.stdout:2/990: dwrite dd/d10/d22/d2a/f2c [0,4194304] 0 2024-02-15T18:31:54.773 INFO:tasks.workunit.client.1.smithi131.stdout:2/991: chown dd/d10/d22/d2f/d38/d74/d2e/d66/d9b 4720 1 2024-02-15T18:31:54.773 INFO:tasks.workunit.client.1.smithi131.stdout:2/992: chown c3 32 1 2024-02-15T18:31:54.793 INFO:tasks.workunit.client.1.smithi131.stdout:2/993: dwrite dd/d10/d22/f56 [0,4194304] 0 2024-02-15T18:31:54.794 INFO:tasks.workunit.client.1.smithi131.stdout:6/943: dwrite d2/d79/fcd [0,4194304] 0 2024-02-15T18:31:54.795 INFO:tasks.workunit.client.1.smithi131.stdout:2/994: creat dd/d10/d22/d2f/d38/d74/d2e/d6a/dc0/f144 x:0 0 0 2024-02-15T18:31:54.796 INFO:tasks.workunit.client.1.smithi131.stdout:6/944: symlink d2/d6d/db9/d12/df6/df9/l129 0 2024-02-15T18:31:54.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:53.453857+0000 mgr.smithi033.apxevf (mgr.14626) 22 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 26 MiB/s rd, 52 MiB/s wr, 244 op/s 2024-02-15T18:31:54.798 INFO:tasks.workunit.client.1.smithi131.stdout:2/995: mknod dd/d10/d22/d2f/d38/c145 0 2024-02-15T18:31:54.799 INFO:tasks.workunit.client.1.smithi131.stdout:2/996: truncate dd/d10/db1/dbd/f132 225332 0 2024-02-15T18:31:54.800 INFO:tasks.workunit.client.1.smithi131.stdout:2/997: creat dd/d10/d22/d2f/d38/d74/f146 x:0 0 0 2024-02-15T18:31:54.800 INFO:tasks.workunit.client.1.smithi131.stdout:2/998: chown dd/d14/d1f/d65/d77/d7a/df3/lfb 2016752422 1 2024-02-15T18:31:54.800 INFO:tasks.workunit.client.1.smithi131.stdout:2/999: chown dd/d10/d22/d2f/d38/d74/l35 16 1 2024-02-15T18:31:54.812 INFO:tasks.workunit.client.1.smithi131.stdout:6/945: dwrite d2/dc/f68 [0,4194304] 0 2024-02-15T18:31:54.815 INFO:tasks.workunit.client.1.smithi131.stdout:6/946: rename d2/d2b/d6e to d2/dc/d12a 0 2024-02-15T18:31:54.815 INFO:tasks.workunit.client.1.smithi131.stdout:6/947: write d2/d6d/db9/f10f [395041,41764] 0 2024-02-15T18:31:54.815 INFO:tasks.workunit.client.1.smithi131.stdout:6/948: chown d2/d6d/fd2 920 1 2024-02-15T18:31:54.829 INFO:tasks.workunit.client.1.smithi131.stdout:6/949: dwrite d2/d6d/fd2 [0,4194304] 0 2024-02-15T18:31:54.830 INFO:tasks.workunit.client.1.smithi131.stdout:6/950: fsync d2/d6d/db9/d12/d4d/f9a 0 2024-02-15T18:31:54.830 INFO:tasks.workunit.client.1.smithi131.stdout:6/951: fsync d2/dc/d27/d62/d97/f1e 0 2024-02-15T18:31:54.832 INFO:tasks.workunit.client.1.smithi131.stdout:6/952: symlink d2/d6d/db9/d12/df6/l12b 0 2024-02-15T18:31:54.832 INFO:tasks.workunit.client.1.smithi131.stdout:6/953: readlink d2/dc/d27/d62/db0/l81 0 2024-02-15T18:31:54.852 INFO:tasks.workunit.client.1.smithi131.stdout:6/954: dwrite d2/dc/d1f/f96 [0,4194304] 0 2024-02-15T18:31:54.858 INFO:tasks.workunit.client.1.smithi131.stdout:6/955: truncate d2/dc/d12a/f6f 246894 0 2024-02-15T18:31:54.865 INFO:tasks.workunit.client.1.smithi131.stdout:6/956: dread d2/dc/d27/d74/d75/dc0/fec [0,4194304] 0 2024-02-15T18:31:54.866 INFO:tasks.workunit.client.1.smithi131.stdout:6/957: fsync d2/d6d/db9/d12/d4d/f9a 0 2024-02-15T18:31:54.866 INFO:tasks.workunit.client.1.smithi131.stdout:6/958: stat d2/dc/d1f/l35 0 2024-02-15T18:31:54.866 INFO:tasks.workunit.client.1.smithi131.stdout:6/959: creat d2/d6d/dbe/f12c x:0 0 0 2024-02-15T18:31:54.867 INFO:tasks.workunit.client.1.smithi131.stdout:6/960: chown d2/dc/d1f/dbc/db6 5454469 1 2024-02-15T18:31:54.867 INFO:tasks.workunit.client.1.smithi131.stdout:6/961: truncate d2/d6d/db9/f54 65378 0 2024-02-15T18:31:54.869 INFO:tasks.workunit.client.1.smithi131.stdout:6/962: rename d2/dc/d27/d74/d75/fd8 to d2/d6d/db9/d12/f12d 0 2024-02-15T18:31:54.869 INFO:tasks.workunit.client.1.smithi131.stdout:0/932: sync 2024-02-15T18:31:54.873 INFO:tasks.workunit.client.1.smithi131.stdout:0/933: mknod d5/d2f/d4b/dd9/d10/d71/d92/df6/d114/c139 0 2024-02-15T18:31:54.876 INFO:tasks.workunit.client.1.smithi131.stdout:6/963: rmdir d2/dc/d27 39 2024-02-15T18:31:54.876 INFO:tasks.workunit.client.1.smithi131.stdout:6/964: dread - d2/dc/d1f/daa/f11f zero size 2024-02-15T18:31:54.876 INFO:tasks.workunit.client.1.smithi131.stdout:0/934: dread d5/d2f/d4b/dd9/d10/d73/f99 [0,4194304] 0 2024-02-15T18:31:54.881 INFO:tasks.workunit.client.1.smithi131.stdout:0/935: dread d5/d2f/d4b/dd9/d4d/fb6 [0,4194304] 0 2024-02-15T18:31:54.886 INFO:tasks.workunit.client.1.smithi131.stdout:0/936: mknod d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/c13a 0 2024-02-15T18:31:54.887 INFO:tasks.workunit.client.1.smithi131.stdout:0/937: read d5/fc0 [3885831,126517] 0 2024-02-15T18:31:54.888 INFO:tasks.workunit.client.1.smithi131.stdout:0/938: mknod d5/d2f/d4b/dd9/d4d/d128/c13b 0 2024-02-15T18:31:54.891 INFO:tasks.workunit.client.1.smithi131.stdout:0/939: link d5/d2f/d4b/dd9/d10/d71/ffd d5/d2f/d4b/d82/d9f/d120/f13c 0 2024-02-15T18:31:54.904 INFO:tasks.workunit.client.1.smithi131.stdout:6/965: dwrite d2/dc/d12a/f6f [0,4194304] 0 2024-02-15T18:31:54.906 INFO:tasks.workunit.client.1.smithi131.stdout:6/966: creat d2/d6d/db9/d48/d40/f12e x:0 0 0 2024-02-15T18:31:54.907 INFO:tasks.workunit.client.1.smithi131.stdout:6/967: mknod d2/d2b/c12f 0 2024-02-15T18:31:54.909 INFO:tasks.workunit.client.1.smithi131.stdout:6/968: rename d2/d6d/db9/da4 to d2/d6d/dbe/d130 0 2024-02-15T18:31:54.910 INFO:tasks.workunit.client.1.smithi131.stdout:0/940: dread d5/fa [0,4194304] 0 2024-02-15T18:31:54.911 INFO:tasks.workunit.client.1.smithi131.stdout:6/969: creat d2/d6d/db9/d12/d4d/ddb/f131 x:0 0 0 2024-02-15T18:31:54.911 INFO:tasks.workunit.client.1.smithi131.stdout:6/970: read - d2/d6d/db9/dca/fe6 zero size 2024-02-15T18:31:54.913 INFO:tasks.workunit.client.1.smithi131.stdout:0/941: symlink d5/d2f/d4b/dd9/d11/d3e/db8/l13d 0 2024-02-15T18:31:54.913 INFO:tasks.workunit.client.1.smithi131.stdout:6/971: link d2/dc/d27/d62/d97/ca9 d2/dc/d27/d62/db0/d112/c132 0 2024-02-15T18:31:54.917 INFO:tasks.workunit.client.1.smithi131.stdout:6/972: write d2/d79/f7a [4109382,25627] 0 2024-02-15T18:31:54.920 INFO:tasks.workunit.client.1.smithi131.stdout:6/973: creat d2/d79/dad/f133 x:0 0 0 2024-02-15T18:31:54.920 INFO:tasks.workunit.client.1.smithi131.stdout:6/974: symlink d2/dc/d27/d74/d75/dc0/l134 0 2024-02-15T18:31:54.920 INFO:tasks.workunit.client.1.smithi131.stdout:6/975: chown d2/d6d/fae 204 1 2024-02-15T18:31:54.922 INFO:tasks.workunit.client.1.smithi131.stdout:6/976: rename d2/dc/d27/d62/db0/c7b to d2/d6d/db9/d12/df6/c135 0 2024-02-15T18:31:54.923 INFO:tasks.workunit.client.1.smithi131.stdout:6/977: mkdir d2/d136 0 2024-02-15T18:31:54.924 INFO:tasks.workunit.client.1.smithi131.stdout:6/978: creat d2/f137 x:0 0 0 2024-02-15T18:31:54.924 INFO:tasks.workunit.client.1.smithi131.stdout:6/979: symlink d2/d6d/db9/d12/l138 0 2024-02-15T18:31:54.925 INFO:tasks.workunit.client.1.smithi131.stdout:6/980: truncate d2/d6d/db9/d48/f1c 488715 0 2024-02-15T18:31:54.927 INFO:tasks.workunit.client.1.smithi131.stdout:6/981: symlink d2/dc/d1f/dbc/db6/l139 0 2024-02-15T18:31:54.932 INFO:tasks.workunit.client.1.smithi131.stdout:0/942: dwrite d5/d2f/d4b/dd9/d11/f88 [4194304,4194304] 0 2024-02-15T18:31:54.934 INFO:tasks.workunit.client.1.smithi131.stdout:0/943: symlink d5/d2f/d4b/dd9/d10/d73/d11a/l13e 0 2024-02-15T18:31:54.935 INFO:tasks.workunit.client.1.smithi131.stdout:0/944: write d5/d2f/d4b/dd9/d10/d3f/f61 [1105814,28824] 0 2024-02-15T18:31:54.935 INFO:tasks.workunit.client.1.smithi131.stdout:6/982: rename d2/dc/d27/d62/db0/d112 to d2/dc/d1f/dbc/de0/df4/d13a 0 2024-02-15T18:31:54.936 INFO:tasks.workunit.client.1.smithi131.stdout:0/945: mkdir d5/d2f/d4b/dd9/d77/d10a/d13f 0 2024-02-15T18:31:54.940 INFO:tasks.workunit.client.1.smithi131.stdout:0/946: getdents d5/d2f/d4b/dd9/d10/d71/d92/df6 0 2024-02-15T18:31:54.941 INFO:tasks.workunit.client.1.smithi131.stdout:0/947: read d5/d2f/d4b/dd9/d10/d3f/f47 [639724,101661] 0 2024-02-15T18:31:54.946 INFO:tasks.workunit.client.1.smithi131.stdout:0/948: write f0 [5736353,112370] 0 2024-02-15T18:31:55.006 INFO:tasks.workunit.client.1.smithi131.stdout:0/949: write d5/d15/d1f/f57 [4482176,86057] 0 2024-02-15T18:31:55.008 INFO:tasks.workunit.client.1.smithi131.stdout:0/950: mkdir d5/d2f/d4b/d140 0 2024-02-15T18:31:55.008 INFO:tasks.workunit.client.1.smithi131.stdout:0/951: dread - d5/d2f/d4b/dd9/d10/d73/fe8 zero size 2024-02-15T18:31:56.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:55.454516+0000 mgr.smithi033.apxevf (mgr.14626) 23 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 31 MiB/s rd, 66 MiB/s wr, 412 op/s 2024-02-15T18:31:56.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:55.454516+0000 mgr.smithi033.apxevf (mgr.14626) 23 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 31 MiB/s rd, 66 MiB/s wr, 412 op/s 2024-02-15T18:31:58.660 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:57.454882+0000 mgr.smithi033.apxevf (mgr.14626) 24 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 13 MiB/s rd, 31 MiB/s wr, 314 op/s 2024-02-15T18:31:58.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:57.454882+0000 mgr.smithi033.apxevf (mgr.14626) 24 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 13 MiB/s rd, 31 MiB/s wr, 314 op/s 2024-02-15T18:31:59.040 INFO:tasks.workunit.client.1.smithi131.stdout:6/983: sync 2024-02-15T18:31:59.041 INFO:tasks.workunit.client.1.smithi131.stdout:0/952: sync 2024-02-15T18:31:59.041 INFO:tasks.workunit.client.1.smithi131.stdout:0/953: chown d5/d2f/d4b/dd9/d11/l3c 0 1 2024-02-15T18:31:59.047 INFO:tasks.workunit.client.1.smithi131.stdout:0/954: symlink d5/d2f/d4b/dd9/d10/d71/d92/df6/d114/l141 0 2024-02-15T18:31:59.047 INFO:tasks.workunit.client.1.smithi131.stdout:0/955: readlink d5/d2f/d4b/dd9/d11/le5 0 2024-02-15T18:31:59.047 INFO:tasks.workunit.client.1.smithi131.stdout:0/956: write d5/d2f/f78 [543993,12345] 0 2024-02-15T18:31:59.047 INFO:tasks.workunit.client.1.smithi131.stdout:0/957: chown d5/d2f/d4b/l7a 852 1 2024-02-15T18:31:59.050 INFO:tasks.workunit.client.1.smithi131.stdout:0/958: mknod d5/d2f/d4b/dd9/c142 0 2024-02-15T18:31:59.082 INFO:tasks.workunit.client.1.smithi131.stdout:0/959: dwrite d5/d2f/d45/d8c/f12e [0,4194304] 0 2024-02-15T18:31:59.082 INFO:tasks.workunit.client.1.smithi131.stdout:0/960: write d5/f4c [449061,58959] 0 2024-02-15T18:31:59.096 INFO:tasks.workunit.client.1.smithi131.stdout:6/984: unlink d2/dc/d27/d62/d97/f109 0 2024-02-15T18:31:59.096 INFO:tasks.workunit.client.1.smithi131.stdout:6/985: truncate d2/dc/d27/d62/db0/f5a 476125 0 2024-02-15T18:31:59.096 INFO:tasks.workunit.client.1.smithi131.stdout:6/986: fdatasync d2/d79/f7a 0 2024-02-15T18:31:59.101 INFO:tasks.workunit.client.1.smithi131.stdout:6/987: rename d2/dc/d27/d62/db0/l3e to d2/d79/dad/dcc/l13b 0 2024-02-15T18:31:59.104 INFO:tasks.workunit.client.1.smithi131.stdout:0/961: dread d5/d2f/f78 [0,4194304] 0 2024-02-15T18:31:59.109 INFO:tasks.workunit.client.1.smithi131.stdout:6/988: dread d2/dc/f22 [0,4194304] 0 2024-02-15T18:31:59.112 INFO:tasks.workunit.client.1.smithi131.stdout:6/989: read d2/dc/d12a/f47 [2198467,117758] 0 2024-02-15T18:31:59.112 INFO:tasks.workunit.client.1.smithi131.stdout:6/990: fdatasync d2/dc/d27/d78/f99 0 2024-02-15T18:31:59.139 INFO:tasks.workunit.client.1.smithi131.stdout:6/991: dwrite d2/dc/d27/d62/faf [0,4194304] 0 2024-02-15T18:31:59.139 INFO:tasks.workunit.client.1.smithi131.stdout:0/962: dwrite d5/d2f/d4b/dd9/d10/f8d [0,4194304] 0 2024-02-15T18:31:59.153 INFO:tasks.workunit.client.1.smithi131.stdout:0/963: mknod d5/d2f/d4b/dd9/d77/d10a/c143 0 2024-02-15T18:31:59.154 INFO:tasks.workunit.client.1.smithi131.stdout:0/964: creat d5/d2f/d4b/dd9/d10/d73/f144 x:0 0 0 2024-02-15T18:31:59.166 INFO:tasks.workunit.client.1.smithi131.stdout:6/992: dwrite d2/dc/d27/d78/f87 [0,4194304] 0 2024-02-15T18:31:59.170 INFO:tasks.workunit.client.1.smithi131.stdout:6/993: creat d2/dc/d27/d62/d8f/f13c x:0 0 0 2024-02-15T18:31:59.170 INFO:tasks.workunit.client.1.smithi131.stdout:6/994: readlink d2/d6d/db9/d12/d4d/lac 0 2024-02-15T18:31:59.172 INFO:tasks.workunit.client.1.smithi131.stdout:6/995: rename d2/dc/d27/l84 to d2/dc/d27/d74/dee/l13d 0 2024-02-15T18:31:59.172 INFO:tasks.workunit.client.1.smithi131.stdout:6/996: getdents d2/d79 0 2024-02-15T18:31:59.173 INFO:tasks.workunit.client.1.smithi131.stdout:6/997: chown d2/dc/d27/d62/d8f 1280418322 1 2024-02-15T18:31:59.173 INFO:tasks.workunit.client.1.smithi131.stdout:6/998: chown d2/dc/d27/d78/f87 24438904 1 2024-02-15T18:31:59.174 INFO:tasks.workunit.client.1.smithi131.stdout:6/999: mkdir d2/dc/d12a/ded/d13e 0 2024-02-15T18:31:59.183 INFO:tasks.workunit.client.1.smithi131.stdout:0/965: dwrite d5/d2f/d4b/dd9/d10/f8d [0,4194304] 0 2024-02-15T18:31:59.186 INFO:tasks.workunit.client.1.smithi131.stdout:0/966: rename d5/d2f/d4b/dd9/d11/d3e/fe2 to d5/d2f/d45/f145 0 2024-02-15T18:31:59.213 INFO:tasks.workunit.client.1.smithi131.stdout:0/967: dwrite d5/d2f/f76 [0,4194304] 0 2024-02-15T18:31:59.213 INFO:tasks.workunit.client.1.smithi131.stdout:0/968: stat d5/d2f 0 2024-02-15T18:31:59.213 INFO:tasks.workunit.client.1.smithi131.stdout:0/969: stat d5/d2f/d45/d8c/f12e 0 2024-02-15T18:31:59.213 INFO:tasks.workunit.client.1.smithi131.stdout:0/970: chown d5/d2f/d4b/le3 12278 1 2024-02-15T18:31:59.234 INFO:tasks.workunit.client.1.smithi131.stdout:0/971: dwrite d5/d2f/f84 [0,4194304] 0 2024-02-15T18:31:59.281 INFO:tasks.workunit.client.1.smithi131.stdout:0/972: truncate f4 2184575 0 2024-02-15T18:31:59.303 INFO:tasks.workunit.client.1.smithi131.stdout:0/973: creat d5/d2f/d45/f146 x:0 0 0 2024-02-15T18:31:59.315 INFO:tasks.workunit.client.1.smithi131.stdout:0/974: write d5/d15/d1f/fea [7346007,20824] 0 2024-02-15T18:31:59.318 INFO:tasks.workunit.client.1.smithi131.stdout:0/975: dread d5/d2f/d4b/dd9/d10/db7/fbb [0,4194304] 0 2024-02-15T18:31:59.637 INFO:tasks.workunit.client.1.smithi131.stdout:0/976: rmdir d5/d2f/d4b/dd9/d77 39 2024-02-15T18:31:59.637 INFO:tasks.workunit.client.1.smithi131.stdout:0/977: truncate d5/d2f/d4b/dd9/d77/da8/dad/dd7/dee/df1/f101 676792 0 2024-02-15T18:31:59.642 INFO:tasks.workunit.client.1.smithi131.stdout:0/978: mknod d5/d15/d1f/df5/c147 0 2024-02-15T18:31:59.642 INFO:tasks.workunit.client.1.smithi131.stdout:0/979: dread - d5/d2f/d4b/dd9/d4d/f109 zero size 2024-02-15T18:31:59.651 INFO:tasks.workunit.client.1.smithi131.stdout:0/980: dread d5/d2f/d4b/dd9/d10/d3f/f61 [0,4194304] 0 2024-02-15T18:31:59.651 INFO:tasks.workunit.client.1.smithi131.stdout:0/981: read - d5/d2f/d4b/d82/f117 zero size 2024-02-15T18:31:59.663 INFO:tasks.workunit.client.1.smithi131.stdout:0/982: unlink d5/d2f/d4b/dd9/d77/d8b/c103 0 2024-02-15T18:31:59.684 INFO:tasks.workunit.client.1.smithi131.stdout:0/983: rename d5/d2f/d4b/dd9/d77/da8 to d5/d2f/d4b/dd9/d10/db7/d148 0 2024-02-15T18:31:59.686 INFO:tasks.workunit.client.1.smithi131.stdout:0/984: read d5/d2f/d45/d8c/fc4 [3904311,33955] 0 2024-02-15T18:31:59.687 INFO:tasks.workunit.client.1.smithi131.stdout:0/985: truncate d5/d15/d1f/f57 835742 0 2024-02-15T18:31:59.690 INFO:tasks.workunit.client.1.smithi131.stdout:0/986: mknod d5/d2f/d4b/dd9/d11/d3e/c149 0 2024-02-15T18:31:59.690 INFO:tasks.workunit.client.1.smithi131.stdout:0/987: dread - d5/d2f/d4b/d82/d9f/f116 zero size 2024-02-15T18:31:59.694 INFO:tasks.workunit.client.1.smithi131.stdout:0/988: rename d5/d2f/d4b/dd9/d10/db7/fce to d5/d2f/d4b/d82/d9f/d120/f14a 0 2024-02-15T18:31:59.703 INFO:tasks.workunit.client.1.smithi131.stdout:0/989: mknod d5/d2f/d4b/dd9/d4d/d128/c14b 0 2024-02-15T18:31:59.704 INFO:tasks.workunit.client.1.smithi131.stdout:0/990: write d5/d2f/d4b/dd9/ff [2739647,28416] 0 2024-02-15T18:31:59.714 INFO:tasks.workunit.client.1.smithi131.stdout:0/991: dread d5/d2f/d4b/dd9/d10/d71/d92/df6/fe4 [0,4194304] 0 2024-02-15T18:31:59.716 INFO:tasks.workunit.client.1.smithi131.stdout:0/992: creat d5/d2f/d4b/d82/d9f/f14c x:0 0 0 2024-02-15T18:31:59.717 INFO:tasks.workunit.client.1.smithi131.stdout:0/993: truncate d5/fa 2932359 0 2024-02-15T18:31:59.720 INFO:tasks.workunit.client.1.smithi131.stdout:0/994: unlink d5/d2f/d4b/dd9/c16 0 2024-02-15T18:31:59.720 INFO:tasks.workunit.client.1.smithi131.stdout:0/995: truncate d5/d2f/d4b/dd9/d11/d3e/f59 1160943 0 2024-02-15T18:31:59.720 INFO:tasks.workunit.client.1.smithi131.stdout:0/996: readlink d5/d2f/d4b/d82/ldc 0 2024-02-15T18:31:59.721 INFO:tasks.workunit.client.1.smithi131.stdout:0/997: fdatasync d5/d2f/d4b/dd9/d10/d71/d92/df6/f113 0 2024-02-15T18:31:59.721 INFO:tasks.workunit.client.1.smithi131.stdout:0/998: chown d5/d2f/d4b/d82/d9f/la3 1323534557 1 2024-02-15T18:31:59.721 INFO:tasks.workunit.client.1.smithi131.stdout:0/999: write d5/d2f/d4b/dd9/d10/d3f/f61 [3823979,56154] 0 2024-02-15T18:31:59.725 INFO:tasks.workunit.client.1.smithi131.stderr:+ rm -rf -- ./tmp.I3dcBQJZUq 2024-02-15T18:31:59.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:58.563762+0000 mon.smithi033 (mon.0) 684 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:31:59.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:31:58.564504+0000 mon.smithi033 (mon.0) 685 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:31:59.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:31:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:31:59.455337+0000 mgr.smithi033.apxevf (mgr.14626) 25 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 21 MiB/s rd, 45 MiB/s wr, 459 op/s 2024-02-15T18:32:00.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:58.563762+0000 mon.smithi033 (mon.0) 684 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:00.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:31:58.564504+0000 mon.smithi033 (mon.0) 685 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:00.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:31:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:31:59.455337+0000 mgr.smithi033.apxevf (mgr.14626) 25 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 21 MiB/s rd, 45 MiB/s wr, 459 op/s 2024-02-15T18:32:02.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:32:01.455727+0000 mgr.smithi033.apxevf (mgr.14626) 26 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 28 MiB/s wr, 313 op/s 2024-02-15T18:32:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:01.455727+0000 mgr.smithi033.apxevf (mgr.14626) 26 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 28 MiB/s wr, 313 op/s 2024-02-15T18:32:04.411 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.145328+0000 mon.smithi033 (mon.0) 686 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:04.411 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.146068+0000 mon.smithi033 (mon.0) 687 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:04.411 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.146719+0000 mon.smithi033 (mon.0) 688 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:32:03.147298+0000 mgr.smithi033.apxevf (mgr.14626) 27 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.152528+0000 mon.smithi033 (mon.0) 689 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.158217+0000 mon.smithi033 (mon.0) 690 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.160583+0000 mon.smithi033 (mon.0) 691 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:32:03.161192+0000 mgr.smithi033.apxevf (mgr.14626) 28 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.164882+0000 mon.smithi033 (mon.0) 692 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.165473+0000 mon.smithi033 (mon.0) 693 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.apxevf"}]: dispatch 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.170570+0000 mon.smithi033 (mon.0) 694 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.apxevf"}]': finished 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.171213+0000 mon.smithi033 (mon.0) 695 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi131.buibla"}]: dispatch 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.176172+0000 mon.smithi033 (mon.0) 696 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi131.buibla"}]': finished 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:03.177333+0000 mon.smithi033 (mon.0) 697 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T18:32:04.412 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:03.456192+0000 mgr.smithi033.apxevf (mgr.14626) 29 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 28 MiB/s wr, 313 op/s 2024-02-15T18:32:04.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.145328+0000 mon.smithi033 (mon.0) 686 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.146068+0000 mon.smithi033 (mon.0) 687 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.146719+0000 mon.smithi033 (mon.0) 688 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:32:03.147298+0000 mgr.smithi033.apxevf (mgr.14626) 27 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.152528+0000 mon.smithi033 (mon.0) 689 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.158217+0000 mon.smithi033 (mon.0) 690 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.160583+0000 mon.smithi033 (mon.0) 691 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:32:03.161192+0000 mgr.smithi033.apxevf (mgr.14626) 28 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.164882+0000 mon.smithi033 (mon.0) 692 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.165473+0000 mon.smithi033 (mon.0) 693 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.apxevf"}]: dispatch 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.170570+0000 mon.smithi033 (mon.0) 694 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.apxevf"}]': finished 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.171213+0000 mon.smithi033 (mon.0) 695 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi131.buibla"}]: dispatch 2024-02-15T18:32:04.550 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.176172+0000 mon.smithi033 (mon.0) 696 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi131.buibla"}]': finished 2024-02-15T18:32:04.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:03.177333+0000 mon.smithi033 (mon.0) 697 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T18:32:04.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:32:03.456192+0000 mgr.smithi033.apxevf (mgr.14626) 29 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 28 MiB/s wr, 313 op/s 2024-02-15T18:32:06.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:32:05.041309+0000 mgr.smithi033.apxevf (mgr.14626) 30 : cephadm [INF] Upgrade: Updating mon.smithi033 2024-02-15T18:32:06.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:05.045515+0000 mon.smithi033 (mon.0) 698 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:06.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:05.046349+0000 mon.smithi033 (mon.0) 699 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:32:06.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:05.046981+0000 mon.smithi033 (mon.0) 700 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:32:06.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:05.047559+0000 mon.smithi033 (mon.0) 701 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:06.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cephadm 2024-02-15T18:32:05.048106+0000 mgr.smithi033.apxevf (mgr.14626) 31 : cephadm [INF] Deploying daemon mon.smithi033 on smithi033 2024-02-15T18:32:06.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:32:05.456920+0000 mgr.smithi033.apxevf (mgr.14626) 32 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 14 MiB/s rd, 31 MiB/s wr, 455 op/s 2024-02-15T18:32:06.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:32:05.771216+0000 mon.smithi033 (mon.0) 702 : cluster [DBG] Standby manager daemon smithi131.buibla restarted 2024-02-15T18:32:06.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:32:05.771319+0000 mon.smithi033 (mon.0) 703 : cluster [DBG] Standby manager daemon smithi131.buibla started 2024-02-15T18:32:06.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:05.774207+0000 mon.smithi033 (mon.0) 704 : audit [DBG] from='mgr.? 172.21.15.131:0/4120781858' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/crt"}]: dispatch 2024-02-15T18:32:06.300 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:05.774618+0000 mon.smithi033 (mon.0) 705 : audit [DBG] from='mgr.? 172.21.15.131:0/4120781858' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:32:06.300 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:05.777547+0000 mon.smithi033 (mon.0) 706 : audit [DBG] from='mgr.? 172.21.15.131:0/4120781858' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/key"}]: dispatch 2024-02-15T18:32:06.300 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: audit 2024-02-15T18:32:05.779179+0000 mon.smithi033 (mon.0) 707 : audit [DBG] from='mgr.? 172.21.15.131:0/4120781858' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:32:05.041309+0000 mgr.smithi033.apxevf (mgr.14626) 30 : cephadm [INF] Upgrade: Updating mon.smithi033 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:05.045515+0000 mon.smithi033 (mon.0) 698 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:05.046349+0000 mon.smithi033 (mon.0) 699 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:05.046981+0000 mon.smithi033 (mon.0) 700 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:05.047559+0000 mon.smithi033 (mon.0) 701 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:32:05.048106+0000 mgr.smithi033.apxevf (mgr.14626) 31 : cephadm [INF] Deploying daemon mon.smithi033 on smithi033 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:05.456920+0000 mgr.smithi033.apxevf (mgr.14626) 32 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 14 MiB/s rd, 31 MiB/s wr, 455 op/s 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:05.771216+0000 mon.smithi033 (mon.0) 702 : cluster [DBG] Standby manager daemon smithi131.buibla restarted 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:05.771319+0000 mon.smithi033 (mon.0) 703 : cluster [DBG] Standby manager daemon smithi131.buibla started 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:05.774207+0000 mon.smithi033 (mon.0) 704 : audit [DBG] from='mgr.? 172.21.15.131:0/4120781858' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/crt"}]: dispatch 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:05.774618+0000 mon.smithi033 (mon.0) 705 : audit [DBG] from='mgr.? 172.21.15.131:0/4120781858' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-15T18:32:06.500 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:05.777547+0000 mon.smithi033 (mon.0) 706 : audit [DBG] from='mgr.? 172.21.15.131:0/4120781858' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.buibla/key"}]: dispatch 2024-02-15T18:32:06.501 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:05.779179+0000 mon.smithi033 (mon.0) 707 : audit [DBG] from='mgr.? 172.21.15.131:0/4120781858' entity='mgr.smithi131.buibla' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-15T18:32:07.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:06 smithi033 systemd[1]: Stopping Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:32:07.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: cluster 2024-02-15T18:32:06.053197+0000 mon.smithi033 (mon.0) 708 : cluster [DBG] mgrmap e28: smithi033.apxevf(active, since 39s), standbys: smithi131.buibla 2024-02-15T18:32:07.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:32:07.068+0000 7fd5a71a9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi033 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:32:07.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033[38126]: debug 2024-02-15T18:32:07.068+0000 7fd5a71a9700 -1 mon.smithi033@0(leader) e2 *** Got Signal Terminated *** 2024-02-15T18:32:07.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:06.053197+0000 mon.smithi033 (mon.0) 708 : cluster [DBG] mgrmap e28: smithi033.apxevf(active, since 39s), standbys: smithi131.buibla 2024-02-15T18:32:07.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:07 smithi033 bash[77350]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033 2024-02-15T18:32:08.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:08 smithi033 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033.service: Succeeded. 2024-02-15T18:32:08.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:08 smithi033 systemd[1]: Stopped Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:32:08.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:08 smithi033 systemd[1]: Starting Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:32:09.551 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.088+0000 7ff989ed5880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-15T18:32:09.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.088+0000 7ff989ed5880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-15T18:32:09.579 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.088+0000 7ff989ed5880 0 pidfile_write: ignore empty --pid-file 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.092+0000 7ff989ed5880 0 load: jerasure load: lrc load: isa 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: RocksDB version: 6.8.1 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Compile date Feb 8 2024 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: DB SUMMARY 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: CURRENT file: CURRENT 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 771 Bytes 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi033/store.db dir, Total Num: 1, files: 000020.sst 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi033/store.db: 000018.log size: 895701 ; 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.error_if_exists: 0 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.create_if_missing: 0 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.paranoid_checks: 1 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.env: 0x555a82132080 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.fs: Posix File System 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.info_log: 0x555a841b2560 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.statistics: (nil) 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.use_fsync: 0 2024-02-15T18:32:09.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_log_file_size: 0 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.allow_fallocate: 1 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.use_direct_reads: 0 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.db_log_dir: 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi033/store.db 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T18:32:09.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_subcompactions: 1 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_background_flushes: -1 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.write_buffer_manager: 0x555a84ea4420 2024-02-15T18:32:09.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.unordered_write: 0 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T18:32:09.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.row_cache: None 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.wal_filter: None 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.preserve_deletes: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.two_write_queues: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.atomic_flush: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.log_readahead_size: 0 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-15T18:32:09.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_background_jobs: 2 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_background_compactions: -1 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_open_files: -1 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T18:32:09.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Compression algorithms supported: 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: kZSTD supported: 0 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: kXpressCompression supported: 0 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: kLZ4Compression supported: 1 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: kBZip2Compression supported: 0 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: kZlibCompression supported: 1 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: kSnappyCompression supported: 1 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000008 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-15T18:32:09.587 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.merge_operator: 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_filter: None 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555a84157d28) 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cache_index_and_filter_blocks: 1 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: pin_top_level_index_and_filter: 1 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: index_type: 0 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: data_block_index_type: 0 2024-02-15T18:32:09.588 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: index_shortening: 1 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: data_block_hash_table_util_ratio: 0.750000 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: hash_index_allow_collision: 1 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: checksum: 1 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: no_block_cache: 0 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: block_cache: 0x555a8418cf10 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: block_cache_name: BinnedLRUCache 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: block_cache_options: 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: capacity : 536870912 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: num_shard_bits : 4 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: strict_capacity_limit : 0 2024-02-15T18:32:09.589 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: high_pri_pool_ratio: 0.000 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: block_cache_compressed: (nil) 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: persistent_cache: (nil) 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: block_size: 4096 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: block_size_deviation: 10 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: block_restart_interval: 16 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: index_block_restart_interval: 1 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: metadata_block_size: 4096 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: partition_filters: 0 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: use_delta_encoding: 1 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T18:32:09.590 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: whole_key_filtering: 1 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: verify_compression: 0 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: read_amp_bytes_per_bit: 0 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: format_version: 2 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: enable_index_compression: 1 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: block_align: 0 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compression: NoCompression 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.num_levels: 7 2024-02-15T18:32:09.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:32:09.592 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T18:32:09.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T18:32:09.594 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.table_properties_collectors: 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.inplace_update_support: 0 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.bloom_locality: 0 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.max_successive_merges: 0 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-15T18:32:09.595 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-15T18:32:09.596 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.ttl: 2592000 2024-02-15T18:32:09.596 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.093+0000 7ff989ed5880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T18:32:09.596 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.094+0000 7ff989ed5880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.094+0000 7ff989ed5880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 22, last_sequence is 9216, log_number is 18,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.094+0000 7ff989ed5880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 18 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.094+0000 7ff989ed5880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021929095239, "job": 1, "event": "recovery_started", "log_files": [18]} 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.094+0000 7ff989ed5880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #18 mode 2 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.095+0000 7ff989ed5880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.097+0000 7ff989ed5880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021929098290, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 22, "file_size": 883842, "table_properties": {"data_size": 881512, "index_size": 1192, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 325, "raw_key_size": 2274, "raw_average_key_size": 25, "raw_value_size": 878966, "raw_average_value_size": 9876, "num_data_blocks": 38, "num_entries": 89, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708021929, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.097+0000 7ff989ed5880 4 rocksdb: [version_set.cc:3826] Creating manifest 23 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.097+0000 7ff989ed5880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.098+0000 7ff989ed5880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021929098717, "job": 1, "event": "recovery_finished"} 2024-02-15T18:32:09.597 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.098+0000 7ff989ed5880 4 rocksdb: DB pointer 0x555a84255800 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.099+0000 7ff970cc6700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.099+0000 7ff970cc6700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ** DB Stats ** 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ** Compaction Stats [default] ** 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: L0 1/0 863.13 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 415.6 0.00 0.00 1 0.002 0 0 2024-02-15T18:32:09.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: L6 1/0 21.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Sum 2/0 22.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 415.6 0.00 0.00 1 0.002 0 0 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 415.6 0.00 0.00 1 0.002 0 0 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ** Compaction Stats [default] ** 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 415.6 0.00 0.00 1 0.002 0 0 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Flush(GB): cumulative 0.001, interval 0.001 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:32:09.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Cumulative compaction: 0.00 GB write, 162.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Interval compaction: 0.00 GB write, 162.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ** Compaction Stats [default] ** 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: L0 1/0 863.13 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 415.6 0.00 0.00 1 0.002 0 0 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: L6 1/0 21.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Sum 2/0 22.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 415.6 0.00 0.00 1 0.002 0 0 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:32:09.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ** Compaction Stats [default] ** 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 415.6 0.00 0.00 1 0.002 0 0 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Flush(GB): cumulative 0.001, interval 0.000 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Cumulative compaction: 0.00 GB write, 160.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:32:09.601 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.099+0000 7ff989ed5880 0 starting mon.smithi033 rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi033 fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.100+0000 7ff989ed5880 1 mon.smithi033@-1(???) e2 preinit fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.100+0000 7ff989ed5880 0 mon.smithi033@-1(???).mds e19 new map 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.100+0000 7ff989ed5880 0 mon.smithi033@-1(???).mds e19 print_map 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: e19 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: legacy client fscid: 1 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Filesystem 'cephfs' (1) 2024-02-15T18:32:09.602 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: fs_name cephfs 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: epoch 19 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: flags 12 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: modified 2024-02-15T18:31:16.192509+0000 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: tableserver 0 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: root 0 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: session_timeout 60 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: session_autoclose 300 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: max_file_size 1099511627776 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: required_client_features {} 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: last_failure 0 2024-02-15T18:32:09.603 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: last_failure_osd_epoch 0 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: max_mds 2 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: in 0,1 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: up {0=24255,1=24271} 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: failed 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: damaged 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: stopped 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: data_pools [3] 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: metadata_pool 2 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: inline_data enabled 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: balancer 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: standby_count_wanted 1 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: [mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:09.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: [mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: Standby daemons: 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: [mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: [mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.100+0000 7ff989ed5880 0 mon.smithi033@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.100+0000 7ff989ed5880 0 mon.smithi033@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.100+0000 7ff989ed5880 0 mon.smithi033@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.100+0000 7ff989ed5880 0 mon.smithi033@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:06.053197+0000 mon.smithi033 (mon.0) 708 : cluster [DBG] mgrmap e28: smithi033.apxevf(active, since 39s), standbys: smithi131.buibla 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:32:09.101+0000 7ff989ed5880 1 mon.smithi033@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 bash[77529]: 4a968e2a086ed21e58e30be006eb4aa7253b8491cabb5f146d5347bf0654e9ca 2024-02-15T18:32:09.605 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:09 smithi033 systemd[1]: Started Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:07.075656+0000 mon.smithi131 (mon.1) 59 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:07.075914+0000 mon.smithi131 (mon.1) 60 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:07.457254+0000 mgr.smithi033.apxevf (mgr.14626) 33 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 9.2 MiB/s rd, 17 MiB/s wr, 287 op/s 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:09.457815+0000 mgr.smithi033.apxevf (mgr.14626) 34 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 9.3 MiB/s rd, 17 MiB/s wr, 428 op/s 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.514598+0000 mon.smithi033 (mon.0) 1 : cluster [INF] mon.smithi033 calling monitor election 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.520727+0000 mon.smithi033 (mon.0) 2 : cluster [INF] mon.smithi033 is new leader, mons smithi033,smithi131 in quorum (ranks 0,1) 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.530054+0000 mon.smithi033 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi131=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.530797+0000 mon.smithi033 (mon.0) 4 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.530843+0000 mon.smithi033 (mon.0) 5 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.534019+0000 mon.smithi033 (mon.0) 6 : cluster [DBG] mgrmap e28: smithi033.apxevf(active, since 43s), standbys: smithi131.buibla 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.546242+0000 mon.smithi033 (mon.0) 7 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-15T18:32:10.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.546264+0000 mon.smithi033 (mon.0) 8 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-15T18:32:11.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.546277+0000 mon.smithi033 (mon.0) 9 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2024-02-15T18:32:11.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:10.546685+0000 mon.smithi033 (mon.0) 10 : audit [INF] from='mgr.14626 ' entity='' 2024-02-15T18:32:11.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:10.551910+0000 mon.smithi131 (mon.1) 61 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:11.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:07.075656+0000 mon.smithi131 (mon.1) 59 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2024-02-15T18:32:11.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:07.075914+0000 mon.smithi131 (mon.1) 60 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-02-15T18:32:11.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:07.457254+0000 mgr.smithi033.apxevf (mgr.14626) 33 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 9.2 MiB/s rd, 17 MiB/s wr, 287 op/s 2024-02-15T18:32:11.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:09.457815+0000 mgr.smithi033.apxevf (mgr.14626) 34 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 9.3 MiB/s rd, 17 MiB/s wr, 428 op/s 2024-02-15T18:32:11.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.514598+0000 mon.smithi033 (mon.0) 1 : cluster [INF] mon.smithi033 calling monitor election 2024-02-15T18:32:11.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.520727+0000 mon.smithi033 (mon.0) 2 : cluster [INF] mon.smithi033 is new leader, mons smithi033,smithi131 in quorum (ranks 0,1) 2024-02-15T18:32:11.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.530054+0000 mon.smithi033 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi131=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2024-02-15T18:32:11.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.530797+0000 mon.smithi033 (mon.0) 4 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:32:11.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.530843+0000 mon.smithi033 (mon.0) 5 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2024-02-15T18:32:11.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.534019+0000 mon.smithi033 (mon.0) 6 : cluster [DBG] mgrmap e28: smithi033.apxevf(active, since 43s), standbys: smithi131.buibla 2024-02-15T18:32:11.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.546242+0000 mon.smithi033 (mon.0) 7 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-15T18:32:11.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.546264+0000 mon.smithi033 (mon.0) 8 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-15T18:32:11.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.546277+0000 mon.smithi033 (mon.0) 9 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2024-02-15T18:32:11.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:10.546685+0000 mon.smithi033 (mon.0) 10 : audit [INF] from='mgr.14626 ' entity='' 2024-02-15T18:32:11.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:10.551910+0000 mon.smithi131 (mon.1) 61 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:11.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:10.599956+0000 mon.smithi033 (mon.0) 11 : cluster [DBG] mgrmap e29: smithi033.apxevf(active, since 43s), standbys: smithi131.buibla 2024-02-15T18:32:11.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:11.458243+0000 mgr.smithi033.apxevf (mgr.14626) 35 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-02-15T18:32:12.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:10.599956+0000 mon.smithi033 (mon.0) 11 : cluster [DBG] mgrmap e29: smithi033.apxevf(active, since 43s), standbys: smithi131.buibla 2024-02-15T18:32:12.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:11.458243+0000 mgr.smithi033.apxevf (mgr.14626) 35 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-02-15T18:32:13.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.194+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3708353370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f6860 msgr2=0x7f81b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.194+0000 7f81b9fc0700 1 --2- 172.21.15.33:0/3708353370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f6860 0x7f81b40f6cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f81a8004660 tx=0x7f81a8009b30).stop 2024-02-15T18:32:13.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.194+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3708353370 shutdown_connections 2024-02-15T18:32:13.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.194+0000 7f81b9fc0700 1 --2- 172.21.15.33:0/3708353370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f6860 0x7f81b40f6cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.194+0000 7f81b9fc0700 1 --2- 172.21.15.33:0/3708353370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b40f55c0 0x7f81b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.194+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3708353370 >> 172.21.15.33:0/3708353370 conn(0x7f81b40f0d40 msgr2=0x7f81b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:13.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.194+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3708353370 shutdown_connections 2024-02-15T18:32:13.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.194+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3708353370 wait complete. 2024-02-15T18:32:13.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b9fc0700 1 Processor -- start 2024-02-15T18:32:13.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b9fc0700 1 -- start start 2024-02-15T18:32:13.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b9fc0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f55c0 0x7f81b4109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:13.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b9fc0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b40f6860 0x7f81b410c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:13.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b9fc0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40603e0 con 0x7f81b40f55c0 2024-02-15T18:32:13.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b9fc0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b4060520 con 0x7f81b40f6860 2024-02-15T18:32:13.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f55c0 0x7f81b4109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:13.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f55c0 0x7f81b4109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47832/0 (socket says 172.21.15.33:47832) 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b37fe700 1 -- 172.21.15.33:0/3570513719 learned_addr learned my addr 172.21.15.33:0/3570513719 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.195+0000 7f81b2ffd700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b40f6860 0x7f81b410c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.196+0000 7f81b37fe700 1 -- 172.21.15.33:0/3570513719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b40f6860 msgr2=0x7f81b410c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.196+0000 7f81b37fe700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b40f6860 0x7f81b410c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.196+0000 7f81b37fe700 1 -- 172.21.15.33:0/3570513719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8005040 con 0x7f81b40f55c0 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.196+0000 7f81b37fe700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f55c0 0x7f81b4109cb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f81a400e7c0 tx=0x7f81a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.196+0000 7f819bfff700 1 -- 172.21.15.33:0/3570513719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a40092e0 con 0x7f81b40f55c0 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.196+0000 7f819bfff700 1 -- 172.21.15.33:0/3570513719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f81a400f040 con 0x7f81b40f55c0 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.196+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b410c760 con 0x7f81b40f55c0 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.196+0000 7f819bfff700 1 -- 172.21.15.33:0/3570513719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a4014920 con 0x7f81b40f55c0 2024-02-15T18:32:13.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.196+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b410cd20 con 0x7f81b40f55c0 2024-02-15T18:32:13.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.197+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b4045ad0 con 0x7f81b40f55c0 2024-02-15T18:32:13.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.197+0000 7f819bfff700 1 -- 172.21.15.33:0/3570513719 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f81a401b030 con 0x7f81b40f55c0 2024-02-15T18:32:13.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.198+0000 7f819bfff700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f819c060fb0 0x7f819c063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:13.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.198+0000 7f819bfff700 1 -- 172.21.15.33:0/3570513719 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f81a407c080 con 0x7f81b40f55c0 2024-02-15T18:32:13.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.198+0000 7f81b2ffd700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f819c060fb0 0x7f819c063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:13.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.198+0000 7f81b2ffd700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f819c060fb0 0x7f819c063470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f81a8009720 tx=0x7f81a8016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:13.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.202+0000 7f819bfff700 1 -- 172.21.15.33:0/3570513719 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f81a404c470 con 0x7f81b40f55c0 2024-02-15T18:32:13.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.424+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81b40fdfa0 con 0x7f819c060fb0 2024-02-15T18:32:13.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.426+0000 7f819bfff700 1 -- 172.21.15.33:0/3570513719 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f81b40fdfa0 con 0x7f819c060fb0 2024-02-15T18:32:13.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f819c060fb0 msgr2=0x7f819c063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f819c060fb0 0x7f819c063470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f81a8009720 tx=0x7f81a8016040).stop 2024-02-15T18:32:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f55c0 msgr2=0x7f81b4109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f55c0 0x7f81b4109cb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f81a400e7c0 tx=0x7f81a400b040).stop 2024-02-15T18:32:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 shutdown_connections 2024-02-15T18:32:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f819c060fb0 0x7f819c063470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b40f55c0 0x7f81b4109cb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 --2- 172.21.15.33:0/3570513719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81b40f6860 0x7f81b410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 >> 172.21.15.33:0/3570513719 conn(0x7f81b40f0d40 msgr2=0x7f81b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 shutdown_connections 2024-02-15T18:32:13.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.428+0000 7f81b9fc0700 1 -- 172.21.15.33:0/3570513719 wait complete. 2024-02-15T18:32:13.431 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:32:13.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.574+0000 7f0d4074b700 1 -- 172.21.15.33:0/552895078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d38060310 msgr2=0x7f0d380fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.574+0000 7f0d4074b700 1 --2- 172.21.15.33:0/552895078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d38060310 0x7f0d380fb6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0d28004660 tx=0x7f0d28009b30).stop 2024-02-15T18:32:13.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.574+0000 7f0d4074b700 1 -- 172.21.15.33:0/552895078 shutdown_connections 2024-02-15T18:32:13.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.574+0000 7f0d4074b700 1 --2- 172.21.15.33:0/552895078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d380fbb90 0x7f0d380fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.574+0000 7f0d4074b700 1 --2- 172.21.15.33:0/552895078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d38060310 0x7f0d380fb6a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.574+0000 7f0d4074b700 1 -- 172.21.15.33:0/552895078 >> 172.21.15.33:0/552895078 conn(0x7f0d380f0d40 msgr2=0x7f0d380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:13.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.575+0000 7f0d4074b700 1 -- 172.21.15.33:0/552895078 shutdown_connections 2024-02-15T18:32:13.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.575+0000 7f0d4074b700 1 -- 172.21.15.33:0/552895078 wait complete. 2024-02-15T18:32:13.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.575+0000 7f0d4074b700 1 Processor -- start 2024-02-15T18:32:13.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.575+0000 7f0d4074b700 1 -- start start 2024-02-15T18:32:13.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.575+0000 7f0d4074b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d38060310 0x7f0d381091e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:13.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.575+0000 7f0d4074b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d380fbb90 0x7f0d381096d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:13.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.575+0000 7f0d4074b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38109c80 con 0x7f0d380fbb90 2024-02-15T18:32:13.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.575+0000 7f0d4074b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38109dc0 con 0x7f0d38060310 2024-02-15T18:32:13.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.576+0000 7f0d3e4e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d38060310 0x7f0d381091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:13.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.576+0000 7f0d3e4e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d38060310 0x7f0d381091e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.33:38680/0 (socket says 172.21.15.33:38680) 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.576+0000 7f0d3e4e7700 1 -- 172.21.15.33:0/3762560114 learned_addr learned my addr 172.21.15.33:0/3762560114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.576+0000 7f0d3dce6700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d380fbb90 0x7f0d381096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.576+0000 7f0d3dce6700 1 -- 172.21.15.33:0/3762560114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d38060310 msgr2=0x7f0d381091e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.576+0000 7f0d3dce6700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d38060310 0x7f0d381091e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.576+0000 7f0d3dce6700 1 -- 172.21.15.33:0/3762560114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d28005040 con 0x7f0d380fbb90 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.577+0000 7f0d3dce6700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d380fbb90 0x7f0d381096d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f0d380600e0 tx=0x7f0d3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.577+0000 7f0d2effd700 1 -- 172.21.15.33:0/3762560114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d340092e0 con 0x7f0d380fbb90 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.577+0000 7f0d2effd700 1 -- 172.21.15.33:0/3762560114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0d3400f040 con 0x7f0d380fbb90 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.577+0000 7f0d2effd700 1 -- 172.21.15.33:0/3762560114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d34014920 con 0x7f0d380fbb90 2024-02-15T18:32:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.579+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3810a760 con 0x7f0d380fbb90 2024-02-15T18:32:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.579+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3810acf0 con 0x7f0d380fbb90 2024-02-15T18:32:13.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.581+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d380f49b0 con 0x7f0d380fbb90 2024-02-15T18:32:13.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.581+0000 7f0d2effd700 1 -- 172.21.15.33:0/3762560114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f0d34014a80 con 0x7f0d380fbb90 2024-02-15T18:32:13.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.581+0000 7f0d2effd700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d1c060fb0 0x7f0d1c063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:13.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.581+0000 7f0d2effd700 1 -- 172.21.15.33:0/3762560114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0d3407c390 con 0x7f0d380fbb90 2024-02-15T18:32:13.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.582+0000 7f0d3e4e7700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d1c060fb0 0x7f0d1c063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:13.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.583+0000 7f0d3e4e7700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d1c060fb0 0x7f0d1c063470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0d28004630 tx=0x7f0d28016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:13.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.589+0000 7f0d2effd700 1 -- 172.21.15.33:0/3762560114 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0d34050170 con 0x7f0d380fbb90 2024-02-15T18:32:13.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.801+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d38101330 con 0x7f0d1c060fb0 2024-02-15T18:32:13.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.802+0000 7f0d2effd700 1 -- 172.21.15.33:0/3762560114 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f0d38101330 con 0x7f0d1c060fb0 2024-02-15T18:32:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d1c060fb0 msgr2=0x7f0d1c063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d1c060fb0 0x7f0d1c063470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0d28004630 tx=0x7f0d28016040).stop 2024-02-15T18:32:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d380fbb90 msgr2=0x7f0d381096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d380fbb90 0x7f0d381096d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f0d380600e0 tx=0x7f0d3400b040).stop 2024-02-15T18:32:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 shutdown_connections 2024-02-15T18:32:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d1c060fb0 0x7f0d1c063470 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d38060310 0x7f0d381091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 --2- 172.21.15.33:0/3762560114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d380fbb90 0x7f0d381096d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 >> 172.21.15.33:0/3762560114 conn(0x7f0d380f0d40 msgr2=0x7f0d380f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 shutdown_connections 2024-02-15T18:32:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.805+0000 7f0d4074b700 1 -- 172.21.15.33:0/3762560114 wait complete. 2024-02-15T18:32:13.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.922+0000 7f48d8e54700 1 -- 172.21.15.33:0/2249128971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f6bf0 msgr2=0x7f48d40f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.922+0000 7f48d8e54700 1 --2- 172.21.15.33:0/2249128971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f6bf0 0x7f48d40f7010 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f48c4004660 tx=0x7f48c4009b30).stop 2024-02-15T18:32:13.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.922+0000 7f48d8e54700 1 -- 172.21.15.33:0/2249128971 shutdown_connections 2024-02-15T18:32:13.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.922+0000 7f48d8e54700 1 --2- 172.21.15.33:0/2249128971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48d40f7590 0x7f48d40f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.922+0000 7f48d8e54700 1 --2- 172.21.15.33:0/2249128971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f6bf0 0x7f48d40f7010 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.922+0000 7f48d8e54700 1 -- 172.21.15.33:0/2249128971 >> 172.21.15.33:0/2249128971 conn(0x7f48d40f04c0 msgr2=0x7f48d40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:13.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.923+0000 7f48d8e54700 1 -- 172.21.15.33:0/2249128971 shutdown_connections 2024-02-15T18:32:13.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.923+0000 7f48d8e54700 1 -- 172.21.15.33:0/2249128971 wait complete. 2024-02-15T18:32:13.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.923+0000 7f48d8e54700 1 Processor -- start 2024-02-15T18:32:13.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.923+0000 7f48d8e54700 1 -- start start 2024-02-15T18:32:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d8e54700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48d40f6bf0 0x7f48d4105f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d8e54700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f7590 0x7f48d4106480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:13.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d8e54700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4106a30 con 0x7f48d40f7590 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d8e54700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4106b70 con 0x7f48d40f6bf0 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f7590 0x7f48d4106480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48d40f6bf0 0x7f48d4105f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f7590 0x7f48d4106480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47882/0 (socket says 172.21.15.33:47882) 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48d40f6bf0 0x7f48d4105f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.33:38702/0 (socket says 172.21.15.33:38702) 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48cbfff700 1 -- 172.21.15.33:0/3272384077 learned_addr learned my addr 172.21.15.33:0/3272384077 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d259c700 1 -- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f7590 msgr2=0x7f48d4106480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d259c700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f7590 0x7f48d4106480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d259c700 1 -- 172.21.15.33:0/3272384077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4005040 con 0x7f48d40f6bf0 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48cbfff700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f7590 0x7f48d4106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.924+0000 7f48d259c700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48d40f6bf0 0x7f48d4105f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f48c4005010 tx=0x7f48c400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.925+0000 7f48caffd700 1 -- 172.21.15.33:0/3272384077 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c4019070 con 0x7f48d40f6bf0 2024-02-15T18:32:13.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.925+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d41074b0 con 0x7f48d40f6bf0 2024-02-15T18:32:13.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.925+0000 7f48caffd700 1 -- 172.21.15.33:0/3272384077 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f48c4007ca0 con 0x7f48d40f6bf0 2024-02-15T18:32:13.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.925+0000 7f48caffd700 1 -- 172.21.15.33:0/3272384077 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48c4014d30 con 0x7f48d40f6bf0 2024-02-15T18:32:13.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.925+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d4107a10 con 0x7f48d40f6bf0 2024-02-15T18:32:13.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.926+0000 7f48caffd700 1 -- 172.21.15.33:0/3272384077 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 29) v1 ==== 77194+0+0 (secure 0 0 0) 0x7f48c4025070 con 0x7f48d40f6bf0 2024-02-15T18:32:13.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.926+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d4045ad0 con 0x7f48d40f6bf0 2024-02-15T18:32:13.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.926+0000 7f48caffd700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f48c0060fb0 0x7f48c0063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:13.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.926+0000 7f48caffd700 1 -- 172.21.15.33:0/3272384077 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f48c407cff0 con 0x7f48d40f6bf0 2024-02-15T18:32:13.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.927+0000 7f48cbfff700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f48c0060fb0 0x7f48c0063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:13.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.927+0000 7f48cbfff700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f48c0060fb0 0x7f48c0063470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f48bc007a30 tx=0x7f48bc00b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:13.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:13.931+0000 7f48caffd700 1 -- 172.21.15.33:0/3272384077 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f48c40abf60 con 0x7f48d40f6bf0 2024-02-15T18:32:14.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.131+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f48d4107c30 con 0x7f48c0060fb0 2024-02-15T18:32:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.141+0000 7f48caffd700 1 -- 172.21.15.33:0/3272384077 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f48d4107c30 con 0x7f48c0060fb0 2024-02-15T18:32:14.134 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:32:14.134 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (7m) 38s ago 8m 15.8M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:32:14.134 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (8m) 38s ago 8m 6391k - 16.2.4 8d91d370c2b8 6deae8bbd6c5 2024-02-15T18:32:14.134 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (7m) 10s ago 7m 6395k - 16.2.4 8d91d370c2b8 e45b11308af7 2024-02-15T18:32:14.134 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (6m) 38s ago 8m 34.0M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:32:14.134 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (3m) 38s ago 3m 15.9M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (3m) 38s ago 3m 11.6M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (3m) 10s ago 3m 159M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (3m) 10s ago 3m 164M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (55s) 38s ago 10m 409M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (16s) 10s ago 7m 42.6M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 starting - - - 2048M 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (7m) 10s ago 7m 36.4M 2048M 16.2.4 8d91d370c2b8 710ae4544ec3 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (8m) 38s ago 8m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (7m) 10s ago 7m 17.0M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 38s ago 7m 309M 4096M 16.2.4 8d91d370c2b8 8fd8ca242c54 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (6m) 38s ago 6m 334M 4096M 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (6m) 38s ago 6m 304M 4096M 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (5m) 10s ago 5m 436M 4096M 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:32:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (5m) 10s ago 5m 408M 4096M 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:32:14.136 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (5m) 10s ago 5m 413M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:32:14.136 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (61s) 38s ago 8m 44.0M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:32:14.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f48c0060fb0 msgr2=0x7f48c0063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f48c0060fb0 0x7f48c0063470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f48bc007a30 tx=0x7f48bc00b040).stop 2024-02-15T18:32:14.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48d40f6bf0 msgr2=0x7f48d4105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48d40f6bf0 0x7f48d4105f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f48c4005010 tx=0x7f48c400b040).stop 2024-02-15T18:32:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 shutdown_connections 2024-02-15T18:32:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f48c0060fb0 0x7f48c0063470 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48d40f6bf0 0x7f48d4105f90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 --2- 172.21.15.33:0/3272384077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48d40f7590 0x7f48d4106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 >> 172.21.15.33:0/3272384077 conn(0x7f48d40f04c0 msgr2=0x7f48d40fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 shutdown_connections 2024-02-15T18:32:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.143+0000 7f48d8e54700 1 -- 172.21.15.33:0/3272384077 wait complete. 2024-02-15T18:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.251+0000 7f0d4b59e700 1 -- 172.21.15.33:0/1364878423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 msgr2=0x7f0d4c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.251+0000 7f0d4b59e700 1 --2- 172.21.15.33:0/1364878423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 0x7f0d4c0f9110 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0d3c004660 tx=0x7f0d3c009b30).stop 2024-02-15T18:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.252+0000 7f0d4b59e700 1 -- 172.21.15.33:0/1364878423 shutdown_connections 2024-02-15T18:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.252+0000 7f0d4b59e700 1 --2- 172.21.15.33:0/1364878423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d4c0f9690 0x7f0d4c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.252+0000 7f0d4b59e700 1 --2- 172.21.15.33:0/1364878423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 0x7f0d4c0f9110 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.252+0000 7f0d4b59e700 1 -- 172.21.15.33:0/1364878423 >> 172.21.15.33:0/1364878423 conn(0x7f0d4c0f0b90 msgr2=0x7f0d4c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.252+0000 7f0d4b59e700 1 -- 172.21.15.33:0/1364878423 shutdown_connections 2024-02-15T18:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.252+0000 7f0d4b59e700 1 -- 172.21.15.33:0/1364878423 wait complete. 2024-02-15T18:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.252+0000 7f0d4b59e700 1 Processor -- start 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.252+0000 7f0d4b59e700 1 -- start start 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 0x7f0d4c108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4b59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d4c0f9690 0x7f0d4c1094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c109a50 con 0x7f0d4c060310 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4b59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c109b90 con 0x7f0d4c0f9690 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 0x7f0d4c108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 0x7f0d4c108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47896/0 (socket says 172.21.15.33:47896) 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4a59c700 1 -- 172.21.15.33:0/25577880 learned_addr learned my addr 172.21.15.33:0/25577880 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d49d9b700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d4c0f9690 0x7f0d4c1094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4a59c700 1 -- 172.21.15.33:0/25577880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d4c0f9690 msgr2=0x7f0d4c1094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4a59c700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d4c0f9690 0x7f0d4c1094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4a59c700 1 -- 172.21.15.33:0/25577880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c005040 con 0x7f0d4c060310 2024-02-15T18:32:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4a59c700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 0x7f0d4c108fb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0d3c0043a0 tx=0x7f0d3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d3affd700 1 -- 172.21.15.33:0/25577880 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d3c019070 con 0x7f0d4c060310 2024-02-15T18:32:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4c10a4d0 con 0x7f0d4c060310 2024-02-15T18:32:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.253+0000 7f0d3affd700 1 -- 172.21.15.33:0/25577880 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0d3c014420 con 0x7f0d4c060310 2024-02-15T18:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.254+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4c10aa30 con 0x7f0d4c060310 2024-02-15T18:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.254+0000 7f0d3affd700 1 -- 172.21.15.33:0/25577880 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d3c01d600 con 0x7f0d4c060310 2024-02-15T18:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.255+0000 7f0d3affd700 1 -- 172.21.15.33:0/25577880 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f0d3c025070 con 0x7f0d4c060310 2024-02-15T18:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.256+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4c045ad0 con 0x7f0d4c060310 2024-02-15T18:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.256+0000 7f0d3affd700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d34061000 0x7f0d340634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.256+0000 7f0d3affd700 1 -- 172.21.15.33:0/25577880 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0d3c07d240 con 0x7f0d4c060310 2024-02-15T18:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.256+0000 7f0d49d9b700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d34061000 0x7f0d340634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.256+0000 7f0d49d9b700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d34061000 0x7f0d340634c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0d40009fd0 tx=0x7f0d4000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:14.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.261+0000 7f0d3affd700 1 -- 172.21.15.33:0/25577880 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0d3c04dbc0 con 0x7f0d4c060310 2024-02-15T18:32:14.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:13.426495+0000 mgr.smithi033.apxevf (mgr.14626) 36 : audit [DBG] from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:14.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:13.458608+0000 mgr.smithi033.apxevf (mgr.14626) 37 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-02-15T18:32:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.531+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d4c0fefa0 con 0x7f0d4c060310 2024-02-15T18:32:14.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.532+0000 7f0d3affd700 1 -- 172.21.15.33:0/25577880 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+806 (secure 0 0 0) 0x7f0d3c023070 con 0x7f0d4c060310 2024-02-15T18:32:14.524 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:32:14.524 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:32:14.525 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3, 2024-02-15T18:32:14.526 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 11 2024-02-15T18:32:14.526 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:32:14.526 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:32:14.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.534+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d34061000 msgr2=0x7f0d340634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.534+0000 7f0d4b59e700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d34061000 0x7f0d340634c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0d40009fd0 tx=0x7f0d4000b040).stop 2024-02-15T18:32:14.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.534+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 msgr2=0x7f0d4c108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.534+0000 7f0d4b59e700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 0x7f0d4c108fb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0d3c0043a0 tx=0x7f0d3c00b040).stop 2024-02-15T18:32:14.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.534+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 shutdown_connections 2024-02-15T18:32:14.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.534+0000 7f0d4b59e700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d34061000 0x7f0d340634c0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0x7f0d40009fd0 tx=0x7f0d4000b040).stop 2024-02-15T18:32:14.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.534+0000 7f0d4b59e700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d4c060310 0x7f0d4c108fb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.534+0000 7f0d4b59e700 1 --2- 172.21.15.33:0/25577880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d4c0f9690 0x7f0d4c1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.534+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 >> 172.21.15.33:0/25577880 conn(0x7f0d4c0f0b90 msgr2=0x7f0d4c0f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.535+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 shutdown_connections 2024-02-15T18:32:14.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.535+0000 7f0d4b59e700 1 -- 172.21.15.33:0/25577880 wait complete. 2024-02-15T18:32:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.687+0000 7f127803b700 1 -- 172.21.15.33:0/3967730521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1270060e10 msgr2=0x7f1270061290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.687+0000 7f127803b700 1 --2- 172.21.15.33:0/3967730521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1270060e10 0x7f1270061290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f1260004660 tx=0x7f1260009b30).stop 2024-02-15T18:32:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.688+0000 7f127803b700 1 -- 172.21.15.33:0/3967730521 shutdown_connections 2024-02-15T18:32:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.688+0000 7f127803b700 1 --2- 172.21.15.33:0/3967730521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1270060e10 0x7f1270061290 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0x7f1260004660 tx=0x7f1260009b30).stop 2024-02-15T18:32:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.688+0000 7f127803b700 1 --2- 172.21.15.33:0/3967730521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1270062420 0x7f1270060920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.688+0000 7f127803b700 1 -- 172.21.15.33:0/3967730521 >> 172.21.15.33:0/3967730521 conn(0x7f1270065850 msgr2=0x7f1270067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.688+0000 7f127803b700 1 -- 172.21.15.33:0/3967730521 shutdown_connections 2024-02-15T18:32:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.688+0000 7f127803b700 1 -- 172.21.15.33:0/3967730521 wait complete. 2024-02-15T18:32:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f127803b700 1 Processor -- start 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f127803b700 1 -- start start 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f127803b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1270062420 0x7f1270115ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f127803b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12701163c0 0x7f12701172b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f127803b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1270116890 con 0x7f12701163c0 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f127803b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12701169d0 con 0x7f1270062420 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f12755d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12701163c0 0x7f12701172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f12755d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12701163c0 0x7f12701172b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47908/0 (socket says 172.21.15.33:47908) 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f12755d6700 1 -- 172.21.15.33:0/3561450186 learned_addr learned my addr 172.21.15.33:0/3561450186 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.689+0000 7f1275dd7700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1270062420 0x7f1270115ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.690+0000 7f12755d6700 1 -- 172.21.15.33:0/3561450186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1270062420 msgr2=0x7f1270115ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.690+0000 7f12755d6700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1270062420 0x7f1270115ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.690+0000 7f12755d6700 1 -- 172.21.15.33:0/3561450186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260005040 con 0x7f12701163c0 2024-02-15T18:32:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.690+0000 7f12755d6700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12701163c0 0x7f12701172b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1260004e30 tx=0x7f1260009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.690+0000 7f12667fc700 1 -- 172.21.15.33:0/3561450186 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1260019070 con 0x7f12701163c0 2024-02-15T18:32:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.690+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1270117800 con 0x7f12701163c0 2024-02-15T18:32:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.690+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1270117d00 con 0x7f12701163c0 2024-02-15T18:32:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.690+0000 7f12667fc700 1 -- 172.21.15.33:0/3561450186 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f12600079c0 con 0x7f12701163c0 2024-02-15T18:32:14.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.690+0000 7f12667fc700 1 -- 172.21.15.33:0/3561450186 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1260014630 con 0x7f12701163c0 2024-02-15T18:32:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.692+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1258004fa0 con 0x7f12701163c0 2024-02-15T18:32:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.693+0000 7f12667fc700 1 -- 172.21.15.33:0/3561450186 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f1260014790 con 0x7f12701163c0 2024-02-15T18:32:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.693+0000 7f12667fc700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f125c060fb0 0x7f125c063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.694+0000 7f12667fc700 1 -- 172.21.15.33:0/3561450186 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f126007d7f0 con 0x7f12701163c0 2024-02-15T18:32:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.694+0000 7f1275dd7700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f125c060fb0 0x7f125c063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.694+0000 7f1275dd7700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f125c060fb0 0x7f125c063470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f126c004c40 tx=0x7f126c00b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.699+0000 7f12667fc700 1 -- 172.21.15.33:0/3561450186 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1260051670 con 0x7f12701163c0 2024-02-15T18:32:14.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.988+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1258005940 con 0x7f12701163c0 2024-02-15T18:32:14.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.989+0000 7f12667fc700 1 -- 172.21.15.33:0/3561450186 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1831 (secure 0 0 0) 0x7f1260051260 con 0x7f12701163c0 2024-02-15T18:32:14.981 INFO:teuthology.orchestra.run.smithi033.stdout:e19 2024-02-15T18:32:14.981 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:32:14.981 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 19 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:31:16.192509+0000 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:32:14.982 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:32:14.983 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:32:14.984 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:32:14.984 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:14.984 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:14.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:32:14.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:32:14.984 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:32:14.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:32:14.984 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:14.984 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.990+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f125c060fb0 msgr2=0x7f125c063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.990+0000 7f127803b700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f125c060fb0 0x7f125c063470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f126c004c40 tx=0x7f126c00b040).stop 2024-02-15T18:32:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.990+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12701163c0 msgr2=0x7f12701172b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.990+0000 7f127803b700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12701163c0 0x7f12701172b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1260004e30 tx=0x7f1260009b30).stop 2024-02-15T18:32:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.990+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 shutdown_connections 2024-02-15T18:32:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.990+0000 7f127803b700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f125c060fb0 0x7f125c063470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.990+0000 7f127803b700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1270062420 0x7f1270115ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.990+0000 7f127803b700 1 --2- 172.21.15.33:0/3561450186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12701163c0 0x7f12701172b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.990+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 >> 172.21.15.33:0/3561450186 conn(0x7f1270065850 msgr2=0x7f1270101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:14.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.991+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 shutdown_connections 2024-02-15T18:32:14.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:14.991+0000 7f127803b700 1 -- 172.21.15.33:0/3561450186 wait complete. 2024-02-15T18:32:14.986 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-02-15T18:32:14.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:13.426495+0000 mgr.smithi033.apxevf (mgr.14626) 36 : audit [DBG] from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:14.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:13.458608+0000 mgr.smithi033.apxevf (mgr.14626) 37 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 1.4 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-02-15T18:32:15.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 -- 172.21.15.33:0/3973923756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 msgr2=0x7f25a00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:15.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 --2- 172.21.15.33:0/3973923756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 0x7f25a00f6950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f2590004660 tx=0x7f2590009b30).stop 2024-02-15T18:32:15.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 -- 172.21.15.33:0/3973923756 shutdown_connections 2024-02-15T18:32:15.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 --2- 172.21.15.33:0/3973923756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a00f77d0 0x7f25a00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:15.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 --2- 172.21.15.33:0/3973923756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 0x7f25a00f6950 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:15.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 -- 172.21.15.33:0/3973923756 >> 172.21.15.33:0/3973923756 conn(0x7f25a00f1c90 msgr2=0x7f25a00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:15.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 -- 172.21.15.33:0/3973923756 shutdown_connections 2024-02-15T18:32:15.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 -- 172.21.15.33:0/3973923756 wait complete. 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 Processor -- start 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.096+0000 7f259f59e700 1 -- start start 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 0x7f25a0106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a00f77d0 0x7f25a01073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0107960 con 0x7f25a00f6530 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259f59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0108160 con 0x7f25a00f77d0 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 0x7f25a0106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 0x7f25a0106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47928/0 (socket says 172.21.15.33:47928) 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259e59c700 1 -- 172.21.15.33:0/1115974157 learned_addr learned my addr 172.21.15.33:0/1115974157 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259dd9b700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a00f77d0 0x7f25a01073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259e59c700 1 -- 172.21.15.33:0/1115974157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a00f77d0 msgr2=0x7f25a01073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:15.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259e59c700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a00f77d0 0x7f25a01073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:15.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259e59c700 1 -- 172.21.15.33:0/1115974157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590005040 con 0x7f25a00f6530 2024-02-15T18:32:15.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259e59c700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 0x7f25a0106ec0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f2590000c00 tx=0x7f259000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:15.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f2596ffd700 1 -- 172.21.15.33:0/1115974157 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2590019070 con 0x7f25a00f6530 2024-02-15T18:32:15.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a01083e0 con 0x7f25a00f6530 2024-02-15T18:32:15.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f2596ffd700 1 -- 172.21.15.33:0/1115974157 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f2590014420 con 0x7f25a00f6530 2024-02-15T18:32:15.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f2596ffd700 1 -- 172.21.15.33:0/1115974157 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f259001d620 con 0x7f25a00f6530 2024-02-15T18:32:15.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.097+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a0108940 con 0x7f25a00f6530 2024-02-15T18:32:15.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.099+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a0059100 con 0x7f25a00f6530 2024-02-15T18:32:15.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.099+0000 7f2596ffd700 1 -- 172.21.15.33:0/1115974157 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f2590025020 con 0x7f25a00f6530 2024-02-15T18:32:15.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.099+0000 7f2596ffd700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f258c061000 0x7f258c0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:15.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.099+0000 7f2596ffd700 1 -- 172.21.15.33:0/1115974157 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f259007cdd0 con 0x7f25a00f6530 2024-02-15T18:32:15.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.099+0000 7f259dd9b700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f258c061000 0x7f258c0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:15.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.100+0000 7f259dd9b700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f258c061000 0x7f258c0634c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2588009fd0 tx=0x7f258800b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.104+0000 7f2596ffd700 1 -- 172.21.15.33:0/1115974157 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2590050bf0 con 0x7f25a00f6530 2024-02-15T18:32:15.099 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-15T18:32:15.099 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-15T18:32:15.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.310+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25a00fee00 con 0x7f258c061000 2024-02-15T18:32:15.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.312+0000 7f2596ffd700 1 -- 172.21.15.33:0/1115974157 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f25a00fee00 con 0x7f258c061000 2024-02-15T18:32:15.304 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:32:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:32:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:32:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:32:15.305 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:32:15.305 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr" 2024-02-15T18:32:15.305 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:32:15.305 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "2/21 daemons upgraded", 2024-02-15T18:32:15.305 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading mon daemons", 2024-02-15T18:32:15.305 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:32:15.305 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:32:15.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f258c061000 msgr2=0x7f258c0634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:15.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f258c061000 0x7f258c0634c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2588009fd0 tx=0x7f258800b040).stop 2024-02-15T18:32:15.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 msgr2=0x7f25a0106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:15.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 0x7f25a0106ec0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f2590000c00 tx=0x7f259000b040).stop 2024-02-15T18:32:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 shutdown_connections 2024-02-15T18:32:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f258c061000 0x7f258c0634c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25a00f6530 0x7f25a0106ec0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 --2- 172.21.15.33:0/1115974157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a00f77d0 0x7f25a01073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 >> 172.21.15.33:0/1115974157 conn(0x7f25a00f1c90 msgr2=0x7f25a00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 shutdown_connections 2024-02-15T18:32:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:15.314+0000 7f259f59e700 1 -- 172.21.15.33:0/1115974157 wait complete. 2024-02-15T18:32:15.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:13.803105+0000 mgr.smithi033.apxevf (mgr.14626) 38 : audit [DBG] from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:15.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:14.133151+0000 mgr.smithi033.apxevf (mgr.14626) 39 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:15.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:14.532597+0000 mon.smithi033 (mon.0) 12 : audit [DBG] from='client.? 172.21.15.33:0/25577880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:15.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:14.989580+0000 mon.smithi033 (mon.0) 13 : audit [DBG] from='client.? 172.21.15.33:0/3561450186' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:32:15.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:13.803105+0000 mgr.smithi033.apxevf (mgr.14626) 38 : audit [DBG] from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:15.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:14.133151+0000 mgr.smithi033.apxevf (mgr.14626) 39 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:15.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:14.532597+0000 mon.smithi033 (mon.0) 12 : audit [DBG] from='client.? 172.21.15.33:0/25577880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:15.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:14.989580+0000 mon.smithi033 (mon.0) 13 : audit [DBG] from='client.? 172.21.15.33:0/3561450186' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:32:16.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:15.312255+0000 mgr.smithi033.apxevf (mgr.14626) 40 : audit [DBG] from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:16.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:15.459148+0000 mgr.smithi033.apxevf (mgr.14626) 41 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 641 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 417 op/s 2024-02-15T18:32:16.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:15.312255+0000 mgr.smithi033.apxevf (mgr.14626) 40 : audit [DBG] from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:16.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:15.459148+0000 mgr.smithi033.apxevf (mgr.14626) 41 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 641 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 417 op/s 2024-02-15T18:32:18.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:17.459579+0000 mgr.smithi033.apxevf (mgr.14626) 42 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 641 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 275 op/s 2024-02-15T18:32:18.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:17.459579+0000 mgr.smithi033.apxevf (mgr.14626) 42 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 641 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 275 op/s 2024-02-15T18:32:20.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:19.290461+0000 mon.smithi033 (mon.0) 14 : audit [INF] from='mgr.14626 ' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:20.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:19.292788+0000 mon.smithi131 (mon.1) 62 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:20.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:19.293568+0000 mon.smithi131 (mon.1) 63 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:20.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:19.294443+0000 mgr.smithi033.apxevf (mgr.14626) 43 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:20.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:19.299867+0000 mon.smithi033 (mon.0) 15 : audit [INF] from='mgr.14626 ' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:20.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:19.306363+0000 mon.smithi131 (mon.1) 64 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:20.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:19.309156+0000 mon.smithi131 (mon.1) 65 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:19.310337+0000 mon.smithi131 (mon.1) 66 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T18:32:20.549 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:19.460098+0000 mgr.smithi033.apxevf (mgr.14626) 44 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 2.2 MiB/s wr, 434 op/s 2024-02-15T18:32:20.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:19.290461+0000 mon.smithi033 (mon.0) 14 : audit [INF] from='mgr.14626 ' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:20.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:19.292788+0000 mon.smithi131 (mon.1) 62 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:20.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:19.293568+0000 mon.smithi131 (mon.1) 63 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:20.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:32:19.294443+0000 mgr.smithi033.apxevf (mgr.14626) 43 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:20.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:19.299867+0000 mon.smithi033 (mon.0) 15 : audit [INF] from='mgr.14626 ' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:20.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:19.306363+0000 mon.smithi131 (mon.1) 64 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:20.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:19.309156+0000 mon.smithi131 (mon.1) 65 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:20.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:19.310337+0000 mon.smithi131 (mon.1) 66 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-15T18:32:20.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:19.460098+0000 mgr.smithi033.apxevf (mgr.14626) 44 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 2.2 MiB/s wr, 434 op/s 2024-02-15T18:32:22.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:21.460603+0000 mgr.smithi033.apxevf (mgr.14626) 45 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 293 op/s 2024-02-15T18:32:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:21.460603+0000 mgr.smithi033.apxevf (mgr.14626) 45 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 293 op/s 2024-02-15T18:32:24.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cluster 2024-02-15T18:32:23.460996+0000 mgr.smithi033.apxevf (mgr.14626) 46 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 293 op/s 2024-02-15T18:32:24.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: cephadm 2024-02-15T18:32:23.553253+0000 mgr.smithi033.apxevf (mgr.14626) 47 : cephadm [INF] Upgrade: Updating mon.smithi131 2024-02-15T18:32:24.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:23.559042+0000 mon.smithi033 (mon.0) 16 : audit [INF] from='mgr.14626 ' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:24.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:23.562700+0000 mon.smithi131 (mon.1) 67 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:32:24.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:23.563487+0000 mon.smithi131 (mon.1) 68 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:32:24.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: audit 2024-02-15T18:32:23.564490+0000 mon.smithi131 (mon.1) 69 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:25.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:23.460996+0000 mgr.smithi033.apxevf (mgr.14626) 46 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 293 op/s 2024-02-15T18:32:25.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:23.553253+0000 mgr.smithi033.apxevf (mgr.14626) 47 : cephadm [INF] Upgrade: Updating mon.smithi131 2024-02-15T18:32:25.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:23.559042+0000 mon.smithi033 (mon.0) 16 : audit [INF] from='mgr.14626 ' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:25.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:23.562700+0000 mon.smithi131 (mon.1) 67 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:32:25.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:23.563487+0000 mon.smithi131 (mon.1) 68 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:32:25.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:23.564490+0000 mon.smithi131 (mon.1) 69 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:25.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:25 smithi131 systemd[1]: Stopping Ceph mon.smithi131 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:32:25.914 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:23.567351+0000 mgr.smithi033.apxevf (mgr.14626) 48 : cephadm [INF] Deploying daemon mon.smithi131 on smithi131 2024-02-15T18:32:25.929 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:32:25.560+0000 7f40a619e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi131 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:32:25.929 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131[40501]: debug 2024-02-15T18:32:25.560+0000 7f40a619e700 -1 mon.smithi131@1(peon) e2 *** Got Signal Terminated *** 2024-02-15T18:32:26.236 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:26 smithi131 bash[59180]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131 2024-02-15T18:32:26.236 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:26 smithi131 bash[59224]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131 2024-02-15T18:32:27.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:26 smithi131 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi131.service: Succeeded. 2024-02-15T18:32:27.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:26 smithi131 systemd[1]: Stopped Ceph mon.smithi131 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:32:27.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 systemd[1]: Starting Ceph mon.smithi131 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:32:27.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.664+0000 7fab53559880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-15T18:32:27.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.664+0000 7fab53559880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-15T18:32:27.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.664+0000 7fab53559880 0 pidfile_write: ignore empty --pid-file 2024-02-15T18:32:27.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.671+0000 7fab53559880 0 load: jerasure load: lrc load: isa 2024-02-15T18:32:27.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: RocksDB version: 6.8.1 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Compile date Feb 8 2024 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: DB SUMMARY 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: CURRENT file: CURRENT 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 695 Bytes 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi131/store.db dir, Total Num: 1, files: 000017.sst 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi131/store.db: 000015.log size: 2868563 ; 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.error_if_exists: 0 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.create_if_missing: 0 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.paranoid_checks: 1 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.env: 0x55a496ae6080 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.fs: Posix File System 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.info_log: 0x55a4981b8560 2024-02-15T18:32:28.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.statistics: (nil) 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.use_fsync: 0 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_log_file_size: 0 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.allow_fallocate: 1 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.use_direct_reads: 0 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-15T18:32:28.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.db_log_dir: 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi131/store.db 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_subcompactions: 1 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_background_flushes: -1 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.write_buffer_manager: 0x55a498eaa420 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-15T18:32:28.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.unordered_write: 0 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.row_cache: None 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.wal_filter: None 2024-02-15T18:32:28.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.preserve_deletes: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.two_write_queues: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.atomic_flush: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.log_readahead_size: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_background_jobs: 2 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_background_compactions: -1 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-15T18:32:28.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-15T18:32:28.007 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-15T18:32:28.007 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-15T18:32:28.007 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-15T18:32:28.007 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_open_files: -1 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Compression algorithms supported: 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: kZSTD supported: 0 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: kXpressCompression supported: 0 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: kLZ4Compression supported: 1 2024-02-15T18:32:28.008 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: kBZip2Compression supported: 0 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: kZlibCompression supported: 1 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: kSnappyCompression supported: 1 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi131/store.db/MANIFEST-000005 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.merge_operator: 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compaction_filter: None 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-15T18:32:28.009 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a49815dd28) 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cache_index_and_filter_blocks: 1 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: pin_top_level_index_and_filter: 1 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: index_type: 0 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: data_block_index_type: 0 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: index_shortening: 1 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: data_block_hash_table_util_ratio: 0.750000 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: hash_index_allow_collision: 1 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: checksum: 1 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: no_block_cache: 0 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: block_cache: 0x55a498192f10 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: block_cache_name: BinnedLRUCache 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: block_cache_options: 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: capacity : 536870912 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: num_shard_bits : 4 2024-02-15T18:32:28.010 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: strict_capacity_limit : 0 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: high_pri_pool_ratio: 0.000 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: block_cache_compressed: (nil) 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: persistent_cache: (nil) 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: block_size: 4096 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: block_size_deviation: 10 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: block_restart_interval: 16 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: index_block_restart_interval: 1 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: metadata_block_size: 4096 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: partition_filters: 0 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: use_delta_encoding: 1 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: whole_key_filtering: 1 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: verify_compression: 0 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: read_amp_bytes_per_bit: 0 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: format_version: 2 2024-02-15T18:32:28.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: enable_index_compression: 1 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: block_align: 0 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compression: NoCompression 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.num_levels: 7 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-15T18:32:28.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.672+0000 7fab53559880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-15T18:32:28.013 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-15T18:32:28.014 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.table_properties_collectors: 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.inplace_update_support: 0 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-15T18:32:28.015 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.bloom_locality: 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.max_successive_merges: 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.ttl: 2592000 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.673+0000 7fab53559880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.678+0000 7fab53559880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.678+0000 7fab53559880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi131/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 19, last_sequence is 9245, log_number is 15,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-15T18:32:28.016 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.678+0000 7fab53559880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 15 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.678+0000 7fab53559880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021947679492, "job": 1, "event": "recovery_started", "log_files": [15]} 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.678+0000 7fab53559880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #15 mode 2 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.681+0000 7fab53559880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.688+0000 7fab53559880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021947689558, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 19, "file_size": 1895871, "table_properties": {"data_size": 1891997, "index_size": 2607, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 453, "raw_key_size": 3739, "raw_average_key_size": 23, "raw_value_size": 1887333, "raw_average_value_size": 11870, "num_data_blocks": 83, "num_entries": 159, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708021947, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.688+0000 7fab53559880 4 rocksdb: [version_set.cc:3826] Creating manifest 20 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.688+0000 7fab53559880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.689+0000 7fab53559880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708021947690467, "job": 1, "event": "recovery_finished"} 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.690+0000 7fab53559880 4 rocksdb: DB pointer 0x55a49825b800 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.691+0000 7fab3a34a700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-15T18:32:28.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.691+0000 7fab3a34a700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ** DB Stats ** 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ** Compaction Stats [default] ** 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: L0 1/0 1.81 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 271.9 0.01 0.00 1 0.007 0 0 2024-02-15T18:32:28.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: L6 1/0 21.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Sum 2/0 23.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 271.9 0.01 0.00 1 0.007 0 0 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 271.9 0.01 0.00 1 0.007 0 0 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ** Compaction Stats [default] ** 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 271.9 0.01 0.00 1 0.007 0 0 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Flush(GB): cumulative 0.002, interval 0.002 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:32:28.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Cumulative compaction: 0.00 GB write, 99.79 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Interval compaction: 0.00 GB write, 99.79 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ** Compaction Stats [default] ** 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: L0 1/0 1.81 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 271.9 0.01 0.00 1 0.007 0 0 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: L6 1/0 21.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Sum 2/0 23.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 271.9 0.01 0.00 1 0.007 0 0 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ** Compaction Stats [default] ** 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-15T18:32:28.020 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 271.9 0.01 0.00 1 0.007 0 0 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Flush(GB): cumulative 0.002, interval 0.000 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: AddFile(Total Files): cumulative 0, interval 0 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: AddFile(Keys): cumulative 0, interval 0 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Cumulative compaction: 0.00 GB write, 99.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: ** File Read Latency Histogram By Level [default] ** 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.694+0000 7fab53559880 0 starting mon.smithi131 rank 1 at public addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] at bind addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi131 fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.695+0000 7fab53559880 1 mon.smithi131@-1(???) e2 preinit fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 2024-02-15T18:32:28.021 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:32:27.695+0000 7fab53559880 0 mon.smithi131@-1(???).mds e19 new map 2024-02-15T18:32:28.022 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:23.460996+0000 mgr.smithi033.apxevf (mgr.14626) 46 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 293 op/s 2024-02-15T18:32:28.022 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:23.553253+0000 mgr.smithi033.apxevf (mgr.14626) 47 : cephadm [INF] Upgrade: Updating mon.smithi131 2024-02-15T18:32:28.022 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:23.559042+0000 mon.smithi033 (mon.0) 16 : audit [INF] from='mgr.14626 ' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:28.022 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:23.562700+0000 mon.smithi131 (mon.1) 67 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-15T18:32:28.022 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:23.563487+0000 mon.smithi131 (mon.1) 68 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-15T18:32:28.022 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:23.564490+0000 mon.smithi131 (mon.1) 69 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:28.022 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 bash[59350]: dd645d69218671f75ab748a69a8d600b8a0635993d19149eb7dee186569351c4 2024-02-15T18:32:28.022 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:27 smithi131 systemd[1]: Started Ceph mon.smithi131 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:32:29.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:23.567351+0000 mgr.smithi033.apxevf (mgr.14626) 48 : cephadm [INF] Deploying daemon mon.smithi131 on smithi131 2024-02-15T18:32:30.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:27.461822+0000 mgr.smithi033.apxevf (mgr.14626) 50 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 313 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 2.2 MiB/s wr, 261 op/s 2024-02-15T18:32:30.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.575316+0000 mon.smithi131 (mon.1) 1 : cluster [INF] mon.smithi131 calling monitor election 2024-02-15T18:32:30.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.580171+0000 mon.smithi033 (mon.0) 19 : cluster [INF] mon.smithi033 calling monitor election 2024-02-15T18:32:30.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.592536+0000 mon.smithi033 (mon.0) 20 : cluster [INF] mon.smithi033 is new leader, mons smithi033,smithi131 in quorum (ranks 0,1) 2024-02-15T18:32:30.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.605561+0000 mon.smithi033 (mon.0) 21 : cluster [DBG] monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi131=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2024-02-15T18:32:30.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.606085+0000 mon.smithi033 (mon.0) 22 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:32:30.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.606111+0000 mon.smithi033 (mon.0) 23 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2024-02-15T18:32:30.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.606414+0000 mon.smithi033 (mon.0) 24 : cluster [DBG] mgrmap e29: smithi033.apxevf(active, since 61s), standbys: smithi131.buibla 2024-02-15T18:32:30.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.611749+0000 mon.smithi033 (mon.0) 25 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-15T18:32:30.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.611772+0000 mon.smithi033 (mon.0) 26 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-15T18:32:30.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:28.611784+0000 mon.smithi033 (mon.0) 27 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2024-02-15T18:32:30.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:28.621013+0000 mon.smithi033 (mon.0) 28 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:30.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:28.622039+0000 mon.smithi033 (mon.0) 29 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:30.005 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:29.462336+0000 mgr.smithi033.apxevf (mgr.14626) 51 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 3.0 MiB/s wr, 438 op/s 2024-02-15T18:32:30.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:27.461822+0000 mgr.smithi033.apxevf (mgr.14626) 50 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 313 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 2.2 MiB/s wr, 261 op/s 2024-02-15T18:32:30.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.575316+0000 mon.smithi131 (mon.1) 1 : cluster [INF] mon.smithi131 calling monitor election 2024-02-15T18:32:30.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.580171+0000 mon.smithi033 (mon.0) 19 : cluster [INF] mon.smithi033 calling monitor election 2024-02-15T18:32:30.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.592536+0000 mon.smithi033 (mon.0) 20 : cluster [INF] mon.smithi033 is new leader, mons smithi033,smithi131 in quorum (ranks 0,1) 2024-02-15T18:32:30.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.605561+0000 mon.smithi033 (mon.0) 21 : cluster [DBG] monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi131=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2024-02-15T18:32:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.606085+0000 mon.smithi033 (mon.0) 22 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:32:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.606111+0000 mon.smithi033 (mon.0) 23 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2024-02-15T18:32:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.606414+0000 mon.smithi033 (mon.0) 24 : cluster [DBG] mgrmap e29: smithi033.apxevf(active, since 61s), standbys: smithi131.buibla 2024-02-15T18:32:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.611749+0000 mon.smithi033 (mon.0) 25 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-15T18:32:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.611772+0000 mon.smithi033 (mon.0) 26 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-15T18:32:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:28.611784+0000 mon.smithi033 (mon.0) 27 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2024-02-15T18:32:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:28.621013+0000 mon.smithi033 (mon.0) 28 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:28.622039+0000 mon.smithi033 (mon.0) 29 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:30.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:29.462336+0000 mgr.smithi033.apxevf (mgr.14626) 51 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 3.0 MiB/s wr, 438 op/s 2024-02-15T18:32:31.040 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-15T18:32:31.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-15T18:32:31.330 DEBUG:teuthology.parallel:result is None 2024-02-15T18:32:32.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:31.462712+0000 mgr.smithi033.apxevf (mgr.14626) 52 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 2.2 MiB/s wr, 279 op/s 2024-02-15T18:32:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:31.462712+0000 mgr.smithi033.apxevf (mgr.14626) 52 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 2.2 MiB/s wr, 279 op/s 2024-02-15T18:32:34.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.805643+0000 mon.smithi033 (mon.0) 30 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:34.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.806897+0000 mon.smithi033 (mon.0) 31 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:34.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.810438+0000 mon.smithi033 (mon.0) 32 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:34.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:32.811741+0000 mgr.smithi033.apxevf (mgr.14626) 53 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:34.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.816981+0000 mon.smithi033 (mon.0) 33 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:34.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.823543+0000 mon.smithi033 (mon.0) 34 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.826309+0000 mon.smithi033 (mon.0) 35 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.827709+0000 mon.smithi033 (mon.0) 36 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:32.828457+0000 mgr.smithi033.apxevf (mgr.14626) 54 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-15T18:32:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.839014+0000 mon.smithi033 (mon.0) 37 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.840037+0000 mon.smithi033 (mon.0) 38 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]: dispatch 2024-02-15T18:32:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.846025+0000 mon.smithi033 (mon.0) 39 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]': finished 2024-02-15T18:32:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.846832+0000 mon.smithi033 (mon.0) 40 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi131"}]: dispatch 2024-02-15T18:32:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:32.851887+0000 mon.smithi033 (mon.0) 41 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi131"}]': finished 2024-02-15T18:32:34.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:33.463021+0000 mgr.smithi033.apxevf (mgr.14626) 55 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 2.2 MiB/s wr, 279 op/s 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.805643+0000 mon.smithi033 (mon.0) 30 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.806897+0000 mon.smithi033 (mon.0) 31 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.810438+0000 mon.smithi033 (mon.0) 32 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:32.811741+0000 mgr.smithi033.apxevf (mgr.14626) 53 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.816981+0000 mon.smithi033 (mon.0) 33 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.823543+0000 mon.smithi033 (mon.0) 34 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.826309+0000 mon.smithi033 (mon.0) 35 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.827709+0000 mon.smithi033 (mon.0) 36 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:32.828457+0000 mgr.smithi033.apxevf (mgr.14626) 54 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-15T18:32:34.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.839014+0000 mon.smithi033 (mon.0) 37 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:34.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.840037+0000 mon.smithi033 (mon.0) 38 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]: dispatch 2024-02-15T18:32:34.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.846025+0000 mon.smithi033 (mon.0) 39 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]': finished 2024-02-15T18:32:34.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.846832+0000 mon.smithi033 (mon.0) 40 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi131"}]: dispatch 2024-02-15T18:32:34.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:32.851887+0000 mon.smithi033 (mon.0) 41 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi131"}]': finished 2024-02-15T18:32:34.299 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:33.463021+0000 mgr.smithi033.apxevf (mgr.14626) 55 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 2.2 MiB/s wr, 279 op/s 2024-02-15T18:32:36.176 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:34.817445+0000 mgr.smithi033.apxevf (mgr.14626) 56 : cephadm [INF] Upgrade: Updating crash.smithi033 (1/2) 2024-02-15T18:32:36.176 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:34.821219+0000 mon.smithi033 (mon.0) 42 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:36.176 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:34.821959+0000 mon.smithi033 (mon.0) 43 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:32:36.176 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:34.822545+0000 mon.smithi033 (mon.0) 44 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:36.176 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:34.823057+0000 mgr.smithi033.apxevf (mgr.14626) 57 : cephadm [INF] Deploying daemon crash.smithi033 on smithi033 2024-02-15T18:32:36.177 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:35.463586+0000 mgr.smithi033.apxevf (mgr.14626) 58 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 3.0 MiB/s wr, 446 op/s 2024-02-15T18:32:36.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:34.817445+0000 mgr.smithi033.apxevf (mgr.14626) 56 : cephadm [INF] Upgrade: Updating crash.smithi033 (1/2) 2024-02-15T18:32:36.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:34.821219+0000 mon.smithi033 (mon.0) 42 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:36.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:34.821959+0000 mon.smithi033 (mon.0) 43 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:32:36.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:34.822545+0000 mon.smithi033 (mon.0) 44 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:36.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:34.823057+0000 mgr.smithi033.apxevf (mgr.14626) 57 : cephadm [INF] Deploying daemon crash.smithi033 on smithi033 2024-02-15T18:32:36.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:35.463586+0000 mgr.smithi033.apxevf (mgr.14626) 58 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 3.0 MiB/s wr, 446 op/s 2024-02-15T18:32:38.651 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:37.463914+0000 mgr.smithi033.apxevf (mgr.14626) 59 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 343 op/s 2024-02-15T18:32:38.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:37.463914+0000 mgr.smithi033.apxevf (mgr.14626) 59 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 343 op/s 2024-02-15T18:32:40.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:39.329668+0000 mon.smithi033 (mon.0) 45 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:40.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:39.464688+0000 mgr.smithi033.apxevf (mgr.14626) 60 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 317 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.4 MiB/s wr, 489 op/s 2024-02-15T18:32:40.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:39.329668+0000 mon.smithi033 (mon.0) 45 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:40.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:39.464688+0000 mgr.smithi033.apxevf (mgr.14626) 60 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 317 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.4 MiB/s wr, 489 op/s 2024-02-15T18:32:42.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:41.465138+0000 mgr.smithi033.apxevf (mgr.14626) 61 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 317 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 312 op/s 2024-02-15T18:32:42.852 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:41.465138+0000 mgr.smithi033.apxevf (mgr.14626) 61 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 317 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 312 op/s 2024-02-15T18:32:44.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:43.187078+0000 mgr.smithi033.apxevf (mgr.14626) 62 : cephadm [INF] Upgrade: Updating crash.smithi131 (2/2) 2024-02-15T18:32:44.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:43.190800+0000 mon.smithi033 (mon.0) 46 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:44.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:43.191504+0000 mon.smithi033 (mon.0) 47 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:32:44.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:43.192086+0000 mon.smithi033 (mon.0) 48 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:44.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:43.192572+0000 mgr.smithi033.apxevf (mgr.14626) 63 : cephadm [INF] Deploying daemon crash.smithi131 on smithi131 2024-02-15T18:32:44.249 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:43.465484+0000 mgr.smithi033.apxevf (mgr.14626) 64 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 317 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 312 op/s 2024-02-15T18:32:44.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:43.187078+0000 mgr.smithi033.apxevf (mgr.14626) 62 : cephadm [INF] Upgrade: Updating crash.smithi131 (2/2) 2024-02-15T18:32:44.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:43.190800+0000 mon.smithi033 (mon.0) 46 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:44.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:43.191504+0000 mon.smithi033 (mon.0) 47 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-15T18:32:44.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:43.192086+0000 mon.smithi033 (mon.0) 48 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:44.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:43.192572+0000 mgr.smithi033.apxevf (mgr.14626) 63 : cephadm [INF] Deploying daemon crash.smithi131 on smithi131 2024-02-15T18:32:44.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:43.465484+0000 mgr.smithi033.apxevf (mgr.14626) 64 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 317 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 312 op/s 2024-02-15T18:32:45.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 -- 172.21.15.33:0/1326893950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f55c0 msgr2=0x7fc3fc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 --2- 172.21.15.33:0/1326893950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f55c0 0x7fc3fc0f59e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc3f8004660 tx=0x7fc3f8009b30).stop 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 -- 172.21.15.33:0/1326893950 shutdown_connections 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 --2- 172.21.15.33:0/1326893950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc0f6860 0x7fc3fc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 --2- 172.21.15.33:0/1326893950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f55c0 0x7fc3fc0f59e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 -- 172.21.15.33:0/1326893950 >> 172.21.15.33:0/1326893950 conn(0x7fc3fc0f0d40 msgr2=0x7fc3fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 -- 172.21.15.33:0/1326893950 shutdown_connections 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 -- 172.21.15.33:0/1326893950 wait complete. 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 Processor -- start 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 -- start start 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc0f55c0 0x7fc3fc106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f6860 0x7fc3fc1074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:45.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc107a90 con 0x7fc3fc0f6860 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.424+0000 7fc403fad700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc107bd0 con 0x7fc3fc0f55c0 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc401548700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f6860 0x7fc3fc1074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc401548700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f6860 0x7fc3fc1074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51062/0 (socket says 172.21.15.33:51062) 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc401548700 1 -- 172.21.15.33:0/1735043122 learned_addr learned my addr 172.21.15.33:0/1735043122 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc401d49700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc0f55c0 0x7fc3fc106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc401548700 1 -- 172.21.15.33:0/1735043122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc0f55c0 msgr2=0x7fc3fc106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc401548700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc0f55c0 0x7fc3fc106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc401548700 1 -- 172.21.15.33:0/1735043122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f8005040 con 0x7fc3fc0f6860 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc401548700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f6860 0x7fc3fc1074e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc3ec00e7f0 tx=0x7fc3ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc3f27fc700 1 -- 172.21.15.33:0/1735043122 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ec0092e0 con 0x7fc3fc0f6860 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc3f27fc700 1 -- 172.21.15.33:0/1735043122 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fc3ec00f040 con 0x7fc3fc0f6860 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc108570 con 0x7fc3fc0f6860 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc3f27fc700 1 -- 172.21.15.33:0/1735043122 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ec014850 con 0x7fc3fc0f6860 2024-02-15T18:32:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.425+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc108b30 con 0x7fc3fc0f6860 2024-02-15T18:32:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.426+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc045ad0 con 0x7fc3fc0f6860 2024-02-15T18:32:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.426+0000 7fc3f27fc700 1 -- 172.21.15.33:0/1735043122 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7fc3ec01b030 con 0x7fc3fc0f6860 2024-02-15T18:32:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.427+0000 7fc3f27fc700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc3e8060fb0 0x7fc3e8063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.427+0000 7fc3f27fc700 1 -- 172.21.15.33:0/1735043122 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc3ec07bec0 con 0x7fc3fc0f6860 2024-02-15T18:32:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.427+0000 7fc401d49700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc3e8060fb0 0x7fc3e8063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:45.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.427+0000 7fc401d49700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc3e8060fb0 0x7fc3e8063470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fc3f8009720 tx=0x7fc3f8016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:45.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.431+0000 7fc3f27fc700 1 -- 172.21.15.33:0/1735043122 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc3ec04fd90 con 0x7fc3fc0f6860 2024-02-15T18:32:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.626+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3fc0faca0 con 0x7fc3e8060fb0 2024-02-15T18:32:45.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.628+0000 7fc3f27fc700 1 -- 172.21.15.33:0/1735043122 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc3fc0faca0 con 0x7fc3e8060fb0 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc3e8060fb0 msgr2=0x7fc3e8063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc3e8060fb0 0x7fc3e8063470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fc3f8009720 tx=0x7fc3f8016040).stop 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f6860 msgr2=0x7fc3fc1074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f6860 0x7fc3fc1074e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc3ec00e7f0 tx=0x7fc3ec00b040).stop 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 shutdown_connections 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc3e8060fb0 0x7fc3e8063470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3fc0f55c0 0x7fc3fc106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 --2- 172.21.15.33:0/1735043122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3fc0f6860 0x7fc3fc1074e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 >> 172.21.15.33:0/1735043122 conn(0x7fc3fc0f0d40 msgr2=0x7fc3fc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 shutdown_connections 2024-02-15T18:32:45.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.630+0000 7fc403fad700 1 -- 172.21.15.33:0/1735043122 wait complete. 2024-02-15T18:32:45.633 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:32:45.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.740+0000 7fcca5a7d700 1 -- 172.21.15.33:0/1141755113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f55c0 msgr2=0x7fcca00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:45.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.740+0000 7fcca5a7d700 1 --2- 172.21.15.33:0/1141755113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f55c0 0x7fcca00f59e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcc90004660 tx=0x7fcc90009b30).stop 2024-02-15T18:32:45.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.740+0000 7fcca5a7d700 1 -- 172.21.15.33:0/1141755113 shutdown_connections 2024-02-15T18:32:45.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.740+0000 7fcca5a7d700 1 --2- 172.21.15.33:0/1141755113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcca00f6860 0x7fcca00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:45.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.740+0000 7fcca5a7d700 1 --2- 172.21.15.33:0/1141755113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f55c0 0x7fcca00f59e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:45.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.740+0000 7fcca5a7d700 1 -- 172.21.15.33:0/1141755113 >> 172.21.15.33:0/1141755113 conn(0x7fcca00f0d40 msgr2=0x7fcca00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:45.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.740+0000 7fcca5a7d700 1 -- 172.21.15.33:0/1141755113 shutdown_connections 2024-02-15T18:32:45.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.740+0000 7fcca5a7d700 1 -- 172.21.15.33:0/1141755113 wait complete. 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcca5a7d700 1 Processor -- start 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcca5a7d700 1 -- start start 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcca5a7d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcca00f55c0 0x7fcca0105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcca5a7d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f6860 0x7fcca01063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcca5a7d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0106950 con 0x7fcca00f6860 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcca5a7d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0106a90 con 0x7fcca00f55c0 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcc9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f6860 0x7fcca01063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcc9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f6860 0x7fcca01063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46446/0 (socket says 172.21.15.33:46446) 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcc9effd700 1 -- 172.21.15.33:0/2204513784 learned_addr learned my addr 172.21.15.33:0/2204513784 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcc9f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcca00f55c0 0x7fcca0105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcc9effd700 1 -- 172.21.15.33:0/2204513784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcca00f55c0 msgr2=0x7fcca0105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcc9effd700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcca00f55c0 0x7fcca0105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:45.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.741+0000 7fcc9effd700 1 -- 172.21.15.33:0/2204513784 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc90005040 con 0x7fcca00f6860 2024-02-15T18:32:45.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.742+0000 7fcc9effd700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f6860 0x7fcca01063a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcc8800e7f0 tx=0x7fcc8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:45.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.742+0000 7fcc97fff700 1 -- 172.21.15.33:0/2204513784 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc880092e0 con 0x7fcca00f6860 2024-02-15T18:32:45.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.742+0000 7fcc97fff700 1 -- 172.21.15.33:0/2204513784 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fcc8800f040 con 0x7fcca00f6860 2024-02-15T18:32:45.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.742+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca0107430 con 0x7fcca00f6860 2024-02-15T18:32:45.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.742+0000 7fcc97fff700 1 -- 172.21.15.33:0/2204513784 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc88014850 con 0x7fcca00f6860 2024-02-15T18:32:45.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.742+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01079f0 con 0x7fcca00f6860 2024-02-15T18:32:45.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.743+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca0045ad0 con 0x7fcca00f6860 2024-02-15T18:32:45.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.743+0000 7fcc97fff700 1 -- 172.21.15.33:0/2204513784 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7fcc8801b030 con 0x7fcca00f6860 2024-02-15T18:32:45.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.744+0000 7fcc97fff700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc8c060fb0 0x7fcc8c063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:45.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.744+0000 7fcc97fff700 1 -- 172.21.15.33:0/2204513784 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fcc8807c020 con 0x7fcca00f6860 2024-02-15T18:32:45.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.744+0000 7fcc9f7fe700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc8c060fb0 0x7fcc8c063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:45.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.744+0000 7fcc9f7fe700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc8c060fb0 0x7fcc8c063470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fcc90009720 tx=0x7fcc90016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:45.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:45.748+0000 7fcc97fff700 1 -- 172.21.15.33:0/2204513784 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcc8804fe90 con 0x7fcca00f6860 2024-02-15T18:32:45.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.004+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcca0107c10 con 0x7fcc8c060fb0 2024-02-15T18:32:45.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.005+0000 7fcc97fff700 1 -- 172.21.15.33:0/2204513784 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fcca0107c10 con 0x7fcc8c060fb0 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.006+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc8c060fb0 msgr2=0x7fcc8c063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.006+0000 7fcca5a7d700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc8c060fb0 0x7fcc8c063470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fcc90009720 tx=0x7fcc90016040).stop 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.006+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f6860 msgr2=0x7fcca01063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.006+0000 7fcca5a7d700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f6860 0x7fcca01063a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fcc8800e7f0 tx=0x7fcc8800b040).stop 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.007+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 shutdown_connections 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.007+0000 7fcca5a7d700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcc8c060fb0 0x7fcc8c063470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.007+0000 7fcca5a7d700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcca00f55c0 0x7fcca0105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.007+0000 7fcca5a7d700 1 --2- 172.21.15.33:0/2204513784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcca00f6860 0x7fcca01063a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.007+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 >> 172.21.15.33:0/2204513784 conn(0x7fcca00f0d40 msgr2=0x7fcca00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.007+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 shutdown_connections 2024-02-15T18:32:46.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.007+0000 7fcca5a7d700 1 -- 172.21.15.33:0/2204513784 wait complete. 2024-02-15T18:32:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.116+0000 7f94e5045700 1 -- 172.21.15.33:0/3396280763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f66d0 msgr2=0x7f94e00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.116+0000 7f94e5045700 1 --2- 172.21.15.33:0/3396280763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f66d0 0x7f94e00f6b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f94c8004660 tx=0x7f94c8009b30).stop 2024-02-15T18:32:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.116+0000 7f94e5045700 1 -- 172.21.15.33:0/3396280763 shutdown_connections 2024-02-15T18:32:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.116+0000 7f94e5045700 1 --2- 172.21.15.33:0/3396280763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f66d0 0x7f94e00f6b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.116+0000 7f94e5045700 1 --2- 172.21.15.33:0/3396280763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00f5430 0x7f94e00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.116+0000 7f94e5045700 1 -- 172.21.15.33:0/3396280763 >> 172.21.15.33:0/3396280763 conn(0x7f94e00f0b90 msgr2=0x7f94e00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.116+0000 7f94e5045700 1 -- 172.21.15.33:0/3396280763 shutdown_connections 2024-02-15T18:32:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.116+0000 7f94e5045700 1 -- 172.21.15.33:0/3396280763 wait complete. 2024-02-15T18:32:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.116+0000 7f94e5045700 1 Processor -- start 2024-02-15T18:32:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94e5045700 1 -- start start 2024-02-15T18:32:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94e5045700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f5430 0x7f94e0109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94e5045700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00f66d0 0x7f94e010bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94e5045700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00603c0 con 0x7f94e00f5430 2024-02-15T18:32:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94e5045700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0060500 con 0x7f94e00f66d0 2024-02-15T18:32:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f5430 0x7f94e0109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f5430 0x7f94e0109ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46478/0 (socket says 172.21.15.33:46478) 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94dffff700 1 -- 172.21.15.33:0/3988582491 learned_addr learned my addr 172.21.15.33:0/3988582491 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94df7fe700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00f66d0 0x7f94e010bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94dffff700 1 -- 172.21.15.33:0/3988582491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00f66d0 msgr2=0x7f94e010bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94dffff700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00f66d0 0x7f94e010bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94dffff700 1 -- 172.21.15.33:0/3988582491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8005040 con 0x7f94e00f5430 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.117+0000 7f94dffff700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f5430 0x7f94e0109ad0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f94d0002700 tx=0x7f94d0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.118+0000 7f94dcff9700 1 -- 172.21.15.33:0/3988582491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d00079c0 con 0x7f94e00f5430 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.118+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e010c580 con 0x7f94e00f5430 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.118+0000 7f94dcff9700 1 -- 172.21.15.33:0/3988582491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f94d000f040 con 0x7f94e00f5430 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.118+0000 7f94dcff9700 1 -- 172.21.15.33:0/3988582491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d0014990 con 0x7f94e00f5430 2024-02-15T18:32:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.118+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e010ca90 con 0x7f94e00f5430 2024-02-15T18:32:46.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.119+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e0059100 con 0x7f94e00f5430 2024-02-15T18:32:46.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.119+0000 7f94dcff9700 1 -- 172.21.15.33:0/3988582491 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f94d001b060 con 0x7f94e00f5430 2024-02-15T18:32:46.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.120+0000 7f94dcff9700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94cc061000 0x7f94cc0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:46.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.120+0000 7f94dcff9700 1 -- 172.21.15.33:0/3988582491 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f94d007c0d0 con 0x7f94e00f5430 2024-02-15T18:32:46.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.120+0000 7f94df7fe700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94cc061000 0x7f94cc0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:46.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.120+0000 7f94df7fe700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94cc061000 0x7f94cc0634c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f94c8004630 tx=0x7f94c8009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:46.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.124+0000 7f94dcff9700 1 -- 172.21.15.33:0/3988582491 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f94d004c4c0 con 0x7f94e00f5430 2024-02-15T18:32:46.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.319+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f94e0057f10 con 0x7f94cc061000 2024-02-15T18:32:46.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.330+0000 7f94dcff9700 1 -- 172.21.15.33:0/3988582491 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f94e0057f10 con 0x7f94cc061000 2024-02-15T18:32:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:32:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (7m) 27s ago 9m 19.5M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:32:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 starting - - - - 2024-02-15T18:32:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (8m) 13s ago 8m 6395k - 16.2.4 8d91d370c2b8 e45b11308af7 2024-02-15T18:32:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (7m) 27s ago 9m 34.0M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:32:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (3m) 27s ago 3m 16.7M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:32:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (4m) 27s ago 4m 12.4M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (4m) 13s ago 4m 130M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (4m) 13s ago 4m 166M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (87s) 27s ago 10m 425M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (48s) 13s ago 8m 388M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (37s) 27s ago 11m 24.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (19s) 13s ago 8m 20.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (8m) 27s ago 8m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (8m) 13s ago 8m 17.0M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 27s ago 7m 374M 4096M 16.2.4 8d91d370c2b8 8fd8ca242c54 2024-02-15T18:32:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (7m) 27s ago 7m 350M 4096M 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:32:46.325 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (6m) 27s ago 6m 339M 4096M 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:32:46.325 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (6m) 13s ago 6m 435M 4096M 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:32:46.325 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (6m) 13s ago 6m 405M 4096M 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:32:46.325 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (5m) 13s ago 5m 397M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:32:46.325 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (94s) 27s ago 8m 53.5M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.331+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94cc061000 msgr2=0x7f94cc0634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.331+0000 7f94e5045700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94cc061000 0x7f94cc0634c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f94c8004630 tx=0x7f94c8009b30).stop 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.331+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f5430 msgr2=0x7f94e0109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.331+0000 7f94e5045700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f5430 0x7f94e0109ad0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f94d0002700 tx=0x7f94d0009e00).stop 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.331+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 shutdown_connections 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.332+0000 7f94e5045700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94cc061000 0x7f94cc0634c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.332+0000 7f94e5045700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94e00f5430 0x7f94e0109ad0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.332+0000 7f94e5045700 1 --2- 172.21.15.33:0/3988582491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94e00f66d0 0x7f94e010bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.332+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 >> 172.21.15.33:0/3988582491 conn(0x7f94e00f0b90 msgr2=0x7f94e00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.332+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 shutdown_connections 2024-02-15T18:32:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.332+0000 7f94e5045700 1 -- 172.21.15.33:0/3988582491 wait complete. 2024-02-15T18:32:46.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.433+0000 7fc283e6a700 1 -- 172.21.15.33:0/2864204735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc27c0f66e0 msgr2=0x7fc27c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.433+0000 7fc283e6a700 1 --2- 172.21.15.33:0/2864204735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc27c0f66e0 0x7fc27c0f6b00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc2780045a0 tx=0x7fc278009b30).stop 2024-02-15T18:32:46.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.433+0000 7fc283e6a700 1 -- 172.21.15.33:0/2864204735 shutdown_connections 2024-02-15T18:32:46.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.433+0000 7fc283e6a700 1 --2- 172.21.15.33:0/2864204735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27c0f7980 0x7fc27c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.433+0000 7fc283e6a700 1 --2- 172.21.15.33:0/2864204735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc27c0f66e0 0x7fc27c0f6b00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.433+0000 7fc283e6a700 1 -- 172.21.15.33:0/2864204735 >> 172.21.15.33:0/2864204735 conn(0x7fc27c0f1e40 msgr2=0x7fc27c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:46.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc283e6a700 1 -- 172.21.15.33:0/2864204735 shutdown_connections 2024-02-15T18:32:46.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc283e6a700 1 -- 172.21.15.33:0/2864204735 wait complete. 2024-02-15T18:32:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc283e6a700 1 Processor -- start 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc283e6a700 1 -- start start 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc283e6a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc27c0f66e0 0x7fc27c107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc283e6a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27c0f7980 0x7fc27c107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc283e6a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c107b10 con 0x7fc27c0f7980 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc283e6a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c107c50 con 0x7fc27c0f66e0 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc281405700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27c0f7980 0x7fc27c107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc281405700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27c0f7980 0x7fc27c107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46496/0 (socket says 172.21.15.33:46496) 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc281405700 1 -- 172.21.15.33:0/666914410 learned_addr learned my addr 172.21.15.33:0/666914410 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.434+0000 7fc281c06700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc27c0f66e0 0x7fc27c107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.435+0000 7fc281405700 1 -- 172.21.15.33:0/666914410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc27c0f66e0 msgr2=0x7fc27c107070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.435+0000 7fc281405700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc27c0f66e0 0x7fc27c107070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.435+0000 7fc281405700 1 -- 172.21.15.33:0/666914410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278005040 con 0x7fc27c0f7980 2024-02-15T18:32:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.435+0000 7fc281405700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27c0f7980 0x7fc27c107560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc27000e7c0 tx=0x7fc27000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.435+0000 7fc26e7fc700 1 -- 172.21.15.33:0/666914410 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2700092e0 con 0x7fc27c0f7980 2024-02-15T18:32:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.435+0000 7fc26e7fc700 1 -- 172.21.15.33:0/666914410 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fc27000f040 con 0x7fc27c0f7980 2024-02-15T18:32:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.435+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c1085f0 con 0x7fc27c0f7980 2024-02-15T18:32:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.435+0000 7fc26e7fc700 1 -- 172.21.15.33:0/666914410 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc270014990 con 0x7fc27c0f7980 2024-02-15T18:32:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.435+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c108b30 con 0x7fc27c0f7980 2024-02-15T18:32:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.436+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c045ad0 con 0x7fc27c0f7980 2024-02-15T18:32:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.437+0000 7fc26e7fc700 1 -- 172.21.15.33:0/666914410 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7fc27001b030 con 0x7fc27c0f7980 2024-02-15T18:32:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.437+0000 7fc26e7fc700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc268060fb0 0x7fc268063470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.437+0000 7fc26e7fc700 1 -- 172.21.15.33:0/666914410 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc27007c040 con 0x7fc27c0f7980 2024-02-15T18:32:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.437+0000 7fc281c06700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc268060fb0 0x7fc268063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.437+0000 7fc281c06700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc268060fb0 0x7fc268063470 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc278004570 tx=0x7fc278016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.442+0000 7fc26e7fc700 1 -- 172.21.15.33:0/666914410 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc27004fe40 con 0x7fc27c0f7980 2024-02-15T18:32:46.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.698+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc27c027a00 con 0x7fc27c0f7980 2024-02-15T18:32:46.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.698+0000 7fc26e7fc700 1 -- 172.21.15.33:0/666914410 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+712 (secure 0 0 0) 0x7fc27004fa30 con 0x7fc27c0f7980 2024-02-15T18:32:46.692 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:32:46.692 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:32:46.692 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:32:46.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:32:46.692 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:32:46.692 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4, 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:32:46.693 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:32:46.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.700+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc268060fb0 msgr2=0x7fc268063470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.700+0000 7fc283e6a700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc268060fb0 0x7fc268063470 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc278004570 tx=0x7fc278016040).stop 2024-02-15T18:32:46.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.700+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27c0f7980 msgr2=0x7fc27c107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.700+0000 7fc283e6a700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27c0f7980 0x7fc27c107560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc27000e7c0 tx=0x7fc27000b040).stop 2024-02-15T18:32:46.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.700+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 shutdown_connections 2024-02-15T18:32:46.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.700+0000 7fc283e6a700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc268060fb0 0x7fc268063470 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.700+0000 7fc283e6a700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc27c0f66e0 0x7fc27c107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.700+0000 7fc283e6a700 1 --2- 172.21.15.33:0/666914410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc27c0f7980 0x7fc27c107560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.700+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 >> 172.21.15.33:0/666914410 conn(0x7fc27c0f1e40 msgr2=0x7fc27c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:46.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.701+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 shutdown_connections 2024-02-15T18:32:46.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.701+0000 7fc283e6a700 1 -- 172.21.15.33:0/666914410 wait complete. 2024-02-15T18:32:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:45.465928+0000 mgr.smithi033.apxevf (mgr.14626) 65 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 469 op/s 2024-02-15T18:32:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:45.465928+0000 mgr.smithi033.apxevf (mgr.14626) 65 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 469 op/s 2024-02-15T18:32:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.819+0000 7f955e46b700 1 -- 172.21.15.33:0/4107984495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f55c0 msgr2=0x7f95580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.819+0000 7f955e46b700 1 --2- 172.21.15.33:0/4107984495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f55c0 0x7f95580f59e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9548004660 tx=0x7f9548009b30).stop 2024-02-15T18:32:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.819+0000 7f955e46b700 1 -- 172.21.15.33:0/4107984495 shutdown_connections 2024-02-15T18:32:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.819+0000 7f955e46b700 1 --2- 172.21.15.33:0/4107984495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95580f6860 0x7f95580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:32:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.819+0000 7f955e46b700 1 --2- 172.21.15.33:0/4107984495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f55c0 0x7f95580f59e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.819+0000 7f955e46b700 1 -- 172.21.15.33:0/4107984495 >> 172.21.15.33:0/4107984495 conn(0x7f95580f0d40 msgr2=0x7f95580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.819+0000 7f955e46b700 1 -- 172.21.15.33:0/4107984495 shutdown_connections 2024-02-15T18:32:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.819+0000 7f955e46b700 1 -- 172.21.15.33:0/4107984495 wait complete. 2024-02-15T18:32:46.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.820+0000 7f955e46b700 1 Processor -- start 2024-02-15T18:32:46.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.820+0000 7f955e46b700 1 -- start start 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.820+0000 7f955e46b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95580f55c0 0x7f9558107150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.820+0000 7f955e46b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f6860 0x7f9558107640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.820+0000 7f955e46b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9558107c80 con 0x7f95580f6860 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.820+0000 7f955e46b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9558108530 con 0x7f95580f55c0 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.821+0000 7f95577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f6860 0x7f9558107640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.821+0000 7f95577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f6860 0x7f9558107640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46524/0 (socket says 172.21.15.33:46524) 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.821+0000 7f95577fe700 1 -- 172.21.15.33:0/3494897800 learned_addr learned my addr 172.21.15.33:0/3494897800 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.821+0000 7f9557fff700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95580f55c0 0x7f9558107150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.821+0000 7f95577fe700 1 -- 172.21.15.33:0/3494897800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95580f55c0 msgr2=0x7f9558107150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.821+0000 7f95577fe700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95580f55c0 0x7f9558107150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.821+0000 7f95577fe700 1 -- 172.21.15.33:0/3494897800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9548005040 con 0x7f95580f6860 2024-02-15T18:32:46.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.821+0000 7f95577fe700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f6860 0x7f9558107640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f954c009390 tx=0x7f954c006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:46.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.823+0000 7f9554ff9700 1 -- 172.21.15.33:0/3494897800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954c013640 con 0x7f95580f6860 2024-02-15T18:32:46.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.823+0000 7f9554ff9700 1 -- 172.21.15.33:0/3494897800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f954c009e40 con 0x7f95580f6860 2024-02-15T18:32:46.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.823+0000 7f9554ff9700 1 -- 172.21.15.33:0/3494897800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954c00dbf0 con 0x7f95580f6860 2024-02-15T18:32:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.823+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95581087b0 con 0x7f95580f6860 2024-02-15T18:32:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.823+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9558108d70 con 0x7f95580f6860 2024-02-15T18:32:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.825+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95580f49b0 con 0x7f95580f6860 2024-02-15T18:32:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.825+0000 7f9554ff9700 1 -- 172.21.15.33:0/3494897800 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f954c01a060 con 0x7f95580f6860 2024-02-15T18:32:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.825+0000 7f9554ff9700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9540061020 0x7f95400634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.825+0000 7f9554ff9700 1 -- 172.21.15.33:0/3494897800 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f954c07c090 con 0x7f95580f6860 2024-02-15T18:32:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.825+0000 7f9557fff700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9540061020 0x7f95400634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.826+0000 7f9557fff700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9540061020 0x7f95400634e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9548004e30 tx=0x7f9548009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:46.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:46.830+0000 7f9554ff9700 1 -- 172.21.15.33:0/3494897800 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f954c04fe70 con 0x7f95580f6860 2024-02-15T18:32:47.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.157+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9558045ad0 con 0x7f95580f6860 2024-02-15T18:32:47.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.158+0000 7f9554ff9700 1 -- 172.21.15.33:0/3494897800 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1831 (secure 0 0 0) 0x7f954c04fa60 con 0x7f95580f6860 2024-02-15T18:32:47.151 INFO:teuthology.orchestra.run.smithi033.stdout:e19 2024-02-15T18:32:47.151 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:32:47.151 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:32:47.151 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:32:47.151 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:32:47.151 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 19 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:31:16.192509+0000 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:32:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:32:47.153 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:47.154 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:32:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:32:47.154 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:32:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:32:47.154 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:47.154 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:32:47.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.159+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9540061020 msgr2=0x7f95400634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:47.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.159+0000 7f955e46b700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9540061020 0x7f95400634e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9548004e30 tx=0x7f9548009b30).stop 2024-02-15T18:32:47.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.159+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f6860 msgr2=0x7f9558107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:47.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.159+0000 7f955e46b700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f6860 0x7f9558107640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f954c009390 tx=0x7f954c006e20).stop 2024-02-15T18:32:47.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.159+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 shutdown_connections 2024-02-15T18:32:47.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.160+0000 7f955e46b700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9540061020 0x7f95400634e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:47.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.160+0000 7f955e46b700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95580f55c0 0x7f9558107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:47.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.160+0000 7f955e46b700 1 --2- 172.21.15.33:0/3494897800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95580f6860 0x7f9558107640 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:47.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.160+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 >> 172.21.15.33:0/3494897800 conn(0x7f95580f0d40 msgr2=0x7f95580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:47.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.160+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 shutdown_connections 2024-02-15T18:32:47.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.160+0000 7f955e46b700 1 -- 172.21.15.33:0/3494897800 wait complete. 2024-02-15T18:32:47.156 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-02-15T18:32:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 -- 172.21.15.33:0/4164624244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 msgr2=0x7f8a500fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 --2- 172.21.15.33:0/4164624244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 0x7f8a500fbc70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8a3c004660 tx=0x7f8a3c009b30).stop 2024-02-15T18:32:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 -- 172.21.15.33:0/4164624244 shutdown_connections 2024-02-15T18:32:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 --2- 172.21.15.33:0/4164624244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 0x7f8a500fbc70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 --2- 172.21.15.33:0/4164624244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a50060310 0x7f8a500f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 -- 172.21.15.33:0/4164624244 >> 172.21.15.33:0/4164624244 conn(0x7f8a500f0d40 msgr2=0x7f8a500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 -- 172.21.15.33:0/4164624244 shutdown_connections 2024-02-15T18:32:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 -- 172.21.15.33:0/4164624244 wait complete. 2024-02-15T18:32:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 Processor -- start 2024-02-15T18:32:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.266+0000 7f8a57134700 1 -- start start 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a57134700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a50060310 0x7f8a500f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a57134700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 0x7f8a500f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a57134700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500f5700 con 0x7f8a500f9820 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a57134700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500f5840 con 0x7f8a50060310 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 0x7f8a500f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a4ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 0x7f8a500f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46536/0 (socket says 172.21.15.33:46536) 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a4ffff700 1 -- 172.21.15.33:0/3167933830 learned_addr learned my addr 172.21.15.33:0/3167933830 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a54ed0700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a50060310 0x7f8a500f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a4ffff700 1 -- 172.21.15.33:0/3167933830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a50060310 msgr2=0x7f8a500f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a4ffff700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a50060310 0x7f8a500f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a4ffff700 1 -- 172.21.15.33:0/3167933830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c005040 con 0x7f8a500f9820 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.267+0000 7f8a4ffff700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 0x7f8a500f51a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8a3c002040 tx=0x7f8a3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.268+0000 7f8a4d7fa700 1 -- 172.21.15.33:0/3167933830 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c019070 con 0x7f8a500f9820 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.268+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a500f5ac0 con 0x7f8a500f9820 2024-02-15T18:32:47.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.268+0000 7f8a4d7fa700 1 -- 172.21.15.33:0/3167933830 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f8a3c007e80 con 0x7f8a500f9820 2024-02-15T18:32:47.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.268+0000 7f8a4d7fa700 1 -- 172.21.15.33:0/3167933830 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c014db0 con 0x7f8a500f9820 2024-02-15T18:32:47.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.268+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a500f6020 con 0x7f8a500f9820 2024-02-15T18:32:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.269+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a50045ad0 con 0x7f8a500f9820 2024-02-15T18:32:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.269+0000 7f8a4d7fa700 1 -- 172.21.15.33:0/3167933830 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 29) v1 ==== 77246+0+0 (secure 0 0 0) 0x7f8a3c025070 con 0x7f8a500f9820 2024-02-15T18:32:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.270+0000 7f8a4d7fa700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8a40060f50 0x7f8a40063410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:32:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.270+0000 7f8a4d7fa700 1 -- 172.21.15.33:0/3167933830 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8a3c07d100 con 0x7f8a500f9820 2024-02-15T18:32:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.270+0000 7f8a54ed0700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8a40060f50 0x7f8a40063410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:32:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.270+0000 7f8a54ed0700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8a40060f50 0x7f8a40063410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8a500f6ab0 tx=0x7f8a4400b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:32:47.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.274+0000 7f8a4d7fa700 1 -- 172.21.15.33:0/3167933830 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8a3c04d490 con 0x7f8a500f9820 2024-02-15T18:32:47.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.474+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a50057f10 con 0x7f8a40060f50 2024-02-15T18:32:47.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.475+0000 7f8a4d7fa700 1 -- 172.21.15.33:0/3167933830 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f8a50057f10 con 0x7f8a40060f50 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: "mon" 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "4/21 daemons upgraded", 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading crash daemons", 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:32:47.469 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:32:47.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.478+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8a40060f50 msgr2=0x7f8a40063410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:47.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.478+0000 7f8a57134700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8a40060f50 0x7f8a40063410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8a500f6ab0 tx=0x7f8a4400b040).stop 2024-02-15T18:32:47.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.478+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 msgr2=0x7f8a500f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:32:47.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.478+0000 7f8a57134700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 0x7f8a500f51a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8a3c002040 tx=0x7f8a3c00b040).stop 2024-02-15T18:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.478+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 shutdown_connections 2024-02-15T18:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.479+0000 7f8a57134700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8a40060f50 0x7f8a40063410 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.479+0000 7f8a57134700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a50060310 0x7f8a500f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.479+0000 7f8a57134700 1 --2- 172.21.15.33:0/3167933830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a500f9820 0x7f8a500f51a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.479+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 >> 172.21.15.33:0/3167933830 conn(0x7f8a500f0d40 msgr2=0x7f8a500f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.479+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 shutdown_connections 2024-02-15T18:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:32:47.479+0000 7f8a57134700 1 -- 172.21.15.33:0/3167933830 wait complete. 2024-02-15T18:32:47.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:45.629194+0000 mgr.smithi033.apxevf (mgr.14626) 66 : audit [DBG] from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:47.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:46.006484+0000 mgr.smithi033.apxevf (mgr.14626) 67 : audit [DBG] from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:47.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:46.321576+0000 mgr.smithi033.apxevf (mgr.14626) 68 : audit [DBG] from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:47.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:46.700146+0000 mon.smithi033 (mon.0) 49 : audit [DBG] from='client.? 172.21.15.33:0/666914410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:47.159624+0000 mon.smithi033 (mon.0) 50 : audit [DBG] from='client.? 172.21.15.33:0/3494897800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:32:47.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:47.228345+0000 mon.smithi033 (mon.0) 51 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:47.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:47.229261+0000 mon.smithi033 (mon.0) 52 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:47.886 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:45.629194+0000 mgr.smithi033.apxevf (mgr.14626) 66 : audit [DBG] from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:47.886 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:46.006484+0000 mgr.smithi033.apxevf (mgr.14626) 67 : audit [DBG] from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:47.886 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:46.321576+0000 mgr.smithi033.apxevf (mgr.14626) 68 : audit [DBG] from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:47.886 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:46.700146+0000 mon.smithi033 (mon.0) 49 : audit [DBG] from='client.? 172.21.15.33:0/666914410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:47.886 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:47.159624+0000 mon.smithi033 (mon.0) 50 : audit [DBG] from='client.? 172.21.15.33:0/3494897800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:32:47.886 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:47.228345+0000 mon.smithi033 (mon.0) 51 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:47.886 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:47.229261+0000 mon.smithi033 (mon.0) 52 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:48.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:47.466239+0000 mgr.smithi033.apxevf (mgr.14626) 69 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 303 op/s 2024-02-15T18:32:48.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:47.476999+0000 mgr.smithi033.apxevf (mgr.14626) 70 : audit [DBG] from='client.34144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:48.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:47.466239+0000 mgr.smithi033.apxevf (mgr.14626) 69 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 314 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.4 MiB/s wr, 303 op/s 2024-02-15T18:32:48.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:47.476999+0000 mgr.smithi033.apxevf (mgr.14626) 70 : audit [DBG] from='client.34144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:32:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:49.466803+0000 mgr.smithi033.apxevf (mgr.14626) 71 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 437 op/s 2024-02-15T18:32:50.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:49.466803+0000 mgr.smithi033.apxevf (mgr.14626) 71 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 437 op/s 2024-02-15T18:32:52.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:51.132039+0000 mon.smithi033 (mon.0) 53 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:52.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:51.467151+0000 mgr.smithi033.apxevf (mgr.14626) 72 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-02-15T18:32:52.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:51.132039+0000 mon.smithi033 (mon.0) 53 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:52.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:51.467151+0000 mgr.smithi033.apxevf (mgr.14626) 72 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-02-15T18:32:54.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:53.467566+0000 mgr.smithi033.apxevf (mgr.14626) 73 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-02-15T18:32:54.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:53.467566+0000 mgr.smithi033.apxevf (mgr.14626) 73 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 291 op/s 2024-02-15T18:32:56.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:55.467984+0000 mgr.smithi033.apxevf (mgr.14626) 74 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 400 op/s 2024-02-15T18:32:56.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.064299+0000 mon.smithi033 (mon.0) 54 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:56.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.378493+0000 mon.smithi033 (mon.0) 55 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:56.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.379243+0000 mon.smithi033 (mon.0) 56 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:56.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.383497+0000 mon.smithi033 (mon.0) 57 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.388180+0000 mon.smithi033 (mon.0) 58 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.390183+0000 mon.smithi033 (mon.0) 59 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.391251+0000 mon.smithi033 (mon.0) 60 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.392295+0000 mon.smithi033 (mon.0) 61 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.396110+0000 mon.smithi033 (mon.0) 62 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.396927+0000 mon.smithi033 (mon.0) 63 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]: dispatch 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.400047+0000 mon.smithi033 (mon.0) 64 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]': finished 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.400687+0000 mon.smithi033 (mon.0) 65 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi131"}]: dispatch 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.403265+0000 mon.smithi033 (mon.0) 66 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi131"}]': finished 2024-02-15T18:32:56.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.404331+0000 mon.smithi033 (mon.0) 67 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T18:32:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:55.467984+0000 mgr.smithi033.apxevf (mgr.14626) 74 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 400 op/s 2024-02-15T18:32:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.064299+0000 mon.smithi033 (mon.0) 54 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.378493+0000 mon.smithi033 (mon.0) 55 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.379243+0000 mon.smithi033 (mon.0) 56 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:32:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.383497+0000 mon.smithi033 (mon.0) 57 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.388180+0000 mon.smithi033 (mon.0) 58 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:32:56.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.390183+0000 mon.smithi033 (mon.0) 59 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:56.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.391251+0000 mon.smithi033 (mon.0) 60 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:56.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.392295+0000 mon.smithi033 (mon.0) 61 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:32:56.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.396110+0000 mon.smithi033 (mon.0) 62 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:56.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.396927+0000 mon.smithi033 (mon.0) 63 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]: dispatch 2024-02-15T18:32:56.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.400047+0000 mon.smithi033 (mon.0) 64 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]': finished 2024-02-15T18:32:56.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.400687+0000 mon.smithi033 (mon.0) 65 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi131"}]: dispatch 2024-02-15T18:32:56.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.403265+0000 mon.smithi033 (mon.0) 66 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi131"}]': finished 2024-02-15T18:32:56.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.404331+0000 mon.smithi033 (mon.0) 67 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T18:32:57.728 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:56.379892+0000 mgr.smithi033.apxevf (mgr.14626) 75 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:57.728 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:56.392818+0000 mgr.smithi033.apxevf (mgr.14626) 76 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-15T18:32:57.728 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:56.404455+0000 mgr.smithi033.apxevf (mgr.14626) 77 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T18:32:57.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:56.405109+0000 mgr.smithi033.apxevf (mgr.14626) 78 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-15T18:32:57.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:56.379892+0000 mgr.smithi033.apxevf (mgr.14626) 75 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:32:57.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:56.392818+0000 mgr.smithi033.apxevf (mgr.14626) 76 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-15T18:32:57.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:56.404455+0000 mgr.smithi033.apxevf (mgr.14626) 77 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-15T18:32:57.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:56.405109+0000 mgr.smithi033.apxevf (mgr.14626) 78 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-15T18:32:58.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:57.468286+0000 mgr.smithi033.apxevf (mgr.14626) 79 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-02-15T18:32:58.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:58.206858+0000 mon.smithi033 (mon.0) 68 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:58.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:58.207633+0000 mon.smithi033 (mon.0) 69 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T18:32:58.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:32:58.208267+0000 mon.smithi033 (mon.0) 70 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:58.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:57.468286+0000 mgr.smithi033.apxevf (mgr.14626) 79 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 319 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-02-15T18:32:58.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:58.206858+0000 mon.smithi033 (mon.0) 68 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:32:58.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:58.207633+0000 mon.smithi033 (mon.0) 69 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-15T18:32:58.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:32:58.208267+0000 mon.smithi033 (mon.0) 70 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:32:59.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:58.203091+0000 mgr.smithi033.apxevf (mgr.14626) 80 : cephadm [INF] Upgrade: Updating osd.0 2024-02-15T18:32:59.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:32:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:32:58.209274+0000 mgr.smithi033.apxevf (mgr.14626) 81 : cephadm [INF] Deploying daemon osd.0 on smithi033 2024-02-15T18:33:00.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:58.203091+0000 mgr.smithi033.apxevf (mgr.14626) 80 : cephadm [INF] Upgrade: Updating osd.0 2024-02-15T18:33:00.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:32:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:32:58.209274+0000 mgr.smithi033.apxevf (mgr.14626) 81 : cephadm [INF] Deploying daemon osd.0 on smithi033 2024-02-15T18:33:00.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:59.468762+0000 mgr.smithi033.apxevf (mgr.14626) 82 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 362 op/s 2024-02-15T18:33:00.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:32:59.536598+0000 mon.smithi033 (mon.0) 71 : cluster [DBG] mgrmap e30: smithi033.apxevf(active, since 92s), standbys: smithi131.buibla 2024-02-15T18:33:01.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:59.468762+0000 mgr.smithi033.apxevf (mgr.14626) 82 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 362 op/s 2024-02-15T18:33:01.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:32:59.536598+0000 mon.smithi033 (mon.0) 71 : cluster [DBG] mgrmap e30: smithi033.apxevf(active, since 92s), standbys: smithi131.buibla 2024-02-15T18:33:01.921 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:01 smithi033 systemd[1]: Stopping Ceph osd.0 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:33:01.922 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.0[48194]: debug 2024-02-15T18:33:01.926+0000 7fc0edae6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:33:01.922 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.0[48194]: debug 2024-02-15T18:33:01.926+0000 7fc0edae6700 -1 osd.0 49 *** Got signal Terminated *** 2024-02-15T18:33:01.922 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.0[48194]: debug 2024-02-15T18:33:01.926+0000 7fc0edae6700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:33:02.682 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:02 smithi033 bash[80243]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.0 2024-02-15T18:33:02.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:01.469057+0000 mgr.smithi033.apxevf (mgr.14626) 83 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 227 op/s 2024-02-15T18:33:02.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180021+0000 mon.smithi033 (mon.0) 72 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:33:02.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180049+0000 mon.smithi033 (mon.0) 73 : cluster [INF] osd.0 failed (root=default,host=smithi033) (connection refused reported by osd.1) 2024-02-15T18:33:02.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180182+0000 mon.smithi033 (mon.0) 74 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:33:02.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180299+0000 mon.smithi033 (mon.0) 75 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:33:02.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180346+0000 mon.smithi033 (mon.0) 76 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:33:02.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180466+0000 mon.smithi033 (mon.0) 77 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:33:02.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180577+0000 mon.smithi033 (mon.0) 78 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:33:02.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180660+0000 mon.smithi033 (mon.0) 79 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180735+0000 mon.smithi033 (mon.0) 80 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180805+0000 mon.smithi033 (mon.0) 81 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180875+0000 mon.smithi033 (mon.0) 82 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.180941+0000 mon.smithi033 (mon.0) 83 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.181011+0000 mon.smithi033 (mon.0) 84 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.181081+0000 mon.smithi033 (mon.0) 85 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.296349+0000 mon.smithi033 (mon.0) 86 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.305020+0000 mon.smithi033 (mon.0) 87 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.497034+0000 mon.smithi033 (mon.0) 88 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:33:02.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.505537+0000 mon.smithi033 (mon.0) 89 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:33:02.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:01.469057+0000 mgr.smithi033.apxevf (mgr.14626) 83 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 1.1 MiB/s wr, 227 op/s 2024-02-15T18:33:02.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180021+0000 mon.smithi033 (mon.0) 72 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:33:02.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180049+0000 mon.smithi033 (mon.0) 73 : cluster [INF] osd.0 failed (root=default,host=smithi033) (connection refused reported by osd.1) 2024-02-15T18:33:02.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180182+0000 mon.smithi033 (mon.0) 74 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:33:02.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180299+0000 mon.smithi033 (mon.0) 75 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:33:02.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180346+0000 mon.smithi033 (mon.0) 76 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:33:02.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180466+0000 mon.smithi033 (mon.0) 77 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180577+0000 mon.smithi033 (mon.0) 78 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180660+0000 mon.smithi033 (mon.0) 79 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180735+0000 mon.smithi033 (mon.0) 80 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180805+0000 mon.smithi033 (mon.0) 81 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180875+0000 mon.smithi033 (mon.0) 82 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.180941+0000 mon.smithi033 (mon.0) 83 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.181011+0000 mon.smithi033 (mon.0) 84 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.181081+0000 mon.smithi033 (mon.0) 85 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.296349+0000 mon.smithi033 (mon.0) 86 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.305020+0000 mon.smithi033 (mon.0) 87 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.497034+0000 mon.smithi033 (mon.0) 88 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-15T18:33:02.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.505537+0000 mon.smithi033 (mon.0) 89 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-15T18:33:03.047 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:02 smithi033 bash[80297]: Error: no container with name or ID "ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.0" found: no such container 2024-02-15T18:33:03.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.541042+0000 mon.smithi033 (mon.0) 90 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:33:03.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:02.548133+0000 mon.smithi033 (mon.0) 91 : cluster [DBG] osdmap e50: 6 total, 5 up, 6 in 2024-02-15T18:33:03.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.541042+0000 mon.smithi033 (mon.0) 90 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:33:03.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:02.548133+0000 mon.smithi033 (mon.0) 91 : cluster [DBG] osdmap e50: 6 total, 5 up, 6 in 2024-02-15T18:33:04.599 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-15T18:33:04.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-15T18:33:04.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:03.469374+0000 mgr.smithi033.apxevf (mgr.14626) 84 : cluster [DBG] pgmap v54: 65 pgs: 9 stale+active+clean, 56 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 272 op/s 2024-02-15T18:33:04.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:03.557024+0000 mon.smithi033 (mon.0) 92 : cluster [DBG] osdmap e51: 6 total, 5 up, 6 in 2024-02-15T18:33:04.798 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:04 smithi033 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.0.service: Succeeded. 2024-02-15T18:33:04.798 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:04 smithi033 systemd[1]: Stopped Ceph osd.0 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:33:04.798 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:04 smithi033 systemd[1]: Starting Ceph osd.0 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:33:04.921 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:03.469374+0000 mgr.smithi033.apxevf (mgr.14626) 84 : cluster [DBG] pgmap v54: 65 pgs: 9 stale+active+clean, 56 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 272 op/s 2024-02-15T18:33:04.921 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:03.557024+0000 mon.smithi033 (mon.0) 92 : cluster [DBG] osdmap e51: 6 total, 5 up, 6 in 2024-02-15T18:33:04.921 DEBUG:teuthology.parallel:result is None 2024-02-15T18:33:04.922 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-15T18:33:04.965 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-15T18:33:04.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-15T18:33:05.021 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-15T18:33:05.021 DEBUG:teuthology.parallel:result is None 2024-02-15T18:33:05.914 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:05.469786+0000 mgr.smithi033.apxevf (mgr.14626) 85 : cluster [DBG] pgmap v56: 65 pgs: 34 peering, 31 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 294 op/s 2024-02-15T18:33:05.914 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:05.553983+0000 mon.smithi033 (mon.0) 93 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-15T18:33:05.915 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:05 smithi033 bash[80555]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:33:05.915 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:05 smithi033 bash[80555]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T18:33:05.915 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:05 smithi033 bash[80555]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-02-15T18:33:05.915 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:05 smithi033 bash[80555]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-15T18:33:05.915 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:05 smithi033 bash[80555]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-02-15T18:33:05.915 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:05 smithi033 bash[80555]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T18:33:05.915 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:05 smithi033 bash[80555]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-15T18:33:05.915 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:05 smithi033 bash[80555]: --> ceph-volume lvm activate successful for osd ID: 0 2024-02-15T18:33:05.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:05.469786+0000 mgr.smithi033.apxevf (mgr.14626) 85 : cluster [DBG] pgmap v56: 65 pgs: 34 peering, 31 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 294 op/s 2024-02-15T18:33:05.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:05.553983+0000 mon.smithi033 (mon.0) 93 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-15T18:33:07.297 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-0[80872]: debug 2024-02-15T18:33:06.930+0000 7f8d0ea61700 1 -- 172.21.15.33:0/1722335697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5604c5d2c680 con 0x5604c5cf3000 2024-02-15T18:33:07.298 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:07 smithi033 bash[80857]: d5594d5916e2689812bff0caf37ac820f20fc5db4e31cd91a8fa6c6ae9bcddea 2024-02-15T18:33:07.298 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:07 smithi033 systemd[1]: Started Ceph osd.0 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:33:07.797 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-0[80872]: debug 2024-02-15T18:33:07.449+0000 7f8d164ef380 -1 Falling back to public interface 2024-02-15T18:33:08.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:07.048881+0000 mon.smithi033 (mon.0) 94 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:08.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:07.056452+0000 mon.smithi033 (mon.0) 95 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:08.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:07.300367+0000 mon.smithi033 (mon.0) 96 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:08.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:07.470175+0000 mgr.smithi033.apxevf (mgr.14626) 86 : cluster [DBG] pgmap v57: 65 pgs: 34 peering, 31 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 605 KiB/s wr, 117 op/s 2024-02-15T18:33:08.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:07.048881+0000 mon.smithi033 (mon.0) 94 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:08.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:07.056452+0000 mon.smithi033 (mon.0) 95 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:08.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:07.300367+0000 mon.smithi033 (mon.0) 96 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:08.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:07.470175+0000 mgr.smithi033.apxevf (mgr.14626) 86 : cluster [DBG] pgmap v57: 65 pgs: 34 peering, 31 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 605 KiB/s wr, 117 op/s 2024-02-15T18:33:10.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:09.470987+0000 mgr.smithi033.apxevf (mgr.14626) 87 : cluster [DBG] pgmap v58: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 825 KiB/s wr, 205 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:10.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:09.470987+0000 mgr.smithi033.apxevf (mgr.14626) 87 : cluster [DBG] pgmap v58: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 825 KiB/s wr, 205 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:11.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:10.116492+0000 mon.smithi033 (mon.0) 97 : cluster [WRN] Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 29 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:11.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:10.116527+0000 mon.smithi033 (mon.0) 98 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-15T18:33:11.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:10.116492+0000 mon.smithi033 (mon.0) 97 : cluster [WRN] Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 29 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:11.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:10.116527+0000 mon.smithi033 (mon.0) 98 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-15T18:33:12.297 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:11.471401+0000 mgr.smithi033.apxevf (mgr.14626) 88 : cluster [DBG] pgmap v59: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 739 KiB/s wr, 184 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:12.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:11.471401+0000 mgr.smithi033.apxevf (mgr.14626) 88 : cluster [DBG] pgmap v59: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 739 KiB/s wr, 184 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:13.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:12.651591+0000 mon.smithi033 (mon.0) 99 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:13.471866+0000 mgr.smithi033.apxevf (mgr.14626) 89 : cluster [DBG] pgmap v60: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 660 KiB/s wr, 164 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.606099+0000 mon.smithi033 (mon.0) 100 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.606949+0000 mon.smithi033 (mon.0) 101 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.607613+0000 mon.smithi033 (mon.0) 102 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.611358+0000 mon.smithi033 (mon.0) 103 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.617061+0000 mon.smithi033 (mon.0) 104 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.619243+0000 mon.smithi033 (mon.0) 105 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.620512+0000 mon.smithi033 (mon.0) 106 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.621758+0000 mon.smithi033 (mon.0) 107 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:13.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.622960+0000 mon.smithi033 (mon.0) 108 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:12.651591+0000 mon.smithi033 (mon.0) 99 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:13.471866+0000 mgr.smithi033.apxevf (mgr.14626) 89 : cluster [DBG] pgmap v60: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 660 KiB/s wr, 164 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.606099+0000 mon.smithi033 (mon.0) 100 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.606949+0000 mon.smithi033 (mon.0) 101 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.607613+0000 mon.smithi033 (mon.0) 102 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:33:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.611358+0000 mon.smithi033 (mon.0) 103 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.617061+0000 mon.smithi033 (mon.0) 104 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.619243+0000 mon.smithi033 (mon.0) 105 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.620512+0000 mon.smithi033 (mon.0) 106 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:13.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.621758+0000 mon.smithi033 (mon.0) 107 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:13.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.622960+0000 mon.smithi033 (mon.0) 108 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:14.547 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-0[80872]: debug 2024-02-15T18:33:14.274+0000 7f8d164ef380 -1 osd.0 49 log_to_monitors {default=true} 2024-02-15T18:33:15.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:33:13.608177+0000 mgr.smithi033.apxevf (mgr.14626) 90 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:15.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:13.623103+0000 mgr.smithi033.apxevf (mgr.14626) 91 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:15.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:33:13.623778+0000 mgr.smithi033.apxevf (mgr.14626) 92 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-15T18:33:15.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:14.278557+0000 mon.smithi033 (mon.0) 109 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1034368821,v1:172.21.15.33:6803/1034368821]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T18:33:15.547 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:33:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-0[80872]: debug 2024-02-15T18:33:15.136+0000 7f8d051d1700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:33:15.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:33:13.608177+0000 mgr.smithi033.apxevf (mgr.14626) 90 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:33:15.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:13.623103+0000 mgr.smithi033.apxevf (mgr.14626) 91 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:15.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:33:13.623778+0000 mgr.smithi033.apxevf (mgr.14626) 92 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-15T18:33:15.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:14.278557+0000 mon.smithi033 (mon.0) 109 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1034368821,v1:172.21.15.33:6803/1034368821]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-15T18:33:16.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:15.129538+0000 mon.smithi033 (mon.0) 110 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1034368821,v1:172.21.15.33:6803/1034368821]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T18:33:16.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:15.129598+0000 mon.smithi033 (mon.0) 111 : cluster [DBG] osdmap e52: 6 total, 5 up, 6 in 2024-02-15T18:33:16.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:15.130196+0000 mon.smithi033 (mon.0) 112 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1034368821,v1:172.21.15.33:6803/1034368821]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:33:16.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:15.472407+0000 mgr.smithi033.apxevf (mgr.14626) 93 : cluster [DBG] pgmap v62: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 6.8 KiB/s rd, 186 KiB/s wr, 72 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:16.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:15.129538+0000 mon.smithi033 (mon.0) 110 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1034368821,v1:172.21.15.33:6803/1034368821]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-15T18:33:16.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:15.129598+0000 mon.smithi033 (mon.0) 111 : cluster [DBG] osdmap e52: 6 total, 5 up, 6 in 2024-02-15T18:33:16.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:15.130196+0000 mon.smithi033 (mon.0) 112 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/1034368821,v1:172.21.15.33:6803/1034368821]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:33:16.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:15.472407+0000 mgr.smithi033.apxevf (mgr.14626) 93 : cluster [DBG] pgmap v62: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 6.8 KiB/s rd, 186 KiB/s wr, 72 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:17.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:16.125623+0000 mon.smithi033 (mon.0) 113 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:33:17.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:16.130061+0000 mon.smithi033 (mon.0) 114 : cluster [INF] osd.0 [v2:172.21.15.33:6802/1034368821,v1:172.21.15.33:6803/1034368821] boot 2024-02-15T18:33:17.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:16.130145+0000 mon.smithi033 (mon.0) 115 : cluster [DBG] osdmap e53: 6 total, 6 up, 6 in 2024-02-15T18:33:17.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:16.130882+0000 mon.smithi033 (mon.0) 116 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:33:17.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:17.131143+0000 mon.smithi033 (mon.0) 117 : cluster [DBG] osdmap e54: 6 total, 6 up, 6 in 2024-02-15T18:33:17.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:16.125623+0000 mon.smithi033 (mon.0) 113 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:33:17.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:16.130061+0000 mon.smithi033 (mon.0) 114 : cluster [INF] osd.0 [v2:172.21.15.33:6802/1034368821,v1:172.21.15.33:6803/1034368821] boot 2024-02-15T18:33:17.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:16.130145+0000 mon.smithi033 (mon.0) 115 : cluster [DBG] osdmap e53: 6 total, 6 up, 6 in 2024-02-15T18:33:17.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:16.130882+0000 mon.smithi033 (mon.0) 116 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-15T18:33:17.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:17.131143+0000 mon.smithi033 (mon.0) 117 : cluster [DBG] osdmap e54: 6 total, 6 up, 6 in 2024-02-15T18:33:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.587+0000 7f37e3e39700 1 -- 172.21.15.33:0/1223342677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 msgr2=0x7f37dc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.587+0000 7f37e3e39700 1 --2- 172.21.15.33:0/1223342677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 0x7f37dc0f59e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f37d8004660 tx=0x7f37d8009b30).stop 2024-02-15T18:33:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.587+0000 7f37e3e39700 1 -- 172.21.15.33:0/1223342677 shutdown_connections 2024-02-15T18:33:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.587+0000 7f37e3e39700 1 --2- 172.21.15.33:0/1223342677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37dc0f6860 0x7f37dc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.587+0000 7f37e3e39700 1 --2- 172.21.15.33:0/1223342677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 0x7f37dc0f59e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.587+0000 7f37e3e39700 1 -- 172.21.15.33:0/1223342677 >> 172.21.15.33:0/1223342677 conn(0x7f37dc0f0d40 msgr2=0x7f37dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.587+0000 7f37e3e39700 1 -- 172.21.15.33:0/1223342677 shutdown_connections 2024-02-15T18:33:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.587+0000 7f37e3e39700 1 -- 172.21.15.33:0/1223342677 wait complete. 2024-02-15T18:33:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e3e39700 1 Processor -- start 2024-02-15T18:33:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e3e39700 1 -- start start 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e3e39700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 0x7f37dc1091f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e3e39700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37dc0f6860 0x7f37dc1096e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e3e39700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc109c90 con 0x7f37dc0f55c0 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e3e39700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc109dd0 con 0x7f37dc0f6860 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e1bd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 0x7f37dc1091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e1bd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 0x7f37dc1091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34638/0 (socket says 172.21.15.33:34638) 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e1bd5700 1 -- 172.21.15.33:0/2310450881 learned_addr learned my addr 172.21.15.33:0/2310450881 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e13d4700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37dc0f6860 0x7f37dc1096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e1bd5700 1 -- 172.21.15.33:0/2310450881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37dc0f6860 msgr2=0x7f37dc1096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e1bd5700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37dc0f6860 0x7f37dc1096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e1bd5700 1 -- 172.21.15.33:0/2310450881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d8005040 con 0x7f37dc0f55c0 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.588+0000 7f37e1bd5700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 0x7f37dc1091f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f37d80043d0 tx=0x7f37d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.589+0000 7f37d27fc700 1 -- 172.21.15.33:0/2310450881 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37d8018070 con 0x7f37dc0f55c0 2024-02-15T18:33:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.589+0000 7f37d27fc700 1 -- 172.21.15.33:0/2310450881 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f37d8007ba0 con 0x7f37dc0f55c0 2024-02-15T18:33:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.589+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc10a710 con 0x7f37dc0f55c0 2024-02-15T18:33:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.589+0000 7f37d27fc700 1 -- 172.21.15.33:0/2310450881 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37d801dea0 con 0x7f37dc0f55c0 2024-02-15T18:33:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.589+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc10abf0 con 0x7f37dc0f55c0 2024-02-15T18:33:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.590+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc045ad0 con 0x7f37dc0f55c0 2024-02-15T18:33:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.590+0000 7f37d27fc700 1 -- 172.21.15.33:0/2310450881 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f37d801d420 con 0x7f37dc0f55c0 2024-02-15T18:33:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.590+0000 7f37d27fc700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f37c8060f20 0x7f37c80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.591+0000 7f37d27fc700 1 -- 172.21.15.33:0/2310450881 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f37d807dd00 con 0x7f37dc0f55c0 2024-02-15T18:33:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.591+0000 7f37e13d4700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f37c8060f20 0x7f37c80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.591+0000 7f37e13d4700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f37c8060f20 0x7f37c80633e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f37cc004ce0 tx=0x7f37cc00b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:17.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.595+0000 7f37d27fc700 1 -- 172.21.15.33:0/2310450881 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f37d8081030 con 0x7f37dc0f55c0 2024-02-15T18:33:17.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.786+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37dc0fb8d0 con 0x7f37c8060f20 2024-02-15T18:33:17.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.787+0000 7f37d27fc700 1 -- 172.21.15.33:0/2310450881 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f37dc0fb8d0 con 0x7f37c8060f20 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.789+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f37c8060f20 msgr2=0x7f37c80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.789+0000 7f37e3e39700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f37c8060f20 0x7f37c80633e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f37cc004ce0 tx=0x7f37cc00b040).stop 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.789+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 msgr2=0x7f37dc1091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.789+0000 7f37e3e39700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 0x7f37dc1091f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f37d80043d0 tx=0x7f37d8009b30).stop 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.789+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 shutdown_connections 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.789+0000 7f37e3e39700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f37c8060f20 0x7f37c80633e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.789+0000 7f37e3e39700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37dc0f55c0 0x7f37dc1091f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.789+0000 7f37e3e39700 1 --2- 172.21.15.33:0/2310450881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37dc0f6860 0x7f37dc1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.789+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 >> 172.21.15.33:0/2310450881 conn(0x7f37dc0f0d40 msgr2=0x7f37dc05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.790+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 shutdown_connections 2024-02-15T18:33:17.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.790+0000 7f37e3e39700 1 -- 172.21.15.33:0/2310450881 wait complete. 2024-02-15T18:33:17.794 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:33:17.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 -- 172.21.15.33:0/207119848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f7980 msgr2=0x7f1c5c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:17.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 --2- 172.21.15.33:0/207119848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f7980 0x7f1c5c0f7de0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1c50004660 tx=0x7f1c50009b30).stop 2024-02-15T18:33:17.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 -- 172.21.15.33:0/207119848 shutdown_connections 2024-02-15T18:33:17.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 --2- 172.21.15.33:0/207119848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f7980 0x7f1c5c0f7de0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:17.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 --2- 172.21.15.33:0/207119848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c5c0f66e0 0x7f1c5c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 -- 172.21.15.33:0/207119848 >> 172.21.15.33:0/207119848 conn(0x7f1c5c0f1e40 msgr2=0x7f1c5c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 -- 172.21.15.33:0/207119848 shutdown_connections 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 -- 172.21.15.33:0/207119848 wait complete. 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 Processor -- start 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 -- start start 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f66e0 0x7f1c5c109200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c5c0f7980 0x7f1c5c1096f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c109ca0 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.896+0000 7f1c60e18700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c109de0 con 0x7f1c5c0f7980 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f66e0 0x7f1c5c109200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f66e0 0x7f1c5c109200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34666/0 (socket says 172.21.15.33:34666) 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c5a59c700 1 -- 172.21.15.33:0/363714506 learned_addr learned my addr 172.21.15.33:0/363714506 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:17.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c59d9b700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c5c0f7980 0x7f1c5c1096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c5a59c700 1 -- 172.21.15.33:0/363714506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c5c0f7980 msgr2=0x7f1c5c1096f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c5a59c700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c5c0f7980 0x7f1c5c1096f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c5a59c700 1 -- 172.21.15.33:0/363714506 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50005040 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c5a59c700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f66e0 0x7f1c5c109200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1c4c00e7c0 tx=0x7f1c4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c4affd700 1 -- 172.21.15.33:0/363714506 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4c0092e0 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c10a780 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c4affd700 1 -- 172.21.15.33:0/363714506 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f1c4c00f040 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.897+0000 7f1c4affd700 1 -- 172.21.15.33:0/363714506 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4c014920 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.898+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c10ad40 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.898+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c045ad0 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.899+0000 7f1c4affd700 1 -- 172.21.15.33:0/363714506 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f1c4c01b030 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.899+0000 7f1c4affd700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1c44060f20 0x7f1c440633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:17.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.899+0000 7f1c4affd700 1 -- 172.21.15.33:0/363714506 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f1c4c07c050 con 0x7f1c5c0f66e0 2024-02-15T18:33:17.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.899+0000 7f1c59d9b700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1c44060f20 0x7f1c440633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:17.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.900+0000 7f1c59d9b700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1c44060f20 0x7f1c440633e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1c50009720 tx=0x7f1c50016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:17.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:17.903+0000 7f1c4affd700 1 -- 172.21.15.33:0/363714506 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1c4c04ff00 con 0x7f1c5c0f66e0 2024-02-15T18:33:18.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.092+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c5c0ff0f0 con 0x7f1c44060f20 2024-02-15T18:33:18.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.093+0000 7f1c4affd700 1 -- 172.21.15.33:0/363714506 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1c5c0ff0f0 con 0x7f1c44060f20 2024-02-15T18:33:18.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.095+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1c44060f20 msgr2=0x7f1c440633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.095+0000 7f1c60e18700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1c44060f20 0x7f1c440633e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1c50009720 tx=0x7f1c50016040).stop 2024-02-15T18:33:18.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.095+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f66e0 msgr2=0x7f1c5c109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.095+0000 7f1c60e18700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f66e0 0x7f1c5c109200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1c4c00e7c0 tx=0x7f1c4c00b040).stop 2024-02-15T18:33:18.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.095+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 shutdown_connections 2024-02-15T18:33:18.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.095+0000 7f1c60e18700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1c44060f20 0x7f1c440633e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.095+0000 7f1c60e18700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c5c0f66e0 0x7f1c5c109200 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.095+0000 7f1c60e18700 1 --2- 172.21.15.33:0/363714506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c5c0f7980 0x7f1c5c1096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.095+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 >> 172.21.15.33:0/363714506 conn(0x7f1c5c0f1e40 msgr2=0x7f1c5c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:18.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.096+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 shutdown_connections 2024-02-15T18:33:18.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.096+0000 7f1c60e18700 1 -- 172.21.15.33:0/363714506 wait complete. 2024-02-15T18:33:18.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.199+0000 7f4de87ac700 1 -- 172.21.15.33:0/2089638105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f55c0 msgr2=0x7f4de00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.199+0000 7f4de87ac700 1 --2- 172.21.15.33:0/2089638105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f55c0 0x7f4de00f59e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4ddc004660 tx=0x7f4ddc009b30).stop 2024-02-15T18:33:18.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.199+0000 7f4de87ac700 1 -- 172.21.15.33:0/2089638105 shutdown_connections 2024-02-15T18:33:18.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.199+0000 7f4de87ac700 1 --2- 172.21.15.33:0/2089638105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4de00f6860 0x7f4de00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.199+0000 7f4de87ac700 1 --2- 172.21.15.33:0/2089638105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f55c0 0x7f4de00f59e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.199+0000 7f4de87ac700 1 -- 172.21.15.33:0/2089638105 >> 172.21.15.33:0/2089638105 conn(0x7f4de00f0d40 msgr2=0x7f4de00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:18.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.199+0000 7f4de87ac700 1 -- 172.21.15.33:0/2089638105 shutdown_connections 2024-02-15T18:33:18.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.199+0000 7f4de87ac700 1 -- 172.21.15.33:0/2089638105 wait complete. 2024-02-15T18:33:18.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de87ac700 1 Processor -- start 2024-02-15T18:33:18.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de87ac700 1 -- start start 2024-02-15T18:33:18.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de87ac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4de00f55c0 0x7f4de0105f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:18.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de87ac700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f6860 0x7f4de01063f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:18.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de87ac700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de01069a0 con 0x7f4de00f6860 2024-02-15T18:33:18.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de87ac700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0106ae0 con 0x7f4de00f55c0 2024-02-15T18:33:18.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de5d47700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f6860 0x7f4de01063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de5d47700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f6860 0x7f4de01063f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34678/0 (socket says 172.21.15.33:34678) 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de5d47700 1 -- 172.21.15.33:0/2813861611 learned_addr learned my addr 172.21.15.33:0/2813861611 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.200+0000 7f4de6548700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4de00f55c0 0x7f4de0105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.201+0000 7f4de5d47700 1 -- 172.21.15.33:0/2813861611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4de00f55c0 msgr2=0x7f4de0105f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.201+0000 7f4de5d47700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4de00f55c0 0x7f4de0105f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.201+0000 7f4de5d47700 1 -- 172.21.15.33:0/2813861611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc005040 con 0x7f4de00f6860 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.201+0000 7f4de6548700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4de00f55c0 0x7f4de0105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.201+0000 7f4de5d47700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f6860 0x7f4de01063f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4dd000e7f0 tx=0x7f4dd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.201+0000 7f4dd6ffd700 1 -- 172.21.15.33:0/2813861611 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dd00092e0 con 0x7f4de00f6860 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.201+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de0107480 con 0x7f4de00f6860 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.201+0000 7f4dd6ffd700 1 -- 172.21.15.33:0/2813861611 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f4dd000f040 con 0x7f4de00f6860 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.201+0000 7f4dd6ffd700 1 -- 172.21.15.33:0/2813861611 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dd0014850 con 0x7f4de00f6860 2024-02-15T18:33:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.202+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de0107a40 con 0x7f4de00f6860 2024-02-15T18:33:18.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.203+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de0045ad0 con 0x7f4de00f6860 2024-02-15T18:33:18.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.203+0000 7f4dd6ffd700 1 -- 172.21.15.33:0/2813861611 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f4dd001b030 con 0x7f4de00f6860 2024-02-15T18:33:18.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.203+0000 7f4dd6ffd700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4dcc060f20 0x7f4dcc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:18.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.203+0000 7f4dd6ffd700 1 -- 172.21.15.33:0/2813861611 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4dd007bfb0 con 0x7f4de00f6860 2024-02-15T18:33:18.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.203+0000 7f4de6548700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4dcc060f20 0x7f4dcc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:18.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.203+0000 7f4de6548700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4dcc060f20 0x7f4dcc0633e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ddc005010 tx=0x7f4ddc016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:18.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.211+0000 7f4dd6ffd700 1 -- 172.21.15.33:0/2813861611 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4dd004fee0 con 0x7f4de00f6860 2024-02-15T18:33:18.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.394+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4de0107c30 con 0x7f4dcc060f20 2024-02-15T18:33:18.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.403+0000 7f4dd6ffd700 1 -- 172.21.15.33:0/2813861611 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4de0107c30 con 0x7f4dcc060f20 2024-02-15T18:33:18.395 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:33:18.395 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (8m) 4s ago 9m 19.5M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:33:18.395 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (39s) 4s ago 9m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:33:18.395 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (31s) 27s ago 8m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (8m) 4s ago 9m 34.2M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (4m) 4s ago 4m 17.1M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (4m) 4s ago 4m 12.8M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (4m) 27s ago 4m 128M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (4m) 27s ago 4m 147M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (119s) 4s ago 11m 429M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (80s) 27s ago 8m 388M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (69s) 4s ago 11m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (51s) 27s ago 8m 25.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (9m) 4s ago 9m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (8m) 27s ago 8m 17.0M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (11s) 4s ago 8m 12.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (7m) 4s ago 7m 389M 4096M 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (7m) 4s ago 7m 324M 4096M 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (7m) 27s ago 7m 440M 4096M 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:33:18.396 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (6m) 27s ago 6m 437M 4096M 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:33:18.397 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (6m) 27s ago 6m 387M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:33:18.397 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (2m) 4s ago 9m 61.3M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:33:18.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4dcc060f20 msgr2=0x7f4dcc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4dcc060f20 0x7f4dcc0633e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f4ddc005010 tx=0x7f4ddc016040).stop 2024-02-15T18:33:18.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f6860 msgr2=0x7f4de01063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f6860 0x7f4de01063f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4dd000e7f0 tx=0x7f4dd000b040).stop 2024-02-15T18:33:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 shutdown_connections 2024-02-15T18:33:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4dcc060f20 0x7f4dcc0633e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4de00f55c0 0x7f4de0105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 --2- 172.21.15.33:0/2813861611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4de00f6860 0x7f4de01063f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 >> 172.21.15.33:0/2813861611 conn(0x7f4de00f0d40 msgr2=0x7f4de00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 shutdown_connections 2024-02-15T18:33:18.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.405+0000 7f4de87ac700 1 -- 172.21.15.33:0/2813861611 wait complete. 2024-02-15T18:33:18.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:17.472934+0000 mgr.smithi033.apxevf (mgr.14626) 94 : cluster [DBG] pgmap v65: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 17 KiB/s wr, 2 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 -- 172.21.15.33:0/270600029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 msgr2=0x7fafd80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 --2- 172.21.15.33:0/270600029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 0x7fafd80f6b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fafcc004660 tx=0x7fafcc009b30).stop 2024-02-15T18:33:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 -- 172.21.15.33:0/270600029 shutdown_connections 2024-02-15T18:33:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 --2- 172.21.15.33:0/270600029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd80f7980 0x7fafd80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 --2- 172.21.15.33:0/270600029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 0x7fafd80f6b00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 -- 172.21.15.33:0/270600029 >> 172.21.15.33:0/270600029 conn(0x7fafd80f1e40 msgr2=0x7fafd80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 -- 172.21.15.33:0/270600029 shutdown_connections 2024-02-15T18:33:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 -- 172.21.15.33:0/270600029 wait complete. 2024-02-15T18:33:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 Processor -- start 2024-02-15T18:33:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.507+0000 7fafdee83700 1 -- start start 2024-02-15T18:33:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdee83700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 0x7fafd8107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdee83700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd80f7980 0x7fafd8107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdee83700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8107ad0 con 0x7fafd80f66e0 2024-02-15T18:33:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdee83700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8107c10 con 0x7fafd80f7980 2024-02-15T18:33:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdcc1f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 0x7fafd8107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:18.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdcc1f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 0x7fafd8107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34690/0 (socket says 172.21.15.33:34690) 2024-02-15T18:33:18.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdcc1f700 1 -- 172.21.15.33:0/640127161 learned_addr learned my addr 172.21.15.33:0/640127161 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:18.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafd7fff700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd80f7980 0x7fafd8107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:18.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdcc1f700 1 -- 172.21.15.33:0/640127161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd80f7980 msgr2=0x7fafd8107520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdcc1f700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd80f7980 0x7fafd8107520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdcc1f700 1 -- 172.21.15.33:0/640127161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4005040 con 0x7fafd80f66e0 2024-02-15T18:33:18.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.508+0000 7fafdcc1f700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 0x7fafd8107030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fafcc000c00 tx=0x7fafcc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:18.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.509+0000 7fafd57fa700 1 -- 172.21.15.33:0/640127161 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafcc019070 con 0x7fafd80f66e0 2024-02-15T18:33:18.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.509+0000 7fafd57fa700 1 -- 172.21.15.33:0/640127161 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fafcc014420 con 0x7fafd80f66e0 2024-02-15T18:33:18.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.509+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc005040 con 0x7fafd80f66e0 2024-02-15T18:33:18.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.509+0000 7fafd57fa700 1 -- 172.21.15.33:0/640127161 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafcc01d620 con 0x7fafd80f66e0 2024-02-15T18:33:18.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.509+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd8108920 con 0x7fafd80f66e0 2024-02-15T18:33:18.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.510+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd8045ad0 con 0x7fafd80f66e0 2024-02-15T18:33:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.510+0000 7fafd57fa700 1 -- 172.21.15.33:0/640127161 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fafcc025070 con 0x7fafd80f66e0 2024-02-15T18:33:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.511+0000 7fafd57fa700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fafc8060f20 0x7fafc80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.511+0000 7fafd57fa700 1 -- 172.21.15.33:0/640127161 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fafcc07d080 con 0x7fafd80f66e0 2024-02-15T18:33:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.511+0000 7fafd7fff700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fafc8060f20 0x7fafc80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.511+0000 7fafd7fff700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fafc8060f20 0x7fafc80633e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fafc4009050 tx=0x7fafc400b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:18.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.515+0000 7fafd57fa700 1 -- 172.21.15.33:0/640127161 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fafcc050f30 con 0x7fafd80f66e0 2024-02-15T18:33:18.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:17.472934+0000 mgr.smithi033.apxevf (mgr.14626) 94 : cluster [DBG] pgmap v65: 65 pgs: 29 active+undersized+degraded, 5 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 17 KiB/s wr, 2 op/s; 70/357 objects degraded (19.608%) 2024-02-15T18:33:18.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.761+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fafd8100ed0 con 0x7fafd80f66e0 2024-02-15T18:33:18.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.762+0000 7fafd57fa700 1 -- 172.21.15.33:0/640127161 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7fafcc023020 con 0x7fafd80f66e0 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:33:18.754 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2024-02-15T18:33:18.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:33:18.755 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:33:18.755 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:33:18.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:33:18.755 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:33:18.755 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 5, 2024-02-15T18:33:18.755 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9 2024-02-15T18:33:18.755 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:33:18.755 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:33:18.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.763+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fafc8060f20 msgr2=0x7fafc80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.763+0000 7fafdee83700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fafc8060f20 0x7fafc80633e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fafc4009050 tx=0x7fafc400b040).stop 2024-02-15T18:33:18.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.763+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 msgr2=0x7fafd8107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.763+0000 7fafdee83700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 0x7fafd8107030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fafcc000c00 tx=0x7fafcc00b040).stop 2024-02-15T18:33:18.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.763+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 shutdown_connections 2024-02-15T18:33:18.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.763+0000 7fafdee83700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fafc8060f20 0x7fafc80633e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.763+0000 7fafdee83700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafd80f66e0 0x7fafd8107030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.763+0000 7fafdee83700 1 --2- 172.21.15.33:0/640127161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafd80f7980 0x7fafd8107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.764+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 >> 172.21.15.33:0/640127161 conn(0x7fafd80f1e40 msgr2=0x7fafd80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:18.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.764+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 shutdown_connections 2024-02-15T18:33:18.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.764+0000 7fafdee83700 1 -- 172.21.15.33:0/640127161 wait complete. 2024-02-15T18:33:18.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.865+0000 7fd351612700 1 -- 172.21.15.33:0/4217642644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 msgr2=0x7fd34c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.865+0000 7fd351612700 1 --2- 172.21.15.33:0/4217642644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 0x7fd34c0f5850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd33c004660 tx=0x7fd33c009b30).stop 2024-02-15T18:33:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.865+0000 7fd351612700 1 -- 172.21.15.33:0/4217642644 shutdown_connections 2024-02-15T18:33:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.865+0000 7fd351612700 1 --2- 172.21.15.33:0/4217642644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd34c0f66d0 0x7fd34c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.865+0000 7fd351612700 1 --2- 172.21.15.33:0/4217642644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 0x7fd34c0f5850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.865+0000 7fd351612700 1 -- 172.21.15.33:0/4217642644 >> 172.21.15.33:0/4217642644 conn(0x7fd34c0f0b90 msgr2=0x7fd34c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.865+0000 7fd351612700 1 -- 172.21.15.33:0/4217642644 shutdown_connections 2024-02-15T18:33:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.865+0000 7fd351612700 1 -- 172.21.15.33:0/4217642644 wait complete. 2024-02-15T18:33:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.866+0000 7fd351612700 1 Processor -- start 2024-02-15T18:33:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.866+0000 7fd351612700 1 -- start start 2024-02-15T18:33:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.866+0000 7fd351612700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 0x7fd34c109010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.866+0000 7fd351612700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd34c0f66d0 0x7fd34c109500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.866+0000 7fd351612700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c109ab0 con 0x7fd34c0f5430 2024-02-15T18:33:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.866+0000 7fd351612700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c109bf0 con 0x7fd34c0f66d0 2024-02-15T18:33:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.866+0000 7fd34bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 0x7fd34c109010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.866+0000 7fd34bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 0x7fd34c109010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34694/0 (socket says 172.21.15.33:34694) 2024-02-15T18:33:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.866+0000 7fd34bfff700 1 -- 172.21.15.33:0/1409427581 learned_addr learned my addr 172.21.15.33:0/1409427581 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd34b7fe700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd34c0f66d0 0x7fd34c109500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd34bfff700 1 -- 172.21.15.33:0/1409427581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd34c0f66d0 msgr2=0x7fd34c109500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd34bfff700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd34c0f66d0 0x7fd34c109500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd34bfff700 1 -- 172.21.15.33:0/1409427581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd340005040 con 0x7fd34c0f5430 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd34bfff700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 0x7fd34c109010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd33c002040 tx=0x7fd33c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd348ff9700 1 -- 172.21.15.33:0/1409427581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33c019070 con 0x7fd34c0f5430 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c005040 con 0x7fd34c0f5430 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd348ff9700 1 -- 172.21.15.33:0/1409427581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd33c007e80 con 0x7fd34c0f5430 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd348ff9700 1 -- 172.21.15.33:0/1409427581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33c014db0 con 0x7fd34c0f5430 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.867+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c10a900 con 0x7fd34c0f5430 2024-02-15T18:33:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.868+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c045ad0 con 0x7fd34c0f5430 2024-02-15T18:33:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.869+0000 7fd348ff9700 1 -- 172.21.15.33:0/1409427581 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd33c025070 con 0x7fd34c0f5430 2024-02-15T18:33:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.869+0000 7fd348ff9700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd334060f10 0x7fd3340633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.869+0000 7fd348ff9700 1 -- 172.21.15.33:0/1409427581 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd33c07d0e0 con 0x7fd34c0f5430 2024-02-15T18:33:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.869+0000 7fd34b7fe700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd334060f10 0x7fd3340633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.869+0000 7fd34b7fe700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd334060f10 0x7fd3340633d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd340009050 tx=0x7fd34000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:18.873+0000 7fd348ff9700 1 -- 172.21.15.33:0/1409427581 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd33c050e70 con 0x7fd34c0f5430 2024-02-15T18:33:19.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.092+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd34c10b0f0 con 0x7fd34c0f5430 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.093+0000 7fd348ff9700 1 -- 172.21.15.33:0/1409427581 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1831 (secure 0 0 0) 0x7fd33c023070 con 0x7fd34c0f5430 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:e19 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 19 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:33:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:31:16.192509+0000 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:33:19.086 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:33:19.087 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:19.088 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:19.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd334060f10 msgr2=0x7fd3340633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:19.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd334060f10 0x7fd3340633d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd340009050 tx=0x7fd34000b040).stop 2024-02-15T18:33:19.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 msgr2=0x7fd34c109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:19.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 0x7fd34c109010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd33c002040 tx=0x7fd33c00b040).stop 2024-02-15T18:33:19.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 shutdown_connections 2024-02-15T18:33:19.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd334060f10 0x7fd3340633d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:19.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd34c0f5430 0x7fd34c109010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:19.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 --2- 172.21.15.33:0/1409427581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd34c0f66d0 0x7fd34c109500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:19.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 >> 172.21.15.33:0/1409427581 conn(0x7fd34c0f0b90 msgr2=0x7fd34c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:19.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 shutdown_connections 2024-02-15T18:33:19.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.095+0000 7fd351612700 1 -- 172.21.15.33:0/1409427581 wait complete. 2024-02-15T18:33:19.089 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.198+0000 7fabb8bbb700 1 -- 172.21.15.33:0/1303171286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f7940 msgr2=0x7fabb40f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.198+0000 7fabb8bbb700 1 --2- 172.21.15.33:0/1303171286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f7940 0x7fabb40f7da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fab9c004660 tx=0x7fab9c009b30).stop 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.198+0000 7fabb8bbb700 1 -- 172.21.15.33:0/1303171286 shutdown_connections 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.198+0000 7fabb8bbb700 1 --2- 172.21.15.33:0/1303171286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f7940 0x7fabb40f7da0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.198+0000 7fabb8bbb700 1 --2- 172.21.15.33:0/1303171286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40f66a0 0x7fabb40f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.198+0000 7fabb8bbb700 1 -- 172.21.15.33:0/1303171286 >> 172.21.15.33:0/1303171286 conn(0x7fabb40f1e00 msgr2=0x7fabb40f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.198+0000 7fabb8bbb700 1 -- 172.21.15.33:0/1303171286 shutdown_connections 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.198+0000 7fabb8bbb700 1 -- 172.21.15.33:0/1303171286 wait complete. 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb8bbb700 1 Processor -- start 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb8bbb700 1 -- start start 2024-02-15T18:33:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb8bbb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f66a0 0x7fabb406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:19.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb8bbb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40f7940 0x7fabb4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:19.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb8bbb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb406a380 con 0x7fabb40f66a0 2024-02-15T18:33:19.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb8bbb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb406a4c0 con 0x7fabb40f7940 2024-02-15T18:33:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f66a0 0x7fabb406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f66a0 0x7fabb406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34720/0 (socket says 172.21.15.33:34720) 2024-02-15T18:33:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb259c700 1 -- 172.21.15.33:0/4079604464 learned_addr learned my addr 172.21.15.33:0/4079604464 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.199+0000 7fabb1d9b700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40f7940 0x7fabb4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.200+0000 7fabb259c700 1 -- 172.21.15.33:0/4079604464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40f7940 msgr2=0x7fabb4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.200+0000 7fabb259c700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40f7940 0x7fabb4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:19.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.200+0000 7fabb259c700 1 -- 172.21.15.33:0/4079604464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c005040 con 0x7fabb40f66a0 2024-02-15T18:33:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.200+0000 7fabb259c700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f66a0 0x7fabb406b9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7faba4002700 tx=0x7faba4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.200+0000 7fabaaffd700 1 -- 172.21.15.33:0/4079604464 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faba40079c0 con 0x7fabb40f66a0 2024-02-15T18:33:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.200+0000 7fabaaffd700 1 -- 172.21.15.33:0/4079604464 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7faba400f040 con 0x7fabb40f66a0 2024-02-15T18:33:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.200+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb406a7a0 con 0x7fabb40f66a0 2024-02-15T18:33:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.200+0000 7fabaaffd700 1 -- 172.21.15.33:0/4079604464 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faba4014940 con 0x7fabb40f66a0 2024-02-15T18:33:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.200+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb410ef00 con 0x7fabb40f66a0 2024-02-15T18:33:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.201+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb4045ad0 con 0x7fabb40f66a0 2024-02-15T18:33:19.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.201+0000 7fabaaffd700 1 -- 172.21.15.33:0/4079604464 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7faba401b060 con 0x7fabb40f66a0 2024-02-15T18:33:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.202+0000 7fabaaffd700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7faba0060f70 0x7faba0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.202+0000 7fabaaffd700 1 -- 172.21.15.33:0/4079604464 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5812+0+0 (secure 0 0 0) 0x7faba407bea0 con 0x7fabb40f66a0 2024-02-15T18:33:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.202+0000 7fabb1d9b700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7faba0060f70 0x7faba0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.202+0000 7fabb1d9b700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7faba0060f70 0x7faba0063430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fab9c004630 tx=0x7fab9c009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:19.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.206+0000 7fabaaffd700 1 -- 172.21.15.33:0/4079604464 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7faba404c3a0 con 0x7fabb40f66a0 2024-02-15T18:33:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.396+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabb40ff0b0 con 0x7faba0060f70 2024-02-15T18:33:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.397+0000 7fabaaffd700 1 -- 172.21.15.33:0/4079604464 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fabb40ff0b0 con 0x7faba0060f70 2024-02-15T18:33:19.389 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:33:19.389 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:33:19.389 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:33:19.389 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:33:19.389 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:33:19.389 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:33:19.390 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:33:19.390 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:33:19.390 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:33:19.390 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "7/21 daemons upgraded", 2024-02-15T18:33:19.390 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:33:19.390 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:33:19.390 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7faba0060f70 msgr2=0x7faba0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7faba0060f70 0x7faba0063430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fab9c004630 tx=0x7fab9c009b30).stop 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f66a0 msgr2=0x7fabb406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f66a0 0x7fabb406b9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7faba4002700 tx=0x7faba4009d80).stop 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 shutdown_connections 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7faba0060f70 0x7faba0063430 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabb40f66a0 0x7fabb406b9a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 --2- 172.21.15.33:0/4079604464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fabb40f7940 0x7fabb4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 >> 172.21.15.33:0/4079604464 conn(0x7fabb40f1e00 msgr2=0x7fabb40fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 shutdown_connections 2024-02-15T18:33:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:19.399+0000 7fabb8bbb700 1 -- 172.21.15.33:0/4079604464 wait complete. 2024-02-15T18:33:19.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:17.787795+0000 mgr.smithi033.apxevf (mgr.14626) 95 : audit [DBG] from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:19.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:18.093885+0000 mgr.smithi033.apxevf (mgr.14626) 96 : audit [DBG] from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:19.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:18.395719+0000 mgr.smithi033.apxevf (mgr.14626) 97 : audit [DBG] from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:19.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:18.762498+0000 mon.smithi033 (mon.0) 118 : audit [DBG] from='client.? 172.21.15.33:0/640127161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:19.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:19.093772+0000 mon.smithi033 (mon.0) 119 : audit [DBG] from='client.? 172.21.15.33:0/1409427581' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:33:19.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:17.787795+0000 mgr.smithi033.apxevf (mgr.14626) 95 : audit [DBG] from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:19.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:18.093885+0000 mgr.smithi033.apxevf (mgr.14626) 96 : audit [DBG] from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:19.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:18.395719+0000 mgr.smithi033.apxevf (mgr.14626) 97 : audit [DBG] from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:19.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:18.762498+0000 mon.smithi033 (mon.0) 118 : audit [DBG] from='client.? 172.21.15.33:0/640127161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:19.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:19.093772+0000 mon.smithi033 (mon.0) 119 : audit [DBG] from='client.? 172.21.15.33:0/1409427581' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:33:20.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:19.397723+0000 mgr.smithi033.apxevf (mgr.14626) 98 : audit [DBG] from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:20.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:19.473420+0000 mgr.smithi033.apxevf (mgr.14626) 99 : cluster [DBG] pgmap v66: 65 pgs: 7 active+undersized+degraded, 7 active+recovery_wait+degraded, 1 active+recovering, 2 active+undersized, 48 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 18 KiB/s wr, 2 op/s; 168/357 objects degraded (47.059%); 271 KiB/s, 2 objects/s recovering 2024-02-15T18:33:20.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:19.397723+0000 mgr.smithi033.apxevf (mgr.14626) 98 : audit [DBG] from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:20.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:19.473420+0000 mgr.smithi033.apxevf (mgr.14626) 99 : cluster [DBG] pgmap v66: 65 pgs: 7 active+undersized+degraded, 7 active+recovery_wait+degraded, 1 active+recovering, 2 active+undersized, 48 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 341 B/s rd, 18 KiB/s wr, 2 op/s; 168/357 objects degraded (47.059%); 271 KiB/s, 2 objects/s recovering 2024-02-15T18:33:21.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:20.152007+0000 mon.smithi033 (mon.0) 120 : cluster [WRN] Health check update: Degraded data redundancy: 168/357 objects degraded (47.059%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:21.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:20.152007+0000 mon.smithi033 (mon.0) 120 : cluster [WRN] Health check update: Degraded data redundancy: 168/357 objects degraded (47.059%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:22.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:21.474002+0000 mgr.smithi033.apxevf (mgr.14626) 100 : cluster [DBG] pgmap v67: 65 pgs: 11 active+recovery_wait+degraded, 2 active+recovering, 52 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 322 B/s wr, 0 op/s; 236/357 objects degraded (66.106%); 343 KiB/s, 7 objects/s recovering 2024-02-15T18:33:22.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:21.474002+0000 mgr.smithi033.apxevf (mgr.14626) 100 : cluster [DBG] pgmap v67: 65 pgs: 11 active+recovery_wait+degraded, 2 active+recovering, 52 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 322 B/s wr, 0 op/s; 236/357 objects degraded (66.106%); 343 KiB/s, 7 objects/s recovering 2024-02-15T18:33:24.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:23.474523+0000 mgr.smithi033.apxevf (mgr.14626) 101 : cluster [DBG] pgmap v68: 65 pgs: 11 active+recovery_wait+degraded, 2 active+recovering, 52 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 236/357 objects degraded (66.106%); 272 KiB/s, 5 objects/s recovering 2024-02-15T18:33:24.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:23.474523+0000 mgr.smithi033.apxevf (mgr.14626) 101 : cluster [DBG] pgmap v68: 65 pgs: 11 active+recovery_wait+degraded, 2 active+recovering, 52 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 236/357 objects degraded (66.106%); 272 KiB/s, 5 objects/s recovering 2024-02-15T18:33:25.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:25.474972+0000 mgr.smithi033.apxevf (mgr.14626) 102 : cluster [DBG] pgmap v69: 65 pgs: 6 active+recovery_wait+degraded, 1 active+recovering, 58 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 547 B/s wr, 0 op/s; 121/357 objects degraded (33.894%); 233 KiB/s, 16 objects/s recovering 2024-02-15T18:33:25.918 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:25.527948+0000 mon.smithi033 (mon.0) 121 : cluster [WRN] Health check update: Degraded data redundancy: 121/357 objects degraded (33.894%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:25.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:25.474972+0000 mgr.smithi033.apxevf (mgr.14626) 102 : cluster [DBG] pgmap v69: 65 pgs: 6 active+recovery_wait+degraded, 1 active+recovering, 58 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 547 B/s wr, 0 op/s; 121/357 objects degraded (33.894%); 233 KiB/s, 16 objects/s recovering 2024-02-15T18:33:25.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:25.527948+0000 mon.smithi033 (mon.0) 121 : cluster [WRN] Health check update: Degraded data redundancy: 121/357 objects degraded (33.894%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:28.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:27.475491+0000 mgr.smithi033.apxevf (mgr.14626) 103 : cluster [DBG] pgmap v70: 65 pgs: 6 active+recovery_wait+degraded, 1 active+recovering, 58 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 494 B/s wr, 0 op/s; 121/357 objects degraded (33.894%); 210 KiB/s, 14 objects/s recovering 2024-02-15T18:33:28.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:27.652321+0000 mon.smithi033 (mon.0) 122 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:28.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:27.475491+0000 mgr.smithi033.apxevf (mgr.14626) 103 : cluster [DBG] pgmap v70: 65 pgs: 6 active+recovery_wait+degraded, 1 active+recovering, 58 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 494 B/s wr, 0 op/s; 121/357 objects degraded (33.894%); 210 KiB/s, 14 objects/s recovering 2024-02-15T18:33:28.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:27.652321+0000 mon.smithi033 (mon.0) 122 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:28.639170+0000 mon.smithi033 (mon.0) 123 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:28.639170+0000 mon.smithi033 (mon.0) 123 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:30.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:28.639348+0000 mgr.smithi033.apxevf (mgr.14626) 104 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:30.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:33:28.640280+0000 mgr.smithi033.apxevf (mgr.14626) 105 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-02-15T18:33:30.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:29.476029+0000 mgr.smithi033.apxevf (mgr.14626) 106 : cluster [DBG] pgmap v71: 65 pgs: 4 active+recovery_wait+degraded, 2 active+recovering, 59 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s; 76/357 objects degraded (21.289%); 181 KiB/s, 16 objects/s recovering 2024-02-15T18:33:30.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:28.639348+0000 mgr.smithi033.apxevf (mgr.14626) 104 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:30.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:33:28.640280+0000 mgr.smithi033.apxevf (mgr.14626) 105 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-02-15T18:33:30.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:29.476029+0000 mgr.smithi033.apxevf (mgr.14626) 106 : cluster [DBG] pgmap v71: 65 pgs: 4 active+recovery_wait+degraded, 2 active+recovering, 59 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s; 76/357 objects degraded (21.289%); 181 KiB/s, 16 objects/s recovering 2024-02-15T18:33:31.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:31.476422+0000 mgr.smithi033.apxevf (mgr.14626) 107 : cluster [DBG] pgmap v72: 65 pgs: 2 active+recovery_wait+degraded, 2 active+recovering, 61 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 40/357 objects degraded (11.204%); 46 KiB/s, 18 objects/s recovering 2024-02-15T18:33:31.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:31.531709+0000 mon.smithi033 (mon.0) 124 : cluster [WRN] Health check update: Degraded data redundancy: 40/357 objects degraded (11.204%), 2 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:32.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:31.476422+0000 mgr.smithi033.apxevf (mgr.14626) 107 : cluster [DBG] pgmap v72: 65 pgs: 2 active+recovery_wait+degraded, 2 active+recovering, 61 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 40/357 objects degraded (11.204%); 46 KiB/s, 18 objects/s recovering 2024-02-15T18:33:32.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:31.531709+0000 mon.smithi033 (mon.0) 124 : cluster [WRN] Health check update: Degraded data redundancy: 40/357 objects degraded (11.204%), 2 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:34.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:33.476848+0000 mgr.smithi033.apxevf (mgr.14626) 108 : cluster [DBG] pgmap v73: 65 pgs: 2 active+recovery_wait+degraded, 2 active+recovering, 61 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 40/357 objects degraded (11.204%); 0 B/s, 15 objects/s recovering 2024-02-15T18:33:34.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:33.476848+0000 mgr.smithi033.apxevf (mgr.14626) 108 : cluster [DBG] pgmap v73: 65 pgs: 2 active+recovery_wait+degraded, 2 active+recovering, 61 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 40/357 objects degraded (11.204%); 0 B/s, 15 objects/s recovering 2024-02-15T18:33:35.914 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:35.477360+0000 mgr.smithi033.apxevf (mgr.14626) 109 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 0 B/s, 20 objects/s recovering 2024-02-15T18:33:35.914 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:35.530852+0000 mon.smithi033 (mon.0) 125 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/357 objects degraded (11.204%), 2 pgs degraded) 2024-02-15T18:33:35.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:35.477360+0000 mgr.smithi033.apxevf (mgr.14626) 109 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 0 B/s, 20 objects/s recovering 2024-02-15T18:33:35.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:35.530852+0000 mon.smithi033 (mon.0) 125 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/357 objects degraded (11.204%), 2 pgs degraded) 2024-02-15T18:33:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:37.477780+0000 mgr.smithi033.apxevf (mgr.14626) 110 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 11 objects/s recovering 2024-02-15T18:33:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:37.477780+0000 mgr.smithi033.apxevf (mgr.14626) 110 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 11 objects/s recovering 2024-02-15T18:33:40.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:39.478264+0000 mgr.smithi033.apxevf (mgr.14626) 111 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 11 objects/s recovering 2024-02-15T18:33:40.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:39.478264+0000 mgr.smithi033.apxevf (mgr.14626) 111 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 11 objects/s recovering 2024-02-15T18:33:42.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:41.478839+0000 mgr.smithi033.apxevf (mgr.14626) 112 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 7 objects/s recovering 2024-02-15T18:33:42.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:41.478839+0000 mgr.smithi033.apxevf (mgr.14626) 112 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 7 objects/s recovering 2024-02-15T18:33:43.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:42.654791+0000 mon.smithi033 (mon.0) 126 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:43.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:42.694364+0000 mon.smithi033 (mon.0) 127 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:43.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:43.479246+0000 mgr.smithi033.apxevf (mgr.14626) 113 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 4 objects/s recovering 2024-02-15T18:33:43.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:43.643739+0000 mon.smithi033 (mon.0) 128 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:43.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:42.654791+0000 mon.smithi033 (mon.0) 126 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:43.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:42.694364+0000 mon.smithi033 (mon.0) 127 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:43.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:43.479246+0000 mgr.smithi033.apxevf (mgr.14626) 113 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 4 objects/s recovering 2024-02-15T18:33:43.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:43.643739+0000 mon.smithi033 (mon.0) 128 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:45.297 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:43.643973+0000 mgr.smithi033.apxevf (mgr.14626) 114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:45.298 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:33:43.645076+0000 mgr.smithi033.apxevf (mgr.14626) 115 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-15T18:33:45.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:43.643973+0000 mgr.smithi033.apxevf (mgr.14626) 114 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-15T18:33:45.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:33:43.645076+0000 mgr.smithi033.apxevf (mgr.14626) 115 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-15T18:33:46.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:33:45.383936+0000 mgr.smithi033.apxevf (mgr.14626) 116 : cephadm [INF] Upgrade: Updating osd.1 2024-02-15T18:33:46.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:45.388655+0000 mon.smithi033 (mon.0) 129 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:46.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:45.389520+0000 mon.smithi033 (mon.0) 130 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T18:33:46.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:45.390233+0000 mon.smithi033 (mon.0) 131 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:46.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:33:45.391293+0000 mgr.smithi033.apxevf (mgr.14626) 117 : cephadm [INF] Deploying daemon osd.1 on smithi033 2024-02-15T18:33:46.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:45.479794+0000 mgr.smithi033.apxevf (mgr.14626) 118 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 4 objects/s recovering 2024-02-15T18:33:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:33:45.383936+0000 mgr.smithi033.apxevf (mgr.14626) 116 : cephadm [INF] Upgrade: Updating osd.1 2024-02-15T18:33:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:45.388655+0000 mon.smithi033 (mon.0) 129 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:45.389520+0000 mon.smithi033 (mon.0) 130 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-15T18:33:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:45.390233+0000 mon.smithi033 (mon.0) 131 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:33:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:33:45.391293+0000 mgr.smithi033.apxevf (mgr.14626) 117 : cephadm [INF] Deploying daemon osd.1 on smithi033 2024-02-15T18:33:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:45.479794+0000 mgr.smithi033.apxevf (mgr.14626) 118 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 4 objects/s recovering 2024-02-15T18:33:48.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:47.480198+0000 mgr.smithi033.apxevf (mgr.14626) 119 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:33:48.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:47.480198+0000 mgr.smithi033.apxevf (mgr.14626) 119 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:33:49.235 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:49 smithi033 systemd[1]: Stopping Ceph osd.1 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:33:49.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.504+0000 7fbd069de700 1 -- 172.21.15.33:0/1691679937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 msgr2=0x7fbd000f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:49.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.504+0000 7fbd069de700 1 --2- 172.21.15.33:0/1691679937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 0x7fbd000f7c30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fbcf0004660 tx=0x7fbcf0009b30).stop 2024-02-15T18:33:49.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.505+0000 7fbd069de700 1 -- 172.21.15.33:0/1691679937 shutdown_connections 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.505+0000 7fbd069de700 1 --2- 172.21.15.33:0/1691679937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 0x7fbd000f7c30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.505+0000 7fbd069de700 1 --2- 172.21.15.33:0/1691679937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd000f6530 0x7fbd000f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.505+0000 7fbd069de700 1 -- 172.21.15.33:0/1691679937 >> 172.21.15.33:0/1691679937 conn(0x7fbd000f1c90 msgr2=0x7fbd000f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.505+0000 7fbd069de700 1 -- 172.21.15.33:0/1691679937 shutdown_connections 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.505+0000 7fbd069de700 1 -- 172.21.15.33:0/1691679937 wait complete. 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.505+0000 7fbd069de700 1 Processor -- start 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.505+0000 7fbd069de700 1 -- start start 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd069de700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd069de700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd069de700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0006a380 con 0x7fbd000f77d0 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd069de700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0006a4c0 con 0x7fbd000f6530 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd051db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd051db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60600/0 (socket says 172.21.15.33:60600) 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd051db700 1 -- 172.21.15.33:0/626432350 learned_addr learned my addr 172.21.15.33:0/626432350 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd059dc700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd051db700 1 -- 172.21.15.33:0/626432350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd000f6530 msgr2=0x7fbd0006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd051db700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd051db700 1 -- 172.21.15.33:0/626432350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0005040 con 0x7fbd000f77d0 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd059dc700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd051db700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fbcf0009f50 tx=0x7fbcf0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbcf67fc700 1 -- 172.21.15.33:0/626432350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcf0018070 con 0x7fbd000f77d0 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbcf67fc700 1 -- 172.21.15.33:0/626432350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fbcf0007ba0 con 0x7fbd000f77d0 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0006a740 con 0x7fbd000f77d0 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbcf67fc700 1 -- 172.21.15.33:0/626432350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcf001c620 con 0x7fbd000f77d0 2024-02-15T18:33:49.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.506+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0006ac20 con 0x7fbd000f77d0 2024-02-15T18:33:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.507+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd00045ad0 con 0x7fbd000f77d0 2024-02-15T18:33:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.508+0000 7fbcf67fc700 1 -- 172.21.15.33:0/626432350 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fbcf001c890 con 0x7fbd000f77d0 2024-02-15T18:33:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.508+0000 7fbcf67fc700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbcec060f70 0x7fbcec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:49.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.508+0000 7fbcf67fc700 1 -- 172.21.15.33:0/626432350 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fbcf007df50 con 0x7fbd000f77d0 2024-02-15T18:33:49.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.508+0000 7fbd059dc700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbcec060f70 0x7fbcec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:49.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.509+0000 7fbd059dc700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbcec060f70 0x7fbcec063430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fbcfc009880 tx=0x7fbcfc00b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.513+0000 7fbcf67fc700 1 -- 172.21.15.33:0/626432350 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbcf00acf60 con 0x7fbd000f77d0 2024-02-15T18:33:49.547 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.1[52262]: debug 2024-02-15T18:33:49.241+0000 7f1ec0862700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:33:49.547 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.1[52262]: debug 2024-02-15T18:33:49.241+0000 7f1ec0862700 -1 osd.1 54 *** Got signal Terminated *** 2024-02-15T18:33:49.547 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.1[52262]: debug 2024-02-15T18:33:49.241+0000 7f1ec0862700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:33:49.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.710+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd000fef10 con 0x7fbcec060f70 2024-02-15T18:33:49.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.711+0000 7fbcf67fc700 1 -- 172.21.15.33:0/626432350 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fbd000fef10 con 0x7fbcec060f70 2024-02-15T18:33:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbcec060f70 msgr2=0x7fbcec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbcec060f70 0x7fbcec063430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fbcfc009880 tx=0x7fbcfc00b040).stop 2024-02-15T18:33:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 msgr2=0x7fbd00069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fbcf0009f50 tx=0x7fbcf0009b30).stop 2024-02-15T18:33:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 shutdown_connections 2024-02-15T18:33:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbcec060f70 0x7fbcec063430 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd000f6530 0x7fbd0006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 --2- 172.21.15.33:0/626432350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd000f77d0 0x7fbd00069e20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 >> 172.21.15.33:0/626432350 conn(0x7fbd000f1c90 msgr2=0x7fbd000fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 shutdown_connections 2024-02-15T18:33:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.713+0000 7fbd069de700 1 -- 172.21.15.33:0/626432350 wait complete. 2024-02-15T18:33:49.716 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:33:49.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.827+0000 7f63650ca700 1 -- 172.21.15.33:0/1196925591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 msgr2=0x7f6360067d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:49.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.827+0000 7f63650ca700 1 --2- 172.21.15.33:0/1196925591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 0x7f6360067d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6350004660 tx=0x7f6350009b30).stop 2024-02-15T18:33:49.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.827+0000 7f63650ca700 1 -- 172.21.15.33:0/1196925591 shutdown_connections 2024-02-15T18:33:49.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.827+0000 7f63650ca700 1 --2- 172.21.15.33:0/1196925591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6360068250 0x7f63600686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:49.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.827+0000 7f63650ca700 1 --2- 172.21.15.33:0/1196925591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 0x7f6360067d60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:49.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.827+0000 7f63650ca700 1 -- 172.21.15.33:0/1196925591 >> 172.21.15.33:0/1196925591 conn(0x7f63600636c0 msgr2=0x7f6360065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:49.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.828+0000 7f63650ca700 1 -- 172.21.15.33:0/1196925591 shutdown_connections 2024-02-15T18:33:49.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.828+0000 7f63650ca700 1 -- 172.21.15.33:0/1196925591 wait complete. 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.828+0000 7f63650ca700 1 Processor -- start 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.828+0000 7f63650ca700 1 -- start start 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f63650ca700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6360068250 0x7f636010d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f63650ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 0x7f636010da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f63650ca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636010e020 con 0x7f63600696d0 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f63650ca700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636010e160 con 0x7f6360068250 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f635e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 0x7f636010da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f635e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 0x7f636010da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60624/0 (socket says 172.21.15.33:60624) 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f635e59c700 1 -- 172.21.15.33:0/686818792 learned_addr learned my addr 172.21.15.33:0/686818792 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f635ed9d700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6360068250 0x7f636010d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f635e59c700 1 -- 172.21.15.33:0/686818792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6360068250 msgr2=0x7f636010d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f635e59c700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6360068250 0x7f636010d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f635e59c700 1 -- 172.21.15.33:0/686818792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6350005040 con 0x7f63600696d0 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f635e59c700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 0x7f636010da20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f63540026d0 tx=0x7f6354009dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f63477fe700 1 -- 172.21.15.33:0/686818792 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63540079c0 con 0x7f63600696d0 2024-02-15T18:33:49.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f63477fe700 1 -- 172.21.15.33:0/686818792 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f635400f040 con 0x7f63600696d0 2024-02-15T18:33:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.829+0000 7f63477fe700 1 -- 172.21.15.33:0/686818792 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6354014950 con 0x7f63600696d0 2024-02-15T18:33:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.830+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636010ead0 con 0x7f63600696d0 2024-02-15T18:33:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.830+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636010f060 con 0x7f63600696d0 2024-02-15T18:33:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.831+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6360045ad0 con 0x7f63600696d0 2024-02-15T18:33:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.832+0000 7f63477fe700 1 -- 172.21.15.33:0/686818792 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f6354007b20 con 0x7f63600696d0 2024-02-15T18:33:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.832+0000 7f63477fe700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6348060f20 0x7f63480633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.832+0000 7f63477fe700 1 -- 172.21.15.33:0/686818792 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f635407c2f0 con 0x7f63600696d0 2024-02-15T18:33:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.833+0000 7f635ed9d700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6348060f20 0x7f63480633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:49.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.833+0000 7f635ed9d700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6348060f20 0x7f63480633e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6350004630 tx=0x7f6350009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:49.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:49.841+0000 7f63477fe700 1 -- 172.21.15.33:0/686818792 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f635404c7f0 con 0x7f63600696d0 2024-02-15T18:33:49.938 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:49 smithi033 bash[83001]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.1 2024-02-15T18:33:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.040+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6360103490 con 0x7f6348060f20 2024-02-15T18:33:50.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.041+0000 7f63477fe700 1 -- 172.21.15.33:0/686818792 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6360103490 con 0x7f6348060f20 2024-02-15T18:33:50.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6348060f20 msgr2=0x7f63480633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6348060f20 0x7f63480633e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6350004630 tx=0x7f6350009b30).stop 2024-02-15T18:33:50.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 msgr2=0x7f636010da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 0x7f636010da20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f63540026d0 tx=0x7f6354009dc0).stop 2024-02-15T18:33:50.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 shutdown_connections 2024-02-15T18:33:50.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6348060f20 0x7f63480633e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6360068250 0x7f636010d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 --2- 172.21.15.33:0/686818792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63600696d0 0x7f636010da20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 >> 172.21.15.33:0/686818792 conn(0x7f63600636c0 msgr2=0x7f6360100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:50.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 shutdown_connections 2024-02-15T18:33:50.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.043+0000 7f63650ca700 1 -- 172.21.15.33:0/686818792 wait complete. 2024-02-15T18:33:50.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.156+0000 7fd15d284700 1 -- 172.21.15.33:0/185421414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 msgr2=0x7fd1580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.156+0000 7fd15d284700 1 --2- 172.21.15.33:0/185421414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 0x7fd1580f59e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd148004660 tx=0x7fd148009b30).stop 2024-02-15T18:33:50.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.156+0000 7fd15d284700 1 -- 172.21.15.33:0/185421414 shutdown_connections 2024-02-15T18:33:50.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.156+0000 7fd15d284700 1 --2- 172.21.15.33:0/185421414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580f6860 0x7fd1580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.156+0000 7fd15d284700 1 --2- 172.21.15.33:0/185421414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 0x7fd1580f59e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.156+0000 7fd15d284700 1 -- 172.21.15.33:0/185421414 >> 172.21.15.33:0/185421414 conn(0x7fd1580f0d40 msgr2=0x7fd1580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.157+0000 7fd15d284700 1 -- 172.21.15.33:0/185421414 shutdown_connections 2024-02-15T18:33:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.157+0000 7fd15d284700 1 -- 172.21.15.33:0/185421414 wait complete. 2024-02-15T18:33:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.157+0000 7fd15d284700 1 Processor -- start 2024-02-15T18:33:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd15d284700 1 -- start start 2024-02-15T18:33:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd15d284700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 0x7fd158105f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd15d284700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580f6860 0x7fd1581063f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd15d284700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1581069a0 con 0x7fd1580f55c0 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd15d284700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd158106ae0 con 0x7fd1580f6860 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd156ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 0x7fd158105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd156ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 0x7fd158105f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60636/0 (socket says 172.21.15.33:60636) 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd156ffd700 1 -- 172.21.15.33:0/1098917477 learned_addr learned my addr 172.21.15.33:0/1098917477 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd14e7fc700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580f6860 0x7fd1581063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd156ffd700 1 -- 172.21.15.33:0/1098917477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580f6860 msgr2=0x7fd1581063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd156ffd700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580f6860 0x7fd1581063f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd156ffd700 1 -- 172.21.15.33:0/1098917477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd148005040 con 0x7fd1580f55c0 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd14e7fc700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580f6860 0x7fd1581063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.158+0000 7fd156ffd700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 0x7fd158105f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd148009f50 tx=0x7fd148009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.159+0000 7fd14ffff700 1 -- 172.21.15.33:0/1098917477 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd14801a070 con 0x7fd1580f55c0 2024-02-15T18:33:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.159+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd158107420 con 0x7fd1580f55c0 2024-02-15T18:33:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.159+0000 7fd14ffff700 1 -- 172.21.15.33:0/1098917477 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd148012ac0 con 0x7fd1580f55c0 2024-02-15T18:33:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.159+0000 7fd14ffff700 1 -- 172.21.15.33:0/1098917477 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd14801fae0 con 0x7fd1580f55c0 2024-02-15T18:33:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.159+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd158107980 con 0x7fd1580f55c0 2024-02-15T18:33:50.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.160+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd158045ad0 con 0x7fd1580f55c0 2024-02-15T18:33:50.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.161+0000 7fd14ffff700 1 -- 172.21.15.33:0/1098917477 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd14801fd50 con 0x7fd1580f55c0 2024-02-15T18:33:50.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.161+0000 7fd14ffff700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd144060f20 0x7fd1440633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:50.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.161+0000 7fd14ffff700 1 -- 172.21.15.33:0/1098917477 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd1480804b0 con 0x7fd1580f55c0 2024-02-15T18:33:50.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.161+0000 7fd14e7fc700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd144060f20 0x7fd1440633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:50.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.162+0000 7fd14e7fc700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd144060f20 0x7fd1440633e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd140004a70 tx=0x7fd140009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:50.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.165+0000 7fd14ffff700 1 -- 172.21.15.33:0/1098917477 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd1480544b0 con 0x7fd1580f55c0 2024-02-15T18:33:50.259 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:49 smithi033 bash[83085]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.1 2024-02-15T18:33:50.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.480613+0000 mgr.smithi033.apxevf (mgr.14626) 120 : cluster [DBG] pgmap v81: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:33:50.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.495558+0000 mon.smithi033 (mon.0) 132 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.495583+0000 mon.smithi033 (mon.0) 133 : cluster [INF] osd.1 failed (root=default,host=smithi033) (connection refused reported by osd.5) 2024-02-15T18:33:50.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.495736+0000 mon.smithi033 (mon.0) 134 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.495826+0000 mon.smithi033 (mon.0) 135 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.496008+0000 mon.smithi033 (mon.0) 136 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.496095+0000 mon.smithi033 (mon.0) 137 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.496153+0000 mon.smithi033 (mon.0) 138 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.496253+0000 mon.smithi033 (mon.0) 139 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.496308+0000 mon.smithi033 (mon.0) 140 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.496471+0000 mon.smithi033 (mon.0) 141 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.496525+0000 mon.smithi033 (mon.0) 142 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.671681+0000 mon.smithi033 (mon.0) 143 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.676282+0000 mon.smithi033 (mon.0) 144 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.689110+0000 mon.smithi033 (mon.0) 145 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.872595+0000 mon.smithi033 (mon.0) 146 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.876928+0000 mon.smithi033 (mon.0) 147 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.889579+0000 mon.smithi033 (mon.0) 148 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.896581+0000 mon.smithi033 (mon.0) 149 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.896632+0000 mon.smithi033 (mon.0) 150 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.896795+0000 mon.smithi033 (mon.0) 151 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.896882+0000 mon.smithi033 (mon.0) 152 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.897011+0000 mon.smithi033 (mon.0) 153 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.897096+0000 mon.smithi033 (mon.0) 154 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.897164+0000 mon.smithi033 (mon.0) 155 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.897239+0000 mon.smithi033 (mon.0) 156 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.897494+0000 mon.smithi033 (mon.0) 157 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:49.897538+0000 mon.smithi033 (mon.0) 158 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:33:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.387+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd158108170 con 0x7fd144060f20 2024-02-15T18:33:50.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.398+0000 7fd14ffff700 1 -- 172.21.15.33:0/1098917477 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd140004670 con 0x7fd144060f20 2024-02-15T18:33:50.390 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:33:50.390 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (8m) 36s ago 10m 19.5M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:33:50.390 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (71s) 36s ago 10m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (63s) 59s ago 9m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (8m) 36s ago 10m 34.2M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (5m) 36s ago 4m 17.1M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (5m) 36s ago 5m 12.8M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (5m) 59s ago 5m 128M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (5m) 59s ago 5m 147M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (2m) 36s ago 11m 429M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (112s) 59s ago 9m 388M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (101s) 36s ago 12m 39.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (83s) 59s ago 9m 25.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (9m) 36s ago 9m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (9m) 59s ago 9m 17.0M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (43s) 36s ago 8m 12.7M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:33:50.391 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (8m) 36s ago 8m 389M 4096M 16.2.4 8d91d370c2b8 faf220cc956d 2024-02-15T18:33:50.392 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (7m) 36s ago 7m 324M 4096M 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:33:50.392 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (7m) 59s ago 7m 440M 4096M 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:33:50.392 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (7m) 59s ago 7m 437M 4096M 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:33:50.392 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (6m) 59s ago 6m 387M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:33:50.392 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (2m) 36s ago 9m 61.3M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:33:50.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd144060f20 msgr2=0x7fd1440633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd144060f20 0x7fd1440633e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd140004a70 tx=0x7fd140009040).stop 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 msgr2=0x7fd158105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 0x7fd158105f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd148009f50 tx=0x7fd148009b30).stop 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 shutdown_connections 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd144060f20 0x7fd1440633e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1580f55c0 0x7fd158105f00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 --2- 172.21.15.33:0/1098917477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580f6860 0x7fd1581063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 >> 172.21.15.33:0/1098917477 conn(0x7fd1580f0d40 msgr2=0x7fd1580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 shutdown_connections 2024-02-15T18:33:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.400+0000 7fd15d284700 1 -- 172.21.15.33:0/1098917477 wait complete. 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.480613+0000 mgr.smithi033.apxevf (mgr.14626) 120 : cluster [DBG] pgmap v81: 65 pgs: 65 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.495558+0000 mon.smithi033 (mon.0) 132 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.495583+0000 mon.smithi033 (mon.0) 133 : cluster [INF] osd.1 failed (root=default,host=smithi033) (connection refused reported by osd.5) 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.495736+0000 mon.smithi033 (mon.0) 134 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.495826+0000 mon.smithi033 (mon.0) 135 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.496008+0000 mon.smithi033 (mon.0) 136 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.496095+0000 mon.smithi033 (mon.0) 137 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.496153+0000 mon.smithi033 (mon.0) 138 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.496253+0000 mon.smithi033 (mon.0) 139 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.496308+0000 mon.smithi033 (mon.0) 140 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.496471+0000 mon.smithi033 (mon.0) 141 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.496525+0000 mon.smithi033 (mon.0) 142 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:33:50.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.671681+0000 mon.smithi033 (mon.0) 143 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.676282+0000 mon.smithi033 (mon.0) 144 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.689110+0000 mon.smithi033 (mon.0) 145 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.872595+0000 mon.smithi033 (mon.0) 146 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.876928+0000 mon.smithi033 (mon.0) 147 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.889579+0000 mon.smithi033 (mon.0) 148 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.896581+0000 mon.smithi033 (mon.0) 149 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.896632+0000 mon.smithi033 (mon.0) 150 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.896795+0000 mon.smithi033 (mon.0) 151 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.896882+0000 mon.smithi033 (mon.0) 152 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.897011+0000 mon.smithi033 (mon.0) 153 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.897096+0000 mon.smithi033 (mon.0) 154 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.897164+0000 mon.smithi033 (mon.0) 155 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.897239+0000 mon.smithi033 (mon.0) 156 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.897494+0000 mon.smithi033 (mon.0) 157 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-15T18:33:50.499 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:49.897538+0000 mon.smithi033 (mon.0) 158 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-15T18:33:50.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 -- 172.21.15.33:0/1808900507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f7980 msgr2=0x7f0ed00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 --2- 172.21.15.33:0/1808900507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f7980 0x7f0ed00f7de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0eb8004660 tx=0x7f0eb8009b30).stop 2024-02-15T18:33:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 -- 172.21.15.33:0/1808900507 shutdown_connections 2024-02-15T18:33:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 --2- 172.21.15.33:0/1808900507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f7980 0x7f0ed00f7de0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 --2- 172.21.15.33:0/1808900507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed00f66e0 0x7f0ed00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 -- 172.21.15.33:0/1808900507 >> 172.21.15.33:0/1808900507 conn(0x7f0ed00f1e40 msgr2=0x7f0ed00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 -- 172.21.15.33:0/1808900507 shutdown_connections 2024-02-15T18:33:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 -- 172.21.15.33:0/1808900507 wait complete. 2024-02-15T18:33:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 Processor -- start 2024-02-15T18:33:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.512+0000 7f0ed632f700 1 -- start start 2024-02-15T18:33:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ed632f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f66e0 0x7f0ed0107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ed632f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed00f7980 0x7f0ed01074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ed632f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0107aa0 con 0x7f0ed00f66e0 2024-02-15T18:33:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ed632f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0107be0 con 0x7f0ed00f7980 2024-02-15T18:33:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ecffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f66e0 0x7f0ed0107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ecffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f66e0 0x7f0ed0107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60650/0 (socket says 172.21.15.33:60650) 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ecffff700 1 -- 172.21.15.33:0/2407880443 learned_addr learned my addr 172.21.15.33:0/2407880443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ec7fff700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed00f7980 0x7f0ed01074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ecffff700 1 -- 172.21.15.33:0/2407880443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed00f7980 msgr2=0x7f0ed01074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ecffff700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed00f7980 0x7f0ed01074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ecffff700 1 -- 172.21.15.33:0/2407880443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb8005040 con 0x7f0ed00f66e0 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ecffff700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f66e0 0x7f0ed0107000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f0ec000e7c0 tx=0x7f0ec000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ecd7fa700 1 -- 172.21.15.33:0/2407880443 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ec00092e0 con 0x7f0ed00f66e0 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.513+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed0108580 con 0x7f0ed00f66e0 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.514+0000 7f0ecd7fa700 1 -- 172.21.15.33:0/2407880443 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0ec000f040 con 0x7f0ed00f66e0 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.514+0000 7f0ecd7fa700 1 -- 172.21.15.33:0/2407880443 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ec0014920 con 0x7f0ed00f66e0 2024-02-15T18:33:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.514+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed0108b40 con 0x7f0ed00f66e0 2024-02-15T18:33:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.515+0000 7f0ecd7fa700 1 -- 172.21.15.33:0/2407880443 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f0ec001b030 con 0x7f0ed00f66e0 2024-02-15T18:33:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.515+0000 7f0ecd7fa700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0ebc060f20 0x7f0ebc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.515+0000 7f0ecd7fa700 1 -- 172.21.15.33:0/2407880443 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0ec007bdd0 con 0x7f0ed00f66e0 2024-02-15T18:33:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.515+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed0108710 con 0x7f0ed00f66e0 2024-02-15T18:33:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.516+0000 7f0ec7fff700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0ebc060f20 0x7f0ebc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:50.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.516+0000 7f0ec7fff700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0ebc060f20 0x7f0ebc0633e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0eb8009720 tx=0x7f0eb8016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:50.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.522+0000 7f0ecd7fa700 1 -- 172.21.15.33:0/2407880443 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0ed0108710 con 0x7f0ed00f66e0 2024-02-15T18:33:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.771+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ed0108710 con 0x7f0ed00f66e0 2024-02-15T18:33:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.771+0000 7f0ecd7fa700 1 -- 172.21.15.33:0/2407880443 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f0ed0108710 con 0x7f0ed00f66e0 2024-02-15T18:33:50.764 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:33:50.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:33:50.764 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:33:50.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:33:50.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:33:50.764 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 1, 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 5, 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:33:50.765 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:33:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0ebc060f20 msgr2=0x7f0ebc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0ebc060f20 0x7f0ebc0633e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0eb8009720 tx=0x7f0eb8016040).stop 2024-02-15T18:33:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f66e0 msgr2=0x7f0ed0107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f66e0 0x7f0ed0107000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f0ec000e7c0 tx=0x7f0ec000b040).stop 2024-02-15T18:33:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 shutdown_connections 2024-02-15T18:33:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0ebc060f20 0x7f0ebc0633e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ed00f66e0 0x7f0ed0107000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 --2- 172.21.15.33:0/2407880443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ed00f7980 0x7f0ed01074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 >> 172.21.15.33:0/2407880443 conn(0x7f0ed00f1e40 msgr2=0x7f0ed00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 shutdown_connections 2024-02-15T18:33:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.773+0000 7f0ed632f700 1 -- 172.21.15.33:0/2407880443 wait complete. 2024-02-15T18:33:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.879+0000 7f2345ecf700 1 -- 172.21.15.33:0/1277907188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 msgr2=0x7f23400f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.879+0000 7f2345ecf700 1 --2- 172.21.15.33:0/1277907188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 0x7f23400f6b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2334004660 tx=0x7f2334009b30).stop 2024-02-15T18:33:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.879+0000 7f2345ecf700 1 -- 172.21.15.33:0/1277907188 shutdown_connections 2024-02-15T18:33:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.879+0000 7f2345ecf700 1 --2- 172.21.15.33:0/1277907188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23400f7980 0x7f23400f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.879+0000 7f2345ecf700 1 --2- 172.21.15.33:0/1277907188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 0x7f23400f6b00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.879+0000 7f2345ecf700 1 -- 172.21.15.33:0/1277907188 >> 172.21.15.33:0/1277907188 conn(0x7f23400f1e40 msgr2=0x7f23400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.879+0000 7f2345ecf700 1 -- 172.21.15.33:0/1277907188 shutdown_connections 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.879+0000 7f2345ecf700 1 -- 172.21.15.33:0/1277907188 wait complete. 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.879+0000 7f2345ecf700 1 Processor -- start 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f2345ecf700 1 -- start start 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f2345ecf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 0x7f2340107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f2345ecf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23400f7980 0x7f2340107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f2345ecf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2340107ad0 con 0x7f23400f66e0 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f2345ecf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2340107c10 con 0x7f23400f7980 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f233f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 0x7f2340107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f233f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 0x7f2340107030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60662/0 (socket says 172.21.15.33:60662) 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f233f7fe700 1 -- 172.21.15.33:0/2078840792 learned_addr learned my addr 172.21.15.33:0/2078840792 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f233f7fe700 1 -- 172.21.15.33:0/2078840792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23400f7980 msgr2=0x7f2340107520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f233f7fe700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23400f7980 0x7f2340107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f233f7fe700 1 -- 172.21.15.33:0/2078840792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334005040 con 0x7f23400f66e0 2024-02-15T18:33:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f233f7fe700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 0x7f2340107030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2334004e30 tx=0x7f2334009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.880+0000 7f2327fff700 1 -- 172.21.15.33:0/2078840792 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2334018070 con 0x7f23400f66e0 2024-02-15T18:33:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.881+0000 7f2327fff700 1 -- 172.21.15.33:0/2078840792 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f2334007ba0 con 0x7f23400f66e0 2024-02-15T18:33:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.881+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2340108550 con 0x7f23400f66e0 2024-02-15T18:33:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.881+0000 7f2327fff700 1 -- 172.21.15.33:0/2078840792 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f233401c620 con 0x7f23400f66e0 2024-02-15T18:33:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.881+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2340108a30 con 0x7f23400f66e0 2024-02-15T18:33:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.882+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2340045ad0 con 0x7f23400f66e0 2024-02-15T18:33:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.883+0000 7f2327fff700 1 -- 172.21.15.33:0/2078840792 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f233401d9a0 con 0x7f23400f66e0 2024-02-15T18:33:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.883+0000 7f2327fff700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2328060f20 0x7f23280633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.883+0000 7f2327fff700 1 -- 172.21.15.33:0/2078840792 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f233407e4c0 con 0x7f23400f66e0 2024-02-15T18:33:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.883+0000 7f233effd700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2328060f20 0x7f23280633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.884+0000 7f233effd700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2328060f20 0x7f23280633e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2330009880 tx=0x7f2330009a60).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:50.886+0000 7f2327fff700 1 -- 172.21.15.33:0/2078840792 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f23340523f0 con 0x7f23400f66e0 2024-02-15T18:33:51.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.104+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23400ff130 con 0x7f23400f66e0 2024-02-15T18:33:51.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.104+0000 7f2327fff700 1 -- 172.21.15.33:0/2078840792 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1831 (secure 0 0 0) 0x7f2334051fe0 con 0x7f23400f66e0 2024-02-15T18:33:51.097 INFO:teuthology.orchestra.run.smithi033.stdout:e19 2024-02-15T18:33:51.097 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:33:51.097 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:33:51.097 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:33:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:33:51.097 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 19 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:31:16.192509+0000 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:33:51.098 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:33:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:33:51.100 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:33:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:33:51.100 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:51.100 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2328060f20 msgr2=0x7f23280633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2328060f20 0x7f23280633e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2330009880 tx=0x7f2330009a60).stop 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 msgr2=0x7f2340107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 0x7f2340107030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2334004e30 tx=0x7f2334009b30).stop 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 shutdown_connections 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2328060f20 0x7f23280633e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23400f66e0 0x7f2340107030 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 --2- 172.21.15.33:0/2078840792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23400f7980 0x7f2340107520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 >> 172.21.15.33:0/2078840792 conn(0x7f23400f1e40 msgr2=0x7f23400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 shutdown_connections 2024-02-15T18:33:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.106+0000 7f2345ecf700 1 -- 172.21.15.33:0/2078840792 wait complete. 2024-02-15T18:33:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-02-15T18:33:51.137 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:49.712544+0000 mgr.smithi033.apxevf (mgr.14626) 121 : audit [DBG] from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:51.137 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:50.042715+0000 mgr.smithi033.apxevf (mgr.14626) 122 : audit [DBG] from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:51.137 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:50.126800+0000 mon.smithi033 (mon.0) 159 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:33:51.137 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:50.138759+0000 mon.smithi033 (mon.0) 160 : cluster [DBG] osdmap e55: 6 total, 5 up, 6 in 2024-02-15T18:33:51.137 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:50.390276+0000 mgr.smithi033.apxevf (mgr.14626) 123 : audit [DBG] from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:51.137 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:50.773025+0000 mon.smithi033 (mon.0) 161 : audit [DBG] from='client.? 172.21.15.33:0/2407880443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:51.137 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:51.106048+0000 mon.smithi033 (mon.0) 162 : audit [DBG] from='client.? 172.21.15.33:0/2078840792' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:33:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.230+0000 7f9556054700 1 -- 172.21.15.33:0/3664069292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006a350 msgr2=0x7f955006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.230+0000 7f9556054700 1 --2- 172.21.15.33:0/3664069292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006a350 0x7f955006a7d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9544004660 tx=0x7f9544009b30).stop 2024-02-15T18:33:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.230+0000 7f9556054700 1 -- 172.21.15.33:0/3664069292 shutdown_connections 2024-02-15T18:33:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.230+0000 7f9556054700 1 --2- 172.21.15.33:0/3664069292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006a350 0x7f955006a7d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.230+0000 7f9556054700 1 --2- 172.21.15.33:0/3664069292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f955006b960 0x7f9550069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.230+0000 7f9556054700 1 -- 172.21.15.33:0/3664069292 >> 172.21.15.33:0/3664069292 conn(0x7f95500f1e40 msgr2=0x7f95500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.230+0000 7f9556054700 1 -- 172.21.15.33:0/3664069292 shutdown_connections 2024-02-15T18:33:51.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.230+0000 7f9556054700 1 -- 172.21.15.33:0/3664069292 wait complete. 2024-02-15T18:33:51.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f9556054700 1 Processor -- start 2024-02-15T18:33:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f9556054700 1 -- start start 2024-02-15T18:33:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f9556054700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f955006a350 0x7f95501091c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f9556054700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006b960 0x7f95501096b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:51.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f9556054700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9550109c60 con 0x7f955006b960 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f9556054700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9550109da0 con 0x7f955006a350 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f954effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006b960 0x7f95501096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f954effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006b960 0x7f95501096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60674/0 (socket says 172.21.15.33:60674) 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f954effd700 1 -- 172.21.15.33:0/747566487 learned_addr learned my addr 172.21.15.33:0/747566487 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f954f7fe700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f955006a350 0x7f95501091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f954effd700 1 -- 172.21.15.33:0/747566487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f955006a350 msgr2=0x7f95501091c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f954effd700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f955006a350 0x7f95501091c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f954effd700 1 -- 172.21.15.33:0/747566487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544005040 con 0x7f955006b960 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.231+0000 7f954effd700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006b960 0x7f95501096b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9544009f50 tx=0x7f9544009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.232+0000 7f9537fff700 1 -- 172.21.15.33:0/747566487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9544018070 con 0x7f955006b960 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.232+0000 7f9537fff700 1 -- 172.21.15.33:0/747566487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9544007ba0 con 0x7f955006b960 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.232+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955010a6e0 con 0x7f955006b960 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.232+0000 7f9537fff700 1 -- 172.21.15.33:0/747566487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954401c420 con 0x7f955006b960 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.232+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955010ac40 con 0x7f955006b960 2024-02-15T18:33:51.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.233+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9550045ad0 con 0x7f955006b960 2024-02-15T18:33:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.233+0000 7f9537fff700 1 -- 172.21.15.33:0/747566487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f954401d420 con 0x7f955006b960 2024-02-15T18:33:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.234+0000 7f9537fff700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9538060f20 0x7f95380633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:33:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.234+0000 7f9537fff700 1 -- 172.21.15.33:0/747566487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f954407dd00 con 0x7f955006b960 2024-02-15T18:33:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.234+0000 7f954f7fe700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9538060f20 0x7f95380633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:33:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.234+0000 7f954f7fe700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9538060f20 0x7f95380633e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9540004c40 tx=0x7f954000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:33:51.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.238+0000 7f9537fff700 1 -- 172.21.15.33:0/747566487 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9544081030 con 0x7f955006b960 2024-02-15T18:33:51.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.431+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f955010aeb0 con 0x7f9538060f20 2024-02-15T18:33:51.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.432+0000 7f9537fff700 1 -- 172.21.15.33:0/747566487 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f955010aeb0 con 0x7f9538060f20 2024-02-15T18:33:51.425 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:33:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:33:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "7/21 daemons upgraded", 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:33:51.426 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:33:51.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9538060f20 msgr2=0x7f95380633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:51.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9538060f20 0x7f95380633e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9540004c40 tx=0x7f954000b040).stop 2024-02-15T18:33:51.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006b960 msgr2=0x7f95501096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:33:51.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006b960 0x7f95501096b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9544009f50 tx=0x7f9544009b30).stop 2024-02-15T18:33:51.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 shutdown_connections 2024-02-15T18:33:51.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9538060f20 0x7f95380633e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:51.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f955006a350 0x7f95501091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:51.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 --2- 172.21.15.33:0/747566487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f955006b960 0x7f95501096b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:33:51.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 >> 172.21.15.33:0/747566487 conn(0x7f95500f1e40 msgr2=0x7f95500fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:33:51.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 shutdown_connections 2024-02-15T18:33:51.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:33:51.434+0000 7f9556054700 1 -- 172.21.15.33:0/747566487 wait complete. 2024-02-15T18:33:51.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:49.712544+0000 mgr.smithi033.apxevf (mgr.14626) 121 : audit [DBG] from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:51.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:50.042715+0000 mgr.smithi033.apxevf (mgr.14626) 122 : audit [DBG] from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:51.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:50.126800+0000 mon.smithi033 (mon.0) 159 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:33:51.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:50.138759+0000 mon.smithi033 (mon.0) 160 : cluster [DBG] osdmap e55: 6 total, 5 up, 6 in 2024-02-15T18:33:51.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:50.390276+0000 mgr.smithi033.apxevf (mgr.14626) 123 : audit [DBG] from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:51.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:50.773025+0000 mon.smithi033 (mon.0) 161 : audit [DBG] from='client.? 172.21.15.33:0/2407880443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:33:51.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:51.106048+0000 mon.smithi033 (mon.0) 162 : audit [DBG] from='client.? 172.21.15.33:0/2078840792' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:33:52.400 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:51.136504+0000 mon.smithi033 (mon.0) 163 : cluster [DBG] osdmap e56: 6 total, 5 up, 6 in 2024-02-15T18:33:52.401 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:51.433961+0000 mgr.smithi033.apxevf (mgr.14626) 124 : audit [DBG] from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:52.401 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:51.481278+0000 mgr.smithi033.apxevf (mgr.14626) 125 : cluster [DBG] pgmap v84: 65 pgs: 12 stale+active+clean, 53 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:33:52.401 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:52 smithi033 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.1.service: Succeeded. 2024-02-15T18:33:52.401 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:52 smithi033 systemd[1]: Stopped Ceph osd.1 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:33:52.401 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:52 smithi033 systemd[1]: Starting Ceph osd.1 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:33:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:51.136504+0000 mon.smithi033 (mon.0) 163 : cluster [DBG] osdmap e56: 6 total, 5 up, 6 in 2024-02-15T18:33:52.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:51.433961+0000 mgr.smithi033.apxevf (mgr.14626) 124 : audit [DBG] from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:33:52.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:51.481278+0000 mgr.smithi033.apxevf (mgr.14626) 125 : cluster [DBG] pgmap v84: 65 pgs: 12 stale+active+clean, 53 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:33:53.508 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:53 smithi033 bash[83450]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:33:53.508 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:53 smithi033 bash[83450]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T18:33:53.508 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:53 smithi033 bash[83450]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-02-15T18:33:53.508 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:53 smithi033 bash[83450]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-15T18:33:53.508 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:53 smithi033 bash[83450]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-02-15T18:33:53.508 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:53 smithi033 bash[83450]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T18:33:53.508 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:53 smithi033 bash[83450]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-15T18:33:53.508 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:53 smithi033 bash[83450]: --> ceph-volume lvm activate successful for osd ID: 1 2024-02-15T18:33:54.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:53.481774+0000 mgr.smithi033.apxevf (mgr.14626) 126 : cluster [DBG] pgmap v85: 65 pgs: 12 stale+active+clean, 53 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:33:54.798 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-1[83714]: debug 2024-02-15T18:33:54.603+0000 7fb23e3a9700 1 -- 172.21.15.33:0/2357593322 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55abd4b9e680 con 0x55abd4b65000 2024-02-15T18:33:54.798 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:54 smithi033 bash[83699]: 43a42c7e90491eeefc5009924ac2061f034154eb10f544aa079be2df3e291907 2024-02-15T18:33:54.798 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:54 smithi033 systemd[1]: Started Ceph osd.1 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:33:54.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:53.481774+0000 mgr.smithi033.apxevf (mgr.14626) 126 : cluster [DBG] pgmap v85: 65 pgs: 12 stale+active+clean, 53 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:33:55.493 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:33:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-1[83714]: debug 2024-02-15T18:33:55.131+0000 7fb245e37380 -1 Falling back to public interface 2024-02-15T18:33:56.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:54.758660+0000 mon.smithi033 (mon.0) 164 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:56.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:54.759425+0000 mon.smithi033 (mon.0) 165 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:56.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:55.482273+0000 mgr.smithi033.apxevf (mgr.14626) 127 : cluster [DBG] pgmap v86: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:33:56.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:54.758660+0000 mon.smithi033 (mon.0) 164 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:56.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:54.759425+0000 mon.smithi033 (mon.0) 165 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:33:56.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:55.482273+0000 mgr.smithi033.apxevf (mgr.14626) 127 : cluster [DBG] pgmap v86: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:33:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:55.756847+0000 mon.smithi033 (mon.0) 166 : cluster [WRN] Health check failed: Degraded data redundancy: 54/357 objects degraded (15.126%), 15 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:57.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:55.756847+0000 mon.smithi033 (mon.0) 166 : cluster [WRN] Health check failed: Degraded data redundancy: 54/357 objects degraded (15.126%), 15 pgs degraded (PG_DEGRADED) 2024-02-15T18:33:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:57.482691+0000 mgr.smithi033.apxevf (mgr.14626) 128 : cluster [DBG] pgmap v87: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:33:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:33:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:33:57.652856+0000 mon.smithi033 (mon.0) 167 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:33:58.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:57.482691+0000 mgr.smithi033.apxevf (mgr.14626) 128 : cluster [DBG] pgmap v87: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:33:58.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:33:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:33:57.652856+0000 mon.smithi033 (mon.0) 167 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:00.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:33:59.483165+0000 mgr.smithi033.apxevf (mgr.14626) 129 : cluster [DBG] pgmap v88: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:00.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:33:59.483165+0000 mgr.smithi033.apxevf (mgr.14626) 129 : cluster [DBG] pgmap v88: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:01.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:00.729630+0000 mon.smithi033 (mon.0) 168 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:01.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.028672+0000 mon.smithi033 (mon.0) 169 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:01.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.029370+0000 mon.smithi033 (mon.0) 170 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:01.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:01.029919+0000 mgr.smithi033.apxevf (mgr.14626) 130 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:01.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.035397+0000 mon.smithi033 (mon.0) 171 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:01.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.040120+0000 mon.smithi033 (mon.0) 172 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:01.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.042175+0000 mon.smithi033 (mon.0) 173 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:01.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.043208+0000 mon.smithi033 (mon.0) 174 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:01.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.044202+0000 mon.smithi033 (mon.0) 175 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:01.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.045209+0000 mon.smithi033 (mon.0) 176 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:34:01.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.045326+0000 mgr.smithi033.apxevf (mgr.14626) 131 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:34:01.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:01.045965+0000 mgr.smithi033.apxevf (mgr.14626) 132 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-15T18:34:01.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:01.483578+0000 mgr.smithi033.apxevf (mgr.14626) 133 : cluster [DBG] pgmap v89: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:00.729630+0000 mon.smithi033 (mon.0) 168 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.028672+0000 mon.smithi033 (mon.0) 169 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.029370+0000 mon.smithi033 (mon.0) 170 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:01.029919+0000 mgr.smithi033.apxevf (mgr.14626) 130 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.035397+0000 mon.smithi033 (mon.0) 171 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.040120+0000 mon.smithi033 (mon.0) 172 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.042175+0000 mon.smithi033 (mon.0) 173 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.043208+0000 mon.smithi033 (mon.0) 174 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:01.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.044202+0000 mon.smithi033 (mon.0) 175 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:01.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.045209+0000 mon.smithi033 (mon.0) 176 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:34:01.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.045326+0000 mgr.smithi033.apxevf (mgr.14626) 131 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:34:01.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:01.045965+0000 mgr.smithi033.apxevf (mgr.14626) 132 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-15T18:34:01.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:01.483578+0000 mgr.smithi033.apxevf (mgr.14626) 133 : cluster [DBG] pgmap v89: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:02.297 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:34:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-1[83714]: debug 2024-02-15T18:34:01.992+0000 7fb245e37380 -1 osd.1 54 log_to_monitors {default=true} 2024-02-15T18:34:02.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:01.997270+0000 mon.smithi033 (mon.0) 177 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/827707777,v1:172.21.15.33:6811/827707777]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T18:34:03.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:01.997270+0000 mon.smithi033 (mon.0) 177 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/827707777,v1:172.21.15.33:6811/827707777]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-15T18:34:03.047 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:34:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-1[83714]: debug 2024-02-15T18:34:02.742+0000 7fb235b1b700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:34:03.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:02.737295+0000 mon.smithi033 (mon.0) 178 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/827707777,v1:172.21.15.33:6811/827707777]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T18:34:03.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:02.737377+0000 mon.smithi033 (mon.0) 179 : cluster [DBG] osdmap e57: 6 total, 5 up, 6 in 2024-02-15T18:34:03.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:02.738139+0000 mon.smithi033 (mon.0) 180 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/827707777,v1:172.21.15.33:6811/827707777]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:34:03.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:03.484065+0000 mgr.smithi033.apxevf (mgr.14626) 134 : cluster [DBG] pgmap v91: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:03.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:02.737295+0000 mon.smithi033 (mon.0) 178 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/827707777,v1:172.21.15.33:6811/827707777]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-15T18:34:03.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:02.737377+0000 mon.smithi033 (mon.0) 179 : cluster [DBG] osdmap e57: 6 total, 5 up, 6 in 2024-02-15T18:34:03.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:02.738139+0000 mon.smithi033 (mon.0) 180 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/827707777,v1:172.21.15.33:6811/827707777]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:34:03.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:03.484065+0000 mgr.smithi033.apxevf (mgr.14626) 134 : cluster [DBG] pgmap v91: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:04.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:03.735100+0000 mon.smithi033 (mon.0) 181 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:34:04.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:03.739180+0000 mon.smithi033 (mon.0) 182 : cluster [INF] osd.1 [v2:172.21.15.33:6810/827707777,v1:172.21.15.33:6811/827707777] boot 2024-02-15T18:34:04.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:03.739243+0000 mon.smithi033 (mon.0) 183 : cluster [DBG] osdmap e58: 6 total, 6 up, 6 in 2024-02-15T18:34:04.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:03.739738+0000 mon.smithi033 (mon.0) 184 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:34:05.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:03.735100+0000 mon.smithi033 (mon.0) 181 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:34:05.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:03.739180+0000 mon.smithi033 (mon.0) 182 : cluster [INF] osd.1 [v2:172.21.15.33:6810/827707777,v1:172.21.15.33:6811/827707777] boot 2024-02-15T18:34:05.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:03.739243+0000 mon.smithi033 (mon.0) 183 : cluster [DBG] osdmap e58: 6 total, 6 up, 6 in 2024-02-15T18:34:05.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:03.739738+0000 mon.smithi033 (mon.0) 184 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-15T18:34:05.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:04.751396+0000 mon.smithi033 (mon.0) 185 : cluster [DBG] osdmap e59: 6 total, 6 up, 6 in 2024-02-15T18:34:05.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:05.484517+0000 mgr.smithi033.apxevf (mgr.14626) 135 : cluster [DBG] pgmap v94: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:06.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:04.751396+0000 mon.smithi033 (mon.0) 185 : cluster [DBG] osdmap e59: 6 total, 6 up, 6 in 2024-02-15T18:34:06.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:05.484517+0000 mgr.smithi033.apxevf (mgr.14626) 135 : cluster [DBG] pgmap v94: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:08.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:07.484918+0000 mgr.smithi033.apxevf (mgr.14626) 136 : cluster [DBG] pgmap v95: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:08.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:07.484918+0000 mgr.smithi033.apxevf (mgr.14626) 136 : cluster [DBG] pgmap v95: 65 pgs: 15 active+undersized+degraded, 17 active+undersized, 33 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-02-15T18:34:10.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:09.485556+0000 mgr.smithi033.apxevf (mgr.14626) 137 : cluster [DBG] pgmap v96: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:10.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:09.485556+0000 mgr.smithi033.apxevf (mgr.14626) 137 : cluster [DBG] pgmap v96: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:11.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:10.127850+0000 mon.smithi033 (mon.0) 186 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/357 objects degraded (15.126%), 15 pgs degraded) 2024-02-15T18:34:11.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:10.127850+0000 mon.smithi033 (mon.0) 186 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/357 objects degraded (15.126%), 15 pgs degraded) 2024-02-15T18:34:12.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:11.486061+0000 mgr.smithi033.apxevf (mgr.14626) 138 : cluster [DBG] pgmap v97: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:12.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:11.486061+0000 mgr.smithi033.apxevf (mgr.14626) 138 : cluster [DBG] pgmap v97: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:13.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:12.654195+0000 mon.smithi033 (mon.0) 187 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:13.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:13.486410+0000 mgr.smithi033.apxevf (mgr.14626) 139 : cluster [DBG] pgmap v98: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:13.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:12.654195+0000 mon.smithi033 (mon.0) 187 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:13.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:13.486410+0000 mgr.smithi033.apxevf (mgr.14626) 139 : cluster [DBG] pgmap v98: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:16.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:15.486938+0000 mgr.smithi033.apxevf (mgr.14626) 140 : cluster [DBG] pgmap v99: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:16.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:16.057372+0000 mon.smithi033 (mon.0) 188 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:34:16.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:15.486938+0000 mgr.smithi033.apxevf (mgr.14626) 140 : cluster [DBG] pgmap v99: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:16.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:16.057372+0000 mon.smithi033 (mon.0) 188 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:34:17.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:16.057586+0000 mgr.smithi033.apxevf (mgr.14626) 141 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:34:17.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:16.058615+0000 mgr.smithi033.apxevf (mgr.14626) 142 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-15T18:34:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:16.057586+0000 mgr.smithi033.apxevf (mgr.14626) 141 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-15T18:34:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:16.058615+0000 mgr.smithi033.apxevf (mgr.14626) 142 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-15T18:34:18.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:17.487314+0000 mgr.smithi033.apxevf (mgr.14626) 143 : cluster [DBG] pgmap v100: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:18.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:17.709546+0000 mon.smithi033 (mon.0) 189 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:18.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:18.043017+0000 mon.smithi033 (mon.0) 190 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:18.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:18.043927+0000 mon.smithi033 (mon.0) 191 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T18:34:18.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:18.044634+0000 mon.smithi033 (mon.0) 192 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:18.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:17.487314+0000 mgr.smithi033.apxevf (mgr.14626) 143 : cluster [DBG] pgmap v100: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:18.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:17.709546+0000 mon.smithi033 (mon.0) 189 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:18.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:18.043017+0000 mon.smithi033 (mon.0) 190 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:18.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:18.043927+0000 mon.smithi033 (mon.0) 191 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-15T18:34:18.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:18.044634+0000 mon.smithi033 (mon.0) 192 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:19.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:18.037925+0000 mgr.smithi033.apxevf (mgr.14626) 144 : cephadm [INF] Upgrade: Updating osd.2 2024-02-15T18:34:19.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:18.045792+0000 mgr.smithi033.apxevf (mgr.14626) 145 : cephadm [INF] Deploying daemon osd.2 on smithi033 2024-02-15T18:34:19.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:18.037925+0000 mgr.smithi033.apxevf (mgr.14626) 144 : cephadm [INF] Upgrade: Updating osd.2 2024-02-15T18:34:19.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:18.045792+0000 mgr.smithi033.apxevf (mgr.14626) 145 : cephadm [INF] Deploying daemon osd.2 on smithi033 2024-02-15T18:34:20.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:19.488089+0000 mgr.smithi033.apxevf (mgr.14626) 146 : cluster [DBG] pgmap v101: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:20.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:19.488089+0000 mgr.smithi033.apxevf (mgr.14626) 146 : cluster [DBG] pgmap v101: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:21.467 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:21 smithi033 systemd[1]: Stopping Ceph osd.2 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:34:21.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.546+0000 7f1cdc747700 1 -- 172.21.15.33:0/1564488972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 msgr2=0x7f1cd40f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:21.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.546+0000 7f1cdc747700 1 --2- 172.21.15.33:0/1564488972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 0x7f1cd40f6910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1cc4004660 tx=0x7f1cc4009b30).stop 2024-02-15T18:34:21.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.546+0000 7f1cdc747700 1 -- 172.21.15.33:0/1564488972 shutdown_connections 2024-02-15T18:34:21.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.546+0000 7f1cdc747700 1 --2- 172.21.15.33:0/1564488972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 0x7f1cd40f6910 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.546+0000 7f1cdc747700 1 --2- 172.21.15.33:0/1564488972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cd40f55d0 0x7f1cd40f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.546+0000 7f1cdc747700 1 -- 172.21.15.33:0/1564488972 >> 172.21.15.33:0/1564488972 conn(0x7f1cd40f0dd0 msgr2=0x7f1cd40f31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.546+0000 7f1cdc747700 1 -- 172.21.15.33:0/1564488972 shutdown_connections 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.546+0000 7f1cdc747700 1 -- 172.21.15.33:0/1564488972 wait complete. 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cdc747700 1 Processor -- start 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cdc747700 1 -- start start 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cdc747700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cd40f55d0 0x7f1cd4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cdc747700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 0x7f1cd41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cdc747700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4107a50 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cdc747700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4107b90 con 0x7f1cd40f55d0 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cd9ce2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 0x7f1cd41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cd9ce2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 0x7f1cd41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44108/0 (socket says 172.21.15.33:44108) 2024-02-15T18:34:21.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cd9ce2700 1 -- 172.21.15.33:0/2199695104 learned_addr learned my addr 172.21.15.33:0/2199695104 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cda4e3700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cd40f55d0 0x7f1cd4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cd9ce2700 1 -- 172.21.15.33:0/2199695104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cd40f55d0 msgr2=0x7f1cd4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cd9ce2700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cd40f55d0 0x7f1cd4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.547+0000 7f1cd9ce2700 1 -- 172.21.15.33:0/2199695104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4005040 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.548+0000 7f1cd9ce2700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 0x7f1cd41074a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1cc4009f50 tx=0x7f1cc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.548+0000 7f1ccaffd700 1 -- 172.21.15.33:0/2199695104 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cc4018070 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.548+0000 7f1ccaffd700 1 -- 172.21.15.33:0/2199695104 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f1cc4007c70 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.548+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd41084d0 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.548+0000 7f1ccaffd700 1 -- 172.21.15.33:0/2199695104 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cc401c620 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.548+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd4108a30 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.549+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd4045ad0 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.549+0000 7f1ccaffd700 1 -- 172.21.15.33:0/2199695104 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f1cc401c890 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.550+0000 7f1ccaffd700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1cc0060f20 0x7f1cc00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:21.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.550+0000 7f1ccaffd700 1 -- 172.21.15.33:0/2199695104 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f1cc407df90 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.550+0000 7f1cda4e3700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1cc0060f20 0x7f1cc00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:21.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.550+0000 7f1cda4e3700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1cc0060f20 0x7f1cc00633e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1cd00041d0 tx=0x7f1cd0009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.555+0000 7f1ccaffd700 1 -- 172.21.15.33:0/2199695104 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1cc4051ec0 con 0x7f1cd40f5ee0 2024-02-15T18:34:21.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.746+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cd40fad50 con 0x7f1cc0060f20 2024-02-15T18:34:21.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.748+0000 7f1ccaffd700 1 -- 172.21.15.33:0/2199695104 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1cd40fad50 con 0x7f1cc0060f20 2024-02-15T18:34:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.749+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1cc0060f20 msgr2=0x7f1cc00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.749+0000 7f1cdc747700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1cc0060f20 0x7f1cc00633e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1cd00041d0 tx=0x7f1cd0009040).stop 2024-02-15T18:34:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.749+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 msgr2=0x7f1cd41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.749+0000 7f1cdc747700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 0x7f1cd41074a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1cc4009f50 tx=0x7f1cc4009b30).stop 2024-02-15T18:34:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.750+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 shutdown_connections 2024-02-15T18:34:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.750+0000 7f1cdc747700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1cc0060f20 0x7f1cc00633e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.750+0000 7f1cdc747700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cd40f55d0 0x7f1cd4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.750+0000 7f1cdc747700 1 --2- 172.21.15.33:0/2199695104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd40f5ee0 0x7f1cd41074a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.750+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 >> 172.21.15.33:0/2199695104 conn(0x7f1cd40f0dd0 msgr2=0x7f1cd405fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.750+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 shutdown_connections 2024-02-15T18:34:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.750+0000 7f1cdc747700 1 -- 172.21.15.33:0/2199695104 wait complete. 2024-02-15T18:34:21.751 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:34:21.797 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.2[56503]: debug 2024-02-15T18:34:21.475+0000 7fdc78f4b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:34:21.797 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.2[56503]: debug 2024-02-15T18:34:21.475+0000 7fdc78f4b700 -1 osd.2 59 *** Got signal Terminated *** 2024-02-15T18:34:21.797 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.2[56503]: debug 2024-02-15T18:34:21.475+0000 7fdc78f4b700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:34:21.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.854+0000 7f31e6988700 1 -- 172.21.15.33:0/2788046597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 msgr2=0x7f31e00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:21.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.854+0000 7f31e6988700 1 --2- 172.21.15.33:0/2788046597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 0x7f31e00f6cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f31c8004660 tx=0x7f31c8009b30).stop 2024-02-15T18:34:21.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.854+0000 7f31e6988700 1 -- 172.21.15.33:0/2788046597 shutdown_connections 2024-02-15T18:34:21.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.854+0000 7f31e6988700 1 --2- 172.21.15.33:0/2788046597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 0x7f31e00f6cc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:21.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.854+0000 7f31e6988700 1 --2- 172.21.15.33:0/2788046597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31e00f55c0 0x7f31e00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:21.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.854+0000 7f31e6988700 1 -- 172.21.15.33:0/2788046597 >> 172.21.15.33:0/2788046597 conn(0x7f31e00f0d40 msgr2=0x7f31e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:21.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.854+0000 7f31e6988700 1 -- 172.21.15.33:0/2788046597 shutdown_connections 2024-02-15T18:34:21.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.854+0000 7f31e6988700 1 -- 172.21.15.33:0/2788046597 wait complete. 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.854+0000 7f31e6988700 1 Processor -- start 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31e6988700 1 -- start start 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31e6988700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31e00f55c0 0x7f31e0105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31e6988700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 0x7f31e01063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31e6988700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0106950 con 0x7f31e00f6860 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31e6988700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0106a90 con 0x7f31e00f55c0 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31df7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 0x7f31e01063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31df7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 0x7f31e01063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44124/0 (socket says 172.21.15.33:44124) 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31df7fe700 1 -- 172.21.15.33:0/3005725222 learned_addr learned my addr 172.21.15.33:0/3005725222 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31dffff700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31e00f55c0 0x7f31e0105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31df7fe700 1 -- 172.21.15.33:0/3005725222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31e00f55c0 msgr2=0x7f31e0105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:21.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31df7fe700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31e00f55c0 0x7f31e0105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:21.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31df7fe700 1 -- 172.21.15.33:0/3005725222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8005040 con 0x7f31e00f6860 2024-02-15T18:34:21.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31dffff700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31e00f55c0 0x7f31e0105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:34:21.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.855+0000 7f31df7fe700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 0x7f31e01063a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f31c8009f50 tx=0x7f31c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:21.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.856+0000 7f31dcff9700 1 -- 172.21.15.33:0/3005725222 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c801a070 con 0x7f31e00f6860 2024-02-15T18:34:21.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.856+0000 7f31dcff9700 1 -- 172.21.15.33:0/3005725222 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f31c801faf0 con 0x7f31e00f6860 2024-02-15T18:34:21.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.856+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e01073d0 con 0x7f31e00f6860 2024-02-15T18:34:21.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.856+0000 7f31dcff9700 1 -- 172.21.15.33:0/3005725222 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31c801e940 con 0x7f31e00f6860 2024-02-15T18:34:21.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.856+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e01078b0 con 0x7f31e00f6860 2024-02-15T18:34:21.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.857+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e0045ad0 con 0x7f31e00f6860 2024-02-15T18:34:21.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.857+0000 7f31dcff9700 1 -- 172.21.15.33:0/3005725222 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f31c801fc60 con 0x7f31e00f6860 2024-02-15T18:34:21.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.857+0000 7f31dcff9700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f31cc060f20 0x7f31cc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:21.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.858+0000 7f31dcff9700 1 -- 172.21.15.33:0/3005725222 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f31c8080270 con 0x7f31e00f6860 2024-02-15T18:34:21.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.858+0000 7f31dffff700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f31cc060f20 0x7f31cc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:21.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.858+0000 7f31dffff700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f31cc060f20 0x7f31cc0633e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f31d0009880 tx=0x7f31d000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:21.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:21.862+0000 7f31dcff9700 1 -- 172.21.15.33:0/3005725222 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f31c80541a0 con 0x7f31e00f6860 2024-02-15T18:34:22.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.052+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f31e005f620 con 0x7f31cc060f20 2024-02-15T18:34:22.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.054+0000 7f31dcff9700 1 -- 172.21.15.33:0/3005725222 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f31e005f620 con 0x7f31cc060f20 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.055+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f31cc060f20 msgr2=0x7f31cc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.055+0000 7f31e6988700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f31cc060f20 0x7f31cc0633e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f31d0009880 tx=0x7f31d000b040).stop 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.055+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 msgr2=0x7f31e01063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.055+0000 7f31e6988700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 0x7f31e01063a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f31c8009f50 tx=0x7f31c8009b30).stop 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.055+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 shutdown_connections 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.055+0000 7f31e6988700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f31cc060f20 0x7f31cc0633e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.055+0000 7f31e6988700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31e00f55c0 0x7f31e0105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.055+0000 7f31e6988700 1 --2- 172.21.15.33:0/3005725222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e00f6860 0x7f31e01063a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.055+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 >> 172.21.15.33:0/3005725222 conn(0x7f31e00f0d40 msgr2=0x7f31e00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:22.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.056+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 shutdown_connections 2024-02-15T18:34:22.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.056+0000 7f31e6988700 1 -- 172.21.15.33:0/3005725222 wait complete. 2024-02-15T18:34:22.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.157+0000 7f12cd2af700 1 -- 172.21.15.33:0/1897872401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 msgr2=0x7f12c80f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.157+0000 7f12cd2af700 1 --2- 172.21.15.33:0/1897872401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 0x7f12c80f6af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f12b8004660 tx=0x7f12b8009b30).stop 2024-02-15T18:34:22.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.157+0000 7f12cd2af700 1 -- 172.21.15.33:0/1897872401 shutdown_connections 2024-02-15T18:34:22.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.157+0000 7f12cd2af700 1 --2- 172.21.15.33:0/1897872401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c80f7970 0x7f12c80f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.157+0000 7f12cd2af700 1 --2- 172.21.15.33:0/1897872401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 0x7f12c80f6af0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.157+0000 7f12cd2af700 1 -- 172.21.15.33:0/1897872401 >> 172.21.15.33:0/1897872401 conn(0x7f12c80f1e10 msgr2=0x7f12c80f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:22.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.157+0000 7f12cd2af700 1 -- 172.21.15.33:0/1897872401 shutdown_connections 2024-02-15T18:34:22.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.157+0000 7f12cd2af700 1 -- 172.21.15.33:0/1897872401 wait complete. 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12cd2af700 1 Processor -- start 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12cd2af700 1 -- start start 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12cd2af700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 0x7f12c8107010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12cd2af700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c80f7970 0x7f12c8107500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12cd2af700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c8107ab0 con 0x7f12c80f66d0 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12cd2af700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c8107bf0 con 0x7f12c80f7970 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12c6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 0x7f12c8107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12c6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 0x7f12c8107010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44140/0 (socket says 172.21.15.33:44140) 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12c6ffd700 1 -- 172.21.15.33:0/3813609569 learned_addr learned my addr 172.21.15.33:0/3813609569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.158+0000 7f12c67fc700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c80f7970 0x7f12c8107500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:22.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.159+0000 7f12c6ffd700 1 -- 172.21.15.33:0/3813609569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c80f7970 msgr2=0x7f12c8107500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.159+0000 7f12c6ffd700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c80f7970 0x7f12c8107500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.159+0000 7f12c6ffd700 1 -- 172.21.15.33:0/3813609569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8005040 con 0x7f12c80f66d0 2024-02-15T18:34:22.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.159+0000 7f12c6ffd700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 0x7f12c8107010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f12b8004e30 tx=0x7f12b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:22.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.159+0000 7f12af7fe700 1 -- 172.21.15.33:0/3813609569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b8018070 con 0x7f12c80f66d0 2024-02-15T18:34:22.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.159+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c8108530 con 0x7f12c80f66d0 2024-02-15T18:34:22.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.159+0000 7f12af7fe700 1 -- 172.21.15.33:0/3813609569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f12b8007ba0 con 0x7f12c80f66d0 2024-02-15T18:34:22.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.159+0000 7f12af7fe700 1 -- 172.21.15.33:0/3813609569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b801c3c0 con 0x7f12c80f66d0 2024-02-15T18:34:22.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.159+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c8108a90 con 0x7f12c80f66d0 2024-02-15T18:34:22.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.160+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c8045ad0 con 0x7f12c80f66d0 2024-02-15T18:34:22.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.161+0000 7f12af7fe700 1 -- 172.21.15.33:0/3813609569 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f12b801d420 con 0x7f12c80f66d0 2024-02-15T18:34:22.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.162+0000 7f12af7fe700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f12b0060f20 0x7f12b00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:22.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.162+0000 7f12af7fe700 1 -- 172.21.15.33:0/3813609569 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f12b807e410 con 0x7f12c80f66d0 2024-02-15T18:34:22.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.162+0000 7f12c67fc700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f12b0060f20 0x7f12b00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:22.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.162+0000 7f12c67fc700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f12b0060f20 0x7f12b00633e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f12bc004c40 tx=0x7f12bc00b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:22.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.165+0000 7f12af7fe700 1 -- 172.21.15.33:0/3813609569 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f12b8052280 con 0x7f12c80f66d0 2024-02-15T18:34:22.297 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:22 smithi033 bash[85703]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.2 2024-02-15T18:34:22.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.351+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f12c80ff0e0 con 0x7f12b0060f20 2024-02-15T18:34:22.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.360+0000 7f12af7fe700 1 -- 172.21.15.33:0/3813609569 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f12c80ff0e0 con 0x7f12b0060f20 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (9m) 21s ago 11m 19.5M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (103s) 21s ago 11m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (95s) 91s ago 10m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (9m) 21s ago 10m 34.2M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (5m) 21s ago 5m 17.3M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (5m) 21s ago 5m 13.0M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (5m) 91s ago 5m 128M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (5m) 91s ago 5m 147M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (3m) 21s ago 12m 432M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (2m) 91s ago 9m 388M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:34:22.352 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (2m) 21s ago 12m 43.4M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (115s) 91s ago 9m 25.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (10m) 21s ago 10m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (9m) 91s ago 9m 17.0M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (75s) 21s ago 9m 196M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (28s) 21s ago 8m 13.1M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (8m) 21s ago 8m 325M 4096M 16.2.4 8d91d370c2b8 33025cf3cc5d 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (8m) 91s ago 8m 440M 4096M 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (7m) 91s ago 7m 437M 4096M 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (7m) 91s ago 7m 387M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:34:22.353 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (3m) 21s ago 10m 65.6M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:34:22.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f12b0060f20 msgr2=0x7f12b00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f12b0060f20 0x7f12b00633e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f12bc004c40 tx=0x7f12bc00b040).stop 2024-02-15T18:34:22.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 msgr2=0x7f12c8107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 0x7f12c8107010 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f12b8004e30 tx=0x7f12b8009b30).stop 2024-02-15T18:34:22.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 shutdown_connections 2024-02-15T18:34:22.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f12b0060f20 0x7f12b00633e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12c80f66d0 0x7f12c8107010 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 --2- 172.21.15.33:0/3813609569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c80f7970 0x7f12c8107500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 >> 172.21.15.33:0/3813609569 conn(0x7f12c80f1e10 msgr2=0x7f12c80fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:22.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 shutdown_connections 2024-02-15T18:34:22.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.362+0000 7f12cd2af700 1 -- 172.21.15.33:0/3813609569 wait complete. 2024-02-15T18:34:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.476+0000 7fa262cfa700 1 -- 172.21.15.33:0/2267358613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f66d0 msgr2=0x7fa25c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.476+0000 7fa262cfa700 1 --2- 172.21.15.33:0/2267358613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f66d0 0x7fa25c0f6b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa258004660 tx=0x7fa258009b30).stop 2024-02-15T18:34:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.476+0000 7fa262cfa700 1 -- 172.21.15.33:0/2267358613 shutdown_connections 2024-02-15T18:34:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.476+0000 7fa262cfa700 1 --2- 172.21.15.33:0/2267358613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f66d0 0x7fa25c0f6b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.476+0000 7fa262cfa700 1 --2- 172.21.15.33:0/2267358613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa25c0f5430 0x7fa25c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.476+0000 7fa262cfa700 1 -- 172.21.15.33:0/2267358613 >> 172.21.15.33:0/2267358613 conn(0x7fa25c0f0b90 msgr2=0x7fa25c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.477+0000 7fa262cfa700 1 -- 172.21.15.33:0/2267358613 shutdown_connections 2024-02-15T18:34:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.477+0000 7fa262cfa700 1 -- 172.21.15.33:0/2267358613 wait complete. 2024-02-15T18:34:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.477+0000 7fa262cfa700 1 Processor -- start 2024-02-15T18:34:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.477+0000 7fa262cfa700 1 -- start start 2024-02-15T18:34:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.477+0000 7fa262cfa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f5430 0x7fa25c10bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.477+0000 7fa262cfa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa25c0f66d0 0x7fa25c10e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.477+0000 7fa262cfa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0602b0 con 0x7fa25c0f5430 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.477+0000 7fa262cfa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0603f0 con 0x7fa25c0f66d0 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa261cf8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f5430 0x7fa25c10bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa261cf8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f5430 0x7fa25c10bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44160/0 (socket says 172.21.15.33:44160) 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa261cf8700 1 -- 172.21.15.33:0/3713158448 learned_addr learned my addr 172.21.15.33:0/3713158448 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa2614f7700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa25c0f66d0 0x7fa25c10e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa261cf8700 1 -- 172.21.15.33:0/3713158448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa25c0f66d0 msgr2=0x7fa25c10e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa261cf8700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa25c0f66d0 0x7fa25c10e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa261cf8700 1 -- 172.21.15.33:0/3713158448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258005040 con 0x7fa25c0f5430 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa261cf8700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f5430 0x7fa25c10bed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa24c002700 tx=0x7fa24c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa2527fc700 1 -- 172.21.15.33:0/3713158448 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24c0079c0 con 0x7fa25c0f5430 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa2527fc700 1 -- 172.21.15.33:0/3713158448 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa24c00f040 con 0x7fa25c0f5430 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c10e8c0 con 0x7fa25c0f5430 2024-02-15T18:34:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa2527fc700 1 -- 172.21.15.33:0/3713158448 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24c014990 con 0x7fa25c0f5430 2024-02-15T18:34:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.478+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c10ecc0 con 0x7fa25c0f5430 2024-02-15T18:34:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.479+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c045ad0 con 0x7fa25c0f5430 2024-02-15T18:34:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.480+0000 7fa2527fc700 1 -- 172.21.15.33:0/3713158448 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa24c01b060 con 0x7fa25c0f5430 2024-02-15T18:34:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.480+0000 7fa2527fc700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa248060f70 0x7fa248063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.480+0000 7fa2527fc700 1 -- 172.21.15.33:0/3713158448 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa24c07c160 con 0x7fa25c0f5430 2024-02-15T18:34:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.481+0000 7fa2614f7700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa248060f70 0x7fa248063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.481+0000 7fa2614f7700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa248060f70 0x7fa248063430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa258004630 tx=0x7fa258009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.488+0000 7fa2527fc700 1 -- 172.21.15.33:0/3713158448 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa24c04c660 con 0x7fa25c0f5430 2024-02-15T18:34:22.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.769+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa25c0586e0 con 0x7fa25c0f5430 2024-02-15T18:34:22.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.770+0000 7fa2527fc700 1 -- 172.21.15.33:0/3713158448 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7fa24c04fc80 con 0x7fa25c0f5430 2024-02-15T18:34:22.761 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2, 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 3 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:34:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6, 2024-02-15T18:34:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2024-02-15T18:34:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:34:22.763 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:34:22.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa248060f70 msgr2=0x7fa248063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa248060f70 0x7fa248063430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa258004630 tx=0x7fa258009b30).stop 2024-02-15T18:34:22.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f5430 msgr2=0x7fa25c10bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f5430 0x7fa25c10bed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa24c002700 tx=0x7fa24c009e00).stop 2024-02-15T18:34:22.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 shutdown_connections 2024-02-15T18:34:22.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa248060f70 0x7fa248063430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c0f5430 0x7fa25c10bed0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 --2- 172.21.15.33:0/3713158448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa25c0f66d0 0x7fa25c10e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 >> 172.21.15.33:0/3713158448 conn(0x7fa25c0f0b90 msgr2=0x7fa25c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:22.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 shutdown_connections 2024-02-15T18:34:22.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.772+0000 7fa262cfa700 1 -- 172.21.15.33:0/3713158448 wait complete. 2024-02-15T18:34:22.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 -- 172.21.15.33:0/1028844534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f6860 msgr2=0x7fb0a00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 --2- 172.21.15.33:0/1028844534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f6860 0x7fb0a00f6cc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb088004660 tx=0x7fb088009b30).stop 2024-02-15T18:34:22.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 -- 172.21.15.33:0/1028844534 shutdown_connections 2024-02-15T18:34:22.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 --2- 172.21.15.33:0/1028844534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f6860 0x7fb0a00f6cc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 --2- 172.21.15.33:0/1028844534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0a00f55c0 0x7fb0a00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 -- 172.21.15.33:0/1028844534 >> 172.21.15.33:0/1028844534 conn(0x7fb0a00f0d40 msgr2=0x7fb0a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:22.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 -- 172.21.15.33:0/1028844534 shutdown_connections 2024-02-15T18:34:22.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 -- 172.21.15.33:0/1028844534 wait complete. 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 Processor -- start 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 -- start start 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.886+0000 7fb0a5934700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f55c0 0x7fb0a00f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb0a5934700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0a00f6860 0x7fb0a00f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb0a5934700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00f8920 con 0x7fb0a00f55c0 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb0a5934700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00f8a60 con 0x7fb0a00f6860 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb09effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f55c0 0x7fb0a00f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb09effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f55c0 0x7fb0a00f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44166/0 (socket says 172.21.15.33:44166) 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb09effd700 1 -- 172.21.15.33:0/1768758185 learned_addr learned my addr 172.21.15.33:0/1768758185 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb09e7fc700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0a00f6860 0x7fb0a00f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb09effd700 1 -- 172.21.15.33:0/1768758185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0a00f6860 msgr2=0x7fb0a00f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb09effd700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0a00f6860 0x7fb0a00f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:22.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb09effd700 1 -- 172.21.15.33:0/1768758185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088005040 con 0x7fb0a00f55c0 2024-02-15T18:34:22.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb09e7fc700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0a00f6860 0x7fb0a00f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:34:22.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb09effd700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f55c0 0x7fb0a00f9f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fb090002700 tx=0x7fb090009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:22.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb0977fe700 1 -- 172.21.15.33:0/1768758185 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb090009320 con 0x7fb0a00f55c0 2024-02-15T18:34:22.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a00f8d40 con 0x7fb0a00f55c0 2024-02-15T18:34:22.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb0977fe700 1 -- 172.21.15.33:0/1768758185 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fb09000f040 con 0x7fb0a00f55c0 2024-02-15T18:34:22.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb0977fe700 1 -- 172.21.15.33:0/1768758185 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0900149d0 con 0x7fb0a00f55c0 2024-02-15T18:34:22.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.887+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a010f000 con 0x7fb0a00f55c0 2024-02-15T18:34:22.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.888+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a0045ad0 con 0x7fb0a00f55c0 2024-02-15T18:34:22.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.889+0000 7fb0977fe700 1 -- 172.21.15.33:0/1768758185 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fb090014b30 con 0x7fb0a00f55c0 2024-02-15T18:34:22.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.889+0000 7fb0977fe700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb08c060f20 0x7fb08c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:22.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.890+0000 7fb0977fe700 1 -- 172.21.15.33:0/1768758185 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb09007c6a0 con 0x7fb0a00f55c0 2024-02-15T18:34:22.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.890+0000 7fb09e7fc700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb08c060f20 0x7fb08c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:22.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.890+0000 7fb09e7fc700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb08c060f20 0x7fb08c0633e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb088005010 tx=0x7fb088009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:22.893+0000 7fb0977fe700 1 -- 172.21.15.33:0/1768758185 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb09004cba0 con 0x7fb0a00f55c0 2024-02-15T18:34:22.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.488470+0000 mgr.smithi033.apxevf (mgr.14626) 147 : cluster [DBG] pgmap v102: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.624854+0000 mon.smithi033 (mon.0) 193 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.624882+0000 mon.smithi033 (mon.0) 194 : cluster [INF] osd.2 failed (root=default,host=smithi033) (connection refused reported by osd.3) 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.690259+0000 mon.smithi033 (mon.0) 195 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.729634+0000 mon.smithi033 (mon.0) 196 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.729734+0000 mon.smithi033 (mon.0) 197 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.729906+0000 mon.smithi033 (mon.0) 198 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.729952+0000 mon.smithi033 (mon.0) 199 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.730047+0000 mon.smithi033 (mon.0) 200 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.730087+0000 mon.smithi033 (mon.0) 201 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.730186+0000 mon.smithi033 (mon.0) 202 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.730224+0000 mon.smithi033 (mon.0) 203 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.730319+0000 mon.smithi033 (mon.0) 204 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.730358+0000 mon.smithi033 (mon.0) 205 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.825740+0000 mon.smithi033 (mon.0) 206 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:22.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.890673+0000 mon.smithi033 (mon.0) 207 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:21.999689+0000 mon.smithi033 (mon.0) 208 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.130752+0000 mon.smithi033 (mon.0) 209 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.130876+0000 mon.smithi033 (mon.0) 210 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.130981+0000 mon.smithi033 (mon.0) 211 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.131021+0000 mon.smithi033 (mon.0) 212 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.131119+0000 mon.smithi033 (mon.0) 213 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.131187+0000 mon.smithi033 (mon.0) 214 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.131254+0000 mon.smithi033 (mon.0) 215 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.131320+0000 mon.smithi033 (mon.0) 216 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.131389+0000 mon.smithi033 (mon.0) 217 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.131460+0000 mon.smithi033 (mon.0) 218 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.226684+0000 mon.smithi033 (mon.0) 219 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:22.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.291615+0000 mon.smithi033 (mon.0) 220 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:23.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.488470+0000 mgr.smithi033.apxevf (mgr.14626) 147 : cluster [DBG] pgmap v102: 65 pgs: 65 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:23.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.624854+0000 mon.smithi033 (mon.0) 193 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:23.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.624882+0000 mon.smithi033 (mon.0) 194 : cluster [INF] osd.2 failed (root=default,host=smithi033) (connection refused reported by osd.3) 2024-02-15T18:34:23.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.690259+0000 mon.smithi033 (mon.0) 195 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:23.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.729634+0000 mon.smithi033 (mon.0) 196 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:23.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.729734+0000 mon.smithi033 (mon.0) 197 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.729906+0000 mon.smithi033 (mon.0) 198 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.729952+0000 mon.smithi033 (mon.0) 199 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.730047+0000 mon.smithi033 (mon.0) 200 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.730087+0000 mon.smithi033 (mon.0) 201 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.730186+0000 mon.smithi033 (mon.0) 202 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.730224+0000 mon.smithi033 (mon.0) 203 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.730319+0000 mon.smithi033 (mon.0) 204 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.730358+0000 mon.smithi033 (mon.0) 205 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.825740+0000 mon.smithi033 (mon.0) 206 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.890673+0000 mon.smithi033 (mon.0) 207 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:21.999689+0000 mon.smithi033 (mon.0) 208 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.130752+0000 mon.smithi033 (mon.0) 209 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.130876+0000 mon.smithi033 (mon.0) 210 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:23.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.130981+0000 mon.smithi033 (mon.0) 211 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:23.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.131021+0000 mon.smithi033 (mon.0) 212 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-15T18:34:23.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.131119+0000 mon.smithi033 (mon.0) 213 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:34:23.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.131187+0000 mon.smithi033 (mon.0) 214 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:34:23.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.131254+0000 mon.smithi033 (mon.0) 215 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:23.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.131320+0000 mon.smithi033 (mon.0) 216 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:23.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.131389+0000 mon.smithi033 (mon.0) 217 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-15T18:34:23.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.131460+0000 mon.smithi033 (mon.0) 218 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-15T18:34:23.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.226684+0000 mon.smithi033 (mon.0) 219 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-15T18:34:23.049 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.291615+0000 mon.smithi033 (mon.0) 220 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-15T18:34:23.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.112+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb0a010f7f0 con 0x7fb0a00f55c0 2024-02-15T18:34:23.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.112+0000 7fb0977fe700 1 -- 172.21.15.33:0/1768758185 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1831 (secure 0 0 0) 0x7fb0900501c0 con 0x7fb0a00f55c0 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:e19 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 19 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:31:16.192509+0000 2024-02-15T18:34:23.104 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:34:23.105 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:23.106 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb08c060f20 msgr2=0x7fb08c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb08c060f20 0x7fb08c0633e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb088005010 tx=0x7fb088009b30).stop 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f55c0 msgr2=0x7fb0a00f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f55c0 0x7fb0a00f9f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fb090002700 tx=0x7fb090009d80).stop 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 shutdown_connections 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb08c060f20 0x7fb08c0633e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0a00f55c0 0x7fb0a00f9f40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 --2- 172.21.15.33:0/1768758185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb0a00f6860 0x7fb0a00f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 >> 172.21.15.33:0/1768758185 conn(0x7fb0a00f0d40 msgr2=0x7fb0a005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:23.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 shutdown_connections 2024-02-15T18:34:23.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.114+0000 7fb0a5934700 1 -- 172.21.15.33:0/1768758185 wait complete. 2024-02-15T18:34:23.108 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-02-15T18:34:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.224+0000 7fee73fff700 1 -- 172.21.15.33:0/1604531823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 msgr2=0x7fee740f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.224+0000 7fee73fff700 1 --2- 172.21.15.33:0/1604531823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 0x7fee740f6b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fee68004660 tx=0x7fee68009b30).stop 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.224+0000 7fee73fff700 1 -- 172.21.15.33:0/1604531823 shutdown_connections 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.224+0000 7fee73fff700 1 --2- 172.21.15.33:0/1604531823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 0x7fee740f6b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.224+0000 7fee73fff700 1 --2- 172.21.15.33:0/1604531823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee740f5440 0x7fee740f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.224+0000 7fee73fff700 1 -- 172.21.15.33:0/1604531823 >> 172.21.15.33:0/1604531823 conn(0x7fee740f0ba0 msgr2=0x7fee740f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.224+0000 7fee73fff700 1 -- 172.21.15.33:0/1604531823 shutdown_connections 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.224+0000 7fee73fff700 1 -- 172.21.15.33:0/1604531823 wait complete. 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee73fff700 1 Processor -- start 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee73fff700 1 -- start start 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee73fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee740f5440 0x7fee740f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee73fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 0x7fee740f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee73fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee740f7f80 con 0x7fee740f66e0 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee73fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee740f80c0 con 0x7fee740f5440 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee727fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 0x7fee740f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee727fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 0x7fee740f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44184/0 (socket says 172.21.15.33:44184) 2024-02-15T18:34:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee727fc700 1 -- 172.21.15.33:0/3915470557 learned_addr learned my addr 172.21.15.33:0/3915470557 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee72ffd700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee740f5440 0x7fee740f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee727fc700 1 -- 172.21.15.33:0/3915470557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee740f5440 msgr2=0x7fee740f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.225+0000 7fee727fc700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee740f5440 0x7fee740f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.226+0000 7fee727fc700 1 -- 172.21.15.33:0/3915470557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee68005040 con 0x7fee740f66e0 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.226+0000 7fee727fc700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 0x7fee740f7a20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fee68013fd0 tx=0x7fee68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.226+0000 7fee5b7fe700 1 -- 172.21.15.33:0/3915470557 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee68018070 con 0x7fee740f66e0 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.226+0000 7fee5b7fe700 1 -- 172.21.15.33:0/3915470557 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fee680097d0 con 0x7fee740f66e0 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.226+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee740f8340 con 0x7fee740f66e0 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.226+0000 7fee5b7fe700 1 -- 172.21.15.33:0/3915470557 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee6801c3c0 con 0x7fee740f66e0 2024-02-15T18:34:23.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.226+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee740f88a0 con 0x7fee740f66e0 2024-02-15T18:34:23.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.227+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee74045ad0 con 0x7fee740f66e0 2024-02-15T18:34:23.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.227+0000 7fee5b7fe700 1 -- 172.21.15.33:0/3915470557 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fee6801d420 con 0x7fee740f66e0 2024-02-15T18:34:23.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.228+0000 7fee5b7fe700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fee5c060f70 0x7fee5c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:23.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.228+0000 7fee5b7fe700 1 -- 172.21.15.33:0/3915470557 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fee6807dc70 con 0x7fee740f66e0 2024-02-15T18:34:23.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.228+0000 7fee72ffd700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fee5c060f70 0x7fee5c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:23.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.228+0000 7fee72ffd700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fee5c060f70 0x7fee5c063430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fee740f9330 tx=0x7fee6400b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:23.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.232+0000 7fee5b7fe700 1 -- 172.21.15.33:0/3915470557 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fee6804e110 con 0x7fee740f66e0 2024-02-15T18:34:23.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.423+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee740fab20 con 0x7fee5c060f70 2024-02-15T18:34:23.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.424+0000 7fee5b7fe700 1 -- 172.21.15.33:0/3915470557 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fee740fab20 con 0x7fee5c060f70 2024-02-15T18:34:23.416 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:34:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:34:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:34:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:34:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:34:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:34:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:34:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:34:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:34:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "8/21 daemons upgraded", 2024-02-15T18:34:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:34:23.417 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:34:23.417 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fee5c060f70 msgr2=0x7fee5c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fee5c060f70 0x7fee5c063430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fee740f9330 tx=0x7fee6400b040).stop 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 msgr2=0x7fee740f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 0x7fee740f7a20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fee68013fd0 tx=0x7fee68009b30).stop 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 shutdown_connections 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fee5c060f70 0x7fee5c063430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee740f5440 0x7fee740f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 --2- 172.21.15.33:0/3915470557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee740f66e0 0x7fee740f7a20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 >> 172.21.15.33:0/3915470557 conn(0x7fee740f0ba0 msgr2=0x7fee7405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.426+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 shutdown_connections 2024-02-15T18:34:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:23.427+0000 7fee73fff700 1 -- 172.21.15.33:0/3915470557 wait complete. 2024-02-15T18:34:23.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:21.748206+0000 mgr.smithi033.apxevf (mgr.14626) 148 : audit [DBG] from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:23.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:22.054176+0000 mgr.smithi033.apxevf (mgr.14626) 149 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:23.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:22.352541+0000 mgr.smithi033.apxevf (mgr.14626) 150 : audit [DBG] from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:23.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.557728+0000 mon.smithi033 (mon.0) 221 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:34:23.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:22.565507+0000 mon.smithi033 (mon.0) 222 : cluster [DBG] osdmap e60: 6 total, 5 up, 6 in 2024-02-15T18:34:23.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:22.770772+0000 mon.smithi033 (mon.0) 223 : audit [DBG] from='client.? 172.21.15.33:0/3713158448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:23.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:23.112978+0000 mon.smithi033 (mon.0) 224 : audit [DBG] from='client.? 172.21.15.33:0/1768758185' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:34:23.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:21.748206+0000 mgr.smithi033.apxevf (mgr.14626) 148 : audit [DBG] from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:23.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:22.054176+0000 mgr.smithi033.apxevf (mgr.14626) 149 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:23.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:22.352541+0000 mgr.smithi033.apxevf (mgr.14626) 150 : audit [DBG] from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:23.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.557728+0000 mon.smithi033 (mon.0) 221 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:34:23.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:22.565507+0000 mon.smithi033 (mon.0) 222 : cluster [DBG] osdmap e60: 6 total, 5 up, 6 in 2024-02-15T18:34:23.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:22.770772+0000 mon.smithi033 (mon.0) 223 : audit [DBG] from='client.? 172.21.15.33:0/3713158448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:23.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:23.112978+0000 mon.smithi033 (mon.0) 224 : audit [DBG] from='client.? 172.21.15.33:0/1768758185' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:34:24.797 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:24 smithi033 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.2.service: Succeeded. 2024-02-15T18:34:24.797 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:24 smithi033 systemd[1]: Stopped Ceph osd.2 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:34:24.797 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:24 smithi033 systemd[1]: Starting Ceph osd.2 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:34:24.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:23.425078+0000 mgr.smithi033.apxevf (mgr.14626) 151 : audit [DBG] from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:24.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:23.488959+0000 mgr.smithi033.apxevf (mgr.14626) 152 : cluster [DBG] pgmap v104: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:24.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:23.563405+0000 mon.smithi033 (mon.0) 225 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-02-15T18:34:24.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:23.568609+0000 mon.smithi033 (mon.0) 226 : cluster [DBG] osdmap e61: 6 total, 5 up, 6 in 2024-02-15T18:34:24.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:23.425078+0000 mgr.smithi033.apxevf (mgr.14626) 151 : audit [DBG] from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:24.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:23.488959+0000 mgr.smithi033.apxevf (mgr.14626) 152 : cluster [DBG] pgmap v104: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-02-15T18:34:24.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:23.563405+0000 mon.smithi033 (mon.0) 225 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-02-15T18:34:24.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:23.568609+0000 mon.smithi033 (mon.0) 226 : cluster [DBG] osdmap e61: 6 total, 5 up, 6 in 2024-02-15T18:34:25.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:25.489373+0000 mgr.smithi033.apxevf (mgr.14626) 153 : cluster [DBG] pgmap v106: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 15/357 objects degraded (4.202%) 2024-02-15T18:34:25.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:25.561625+0000 mon.smithi033 (mon.0) 227 : cluster [WRN] Health check failed: Degraded data redundancy: 15/357 objects degraded (4.202%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T18:34:25.798 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:25 smithi033 bash[86148]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:34:25.798 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:25 smithi033 bash[86148]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T18:34:25.798 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:25 smithi033 bash[86148]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-02-15T18:34:25.798 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:25 smithi033 bash[86148]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-15T18:34:25.798 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:25 smithi033 bash[86148]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-02-15T18:34:25.798 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:25 smithi033 bash[86148]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T18:34:25.798 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:25 smithi033 bash[86148]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-15T18:34:25.798 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:25 smithi033 bash[86148]: --> ceph-volume lvm activate successful for osd ID: 2 2024-02-15T18:34:25.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:25.489373+0000 mgr.smithi033.apxevf (mgr.14626) 153 : cluster [DBG] pgmap v106: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 15/357 objects degraded (4.202%) 2024-02-15T18:34:25.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:25.561625+0000 mon.smithi033 (mon.0) 227 : cluster [WRN] Health check failed: Degraded data redundancy: 15/357 objects degraded (4.202%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T18:34:27.297 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-2[86439]: debug 2024-02-15T18:34:26.891+0000 7fde7ffee700 1 -- 172.21.15.33:0/444235310 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56040b6d2680 con 0x56040b699400 2024-02-15T18:34:27.297 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:27 smithi033 bash[86424]: fc3ec254b448fe7069fe87a33ba470559a090c074d86ee96a099b218a4ea7096 2024-02-15T18:34:27.297 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:27 smithi033 systemd[1]: Started Ceph osd.2 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:34:27.739 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-2[86439]: debug 2024-02-15T18:34:27.416+0000 7fde87a7c380 -1 Falling back to public interface 2024-02-15T18:34:28.297 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:27.055671+0000 mon.smithi033 (mon.0) 228 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:28.297 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:27.056463+0000 mon.smithi033 (mon.0) 229 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:28.297 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:27.301255+0000 mon.smithi033 (mon.0) 230 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:28.297 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:27.489680+0000 mgr.smithi033.apxevf (mgr.14626) 154 : cluster [DBG] pgmap v107: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 15/357 objects degraded (4.202%) 2024-02-15T18:34:28.297 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:27.653683+0000 mon.smithi033 (mon.0) 231 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:28.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:27.055671+0000 mon.smithi033 (mon.0) 228 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:28.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:27.056463+0000 mon.smithi033 (mon.0) 229 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:28.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:27.301255+0000 mon.smithi033 (mon.0) 230 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:28.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:27.489680+0000 mgr.smithi033.apxevf (mgr.14626) 154 : cluster [DBG] pgmap v107: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 15/357 objects degraded (4.202%) 2024-02-15T18:34:28.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:27.653683+0000 mon.smithi033 (mon.0) 231 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:29.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:29.130885+0000 mon.smithi033 (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 6 pgs peering (PG_AVAILABILITY) 2024-02-15T18:34:29.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:29.130885+0000 mon.smithi033 (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 6 pgs peering (PG_AVAILABILITY) 2024-02-15T18:34:30.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:29.490326+0000 mgr.smithi033.apxevf (mgr.14626) 155 : cluster [DBG] pgmap v108: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:30.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:29.490326+0000 mgr.smithi033.apxevf (mgr.14626) 155 : cluster [DBG] pgmap v108: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:31.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:30.301110+0000 mon.smithi033 (mon.0) 233 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 6 pgs peering) 2024-02-15T18:34:31.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:30.301110+0000 mon.smithi033 (mon.0) 233 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 6 pgs peering) 2024-02-15T18:34:32.718 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:31.490673+0000 mgr.smithi033.apxevf (mgr.14626) 156 : cluster [DBG] pgmap v109: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:32.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:31.490673+0000 mgr.smithi033.apxevf (mgr.14626) 156 : cluster [DBG] pgmap v109: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:34.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.241796+0000 mon.smithi033 (mon.0) 234 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.242711+0000 mon.smithi033 (mon.0) 235 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.243361+0000 mon.smithi033 (mon.0) 236 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:33.243923+0000 mgr.smithi033.apxevf (mgr.14626) 157 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.247828+0000 mon.smithi033 (mon.0) 237 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.253609+0000 mon.smithi033 (mon.0) 238 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.255987+0000 mon.smithi033 (mon.0) 239 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.257121+0000 mon.smithi033 (mon.0) 240 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.258187+0000 mon.smithi033 (mon.0) 241 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.259252+0000 mon.smithi033 (mon.0) 242 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:33.259393+0000 mgr.smithi033.apxevf (mgr.14626) 158 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:33.260043+0000 mgr.smithi033.apxevf (mgr.14626) 159 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:33.491020+0000 mgr.smithi033.apxevf (mgr.14626) 160 : cluster [DBG] pgmap v110: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:34.498 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:34.131805+0000 mon.smithi033 (mon.0) 243 : cluster [WRN] Health check update: Degraded data redundancy: 44/357 objects degraded (12.325%), 12 pgs degraded (PG_DEGRADED) 2024-02-15T18:34:34.547 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-2[86439]: debug 2024-02-15T18:34:34.342+0000 7fde87a7c380 -1 osd.2 59 log_to_monitors {default=true} 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.241796+0000 mon.smithi033 (mon.0) 234 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.242711+0000 mon.smithi033 (mon.0) 235 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.243361+0000 mon.smithi033 (mon.0) 236 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:33.243923+0000 mgr.smithi033.apxevf (mgr.14626) 157 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.247828+0000 mon.smithi033 (mon.0) 237 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.253609+0000 mon.smithi033 (mon.0) 238 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.255987+0000 mon.smithi033 (mon.0) 239 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.257121+0000 mon.smithi033 (mon.0) 240 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.258187+0000 mon.smithi033 (mon.0) 241 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.259252+0000 mon.smithi033 (mon.0) 242 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:34:34.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:33.259393+0000 mgr.smithi033.apxevf (mgr.14626) 158 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:34:34.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:33.260043+0000 mgr.smithi033.apxevf (mgr.14626) 159 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T18:34:34.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:33.491020+0000 mgr.smithi033.apxevf (mgr.14626) 160 : cluster [DBG] pgmap v110: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:34.548 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:34.131805+0000 mon.smithi033 (mon.0) 243 : cluster [WRN] Health check update: Degraded data redundancy: 44/357 objects degraded (12.325%), 12 pgs degraded (PG_DEGRADED) 2024-02-15T18:34:35.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:34.346480+0000 mon.smithi033 (mon.0) 244 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3790166603,v1:172.21.15.33:6819/3790166603]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T18:34:35.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:34.346480+0000 mon.smithi033 (mon.0) 244 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3790166603,v1:172.21.15.33:6819/3790166603]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-15T18:34:35.547 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:34:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-2[86439]: debug 2024-02-15T18:34:35.264+0000 7fde78762700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:34:36.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:35.258397+0000 mon.smithi033 (mon.0) 245 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3790166603,v1:172.21.15.33:6819/3790166603]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T18:34:36.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:35.258466+0000 mon.smithi033 (mon.0) 246 : cluster [DBG] osdmap e62: 6 total, 5 up, 6 in 2024-02-15T18:34:36.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:35.259238+0000 mon.smithi033 (mon.0) 247 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3790166603,v1:172.21.15.33:6819/3790166603]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:34:36.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:35.491511+0000 mgr.smithi033.apxevf (mgr.14626) 161 : cluster [DBG] pgmap v112: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:36.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:35.258397+0000 mon.smithi033 (mon.0) 245 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3790166603,v1:172.21.15.33:6819/3790166603]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-15T18:34:36.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:35.258466+0000 mon.smithi033 (mon.0) 246 : cluster [DBG] osdmap e62: 6 total, 5 up, 6 in 2024-02-15T18:34:36.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:35.259238+0000 mon.smithi033 (mon.0) 247 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3790166603,v1:172.21.15.33:6819/3790166603]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-02-15T18:34:36.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:35.491511+0000 mgr.smithi033.apxevf (mgr.14626) 161 : cluster [DBG] pgmap v112: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:37.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:36.254496+0000 mon.smithi033 (mon.0) 248 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:34:37.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:36.261060+0000 mon.smithi033 (mon.0) 249 : cluster [INF] osd.2 [v2:172.21.15.33:6818/3790166603,v1:172.21.15.33:6819/3790166603] boot 2024-02-15T18:34:37.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:36.261135+0000 mon.smithi033 (mon.0) 250 : cluster [DBG] osdmap e63: 6 total, 6 up, 6 in 2024-02-15T18:34:37.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:36.262055+0000 mon.smithi033 (mon.0) 251 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:34:37.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:37.260070+0000 mon.smithi033 (mon.0) 252 : cluster [DBG] osdmap e64: 6 total, 6 up, 6 in 2024-02-15T18:34:37.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:36.254496+0000 mon.smithi033 (mon.0) 248 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:34:37.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:36.261060+0000 mon.smithi033 (mon.0) 249 : cluster [INF] osd.2 [v2:172.21.15.33:6818/3790166603,v1:172.21.15.33:6819/3790166603] boot 2024-02-15T18:34:37.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:36.261135+0000 mon.smithi033 (mon.0) 250 : cluster [DBG] osdmap e63: 6 total, 6 up, 6 in 2024-02-15T18:34:37.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:36.262055+0000 mon.smithi033 (mon.0) 251 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-15T18:34:37.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:37.260070+0000 mon.smithi033 (mon.0) 252 : cluster [DBG] osdmap e64: 6 total, 6 up, 6 in 2024-02-15T18:34:38.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:37.492003+0000 mgr.smithi033.apxevf (mgr.14626) 162 : cluster [DBG] pgmap v115: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:38.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:37.492003+0000 mgr.smithi033.apxevf (mgr.14626) 162 : cluster [DBG] pgmap v115: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 44/357 objects degraded (12.325%) 2024-02-15T18:34:40.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:39.492579+0000 mgr.smithi033.apxevf (mgr.14626) 163 : cluster [DBG] pgmap v116: 65 pgs: 6 active+undersized+degraded, 8 active+undersized, 51 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 25/357 objects degraded (7.003%) 2024-02-15T18:34:40.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:39.492579+0000 mgr.smithi033.apxevf (mgr.14626) 163 : cluster [DBG] pgmap v116: 65 pgs: 6 active+undersized+degraded, 8 active+undersized, 51 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 25/357 objects degraded (7.003%) 2024-02-15T18:34:41.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:40.134866+0000 mon.smithi033 (mon.0) 253 : cluster [WRN] Health check update: Degraded data redundancy: 25/357 objects degraded (7.003%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:34:41.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:40.134866+0000 mon.smithi033 (mon.0) 253 : cluster [WRN] Health check update: Degraded data redundancy: 25/357 objects degraded (7.003%), 6 pgs degraded (PG_DEGRADED) 2024-02-15T18:34:42.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:41.493076+0000 mgr.smithi033.apxevf (mgr.14626) 164 : cluster [DBG] pgmap v117: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 328 B/s rd, 0 op/s 2024-02-15T18:34:42.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:41.493076+0000 mgr.smithi033.apxevf (mgr.14626) 164 : cluster [DBG] pgmap v117: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 328 B/s rd, 0 op/s 2024-02-15T18:34:43.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:42.143772+0000 mon.smithi033 (mon.0) 254 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/357 objects degraded (7.003%), 6 pgs degraded) 2024-02-15T18:34:43.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:42.654252+0000 mon.smithi033 (mon.0) 255 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:43.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:42.143772+0000 mon.smithi033 (mon.0) 254 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/357 objects degraded (7.003%), 6 pgs degraded) 2024-02-15T18:34:43.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:42.654252+0000 mon.smithi033 (mon.0) 255 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:44.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:43.493770+0000 mgr.smithi033.apxevf (mgr.14626) 165 : cluster [DBG] pgmap v118: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-02-15T18:34:44.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:43.493770+0000 mgr.smithi033.apxevf (mgr.14626) 165 : cluster [DBG] pgmap v118: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-02-15T18:34:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:45.494501+0000 mgr.smithi033.apxevf (mgr.14626) 166 : cluster [DBG] pgmap v119: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 221 B/s rd, 0 op/s 2024-02-15T18:34:46.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:45.494501+0000 mgr.smithi033.apxevf (mgr.14626) 166 : cluster [DBG] pgmap v119: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 221 B/s rd, 0 op/s 2024-02-15T18:34:48.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:47.494944+0000 mgr.smithi033.apxevf (mgr.14626) 167 : cluster [DBG] pgmap v120: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 200 B/s rd, 0 op/s 2024-02-15T18:34:48.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:47.723308+0000 mon.smithi033 (mon.0) 256 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:48.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:48.275386+0000 mon.smithi033 (mon.0) 257 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:34:48.814 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:47.494944+0000 mgr.smithi033.apxevf (mgr.14626) 167 : cluster [DBG] pgmap v120: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 200 B/s rd, 0 op/s 2024-02-15T18:34:48.815 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:47.723308+0000 mon.smithi033 (mon.0) 256 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:48.815 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:48.275386+0000 mon.smithi033 (mon.0) 257 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:34:49.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:48.275594+0000 mgr.smithi033.apxevf (mgr.14626) 168 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:34:49.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:48.276613+0000 mgr.smithi033.apxevf (mgr.14626) 169 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-15T18:34:49.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:48.275594+0000 mgr.smithi033.apxevf (mgr.14626) 168 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-15T18:34:49.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:48.276613+0000 mgr.smithi033.apxevf (mgr.14626) 169 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-15T18:34:50.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:49.495558+0000 mgr.smithi033.apxevf (mgr.14626) 170 : cluster [DBG] pgmap v121: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 0 op/s 2024-02-15T18:34:50.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:49.753167+0000 mon.smithi033 (mon.0) 258 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:50.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:49.754137+0000 mon.smithi033 (mon.0) 259 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T18:34:50.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:49.754899+0000 mon.smithi033 (mon.0) 260 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:50.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:49.495558+0000 mgr.smithi033.apxevf (mgr.14626) 170 : cluster [DBG] pgmap v121: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 0 op/s 2024-02-15T18:34:50.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:49.753167+0000 mon.smithi033 (mon.0) 258 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:50.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:49.754137+0000 mon.smithi033 (mon.0) 259 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-15T18:34:50.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:49.754899+0000 mon.smithi033 (mon.0) 260 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:34:51.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:49.748499+0000 mgr.smithi033.apxevf (mgr.14626) 171 : cephadm [INF] Upgrade: Updating osd.3 2024-02-15T18:34:51.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:34:49.756123+0000 mgr.smithi033.apxevf (mgr.14626) 172 : cephadm [INF] Deploying daemon osd.3 on smithi131 2024-02-15T18:34:52.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:49.748499+0000 mgr.smithi033.apxevf (mgr.14626) 171 : cephadm [INF] Upgrade: Updating osd.3 2024-02-15T18:34:52.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:34:49.756123+0000 mgr.smithi033.apxevf (mgr.14626) 172 : cephadm [INF] Deploying daemon osd.3 on smithi131 2024-02-15T18:34:52.585 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:51.496009+0000 mgr.smithi033.apxevf (mgr.14626) 173 : cluster [DBG] pgmap v122: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 0 op/s 2024-02-15T18:34:52.585 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:52 smithi131 systemd[1]: Stopping Ceph osd.3 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:34:52.924 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.3[44790]: debug 2024-02-15T18:34:52.592+0000 7fe707f11700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:34:52.924 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.3[44790]: debug 2024-02-15T18:34:52.592+0000 7fe707f11700 -1 osd.3 64 *** Got signal Terminated *** 2024-02-15T18:34:52.924 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.3[44790]: debug 2024-02-15T18:34:52.592+0000 7fe707f11700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:34:53.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:51.496009+0000 mgr.smithi033.apxevf (mgr.14626) 173 : cluster [DBG] pgmap v122: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 0 op/s 2024-02-15T18:34:53.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:53 smithi131 bash[61198]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.3 2024-02-15T18:34:53.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:53 smithi131 bash[61253]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.3 2024-02-15T18:34:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/3330793612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 msgr2=0x7f5ba00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 --2- 172.21.15.33:0/3330793612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 0x7f5ba00f6cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5b94004660 tx=0x7f5b94009b30).stop 2024-02-15T18:34:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/3330793612 shutdown_connections 2024-02-15T18:34:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 --2- 172.21.15.33:0/3330793612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 0x7f5ba00f6cc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 --2- 172.21.15.33:0/3330793612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba00f55c0 0x7f5ba00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/3330793612 >> 172.21.15.33:0/3330793612 conn(0x7f5ba00f0d40 msgr2=0x7f5ba00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/3330793612 shutdown_connections 2024-02-15T18:34:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/3330793612 wait complete. 2024-02-15T18:34:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 Processor -- start 2024-02-15T18:34:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.544+0000 7f5ba6bcb700 1 -- start start 2024-02-15T18:34:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5ba6bcb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba00f55c0 0x7f5ba0106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5ba6bcb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 0x7f5ba01074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5ba6bcb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba0107a60 con 0x7f5ba00f6860 2024-02-15T18:34:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5ba6bcb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba0107ba0 con 0x7f5ba00f55c0 2024-02-15T18:34:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5b9ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 0x7f5ba01074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5b9ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 0x7f5ba01074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39610/0 (socket says 172.21.15.33:39610) 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5b9ffff700 1 -- 172.21.15.33:0/56561852 learned_addr learned my addr 172.21.15.33:0/56561852 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5ba4967700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba00f55c0 0x7f5ba0106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5b9ffff700 1 -- 172.21.15.33:0/56561852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba00f55c0 msgr2=0x7f5ba0106fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5b9ffff700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba00f55c0 0x7f5ba0106fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5b9ffff700 1 -- 172.21.15.33:0/56561852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94005040 con 0x7f5ba00f6860 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5b9ffff700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 0x7f5ba01074b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5b94000c00 tx=0x7f5b9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.545+0000 7f5b9d7fa700 1 -- 172.21.15.33:0/56561852 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b94019070 con 0x7f5ba00f6860 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.546+0000 7f5b9d7fa700 1 -- 172.21.15.33:0/56561852 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f5b94007e80 con 0x7f5ba00f6860 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.546+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba01084e0 con 0x7f5ba00f6860 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.546+0000 7f5b9d7fa700 1 -- 172.21.15.33:0/56561852 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b94014db0 con 0x7f5ba00f6860 2024-02-15T18:34:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.546+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba0108a40 con 0x7f5ba00f6860 2024-02-15T18:34:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.547+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba0045ad0 con 0x7f5ba00f6860 2024-02-15T18:34:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.547+0000 7f5b9d7fa700 1 -- 172.21.15.33:0/56561852 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f5b94025070 con 0x7f5ba00f6860 2024-02-15T18:34:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.547+0000 7f5b9d7fa700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5b88060ec0 0x7f5b88063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.548+0000 7f5b9d7fa700 1 -- 172.21.15.33:0/56561852 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5b9407d040 con 0x7f5ba00f6860 2024-02-15T18:34:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.548+0000 7f5ba4967700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5b88060ec0 0x7f5b88063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:53.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.548+0000 7f5ba4967700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5b88060ec0 0x7f5b88063380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f5b90009fd0 tx=0x7f5b9000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.552+0000 7f5b9d7fa700 1 -- 172.21.15.33:0/56561852 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5b94050f00 con 0x7f5ba00f6860 2024-02-15T18:34:53.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.752+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ba00faca0 con 0x7f5b88060ec0 2024-02-15T18:34:53.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.753+0000 7f5b9d7fa700 1 -- 172.21.15.33:0/56561852 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5ba00faca0 con 0x7f5b88060ec0 2024-02-15T18:34:53.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5b88060ec0 msgr2=0x7f5b88063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:53.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5b88060ec0 0x7f5b88063380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f5b90009fd0 tx=0x7f5b9000b040).stop 2024-02-15T18:34:53.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 msgr2=0x7f5ba01074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:53.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 0x7f5ba01074b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5b94000c00 tx=0x7f5b9400b040).stop 2024-02-15T18:34:53.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 shutdown_connections 2024-02-15T18:34:53.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5b88060ec0 0x7f5b88063380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:53.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba00f55c0 0x7f5ba0106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:53.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 --2- 172.21.15.33:0/56561852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ba00f6860 0x7f5ba01074b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:53.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 >> 172.21.15.33:0/56561852 conn(0x7f5ba00f0d40 msgr2=0x7f5ba005ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:53.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 shutdown_connections 2024-02-15T18:34:53.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.755+0000 7f5ba6bcb700 1 -- 172.21.15.33:0/56561852 wait complete. 2024-02-15T18:34:53.757 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:34:53.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.663237+0000 mon.smithi033 (mon.0) 261 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.663306+0000 mon.smithi033 (mon.0) 262 : cluster [INF] osd.3 failed (root=default,host=smithi131) (connection refused reported by osd.5) 2024-02-15T18:34:53.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.774261+0000 mon.smithi033 (mon.0) 263 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849018+0000 mon.smithi033 (mon.0) 264 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849082+0000 mon.smithi033 (mon.0) 265 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849236+0000 mon.smithi033 (mon.0) 266 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849293+0000 mon.smithi033 (mon.0) 267 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849422+0000 mon.smithi033 (mon.0) 268 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849508+0000 mon.smithi033 (mon.0) 269 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849641+0000 mon.smithi033 (mon.0) 270 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849751+0000 mon.smithi033 (mon.0) 271 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849834+0000 mon.smithi033 (mon.0) 272 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.849951+0000 mon.smithi033 (mon.0) 273 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.860260+0000 mon.smithi033 (mon.0) 274 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.863685+0000 mon.smithi033 (mon.0) 275 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.891755+0000 mon.smithi033 (mon.0) 276 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:52.975049+0000 mon.smithi033 (mon.0) 277 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.060763+0000 mon.smithi033 (mon.0) 278 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.092212+0000 mon.smithi033 (mon.0) 279 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250043+0000 mon.smithi033 (mon.0) 280 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250103+0000 mon.smithi033 (mon.0) 281 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250239+0000 mon.smithi033 (mon.0) 282 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250293+0000 mon.smithi033 (mon.0) 283 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250406+0000 mon.smithi033 (mon.0) 284 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250531+0000 mon.smithi033 (mon.0) 285 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250626+0000 mon.smithi033 (mon.0) 286 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250735+0000 mon.smithi033 (mon.0) 287 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250823+0000 mon.smithi033 (mon.0) 288 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.250930+0000 mon.smithi033 (mon.0) 289 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.264680+0000 mon.smithi033 (mon.0) 290 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.289795+0000 mon.smithi033 (mon.0) 291 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.376047+0000 mon.smithi033 (mon.0) 292 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.461848+0000 mon.smithi033 (mon.0) 293 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.491099+0000 mon.smithi033 (mon.0) 294 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.492982+0000 mon.smithi033 (mon.0) 295 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.858+0000 7f7dd2c81700 1 -- 172.21.15.33:0/470087985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 msgr2=0x7f7dcc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:53.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.858+0000 7f7dd2c81700 1 --2- 172.21.15.33:0/470087985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 0x7f7dcc0f6b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7dbc004660 tx=0x7f7dbc009b30).stop 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.858+0000 7f7dd2c81700 1 -- 172.21.15.33:0/470087985 shutdown_connections 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.858+0000 7f7dd2c81700 1 --2- 172.21.15.33:0/470087985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 0x7f7dcc0f6b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.858+0000 7f7dd2c81700 1 --2- 172.21.15.33:0/470087985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc0f5430 0x7f7dcc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.858+0000 7f7dd2c81700 1 -- 172.21.15.33:0/470087985 >> 172.21.15.33:0/470087985 conn(0x7f7dcc0f0b90 msgr2=0x7f7dcc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd2c81700 1 -- 172.21.15.33:0/470087985 shutdown_connections 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd2c81700 1 -- 172.21.15.33:0/470087985 wait complete. 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd2c81700 1 Processor -- start 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd2c81700 1 -- start start 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd2c81700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc0f5430 0x7f7dcc109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd2c81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 0x7f7dcc10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd2c81700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc0603e0 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd2c81700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc060520 con 0x7f7dcc0f5430 2024-02-15T18:34:53.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd147e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 0x7f7dcc10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd147e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 0x7f7dcc10bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39628/0 (socket says 172.21.15.33:39628) 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd147e700 1 -- 172.21.15.33:0/3934849360 learned_addr learned my addr 172.21.15.33:0/3934849360 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.859+0000 7f7dd1c7f700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc0f5430 0x7f7dcc109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.860+0000 7f7dd147e700 1 -- 172.21.15.33:0/3934849360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc0f5430 msgr2=0x7f7dcc109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.860+0000 7f7dd147e700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc0f5430 0x7f7dcc109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.860+0000 7f7dd147e700 1 -- 172.21.15.33:0/3934849360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc005040 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.860+0000 7f7dd147e700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 0x7f7dcc10bfb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f7dbc000c00 tx=0x7f7dbc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.860+0000 7f7dc27fc700 1 -- 172.21.15.33:0/3934849360 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dbc019070 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.860+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dcc10c500 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.860+0000 7f7dc27fc700 1 -- 172.21.15.33:0/3934849360 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f7dbc007e80 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.860+0000 7f7dc27fc700 1 -- 172.21.15.33:0/3934849360 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dbc014db0 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.860+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dcc10ca60 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.861+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dcc045ad0 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.862+0000 7f7dc27fc700 1 -- 172.21.15.33:0/3934849360 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f7dbc025070 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.862+0000 7f7dc27fc700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7db8060f10 0x7f7db80633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:53.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.862+0000 7f7dc27fc700 1 -- 172.21.15.33:0/3934849360 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7dbc07d020 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.862+0000 7f7dd1c7f700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7db8060f10 0x7f7db80633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:53.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.862+0000 7f7dd1c7f700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7db8060f10 0x7f7db80633d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7dcc060060 tx=0x7f7dc800b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:53.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:53.866+0000 7f7dc27fc700 1 -- 172.21.15.33:0/3934849360 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7dbc04d4a0 con 0x7f7dcc0f66d0 2024-02-15T18:34:53.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.663237+0000 mon.smithi033 (mon.0) 261 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.663306+0000 mon.smithi033 (mon.0) 262 : cluster [INF] osd.3 failed (root=default,host=smithi131) (connection refused reported by osd.5) 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.774261+0000 mon.smithi033 (mon.0) 263 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849018+0000 mon.smithi033 (mon.0) 264 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849082+0000 mon.smithi033 (mon.0) 265 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849236+0000 mon.smithi033 (mon.0) 266 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849293+0000 mon.smithi033 (mon.0) 267 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849422+0000 mon.smithi033 (mon.0) 268 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849508+0000 mon.smithi033 (mon.0) 269 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849641+0000 mon.smithi033 (mon.0) 270 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849751+0000 mon.smithi033 (mon.0) 271 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849834+0000 mon.smithi033 (mon.0) 272 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.849951+0000 mon.smithi033 (mon.0) 273 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.860260+0000 mon.smithi033 (mon.0) 274 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.863685+0000 mon.smithi033 (mon.0) 275 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.891755+0000 mon.smithi033 (mon.0) 276 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:52.975049+0000 mon.smithi033 (mon.0) 277 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.060763+0000 mon.smithi033 (mon.0) 278 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.092212+0000 mon.smithi033 (mon.0) 279 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250043+0000 mon.smithi033 (mon.0) 280 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250103+0000 mon.smithi033 (mon.0) 281 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250239+0000 mon.smithi033 (mon.0) 282 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250293+0000 mon.smithi033 (mon.0) 283 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250406+0000 mon.smithi033 (mon.0) 284 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250531+0000 mon.smithi033 (mon.0) 285 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250626+0000 mon.smithi033 (mon.0) 286 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250735+0000 mon.smithi033 (mon.0) 287 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250823+0000 mon.smithi033 (mon.0) 288 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.250930+0000 mon.smithi033 (mon.0) 289 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.264680+0000 mon.smithi033 (mon.0) 290 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.289795+0000 mon.smithi033 (mon.0) 291 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.376047+0000 mon.smithi033 (mon.0) 292 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.461848+0000 mon.smithi033 (mon.0) 293 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.491099+0000 mon.smithi033 (mon.0) 294 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-15T18:34:53.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.492982+0000 mon.smithi033 (mon.0) 295 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-15T18:34:54.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.059+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dcc057f10 con 0x7f7db8060f10 2024-02-15T18:34:54.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.060+0000 7f7dc27fc700 1 -- 172.21.15.33:0/3934849360 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7dcc057f10 con 0x7f7db8060f10 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7db8060f10 msgr2=0x7f7db80633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7db8060f10 0x7f7db80633d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7dcc060060 tx=0x7f7dc800b040).stop 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 msgr2=0x7f7dcc10bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 0x7f7dcc10bfb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f7dbc000c00 tx=0x7f7dbc00b040).stop 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 shutdown_connections 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7db8060f10 0x7f7db80633d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dcc0f5430 0x7f7dcc109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 --2- 172.21.15.33:0/3934849360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dcc0f66d0 0x7f7dcc10bfb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 >> 172.21.15.33:0/3934849360 conn(0x7f7dcc0f0b90 msgr2=0x7f7dcc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.062+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 shutdown_connections 2024-02-15T18:34:54.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.063+0000 7f7dd2c81700 1 -- 172.21.15.33:0/3934849360 wait complete. 2024-02-15T18:34:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.164+0000 7fbbf9cae700 1 -- 172.21.15.33:0/2544302088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f6860 msgr2=0x7fbbf40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.164+0000 7fbbf9cae700 1 --2- 172.21.15.33:0/2544302088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f6860 0x7fbbf40f6cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fbbdc004660 tx=0x7fbbdc009b30).stop 2024-02-15T18:34:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.164+0000 7fbbf9cae700 1 -- 172.21.15.33:0/2544302088 shutdown_connections 2024-02-15T18:34:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.164+0000 7fbbf9cae700 1 --2- 172.21.15.33:0/2544302088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f6860 0x7fbbf40f6cc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.164+0000 7fbbf9cae700 1 --2- 172.21.15.33:0/2544302088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbf40f55c0 0x7fbbf40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.164+0000 7fbbf9cae700 1 -- 172.21.15.33:0/2544302088 >> 172.21.15.33:0/2544302088 conn(0x7fbbf40f0d40 msgr2=0x7fbbf40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.164+0000 7fbbf9cae700 1 -- 172.21.15.33:0/2544302088 shutdown_connections 2024-02-15T18:34:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.164+0000 7fbbf9cae700 1 -- 172.21.15.33:0/2544302088 wait complete. 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.164+0000 7fbbf9cae700 1 Processor -- start 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf9cae700 1 -- start start 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf9cae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f55c0 0x7fbbf4109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf9cae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbf40f6860 0x7fbbf410c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf9cae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40603c0 con 0x7fbbf40f55c0 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf9cae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4060500 con 0x7fbbf40f6860 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f55c0 0x7fbbf4109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f55c0 0x7fbbf4109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39634/0 (socket says 172.21.15.33:39634) 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf37fe700 1 -- 172.21.15.33:0/3598105692 learned_addr learned my addr 172.21.15.33:0/3598105692 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf2ffd700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbf40f6860 0x7fbbf410c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf37fe700 1 -- 172.21.15.33:0/3598105692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbf40f6860 msgr2=0x7fbbf410c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf37fe700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbf40f6860 0x7fbbf410c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf37fe700 1 -- 172.21.15.33:0/3598105692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc005040 con 0x7fbbf40f55c0 2024-02-15T18:34:54.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.165+0000 7fbbf37fe700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f55c0 0x7fbbf4109cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fbbe400e7c0 tx=0x7fbbe400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:54.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.166+0000 7fbbebfff700 1 -- 172.21.15.33:0/3598105692 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbe40092e0 con 0x7fbbf40f55c0 2024-02-15T18:34:54.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.166+0000 7fbbebfff700 1 -- 172.21.15.33:0/3598105692 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fbbe400f040 con 0x7fbbf40f55c0 2024-02-15T18:34:54.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.166+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf410c780 con 0x7fbbf40f55c0 2024-02-15T18:34:54.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.166+0000 7fbbebfff700 1 -- 172.21.15.33:0/3598105692 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbe4014920 con 0x7fbbf40f55c0 2024-02-15T18:34:54.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.166+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf410cd10 con 0x7fbbf40f55c0 2024-02-15T18:34:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.167+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf40f49b0 con 0x7fbbf40f55c0 2024-02-15T18:34:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.167+0000 7fbbebfff700 1 -- 172.21.15.33:0/3598105692 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fbbe401b030 con 0x7fbbf40f55c0 2024-02-15T18:34:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.167+0000 7fbbebfff700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbbe0060f20 0x7fbbe00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.168+0000 7fbbebfff700 1 -- 172.21.15.33:0/3598105692 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fbbe407bd00 con 0x7fbbf40f55c0 2024-02-15T18:34:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.168+0000 7fbbf2ffd700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbbe0060f20 0x7fbbe00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.168+0000 7fbbf2ffd700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbbe0060f20 0x7fbbe00633e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fbbdc004630 tx=0x7fbbdc016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:54.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.172+0000 7fbbebfff700 1 -- 172.21.15.33:0/3598105692 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbbe407f030 con 0x7fbbf40f55c0 2024-02-15T18:34:54.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.353+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbf40fe000 con 0x7fbbe0060f20 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.363+0000 7fbbebfff700 1 -- 172.21.15.33:0/3598105692 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fbbf40fe000 con 0x7fbbe0060f20 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (9m) 21s ago 11m 19.5M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (2m) 21s ago 11m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (2m) 2m ago 10m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (9m) 21s ago 11m 34.2M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (6m) 21s ago 6m 17.4M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (6m) 21s ago 6m 13.2M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (6m) 2m ago 6m 128M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (6m) 2m ago 6m 147M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:34:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (3m) 21s ago 12m 433M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (2m) 2m ago 10m 388M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (2m) 21s ago 13m 42.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (2m) 2m ago 10m 25.6M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (11m) 21s ago 11m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (10m) 2m ago 10m 17.0M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (107s) 21s ago 9m 196M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (60s) 21s ago 9m 193M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (27s) 21s ago 8m 10.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (8m) 2m ago 8m 440M 4096M 16.2.4 8d91d370c2b8 cdd4cc2e6367 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (8m) 2m ago 8m 437M 4096M 16.2.4 8d91d370c2b8 df7bc67e84c2 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (7m) 2m ago 7m 387M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:34:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (3m) 21s ago 10m 65.6M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.364+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbbe0060f20 msgr2=0x7fbbe00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.364+0000 7fbbf9cae700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbbe0060f20 0x7fbbe00633e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fbbdc004630 tx=0x7fbbdc016040).stop 2024-02-15T18:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.364+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f55c0 msgr2=0x7fbbf4109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.364+0000 7fbbf9cae700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f55c0 0x7fbbf4109cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fbbe400e7c0 tx=0x7fbbe400b040).stop 2024-02-15T18:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.364+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 shutdown_connections 2024-02-15T18:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.364+0000 7fbbf9cae700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fbbe0060f20 0x7fbbe00633e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.364+0000 7fbbf9cae700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbf40f55c0 0x7fbbf4109cd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.364+0000 7fbbf9cae700 1 --2- 172.21.15.33:0/3598105692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbbf40f6860 0x7fbbf410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.364+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 >> 172.21.15.33:0/3598105692 conn(0x7fbbf40f0d40 msgr2=0x7fbbf40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.365+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 shutdown_connections 2024-02-15T18:34:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.365+0000 7fbbf9cae700 1 -- 172.21.15.33:0/3598105692 wait complete. 2024-02-15T18:34:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 -- 172.21.15.33:0/2224698202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 msgr2=0x7f9bbc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 --2- 172.21.15.33:0/2224698202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 0x7f9bbc0f7de0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f9bb8004660 tx=0x7f9bb8009b30).stop 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 -- 172.21.15.33:0/2224698202 shutdown_connections 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 --2- 172.21.15.33:0/2224698202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 0x7f9bbc0f7de0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 --2- 172.21.15.33:0/2224698202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bbc0f66e0 0x7f9bbc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 -- 172.21.15.33:0/2224698202 >> 172.21.15.33:0/2224698202 conn(0x7f9bbc0f1e40 msgr2=0x7f9bbc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 -- 172.21.15.33:0/2224698202 shutdown_connections 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 -- 172.21.15.33:0/2224698202 wait complete. 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 Processor -- start 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.465+0000 7f9bc43e8700 1 -- start start 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc43e8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bbc0f66e0 0x7f9bbc107070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc43e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 0x7f9bbc107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc43e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc107ba0 con 0x7f9bbc0f7980 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc43e8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc108450 con 0x7f9bbc0f66e0 2024-02-15T18:34:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc1983700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 0x7f9bbc107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc1983700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 0x7f9bbc107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39654/0 (socket says 172.21.15.33:39654) 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc1983700 1 -- 172.21.15.33:0/3062288791 learned_addr learned my addr 172.21.15.33:0/3062288791 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc2184700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bbc0f66e0 0x7f9bbc107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc1983700 1 -- 172.21.15.33:0/3062288791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bbc0f66e0 msgr2=0x7f9bbc107070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc1983700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bbc0f66e0 0x7f9bbc107070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc1983700 1 -- 172.21.15.33:0/3062288791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb8005040 con 0x7f9bbc0f7980 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc1983700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 0x7f9bbc107560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9bb8009f50 tx=0x7f9bb8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9baeffd700 1 -- 172.21.15.33:0/3062288791 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bb8018070 con 0x7f9bbc0f7980 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9baeffd700 1 -- 172.21.15.33:0/3062288791 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9bb8007d70 con 0x7f9bbc0f7980 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc1086d0 con 0x7f9bbc0f7980 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9baeffd700 1 -- 172.21.15.33:0/3062288791 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bb801c620 con 0x7f9bbc0f7980 2024-02-15T18:34:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.466+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc108bb0 con 0x7f9bbc0f7980 2024-02-15T18:34:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.467+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc0f5ad0 con 0x7f9bbc0f7980 2024-02-15T18:34:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.468+0000 7f9baeffd700 1 -- 172.21.15.33:0/3062288791 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f9bb801c890 con 0x7f9bbc0f7980 2024-02-15T18:34:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.468+0000 7f9baeffd700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9ba8060f20 0x7f9ba80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.468+0000 7f9baeffd700 1 -- 172.21.15.33:0/3062288791 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9bb807df50 con 0x7f9bbc0f7980 2024-02-15T18:34:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.468+0000 7f9bc2184700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9ba8060f20 0x7f9ba80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.469+0000 7f9bc2184700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9ba8060f20 0x7f9ba80633e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9bbc0f77e0 tx=0x7f9bb0008040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.472+0000 7f9baeffd700 1 -- 172.21.15.33:0/3062288791 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9bb80acf60 con 0x7f9bbc0f7980 2024-02-15T18:34:54.689 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.496384+0000 mgr.smithi033.apxevf (mgr.14626) 174 : cluster [DBG] pgmap v123: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:54.690 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.563128+0000 mon.smithi033 (mon.0) 296 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:34:54.690 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:53.570319+0000 mon.smithi033 (mon.0) 297 : cluster [DBG] osdmap e65: 6 total, 5 up, 6 in 2024-02-15T18:34:54.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.740+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9bbc0ff050 con 0x7f9bbc0f7980 2024-02-15T18:34:54.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.740+0000 7f9baeffd700 1 -- 172.21.15.33:0/3062288791 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f9bb8051c50 con 0x7f9bbc0f7980 2024-02-15T18:34:54.732 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:34:54.732 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:34:54.732 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:34:54.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:34:54.732 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:34:54.732 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 3, 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 7, 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:34:54.733 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:34:54.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9ba8060f20 msgr2=0x7f9ba80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9ba8060f20 0x7f9ba80633e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9bbc0f77e0 tx=0x7f9bb0008040).stop 2024-02-15T18:34:54.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 msgr2=0x7f9bbc107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 0x7f9bbc107560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9bb8009f50 tx=0x7f9bb8009b30).stop 2024-02-15T18:34:54.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 shutdown_connections 2024-02-15T18:34:54.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9ba8060f20 0x7f9ba80633e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bbc0f66e0 0x7f9bbc107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 --2- 172.21.15.33:0/3062288791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc0f7980 0x7f9bbc107560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 >> 172.21.15.33:0/3062288791 conn(0x7f9bbc0f1e40 msgr2=0x7f9bbc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:54.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 shutdown_connections 2024-02-15T18:34:54.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.742+0000 7f9bc43e8700 1 -- 172.21.15.33:0/3062288791 wait complete. 2024-02-15T18:34:54.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.843+0000 7f609ab5a700 1 -- 172.21.15.33:0/3334952274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f55c0 msgr2=0x7f60940f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.843+0000 7f609ab5a700 1 --2- 172.21.15.33:0/3334952274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f55c0 0x7f60940f59e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f6088004660 tx=0x7f6088009b30).stop 2024-02-15T18:34:54.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.843+0000 7f609ab5a700 1 -- 172.21.15.33:0/3334952274 shutdown_connections 2024-02-15T18:34:54.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.843+0000 7f609ab5a700 1 --2- 172.21.15.33:0/3334952274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60940f6860 0x7f60940f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.843+0000 7f609ab5a700 1 --2- 172.21.15.33:0/3334952274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f55c0 0x7f60940f59e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.843+0000 7f609ab5a700 1 -- 172.21.15.33:0/3334952274 >> 172.21.15.33:0/3334952274 conn(0x7f60940f0d40 msgr2=0x7f60940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:54.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.843+0000 7f609ab5a700 1 -- 172.21.15.33:0/3334952274 shutdown_connections 2024-02-15T18:34:54.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.843+0000 7f609ab5a700 1 -- 172.21.15.33:0/3334952274 wait complete. 2024-02-15T18:34:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.843+0000 7f609ab5a700 1 Processor -- start 2024-02-15T18:34:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f609ab5a700 1 -- start start 2024-02-15T18:34:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f609ab5a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60940f55c0 0x7f60940f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f609ab5a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f6860 0x7f60940f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f609ab5a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60940f8100 con 0x7f60940f6860 2024-02-15T18:34:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f609ab5a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60940f8240 con 0x7f60940f55c0 2024-02-15T18:34:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f6093fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f6860 0x7f60940f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f6093fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f6860 0x7f60940f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39674/0 (socket says 172.21.15.33:39674) 2024-02-15T18:34:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f6093fff700 1 -- 172.21.15.33:0/128788903 learned_addr learned my addr 172.21.15.33:0/128788903 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f60988f6700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60940f55c0 0x7f60940f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f6093fff700 1 -- 172.21.15.33:0/128788903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60940f55c0 msgr2=0x7f60940f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f6093fff700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60940f55c0 0x7f60940f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f6093fff700 1 -- 172.21.15.33:0/128788903 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6088005040 con 0x7f60940f6860 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.844+0000 7f6093fff700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f6860 0x7f60940f7ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f608000c790 tx=0x7f6080007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.845+0000 7f60917fa700 1 -- 172.21.15.33:0/128788903 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608000e680 con 0x7f60940f6860 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.845+0000 7f60917fa700 1 -- 172.21.15.33:0/128788903 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f608000ecd0 con 0x7f60940f6860 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.845+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60940f8520 con 0x7f60940f6860 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.845+0000 7f60917fa700 1 -- 172.21.15.33:0/128788903 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6080013ea0 con 0x7f60940f6860 2024-02-15T18:34:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.845+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609410f020 con 0x7f60940f6860 2024-02-15T18:34:54.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.846+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6094045ad0 con 0x7f60940f6860 2024-02-15T18:34:54.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.846+0000 7f60917fa700 1 -- 172.21.15.33:0/128788903 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f608001a060 con 0x7f60940f6860 2024-02-15T18:34:54.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.847+0000 7f60917fa700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6084060f20 0x7f60840633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:54.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.847+0000 7f60917fa700 1 -- 172.21.15.33:0/128788903 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f608007c400 con 0x7f60940f6860 2024-02-15T18:34:54.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.847+0000 7f60988f6700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6084060f20 0x7f60840633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:54.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.847+0000 7f60988f6700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6084060f20 0x7f60840633e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f60940f94b0 tx=0x7f6088009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:54.850+0000 7f60917fa700 1 -- 172.21.15.33:0/128788903 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f608004c900 con 0x7f60940f6860 2024-02-15T18:34:55.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.496384+0000 mgr.smithi033.apxevf (mgr.14626) 174 : cluster [DBG] pgmap v123: 65 pgs: 65 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:34:55.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.563128+0000 mon.smithi033 (mon.0) 296 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:34:55.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:53.570319+0000 mon.smithi033 (mon.0) 297 : cluster [DBG] osdmap e65: 6 total, 5 up, 6 in 2024-02-15T18:34:55.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.067+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f609410f5d0 con 0x7f60940f6860 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.068+0000 7f60917fa700 1 -- 172.21.15.33:0/128788903 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1831 (secure 0 0 0) 0x7f608004ff20 con 0x7f60940f6860 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:e19 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 19 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:34:55.060 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:31:16.192509+0000 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:34:55.061 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:55.062 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:34:55.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.069+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6084060f20 msgr2=0x7f60840633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:55.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.069+0000 7f609ab5a700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6084060f20 0x7f60840633e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f60940f94b0 tx=0x7f6088009b30).stop 2024-02-15T18:34:55.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.070+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f6860 msgr2=0x7f60940f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:55.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.070+0000 7f609ab5a700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f6860 0x7f60940f7ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f608000c790 tx=0x7f6080007d70).stop 2024-02-15T18:34:55.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.070+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 shutdown_connections 2024-02-15T18:34:55.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.070+0000 7f609ab5a700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6084060f20 0x7f60840633e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:55.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.070+0000 7f609ab5a700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60940f55c0 0x7f60940f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:55.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.070+0000 7f609ab5a700 1 --2- 172.21.15.33:0/128788903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60940f6860 0x7f60940f7ba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:55.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.070+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 >> 172.21.15.33:0/128788903 conn(0x7f60940f0d40 msgr2=0x7f609405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:55.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.070+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 shutdown_connections 2024-02-15T18:34:55.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.070+0000 7f609ab5a700 1 -- 172.21.15.33:0/128788903 wait complete. 2024-02-15T18:34:55.064 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-02-15T18:34:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.172+0000 7f194df78700 1 -- 172.21.15.33:0/2754171004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f7980 msgr2=0x7f19480f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.172+0000 7f194df78700 1 --2- 172.21.15.33:0/2754171004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f7980 0x7f19480f7de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1938004660 tx=0x7f1938009b30).stop 2024-02-15T18:34:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.172+0000 7f194df78700 1 -- 172.21.15.33:0/2754171004 shutdown_connections 2024-02-15T18:34:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.172+0000 7f194df78700 1 --2- 172.21.15.33:0/2754171004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f7980 0x7f19480f7de0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.172+0000 7f194df78700 1 --2- 172.21.15.33:0/2754171004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19480f66e0 0x7f19480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.172+0000 7f194df78700 1 -- 172.21.15.33:0/2754171004 >> 172.21.15.33:0/2754171004 conn(0x7f19480f1e40 msgr2=0x7f19480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.173+0000 7f194df78700 1 -- 172.21.15.33:0/2754171004 shutdown_connections 2024-02-15T18:34:55.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.173+0000 7f194df78700 1 -- 172.21.15.33:0/2754171004 wait complete. 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.173+0000 7f194df78700 1 Processor -- start 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.173+0000 7f194df78700 1 -- start start 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f194df78700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f66e0 0x7f1948107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f194df78700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19480f7980 0x7f19481074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f194df78700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948107aa0 con 0x7f19480f66e0 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f194df78700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948107be0 con 0x7f19480f7980 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f19477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f66e0 0x7f1948107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f19477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f66e0 0x7f1948107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39702/0 (socket says 172.21.15.33:39702) 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f19477fe700 1 -- 172.21.15.33:0/2795132353 learned_addr learned my addr 172.21.15.33:0/2795132353 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:34:55.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f1946ffd700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19480f7980 0x7f19481074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f19477fe700 1 -- 172.21.15.33:0/2795132353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19480f7980 msgr2=0x7f19481074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f19477fe700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19480f7980 0x7f19481074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f19477fe700 1 -- 172.21.15.33:0/2795132353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1938005040 con 0x7f19480f66e0 2024-02-15T18:34:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f19477fe700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f66e0 0x7f1948107000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1930002700 tx=0x7f1930009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f193ffff700 1 -- 172.21.15.33:0/2795132353 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19300079c0 con 0x7f19480f66e0 2024-02-15T18:34:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f193ffff700 1 -- 172.21.15.33:0/2795132353 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f193000f040 con 0x7f19480f66e0 2024-02-15T18:34:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1948108580 con 0x7f19480f66e0 2024-02-15T18:34:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.174+0000 7f193ffff700 1 -- 172.21.15.33:0/2795132353 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1930014940 con 0x7f19480f66e0 2024-02-15T18:34:55.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.175+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1948108b40 con 0x7f19480f66e0 2024-02-15T18:34:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.176+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1948045ad0 con 0x7f19480f66e0 2024-02-15T18:34:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.176+0000 7f193ffff700 1 -- 172.21.15.33:0/2795132353 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f193001b060 con 0x7f19480f66e0 2024-02-15T18:34:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.176+0000 7f193ffff700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1934060f20 0x7f19340633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:34:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.176+0000 7f193ffff700 1 -- 172.21.15.33:0/2795132353 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f193007bea0 con 0x7f19480f66e0 2024-02-15T18:34:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.177+0000 7f1946ffd700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1934060f20 0x7f19340633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:34:55.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.177+0000 7f1946ffd700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1934060f20 0x7f19340633e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1938004630 tx=0x7f1938009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:34:55.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.180+0000 7f193ffff700 1 -- 172.21.15.33:0/2795132353 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f193004fdd0 con 0x7f19480f66e0 2024-02-15T18:34:55.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.3.service: Succeeded. 2024-02-15T18:34:55.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 systemd[1]: Stopped Ceph osd.3 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:34:55.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 systemd[1]: Starting Ceph osd.3 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:34:55.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.371+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1948108e10 con 0x7f1934060f20 2024-02-15T18:34:55.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.372+0000 7f193ffff700 1 -- 172.21.15.33:0/2795132353 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1948108e10 con 0x7f1934060f20 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "9/21 daemons upgraded", 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:34:55.365 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.374+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1934060f20 msgr2=0x7f19340633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.374+0000 7f194df78700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1934060f20 0x7f19340633e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1938004630 tx=0x7f1938009b30).stop 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.374+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f66e0 msgr2=0x7f1948107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.374+0000 7f194df78700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f66e0 0x7f1948107000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f1930002700 tx=0x7f1930009d80).stop 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.374+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 shutdown_connections 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.374+0000 7f194df78700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1934060f20 0x7f19340633e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.374+0000 7f194df78700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19480f66e0 0x7f1948107000 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.374+0000 7f194df78700 1 --2- 172.21.15.33:0/2795132353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19480f7980 0x7f19481074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.374+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 >> 172.21.15.33:0/2795132353 conn(0x7f19480f1e40 msgr2=0x7f19480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.375+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 shutdown_connections 2024-02-15T18:34:55.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:34:55.375+0000 7f194df78700 1 -- 172.21.15.33:0/2795132353 wait complete. 2024-02-15T18:34:55.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:53.754951+0000 mgr.smithi033.apxevf (mgr.14626) 175 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:55.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:54.061931+0000 mgr.smithi033.apxevf (mgr.14626) 176 : audit [DBG] from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:55.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:54.356049+0000 mgr.smithi033.apxevf (mgr.14626) 177 : audit [DBG] from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:55.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:54.572511+0000 mon.smithi033 (mon.0) 298 : cluster [DBG] osdmap e66: 6 total, 5 up, 6 in 2024-02-15T18:34:55.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:54.741908+0000 mon.smithi033 (mon.0) 299 : audit [DBG] from='client.? 172.21.15.33:0/3062288791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:55.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:55.069573+0000 mon.smithi033 (mon.0) 300 : audit [DBG] from='client.? 172.21.15.33:0/128788903' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:34:55.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:53.754951+0000 mgr.smithi033.apxevf (mgr.14626) 175 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:55.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:54.061931+0000 mgr.smithi033.apxevf (mgr.14626) 176 : audit [DBG] from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:55.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:54.356049+0000 mgr.smithi033.apxevf (mgr.14626) 177 : audit [DBG] from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:55.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:54.572511+0000 mon.smithi033 (mon.0) 298 : cluster [DBG] osdmap e66: 6 total, 5 up, 6 in 2024-02-15T18:34:55.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:54.741908+0000 mon.smithi033 (mon.0) 299 : audit [DBG] from='client.? 172.21.15.33:0/3062288791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:34:55.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:55.069573+0000 mon.smithi033 (mon.0) 300 : audit [DBG] from='client.? 172.21.15.33:0/128788903' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:34:56.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 bash[61511]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:34:56.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 bash[61511]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T18:34:56.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 bash[61511]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-02-15T18:34:56.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 bash[61511]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-15T18:34:56.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 bash[61511]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-02-15T18:34:56.247 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 bash[61511]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-15T18:34:56.248 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 bash[61511]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-15T18:34:56.248 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:55 smithi131 bash[61511]: --> ceph-volume lvm activate successful for osd ID: 3 2024-02-15T18:34:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:55.373933+0000 mgr.smithi033.apxevf (mgr.14626) 178 : audit [DBG] from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:55.496841+0000 mgr.smithi033.apxevf (mgr.14626) 179 : cluster [DBG] pgmap v126: 65 pgs: 3 active+undersized+degraded, 12 stale+active+clean, 8 active+undersized, 42 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 9/357 objects degraded (2.521%) 2024-02-15T18:34:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:55.570712+0000 mon.smithi033 (mon.0) 301 : cluster [WRN] Health check failed: Degraded data redundancy: 9/357 objects degraded (2.521%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T18:34:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:55.373933+0000 mgr.smithi033.apxevf (mgr.14626) 178 : audit [DBG] from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:34:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:55.496841+0000 mgr.smithi033.apxevf (mgr.14626) 179 : cluster [DBG] pgmap v126: 65 pgs: 3 active+undersized+degraded, 12 stale+active+clean, 8 active+undersized, 42 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 9/357 objects degraded (2.521%) 2024-02-15T18:34:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:55.570712+0000 mon.smithi033 (mon.0) 301 : cluster [WRN] Health check failed: Degraded data redundancy: 9/357 objects degraded (2.521%), 3 pgs degraded (PG_DEGRADED) 2024-02-15T18:34:57.497 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-3[61792]: debug 2024-02-15T18:34:57.149+0000 7fc2206ec700 1 -- 172.21.15.131:0/3473415348 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c954bd2680 con 0x55c954b99000 2024-02-15T18:34:57.497 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:57 smithi131 bash[61778]: 4030e9f6d6c2aa0470bb18508332388e47efec247217b8cdb85acf7068e68ded 2024-02-15T18:34:57.497 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:57 smithi131 systemd[1]: Started Ceph osd.3 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:34:57.981 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:34:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-3[61792]: debug 2024-02-15T18:34:57.665+0000 7fc22817a380 -1 Falling back to public interface 2024-02-15T18:34:58.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:57.282187+0000 mon.smithi033 (mon.0) 302 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:58.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:57.283113+0000 mon.smithi033 (mon.0) 303 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:58.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:57.497256+0000 mgr.smithi033.apxevf (mgr.14626) 180 : cluster [DBG] pgmap v127: 65 pgs: 3 active+undersized+degraded, 12 stale+active+clean, 8 active+undersized, 42 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 9/357 objects degraded (2.521%) 2024-02-15T18:34:58.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:34:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:34:57.656447+0000 mon.smithi033 (mon.0) 304 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:58.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:57.282187+0000 mon.smithi033 (mon.0) 302 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:34:58.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:57.283113+0000 mon.smithi033 (mon.0) 303 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:34:58.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:57.497256+0000 mgr.smithi033.apxevf (mgr.14626) 180 : cluster [DBG] pgmap v127: 65 pgs: 3 active+undersized+degraded, 12 stale+active+clean, 8 active+undersized, 42 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 9/357 objects degraded (2.521%) 2024-02-15T18:34:58.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:34:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:34:57.656447+0000 mon.smithi033 (mon.0) 304 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:00.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:34:59.498020+0000 mgr.smithi033.apxevf (mgr.14626) 181 : cluster [DBG] pgmap v128: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:00.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:34:59.498020+0000 mgr.smithi033.apxevf (mgr.14626) 181 : cluster [DBG] pgmap v128: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:01.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.643849+0000 mon.smithi033 (mon.0) 305 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:01.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.948709+0000 mon.smithi033 (mon.0) 306 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:01.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.949718+0000 mon.smithi033 (mon.0) 307 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:00.950486+0000 mgr.smithi033.apxevf (mgr.14626) 182 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.954760+0000 mon.smithi033 (mon.0) 308 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.960979+0000 mon.smithi033 (mon.0) 309 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.963695+0000 mon.smithi033 (mon.0) 310 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.965153+0000 mon.smithi033 (mon.0) 311 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.966544+0000 mon.smithi033 (mon.0) 312 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.967996+0000 mon.smithi033 (mon.0) 313 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:00.968156+0000 mgr.smithi033.apxevf (mgr.14626) 183 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:00.969064+0000 mgr.smithi033.apxevf (mgr.14626) 184 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-15T18:35:01.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:01.498799+0000 mgr.smithi033.apxevf (mgr.14626) 185 : cluster [DBG] pgmap v129: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:02.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.643849+0000 mon.smithi033 (mon.0) 305 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:02.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.948709+0000 mon.smithi033 (mon.0) 306 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:02.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.949718+0000 mon.smithi033 (mon.0) 307 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:02.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:00.950486+0000 mgr.smithi033.apxevf (mgr.14626) 182 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:02.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.954760+0000 mon.smithi033 (mon.0) 308 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:02.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.960979+0000 mon.smithi033 (mon.0) 309 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:02.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.963695+0000 mon.smithi033 (mon.0) 310 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:02.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.965153+0000 mon.smithi033 (mon.0) 311 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:02.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.966544+0000 mon.smithi033 (mon.0) 312 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:02.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.967996+0000 mon.smithi033 (mon.0) 313 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:35:02.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:00.968156+0000 mgr.smithi033.apxevf (mgr.14626) 183 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:35:02.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:00.969064+0000 mgr.smithi033.apxevf (mgr.14626) 184 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-15T18:35:02.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:01.498799+0000 mgr.smithi033.apxevf (mgr.14626) 185 : cluster [DBG] pgmap v129: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:04.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:03.499320+0000 mgr.smithi033.apxevf (mgr.14626) 186 : cluster [DBG] pgmap v130: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:04.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:04.137218+0000 mon.smithi033 (mon.0) 314 : cluster [WRN] Health check update: Degraded data redundancy: 71/357 objects degraded (19.888%), 18 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:04.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:03.499320+0000 mgr.smithi033.apxevf (mgr.14626) 186 : cluster [DBG] pgmap v130: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:04.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:04.137218+0000 mon.smithi033 (mon.0) 314 : cluster [WRN] Health check update: Degraded data redundancy: 71/357 objects degraded (19.888%), 18 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:05.497 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:35:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-3[61792]: debug 2024-02-15T18:35:05.248+0000 7fc22817a380 -1 osd.3 64 log_to_monitors {default=true} 2024-02-15T18:35:05.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:05.251249+0000 mon.smithi131 (mon.1) 2 : audit [INF] from='osd.3 [v2:172.21.15.131:6800/4028459199,v1:172.21.15.131:6801/4028459199]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:35:05.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:05.251812+0000 mon.smithi033 (mon.0) 315 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:35:05.997 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:35:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-3[61792]: debug 2024-02-15T18:35:05.568+0000 7fc216e5c700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:35:05.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:05.251249+0000 mon.smithi131 (mon.1) 2 : audit [INF] from='osd.3 [v2:172.21.15.131:6800/4028459199,v1:172.21.15.131:6801/4028459199]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:35:05.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:05.251812+0000 mon.smithi033 (mon.0) 315 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-15T18:35:06.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:05.499912+0000 mgr.smithi033.apxevf (mgr.14626) 187 : cluster [DBG] pgmap v131: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:06.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:05.560319+0000 mon.smithi033 (mon.0) 316 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T18:35:06.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:05.560418+0000 mon.smithi033 (mon.0) 317 : cluster [DBG] osdmap e67: 6 total, 5 up, 6 in 2024-02-15T18:35:06.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:05.560917+0000 mon.smithi131 (mon.1) 3 : audit [INF] from='osd.3 [v2:172.21.15.131:6800/4028459199,v1:172.21.15.131:6801/4028459199]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:35:06.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:05.561398+0000 mon.smithi033 (mon.0) 318 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:35:07.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:05.499912+0000 mgr.smithi033.apxevf (mgr.14626) 187 : cluster [DBG] pgmap v131: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:07.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:05.560319+0000 mon.smithi033 (mon.0) 316 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-15T18:35:07.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:05.560418+0000 mon.smithi033 (mon.0) 317 : cluster [DBG] osdmap e67: 6 total, 5 up, 6 in 2024-02-15T18:35:07.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:05.560917+0000 mon.smithi131 (mon.1) 3 : audit [INF] from='osd.3 [v2:172.21.15.131:6800/4028459199,v1:172.21.15.131:6801/4028459199]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:35:07.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:05.561398+0000 mon.smithi033 (mon.0) 318 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:35:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:06.557577+0000 mon.smithi033 (mon.0) 319 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:35:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:06.561804+0000 mon.smithi033 (mon.0) 320 : cluster [INF] osd.3 [v2:172.21.15.131:6800/4028459199,v1:172.21.15.131:6801/4028459199] boot 2024-02-15T18:35:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:06.561847+0000 mon.smithi033 (mon.0) 321 : cluster [DBG] osdmap e68: 6 total, 6 up, 6 in 2024-02-15T18:35:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:06.562288+0000 mon.smithi033 (mon.0) 322 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:35:08.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:06.557577+0000 mon.smithi033 (mon.0) 319 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:35:08.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:06.561804+0000 mon.smithi033 (mon.0) 320 : cluster [INF] osd.3 [v2:172.21.15.131:6800/4028459199,v1:172.21.15.131:6801/4028459199] boot 2024-02-15T18:35:08.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:06.561847+0000 mon.smithi033 (mon.0) 321 : cluster [DBG] osdmap e68: 6 total, 6 up, 6 in 2024-02-15T18:35:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:06.562288+0000 mon.smithi033 (mon.0) 322 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-15T18:35:08.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:07.500549+0000 mgr.smithi033.apxevf (mgr.14626) 188 : cluster [DBG] pgmap v134: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:08.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:07.572856+0000 mon.smithi033 (mon.0) 323 : cluster [DBG] osdmap e69: 6 total, 6 up, 6 in 2024-02-15T18:35:09.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:07.500549+0000 mgr.smithi033.apxevf (mgr.14626) 188 : cluster [DBG] pgmap v134: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 71/357 objects degraded (19.888%) 2024-02-15T18:35:09.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:07.572856+0000 mon.smithi033 (mon.0) 323 : cluster [DBG] osdmap e69: 6 total, 6 up, 6 in 2024-02-15T18:35:10.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:09.501225+0000 mgr.smithi033.apxevf (mgr.14626) 189 : cluster [DBG] pgmap v136: 65 pgs: 11 active+undersized+degraded, 12 active+undersized, 42 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 49/357 objects degraded (13.725%) 2024-02-15T18:35:10.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:09.501225+0000 mgr.smithi033.apxevf (mgr.14626) 189 : cluster [DBG] pgmap v136: 65 pgs: 11 active+undersized+degraded, 12 active+undersized, 42 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 49/357 objects degraded (13.725%) 2024-02-15T18:35:11.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:11 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:10.140130+0000 mon.smithi033 (mon.0) 324 : cluster [WRN] Health check update: Degraded data redundancy: 49/357 objects degraded (13.725%), 11 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:11.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:11 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:10.140130+0000 mon.smithi033 (mon.0) 324 : cluster [WRN] Health check update: Degraded data redundancy: 49/357 objects degraded (13.725%), 11 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:12.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:11.501836+0000 mgr.smithi033.apxevf (mgr.14626) 190 : cluster [DBG] pgmap v137: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:12.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:11.501836+0000 mgr.smithi033.apxevf (mgr.14626) 190 : cluster [DBG] pgmap v137: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:13.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:12.147266+0000 mon.smithi033 (mon.0) 325 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 49/357 objects degraded (13.725%), 11 pgs degraded) 2024-02-15T18:35:13.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:12.654858+0000 mon.smithi033 (mon.0) 326 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:13.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:12.147266+0000 mon.smithi033 (mon.0) 325 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 49/357 objects degraded (13.725%), 11 pgs degraded) 2024-02-15T18:35:13.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:12.654858+0000 mon.smithi033 (mon.0) 326 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:14.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:13.502268+0000 mgr.smithi033.apxevf (mgr.14626) 191 : cluster [DBG] pgmap v138: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:14.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:13.502268+0000 mgr.smithi033.apxevf (mgr.14626) 191 : cluster [DBG] pgmap v138: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:16.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:15.502805+0000 mgr.smithi033.apxevf (mgr.14626) 192 : cluster [DBG] pgmap v139: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:16.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:15.976698+0000 mon.smithi033 (mon.0) 327 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:35:17.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:15.502805+0000 mgr.smithi033.apxevf (mgr.14626) 192 : cluster [DBG] pgmap v139: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:17.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:15.976698+0000 mon.smithi033 (mon.0) 327 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:35:17.690 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:15.976890+0000 mgr.smithi033.apxevf (mgr.14626) 193 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:35:17.690 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:15.977881+0000 mgr.smithi033.apxevf (mgr.14626) 194 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-15T18:35:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:15.976890+0000 mgr.smithi033.apxevf (mgr.14626) 193 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-15T18:35:18.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:15.977881+0000 mgr.smithi033.apxevf (mgr.14626) 194 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-15T18:35:18.979 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:17.503339+0000 mgr.smithi033.apxevf (mgr.14626) 195 : cluster [DBG] pgmap v140: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:18.994 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:17.723493+0000 mon.smithi033 (mon.0) 328 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:18.994 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:17.724551+0000 mon.smithi033 (mon.0) 329 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T18:35:18.994 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:17.725432+0000 mon.smithi033 (mon.0) 330 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:18.994 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:17.740151+0000 mon.smithi033 (mon.0) 331 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:19.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:17.503339+0000 mgr.smithi033.apxevf (mgr.14626) 195 : cluster [DBG] pgmap v140: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:19.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:17.723493+0000 mon.smithi033 (mon.0) 328 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:19.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:17.724551+0000 mon.smithi033 (mon.0) 329 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-15T18:35:19.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:17.725432+0000 mon.smithi033 (mon.0) 330 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:19.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:17.740151+0000 mon.smithi033 (mon.0) 331 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:19.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:17.718981+0000 mgr.smithi033.apxevf (mgr.14626) 196 : cephadm [INF] Upgrade: Updating osd.4 2024-02-15T18:35:19.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:17.726714+0000 mgr.smithi033.apxevf (mgr.14626) 197 : cephadm [INF] Deploying daemon osd.4 on smithi131 2024-02-15T18:35:20.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:17.718981+0000 mgr.smithi033.apxevf (mgr.14626) 196 : cephadm [INF] Upgrade: Updating osd.4 2024-02-15T18:35:20.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:17.726714+0000 mgr.smithi033.apxevf (mgr.14626) 197 : cephadm [INF] Deploying daemon osd.4 on smithi131 2024-02-15T18:35:20.645 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:19.503817+0000 mgr.smithi033.apxevf (mgr.14626) 198 : cluster [DBG] pgmap v141: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:20.646 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:20 smithi131 systemd[1]: Stopping Ceph osd.4 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:35:20.646 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.4[48390]: debug 2024-02-15T18:35:20.653+0000 7f3e1a651700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:35:20.985 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.4[48390]: debug 2024-02-15T18:35:20.653+0000 7f3e1a651700 -1 osd.4 69 *** Got signal Terminated *** 2024-02-15T18:35:20.985 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.4[48390]: debug 2024-02-15T18:35:20.653+0000 7f3e1a651700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:35:21.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:19.503817+0000 mgr.smithi033.apxevf (mgr.14626) 198 : cluster [DBG] pgmap v141: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:21.247 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:21 smithi131 bash[63498]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.4 2024-02-15T18:35:21.570 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:21 smithi131 bash[63551]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.4 2024-02-15T18:35:21.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.912036+0000 mon.smithi033 (mon.0) 332 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:35:21.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.912073+0000 mon.smithi033 (mon.0) 333 : cluster [INF] osd.4 failed (root=default,host=smithi131) (connection refused reported by osd.2) 2024-02-15T18:35:21.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.912242+0000 mon.smithi033 (mon.0) 334 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:35:21.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.912296+0000 mon.smithi033 (mon.0) 335 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:35:21.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.912591+0000 mon.smithi033 (mon.0) 336 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.912654+0000 mon.smithi033 (mon.0) 337 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.912880+0000 mon.smithi033 (mon.0) 338 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.913032+0000 mon.smithi033 (mon.0) 339 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.913155+0000 mon.smithi033 (mon.0) 340 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.913263+0000 mon.smithi033 (mon.0) 341 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:20.913351+0000 mon.smithi033 (mon.0) 342 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.313124+0000 mon.smithi033 (mon.0) 343 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.313185+0000 mon.smithi033 (mon.0) 344 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.313306+0000 mon.smithi033 (mon.0) 345 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.313616+0000 mon.smithi033 (mon.0) 346 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.313691+0000 mon.smithi033 (mon.0) 347 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.313987+0000 mon.smithi033 (mon.0) 348 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.314149+0000 mon.smithi033 (mon.0) 349 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.314303+0000 mon.smithi033 (mon.0) 350 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:35:21.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.314434+0000 mon.smithi033 (mon.0) 351 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:35:21.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.314527+0000 mon.smithi033 (mon.0) 352 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.912036+0000 mon.smithi033 (mon.0) 332 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.912073+0000 mon.smithi033 (mon.0) 333 : cluster [INF] osd.4 failed (root=default,host=smithi131) (connection refused reported by osd.2) 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.912242+0000 mon.smithi033 (mon.0) 334 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.912296+0000 mon.smithi033 (mon.0) 335 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.912591+0000 mon.smithi033 (mon.0) 336 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.912654+0000 mon.smithi033 (mon.0) 337 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.912880+0000 mon.smithi033 (mon.0) 338 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.913032+0000 mon.smithi033 (mon.0) 339 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.913155+0000 mon.smithi033 (mon.0) 340 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.913263+0000 mon.smithi033 (mon.0) 341 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:20.913351+0000 mon.smithi033 (mon.0) 342 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:35:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.313124+0000 mon.smithi033 (mon.0) 343 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:35:22.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.313185+0000 mon.smithi033 (mon.0) 344 : cluster [DBG] osd.4 reported immediately failed by osd.1 2024-02-15T18:35:22.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.313306+0000 mon.smithi033 (mon.0) 345 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:35:22.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.313616+0000 mon.smithi033 (mon.0) 346 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:35:22.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.313691+0000 mon.smithi033 (mon.0) 347 : cluster [DBG] osd.4 reported immediately failed by osd.5 2024-02-15T18:35:22.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.313987+0000 mon.smithi033 (mon.0) 348 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:35:22.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.314149+0000 mon.smithi033 (mon.0) 349 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-15T18:35:22.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.314303+0000 mon.smithi033 (mon.0) 350 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:35:22.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.314434+0000 mon.smithi033 (mon.0) 351 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-15T18:35:22.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.314527+0000 mon.smithi033 (mon.0) 352 : cluster [DBG] osd.4 reported immediately failed by osd.0 2024-02-15T18:35:22.876 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.504392+0000 mgr.smithi033.apxevf (mgr.14626) 199 : cluster [DBG] pgmap v142: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:22.876 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.570296+0000 mon.smithi033 (mon.0) 353 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:35:22.876 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.580463+0000 mon.smithi033 (mon.0) 354 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:35:22.877 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:21.580510+0000 mon.smithi033 (mon.0) 355 : cluster [DBG] osdmap e70: 6 total, 5 up, 6 in 2024-02-15T18:35:23.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.504392+0000 mgr.smithi033.apxevf (mgr.14626) 199 : cluster [DBG] pgmap v142: 65 pgs: 65 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:23.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.570296+0000 mon.smithi033 (mon.0) 353 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:35:23.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.580463+0000 mon.smithi033 (mon.0) 354 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:35:23.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:21.580510+0000 mon.smithi033 (mon.0) 355 : cluster [DBG] osdmap e70: 6 total, 5 up, 6 in 2024-02-15T18:35:23.131 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:23 smithi131 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.4.service: Succeeded. 2024-02-15T18:35:23.132 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:23 smithi131 systemd[1]: Stopped Ceph osd.4 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:35:23.497 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:23 smithi131 systemd[1]: Starting Ceph osd.4 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:35:23.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:22.580477+0000 mon.smithi033 (mon.0) 356 : cluster [DBG] osdmap e71: 6 total, 5 up, 6 in 2024-02-15T18:35:23.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:22.580477+0000 mon.smithi033 (mon.0) 356 : cluster [DBG] osdmap e71: 6 total, 5 up, 6 in 2024-02-15T18:35:24.458 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:24 smithi131 bash[63812]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:35:24.459 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:24 smithi131 bash[63812]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T18:35:24.459 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:24 smithi131 bash[63812]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-02-15T18:35:24.459 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:24 smithi131 bash[63812]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-15T18:35:24.459 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:24 smithi131 bash[63812]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-02-15T18:35:24.459 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:24 smithi131 bash[63812]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-15T18:35:24.459 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:24 smithi131 bash[63812]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-15T18:35:24.459 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:24 smithi131 bash[63812]: --> ceph-volume lvm activate successful for osd ID: 4 2024-02-15T18:35:24.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:23.504932+0000 mgr.smithi033.apxevf (mgr.14626) 200 : cluster [DBG] pgmap v145: 65 pgs: 4 active+undersized+degraded, 5 stale+active+clean, 4 active+undersized, 52 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13/357 objects degraded (3.641%) 2024-02-15T18:35:24.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:23.584239+0000 mon.smithi033 (mon.0) 357 : cluster [WRN] Health check failed: Degraded data redundancy: 13/357 objects degraded (3.641%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:25.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:23.504932+0000 mgr.smithi033.apxevf (mgr.14626) 200 : cluster [DBG] pgmap v145: 65 pgs: 4 active+undersized+degraded, 5 stale+active+clean, 4 active+undersized, 52 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 13/357 objects degraded (3.641%) 2024-02-15T18:35:25.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:23.584239+0000 mon.smithi033 (mon.0) 357 : cluster [WRN] Health check failed: Degraded data redundancy: 13/357 objects degraded (3.641%), 4 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:25.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.492+0000 7fa7b31e5700 1 -- 172.21.15.33:0/3485227059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac0f9690 msgr2=0x7fa7ac0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.492+0000 7fa7b31e5700 1 --2- 172.21.15.33:0/3485227059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac0f9690 0x7fa7ac0fbae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa79c004660 tx=0x7fa79c009b30).stop 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.492+0000 7fa7b31e5700 1 -- 172.21.15.33:0/3485227059 shutdown_connections 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.492+0000 7fa7b31e5700 1 --2- 172.21.15.33:0/3485227059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac0f9690 0x7fa7ac0fbae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.492+0000 7fa7b31e5700 1 --2- 172.21.15.33:0/3485227059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7ac060310 0x7fa7ac0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.492+0000 7fa7b31e5700 1 -- 172.21.15.33:0/3485227059 >> 172.21.15.33:0/3485227059 conn(0x7fa7ac0f0b90 msgr2=0x7fa7ac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.492+0000 7fa7b31e5700 1 -- 172.21.15.33:0/3485227059 shutdown_connections 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.492+0000 7fa7b31e5700 1 -- 172.21.15.33:0/3485227059 wait complete. 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.492+0000 7fa7b31e5700 1 Processor -- start 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b31e5700 1 -- start start 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b31e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac060310 0x7fa7ac106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b31e5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7ac0f9690 0x7fa7ac107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b31e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac107900 con 0x7fa7ac060310 2024-02-15T18:35:25.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b31e5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac108110 con 0x7fa7ac0f9690 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b21e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac060310 0x7fa7ac106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b21e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac060310 0x7fa7ac106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45144/0 (socket says 172.21.15.33:45144) 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b21e3700 1 -- 172.21.15.33:0/1608160148 learned_addr learned my addr 172.21.15.33:0/1608160148 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b19e2700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7ac0f9690 0x7fa7ac107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b21e3700 1 -- 172.21.15.33:0/1608160148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7ac0f9690 msgr2=0x7fa7ac107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b21e3700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7ac0f9690 0x7fa7ac107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b21e3700 1 -- 172.21.15.33:0/1608160148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c005040 con 0x7fa7ac060310 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7b21e3700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac060310 0x7fa7ac106e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa7a80026d0 tx=0x7fa7a8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.493+0000 7fa7a2ffd700 1 -- 172.21.15.33:0/1608160148 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7a80079c0 con 0x7fa7ac060310 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.494+0000 7fa7a2ffd700 1 -- 172.21.15.33:0/1608160148 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa7a800f040 con 0x7fa7ac060310 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.494+0000 7fa7a2ffd700 1 -- 172.21.15.33:0/1608160148 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7a80149f0 con 0x7fa7ac060310 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.494+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac108390 con 0x7fa7ac060310 2024-02-15T18:35:25.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.494+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac108900 con 0x7fa7ac060310 2024-02-15T18:35:25.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.495+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac059100 con 0x7fa7ac060310 2024-02-15T18:35:25.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.495+0000 7fa7a2ffd700 1 -- 172.21.15.33:0/1608160148 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa7a8014b50 con 0x7fa7ac060310 2024-02-15T18:35:25.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.495+0000 7fa7a2ffd700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa798060f70 0x7fa798063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:25.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.495+0000 7fa7a2ffd700 1 -- 172.21.15.33:0/1608160148 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa7a807c0c0 con 0x7fa7ac060310 2024-02-15T18:35:25.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.496+0000 7fa7b19e2700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa798060f70 0x7fa798063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:25.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.496+0000 7fa7b19e2700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa798060f70 0x7fa798063430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa79c004630 tx=0x7fa79c009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:25.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.500+0000 7fa7a2ffd700 1 -- 172.21.15.33:0/1608160148 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa7a804c540 con 0x7fa7ac060310 2024-02-15T18:35:25.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.694+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7ac0008d0 con 0x7fa798060f70 2024-02-15T18:35:25.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.695+0000 7fa7a2ffd700 1 -- 172.21.15.33:0/1608160148 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa7ac0008d0 con 0x7fa798060f70 2024-02-15T18:35:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.697+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa798060f70 msgr2=0x7fa798063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.697+0000 7fa7b31e5700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa798060f70 0x7fa798063430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa79c004630 tx=0x7fa79c009b30).stop 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.697+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac060310 msgr2=0x7fa7ac106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.697+0000 7fa7b31e5700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac060310 0x7fa7ac106e10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa7a80026d0 tx=0x7fa7a8009de0).stop 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.698+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 shutdown_connections 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.698+0000 7fa7b31e5700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa798060f70 0x7fa798063430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.698+0000 7fa7b31e5700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7ac060310 0x7fa7ac106e10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.698+0000 7fa7b31e5700 1 --2- 172.21.15.33:0/1608160148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7ac0f9690 0x7fa7ac107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.698+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 >> 172.21.15.33:0/1608160148 conn(0x7fa7ac0f0b90 msgr2=0x7fa7ac0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.698+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 shutdown_connections 2024-02-15T18:35:25.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.698+0000 7fa7b31e5700 1 -- 172.21.15.33:0/1608160148 wait complete. 2024-02-15T18:35:25.700 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:35:25.747 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:35:25.285+0000 7f28a41e6700 1 -- 172.21.15.131:0/1047790702 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d18cf10680 con 0x55d18ced7400 2024-02-15T18:35:25.747 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:25 smithi131 bash[64079]: 902c89c867aa24d143846b1967a327463e80aa2f58d816a3edabe2f0544de636 2024-02-15T18:35:25.747 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:25 smithi131 systemd[1]: Started Ceph osd.4 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:35:25.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.802+0000 7f8201fa8700 1 -- 172.21.15.33:0/3327343334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0fbbf0 msgr2=0x7f81fc0fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:25.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.802+0000 7f8201fa8700 1 --2- 172.21.15.33:0/3327343334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0fbbf0 0x7f81fc0fdfe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f81ec004660 tx=0x7f81ec009b30).stop 2024-02-15T18:35:25.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.802+0000 7f8201fa8700 1 -- 172.21.15.33:0/3327343334 shutdown_connections 2024-02-15T18:35:25.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.802+0000 7f8201fa8700 1 --2- 172.21.15.33:0/3327343334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0fbbf0 0x7f81fc0fdfe0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.802+0000 7f8201fa8700 1 --2- 172.21.15.33:0/3327343334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81fc0602b0 0x7f81fc0fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.802+0000 7f8201fa8700 1 -- 172.21.15.33:0/3327343334 >> 172.21.15.33:0/3327343334 conn(0x7f81fc0f0d40 msgr2=0x7f81fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:25.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.802+0000 7f8201fa8700 1 -- 172.21.15.33:0/3327343334 shutdown_connections 2024-02-15T18:35:25.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.802+0000 7f8201fa8700 1 -- 172.21.15.33:0/3327343334 wait complete. 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.802+0000 7f8201fa8700 1 Processor -- start 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f8201fa8700 1 -- start start 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f8201fa8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0602b0 0x7f81fc1091c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f8201fa8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81fc0fbbf0 0x7f81fc1096b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f8201fa8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc109c60 con 0x7f81fc0602b0 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f8201fa8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc109da0 con 0x7f81fc0fbbf0 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f81fb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0602b0 0x7f81fc1091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f81fb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0602b0 0x7f81fc1091c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45158/0 (socket says 172.21.15.33:45158) 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f81fb7fe700 1 -- 172.21.15.33:0/3260385582 learned_addr learned my addr 172.21.15.33:0/3260385582 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f81faffd700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81fc0fbbf0 0x7f81fc1096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f81fb7fe700 1 -- 172.21.15.33:0/3260385582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81fc0fbbf0 msgr2=0x7f81fc1096b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f81fb7fe700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81fc0fbbf0 0x7f81fc1096b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f81fb7fe700 1 -- 172.21.15.33:0/3260385582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec005040 con 0x7f81fc0602b0 2024-02-15T18:35:25.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.803+0000 7f81fb7fe700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0602b0 0x7f81fc1091c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f81e400e7f0 tx=0x7f81e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:25.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.804+0000 7f81f3fff700 1 -- 172.21.15.33:0/3260385582 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81e40092e0 con 0x7f81fc0602b0 2024-02-15T18:35:25.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.804+0000 7f81f3fff700 1 -- 172.21.15.33:0/3260385582 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f81e400f040 con 0x7f81fc0602b0 2024-02-15T18:35:25.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.804+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc10a740 con 0x7f81fc0602b0 2024-02-15T18:35:25.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.804+0000 7f81f3fff700 1 -- 172.21.15.33:0/3260385582 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81e4014850 con 0x7f81fc0602b0 2024-02-15T18:35:25.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.804+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc10ad00 con 0x7f81fc0602b0 2024-02-15T18:35:25.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.805+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc045ad0 con 0x7f81fc0602b0 2024-02-15T18:35:25.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.805+0000 7f81f3fff700 1 -- 172.21.15.33:0/3260385582 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f81e401b030 con 0x7f81fc0602b0 2024-02-15T18:35:25.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.805+0000 7f81f3fff700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f81e8060f20 0x7f81e80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:25.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.805+0000 7f81f3fff700 1 -- 172.21.15.33:0/3260385582 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f81e407be30 con 0x7f81fc0602b0 2024-02-15T18:35:25.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.806+0000 7f81faffd700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f81e8060f20 0x7f81e80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:25.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.806+0000 7f81faffd700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f81e8060f20 0x7f81e80633e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f81ec009720 tx=0x7f81ec016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:25.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.810+0000 7f81f3fff700 1 -- 172.21.15.33:0/3260385582 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f81e404fd90 con 0x7f81fc0602b0 2024-02-15T18:35:25.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:25.999+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81fc101340 con 0x7f81e8060f20 2024-02-15T18:35:25.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.000+0000 7f81f3fff700 1 -- 172.21.15.33:0/3260385582 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f81ec00f070 con 0x7f81e8060f20 2024-02-15T18:35:25.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f81e8060f20 msgr2=0x7f81e80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:25.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f81e8060f20 0x7f81e80633e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f81ec009720 tx=0x7f81ec016040).stop 2024-02-15T18:35:25.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0602b0 msgr2=0x7f81fc1091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:25.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0602b0 0x7f81fc1091c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f81e400e7f0 tx=0x7f81e400b040).stop 2024-02-15T18:35:25.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 shutdown_connections 2024-02-15T18:35:25.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f81e8060f20 0x7f81e80633e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81fc0602b0 0x7f81fc1091c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 --2- 172.21.15.33:0/3260385582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81fc0fbbf0 0x7f81fc1096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:25.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 >> 172.21.15.33:0/3260385582 conn(0x7f81fc0f0d40 msgr2=0x7f81fc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:25.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 shutdown_connections 2024-02-15T18:35:25.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.002+0000 7f8201fa8700 1 -- 172.21.15.33:0/3260385582 wait complete. 2024-02-15T18:35:26.078 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:35:25.807+0000 7f28abc74380 -1 Falling back to public interface 2024-02-15T18:35:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.104+0000 7f283b392700 1 -- 172.21.15.33:0/427367512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 msgr2=0x7f283406a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.104+0000 7f283b392700 1 --2- 172.21.15.33:0/427367512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 0x7f283406a830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f2824004660 tx=0x7f2824009b30).stop 2024-02-15T18:35:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.104+0000 7f283b392700 1 -- 172.21.15.33:0/427367512 shutdown_connections 2024-02-15T18:35:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.104+0000 7f283b392700 1 --2- 172.21.15.33:0/427367512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 0x7f283406a830 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.104+0000 7f283b392700 1 --2- 172.21.15.33:0/427367512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f283406b9c0 0x7f2834069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.104+0000 7f283b392700 1 -- 172.21.15.33:0/427367512 >> 172.21.15.33:0/427367512 conn(0x7f28340f1e40 msgr2=0x7f28340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.104+0000 7f283b392700 1 -- 172.21.15.33:0/427367512 shutdown_connections 2024-02-15T18:35:26.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.104+0000 7f283b392700 1 -- 172.21.15.33:0/427367512 wait complete. 2024-02-15T18:35:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283b392700 1 Processor -- start 2024-02-15T18:35:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283b392700 1 -- start start 2024-02-15T18:35:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283b392700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 0x7f28341091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283b392700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f283406b9c0 0x7f28341096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283b392700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834109c70 con 0x7f283406a3b0 2024-02-15T18:35:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283b392700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834109db0 con 0x7f283406b9c0 2024-02-15T18:35:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283912e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 0x7f28341091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283912e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 0x7f28341091d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45172/0 (socket says 172.21.15.33:45172) 2024-02-15T18:35:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283912e700 1 -- 172.21.15.33:0/95340786 learned_addr learned my addr 172.21.15.33:0/95340786 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283892d700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f283406b9c0 0x7f28341096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283912e700 1 -- 172.21.15.33:0/95340786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f283406b9c0 msgr2=0x7f28341096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283912e700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f283406b9c0 0x7f28341096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283912e700 1 -- 172.21.15.33:0/95340786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2824005040 con 0x7f283406a3b0 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f283912e700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 0x7f28341091d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f283000e7f0 tx=0x7f283000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.105+0000 7f2829ffb700 1 -- 172.21.15.33:0/95340786 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28300092e0 con 0x7f283406a3b0 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.106+0000 7f2829ffb700 1 -- 172.21.15.33:0/95340786 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f283000f040 con 0x7f283406a3b0 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.106+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283410a750 con 0x7f283406a3b0 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.106+0000 7f2829ffb700 1 -- 172.21.15.33:0/95340786 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2830014850 con 0x7f283406a3b0 2024-02-15T18:35:26.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.106+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283410ad10 con 0x7f283406a3b0 2024-02-15T18:35:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.107+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2834045ad0 con 0x7f283406a3b0 2024-02-15T18:35:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.107+0000 7f2829ffb700 1 -- 172.21.15.33:0/95340786 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f283001b030 con 0x7f283406a3b0 2024-02-15T18:35:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.107+0000 7f2829ffb700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2820060f20 0x7f28200633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.107+0000 7f2829ffb700 1 -- 172.21.15.33:0/95340786 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f283007be50 con 0x7f283406a3b0 2024-02-15T18:35:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.107+0000 7f283892d700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2820060f20 0x7f28200633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:26.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.108+0000 7f283892d700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2820060f20 0x7f28200633e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2824009720 tx=0x7f2824016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:26.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.112+0000 7f2829ffb700 1 -- 172.21.15.33:0/95340786 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f283004fdb0 con 0x7f283406a3b0 2024-02-15T18:35:26.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.294+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2834101320 con 0x7f2820060f20 2024-02-15T18:35:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.303+0000 7f2829ffb700 1 -- 172.21.15.33:0/95340786 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f2834101320 con 0x7f2820060f20 2024-02-15T18:35:26.294 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:35:26.294 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (10m) 53s ago 12m 19.5M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:35:26.294 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (2m) 53s ago 12m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (2m) 25s ago 11m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (10m) 53s ago 11m 34.2M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (6m) 53s ago 6m 17.4M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (6m) 53s ago 6m 13.2M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (6m) 25s ago 6m 118M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (6m) 25s ago 6m 133M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (4m) 53s ago 13m 433M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (3m) 25s ago 11m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (3m) 53s ago 13m 42.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (2m) 25s ago 10m 35.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (11m) 53s ago 11m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (10m) 25s ago 10m 17.1M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (2m) 53s ago 10m 196M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (92s) 53s ago 9m 193M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (59s) 53s ago 9m 10.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:35:26.295 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (29s) 25s ago 9m 13.2M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4030e9f6d6c2 2024-02-15T18:35:26.296 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 starting - - - 4096M 2024-02-15T18:35:26.296 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (8m) 25s ago 8m 385M 4096M 16.2.4 8d91d370c2b8 94ff8c19b876 2024-02-15T18:35:26.296 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (4m) 53s ago 11m 65.6M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:35:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2820060f20 msgr2=0x7f28200633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2820060f20 0x7f28200633e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2824009720 tx=0x7f2824016040).stop 2024-02-15T18:35:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 msgr2=0x7f28341091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 0x7f28341091d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f283000e7f0 tx=0x7f283000b040).stop 2024-02-15T18:35:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 shutdown_connections 2024-02-15T18:35:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2820060f20 0x7f28200633e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f283406a3b0 0x7f28341091d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 --2- 172.21.15.33:0/95340786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f283406b9c0 0x7f28341096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 >> 172.21.15.33:0/95340786 conn(0x7f28340f1e40 msgr2=0x7f28340fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.305+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 shutdown_connections 2024-02-15T18:35:26.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.306+0000 7f283b392700 1 -- 172.21.15.33:0/95340786 wait complete. 2024-02-15T18:35:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.406+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3002566174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 msgr2=0x7f6ce40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.406+0000 7f6ceb32e700 1 --2- 172.21.15.33:0/3002566174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 0x7f6ce40f59e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6ce0004660 tx=0x7f6ce0009b30).stop 2024-02-15T18:35:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.406+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3002566174 shutdown_connections 2024-02-15T18:35:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.406+0000 7f6ceb32e700 1 --2- 172.21.15.33:0/3002566174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ce40f6860 0x7f6ce40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.406+0000 7f6ceb32e700 1 --2- 172.21.15.33:0/3002566174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 0x7f6ce40f59e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.406+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3002566174 >> 172.21.15.33:0/3002566174 conn(0x7f6ce40f0d40 msgr2=0x7f6ce40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.406+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3002566174 shutdown_connections 2024-02-15T18:35:26.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.406+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3002566174 wait complete. 2024-02-15T18:35:26.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ceb32e700 1 Processor -- start 2024-02-15T18:35:26.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ceb32e700 1 -- start start 2024-02-15T18:35:26.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ceb32e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 0x7f6ce40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:26.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ceb32e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ce40f6860 0x7f6ce40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:26.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ceb32e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40f8100 con 0x7f6ce40f55c0 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ceb32e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40f8240 con 0x7f6ce40f6860 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ce90ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 0x7f6ce40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ce90ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 0x7f6ce40f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45190/0 (socket says 172.21.15.33:45190) 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ce90ca700 1 -- 172.21.15.33:0/3830136443 learned_addr learned my addr 172.21.15.33:0/3830136443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ce88c9700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ce40f6860 0x7f6ce40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ce90ca700 1 -- 172.21.15.33:0/3830136443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ce40f6860 msgr2=0x7f6ce40f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ce90ca700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ce40f6860 0x7f6ce40f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ce90ca700 1 -- 172.21.15.33:0/3830136443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0005040 con 0x7f6ce40f55c0 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ce88c9700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ce40f6860 0x7f6ce40f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.407+0000 7f6ce90ca700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 0x7f6ce40f9720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f6ce0013fd0 tx=0x7f6ce0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.408+0000 7f6cd5ffb700 1 -- 172.21.15.33:0/3830136443 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce0018070 con 0x7f6ce40f55c0 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.408+0000 7f6cd5ffb700 1 -- 172.21.15.33:0/3830136443 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f6ce0007d70 con 0x7f6ce40f55c0 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.408+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce40f84c0 con 0x7f6ce40f55c0 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.408+0000 7f6cd5ffb700 1 -- 172.21.15.33:0/3830136443 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce001c620 con 0x7f6ce40f55c0 2024-02-15T18:35:26.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.408+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce40f8a20 con 0x7f6ce40f55c0 2024-02-15T18:35:26.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.409+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce4045ad0 con 0x7f6ce40f55c0 2024-02-15T18:35:26.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.409+0000 7f6cd5ffb700 1 -- 172.21.15.33:0/3830136443 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f6ce001c8e0 con 0x7f6ce40f55c0 2024-02-15T18:35:26.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.409+0000 7f6cd5ffb700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6cd0060f20 0x7f6cd00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:26.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.410+0000 7f6cd5ffb700 1 -- 172.21.15.33:0/3830136443 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6ce007df90 con 0x7f6ce40f55c0 2024-02-15T18:35:26.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.410+0000 7f6ce88c9700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6cd0060f20 0x7f6cd00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:26.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.410+0000 7f6ce88c9700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6cd0060f20 0x7f6cd00633e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f6cd8004ac0 tx=0x7f6cd8009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:26.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.414+0000 7f6cd5ffb700 1 -- 172.21.15.33:0/3830136443 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6ce004e410 con 0x7f6ce40f55c0 2024-02-15T18:35:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.657+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ce410f630 con 0x7f6ce40f55c0 2024-02-15T18:35:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.658+0000 7f6cd5ffb700 1 -- 172.21.15.33:0/3830136443 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+820 (secure 0 0 0) 0x7f6ce0051a30 con 0x7f6ce40f55c0 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4, 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:35:26.649 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:35:26.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:35:26.650 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:35:26.650 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 8, 2024-02-15T18:35:26.650 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2024-02-15T18:35:26.650 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:35:26.650 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:35:26.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.659+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6cd0060f20 msgr2=0x7f6cd00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.659+0000 7f6ceb32e700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6cd0060f20 0x7f6cd00633e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f6cd8004ac0 tx=0x7f6cd8009040).stop 2024-02-15T18:35:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.660+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 msgr2=0x7f6ce40f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.660+0000 7f6ceb32e700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 0x7f6ce40f9720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f6ce0013fd0 tx=0x7f6ce0009b30).stop 2024-02-15T18:35:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.660+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 shutdown_connections 2024-02-15T18:35:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.660+0000 7f6ceb32e700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f6cd0060f20 0x7f6cd00633e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.660+0000 7f6ceb32e700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ce40f55c0 0x7f6ce40f9720 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.660+0000 7f6ceb32e700 1 --2- 172.21.15.33:0/3830136443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ce40f6860 0x7f6ce40f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.660+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 >> 172.21.15.33:0/3830136443 conn(0x7f6ce40f0d40 msgr2=0x7f6ce405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.660+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 shutdown_connections 2024-02-15T18:35:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.660+0000 7f6ceb32e700 1 -- 172.21.15.33:0/3830136443 wait complete. 2024-02-15T18:35:26.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:25.392669+0000 mon.smithi033 (mon.0) 358 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:26.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:25.393659+0000 mon.smithi033 (mon.0) 359 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:26.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:25.505391+0000 mgr.smithi033.apxevf (mgr.14626) 201 : cluster [DBG] pgmap v146: 65 pgs: 10 active+undersized+degraded, 1 stale+active+clean, 13 active+undersized, 41 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 35/357 objects degraded (9.804%) 2024-02-15T18:35:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.761+0000 7f4128707700 1 -- 172.21.15.33:0/2058660794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 msgr2=0x7f41200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.761+0000 7f4128707700 1 --2- 172.21.15.33:0/2058660794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 0x7f41200f6cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4114004660 tx=0x7f4114009b30).stop 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.761+0000 7f4128707700 1 -- 172.21.15.33:0/2058660794 shutdown_connections 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.761+0000 7f4128707700 1 --2- 172.21.15.33:0/2058660794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 0x7f41200f6cc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.761+0000 7f4128707700 1 --2- 172.21.15.33:0/2058660794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41200f55c0 0x7f41200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.761+0000 7f4128707700 1 -- 172.21.15.33:0/2058660794 >> 172.21.15.33:0/2058660794 conn(0x7f41200f0d40 msgr2=0x7f41200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.761+0000 7f4128707700 1 -- 172.21.15.33:0/2058660794 shutdown_connections 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.761+0000 7f4128707700 1 -- 172.21.15.33:0/2058660794 wait complete. 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4128707700 1 Processor -- start 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4128707700 1 -- start start 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4128707700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41200f55c0 0x7f4120106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4128707700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 0x7f41201074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4128707700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4120107a70 con 0x7f41200f6860 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4128707700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4120107bb0 con 0x7f41200f55c0 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4125ca2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 0x7f41201074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4125ca2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 0x7f41201074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45198/0 (socket says 172.21.15.33:45198) 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4125ca2700 1 -- 172.21.15.33:0/63226820 learned_addr learned my addr 172.21.15.33:0/63226820 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f41264a3700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41200f55c0 0x7f4120106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4125ca2700 1 -- 172.21.15.33:0/63226820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41200f55c0 msgr2=0x7f4120106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4125ca2700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41200f55c0 0x7f4120106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4125ca2700 1 -- 172.21.15.33:0/63226820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114005040 con 0x7f41200f6860 2024-02-15T18:35:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.762+0000 7f4125ca2700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 0x7f41201074c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f4114009f50 tx=0x7f4114009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.763+0000 7f4112ffd700 1 -- 172.21.15.33:0/63226820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4114018070 con 0x7f41200f6860 2024-02-15T18:35:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.763+0000 7f4112ffd700 1 -- 172.21.15.33:0/63226820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f4114007c70 con 0x7f41200f6860 2024-02-15T18:35:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.763+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41201084f0 con 0x7f41200f6860 2024-02-15T18:35:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.763+0000 7f4112ffd700 1 -- 172.21.15.33:0/63226820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f411401c620 con 0x7f41200f6860 2024-02-15T18:35:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.763+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4120108a50 con 0x7f41200f6860 2024-02-15T18:35:26.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.764+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4120045ad0 con 0x7f41200f6860 2024-02-15T18:35:26.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.764+0000 7f4112ffd700 1 -- 172.21.15.33:0/63226820 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f411401da10 con 0x7f41200f6860 2024-02-15T18:35:26.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.764+0000 7f4112ffd700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f410c060f20 0x7f410c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:26.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.765+0000 7f4112ffd700 1 -- 172.21.15.33:0/63226820 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f411407e000 con 0x7f41200f6860 2024-02-15T18:35:26.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.765+0000 7f41264a3700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f410c060f20 0x7f410c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:26.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.765+0000 7f41264a3700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f410c060f20 0x7f410c0633e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f41200f66c0 tx=0x7f411c009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:26.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.769+0000 7f4112ffd700 1 -- 172.21.15.33:0/63226820 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4114051f30 con 0x7f41200f6860 2024-02-15T18:35:26.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:25.392669+0000 mon.smithi033 (mon.0) 358 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:26.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:25.393659+0000 mon.smithi033 (mon.0) 359 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:26.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:25.505391+0000 mgr.smithi033.apxevf (mgr.14626) 201 : cluster [DBG] pgmap v146: 65 pgs: 10 active+undersized+degraded, 1 stale+active+clean, 13 active+undersized, 41 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 35/357 objects degraded (9.804%) 2024-02-15T18:35:26.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.984+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f41200fde90 con 0x7f41200f6860 2024-02-15T18:35:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.985+0000 7f4112ffd700 1 -- 172.21.15.33:0/63226820 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f4114051b20 con 0x7f41200f6860 2024-02-15T18:35:26.976 INFO:teuthology.orchestra.run.smithi033.stdout:e20 2024-02-15T18:35:26.976 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:35:26.976 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:35:26.976 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:35:26.976 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:35:26.976 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:35:26.976 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:35:26.976 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 20 2024-02-15T18:35:26.977 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:35:26.977 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:35:26.977 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:35:21.569761+0000 2024-02-15T18:35:26.979 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:35:26.979 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:35:26.979 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:35:26.979 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:35:26.979 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:35:26.979 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:35:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:35:26.981 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:35:26.981 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:35:26.981 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:35:26.981 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:35:26.981 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:35:26.981 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:35:26.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.986+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f410c060f20 msgr2=0x7f410c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.986+0000 7f4128707700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f410c060f20 0x7f410c0633e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f41200f66c0 tx=0x7f411c009040).stop 2024-02-15T18:35:26.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.986+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 msgr2=0x7f41201074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:26.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.986+0000 7f4128707700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 0x7f41201074c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f4114009f50 tx=0x7f4114009b30).stop 2024-02-15T18:35:26.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.986+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 shutdown_connections 2024-02-15T18:35:26.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.987+0000 7f4128707700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f410c060f20 0x7f410c0633e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.987+0000 7f4128707700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41200f55c0 0x7f4120106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.987+0000 7f4128707700 1 --2- 172.21.15.33:0/63226820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41200f6860 0x7f41201074c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:26.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.987+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 >> 172.21.15.33:0/63226820 conn(0x7f41200f0d40 msgr2=0x7f412005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:26.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.987+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 shutdown_connections 2024-02-15T18:35:26.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:26.987+0000 7f4128707700 1 -- 172.21.15.33:0/63226820 wait complete. 2024-02-15T18:35:26.983 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 20 2024-02-15T18:35:27.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.089+0000 7f8548dbc700 1 -- 172.21.15.33:0/3224674955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f7980 msgr2=0x7f85440f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.089+0000 7f8548dbc700 1 --2- 172.21.15.33:0/3224674955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f7980 0x7f85440f7de0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f852c004660 tx=0x7f852c009b30).stop 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.089+0000 7f8548dbc700 1 -- 172.21.15.33:0/3224674955 shutdown_connections 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.089+0000 7f8548dbc700 1 --2- 172.21.15.33:0/3224674955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f7980 0x7f85440f7de0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.089+0000 7f8548dbc700 1 --2- 172.21.15.33:0/3224674955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85440f66e0 0x7f85440f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.089+0000 7f8548dbc700 1 -- 172.21.15.33:0/3224674955 >> 172.21.15.33:0/3224674955 conn(0x7f85440f1e40 msgr2=0x7f85440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.089+0000 7f8548dbc700 1 -- 172.21.15.33:0/3224674955 shutdown_connections 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.089+0000 7f8548dbc700 1 -- 172.21.15.33:0/3224674955 wait complete. 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.089+0000 7f8548dbc700 1 Processor -- start 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f8548dbc700 1 -- start start 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f8548dbc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f66e0 0x7f8544107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f8548dbc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85440f7980 0x7f85441074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f8548dbc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544107aa0 con 0x7f85440f66e0 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f8548dbc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8544107be0 con 0x7f85440f7980 2024-02-15T18:35:27.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f854259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f66e0 0x7f8544107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f854259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f66e0 0x7f8544107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45212/0 (socket says 172.21.15.33:45212) 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f854259c700 1 -- 172.21.15.33:0/1698608146 learned_addr learned my addr 172.21.15.33:0/1698608146 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f8541d9b700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85440f7980 0x7f85441074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f854259c700 1 -- 172.21.15.33:0/1698608146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85440f7980 msgr2=0x7f85441074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f854259c700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85440f7980 0x7f85441074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f854259c700 1 -- 172.21.15.33:0/1698608146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c005040 con 0x7f85440f66e0 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f854259c700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f66e0 0x7f8544107000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f853400c790 tx=0x7f8534007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.090+0000 7f853affd700 1 -- 172.21.15.33:0/1698608146 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8534013630 con 0x7f85440f66e0 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.091+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8544108580 con 0x7f85440f66e0 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.091+0000 7f853affd700 1 -- 172.21.15.33:0/1698608146 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f85340128a0 con 0x7f85440f66e0 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.091+0000 7f853affd700 1 -- 172.21.15.33:0/1698608146 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8534002960 con 0x7f85440f66e0 2024-02-15T18:35:27.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.091+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8544108b40 con 0x7f85440f66e0 2024-02-15T18:35:27.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.091+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8544045ad0 con 0x7f85440f66e0 2024-02-15T18:35:27.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.092+0000 7f853affd700 1 -- 172.21.15.33:0/1698608146 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f8534010070 con 0x7f85440f66e0 2024-02-15T18:35:27.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.092+0000 7f853affd700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8530060f20 0x7f85300633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:27.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.092+0000 7f853affd700 1 -- 172.21.15.33:0/1698608146 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f853407c1d0 con 0x7f85440f66e0 2024-02-15T18:35:27.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.093+0000 7f8541d9b700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8530060f20 0x7f85300633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:27.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.093+0000 7f8541d9b700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8530060f20 0x7f85300633e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f852c009f50 tx=0x7f852c009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:27.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.097+0000 7f853affd700 1 -- 172.21.15.33:0/1698608146 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8534050020 con 0x7f85440f66e0 2024-02-15T18:35:27.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.286+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85440ff130 con 0x7f8530060f20 2024-02-15T18:35:27.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.287+0000 7f853affd700 1 -- 172.21.15.33:0/1698608146 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f85440ff130 con 0x7f8530060f20 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "10/21 daemons upgraded", 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:35:27.278 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8530060f20 msgr2=0x7f85300633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8530060f20 0x7f85300633e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f852c009f50 tx=0x7f852c009b30).stop 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f66e0 msgr2=0x7f8544107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f66e0 0x7f8544107000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f853400c790 tx=0x7f8534007d90).stop 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 shutdown_connections 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8530060f20 0x7f85300633e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85440f66e0 0x7f8544107000 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 --2- 172.21.15.33:0/1698608146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85440f7980 0x7f85441074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 >> 172.21.15.33:0/1698608146 conn(0x7f85440f1e40 msgr2=0x7f85440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 shutdown_connections 2024-02-15T18:35:27.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:27.289+0000 7f8548dbc700 1 -- 172.21.15.33:0/1698608146 wait complete. 2024-02-15T18:35:27.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:25.696116+0000 mgr.smithi033.apxevf (mgr.14626) 202 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:27.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:26.000822+0000 mgr.smithi033.apxevf (mgr.14626) 203 : audit [DBG] from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:27.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:26.295961+0000 mgr.smithi033.apxevf (mgr.14626) 204 : audit [DBG] from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:27.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:26.658633+0000 mon.smithi033 (mon.0) 360 : audit [DBG] from='client.? 172.21.15.33:0/3830136443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:27.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:26.985630+0000 mon.smithi033 (mon.0) 361 : audit [DBG] from='client.? 172.21.15.33:0/63226820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:35:27.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:25.696116+0000 mgr.smithi033.apxevf (mgr.14626) 202 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:27.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:26.000822+0000 mgr.smithi033.apxevf (mgr.14626) 203 : audit [DBG] from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:27.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:26.295961+0000 mgr.smithi033.apxevf (mgr.14626) 204 : audit [DBG] from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:27.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:26.658633+0000 mon.smithi033 (mon.0) 360 : audit [DBG] from='client.? 172.21.15.33:0/3830136443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:27.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:26.985630+0000 mon.smithi033 (mon.0) 361 : audit [DBG] from='client.? 172.21.15.33:0/63226820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:35:28.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:27.287390+0000 mgr.smithi033.apxevf (mgr.14626) 205 : audit [DBG] from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:28.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:27.505789+0000 mgr.smithi033.apxevf (mgr.14626) 206 : cluster [DBG] pgmap v147: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/357 objects degraded (17.647%) 2024-02-15T18:35:28.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:27.654602+0000 mon.smithi033 (mon.0) 362 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:28.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:27.287390+0000 mgr.smithi033.apxevf (mgr.14626) 205 : audit [DBG] from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:28.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:27.505789+0000 mgr.smithi033.apxevf (mgr.14626) 206 : cluster [DBG] pgmap v147: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/357 objects degraded (17.647%) 2024-02-15T18:35:28.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:27.654602+0000 mon.smithi033 (mon.0) 362 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:29.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.555043+0000 mon.smithi033 (mon.0) 363 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.555997+0000 mon.smithi033 (mon.0) 364 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.556863+0000 mon.smithi033 (mon.0) 365 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:28.557582+0000 mgr.smithi033.apxevf (mgr.14626) 207 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.561342+0000 mon.smithi033 (mon.0) 366 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.567345+0000 mon.smithi033 (mon.0) 367 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.570143+0000 mon.smithi033 (mon.0) 368 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.571576+0000 mon.smithi033 (mon.0) 369 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.572970+0000 mon.smithi033 (mon.0) 370 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.574441+0000 mon.smithi033 (mon.0) 371 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:28.574601+0000 mgr.smithi033.apxevf (mgr.14626) 208 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:28.575388+0000 mgr.smithi033.apxevf (mgr.14626) 209 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T18:35:29.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:29.142717+0000 mon.smithi033 (mon.0) 372 : cluster [WRN] Health check update: Degraded data redundancy: 63/357 objects degraded (17.647%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.555043+0000 mon.smithi033 (mon.0) 363 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.555997+0000 mon.smithi033 (mon.0) 364 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.556863+0000 mon.smithi033 (mon.0) 365 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:28.557582+0000 mgr.smithi033.apxevf (mgr.14626) 207 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.561342+0000 mon.smithi033 (mon.0) 366 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.567345+0000 mon.smithi033 (mon.0) 367 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.570143+0000 mon.smithi033 (mon.0) 368 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.571576+0000 mon.smithi033 (mon.0) 369 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.572970+0000 mon.smithi033 (mon.0) 370 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.574441+0000 mon.smithi033 (mon.0) 371 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:28.574601+0000 mgr.smithi033.apxevf (mgr.14626) 208 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:28.575388+0000 mgr.smithi033.apxevf (mgr.14626) 209 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-15T18:35:29.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:29.142717+0000 mon.smithi033 (mon.0) 372 : cluster [WRN] Health check update: Degraded data redundancy: 63/357 objects degraded (17.647%), 16 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:30.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:29.506418+0000 mgr.smithi033.apxevf (mgr.14626) 210 : cluster [DBG] pgmap v148: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/357 objects degraded (17.647%) 2024-02-15T18:35:31.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:29.506418+0000 mgr.smithi033.apxevf (mgr.14626) 210 : cluster [DBG] pgmap v148: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/357 objects degraded (17.647%) 2024-02-15T18:35:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:31.506983+0000 mgr.smithi033.apxevf (mgr.14626) 211 : cluster [DBG] pgmap v149: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/357 objects degraded (17.647%) 2024-02-15T18:35:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:31.506983+0000 mgr.smithi033.apxevf (mgr.14626) 211 : cluster [DBG] pgmap v149: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/357 objects degraded (17.647%) 2024-02-15T18:35:33.747 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:35:33.333+0000 7f28abc74380 -1 osd.4 69 log_to_monitors {default=true} 2024-02-15T18:35:33.747 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:35:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:35:33.579+0000 7f289c95a700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:35:33.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:33.337882+0000 mon.smithi131 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.131:6808/3577732459,v1:172.21.15.131:6809/3577732459]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:35:33.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:33.338325+0000 mon.smithi033 (mon.0) 373 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:35:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:33.337882+0000 mon.smithi131 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.131:6808/3577732459,v1:172.21.15.131:6809/3577732459]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:35:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:33.338325+0000 mon.smithi033 (mon.0) 373 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-15T18:35:34.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:33.507439+0000 mgr.smithi033.apxevf (mgr.14626) 212 : cluster [DBG] pgmap v150: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/357 objects degraded (17.647%) 2024-02-15T18:35:34.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:33.567493+0000 mon.smithi033 (mon.0) 374 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T18:35:34.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:33.567582+0000 mon.smithi033 (mon.0) 375 : cluster [DBG] osdmap e72: 6 total, 5 up, 6 in 2024-02-15T18:35:34.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:33.571540+0000 mon.smithi131 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.131:6808/3577732459,v1:172.21.15.131:6809/3577732459]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:35:34.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:33.572001+0000 mon.smithi033 (mon.0) 376 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:35:35.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:33.507439+0000 mgr.smithi033.apxevf (mgr.14626) 212 : cluster [DBG] pgmap v150: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 312 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/357 objects degraded (17.647%) 2024-02-15T18:35:35.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:33.567493+0000 mon.smithi033 (mon.0) 374 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-15T18:35:35.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:33.567582+0000 mon.smithi033 (mon.0) 375 : cluster [DBG] osdmap e72: 6 total, 5 up, 6 in 2024-02-15T18:35:35.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:33.571540+0000 mon.smithi131 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.131:6808/3577732459,v1:172.21.15.131:6809/3577732459]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:35:35.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:33.572001+0000 mon.smithi033 (mon.0) 376 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:35:35.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:34.565192+0000 mon.smithi033 (mon.0) 377 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:35:35.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:34.569570+0000 mon.smithi033 (mon.0) 378 : cluster [INF] osd.4 [v2:172.21.15.131:6808/3577732459,v1:172.21.15.131:6809/3577732459] boot 2024-02-15T18:35:35.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:34.569609+0000 mon.smithi033 (mon.0) 379 : cluster [DBG] osdmap e73: 6 total, 6 up, 6 in 2024-02-15T18:35:35.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:34.570133+0000 mon.smithi033 (mon.0) 380 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:35:35.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:34.565192+0000 mon.smithi033 (mon.0) 377 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:35:35.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:34.569570+0000 mon.smithi033 (mon.0) 378 : cluster [INF] osd.4 [v2:172.21.15.131:6808/3577732459,v1:172.21.15.131:6809/3577732459] boot 2024-02-15T18:35:35.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:34.569609+0000 mon.smithi033 (mon.0) 379 : cluster [DBG] osdmap e73: 6 total, 6 up, 6 in 2024-02-15T18:35:35.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:34.570133+0000 mon.smithi033 (mon.0) 380 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-15T18:35:36.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:35.508014+0000 mgr.smithi033.apxevf (mgr.14626) 213 : cluster [DBG] pgmap v153: 65 pgs: 7 peering, 13 active+undersized+degraded, 14 active+undersized, 31 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 49/357 objects degraded (13.725%) 2024-02-15T18:35:36.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:35.573263+0000 mon.smithi033 (mon.0) 381 : cluster [WRN] Health check update: Degraded data redundancy: 49/357 objects degraded (13.725%), 13 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:36.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:35.581571+0000 mon.smithi033 (mon.0) 382 : cluster [DBG] osdmap e74: 6 total, 6 up, 6 in 2024-02-15T18:35:37.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:35.508014+0000 mgr.smithi033.apxevf (mgr.14626) 213 : cluster [DBG] pgmap v153: 65 pgs: 7 peering, 13 active+undersized+degraded, 14 active+undersized, 31 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 49/357 objects degraded (13.725%) 2024-02-15T18:35:37.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:35.573263+0000 mon.smithi033 (mon.0) 381 : cluster [WRN] Health check update: Degraded data redundancy: 49/357 objects degraded (13.725%), 13 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:37.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:35.581571+0000 mon.smithi033 (mon.0) 382 : cluster [DBG] osdmap e74: 6 total, 6 up, 6 in 2024-02-15T18:35:38.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:37.508601+0000 mgr.smithi033.apxevf (mgr.14626) 214 : cluster [DBG] pgmap v155: 65 pgs: 17 peering, 8 active+undersized+degraded, 9 active+undersized, 31 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24/357 objects degraded (6.723%) 2024-02-15T18:35:39.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:37.508601+0000 mgr.smithi033.apxevf (mgr.14626) 214 : cluster [DBG] pgmap v155: 65 pgs: 17 peering, 8 active+undersized+degraded, 9 active+undersized, 31 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24/357 objects degraded (6.723%) 2024-02-15T18:35:40.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:39.509265+0000 mgr.smithi033.apxevf (mgr.14626) 215 : cluster [DBG] pgmap v156: 65 pgs: 17 peering, 48 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:40.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:39.509265+0000 mgr.smithi033.apxevf (mgr.14626) 215 : cluster [DBG] pgmap v156: 65 pgs: 17 peering, 48 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:41.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:40.147370+0000 mon.smithi033 (mon.0) 383 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/357 objects degraded (6.723%), 8 pgs degraded) 2024-02-15T18:35:41.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:40.147370+0000 mon.smithi033 (mon.0) 383 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/357 objects degraded (6.723%), 8 pgs degraded) 2024-02-15T18:35:42.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:41.509769+0000 mgr.smithi033.apxevf (mgr.14626) 216 : cluster [DBG] pgmap v157: 65 pgs: 65 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:42.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:41.509769+0000 mgr.smithi033.apxevf (mgr.14626) 216 : cluster [DBG] pgmap v157: 65 pgs: 65 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:43.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:42.655538+0000 mon.smithi033 (mon.0) 384 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:43.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:43.510128+0000 mgr.smithi033.apxevf (mgr.14626) 217 : cluster [DBG] pgmap v158: 65 pgs: 65 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:43.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:43.590916+0000 mon.smithi033 (mon.0) 385 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:35:43.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:43.591111+0000 mgr.smithi033.apxevf (mgr.14626) 218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:35:43.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:43.592164+0000 mgr.smithi033.apxevf (mgr.14626) 219 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-15T18:35:43.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:42.655538+0000 mon.smithi033 (mon.0) 384 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:43.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:43.510128+0000 mgr.smithi033.apxevf (mgr.14626) 217 : cluster [DBG] pgmap v158: 65 pgs: 65 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:43.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:43.590916+0000 mon.smithi033 (mon.0) 385 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:35:43.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:43.591111+0000 mgr.smithi033.apxevf (mgr.14626) 218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-15T18:35:43.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:43.592164+0000 mgr.smithi033.apxevf (mgr.14626) 219 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-15T18:35:45.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:44.664485+0000 mon.smithi033 (mon.0) 386 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:35:45.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:45.133079+0000 mgr.smithi033.apxevf (mgr.14626) 220 : cephadm [INF] Upgrade: Updating osd.5 2024-02-15T18:35:45.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:45.138117+0000 mon.smithi033 (mon.0) 387 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:45.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:45.139119+0000 mon.smithi033 (mon.0) 388 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T18:35:45.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:45.139965+0000 mon.smithi033 (mon.0) 389 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:45.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:45.141216+0000 mgr.smithi033.apxevf (mgr.14626) 221 : cephadm [INF] Deploying daemon osd.5 on smithi131 2024-02-15T18:35:45.913 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:45.510755+0000 mgr.smithi033.apxevf (mgr.14626) 222 : cluster [DBG] pgmap v159: 65 pgs: 65 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:45.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:44.664485+0000 mon.smithi033 (mon.0) 386 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:35:45.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:45.133079+0000 mgr.smithi033.apxevf (mgr.14626) 220 : cephadm [INF] Upgrade: Updating osd.5 2024-02-15T18:35:45.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:45.138117+0000 mon.smithi033 (mon.0) 387 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:45.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:45.139119+0000 mon.smithi033 (mon.0) 388 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-15T18:35:45.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:45.139965+0000 mon.smithi033 (mon.0) 389 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:45.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:45.141216+0000 mgr.smithi033.apxevf (mgr.14626) 221 : cephadm [INF] Deploying daemon osd.5 on smithi131 2024-02-15T18:35:45.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:45.510755+0000 mgr.smithi033.apxevf (mgr.14626) 222 : cluster [DBG] pgmap v159: 65 pgs: 65 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:47.997 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:47 smithi131 systemd[1]: Stopping Ceph osd.5 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:35:47.997 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.5[52036]: debug 2024-02-15T18:35:47.950+0000 7f84ea100700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:35:47.997 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.5[52036]: debug 2024-02-15T18:35:47.950+0000 7f84ea100700 -1 osd.5 74 *** Got signal Terminated *** 2024-02-15T18:35:47.997 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.5[52036]: debug 2024-02-15T18:35:47.950+0000 7f84ea100700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:35:48.556 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:48 smithi131 bash[65733]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.5 2024-02-15T18:35:48.997 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:48 smithi131 bash[65787]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.5 2024-02-15T18:35:48.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:47.511226+0000 mgr.smithi033.apxevf (mgr.14626) 223 : cluster [DBG] pgmap v160: 65 pgs: 65 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:48.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:47.754178+0000 mon.smithi033 (mon.0) 390 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:48.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.206456+0000 mon.smithi033 (mon.0) 391 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:35:48.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.206518+0000 mon.smithi033 (mon.0) 392 : cluster [INF] osd.5 failed (root=default,host=smithi131) (connection refused reported by osd.4) 2024-02-15T18:35:48.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.206896+0000 mon.smithi033 (mon.0) 393 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:35:48.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.207040+0000 mon.smithi033 (mon.0) 394 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:35:48.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.207168+0000 mon.smithi033 (mon.0) 395 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:35:48.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.207220+0000 mon.smithi033 (mon.0) 396 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:35:48.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.207337+0000 mon.smithi033 (mon.0) 397 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:35:48.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.207428+0000 mon.smithi033 (mon.0) 398 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:35:48.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.207582+0000 mon.smithi033 (mon.0) 399 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:35:48.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.207634+0000 mon.smithi033 (mon.0) 400 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:35:48.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.207785+0000 mon.smithi033 (mon.0) 401 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:35:49.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:47.511226+0000 mgr.smithi033.apxevf (mgr.14626) 223 : cluster [DBG] pgmap v160: 65 pgs: 65 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:47.754178+0000 mon.smithi033 (mon.0) 390 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.206456+0000 mon.smithi033 (mon.0) 391 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.206518+0000 mon.smithi033 (mon.0) 392 : cluster [INF] osd.5 failed (root=default,host=smithi131) (connection refused reported by osd.4) 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.206896+0000 mon.smithi033 (mon.0) 393 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.207040+0000 mon.smithi033 (mon.0) 394 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.207168+0000 mon.smithi033 (mon.0) 395 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.207220+0000 mon.smithi033 (mon.0) 396 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.207337+0000 mon.smithi033 (mon.0) 397 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.207428+0000 mon.smithi033 (mon.0) 398 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.207582+0000 mon.smithi033 (mon.0) 399 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.207634+0000 mon.smithi033 (mon.0) 400 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:35:49.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.207785+0000 mon.smithi033 (mon.0) 401 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.606983+0000 mon.smithi033 (mon.0) 402 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.607075+0000 mon.smithi033 (mon.0) 403 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.607254+0000 mon.smithi033 (mon.0) 404 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.607341+0000 mon.smithi033 (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.608046+0000 mon.smithi033 (mon.0) 406 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.608112+0000 mon.smithi033 (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.608233+0000 mon.smithi033 (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.608326+0000 mon.smithi033 (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.608409+0000 mon.smithi033 (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.608503+0000 mon.smithi033 (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:35:49.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.752568+0000 mon.smithi033 (mon.0) 412 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:35:49.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:48.759008+0000 mon.smithi033 (mon.0) 413 : cluster [DBG] osdmap e75: 6 total, 5 up, 6 in 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.606983+0000 mon.smithi033 (mon.0) 402 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.607075+0000 mon.smithi033 (mon.0) 403 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.607254+0000 mon.smithi033 (mon.0) 404 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.607341+0000 mon.smithi033 (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.608046+0000 mon.smithi033 (mon.0) 406 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.608112+0000 mon.smithi033 (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.608233+0000 mon.smithi033 (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.608326+0000 mon.smithi033 (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.608409+0000 mon.smithi033 (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.608503+0000 mon.smithi033 (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.752568+0000 mon.smithi033 (mon.0) 412 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-15T18:35:50.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:48.759008+0000 mon.smithi033 (mon.0) 413 : cluster [DBG] osdmap e75: 6 total, 5 up, 6 in 2024-02-15T18:35:50.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:49.511613+0000 mgr.smithi033.apxevf (mgr.14626) 224 : cluster [DBG] pgmap v162: 65 pgs: 13 stale+active+clean, 52 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:50.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:49.762452+0000 mon.smithi033 (mon.0) 414 : cluster [DBG] osdmap e76: 6 total, 5 up, 6 in 2024-02-15T18:35:50.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:50 smithi131 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.5.service: Succeeded. 2024-02-15T18:35:50.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:50 smithi131 systemd[1]: Stopped Ceph osd.5 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:35:50.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:50 smithi131 systemd[1]: Starting Ceph osd.5 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:35:51.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:49.511613+0000 mgr.smithi033.apxevf (mgr.14626) 224 : cluster [DBG] pgmap v162: 65 pgs: 13 stale+active+clean, 52 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:35:51.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:49.762452+0000 mon.smithi033 (mon.0) 414 : cluster [DBG] osdmap e76: 6 total, 5 up, 6 in 2024-02-15T18:35:51.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:51.512115+0000 mgr.smithi033.apxevf (mgr.14626) 225 : cluster [DBG] pgmap v164: 65 pgs: 9 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 42 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 40/357 objects degraded (11.204%) 2024-02-15T18:35:51.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:51.569033+0000 mon.smithi033 (mon.0) 415 : cluster [WRN] Health check failed: Degraded data redundancy: 40/357 objects degraded (11.204%), 9 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:51.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:51 smithi131 bash[66046]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-15T18:35:51.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:51 smithi131 bash[66046]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T18:35:51.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:51 smithi131 bash[66046]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-02-15T18:35:51.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:51 smithi131 bash[66046]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-15T18:35:51.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:51 smithi131 bash[66046]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-02-15T18:35:51.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:51 smithi131 bash[66046]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-15T18:35:51.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:51 smithi131 bash[66046]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-15T18:35:51.748 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:51 smithi131 bash[66046]: --> ceph-volume lvm activate successful for osd ID: 5 2024-02-15T18:35:52.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:51.512115+0000 mgr.smithi033.apxevf (mgr.14626) 225 : cluster [DBG] pgmap v164: 65 pgs: 9 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 42 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 40/357 objects degraded (11.204%) 2024-02-15T18:35:52.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:51.569033+0000 mon.smithi033 (mon.0) 415 : cluster [WRN] Health check failed: Degraded data redundancy: 40/357 objects degraded (11.204%), 9 pgs degraded (PG_DEGRADED) 2024-02-15T18:35:52.997 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:35:52.635+0000 7f8bd3987700 1 -- 172.21.15.131:0/2454572898 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555dee260680 con 0x555dee227000 2024-02-15T18:35:52.997 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:52 smithi131 bash[66311]: ba19a3c17a66ecc866e3f38b1e27afbd2c58a03f7c27148338f14bb319dbcb61 2024-02-15T18:35:52.997 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:52 smithi131 systemd[1]: Started Ceph osd.5 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:35:53.405 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:35:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:35:53.154+0000 7f8bdb415380 -1 Falling back to public interface 2024-02-15T18:35:53.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:52.764435+0000 mon.smithi033 (mon.0) 416 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:53.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:52.765300+0000 mon.smithi033 (mon.0) 417 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:53.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:53.512680+0000 mgr.smithi033.apxevf (mgr.14626) 226 : cluster [DBG] pgmap v165: 65 pgs: 11 active+undersized+degraded, 4 stale+active+clean, 10 active+undersized, 40 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47/357 objects degraded (13.165%) 2024-02-15T18:35:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:52.764435+0000 mon.smithi033 (mon.0) 416 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:52.765300+0000 mon.smithi033 (mon.0) 417 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:53.512680+0000 mgr.smithi033.apxevf (mgr.14626) 226 : cluster [DBG] pgmap v165: 65 pgs: 11 active+undersized+degraded, 4 stale+active+clean, 10 active+undersized, 40 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 47/357 objects degraded (13.165%) 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:55.513195+0000 mgr.smithi033.apxevf (mgr.14626) 227 : cluster [DBG] pgmap v166: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.840258+0000 mon.smithi033 (mon.0) 418 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.841153+0000 mon.smithi033 (mon.0) 419 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.842080+0000 mon.smithi033 (mon.0) 420 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.846870+0000 mon.smithi033 (mon.0) 421 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.853022+0000 mon.smithi033 (mon.0) 422 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.855689+0000 mon.smithi033 (mon.0) 423 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.857120+0000 mon.smithi033 (mon.0) 424 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.858461+0000 mon.smithi033 (mon.0) 425 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.860147+0000 mon.smithi033 (mon.0) 426 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:56.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.864690+0000 mon.smithi033 (mon.0) 427 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.865576+0000 mon.smithi033 (mon.0) 428 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.870469+0000 mon.smithi033 (mon.0) 429 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.871277+0000 mon.smithi033 (mon.0) 430 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.876342+0000 mon.smithi033 (mon.0) 431 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.877106+0000 mon.smithi033 (mon.0) 432 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.880720+0000 mon.smithi033 (mon.0) 433 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.881437+0000 mon.smithi033 (mon.0) 434 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.886768+0000 mon.smithi033 (mon.0) 435 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.887488+0000 mon.smithi033 (mon.0) 436 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.892417+0000 mon.smithi033 (mon.0) 437 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.893136+0000 mon.smithi033 (mon.0) 438 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.898084+0000 mon.smithi033 (mon.0) 439 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.903177+0000 mon.smithi033 (mon.0) 440 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:56.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:55.903565+0000 mon.smithi033 (mon.0) 441 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-15T18:35:57.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:55.513195+0000 mgr.smithi033.apxevf (mgr.14626) 227 : cluster [DBG] pgmap v166: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T18:35:57.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.840258+0000 mon.smithi033 (mon.0) 418 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.841153+0000 mon.smithi033 (mon.0) 419 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.842080+0000 mon.smithi033 (mon.0) 420 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.846870+0000 mon.smithi033 (mon.0) 421 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.853022+0000 mon.smithi033 (mon.0) 422 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.855689+0000 mon.smithi033 (mon.0) 423 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.857120+0000 mon.smithi033 (mon.0) 424 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.858461+0000 mon.smithi033 (mon.0) 425 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.860147+0000 mon.smithi033 (mon.0) 426 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.864690+0000 mon.smithi033 (mon.0) 427 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.865576+0000 mon.smithi033 (mon.0) 428 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.870469+0000 mon.smithi033 (mon.0) 429 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.871277+0000 mon.smithi033 (mon.0) 430 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.876342+0000 mon.smithi033 (mon.0) 431 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.877106+0000 mon.smithi033 (mon.0) 432 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-15T18:35:57.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.880720+0000 mon.smithi033 (mon.0) 433 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-15T18:35:57.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.881437+0000 mon.smithi033 (mon.0) 434 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-15T18:35:57.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.886768+0000 mon.smithi033 (mon.0) 435 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-15T18:35:57.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.887488+0000 mon.smithi033 (mon.0) 436 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-15T18:35:57.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.892417+0000 mon.smithi033 (mon.0) 437 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-15T18:35:57.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.893136+0000 mon.smithi033 (mon.0) 438 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-15T18:35:57.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.898084+0000 mon.smithi033 (mon.0) 439 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-15T18:35:57.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.903177+0000 mon.smithi033 (mon.0) 440 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:57.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:55.903565+0000 mon.smithi033 (mon.0) 441 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-15T18:35:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.404+0000 7f7aeedf9700 1 -- 172.21.15.33:0/1604916198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 msgr2=0x7f7ae80f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.404+0000 7f7aeedf9700 1 --2- 172.21.15.33:0/1604916198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 0x7f7ae80f7c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7ae4004660 tx=0x7f7ae4009b30).stop 2024-02-15T18:35:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.404+0000 7f7aeedf9700 1 -- 172.21.15.33:0/1604916198 shutdown_connections 2024-02-15T18:35:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.404+0000 7f7aeedf9700 1 --2- 172.21.15.33:0/1604916198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 0x7f7ae80f7c20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.404+0000 7f7aeedf9700 1 --2- 172.21.15.33:0/1604916198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ae80f6520 0x7f7ae80f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.404+0000 7f7aeedf9700 1 -- 172.21.15.33:0/1604916198 >> 172.21.15.33:0/1604916198 conn(0x7f7ae80f1ca0 msgr2=0x7f7ae80f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.404+0000 7f7aeedf9700 1 -- 172.21.15.33:0/1604916198 shutdown_connections 2024-02-15T18:35:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.404+0000 7f7aeedf9700 1 -- 172.21.15.33:0/1604916198 wait complete. 2024-02-15T18:35:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aeedf9700 1 Processor -- start 2024-02-15T18:35:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aeedf9700 1 -- start start 2024-02-15T18:35:57.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aeedf9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ae80f6520 0x7f7ae8106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aeedf9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 0x7f7ae8107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aeedf9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8107900 con 0x7f7ae80f77c0 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aeedf9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae8108110 con 0x7f7ae80f6520 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aed5f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 0x7f7ae8107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aed5f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 0x7f7ae8107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35400/0 (socket says 172.21.15.33:35400) 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aed5f6700 1 -- 172.21.15.33:0/708163923 learned_addr learned my addr 172.21.15.33:0/708163923 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aeddf7700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ae80f6520 0x7f7ae8106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aed5f6700 1 -- 172.21.15.33:0/708163923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ae80f6520 msgr2=0x7f7ae8106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aed5f6700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ae80f6520 0x7f7ae8106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aed5f6700 1 -- 172.21.15.33:0/708163923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4005040 con 0x7f7ae80f77c0 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.405+0000 7f7aeddf7700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ae80f6520 0x7f7ae8106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.406+0000 7f7aed5f6700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 0x7f7ae8107300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f7ae4000c00 tx=0x7f7ae400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.406+0000 7f7ade7fc700 1 -- 172.21.15.33:0/708163923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae4019070 con 0x7f7ae80f77c0 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.406+0000 7f7ade7fc700 1 -- 172.21.15.33:0/708163923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f7ae4007e80 con 0x7f7ae80f77c0 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.406+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae8108330 con 0x7f7ae80f77c0 2024-02-15T18:35:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.406+0000 7f7ade7fc700 1 -- 172.21.15.33:0/708163923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ae4014db0 con 0x7f7ae80f77c0 2024-02-15T18:35:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.406+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae8108890 con 0x7f7ae80f77c0 2024-02-15T18:35:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.407+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae8059100 con 0x7f7ae80f77c0 2024-02-15T18:35:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.407+0000 7f7ade7fc700 1 -- 172.21.15.33:0/708163923 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f7ae4025070 con 0x7f7ae80f77c0 2024-02-15T18:35:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.408+0000 7f7ade7fc700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7ad4060f10 0x7f7ad40633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.408+0000 7f7ade7fc700 1 -- 172.21.15.33:0/708163923 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7ae407d040 con 0x7f7ae80f77c0 2024-02-15T18:35:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.408+0000 7f7aeddf7700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7ad4060f10 0x7f7ad40633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.408+0000 7f7aeddf7700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7ad4060f10 0x7f7ad40633d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f7ae8106b80 tx=0x7f7ad800b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.412+0000 7f7ade7fc700 1 -- 172.21.15.33:0/708163923 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7ae404d4d0 con 0x7f7ae80f77c0 2024-02-15T18:35:57.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.602+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae80fef80 con 0x7f7ad4060f10 2024-02-15T18:35:57.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.603+0000 7f7ade7fc700 1 -- 172.21.15.33:0/708163923 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7ae80fef80 con 0x7f7ad4060f10 2024-02-15T18:35:57.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7ad4060f10 msgr2=0x7f7ad40633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:57.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7ad4060f10 0x7f7ad40633d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f7ae8106b80 tx=0x7f7ad800b040).stop 2024-02-15T18:35:57.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 msgr2=0x7f7ae8107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:57.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 0x7f7ae8107300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f7ae4000c00 tx=0x7f7ae400b040).stop 2024-02-15T18:35:57.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 shutdown_connections 2024-02-15T18:35:57.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7ad4060f10 0x7f7ad40633d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ae80f6520 0x7f7ae8106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 --2- 172.21.15.33:0/708163923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae80f77c0 0x7f7ae8107300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 >> 172.21.15.33:0/708163923 conn(0x7f7ae80f1ca0 msgr2=0x7f7ae80fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:57.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 shutdown_connections 2024-02-15T18:35:57.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.605+0000 7f7aeedf9700 1 -- 172.21.15.33:0/708163923 wait complete. 2024-02-15T18:35:57.607 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:35:57.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 -- 172.21.15.33:0/1070978779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 msgr2=0x7ff05c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:57.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 --2- 172.21.15.33:0/1070978779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 0x7ff05c0f59e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff058004660 tx=0x7ff058009b30).stop 2024-02-15T18:35:57.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 -- 172.21.15.33:0/1070978779 shutdown_connections 2024-02-15T18:35:57.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 --2- 172.21.15.33:0/1070978779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff05c0f6860 0x7ff05c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 --2- 172.21.15.33:0/1070978779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 0x7ff05c0f59e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 -- 172.21.15.33:0/1070978779 >> 172.21.15.33:0/1070978779 conn(0x7ff05c0f0d40 msgr2=0x7ff05c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 -- 172.21.15.33:0/1070978779 shutdown_connections 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 -- 172.21.15.33:0/1070978779 wait complete. 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 Processor -- start 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.726+0000 7ff063f1a700 1 -- start start 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff063f1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 0x7ff05c106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff063f1a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff05c0f6860 0x7ff05c1074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff063f1a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c107a90 con 0x7ff05c0f55c0 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff063f1a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c107bd0 con 0x7ff05c0f6860 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff061cb6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 0x7ff05c106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff061cb6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 0x7ff05c106ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35428/0 (socket says 172.21.15.33:35428) 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff061cb6700 1 -- 172.21.15.33:0/3323164595 learned_addr learned my addr 172.21.15.33:0/3323164595 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:57.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff0614b5700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff05c0f6860 0x7ff05c1074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff061cb6700 1 -- 172.21.15.33:0/3323164595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff05c0f6860 msgr2=0x7ff05c1074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff061cb6700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff05c0f6860 0x7ff05c1074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff061cb6700 1 -- 172.21.15.33:0/3323164595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff058005040 con 0x7ff05c0f55c0 2024-02-15T18:35:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff061cb6700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 0x7ff05c106ff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff058004e30 tx=0x7ff058009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff0527fc700 1 -- 172.21.15.33:0/3323164595 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff058018070 con 0x7ff05c0f55c0 2024-02-15T18:35:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c108510 con 0x7ff05c0f55c0 2024-02-15T18:35:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff0527fc700 1 -- 172.21.15.33:0/3323164595 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7ff058007ba0 con 0x7ff05c0f55c0 2024-02-15T18:35:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff0527fc700 1 -- 172.21.15.33:0/3323164595 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff05801c620 con 0x7ff05c0f55c0 2024-02-15T18:35:57.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.727+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c108a70 con 0x7ff05c0f55c0 2024-02-15T18:35:57.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.728+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c045ad0 con 0x7ff05c0f55c0 2024-02-15T18:35:57.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.729+0000 7ff0527fc700 1 -- 172.21.15.33:0/3323164595 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ff05801d9a0 con 0x7ff05c0f55c0 2024-02-15T18:35:57.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.729+0000 7ff0527fc700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff048060f20 0x7ff0480633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:57.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.729+0000 7ff0527fc700 1 -- 172.21.15.33:0/3323164595 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff05807df60 con 0x7ff05c0f55c0 2024-02-15T18:35:57.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.729+0000 7ff0614b5700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff048060f20 0x7ff0480633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:57.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.730+0000 7ff0614b5700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff048060f20 0x7ff0480633e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff04c0096c0 tx=0x7ff04c009be0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:57.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.733+0000 7ff0527fc700 1 -- 172.21.15.33:0/3323164595 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff058051d50 con 0x7ff05c0f55c0 2024-02-15T18:35:57.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.924+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff05c0faca0 con 0x7ff048060f20 2024-02-15T18:35:57.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.926+0000 7ff0527fc700 1 -- 172.21.15.33:0/3323164595 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff05c0faca0 con 0x7ff048060f20 2024-02-15T18:35:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.927+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff048060f20 msgr2=0x7ff0480633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.927+0000 7ff063f1a700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff048060f20 0x7ff0480633e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff04c0096c0 tx=0x7ff04c009be0).stop 2024-02-15T18:35:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.927+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 msgr2=0x7ff05c106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.927+0000 7ff063f1a700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 0x7ff05c106ff0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff058004e30 tx=0x7ff058009b30).stop 2024-02-15T18:35:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.927+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 shutdown_connections 2024-02-15T18:35:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.927+0000 7ff063f1a700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff048060f20 0x7ff0480633e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.927+0000 7ff063f1a700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff05c0f55c0 0x7ff05c106ff0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.927+0000 7ff063f1a700 1 --2- 172.21.15.33:0/3323164595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff05c0f6860 0x7ff05c1074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.927+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 >> 172.21.15.33:0/3323164595 conn(0x7ff05c0f0d40 msgr2=0x7ff05c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.928+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 shutdown_connections 2024-02-15T18:35:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:57.928+0000 7ff063f1a700 1 -- 172.21.15.33:0/3323164595 wait complete. 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:55.842830+0000 mgr.smithi033.apxevf (mgr.14626) 228 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:55.860869+0000 mgr.smithi033.apxevf (mgr.14626) 229 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:55.899763+0000 mgr.smithi033.apxevf (mgr.14626) 230 : cephadm [INF] Upgrade: Scaling down filesystem cephfs 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.905662+0000 mon.smithi033 (mon.0) 442 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:56.905726+0000 mon.smithi033 (mon.0) 443 : cluster [INF] stopping daemon mds.cephfs.smithi131.bgnwzs 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:56.906055+0000 mon.smithi033 (mon.0) 444 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:56.908815+0000 mon.smithi033 (mon.0) 445 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:stopping} 2 up:standby 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.908972+0000 mon.smithi033 (mon.0) 446 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.910745+0000 mon.smithi033 (mon.0) 447 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.911599+0000 mon.smithi033 (mon.0) 448 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.916012+0000 mon.smithi033 (mon.0) 449 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:57.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.922082+0000 mon.smithi033 (mon.0) 450 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:57.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.924675+0000 mon.smithi033 (mon.0) 451 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:57.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.926097+0000 mon.smithi033 (mon.0) 452 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:57.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.927395+0000 mon.smithi033 (mon.0) 453 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:57.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:56.929110+0000 mon.smithi033 (mon.0) 454 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:58.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.030+0000 7fd002a2f700 1 -- 172.21.15.33:0/4099343491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f55c0 msgr2=0x7fcffc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.030+0000 7fd002a2f700 1 --2- 172.21.15.33:0/4099343491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f55c0 0x7fcffc0f59e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fcfec004660 tx=0x7fcfec009b30).stop 2024-02-15T18:35:58.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.030+0000 7fd002a2f700 1 -- 172.21.15.33:0/4099343491 shutdown_connections 2024-02-15T18:35:58.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.030+0000 7fd002a2f700 1 --2- 172.21.15.33:0/4099343491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcffc0f6860 0x7fcffc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:35:58.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.030+0000 7fd002a2f700 1 --2- 172.21.15.33:0/4099343491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f55c0 0x7fcffc0f59e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.030+0000 7fd002a2f700 1 -- 172.21.15.33:0/4099343491 >> 172.21.15.33:0/4099343491 conn(0x7fcffc0f0d40 msgr2=0x7fcffc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:58.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.030+0000 7fd002a2f700 1 -- 172.21.15.33:0/4099343491 shutdown_connections 2024-02-15T18:35:58.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.030+0000 7fd002a2f700 1 -- 172.21.15.33:0/4099343491 wait complete. 2024-02-15T18:35:58.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.031+0000 7fd002a2f700 1 Processor -- start 2024-02-15T18:35:58.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.031+0000 7fd002a2f700 1 -- start start 2024-02-15T18:35:58.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.031+0000 7fd002a2f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcffc0f55c0 0x7fcffc105f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.031+0000 7fd002a2f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f6860 0x7fcffc106480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.031+0000 7fd002a2f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc106ac0 con 0x7fcffc0f6860 2024-02-15T18:35:58.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.031+0000 7fd002a2f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc107370 con 0x7fcffc0f55c0 2024-02-15T18:35:58.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.031+0000 7fcff3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f6860 0x7fcffc106480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.031+0000 7fcff3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f6860 0x7fcffc106480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35460/0 (socket says 172.21.15.33:35460) 2024-02-15T18:35:58.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.031+0000 7fcff3fff700 1 -- 172.21.15.33:0/2803165955 learned_addr learned my addr 172.21.15.33:0/2803165955 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fcffbfff700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcffc0f55c0 0x7fcffc105f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fcff3fff700 1 -- 172.21.15.33:0/2803165955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcffc0f55c0 msgr2=0x7fcffc105f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fcff3fff700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcffc0f55c0 0x7fcffc105f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fcff3fff700 1 -- 172.21.15.33:0/2803165955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec005040 con 0x7fcffc0f6860 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fcff3fff700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f6860 0x7fcffc106480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fcfe400b410 tx=0x7fcfe4006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fcff97fa700 1 -- 172.21.15.33:0/2803165955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe40125f0 con 0x7fcffc0f6860 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fcff97fa700 1 -- 172.21.15.33:0/2803165955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fcfe4012c40 con 0x7fcffc0f6860 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc107650 con 0x7fcffc0f6860 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fcff97fa700 1 -- 172.21.15.33:0/2803165955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe4002b80 con 0x7fcffc0f6860 2024-02-15T18:35:58.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.032+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc107b90 con 0x7fcffc0f6860 2024-02-15T18:35:58.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.033+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc0f49b0 con 0x7fcffc0f6860 2024-02-15T18:35:58.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.033+0000 7fcff97fa700 1 -- 172.21.15.33:0/2803165955 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fcfe400f030 con 0x7fcffc0f6860 2024-02-15T18:35:58.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.034+0000 7fcff97fa700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcfe8060f20 0x7fcfe80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.034+0000 7fcff97fa700 1 -- 172.21.15.33:0/2803165955 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fcfe407c600 con 0x7fcffc0f6860 2024-02-15T18:35:58.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.034+0000 7fcffbfff700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcfe8060f20 0x7fcfe80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.034+0000 7fcffbfff700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcfe8060f20 0x7fcfe80633e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fcfec004e30 tx=0x7fcfec009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:58.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.038+0000 7fcff97fa700 1 -- 172.21.15.33:0/2803165955 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcfe40504b0 con 0x7fcffc0f6860 2024-02-15T18:35:58.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:55.842830+0000 mgr.smithi033.apxevf (mgr.14626) 228 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:55.860869+0000 mgr.smithi033.apxevf (mgr.14626) 229 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:55.899763+0000 mgr.smithi033.apxevf (mgr.14626) 230 : cephadm [INF] Upgrade: Scaling down filesystem cephfs 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.905662+0000 mon.smithi033 (mon.0) 442 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:56.905726+0000 mon.smithi033 (mon.0) 443 : cluster [INF] stopping daemon mds.cephfs.smithi131.bgnwzs 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:56.906055+0000 mon.smithi033 (mon.0) 444 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:active} 2 up:standby 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:56.908815+0000 mon.smithi033 (mon.0) 445 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:stopping} 2 up:standby 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.908972+0000 mon.smithi033 (mon.0) 446 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.910745+0000 mon.smithi033 (mon.0) 447 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.911599+0000 mon.smithi033 (mon.0) 448 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.916012+0000 mon.smithi033 (mon.0) 449 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.922082+0000 mon.smithi033 (mon.0) 450 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.924675+0000 mon.smithi033 (mon.0) 451 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:58.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.926097+0000 mon.smithi033 (mon.0) 452 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:58.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.927395+0000 mon.smithi033 (mon.0) 453 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:58.048 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:56.929110+0000 mon.smithi033 (mon.0) 454 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:58.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.220+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcffc0fdfe0 con 0x7fcfe8060f20 2024-02-15T18:35:58.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.230+0000 7fcff97fa700 1 -- 172.21.15.33:0/2803165955 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fcffc0fdfe0 con 0x7fcfe8060f20 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (10m) 84s ago 12m 19.5M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (3m) 84s ago 12m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (3m) 2s ago 11m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (10m) 84s ago 12m 34.2M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (7m) 84s ago 7m 17.4M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (7m) 84s ago 7m 13.2M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (7m) 2s ago 7m 118M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (7m) 2s ago 7m 133M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (4m) 84s ago 14m 433M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (4m) 2s ago 11m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (3m) 84s ago 14m 42.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:35:58.222 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (3m) 2s ago 11m 41.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:35:58.223 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (12m) 84s ago 12m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:35:58.223 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (11m) 2s ago 11m 17.1M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:35:58.223 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (2m) 84s ago 10m 196M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:35:58.223 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (2m) 84s ago 10m 193M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:35:58.223 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (91s) 84s ago 9m 10.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:35:58.223 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (61s) 2s ago 9m 251M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4030e9f6d6c2 2024-02-15T18:35:58.223 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (33s) 2s ago 9m 244M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 902c89c867aa 2024-02-15T18:35:58.223 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (5s) 2s ago 8m 12.9M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc ba19a3c17a66 2024-02-15T18:35:58.223 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (4m) 84s ago 11m 65.6M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:35:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcfe8060f20 msgr2=0x7fcfe80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcfe8060f20 0x7fcfe80633e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fcfec004e30 tx=0x7fcfec009b30).stop 2024-02-15T18:35:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f6860 msgr2=0x7fcffc106480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f6860 0x7fcffc106480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fcfe400b410 tx=0x7fcfe4006ef0).stop 2024-02-15T18:35:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 shutdown_connections 2024-02-15T18:35:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcfe8060f20 0x7fcfe80633e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcffc0f55c0 0x7fcffc105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 --2- 172.21.15.33:0/2803165955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcffc0f6860 0x7fcffc106480 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 >> 172.21.15.33:0/2803165955 conn(0x7fcffc0f0d40 msgr2=0x7fcffc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:58.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 shutdown_connections 2024-02-15T18:35:58.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.232+0000 7fd002a2f700 1 -- 172.21.15.33:0/2803165955 wait complete. 2024-02-15T18:35:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.332+0000 7f93eed83700 1 -- 172.21.15.33:0/3729498138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 msgr2=0x7f93e80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.332+0000 7f93eed83700 1 --2- 172.21.15.33:0/3729498138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 0x7f93e80f6b00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f93dc004660 tx=0x7f93dc009b30).stop 2024-02-15T18:35:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.332+0000 7f93eed83700 1 -- 172.21.15.33:0/3729498138 shutdown_connections 2024-02-15T18:35:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.332+0000 7f93eed83700 1 --2- 172.21.15.33:0/3729498138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93e80f7980 0x7f93e80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.332+0000 7f93eed83700 1 --2- 172.21.15.33:0/3729498138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 0x7f93e80f6b00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.332+0000 7f93eed83700 1 -- 172.21.15.33:0/3729498138 >> 172.21.15.33:0/3729498138 conn(0x7f93e80f1e40 msgr2=0x7f93e80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:58.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.332+0000 7f93eed83700 1 -- 172.21.15.33:0/3729498138 shutdown_connections 2024-02-15T18:35:58.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.332+0000 7f93eed83700 1 -- 172.21.15.33:0/3729498138 wait complete. 2024-02-15T18:35:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.333+0000 7f93eed83700 1 Processor -- start 2024-02-15T18:35:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.333+0000 7f93eed83700 1 -- start start 2024-02-15T18:35:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.333+0000 7f93eed83700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 0x7f93e806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.333+0000 7f93eed83700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93e80f7980 0x7f93e8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.333+0000 7f93eed83700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e806a380 con 0x7f93e80f66e0 2024-02-15T18:35:58.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.333+0000 7f93eed83700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e806a4c0 con 0x7f93e80f7980 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93ecb1f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 0x7f93e806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93ecb1f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 0x7f93e806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35478/0 (socket says 172.21.15.33:35478) 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93ecb1f700 1 -- 172.21.15.33:0/4128431076 learned_addr learned my addr 172.21.15.33:0/4128431076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93e7fff700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93e80f7980 0x7f93e8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93ecb1f700 1 -- 172.21.15.33:0/4128431076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93e80f7980 msgr2=0x7f93e8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93ecb1f700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93e80f7980 0x7f93e8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93ecb1f700 1 -- 172.21.15.33:0/4128431076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc005040 con 0x7f93e80f66e0 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93ecb1f700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 0x7f93e806b9a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f93dc002040 tx=0x7f93dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93e57fa700 1 -- 172.21.15.33:0/4128431076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93dc019070 con 0x7f93e80f66e0 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93e57fa700 1 -- 172.21.15.33:0/4128431076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f93dc007e80 con 0x7f93e80f66e0 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e806a740 con 0x7f93e80f66e0 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93e57fa700 1 -- 172.21.15.33:0/4128431076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93dc014db0 con 0x7f93e80f66e0 2024-02-15T18:35:58.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.334+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e806aca0 con 0x7f93e80f66e0 2024-02-15T18:35:58.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.335+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e8045ad0 con 0x7f93e80f66e0 2024-02-15T18:35:58.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.336+0000 7f93e57fa700 1 -- 172.21.15.33:0/4128431076 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f93dc025070 con 0x7f93e80f66e0 2024-02-15T18:35:58.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.336+0000 7f93e57fa700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f93d8060ec0 0x7f93d8063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.336+0000 7f93e57fa700 1 -- 172.21.15.33:0/4128431076 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f93dc07cff0 con 0x7f93e80f66e0 2024-02-15T18:35:58.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.336+0000 7f93e7fff700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f93d8060ec0 0x7f93d8063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.336+0000 7f93e7fff700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f93d8060ec0 0x7f93d8063380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f93d4009fd0 tx=0x7f93d400b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:58.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.340+0000 7f93e57fa700 1 -- 172.21.15.33:0/4128431076 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f93dc04d410 con 0x7f93e80f66e0 2024-02-15T18:35:58.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.587+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f93e80586e0 con 0x7f93e80f66e0 2024-02-15T18:35:58.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.587+0000 7f93e57fa700 1 -- 172.21.15.33:0/4128431076 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+726 (secure 0 0 0) 0x7f93dc023020 con 0x7f93e80f66e0 2024-02-15T18:35:58.579 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:35:58.579 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:35:58.579 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:35:58.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:35:58.579 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:35:58.579 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:35:58.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 5 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 9, 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:35:58.580 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:35:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f93d8060ec0 msgr2=0x7f93d8063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f93d8060ec0 0x7f93d8063380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f93d4009fd0 tx=0x7f93d400b040).stop 2024-02-15T18:35:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 msgr2=0x7f93e806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 0x7f93e806b9a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f93dc002040 tx=0x7f93dc00b040).stop 2024-02-15T18:35:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 shutdown_connections 2024-02-15T18:35:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f93d8060ec0 0x7f93d8063380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e80f66e0 0x7f93e806b9a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 --2- 172.21.15.33:0/4128431076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93e80f7980 0x7f93e8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 >> 172.21.15.33:0/4128431076 conn(0x7f93e80f1e40 msgr2=0x7f93e80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:58.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 shutdown_connections 2024-02-15T18:35:58.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.589+0000 7f93eed83700 1 -- 172.21.15.33:0/4128431076 wait complete. 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.691+0000 7f0d9c468700 1 -- 172.21.15.33:0/2501096849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 msgr2=0x7f0d940f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.691+0000 7f0d9c468700 1 --2- 172.21.15.33:0/2501096849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 0x7f0d940f7de0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0d88004660 tx=0x7f0d88009b30).stop 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.691+0000 7f0d9c468700 1 -- 172.21.15.33:0/2501096849 shutdown_connections 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.691+0000 7f0d9c468700 1 --2- 172.21.15.33:0/2501096849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 0x7f0d940f7de0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.691+0000 7f0d9c468700 1 --2- 172.21.15.33:0/2501096849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d940f66e0 0x7f0d940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.691+0000 7f0d9c468700 1 -- 172.21.15.33:0/2501096849 >> 172.21.15.33:0/2501096849 conn(0x7f0d940f1e40 msgr2=0x7f0d940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.691+0000 7f0d9c468700 1 -- 172.21.15.33:0/2501096849 shutdown_connections 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.691+0000 7f0d9c468700 1 -- 172.21.15.33:0/2501096849 wait complete. 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d9c468700 1 Processor -- start 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d9c468700 1 -- start start 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d9c468700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d940f66e0 0x7f0d94107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d9c468700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 0x7f0d941074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d9c468700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94107aa0 con 0x7f0d940f7980 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d9c468700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94107be0 con 0x7f0d940f66e0 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d99a03700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 0x7f0d941074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d99a03700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 0x7f0d941074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35492/0 (socket says 172.21.15.33:35492) 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d99a03700 1 -- 172.21.15.33:0/301485480 learned_addr learned my addr 172.21.15.33:0/301485480 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d9a204700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d940f66e0 0x7f0d94107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d99a03700 1 -- 172.21.15.33:0/301485480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d940f66e0 msgr2=0x7f0d94107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d99a03700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d940f66e0 0x7f0d94107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.692+0000 7f0d99a03700 1 -- 172.21.15.33:0/301485480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88005040 con 0x7f0d940f7980 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.693+0000 7f0d99a03700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 0x7f0d941074f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0d88000c00 tx=0x7f0d8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.693+0000 7f0d86ffd700 1 -- 172.21.15.33:0/301485480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d88019070 con 0x7f0d940f7980 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.693+0000 7f0d86ffd700 1 -- 172.21.15.33:0/301485480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0d88007e80 con 0x7f0d940f7980 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.693+0000 7f0d86ffd700 1 -- 172.21.15.33:0/301485480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d88014db0 con 0x7f0d940f7980 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.693+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d94108520 con 0x7f0d940f7980 2024-02-15T18:35:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.693+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d94108a80 con 0x7f0d940f7980 2024-02-15T18:35:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.694+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d94045ad0 con 0x7f0d940f7980 2024-02-15T18:35:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.694+0000 7f0d86ffd700 1 -- 172.21.15.33:0/301485480 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f0d88025070 con 0x7f0d940f7980 2024-02-15T18:35:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.695+0000 7f0d86ffd700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d80060ec0 0x7f0d80063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.695+0000 7f0d86ffd700 1 -- 172.21.15.33:0/301485480 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0d8807d020 con 0x7f0d940f7980 2024-02-15T18:35:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.695+0000 7f0d9a204700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d80060ec0 0x7f0d80063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.695+0000 7f0d9a204700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d80060ec0 0x7f0d80063380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0d90009fd0 tx=0x7f0d9000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:58.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.699+0000 7f0d86ffd700 1 -- 172.21.15.33:0/301485480 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0d88050ed0 con 0x7f0d940f7980 2024-02-15T18:35:58.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.917+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0d94027a00 con 0x7f0d940f7980 2024-02-15T18:35:58.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.918+0000 7f0d86ffd700 1 -- 172.21.15.33:0/301485480 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1799 (secure 0 0 0) 0x7f0d88023070 con 0x7f0d940f7980 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:e23 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 23 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:35:56.905772+0000 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:35:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:35:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:stopping seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:35:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:35:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.919+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d80060ec0 msgr2=0x7f0d80063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d80060ec0 0x7f0d80063380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0d90009fd0 tx=0x7f0d9000b040).stop 2024-02-15T18:35:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 msgr2=0x7f0d941074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 0x7f0d941074f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f0d88000c00 tx=0x7f0d8800b040).stop 2024-02-15T18:35:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 shutdown_connections 2024-02-15T18:35:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0d80060ec0 0x7f0d80063380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d940f66e0 0x7f0d94107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 --2- 172.21.15.33:0/301485480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d940f7980 0x7f0d941074f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 >> 172.21.15.33:0/301485480 conn(0x7f0d940f1e40 msgr2=0x7f0d940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 shutdown_connections 2024-02-15T18:35:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:58.920+0000 7f0d9c468700 1 -- 172.21.15.33:0/301485480 wait complete. 2024-02-15T18:35:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-02-15T18:35:58.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:56.912330+0000 mgr.smithi033.apxevf (mgr.14626) 231 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:58.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:35:56.930672+0000 mgr.smithi033.apxevf (mgr.14626) 232 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:35:58.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:57.513596+0000 mgr.smithi033.apxevf (mgr.14626) 233 : cluster [DBG] pgmap v167: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T18:35:58.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:57.655610+0000 mon.smithi033 (mon.0) 455 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.022+0000 7fe0eced9700 1 -- 172.21.15.33:0/677894422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f6860 msgr2=0x7fe0e80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.022+0000 7fe0eced9700 1 --2- 172.21.15.33:0/677894422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f6860 0x7fe0e80f6cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe0dc004660 tx=0x7fe0dc009b30).stop 2024-02-15T18:35:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.022+0000 7fe0eced9700 1 -- 172.21.15.33:0/677894422 shutdown_connections 2024-02-15T18:35:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.022+0000 7fe0eced9700 1 --2- 172.21.15.33:0/677894422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f6860 0x7fe0e80f6cc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.022+0000 7fe0eced9700 1 --2- 172.21.15.33:0/677894422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e80f55c0 0x7fe0e80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.022+0000 7fe0eced9700 1 -- 172.21.15.33:0/677894422 >> 172.21.15.33:0/677894422 conn(0x7fe0e80f0d40 msgr2=0x7fe0e80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.022+0000 7fe0eced9700 1 -- 172.21.15.33:0/677894422 shutdown_connections 2024-02-15T18:35:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.022+0000 7fe0eced9700 1 -- 172.21.15.33:0/677894422 wait complete. 2024-02-15T18:35:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.023+0000 7fe0eced9700 1 Processor -- start 2024-02-15T18:35:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.023+0000 7fe0eced9700 1 -- start start 2024-02-15T18:35:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.023+0000 7fe0eced9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f55c0 0x7fe0e8109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.023+0000 7fe0eced9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e80f6860 0x7fe0e810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.023+0000 7fe0eced9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80603e0 con 0x7fe0e80f55c0 2024-02-15T18:35:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.023+0000 7fe0eced9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8060520 con 0x7fe0e80f6860 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0e659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f55c0 0x7fe0e8109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0e659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f55c0 0x7fe0e8109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35510/0 (socket says 172.21.15.33:35510) 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0e659c700 1 -- 172.21.15.33:0/845937842 learned_addr learned my addr 172.21.15.33:0/845937842 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0e5d9b700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e80f6860 0x7fe0e810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0e659c700 1 -- 172.21.15.33:0/845937842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e80f6860 msgr2=0x7fe0e810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0e659c700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e80f6860 0x7fe0e810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0e659c700 1 -- 172.21.15.33:0/845937842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc005040 con 0x7fe0e80f55c0 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0e5d9b700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e80f6860 0x7fe0e810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0e659c700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f55c0 0x7fe0e8109cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe0d800e7c0 tx=0x7fe0d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0d6ffd700 1 -- 172.21.15.33:0/845937842 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d80092e0 con 0x7fe0e80f55c0 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e810c760 con 0x7fe0e80f55c0 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0d6ffd700 1 -- 172.21.15.33:0/845937842 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fe0d800f040 con 0x7fe0e80f55c0 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0d6ffd700 1 -- 172.21.15.33:0/845937842 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0d8014920 con 0x7fe0e80f55c0 2024-02-15T18:35:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.024+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e810cd20 con 0x7fe0e80f55c0 2024-02-15T18:35:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.025+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e8045ad0 con 0x7fe0e80f55c0 2024-02-15T18:35:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.026+0000 7fe0d6ffd700 1 -- 172.21.15.33:0/845937842 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe0d801b030 con 0x7fe0e80f55c0 2024-02-15T18:35:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.026+0000 7fe0d6ffd700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe0d0060f20 0x7fe0d00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:35:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.026+0000 7fe0d6ffd700 1 -- 172.21.15.33:0/845937842 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fe0d807c050 con 0x7fe0e80f55c0 2024-02-15T18:35:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.026+0000 7fe0e5d9b700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe0d0060f20 0x7fe0d00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:35:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.026+0000 7fe0e5d9b700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe0d0060f20 0x7fe0d00633e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe0dc005010 tx=0x7fe0dc016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:35:59.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.030+0000 7fe0d6ffd700 1 -- 172.21.15.33:0/845937842 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe0d804c4d0 con 0x7fe0e80f55c0 2024-02-15T18:35:59.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:56.912330+0000 mgr.smithi033.apxevf (mgr.14626) 231 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:35:59.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:35:56.930672+0000 mgr.smithi033.apxevf (mgr.14626) 232 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:35:59.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:57.513596+0000 mgr.smithi033.apxevf (mgr.14626) 233 : cluster [DBG] pgmap v167: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T18:35:59.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:57.655610+0000 mon.smithi033 (mon.0) 455 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:35:59.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.221+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0e80fdfa0 con 0x7fe0d0060f20 2024-02-15T18:35:59.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.222+0000 7fe0d6ffd700 1 -- 172.21.15.33:0/845937842 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe0e80fdfa0 con 0x7fe0d0060f20 2024-02-15T18:35:59.214 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:35:59.214 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:35:59.214 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:35:59.214 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:35:59.214 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:35:59.214 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:35:59.214 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:35:59.214 INFO:teuthology.orchestra.run.smithi033.stdout: "osd", 2024-02-15T18:35:59.215 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:35:59.215 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:35:59.215 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "12/21 daemons upgraded", 2024-02-15T18:35:59.215 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:35:59.215 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:35:59.215 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe0d0060f20 msgr2=0x7fe0d00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe0d0060f20 0x7fe0d00633e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe0dc005010 tx=0x7fe0dc016040).stop 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f55c0 msgr2=0x7fe0e8109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f55c0 0x7fe0e8109cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe0d800e7c0 tx=0x7fe0d800b040).stop 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 shutdown_connections 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe0d0060f20 0x7fe0d00633e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80f55c0 0x7fe0e8109cb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 --2- 172.21.15.33:0/845937842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0e80f6860 0x7fe0e810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 >> 172.21.15.33:0/845937842 conn(0x7fe0e80f0d40 msgr2=0x7fe0e80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:35:59.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 shutdown_connections 2024-02-15T18:35:59.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:35:59.224+0000 7fe0eced9700 1 -- 172.21.15.33:0/845937842 wait complete. 2024-02-15T18:35:59.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:57.604900+0000 mgr.smithi033.apxevf (mgr.14626) 234 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:59.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:57.927299+0000 mgr.smithi033.apxevf (mgr.14626) 235 : audit [DBG] from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:59.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:58.222991+0000 mgr.smithi033.apxevf (mgr.14626) 236 : audit [DBG] from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:35:59.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:58.589161+0000 mon.smithi033 (mon.0) 456 : audit [DBG] from='client.? 172.21.15.33:0/4128431076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:35:59.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:58.919730+0000 mon.smithi033 (mon.0) 457 : audit [DBG] from='client.? 172.21.15.33:0/301485480' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:35:59.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:35:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:59.149151+0000 mon.smithi033 (mon.0) 458 : cluster [WRN] Health check update: Degraded data redundancy: 55/357 objects degraded (15.406%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T18:36:00.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:57.604900+0000 mgr.smithi033.apxevf (mgr.14626) 234 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:00.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:57.927299+0000 mgr.smithi033.apxevf (mgr.14626) 235 : audit [DBG] from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:00.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:58.222991+0000 mgr.smithi033.apxevf (mgr.14626) 236 : audit [DBG] from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:00.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:58.589161+0000 mon.smithi033 (mon.0) 456 : audit [DBG] from='client.? 172.21.15.33:0/4128431076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:00.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:58.919730+0000 mon.smithi033 (mon.0) 457 : audit [DBG] from='client.? 172.21.15.33:0/301485480' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:36:00.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:35:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:59.149151+0000 mon.smithi033 (mon.0) 458 : cluster [WRN] Health check update: Degraded data redundancy: 55/357 objects degraded (15.406%), 14 pgs degraded (PG_DEGRADED) 2024-02-15T18:36:00.822 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:35:59.223920+0000 mgr.smithi033.apxevf (mgr.14626) 237 : audit [DBG] from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:00.822 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:35:59.514170+0000 mgr.smithi033.apxevf (mgr.14626) 238 : cluster [DBG] pgmap v168: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T18:36:01.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:35:59.223920+0000 mgr.smithi033.apxevf (mgr.14626) 237 : audit [DBG] from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:01.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:35:59.514170+0000 mgr.smithi033.apxevf (mgr.14626) 238 : cluster [DBG] pgmap v168: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T18:36:01.246 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:36:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:36:00.831+0000 7f8bdb415380 -1 osd.5 74 log_to_monitors {default=true} 2024-02-15T18:36:01.996 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:36:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:36:01.595+0000 7f8bcc8fc700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-15T18:36:01.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:00.835309+0000 mon.smithi131 (mon.1) 6 : audit [INF] from='osd.5 [v2:172.21.15.131:6816/1938605794,v1:172.21.15.131:6817/1938605794]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:36:01.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:00.835869+0000 mon.smithi033 (mon.0) 459 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:36:02.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:00.835309+0000 mon.smithi131 (mon.1) 6 : audit [INF] from='osd.5 [v2:172.21.15.131:6816/1938605794,v1:172.21.15.131:6817/1938605794]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:36:02.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:00.835869+0000 mon.smithi033 (mon.0) 459 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-15T18:36:02.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:01.514800+0000 mgr.smithi033.apxevf (mgr.14626) 239 : cluster [DBG] pgmap v169: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T18:36:02.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:01.582672+0000 mon.smithi033 (mon.0) 460 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T18:36:02.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:01.582794+0000 mon.smithi033 (mon.0) 461 : cluster [DBG] osdmap e77: 6 total, 5 up, 6 in 2024-02-15T18:36:02.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:01.587391+0000 mon.smithi131 (mon.1) 7 : audit [INF] from='osd.5 [v2:172.21.15.131:6816/1938605794,v1:172.21.15.131:6817/1938605794]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:36:02.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:01.588053+0000 mon.smithi033 (mon.0) 462 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:36:03.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:01.514800+0000 mgr.smithi033.apxevf (mgr.14626) 239 : cluster [DBG] pgmap v169: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 312 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-02-15T18:36:03.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:01.582672+0000 mon.smithi033 (mon.0) 460 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-15T18:36:03.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:01.582794+0000 mon.smithi033 (mon.0) 461 : cluster [DBG] osdmap e77: 6 total, 5 up, 6 in 2024-02-15T18:36:03.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:01.587391+0000 mon.smithi131 (mon.1) 7 : audit [INF] from='osd.5 [v2:172.21.15.131:6816/1938605794,v1:172.21.15.131:6817/1938605794]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:36:03.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:01.588053+0000 mon.smithi033 (mon.0) 462 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-02-15T18:36:03.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:02.580576+0000 mon.smithi033 (mon.0) 463 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:36:03.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:02.587422+0000 mon.smithi033 (mon.0) 464 : cluster [INF] osd.5 [v2:172.21.15.131:6816/1938605794,v1:172.21.15.131:6817/1938605794] boot 2024-02-15T18:36:03.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:02.587480+0000 mon.smithi033 (mon.0) 465 : cluster [DBG] osdmap e78: 6 total, 6 up, 6 in 2024-02-15T18:36:03.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:02.589491+0000 mon.smithi033 (mon.0) 466 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:36:03.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:02.764698+0000 mon.smithi033 (mon.0) 467 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:03.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:03.586720+0000 mon.smithi033 (mon.0) 468 : cluster [DBG] osdmap e79: 6 total, 6 up, 6 in 2024-02-15T18:36:03.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:02.580576+0000 mon.smithi033 (mon.0) 463 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-15T18:36:03.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:02.587422+0000 mon.smithi033 (mon.0) 464 : cluster [INF] osd.5 [v2:172.21.15.131:6816/1938605794,v1:172.21.15.131:6817/1938605794] boot 2024-02-15T18:36:03.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:02.587480+0000 mon.smithi033 (mon.0) 465 : cluster [DBG] osdmap e78: 6 total, 6 up, 6 in 2024-02-15T18:36:03.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:02.589491+0000 mon.smithi033 (mon.0) 466 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-15T18:36:03.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:02.764698+0000 mon.smithi033 (mon.0) 467 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:03.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:03.586720+0000 mon.smithi033 (mon.0) 468 : cluster [DBG] osdmap e79: 6 total, 6 up, 6 in 2024-02-15T18:36:04.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:03.515540+0000 mgr.smithi033.apxevf (mgr.14626) 240 : cluster [DBG] pgmap v172: 65 pgs: 2 peering, 13 active+undersized+degraded, 13 active+undersized, 37 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51/357 objects degraded (14.286%) 2024-02-15T18:36:04.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:04.150355+0000 mon.smithi033 (mon.0) 469 : cluster [WRN] Health check update: Degraded data redundancy: 51/357 objects degraded (14.286%), 13 pgs degraded (PG_DEGRADED) 2024-02-15T18:36:05.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:03.515540+0000 mgr.smithi033.apxevf (mgr.14626) 240 : cluster [DBG] pgmap v172: 65 pgs: 2 peering, 13 active+undersized+degraded, 13 active+undersized, 37 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51/357 objects degraded (14.286%) 2024-02-15T18:36:05.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:04.150355+0000 mon.smithi033 (mon.0) 469 : cluster [WRN] Health check update: Degraded data redundancy: 51/357 objects degraded (14.286%), 13 pgs degraded (PG_DEGRADED) 2024-02-15T18:36:05.912 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:05 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:05.516022+0000 mgr.smithi033.apxevf (mgr.14626) 241 : cluster [DBG] pgmap v174: 65 pgs: 5 peering, 10 active+undersized+degraded, 10 active+undersized, 40 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s; 44/357 objects degraded (12.325%) 2024-02-15T18:36:05.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:05 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:05.516022+0000 mgr.smithi033.apxevf (mgr.14626) 241 : cluster [DBG] pgmap v174: 65 pgs: 5 peering, 10 active+undersized+degraded, 10 active+undersized, 40 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s; 44/357 objects degraded (12.325%) 2024-02-15T18:36:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:06.609494+0000 mon.smithi033 (mon.0) 470 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:stopping} 2 up:standby 2024-02-15T18:36:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:06.934257+0000 mon.smithi033 (mon.0) 471 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:07.227254+0000 mon.smithi033 (mon.0) 472 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:07.228224+0000 mon.smithi033 (mon.0) 473 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:07.229023+0000 mgr.smithi033.apxevf (mgr.14626) 242 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:07.233432+0000 mon.smithi033 (mon.0) 474 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:07.239856+0000 mon.smithi033 (mon.0) 475 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:07.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:07.242625+0000 mon.smithi033 (mon.0) 476 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:07.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:07.244162+0000 mon.smithi033 (mon.0) 477 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:07.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:07.245600+0000 mon.smithi033 (mon.0) 478 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:07.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:07.247418+0000 mon.smithi033 (mon.0) 479 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:07.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:07.249108+0000 mgr.smithi033.apxevf (mgr.14626) 243 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:36:07.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:07.516682+0000 mgr.smithi033.apxevf (mgr.14626) 244 : cluster [DBG] pgmap v175: 65 pgs: 5 peering, 60 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s wr, 0 op/s; 29 B/s, 0 objects/s recovering 2024-02-15T18:36:08.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:06.609494+0000 mon.smithi033 (mon.0) 470 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi131.ywlevz=up:active,1=cephfs.smithi131.bgnwzs=up:stopping} 2 up:standby 2024-02-15T18:36:08.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:06.934257+0000 mon.smithi033 (mon.0) 471 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:08.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:07.227254+0000 mon.smithi033 (mon.0) 472 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:08.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:07.228224+0000 mon.smithi033 (mon.0) 473 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:07.229023+0000 mgr.smithi033.apxevf (mgr.14626) 242 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:07.233432+0000 mon.smithi033 (mon.0) 474 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:07.239856+0000 mon.smithi033 (mon.0) 475 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:07.242625+0000 mon.smithi033 (mon.0) 476 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:07.244162+0000 mon.smithi033 (mon.0) 477 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:07.245600+0000 mon.smithi033 (mon.0) 478 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:07.247418+0000 mon.smithi033 (mon.0) 479 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:07.249108+0000 mgr.smithi033.apxevf (mgr.14626) 243 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:36:08.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:07.516682+0000 mgr.smithi033.apxevf (mgr.14626) 244 : cluster [DBG] pgmap v175: 65 pgs: 5 peering, 60 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s wr, 0 op/s; 29 B/s, 0 objects/s recovering 2024-02-15T18:36:08.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:08.231182+0000 mon.smithi033 (mon.0) 480 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/357 objects degraded (12.325%), 10 pgs degraded) 2024-02-15T18:36:09.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:08.231182+0000 mon.smithi033 (mon.0) 480 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/357 objects degraded (12.325%), 10 pgs degraded) 2024-02-15T18:36:10.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:09.517091+0000 mgr.smithi033.apxevf (mgr.14626) 245 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s wr, 0 op/s; 22 B/s, 0 objects/s recovering 2024-02-15T18:36:10.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:09.517091+0000 mgr.smithi033.apxevf (mgr.14626) 245 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s wr, 0 op/s; 22 B/s, 0 objects/s recovering 2024-02-15T18:36:12.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:11.517527+0000 mgr.smithi033.apxevf (mgr.14626) 246 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 114 B/s rd, 2.1 KiB/s wr, 1 op/s; 20 B/s, 0 objects/s recovering 2024-02-15T18:36:13.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:11.517527+0000 mgr.smithi033.apxevf (mgr.14626) 246 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 114 B/s rd, 2.1 KiB/s wr, 1 op/s; 20 B/s, 0 objects/s recovering 2024-02-15T18:36:13.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:12.655883+0000 mon.smithi033 (mon.0) 481 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:13.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:12.773820+0000 mon.smithi033 (mon.0) 482 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:13.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:13.518006+0000 mgr.smithi033.apxevf (mgr.14626) 247 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 102 B/s rd, 1.9 KiB/s wr, 1 op/s; 17 B/s, 0 objects/s recovering 2024-02-15T18:36:13.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:12.655883+0000 mon.smithi033 (mon.0) 481 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:13.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:12.773820+0000 mon.smithi033 (mon.0) 482 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:13.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:13.518006+0000 mgr.smithi033.apxevf (mgr.14626) 247 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 102 B/s rd, 1.9 KiB/s wr, 1 op/s; 17 B/s, 0 objects/s recovering 2024-02-15T18:36:16.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:15.518530+0000 mgr.smithi033.apxevf (mgr.14626) 248 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.9 KiB/s wr, 1 op/s; 15 B/s, 0 objects/s recovering 2024-02-15T18:36:17.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:15.518530+0000 mgr.smithi033.apxevf (mgr.14626) 248 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.9 KiB/s wr, 1 op/s; 15 B/s, 0 objects/s recovering 2024-02-15T18:36:17.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:17.259962+0000 mon.smithi033 (mon.0) 483 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:17.261926+0000 mon.smithi033 (mon.0) 484 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:17.262905+0000 mon.smithi033 (mon.0) 485 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:17.268434+0000 mon.smithi033 (mon.0) 486 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:17.274596+0000 mon.smithi033 (mon.0) 487 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:17.277266+0000 mon.smithi033 (mon.0) 488 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:17.278693+0000 mon.smithi033 (mon.0) 489 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:17.280112+0000 mon.smithi033 (mon.0) 490 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:17.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:17.282014+0000 mon.smithi033 (mon.0) 491 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:17.259962+0000 mon.smithi033 (mon.0) 483 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:17.261926+0000 mon.smithi033 (mon.0) 484 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:17.262905+0000 mon.smithi033 (mon.0) 485 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:17.268434+0000 mon.smithi033 (mon.0) 486 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:17.274596+0000 mon.smithi033 (mon.0) 487 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:17.277266+0000 mon.smithi033 (mon.0) 488 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:17.278693+0000 mon.smithi033 (mon.0) 489 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:17.280112+0000 mon.smithi033 (mon.0) 490 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:18.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:17.282014+0000 mon.smithi033 (mon.0) 491 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:18.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:17.263800+0000 mgr.smithi033.apxevf (mgr.14626) 249 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:18.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:17.283680+0000 mgr.smithi033.apxevf (mgr.14626) 250 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:36:18.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:17.519104+0000 mgr.smithi033.apxevf (mgr.14626) 251 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.9 KiB/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-02-15T18:36:19.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:17.263800+0000 mgr.smithi033.apxevf (mgr.14626) 249 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:19.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:17.283680+0000 mgr.smithi033.apxevf (mgr.14626) 250 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:36:19.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:17.519104+0000 mgr.smithi033.apxevf (mgr.14626) 251 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.9 KiB/s wr, 2 op/s; 14 B/s, 0 objects/s recovering 2024-02-15T18:36:20.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:19.519720+0000 mgr.smithi033.apxevf (mgr.14626) 252 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-15T18:36:20.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:19.519720+0000 mgr.smithi033.apxevf (mgr.14626) 252 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-15T18:36:22.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:21.520118+0000 mgr.smithi033.apxevf (mgr.14626) 253 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.5 KiB/s wr, 6 op/s 2024-02-15T18:36:23.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:21.520118+0000 mgr.smithi033.apxevf (mgr.14626) 253 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 1.5 KiB/s wr, 6 op/s 2024-02-15T18:36:24.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:23.520664+0000 mgr.smithi033.apxevf (mgr.14626) 254 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 228 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 7 op/s 2024-02-15T18:36:25.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:23.520664+0000 mgr.smithi033.apxevf (mgr.14626) 254 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 228 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 7 op/s 2024-02-15T18:36:26.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:25.521157+0000 mgr.smithi033.apxevf (mgr.14626) 255 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-02-15T18:36:27.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:25.521157+0000 mgr.smithi033.apxevf (mgr.14626) 255 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-02-15T18:36:27.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:27.294369+0000 mon.smithi033 (mon.0) 492 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:28.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:27 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:27.294369+0000 mon.smithi033 (mon.0) 492 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:28.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:27.521643+0000 mgr.smithi033.apxevf (mgr.14626) 256 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-02-15T18:36:28.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:27.608690+0000 mon.smithi033 (mon.0) 493 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:28.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:27.609341+0000 mon.smithi033 (mon.0) 494 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:28.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:27.613900+0000 mon.smithi033 (mon.0) 495 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:28.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:27.618608+0000 mon.smithi033 (mon.0) 496 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:28.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:27.620621+0000 mon.smithi033 (mon.0) 497 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:28.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:27.621684+0000 mon.smithi033 (mon.0) 498 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:28.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:27.622681+0000 mon.smithi033 (mon.0) 499 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:28.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:27.624340+0000 mon.smithi033 (mon.0) 500 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:27.521643+0000 mgr.smithi033.apxevf (mgr.14626) 256 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-02-15T18:36:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:27.608690+0000 mon.smithi033 (mon.0) 493 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:27.609341+0000 mon.smithi033 (mon.0) 494 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:27.613900+0000 mon.smithi033 (mon.0) 495 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:27.618608+0000 mon.smithi033 (mon.0) 496 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:27.620621+0000 mon.smithi033 (mon.0) 497 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:27.621684+0000 mon.smithi033 (mon.0) 498 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:27.622681+0000 mon.smithi033 (mon.0) 499 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:29.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:27.624340+0000 mon.smithi033 (mon.0) 500 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.341+0000 7f5dc5726700 1 -- 172.21.15.33:0/4115856362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f77e0 msgr2=0x7f5dc00f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.341+0000 7f5dc5726700 1 --2- 172.21.15.33:0/4115856362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f77e0 0x7f5dc00f7c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f5da8004660 tx=0x7f5da8009b30).stop 2024-02-15T18:36:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.341+0000 7f5dc5726700 1 -- 172.21.15.33:0/4115856362 shutdown_connections 2024-02-15T18:36:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.341+0000 7f5dc5726700 1 --2- 172.21.15.33:0/4115856362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f77e0 0x7f5dc00f7c40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.341+0000 7f5dc5726700 1 --2- 172.21.15.33:0/4115856362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc00f6540 0x7f5dc00f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.341+0000 7f5dc5726700 1 -- 172.21.15.33:0/4115856362 >> 172.21.15.33:0/4115856362 conn(0x7f5dc00f1ca0 msgr2=0x7f5dc00f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.341+0000 7f5dc5726700 1 -- 172.21.15.33:0/4115856362 shutdown_connections 2024-02-15T18:36:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.341+0000 7f5dc5726700 1 -- 172.21.15.33:0/4115856362 wait complete. 2024-02-15T18:36:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dc5726700 1 Processor -- start 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dc5726700 1 -- start start 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dc5726700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f6540 0x7f5dc006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dc5726700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc00f77e0 0x7f5dc0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dc5726700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc006a380 con 0x7f5dc00f6540 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dc5726700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc006a4c0 con 0x7f5dc00f77e0 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dbeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f6540 0x7f5dc006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dbeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f6540 0x7f5dc006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43784/0 (socket says 172.21.15.33:43784) 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dbeffd700 1 -- 172.21.15.33:0/2637646928 learned_addr learned my addr 172.21.15.33:0/2637646928 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.342+0000 7f5dbe7fc700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc00f77e0 0x7f5dc0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.343+0000 7f5dbeffd700 1 -- 172.21.15.33:0/2637646928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc00f77e0 msgr2=0x7f5dc0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.343+0000 7f5dbeffd700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc00f77e0 0x7f5dc0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.343+0000 7f5dbeffd700 1 -- 172.21.15.33:0/2637646928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da8005040 con 0x7f5dc00f6540 2024-02-15T18:36:29.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.343+0000 7f5dbeffd700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f6540 0x7f5dc006b9a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f5db0002700 tx=0x7f5db0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.343+0000 7f5db77fe700 1 -- 172.21.15.33:0/2637646928 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5db00079c0 con 0x7f5dc00f6540 2024-02-15T18:36:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.343+0000 7f5db77fe700 1 -- 172.21.15.33:0/2637646928 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f5db000f040 con 0x7f5dc00f6540 2024-02-15T18:36:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.343+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc006a7a0 con 0x7f5dc00f6540 2024-02-15T18:36:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.343+0000 7f5db77fe700 1 -- 172.21.15.33:0/2637646928 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5db0014940 con 0x7f5dc00f6540 2024-02-15T18:36:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.343+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc010edf0 con 0x7f5dc00f6540 2024-02-15T18:36:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.344+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc0045ad0 con 0x7f5dc00f6540 2024-02-15T18:36:29.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.344+0000 7f5db77fe700 1 -- 172.21.15.33:0/2637646928 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f5db001b060 con 0x7f5dc00f6540 2024-02-15T18:36:29.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.345+0000 7f5db77fe700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5dac060f70 0x7f5dac063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:29.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.345+0000 7f5db77fe700 1 -- 172.21.15.33:0/2637646928 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5db007bea0 con 0x7f5dc00f6540 2024-02-15T18:36:29.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.345+0000 7f5dbe7fc700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5dac060f70 0x7f5dac063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:29.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.345+0000 7f5dbe7fc700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5dac060f70 0x7f5dac063430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5da8004630 tx=0x7f5da8009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.349+0000 7f5db77fe700 1 -- 172.21.15.33:0/2637646928 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5db004c3a0 con 0x7f5dc00f6540 2024-02-15T18:36:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.539+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5dc00fef90 con 0x7f5dac060f70 2024-02-15T18:36:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.540+0000 7f5db77fe700 1 -- 172.21.15.33:0/2637646928 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5dc00fef90 con 0x7f5dac060f70 2024-02-15T18:36:29.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5dac060f70 msgr2=0x7f5dac063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5dac060f70 0x7f5dac063430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5da8004630 tx=0x7f5da8009b30).stop 2024-02-15T18:36:29.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f6540 msgr2=0x7f5dc006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f6540 0x7f5dc006b9a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f5db0002700 tx=0x7f5db0009d80).stop 2024-02-15T18:36:29.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 shutdown_connections 2024-02-15T18:36:29.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5dac060f70 0x7f5dac063430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc00f6540 0x7f5dc006b9a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 --2- 172.21.15.33:0/2637646928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dc00f77e0 0x7f5dc0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 >> 172.21.15.33:0/2637646928 conn(0x7f5dc00f1ca0 msgr2=0x7f5dc00fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:29.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 shutdown_connections 2024-02-15T18:36:29.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.542+0000 7f5dc5726700 1 -- 172.21.15.33:0/2637646928 wait complete. 2024-02-15T18:36:29.542 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:36:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.645+0000 7fce254b6700 1 -- 172.21.15.33:0/315347609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 msgr2=0x7fce200f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.645+0000 7fce254b6700 1 --2- 172.21.15.33:0/315347609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 0x7fce200f5a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fce10004660 tx=0x7fce10009b30).stop 2024-02-15T18:36:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.645+0000 7fce254b6700 1 -- 172.21.15.33:0/315347609 shutdown_connections 2024-02-15T18:36:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.645+0000 7fce254b6700 1 --2- 172.21.15.33:0/315347609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200f5ef0 0x7fce200f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.645+0000 7fce254b6700 1 --2- 172.21.15.33:0/315347609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 0x7fce200f5a00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.645+0000 7fce254b6700 1 -- 172.21.15.33:0/315347609 >> 172.21.15.33:0/315347609 conn(0x7fce200f0de0 msgr2=0x7fce200f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.645+0000 7fce254b6700 1 -- 172.21.15.33:0/315347609 shutdown_connections 2024-02-15T18:36:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.645+0000 7fce254b6700 1 -- 172.21.15.33:0/315347609 wait complete. 2024-02-15T18:36:29.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce254b6700 1 Processor -- start 2024-02-15T18:36:29.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce254b6700 1 -- start start 2024-02-15T18:36:29.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce254b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 0x7fce20106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:29.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce254b6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200f5ef0 0x7fce201074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:29.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce254b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce20107a60 con 0x7fce200f55e0 2024-02-15T18:36:29.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce254b6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce20107ba0 con 0x7fce200f5ef0 2024-02-15T18:36:29.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce1effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 0x7fce20106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce1effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 0x7fce20106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43794/0 (socket says 172.21.15.33:43794) 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce1effd700 1 -- 172.21.15.33:0/4179589524 learned_addr learned my addr 172.21.15.33:0/4179589524 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.646+0000 7fce1e7fc700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200f5ef0 0x7fce201074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce1effd700 1 -- 172.21.15.33:0/4179589524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200f5ef0 msgr2=0x7fce201074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce1effd700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200f5ef0 0x7fce201074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce1effd700 1 -- 172.21.15.33:0/4179589524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce10005040 con 0x7fce200f55e0 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce1e7fc700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200f5ef0 0x7fce201074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce1effd700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 0x7fce20106fc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fce10009f50 tx=0x7fce10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce077fe700 1 -- 172.21.15.33:0/4179589524 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce10018070 con 0x7fce200f55e0 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce077fe700 1 -- 172.21.15.33:0/4179589524 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fce10007ba0 con 0x7fce200f55e0 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce201084e0 con 0x7fce200f55e0 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce077fe700 1 -- 172.21.15.33:0/4179589524 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce1001c620 con 0x7fce200f55e0 2024-02-15T18:36:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.647+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce20108a40 con 0x7fce200f55e0 2024-02-15T18:36:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.648+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce20045ad0 con 0x7fce200f55e0 2024-02-15T18:36:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.648+0000 7fce077fe700 1 -- 172.21.15.33:0/4179589524 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fce1001d420 con 0x7fce200f55e0 2024-02-15T18:36:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.649+0000 7fce077fe700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fce08060f20 0x7fce080633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.649+0000 7fce077fe700 1 -- 172.21.15.33:0/4179589524 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fce1007df80 con 0x7fce200f55e0 2024-02-15T18:36:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.649+0000 7fce1e7fc700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fce08060f20 0x7fce080633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.649+0000 7fce1e7fc700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fce08060f20 0x7fce080633e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fce14009740 tx=0x7fce14009be0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.653+0000 7fce077fe700 1 -- 172.21.15.33:0/4179589524 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fce10051e30 con 0x7fce200f55e0 2024-02-15T18:36:29.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.843+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce200fad60 con 0x7fce08060f20 2024-02-15T18:36:29.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.844+0000 7fce077fe700 1 -- 172.21.15.33:0/4179589524 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fce200fad60 con 0x7fce08060f20 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fce08060f20 msgr2=0x7fce080633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fce08060f20 0x7fce080633e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fce14009740 tx=0x7fce14009be0).stop 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 msgr2=0x7fce20106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 0x7fce20106fc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fce10009f50 tx=0x7fce10009b30).stop 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 shutdown_connections 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fce08060f20 0x7fce080633e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce200f55e0 0x7fce20106fc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 --2- 172.21.15.33:0/4179589524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce200f5ef0 0x7fce201074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 >> 172.21.15.33:0/4179589524 conn(0x7fce200f0de0 msgr2=0x7fce2005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 shutdown_connections 2024-02-15T18:36:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.846+0000 7fce254b6700 1 -- 172.21.15.33:0/4179589524 wait complete. 2024-02-15T18:36:29.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.947+0000 7fd126b21700 1 -- 172.21.15.33:0/1520114624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 msgr2=0x7fd1200f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.947+0000 7fd126b21700 1 --2- 172.21.15.33:0/1520114624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 0x7fd1200f6950 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fd11c004660 tx=0x7fd11c009b30).stop 2024-02-15T18:36:29.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.947+0000 7fd126b21700 1 -- 172.21.15.33:0/1520114624 shutdown_connections 2024-02-15T18:36:29.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.947+0000 7fd126b21700 1 --2- 172.21.15.33:0/1520114624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1200f77d0 0x7fd1200f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.947+0000 7fd126b21700 1 --2- 172.21.15.33:0/1520114624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 0x7fd1200f6950 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:29.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.947+0000 7fd126b21700 1 -- 172.21.15.33:0/1520114624 >> 172.21.15.33:0/1520114624 conn(0x7fd1200f1c90 msgr2=0x7fd1200f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:29.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd126b21700 1 -- 172.21.15.33:0/1520114624 shutdown_connections 2024-02-15T18:36:29.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd126b21700 1 -- 172.21.15.33:0/1520114624 wait complete. 2024-02-15T18:36:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd126b21700 1 Processor -- start 2024-02-15T18:36:29.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd126b21700 1 -- start start 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd126b21700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 0x7fd120106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd126b21700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1200f77d0 0x7fd1201073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd126b21700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120107960 con 0x7fd1200f6530 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd126b21700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120108160 con 0x7fd1200f77d0 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd125b1f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 0x7fd120106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd125b1f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 0x7fd120106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43812/0 (socket says 172.21.15.33:43812) 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.948+0000 7fd125b1f700 1 -- 172.21.15.33:0/945867538 learned_addr learned my addr 172.21.15.33:0/945867538 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.949+0000 7fd125b1f700 1 -- 172.21.15.33:0/945867538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1200f77d0 msgr2=0x7fd1201073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.949+0000 7fd125b1f700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1200f77d0 0x7fd1201073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.949+0000 7fd125b1f700 1 -- 172.21.15.33:0/945867538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c005040 con 0x7fd1200f6530 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.949+0000 7fd125b1f700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 0x7fd120106ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd11c004e30 tx=0x7fd11c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:29.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.949+0000 7fd1167fc700 1 -- 172.21.15.33:0/945867538 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd11c018070 con 0x7fd1200f6530 2024-02-15T18:36:29.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.949+0000 7fd1167fc700 1 -- 172.21.15.33:0/945867538 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd11c007ba0 con 0x7fd1200f6530 2024-02-15T18:36:29.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.949+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1201083e0 con 0x7fd1200f6530 2024-02-15T18:36:29.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.949+0000 7fd1167fc700 1 -- 172.21.15.33:0/945867538 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd11c01c620 con 0x7fd1200f6530 2024-02-15T18:36:29.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.949+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd120108940 con 0x7fd1200f6530 2024-02-15T18:36:29.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.950+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd120059100 con 0x7fd1200f6530 2024-02-15T18:36:29.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.950+0000 7fd1167fc700 1 -- 172.21.15.33:0/945867538 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd11c01d9a0 con 0x7fd1200f6530 2024-02-15T18:36:29.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.951+0000 7fd1167fc700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd10c060f70 0x7fd10c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:29.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.951+0000 7fd1167fc700 1 -- 172.21.15.33:0/945867538 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd11c07ddf0 con 0x7fd1200f6530 2024-02-15T18:36:29.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.951+0000 7fd12531e700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd10c060f70 0x7fd10c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:29.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.951+0000 7fd12531e700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd10c060f70 0x7fd10c063430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd110004a10 tx=0x7fd1100099e0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:29.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:29.955+0000 7fd1167fc700 1 -- 172.21.15.33:0/945867538 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd11c051d20 con 0x7fd1200f6530 2024-02-15T18:36:29.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:27.609890+0000 mgr.smithi033.apxevf (mgr.14626) 257 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:29.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:27.625778+0000 mgr.smithi033.apxevf (mgr.14626) 258 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:36:30.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:27.609890+0000 mgr.smithi033.apxevf (mgr.14626) 257 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:30.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:27.625778+0000 mgr.smithi033.apxevf (mgr.14626) 258 : cephadm [INF] Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-02-15T18:36:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.141+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1200fef40 con 0x7fd10c060f70 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.150+0000 7fd1167fc700 1 -- 172.21.15.33:0/945867538 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd1200fef40 con 0x7fd10c060f70 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (11m) 116s ago 13m 19.5M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (3m) 116s ago 13m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (3m) 34s ago 12m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (11m) 116s ago 12m 34.2M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (7m) 116s ago 7m 17.4M - 16.2.4 8d91d370c2b8 e29b26d7820f 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (7m) 116s ago 7m 13.2M - 16.2.4 8d91d370c2b8 27613bcf4796 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (7m) 34s ago 7m 118M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:36:30.141 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (7m) 34s ago 7m 133M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (5m) 116s ago 14m 433M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (4m) 34s ago 12m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (4m) 116s ago 14m 42.0M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (4m) 34s ago 12m 41.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (12m) 116s ago 12m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (11m) 34s ago 11m 17.1M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (3m) 116s ago 11m 196M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (2m) 116s ago 10m 193M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (2m) 116s ago 10m 10.4M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (93s) 34s ago 10m 251M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4030e9f6d6c2 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (65s) 34s ago 9m 244M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 902c89c867aa 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (37s) 34s ago 9m 12.9M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc ba19a3c17a66 2024-02-15T18:36:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (5m) 116s ago 12m 65.6M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd10c060f70 msgr2=0x7fd10c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd10c060f70 0x7fd10c063430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd110004a10 tx=0x7fd1100099e0).stop 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 msgr2=0x7fd120106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 0x7fd120106ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd11c004e30 tx=0x7fd11c009b30).stop 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 shutdown_connections 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd10c060f70 0x7fd10c063430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1200f6530 0x7fd120106ec0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 --2- 172.21.15.33:0/945867538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1200f77d0 0x7fd1201073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 >> 172.21.15.33:0/945867538 conn(0x7fd1200f1c90 msgr2=0x7fd1200fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 shutdown_connections 2024-02-15T18:36:30.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.152+0000 7fd126b21700 1 -- 172.21.15.33:0/945867538 wait complete. 2024-02-15T18:36:30.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.254+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1334216655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 msgr2=0x7fd09c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.254+0000 7fd0a08e9700 1 --2- 172.21.15.33:0/1334216655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 0x7fd09c0f9110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd08c004660 tx=0x7fd08c009b30).stop 2024-02-15T18:36:30.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.254+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1334216655 shutdown_connections 2024-02-15T18:36:30.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.254+0000 7fd0a08e9700 1 --2- 172.21.15.33:0/1334216655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c0f9690 0x7fd09c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.254+0000 7fd0a08e9700 1 --2- 172.21.15.33:0/1334216655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 0x7fd09c0f9110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.254+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1334216655 >> 172.21.15.33:0/1334216655 conn(0x7fd09c0f0b90 msgr2=0x7fd09c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:30.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.254+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1334216655 shutdown_connections 2024-02-15T18:36:30.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.254+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1334216655 wait complete. 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd0a08e9700 1 Processor -- start 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd0a08e9700 1 -- start start 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd0a08e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 0x7fd09c0f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd0a08e9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c0f9690 0x7fd09c0f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd0a08e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0f5570 con 0x7fd09c060310 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd0a08e9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0f56b0 con 0x7fd09c0f9690 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd09ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 0x7fd09c0f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd09ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 0x7fd09c0f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43838/0 (socket says 172.21.15.33:43838) 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd09ad9d700 1 -- 172.21.15.33:0/1145071921 learned_addr learned my addr 172.21.15.33:0/1145071921 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.255+0000 7fd09a59c700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c0f9690 0x7fd09c0f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.256+0000 7fd09ad9d700 1 -- 172.21.15.33:0/1145071921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c0f9690 msgr2=0x7fd09c0f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.256+0000 7fd09ad9d700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c0f9690 0x7fd09c0f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.256+0000 7fd09ad9d700 1 -- 172.21.15.33:0/1145071921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c005040 con 0x7fd09c060310 2024-02-15T18:36:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.256+0000 7fd09ad9d700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 0x7fd09c0f6b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fd08c009f50 tx=0x7fd08c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.256+0000 7fd0837fe700 1 -- 172.21.15.33:0/1145071921 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd08c018070 con 0x7fd09c060310 2024-02-15T18:36:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.256+0000 7fd0837fe700 1 -- 172.21.15.33:0/1145071921 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd08c007ba0 con 0x7fd09c060310 2024-02-15T18:36:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.256+0000 7fd0837fe700 1 -- 172.21.15.33:0/1145071921 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd08c01c420 con 0x7fd09c060310 2024-02-15T18:36:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.256+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c0f5930 con 0x7fd09c060310 2024-02-15T18:36:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.256+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c0f5e10 con 0x7fd09c060310 2024-02-15T18:36:30.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.257+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c045ad0 con 0x7fd09c060310 2024-02-15T18:36:30.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.258+0000 7fd0837fe700 1 -- 172.21.15.33:0/1145071921 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd08c023020 con 0x7fd09c060310 2024-02-15T18:36:30.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.258+0000 7fd0837fe700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd084060f70 0x7fd084063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:30.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.258+0000 7fd0837fe700 1 -- 172.21.15.33:0/1145071921 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd08c07d810 con 0x7fd09c060310 2024-02-15T18:36:30.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.258+0000 7fd09a59c700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd084060f70 0x7fd084063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:30.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.258+0000 7fd09a59c700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd084060f70 0x7fd084063430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd09c0600e0 tx=0x7fd09000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.262+0000 7fd0837fe700 1 -- 172.21.15.33:0/1145071921 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd08c04dc30 con 0x7fd09c060310 2024-02-15T18:36:30.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.504+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd09c0586e0 con 0x7fd09c060310 2024-02-15T18:36:30.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.505+0000 7fd0837fe700 1 -- 172.21.15.33:0/1145071921 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7fd08c051250 con 0x7fd09c060310 2024-02-15T18:36:30.495 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:36:30.495 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:36:30.495 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:36:30.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:36:30.495 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 10, 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:36:30.496 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:36:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.506+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd084060f70 msgr2=0x7fd084063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.506+0000 7fd0a08e9700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd084060f70 0x7fd084063430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd09c0600e0 tx=0x7fd09000b040).stop 2024-02-15T18:36:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.507+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 msgr2=0x7fd09c0f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.507+0000 7fd0a08e9700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 0x7fd09c0f6b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fd08c009f50 tx=0x7fd08c009b30).stop 2024-02-15T18:36:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.507+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 shutdown_connections 2024-02-15T18:36:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.507+0000 7fd0a08e9700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd084060f70 0x7fd084063430 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.507+0000 7fd0a08e9700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd09c060310 0x7fd09c0f6b90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.507+0000 7fd0a08e9700 1 --2- 172.21.15.33:0/1145071921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd09c0f9690 0x7fd09c0f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.507+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 >> 172.21.15.33:0/1145071921 conn(0x7fd09c0f0b90 msgr2=0x7fd09c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.507+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 shutdown_connections 2024-02-15T18:36:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.507+0000 7fd0a08e9700 1 -- 172.21.15.33:0/1145071921 wait complete. 2024-02-15T18:36:30.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 -- 172.21.15.33:0/3560261952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 msgr2=0x7f79500f9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 --2- 172.21.15.33:0/3560261952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 0x7f79500f9fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f793c004660 tx=0x7f793c009b30).stop 2024-02-15T18:36:30.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 -- 172.21.15.33:0/3560261952 shutdown_connections 2024-02-15T18:36:30.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 --2- 172.21.15.33:0/3560261952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 0x7f79500f9fe0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 --2- 172.21.15.33:0/3560261952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79500f88e0 0x7f79500f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 -- 172.21.15.33:0/3560261952 >> 172.21.15.33:0/3560261952 conn(0x7f79500f40e0 msgr2=0x7f79500f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:30.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 -- 172.21.15.33:0/3560261952 shutdown_connections 2024-02-15T18:36:30.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 -- 172.21.15.33:0/3560261952 wait complete. 2024-02-15T18:36:30.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 Processor -- start 2024-02-15T18:36:30.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.609+0000 7f79571b4700 1 -- start start 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f79571b4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79500f88e0 0x7f79501091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f79571b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 0x7f79501096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f79571b4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7950109c70 con 0x7f79500f9b80 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f79571b4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7950109db0 con 0x7f79500f88e0 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 0x7f79501096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 0x7f79501096c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43858/0 (socket says 172.21.15.33:43858) 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794ffff700 1 -- 172.21.15.33:0/108320509 learned_addr learned my addr 172.21.15.33:0/108320509 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f7954f50700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79500f88e0 0x7f79501091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794ffff700 1 -- 172.21.15.33:0/108320509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79500f88e0 msgr2=0x7f79501091d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794ffff700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79500f88e0 0x7f79501091d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794ffff700 1 -- 172.21.15.33:0/108320509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c005040 con 0x7f79500f9b80 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f7954f50700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79500f88e0 0x7f79501091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794ffff700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 0x7f79501096c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f793c009f50 tx=0x7f793c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794d7fa700 1 -- 172.21.15.33:0/108320509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f793c018070 con 0x7f79500f9b80 2024-02-15T18:36:30.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794d7fa700 1 -- 172.21.15.33:0/108320509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f793c007ba0 con 0x7f79500f9b80 2024-02-15T18:36:30.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795010a6f0 con 0x7f79500f9b80 2024-02-15T18:36:30.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f794d7fa700 1 -- 172.21.15.33:0/108320509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f793c01c620 con 0x7f79500f9b80 2024-02-15T18:36:30.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.610+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795010ac50 con 0x7f79500f9b80 2024-02-15T18:36:30.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.611+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7950045ad0 con 0x7f79500f9b80 2024-02-15T18:36:30.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.612+0000 7f794d7fa700 1 -- 172.21.15.33:0/108320509 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f793c01d420 con 0x7f79500f9b80 2024-02-15T18:36:30.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.612+0000 7f794d7fa700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7940060f20 0x7f79400633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:30.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.612+0000 7f794d7fa700 1 -- 172.21.15.33:0/108320509 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f793c07dec0 con 0x7f79500f9b80 2024-02-15T18:36:30.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.612+0000 7f7954f50700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7940060f20 0x7f79400633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:30.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.612+0000 7f7954f50700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7940060f20 0x7f79400633e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f79500f99e0 tx=0x7f7944009c00).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:30.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.616+0000 7f794d7fa700 1 -- 172.21.15.33:0/108320509 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f793c051d90 con 0x7f79500f9b80 2024-02-15T18:36:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.835+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7950027a00 con 0x7f79500f9b80 2024-02-15T18:36:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.835+0000 7f794d7fa700 1 -- 172.21.15.33:0/108320509 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1816 (secure 0 0 0) 0x7f793c051980 con 0x7f79500f9b80 2024-02-15T18:36:30.826 INFO:teuthology.orchestra.run.smithi033.stdout:e24 2024-02-15T18:36:30.826 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:36:30.826 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:36:30.826 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:36:30.826 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:36:30.826 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 24 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:36:06.605483+0000 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:36:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255,1=24271} 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{1:24271} state up:stopping seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:36:30.828 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:36:30.829 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:36:30.829 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:36:30.829 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:14446} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/1297796613,v1:172.21.15.33:6829/1297796613] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:36:30.829 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:14486} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6826/737113278,v1:172.21.15.33:6827/737113278] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:36:30.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7940060f20 msgr2=0x7f79400633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7940060f20 0x7f79400633e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f79500f99e0 tx=0x7f7944009c00).stop 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 msgr2=0x7f79501096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 0x7f79501096c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f793c009f50 tx=0x7f793c009b30).stop 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 shutdown_connections 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f7940060f20 0x7f79400633e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79500f88e0 0x7f79501091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 --2- 172.21.15.33:0/108320509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79500f9b80 0x7f79501096c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 >> 172.21.15.33:0/108320509 conn(0x7f79500f40e0 msgr2=0x7f79500fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 shutdown_connections 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.837+0000 7f79571b4700 1 -- 172.21.15.33:0/108320509 wait complete. 2024-02-15T18:36:30.830 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-02-15T18:36:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.939+0000 7fd861bba700 1 -- 172.21.15.33:0/3189124673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f6530 msgr2=0x7fd85c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.939+0000 7fd861bba700 1 --2- 172.21.15.33:0/3189124673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f6530 0x7fd85c0f6950 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd8580099e0 tx=0x7fd858004d10).stop 2024-02-15T18:36:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.939+0000 7fd861bba700 1 -- 172.21.15.33:0/3189124673 shutdown_connections 2024-02-15T18:36:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.939+0000 7fd861bba700 1 --2- 172.21.15.33:0/3189124673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85c0f77d0 0x7fd85c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.939+0000 7fd861bba700 1 --2- 172.21.15.33:0/3189124673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f6530 0x7fd85c0f6950 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.939+0000 7fd861bba700 1 -- 172.21.15.33:0/3189124673 >> 172.21.15.33:0/3189124673 conn(0x7fd85c0f1c90 msgr2=0x7fd85c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:30.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.939+0000 7fd861bba700 1 -- 172.21.15.33:0/3189124673 shutdown_connections 2024-02-15T18:36:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.939+0000 7fd861bba700 1 -- 172.21.15.33:0/3189124673 wait complete. 2024-02-15T18:36:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.940+0000 7fd861bba700 1 Processor -- start 2024-02-15T18:36:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.940+0000 7fd861bba700 1 -- start start 2024-02-15T18:36:30.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.940+0000 7fd861bba700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85c0f6530 0x7fd85c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:30.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.940+0000 7fd861bba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f77d0 0x7fd85c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:30.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.940+0000 7fd861bba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c06a380 con 0x7fd85c0f77d0 2024-02-15T18:36:30.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.940+0000 7fd861bba700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c06a4c0 con 0x7fd85c0f6530 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.940+0000 7fd853fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f77d0 0x7fd85c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.940+0000 7fd853fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f77d0 0x7fd85c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43876/0 (socket says 172.21.15.33:43876) 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.940+0000 7fd853fff700 1 -- 172.21.15.33:0/1660128843 learned_addr learned my addr 172.21.15.33:0/1660128843 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd860bb8700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85c0f6530 0x7fd85c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd853fff700 1 -- 172.21.15.33:0/1660128843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85c0f6530 msgr2=0x7fd85c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd853fff700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85c0f6530 0x7fd85c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd853fff700 1 -- 172.21.15.33:0/1660128843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd858009640 con 0x7fd85c0f77d0 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd853fff700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f77d0 0x7fd85c069e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd84c00c530 tx=0x7fd84c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd8517fa700 1 -- 172.21.15.33:0/1660128843 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84c00f650 con 0x7fd85c0f77d0 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd8517fa700 1 -- 172.21.15.33:0/1660128843 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd84c00fca0 con 0x7fd85c0f77d0 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c06a7a0 con 0x7fd85c0f77d0 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd8517fa700 1 -- 172.21.15.33:0/1660128843 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84c012e10 con 0x7fd85c0f77d0 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.941+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c10eff0 con 0x7fd85c0f77d0 2024-02-15T18:36:30.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.942+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c059100 con 0x7fd85c0f77d0 2024-02-15T18:36:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.943+0000 7fd8517fa700 1 -- 172.21.15.33:0/1660128843 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd84c010070 con 0x7fd85c0f77d0 2024-02-15T18:36:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.943+0000 7fd8517fa700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd844060f70 0x7fd844063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:36:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.943+0000 7fd8517fa700 1 -- 172.21.15.33:0/1660128843 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd84c07bdc0 con 0x7fd85c0f77d0 2024-02-15T18:36:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.943+0000 7fd860bb8700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd844060f70 0x7fd844063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:36:30.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.944+0000 7fd860bb8700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd844060f70 0x7fd844063430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd858005010 tx=0x7fd858004d10).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:36:30.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:30.947+0000 7fd8517fa700 1 -- 172.21.15.33:0/1660128843 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd84c047f60 con 0x7fd85c0f77d0 2024-02-15T18:36:30.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:29.522098+0000 mgr.smithi033.apxevf (mgr.14626) 259 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 7 op/s 2024-02-15T18:36:30.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:29.540546+0000 mgr.smithi033.apxevf (mgr.14626) 260 : audit [DBG] from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:30.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:30.505425+0000 mon.smithi033 (mon.0) 501 : audit [DBG] from='client.? 172.21.15.33:0/1145071921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:31.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:29.522098+0000 mgr.smithi033.apxevf (mgr.14626) 259 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 7 op/s 2024-02-15T18:36:31.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:29.540546+0000 mgr.smithi033.apxevf (mgr.14626) 260 : audit [DBG] from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:31.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:30.505425+0000 mon.smithi033 (mon.0) 501 : audit [DBG] from='client.? 172.21.15.33:0/1145071921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.138+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd85c0feec0 con 0x7fd844060f70 2024-02-15T18:36:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.139+0000 7fd8517fa700 1 -- 172.21.15.33:0/1660128843 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd85c0feec0 con 0x7fd844060f70 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "osd", 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "12/21 daemons upgraded", 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading osd daemons", 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:36:31.130 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:36:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd844060f70 msgr2=0x7fd844063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd844060f70 0x7fd844063430 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd858005010 tx=0x7fd858004d10).stop 2024-02-15T18:36:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f77d0 msgr2=0x7fd85c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:36:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f77d0 0x7fd85c069e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd84c00c530 tx=0x7fd84c007e20).stop 2024-02-15T18:36:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 shutdown_connections 2024-02-15T18:36:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd844060f70 0x7fd844063430 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd85c0f6530 0x7fd85c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 --2- 172.21.15.33:0/1660128843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd85c0f77d0 0x7fd85c069e20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:36:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 >> 172.21.15.33:0/1660128843 conn(0x7fd85c0f1c90 msgr2=0x7fd85c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:36:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 shutdown_connections 2024-02-15T18:36:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:36:31.141+0000 7fd861bba700 1 -- 172.21.15.33:0/1660128843 wait complete. 2024-02-15T18:36:31.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:29.844928+0000 mgr.smithi033.apxevf (mgr.14626) 261 : audit [DBG] from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:31.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:30.142400+0000 mgr.smithi033.apxevf (mgr.14626) 262 : audit [DBG] from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:31.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:30.836427+0000 mon.smithi033 (mon.0) 502 : audit [DBG] from='client.? 172.21.15.33:0/108320509' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:36:31.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:31.021092+0000 mon.smithi033 (mon.0) 503 : cluster [INF] daemon mds.cephfs.smithi131.bgnwzs finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-02-15T18:36:32.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:29.844928+0000 mgr.smithi033.apxevf (mgr.14626) 261 : audit [DBG] from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:32.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:30.142400+0000 mgr.smithi033.apxevf (mgr.14626) 262 : audit [DBG] from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:32.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:30.836427+0000 mon.smithi033 (mon.0) 502 : audit [DBG] from='client.? 172.21.15.33:0/108320509' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:36:32.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:31.021092+0000 mon.smithi033 (mon.0) 503 : cluster [INF] daemon mds.cephfs.smithi131.bgnwzs finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-02-15T18:36:32.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:31.139525+0000 mgr.smithi033.apxevf (mgr.14626) 263 : audit [DBG] from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:32.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:31.522573+0000 mgr.smithi033.apxevf (mgr.14626) 264 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 6 op/s 2024-02-15T18:36:32.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:31.599507+0000 mon.smithi033 (mon.0) 504 : cluster [DBG] mds.1 [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] down:stopped 2024-02-15T18:36:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:31.599555+0000 mon.smithi033 (mon.0) 505 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2 up:standby 2024-02-15T18:36:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:31.139525+0000 mgr.smithi033.apxevf (mgr.14626) 263 : audit [DBG] from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:36:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:31.522573+0000 mgr.smithi033.apxevf (mgr.14626) 264 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 6 op/s 2024-02-15T18:36:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:31.599507+0000 mon.smithi033 (mon.0) 504 : cluster [DBG] mds.1 [v2:172.21.15.131:6826/3549169411,v1:172.21.15.131:6827/3549169411] down:stopped 2024-02-15T18:36:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:31.599555+0000 mon.smithi033 (mon.0) 505 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2 up:standby 2024-02-15T18:36:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:32.601613+0000 mon.smithi033 (mon.0) 506 : cluster [DBG] mds.? [v2:172.21.15.131:6826/112791917,v1:172.21.15.131:6827/112791917] up:boot 2024-02-15T18:36:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:32.601693+0000 mon.smithi033 (mon.0) 507 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 3 up:standby 2024-02-15T18:36:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:32.602064+0000 mon.smithi033 (mon.0) 508 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:36:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:33.523033+0000 mgr.smithi033.apxevf (mgr.14626) 265 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-02-15T18:36:33.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:32.601613+0000 mon.smithi033 (mon.0) 506 : cluster [DBG] mds.? [v2:172.21.15.131:6826/112791917,v1:172.21.15.131:6827/112791917] up:boot 2024-02-15T18:36:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:32.601693+0000 mon.smithi033 (mon.0) 507 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 3 up:standby 2024-02-15T18:36:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:32.602064+0000 mon.smithi033 (mon.0) 508 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:36:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:33.523033+0000 mgr.smithi033.apxevf (mgr.14626) 265 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 3 op/s 2024-02-15T18:36:36.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:35.523541+0000 mgr.smithi033.apxevf (mgr.14626) 266 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 1 op/s 2024-02-15T18:36:37.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:35.523541+0000 mgr.smithi033.apxevf (mgr.14626) 266 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 1 op/s 2024-02-15T18:36:38.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:37.524171+0000 mgr.smithi033.apxevf (mgr.14626) 267 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 1 op/s 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.636290+0000 mon.smithi033 (mon.0) 509 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.638276+0000 mon.smithi033 (mon.0) 510 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.639153+0000 mon.smithi033 (mon.0) 511 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.645834+0000 mon.smithi033 (mon.0) 512 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.651980+0000 mon.smithi033 (mon.0) 513 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.654589+0000 mon.smithi033 (mon.0) 514 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.656013+0000 mon.smithi033 (mon.0) 515 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.657368+0000 mon.smithi033 (mon.0) 516 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.659135+0000 mon.smithi033 (mon.0) 517 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:38.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:37.661010+0000 mon.smithi033 (mon.0) 518 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi033.qszefh"]}]: dispatch 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:37.524171+0000 mgr.smithi033.apxevf (mgr.14626) 267 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 1 op/s 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.636290+0000 mon.smithi033 (mon.0) 509 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.638276+0000 mon.smithi033 (mon.0) 510 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.639153+0000 mon.smithi033 (mon.0) 511 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.645834+0000 mon.smithi033 (mon.0) 512 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.651980+0000 mon.smithi033 (mon.0) 513 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.654589+0000 mon.smithi033 (mon.0) 514 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.656013+0000 mon.smithi033 (mon.0) 515 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.657368+0000 mon.smithi033 (mon.0) 516 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.659135+0000 mon.smithi033 (mon.0) 517 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:38.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:37.661010+0000 mon.smithi033 (mon.0) 518 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi033.qszefh"]}]: dispatch 2024-02-15T18:36:39.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:37.639896+0000 mgr.smithi033.apxevf (mgr.14626) 268 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:39.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:37.661605+0000 mgr.smithi033.apxevf (mgr.14626) 269 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi033.qszefh 2024-02-15T18:36:39.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:39.347490+0000 mon.smithi033 (mon.0) 519 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:39.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:39.348333+0000 mon.smithi033 (mon.0) 520 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.qszefh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:36:39.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:39.349090+0000 mon.smithi033 (mon.0) 521 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:39.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:37.639896+0000 mgr.smithi033.apxevf (mgr.14626) 268 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:39.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:37.661605+0000 mgr.smithi033.apxevf (mgr.14626) 269 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi033.qszefh 2024-02-15T18:36:39.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:39.347490+0000 mon.smithi033 (mon.0) 519 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:39.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:39.348333+0000 mon.smithi033 (mon.0) 520 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.qszefh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:36:39.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:39.349090+0000 mon.smithi033 (mon.0) 521 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:40.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:39.342916+0000 mgr.smithi033.apxevf (mgr.14626) 270 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi033.qszefh 2024-02-15T18:36:40.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:39.349766+0000 mgr.smithi033.apxevf (mgr.14626) 271 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.qszefh on smithi033 2024-02-15T18:36:40.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:39.524546+0000 mgr.smithi033.apxevf (mgr.14626) 272 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:40.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:39.342916+0000 mgr.smithi033.apxevf (mgr.14626) 270 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi033.qszefh 2024-02-15T18:36:40.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:39.349766+0000 mgr.smithi033.apxevf (mgr.14626) 271 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.qszefh on smithi033 2024-02-15T18:36:40.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:39.524546+0000 mgr.smithi033.apxevf (mgr.14626) 272 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:42.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:41.151085+0000 mon.smithi033 (mon.0) 522 : cluster [DBG] osdmap e80: 6 total, 6 up, 6 in 2024-02-15T18:36:42.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:41.524977+0000 mgr.smithi033.apxevf (mgr.14626) 273 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:42.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:41.591719+0000 mon.smithi033 (mon.0) 523 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2 up:standby 2024-02-15T18:36:42.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:41.151085+0000 mon.smithi033 (mon.0) 522 : cluster [DBG] osdmap e80: 6 total, 6 up, 6 in 2024-02-15T18:36:42.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:41.524977+0000 mgr.smithi033.apxevf (mgr.14626) 273 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:42.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:41.591719+0000 mon.smithi033 (mon.0) 523 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2 up:standby 2024-02-15T18:36:43.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:43.481709+0000 mon.smithi033 (mon.0) 524 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:36:43.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:43.481709+0000 mon.smithi033 (mon.0) 524 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:36:44.907 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:43.525448+0000 mgr.smithi033.apxevf (mgr.14626) 274 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:44.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:43.525448+0000 mgr.smithi033.apxevf (mgr.14626) 274 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:45.525833+0000 mgr.smithi033.apxevf (mgr.14626) 275 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:46.559178+0000 mon.smithi033 (mon.0) 525 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:46.559897+0000 mon.smithi033 (mon.0) 526 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:46.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:45.525833+0000 mgr.smithi033.apxevf (mgr.14626) 275 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:46.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:46.559178+0000 mon.smithi033 (mon.0) 525 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:46.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:46.559897+0000 mon.smithi033 (mon.0) 526 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:47.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:46.585182+0000 mon.smithi033 (mon.0) 527 : cluster [DBG] mds.? [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] up:boot 2024-02-15T18:36:47.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:46.585222+0000 mon.smithi033 (mon.0) 528 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 3 up:standby 2024-02-15T18:36:47.583 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:46.585558+0000 mon.smithi033 (mon.0) 529 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:36:47.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:46.585182+0000 mon.smithi033 (mon.0) 527 : cluster [DBG] mds.? [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] up:boot 2024-02-15T18:36:47.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:46.585222+0000 mon.smithi033 (mon.0) 528 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 3 up:standby 2024-02-15T18:36:47.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:46.585558+0000 mon.smithi033 (mon.0) 529 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:36:48.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:47.526290+0000 mgr.smithi033.apxevf (mgr.14626) 276 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:49.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:47.526290+0000 mgr.smithi033.apxevf (mgr.14626) 276 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:50.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:49.526739+0000 mgr.smithi033.apxevf (mgr.14626) 277 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:50.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:49.526739+0000 mgr.smithi033.apxevf (mgr.14626) 277 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:52.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:51.527135+0000 mgr.smithi033.apxevf (mgr.14626) 278 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:52.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:51.527135+0000 mgr.smithi033.apxevf (mgr.14626) 278 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:54.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.877626+0000 mon.smithi033 (mon.0) 530 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:54.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.878443+0000 mon.smithi033 (mon.0) 531 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:54.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.879148+0000 mon.smithi033 (mon.0) 532 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:54.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:52.879765+0000 mgr.smithi033.apxevf (mgr.14626) 279 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:54.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.883276+0000 mon.smithi033 (mon.0) 533 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:54.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.888466+0000 mon.smithi033 (mon.0) 534 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:54.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.890734+0000 mon.smithi033 (mon.0) 535 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:54.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.891932+0000 mon.smithi033 (mon.0) 536 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:54.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.893117+0000 mon.smithi033 (mon.0) 537 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:54.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.894674+0000 mon.smithi033 (mon.0) 538 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:54.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:52.896316+0000 mon.smithi033 (mon.0) 539 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi033.mcppgd"]}]: dispatch 2024-02-15T18:36:54.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:52.896837+0000 mgr.smithi033.apxevf (mgr.14626) 280 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi033.mcppgd 2024-02-15T18:36:54.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:53 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:53.527765+0000 mgr.smithi033.apxevf (mgr.14626) 281 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:54.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.877626+0000 mon.smithi033 (mon.0) 530 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:54.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.878443+0000 mon.smithi033 (mon.0) 531 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:54.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.879148+0000 mon.smithi033 (mon.0) 532 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:52.879765+0000 mgr.smithi033.apxevf (mgr.14626) 279 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.883276+0000 mon.smithi033 (mon.0) 533 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.888466+0000 mon.smithi033 (mon.0) 534 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.890734+0000 mon.smithi033 (mon.0) 535 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.891932+0000 mon.smithi033 (mon.0) 536 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.893117+0000 mon.smithi033 (mon.0) 537 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.894674+0000 mon.smithi033 (mon.0) 538 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:52.896316+0000 mon.smithi033 (mon.0) 539 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi033.mcppgd"]}]: dispatch 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:52.896837+0000 mgr.smithi033.apxevf (mgr.14626) 280 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi033.mcppgd 2024-02-15T18:36:54.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:53.527765+0000 mgr.smithi033.apxevf (mgr.14626) 281 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:56.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:54.805815+0000 mgr.smithi033.apxevf (mgr.14626) 282 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi033.mcppgd 2024-02-15T18:36:56.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:54.810460+0000 mon.smithi033 (mon.0) 540 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:56.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:54.811463+0000 mon.smithi033 (mon.0) 541 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.mcppgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:36:56.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:36:54.812308+0000 mon.smithi033 (mon.0) 542 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:56.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:36:54.813003+0000 mgr.smithi033.apxevf (mgr.14626) 283 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.mcppgd on smithi033 2024-02-15T18:36:56.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:55.528140+0000 mgr.smithi033.apxevf (mgr.14626) 284 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:56.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:54.805815+0000 mgr.smithi033.apxevf (mgr.14626) 282 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi033.mcppgd 2024-02-15T18:36:56.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:54.810460+0000 mon.smithi033 (mon.0) 540 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:36:56.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:54.811463+0000 mon.smithi033 (mon.0) 541 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.mcppgd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:36:56.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:36:54.812308+0000 mon.smithi033 (mon.0) 542 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:36:56.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:36:54.813003+0000 mgr.smithi033.apxevf (mgr.14626) 283 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.mcppgd on smithi033 2024-02-15T18:36:56.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:55.528140+0000 mgr.smithi033.apxevf (mgr.14626) 284 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:57.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:56.655248+0000 mon.smithi033 (mon.0) 543 : cluster [DBG] osdmap e81: 6 total, 6 up, 6 in 2024-02-15T18:36:57.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:56.818400+0000 mon.smithi033 (mon.0) 544 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2 up:standby 2024-02-15T18:36:57.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:36:57 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:57.528538+0000 mgr.smithi033.apxevf (mgr.14626) 285 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:36:58.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:56.655248+0000 mon.smithi033 (mon.0) 543 : cluster [DBG] osdmap e81: 6 total, 6 up, 6 in 2024-02-15T18:36:58.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:56.818400+0000 mon.smithi033 (mon.0) 544 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 2 up:standby 2024-02-15T18:36:58.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:36:57 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:57.528538+0000 mgr.smithi033.apxevf (mgr.14626) 285 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:00.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:36:59.528933+0000 mgr.smithi033.apxevf (mgr.14626) 286 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:00.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:00.110097+0000 mon.smithi033 (mon.0) 545 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:00.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:00.110805+0000 mon.smithi033 (mon.0) 546 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:00.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:36:59.528933+0000 mgr.smithi033.apxevf (mgr.14626) 286 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:00.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:00.110097+0000 mon.smithi033 (mon.0) 545 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:00.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:00.110805+0000 mon.smithi033 (mon.0) 546 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:01.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.265+0000 7ff569188700 1 -- 172.21.15.33:0/3635427524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 msgr2=0x7ff5640f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.265+0000 7ff569188700 1 --2- 172.21.15.33:0/3635427524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 0x7ff5640f6920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7ff558004660 tx=0x7ff558009b30).stop 2024-02-15T18:37:01.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.265+0000 7ff569188700 1 -- 172.21.15.33:0/3635427524 shutdown_connections 2024-02-15T18:37:01.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.265+0000 7ff569188700 1 --2- 172.21.15.33:0/3635427524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 0x7ff5640f6920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.265+0000 7ff569188700 1 --2- 172.21.15.33:0/3635427524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5640f55e0 0x7ff5640f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.265+0000 7ff569188700 1 -- 172.21.15.33:0/3635427524 >> 172.21.15.33:0/3635427524 conn(0x7ff5640f0de0 msgr2=0x7ff5640f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:01.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.265+0000 7ff569188700 1 -- 172.21.15.33:0/3635427524 shutdown_connections 2024-02-15T18:37:01.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.265+0000 7ff569188700 1 -- 172.21.15.33:0/3635427524 wait complete. 2024-02-15T18:37:01.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.266+0000 7ff569188700 1 Processor -- start 2024-02-15T18:37:01.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.266+0000 7ff569188700 1 -- start start 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.266+0000 7ff569188700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5640f55e0 0x7ff564109d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.266+0000 7ff569188700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 0x7ff56410c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.266+0000 7ff569188700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640604c0 con 0x7ff5640f5ef0 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.266+0000 7ff569188700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564060600 con 0x7ff5640f55e0 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.266+0000 7ff56259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 0x7ff56410c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.266+0000 7ff56259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 0x7ff56410c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33722/0 (socket says 172.21.15.33:33722) 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.266+0000 7ff56259c700 1 -- 172.21.15.33:0/3315434117 learned_addr learned my addr 172.21.15.33:0/3315434117 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff562d9d700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5640f55e0 0x7ff564109d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff56259c700 1 -- 172.21.15.33:0/3315434117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5640f55e0 msgr2=0x7ff564109d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff56259c700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5640f55e0 0x7ff564109d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff56259c700 1 -- 172.21.15.33:0/3315434117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558005040 con 0x7ff5640f5ef0 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff56259c700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 0x7ff56410c200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff558000c00 tx=0x7ff55800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff54b7fe700 1 -- 172.21.15.33:0/3315434117 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff558019070 con 0x7ff5640f5ef0 2024-02-15T18:37:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56410c750 con 0x7ff5640f5ef0 2024-02-15T18:37:01.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff54b7fe700 1 -- 172.21.15.33:0/3315434117 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7ff558014420 con 0x7ff5640f5ef0 2024-02-15T18:37:01.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff54b7fe700 1 -- 172.21.15.33:0/3315434117 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff55801d600 con 0x7ff5640f5ef0 2024-02-15T18:37:01.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.267+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56410cc80 con 0x7ff5640f5ef0 2024-02-15T18:37:01.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.268+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff564045ad0 con 0x7ff5640f5ef0 2024-02-15T18:37:01.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.269+0000 7ff54b7fe700 1 -- 172.21.15.33:0/3315434117 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ff558014590 con 0x7ff5640f5ef0 2024-02-15T18:37:01.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.269+0000 7ff54b7fe700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff54c060f20 0x7ff54c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:01.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.269+0000 7ff54b7fe700 1 -- 172.21.15.33:0/3315434117 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff55807d0a0 con 0x7ff5640f5ef0 2024-02-15T18:37:01.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.269+0000 7ff562d9d700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff54c060f20 0x7ff54c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:01.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.270+0000 7ff562d9d700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff54c060f20 0x7ff54c0633e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff564060140 tx=0x7ff55400b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:01.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.274+0000 7ff54b7fe700 1 -- 172.21.15.33:0/3315434117 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff55804d400 con 0x7ff5640f5ef0 2024-02-15T18:37:01.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.473+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5640fe090 con 0x7ff54c060f20 2024-02-15T18:37:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.474+0000 7ff54b7fe700 1 -- 172.21.15.33:0/3315434117 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff55400f040 con 0x7ff54c060f20 2024-02-15T18:37:01.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff54c060f20 msgr2=0x7ff54c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff54c060f20 0x7ff54c0633e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff564060140 tx=0x7ff55400b040).stop 2024-02-15T18:37:01.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 msgr2=0x7ff56410c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 0x7ff56410c200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7ff558000c00 tx=0x7ff55800b040).stop 2024-02-15T18:37:01.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 shutdown_connections 2024-02-15T18:37:01.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff54c060f20 0x7ff54c0633e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5640f55e0 0x7ff564109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 --2- 172.21.15.33:0/3315434117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5640f5ef0 0x7ff56410c200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 >> 172.21.15.33:0/3315434117 conn(0x7ff5640f0de0 msgr2=0x7ff5640fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 shutdown_connections 2024-02-15T18:37:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.476+0000 7ff569188700 1 -- 172.21.15.33:0/3315434117 wait complete. 2024-02-15T18:37:01.477 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:37:01.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:00.173924+0000 mon.smithi033 (mon.0) 547 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2386752010,v1:172.21.15.33:6829/2386752010] up:boot 2024-02-15T18:37:01.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:00.173963+0000 mon.smithi033 (mon.0) 548 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 3 up:standby 2024-02-15T18:37:01.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:01 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:00.174168+0000 mon.smithi033 (mon.0) 549 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:37:01.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:00.173924+0000 mon.smithi033 (mon.0) 547 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2386752010,v1:172.21.15.33:6829/2386752010] up:boot 2024-02-15T18:37:01.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:00.173963+0000 mon.smithi033 (mon.0) 548 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi131.ywlevz=up:active} 3 up:standby 2024-02-15T18:37:01.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:01 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:00.174168+0000 mon.smithi033 (mon.0) 549 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:37:01.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.578+0000 7fccd24aa700 1 -- 172.21.15.33:0/582028762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 msgr2=0x7fcccc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.578+0000 7fccd24aa700 1 --2- 172.21.15.33:0/582028762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 0x7fcccc0f6b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fccbc004660 tx=0x7fccbc009b30).stop 2024-02-15T18:37:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.578+0000 7fccd24aa700 1 -- 172.21.15.33:0/582028762 shutdown_connections 2024-02-15T18:37:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.578+0000 7fccd24aa700 1 --2- 172.21.15.33:0/582028762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 0x7fcccc0f6b30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.578+0000 7fccd24aa700 1 --2- 172.21.15.33:0/582028762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcccc0f5430 0x7fcccc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.578+0000 7fccd24aa700 1 -- 172.21.15.33:0/582028762 >> 172.21.15.33:0/582028762 conn(0x7fcccc0f0b90 msgr2=0x7fcccc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd24aa700 1 -- 172.21.15.33:0/582028762 shutdown_connections 2024-02-15T18:37:01.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd24aa700 1 -- 172.21.15.33:0/582028762 wait complete. 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd24aa700 1 Processor -- start 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd24aa700 1 -- start start 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd24aa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcccc0f5430 0x7fcccc106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd24aa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 0x7fcccc107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd24aa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc107920 con 0x7fcccc0f66d0 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd24aa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc108130 con 0x7fcccc0f5430 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd0ca7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 0x7fcccc107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd0ca7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 0x7fcccc107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33734/0 (socket says 172.21.15.33:33734) 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.579+0000 7fccd0ca7700 1 -- 172.21.15.33:0/1560309370 learned_addr learned my addr 172.21.15.33:0/1560309370 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccd14a8700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcccc0f5430 0x7fcccc106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccd0ca7700 1 -- 172.21.15.33:0/1560309370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcccc0f5430 msgr2=0x7fcccc106e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccd0ca7700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcccc0f5430 0x7fcccc106e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccd0ca7700 1 -- 172.21.15.33:0/1560309370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc005040 con 0x7fcccc0f66d0 2024-02-15T18:37:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccd0ca7700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 0x7fcccc107320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fccbc009f50 tx=0x7fccbc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccc1ffb700 1 -- 172.21.15.33:0/1560309370 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccbc018070 con 0x7fcccc0f66d0 2024-02-15T18:37:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccc1ffb700 1 -- 172.21.15.33:0/1560309370 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fccbc007ba0 con 0x7fcccc0f66d0 2024-02-15T18:37:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcccc108350 con 0x7fcccc0f66d0 2024-02-15T18:37:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccc1ffb700 1 -- 172.21.15.33:0/1560309370 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccbc01c420 con 0x7fcccc0f66d0 2024-02-15T18:37:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.580+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcccc1088b0 con 0x7fcccc0f66d0 2024-02-15T18:37:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.581+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcccc059100 con 0x7fcccc0f66d0 2024-02-15T18:37:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.582+0000 7fccc1ffb700 1 -- 172.21.15.33:0/1560309370 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fccbc01d420 con 0x7fcccc0f66d0 2024-02-15T18:37:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.582+0000 7fccc1ffb700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fccb8060f70 0x7fccb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.582+0000 7fccc1ffb700 1 -- 172.21.15.33:0/1560309370 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fccbc07dda0 con 0x7fcccc0f66d0 2024-02-15T18:37:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.582+0000 7fccd14a8700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fccb8060f70 0x7fccb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:01.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.583+0000 7fccd14a8700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fccb8060f70 0x7fccb8063430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fcccc106ba0 tx=0x7fccc800b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:01.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.586+0000 7fccc1ffb700 1 -- 172.21.15.33:0/1560309370 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fccbc04e1c0 con 0x7fcccc0f66d0 2024-02-15T18:37:01.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.779+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcccc0fab10 con 0x7fccb8060f70 2024-02-15T18:37:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.780+0000 7fccc1ffb700 1 -- 172.21.15.33:0/1560309370 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcccc0fab10 con 0x7fccb8060f70 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fccb8060f70 msgr2=0x7fccb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fccb8060f70 0x7fccb8063430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fcccc106ba0 tx=0x7fccc800b040).stop 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 msgr2=0x7fcccc107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 0x7fcccc107320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fccbc009f50 tx=0x7fccbc009b30).stop 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 shutdown_connections 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fccb8060f70 0x7fccb8063430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcccc0f5430 0x7fcccc106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 --2- 172.21.15.33:0/1560309370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcccc0f66d0 0x7fcccc107320 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 >> 172.21.15.33:0/1560309370 conn(0x7fcccc0f0b90 msgr2=0x7fcccc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.782+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 shutdown_connections 2024-02-15T18:37:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.783+0000 7fccd24aa700 1 -- 172.21.15.33:0/1560309370 wait complete. 2024-02-15T18:37:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.884+0000 7fd30bfff700 1 -- 172.21.15.33:0/494045288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 msgr2=0x7fd30c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.884+0000 7fd30bfff700 1 --2- 172.21.15.33:0/494045288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 0x7fd30c0f9110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fd2fc004660 tx=0x7fd2fc009b30).stop 2024-02-15T18:37:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 -- 172.21.15.33:0/494045288 shutdown_connections 2024-02-15T18:37:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 --2- 172.21.15.33:0/494045288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd30c0f9690 0x7fd30c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:37:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 --2- 172.21.15.33:0/494045288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 0x7fd30c0f9110 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 -- 172.21.15.33:0/494045288 >> 172.21.15.33:0/494045288 conn(0x7fd30c0f0b90 msgr2=0x7fd30c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 -- 172.21.15.33:0/494045288 shutdown_connections 2024-02-15T18:37:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 -- 172.21.15.33:0/494045288 wait complete. 2024-02-15T18:37:01.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 Processor -- start 2024-02-15T18:37:01.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 -- start start 2024-02-15T18:37:01.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 0x7fd30c0f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:01.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd30c0f9690 0x7fd30c0f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:01.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0f5600 con 0x7fd30c060310 2024-02-15T18:37:01.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.885+0000 7fd30bfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0f5740 con 0x7fd30c0f9690 2024-02-15T18:37:01.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd30affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 0x7fd30c0f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:01.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd30affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 0x7fd30c0f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33750/0 (socket says 172.21.15.33:33750) 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd30affd700 1 -- 172.21.15.33:0/992405368 learned_addr learned my addr 172.21.15.33:0/992405368 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd30affd700 1 -- 172.21.15.33:0/992405368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd30c0f9690 msgr2=0x7fd30c0f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd30affd700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd30c0f9690 0x7fd30c0f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd30affd700 1 -- 172.21.15.33:0/992405368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc005040 con 0x7fd30c060310 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd30affd700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 0x7fd30c0f6b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd2fc009f50 tx=0x7fd2fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd2f37fe700 1 -- 172.21.15.33:0/992405368 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2fc018070 con 0x7fd30c060310 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd2f37fe700 1 -- 172.21.15.33:0/992405368 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd2fc007d70 con 0x7fd30c060310 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30c0f59c0 con 0x7fd30c060310 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd2f37fe700 1 -- 172.21.15.33:0/992405368 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2fc01c620 con 0x7fd30c060310 2024-02-15T18:37:01.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.886+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30c10eeb0 con 0x7fd30c060310 2024-02-15T18:37:01.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.887+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30c059100 con 0x7fd30c060310 2024-02-15T18:37:01.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.888+0000 7fd2f37fe700 1 -- 172.21.15.33:0/992405368 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd2fc01c890 con 0x7fd30c060310 2024-02-15T18:37:01.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.888+0000 7fd2f37fe700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd2f4060f70 0x7fd2f4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:01.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.888+0000 7fd2f37fe700 1 -- 172.21.15.33:0/992405368 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fd2fc07df70 con 0x7fd30c060310 2024-02-15T18:37:01.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.888+0000 7fd30a7fc700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd2f4060f70 0x7fd2f4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:01.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.889+0000 7fd30a7fc700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd2f4060f70 0x7fd2f4063430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fd30c0600e0 tx=0x7fd300006b50).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:01.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:01.892+0000 7fd2f37fe700 1 -- 172.21.15.33:0/992405368 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd2fc0acf60 con 0x7fd30c060310 2024-02-15T18:37:02.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.075+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd30c0fef80 con 0x7fd2f4060f70 2024-02-15T18:37:02.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.084+0000 7fd2f37fe700 1 -- 172.21.15.33:0/992405368 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fd30c0fef80 con 0x7fd2f4060f70 2024-02-15T18:37:02.075 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (11m) 9s ago 13m 21.2M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (4m) 9s ago 13m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (4m) 66s ago 12m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (11m) 9s ago 13m 34.4M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 starting - - - - 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (16s) 9s ago 8m 13.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc e375dd9e3a03 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (8m) 66s ago 8m 118M - 16.2.4 8d91d370c2b8 b4b8eb0d5a15 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (8m) 66s ago 8m 133M - 16.2.4 8d91d370c2b8 e7c73ccd0558 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (5m) 9s ago 15m 438M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (5m) 66s ago 12m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (4m) 9s ago 15m 51.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (4m) 66s ago 12m 41.7M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:37:02.076 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (13m) 9s ago 13m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:37:02.077 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (12m) 66s ago 12m 17.1M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:37:02.077 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (3m) 9s ago 12m 198M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:37:02.077 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (3m) 9s ago 11m 200M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:37:02.077 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (2m) 9s ago 11m 201M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:37:02.077 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (2m) 66s ago 10m 251M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4030e9f6d6c2 2024-02-15T18:37:02.077 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (97s) 66s ago 10m 244M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 902c89c867aa 2024-02-15T18:37:02.077 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (69s) 66s ago 10m 12.9M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc ba19a3c17a66 2024-02-15T18:37:02.077 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (5m) 9s ago 12m 68.1M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd2f4060f70 msgr2=0x7fd2f4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd2f4060f70 0x7fd2f4063430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fd30c0600e0 tx=0x7fd300006b50).stop 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 msgr2=0x7fd30c0f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 0x7fd30c0f6b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd2fc009f50 tx=0x7fd2fc009b30).stop 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 shutdown_connections 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd2f4060f70 0x7fd2f4063430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c060310 0x7fd30c0f6b90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 --2- 172.21.15.33:0/992405368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd30c0f9690 0x7fd30c0f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 >> 172.21.15.33:0/992405368 conn(0x7fd30c0f0b90 msgr2=0x7fd30c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:02.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 shutdown_connections 2024-02-15T18:37:02.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.086+0000 7fd30bfff700 1 -- 172.21.15.33:0/992405368 wait complete. 2024-02-15T18:37:02.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.189+0000 7fc7d7fff700 1 -- 172.21.15.33:0/767428978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 msgr2=0x7fc7d80f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.189+0000 7fc7d7fff700 1 --2- 172.21.15.33:0/767428978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 0x7fc7d80f9170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fc7c8004660 tx=0x7fc7c8009b30).stop 2024-02-15T18:37:02.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.189+0000 7fc7d7fff700 1 -- 172.21.15.33:0/767428978 shutdown_connections 2024-02-15T18:37:02.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.189+0000 7fc7d7fff700 1 --2- 172.21.15.33:0/767428978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d80f96f0 0x7fc7d80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.189+0000 7fc7d7fff700 1 --2- 172.21.15.33:0/767428978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 0x7fc7d80f9170 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.189+0000 7fc7d7fff700 1 -- 172.21.15.33:0/767428978 >> 172.21.15.33:0/767428978 conn(0x7fc7d80f0b90 msgr2=0x7fc7d80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.189+0000 7fc7d7fff700 1 -- 172.21.15.33:0/767428978 shutdown_connections 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.189+0000 7fc7d7fff700 1 -- 172.21.15.33:0/767428978 wait complete. 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d7fff700 1 Processor -- start 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d7fff700 1 -- start start 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 0x7fc7d80f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d80f96f0 0x7fc7d80f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d7fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d80f55d0 con 0x7fc7d80602b0 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d7fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d80f5710 con 0x7fc7d80f96f0 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 0x7fc7d80f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 0x7fc7d80f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33764/0 (socket says 172.21.15.33:33764) 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d6ffd700 1 -- 172.21.15.33:0/1347421114 learned_addr learned my addr 172.21.15.33:0/1347421114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.190+0000 7fc7d67fc700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d80f96f0 0x7fc7d80f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:02.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.191+0000 7fc7d6ffd700 1 -- 172.21.15.33:0/1347421114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d80f96f0 msgr2=0x7fc7d80f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.191+0000 7fc7d6ffd700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d80f96f0 0x7fc7d80f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.191+0000 7fc7d6ffd700 1 -- 172.21.15.33:0/1347421114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c8005040 con 0x7fc7d80602b0 2024-02-15T18:37:02.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.191+0000 7fc7d6ffd700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 0x7fc7d80f6bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fc7c8009f50 tx=0x7fc7c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:02.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.191+0000 7fc7cf7fe700 1 -- 172.21.15.33:0/1347421114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7c8018070 con 0x7fc7d80602b0 2024-02-15T18:37:02.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.191+0000 7fc7cf7fe700 1 -- 172.21.15.33:0/1347421114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fc7c8007c70 con 0x7fc7d80602b0 2024-02-15T18:37:02.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.191+0000 7fc7cf7fe700 1 -- 172.21.15.33:0/1347421114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7c801c620 con 0x7fc7d80602b0 2024-02-15T18:37:02.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.191+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d80f5990 con 0x7fc7d80602b0 2024-02-15T18:37:02.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.191+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d80f5ef0 con 0x7fc7d80602b0 2024-02-15T18:37:02.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.192+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d8045ad0 con 0x7fc7d80602b0 2024-02-15T18:37:02.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.192+0000 7fc7cf7fe700 1 -- 172.21.15.33:0/1347421114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fc7c801da10 con 0x7fc7d80602b0 2024-02-15T18:37:02.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.193+0000 7fc7cf7fe700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc7c4060f70 0x7fc7c4063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:02.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.193+0000 7fc7cf7fe700 1 -- 172.21.15.33:0/1347421114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc7c807e000 con 0x7fc7d80602b0 2024-02-15T18:37:02.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.193+0000 7fc7d67fc700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc7c4060f70 0x7fc7c4063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:02.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.193+0000 7fc7d67fc700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc7c4060f70 0x7fc7c4063430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc7c0007fd0 tx=0x7fc7c0009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:02.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.197+0000 7fc7cf7fe700 1 -- 172.21.15.33:0/1347421114 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc7c804e500 con 0x7fc7d80602b0 2024-02-15T18:37:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.469+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc7d80fef30 con 0x7fc7d80602b0 2024-02-15T18:37:02.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.470+0000 7fc7cf7fe700 1 -- 172.21.15.33:0/1347421114 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7fc7c8051b20 con 0x7fc7d80602b0 2024-02-15T18:37:02.461 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:37:02.461 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2, 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:37:02.462 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:37:02.463 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 12, 2024-02-15T18:37:02.463 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2024-02-15T18:37:02.463 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:37:02.463 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:37:02.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc7c4060f70 msgr2=0x7fc7c4063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc7c4060f70 0x7fc7c4063430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fc7c0007fd0 tx=0x7fc7c0009040).stop 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 msgr2=0x7fc7d80f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 0x7fc7d80f6bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fc7c8009f50 tx=0x7fc7c8009b30).stop 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 shutdown_connections 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc7c4060f70 0x7fc7c4063430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7d80602b0 0x7fc7d80f6bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 --2- 172.21.15.33:0/1347421114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d80f96f0 0x7fc7d80f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 >> 172.21.15.33:0/1347421114 conn(0x7fc7d80f0b90 msgr2=0x7fc7d80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 shutdown_connections 2024-02-15T18:37:02.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.472+0000 7fc7d7fff700 1 -- 172.21.15.33:0/1347421114 wait complete. 2024-02-15T18:37:02.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:01.475729+0000 mgr.smithi033.apxevf (mgr.14626) 287 : audit [DBG] from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:02.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:01.529311+0000 mgr.smithi033.apxevf (mgr.14626) 288 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:02.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:01.475729+0000 mgr.smithi033.apxevf (mgr.14626) 287 : audit [DBG] from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:02.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:01.529311+0000 mgr.smithi033.apxevf (mgr.14626) 288 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:02.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.573+0000 7f2963ae8700 1 -- 172.21.15.33:0/2445313785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f6860 msgr2=0x7f295c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.573+0000 7f2963ae8700 1 --2- 172.21.15.33:0/2445313785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f6860 0x7f295c0f6cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f2958004660 tx=0x7f2958009b30).stop 2024-02-15T18:37:02.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.573+0000 7f2963ae8700 1 -- 172.21.15.33:0/2445313785 shutdown_connections 2024-02-15T18:37:02.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.573+0000 7f2963ae8700 1 --2- 172.21.15.33:0/2445313785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f6860 0x7f295c0f6cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.573+0000 7f2963ae8700 1 --2- 172.21.15.33:0/2445313785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0f55c0 0x7f295c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.573+0000 7f2963ae8700 1 -- 172.21.15.33:0/2445313785 >> 172.21.15.33:0/2445313785 conn(0x7f295c0f0d40 msgr2=0x7f295c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:02.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.573+0000 7f2963ae8700 1 -- 172.21.15.33:0/2445313785 shutdown_connections 2024-02-15T18:37:02.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.573+0000 7f2963ae8700 1 -- 172.21.15.33:0/2445313785 wait complete. 2024-02-15T18:37:02.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2963ae8700 1 Processor -- start 2024-02-15T18:37:02.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2963ae8700 1 -- start start 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2963ae8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f55c0 0x7f295c109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2963ae8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0f6860 0x7f295c10c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2963ae8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0603c0 con 0x7f295c0f55c0 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2963ae8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c060500 con 0x7f295c0f6860 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2961884700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f55c0 0x7f295c109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2961884700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f55c0 0x7f295c109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33782/0 (socket says 172.21.15.33:33782) 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2961884700 1 -- 172.21.15.33:0/249248212 learned_addr learned my addr 172.21.15.33:0/249248212 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2961083700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0f6860 0x7f295c10c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2961884700 1 -- 172.21.15.33:0/249248212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0f6860 msgr2=0x7f295c10c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2961884700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0f6860 0x7f295c10c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2961884700 1 -- 172.21.15.33:0/249248212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958005040 con 0x7f295c0f55c0 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.574+0000 7f2961884700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f55c0 0x7f295c109cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f2950002700 tx=0x7f2950009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.575+0000 7f294e7fc700 1 -- 172.21.15.33:0/249248212 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2950009320 con 0x7f295c0f55c0 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.575+0000 7f294e7fc700 1 -- 172.21.15.33:0/249248212 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f295000f040 con 0x7f295c0f55c0 2024-02-15T18:37:02.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.575+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295c10c780 con 0x7f295c0f55c0 2024-02-15T18:37:02.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.575+0000 7f294e7fc700 1 -- 172.21.15.33:0/249248212 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29500149d0 con 0x7f295c0f55c0 2024-02-15T18:37:02.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.575+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c10cd10 con 0x7f295c0f55c0 2024-02-15T18:37:02.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.576+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295c0f49b0 con 0x7f295c0f55c0 2024-02-15T18:37:02.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.576+0000 7f294e7fc700 1 -- 172.21.15.33:0/249248212 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f29500077b0 con 0x7f295c0f55c0 2024-02-15T18:37:02.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.577+0000 7f294e7fc700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2948060f20 0x7f29480633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:02.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.577+0000 7f294e7fc700 1 -- 172.21.15.33:0/249248212 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f295007c360 con 0x7f295c0f55c0 2024-02-15T18:37:02.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.577+0000 7f2961083700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2948060f20 0x7f29480633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:02.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.577+0000 7f2961083700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2948060f20 0x7f29480633e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2958009d60 tx=0x7f2958009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:02.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.581+0000 7f294e7fc700 1 -- 172.21.15.33:0/249248212 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f295004c7e0 con 0x7f295c0f55c0 2024-02-15T18:37:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.805+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f295c045ad0 con 0x7f295c0f55c0 2024-02-15T18:37:02.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.805+0000 7f294e7fc700 1 -- 172.21.15.33:0/249248212 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1790 (secure 0 0 0) 0x7f295004fe00 con 0x7f295c0f55c0 2024-02-15T18:37:02.796 INFO:teuthology.orchestra.run.smithi033.stdout:e30 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 25 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:36:31.592839+0000 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:37:02.797 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24255} 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 1 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:37:02.798 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{0:24255} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.131:6824/1245860707,v1:172.21.15.131:6825/1245860707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{-1:34334} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{-1:34338} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6828/2386752010,v1:172.21.15.33:6829/2386752010] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:37:02.799 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{-1:44279} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/112791917,v1:172.21.15.131:6827/112791917] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:37:02.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2948060f20 msgr2=0x7f29480633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2948060f20 0x7f29480633e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2958009d60 tx=0x7f2958009b30).stop 2024-02-15T18:37:02.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f55c0 msgr2=0x7f295c109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f55c0 0x7f295c109cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f2950002700 tx=0x7f2950009d80).stop 2024-02-15T18:37:02.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 shutdown_connections 2024-02-15T18:37:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2948060f20 0x7f29480633e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f295c0f55c0 0x7f295c109cd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 --2- 172.21.15.33:0/249248212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f295c0f6860 0x7f295c10c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 >> 172.21.15.33:0/249248212 conn(0x7f295c0f0d40 msgr2=0x7f295c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 shutdown_connections 2024-02-15T18:37:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.807+0000 7f2963ae8700 1 -- 172.21.15.33:0/249248212 wait complete. 2024-02-15T18:37:02.801 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.909+0000 7f9a32cf7700 1 -- 172.21.15.33:0/631903874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f66e0 msgr2=0x7f9a2c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.909+0000 7f9a32cf7700 1 --2- 172.21.15.33:0/631903874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f66e0 0x7f9a2c0f6b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f9a20004660 tx=0x7f9a20009b30).stop 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.909+0000 7f9a32cf7700 1 -- 172.21.15.33:0/631903874 shutdown_connections 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.909+0000 7f9a32cf7700 1 --2- 172.21.15.33:0/631903874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a2c0f7980 0x7f9a2c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.909+0000 7f9a32cf7700 1 --2- 172.21.15.33:0/631903874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f66e0 0x7f9a2c0f6b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.909+0000 7f9a32cf7700 1 -- 172.21.15.33:0/631903874 >> 172.21.15.33:0/631903874 conn(0x7f9a2c0f1e40 msgr2=0x7f9a2c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.909+0000 7f9a32cf7700 1 -- 172.21.15.33:0/631903874 shutdown_connections 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.909+0000 7f9a32cf7700 1 -- 172.21.15.33:0/631903874 wait complete. 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a32cf7700 1 Processor -- start 2024-02-15T18:37:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a32cf7700 1 -- start start 2024-02-15T18:37:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a32cf7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a2c0f66e0 0x7f9a2c107030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a32cf7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f7980 0x7f9a2c107520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a32cf7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c107ad0 con 0x7f9a2c0f7980 2024-02-15T18:37:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a32cf7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c107c10 con 0x7f9a2c0f66e0 2024-02-15T18:37:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a2bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f7980 0x7f9a2c107520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a2bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f7980 0x7f9a2c107520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33788/0 (socket says 172.21.15.33:33788) 2024-02-15T18:37:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a2bfff700 1 -- 172.21.15.33:0/3337012 learned_addr learned my addr 172.21.15.33:0/3337012 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.910+0000 7f9a30a93700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a2c0f66e0 0x7f9a2c107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.911+0000 7f9a2bfff700 1 -- 172.21.15.33:0/3337012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a2c0f66e0 msgr2=0x7f9a2c107030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.911+0000 7f9a2bfff700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a2c0f66e0 0x7f9a2c107030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.911+0000 7f9a2bfff700 1 -- 172.21.15.33:0/3337012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20005040 con 0x7f9a2c0f7980 2024-02-15T18:37:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.911+0000 7f9a2bfff700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f7980 0x7f9a2c107520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9a1800e7f0 tx=0x7f9a1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.911+0000 7f9a297fa700 1 -- 172.21.15.33:0/3337012 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a180092e0 con 0x7f9a2c0f7980 2024-02-15T18:37:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.911+0000 7f9a297fa700 1 -- 172.21.15.33:0/3337012 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9a1800f040 con 0x7f9a2c0f7980 2024-02-15T18:37:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.911+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c1085b0 con 0x7f9a2c0f7980 2024-02-15T18:37:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.911+0000 7f9a297fa700 1 -- 172.21.15.33:0/3337012 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a18014850 con 0x7f9a2c0f7980 2024-02-15T18:37:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.911+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c108b70 con 0x7f9a2c0f7980 2024-02-15T18:37:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.912+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c045ad0 con 0x7f9a2c0f7980 2024-02-15T18:37:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.912+0000 7f9a297fa700 1 -- 172.21.15.33:0/3337012 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f9a1801b030 con 0x7f9a2c0f7980 2024-02-15T18:37:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.913+0000 7f9a297fa700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9a1c060f20 0x7f9a1c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.913+0000 7f9a297fa700 1 -- 172.21.15.33:0/3337012 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9a1807be90 con 0x7f9a2c0f7980 2024-02-15T18:37:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.913+0000 7f9a30a93700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9a1c060f20 0x7f9a1c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:02.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.913+0000 7f9a30a93700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9a1c060f20 0x7f9a1c0633e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9a20009720 tx=0x7f9a20016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:02.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:02.917+0000 7f9a297fa700 1 -- 172.21.15.33:0/3337012 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9a1804fdf0 con 0x7f9a2c0f7980 2024-02-15T18:37:03.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.105+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a2c0ff0c0 con 0x7f9a1c060f20 2024-02-15T18:37:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.107+0000 7f9a297fa700 1 -- 172.21.15.33:0/3337012 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9a2c0ff0c0 con 0x7f9a1c060f20 2024-02-15T18:37:03.098 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:37:03.098 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:37:03.098 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:37:03.098 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:37:03.098 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:37:03.098 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:37:03.098 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:37:03.098 INFO:teuthology.orchestra.run.smithi033.stdout: "osd", 2024-02-15T18:37:03.099 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:37:03.099 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:37:03.099 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "13/21 daemons upgraded", 2024-02-15T18:37:03.099 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading mds daemons", 2024-02-15T18:37:03.099 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:37:03.099 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.108+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9a1c060f20 msgr2=0x7f9a1c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.108+0000 7f9a32cf7700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9a1c060f20 0x7f9a1c0633e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f9a20009720 tx=0x7f9a20016040).stop 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.108+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f7980 msgr2=0x7f9a2c107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.108+0000 7f9a32cf7700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f7980 0x7f9a2c107520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9a1800e7f0 tx=0x7f9a1800b040).stop 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.108+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 shutdown_connections 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.108+0000 7f9a32cf7700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9a1c060f20 0x7f9a1c0633e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.109+0000 7f9a32cf7700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a2c0f66e0 0x7f9a2c107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.109+0000 7f9a32cf7700 1 --2- 172.21.15.33:0/3337012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2c0f7980 0x7f9a2c107520 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.109+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 >> 172.21.15.33:0/3337012 conn(0x7f9a2c0f1e40 msgr2=0x7f9a2c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.109+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 shutdown_connections 2024-02-15T18:37:03.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:03.109+0000 7f9a32cf7700 1 -- 172.21.15.33:0/3337012 wait complete. 2024-02-15T18:37:03.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:01.782120+0000 mgr.smithi033.apxevf (mgr.14626) 289 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:03.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:02.077592+0000 mgr.smithi033.apxevf (mgr.14626) 290 : audit [DBG] from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:03.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:02.471888+0000 mon.smithi033 (mon.0) 550 : audit [DBG] from='client.? 172.21.15.33:0/1347421114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:03.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:03 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:02.806903+0000 mon.smithi033 (mon.0) 551 : audit [DBG] from='client.? 172.21.15.33:0/249248212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:37:03.511 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:01.782120+0000 mgr.smithi033.apxevf (mgr.14626) 289 : audit [DBG] from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:03.511 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:02.077592+0000 mgr.smithi033.apxevf (mgr.14626) 290 : audit [DBG] from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:03.511 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:02.471888+0000 mon.smithi033 (mon.0) 550 : audit [DBG] from='client.? 172.21.15.33:0/1347421114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:03.511 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:02.806903+0000 mon.smithi033 (mon.0) 551 : audit [DBG] from='client.? 172.21.15.33:0/249248212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:37:04.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:03.108297+0000 mgr.smithi033.apxevf (mgr.14626) 291 : audit [DBG] from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:04.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:03.529916+0000 mgr.smithi033.apxevf (mgr.14626) 292 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:03.108297+0000 mgr.smithi033.apxevf (mgr.14626) 291 : audit [DBG] from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:03.529916+0000 mgr.smithi033.apxevf (mgr.14626) 292 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:06.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.409889+0000 mon.smithi033 (mon.0) 552 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:06.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.410683+0000 mon.smithi033 (mon.0) 553 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:06.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.411307+0000 mon.smithi033 (mon.0) 554 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:05.411831+0000 mgr.smithi033.apxevf (mgr.14626) 293 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.414707+0000 mon.smithi033 (mon.0) 555 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.419322+0000 mon.smithi033 (mon.0) 556 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.421397+0000 mon.smithi033 (mon.0) 557 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.422474+0000 mon.smithi033 (mon.0) 558 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.423523+0000 mon.smithi033 (mon.0) 559 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.424883+0000 mon.smithi033 (mon.0) 560 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:05.426396+0000 mon.smithi033 (mon.0) 561 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi131.ywlevz"]}]: dispatch 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:05.426854+0000 mgr.smithi033.apxevf (mgr.14626) 294 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi131.ywlevz 2024-02-15T18:37:06.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:05.530309+0000 mgr.smithi033.apxevf (mgr.14626) 295 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:06.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.409889+0000 mon.smithi033 (mon.0) 552 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:06.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.410683+0000 mon.smithi033 (mon.0) 553 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:06.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.411307+0000 mon.smithi033 (mon.0) 554 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:37:06.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:05.411831+0000 mgr.smithi033.apxevf (mgr.14626) 293 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:37:06.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.414707+0000 mon.smithi033 (mon.0) 555 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:06.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.419322+0000 mon.smithi033 (mon.0) 556 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:06.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.421397+0000 mon.smithi033 (mon.0) 557 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:06.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.422474+0000 mon.smithi033 (mon.0) 558 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:06.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.423523+0000 mon.smithi033 (mon.0) 559 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:06.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.424883+0000 mon.smithi033 (mon.0) 560 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:06.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:05.426396+0000 mon.smithi033 (mon.0) 561 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi131.ywlevz"]}]: dispatch 2024-02-15T18:37:06.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:05.426854+0000 mgr.smithi033.apxevf (mgr.14626) 294 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi131.ywlevz 2024-02-15T18:37:06.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:05.530309+0000 mgr.smithi033.apxevf (mgr.14626) 295 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:08.414 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:07.083225+0000 mgr.smithi033.apxevf (mgr.14626) 296 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi131.ywlevz 2024-02-15T18:37:08.414 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:07.088488+0000 mon.smithi033 (mon.0) 562 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:08.414 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:07.089460+0000 mon.smithi033 (mon.0) 563 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.ywlevz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:37:08.414 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:07.090367+0000 mon.smithi033 (mon.0) 564 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:08.414 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:07.091144+0000 mgr.smithi033.apxevf (mgr.14626) 297 : cephadm [INF] Deploying daemon mds.cephfs.smithi131.ywlevz on smithi131 2024-02-15T18:37:08.414 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:07.530789+0000 mgr.smithi033.apxevf (mgr.14626) 298 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:08.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:07.083225+0000 mgr.smithi033.apxevf (mgr.14626) 296 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi131.ywlevz 2024-02-15T18:37:08.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:07.088488+0000 mon.smithi033 (mon.0) 562 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:08.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:07.089460+0000 mon.smithi033 (mon.0) 563 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.ywlevz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:37:08.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:07.090367+0000 mon.smithi033 (mon.0) 564 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:08.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:07.091144+0000 mgr.smithi033.apxevf (mgr.14626) 297 : cephadm [INF] Deploying daemon mds.cephfs.smithi131.ywlevz on smithi131 2024-02-15T18:37:08.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:07.530789+0000 mgr.smithi033.apxevf (mgr.14626) 298 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:09.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:37:09.090+0000 7ff975cd0700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T18:37:09.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:08.709115+0000 mon.smithi033 (mon.0) 565 : cluster [DBG] osdmap e82: 6 total, 6 up, 6 in 2024-02-15T18:37:09.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:09.092151+0000 mon.smithi033 (mon.0) 566 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T18:37:09.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:09.092179+0000 mon.smithi033 (mon.0) 567 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T18:37:09.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:09.095995+0000 mon.smithi033 (mon.0) 568 : cluster [INF] Standby daemon mds.cephfs.smithi033.qszefh assigned to filesystem cephfs as rank 0 2024-02-15T18:37:09.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:09.096138+0000 mon.smithi033 (mon.0) 569 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T18:37:09.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:09.096375+0000 mon.smithi033 (mon.0) 570 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-15T18:37:09.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:09.099281+0000 mon.smithi033 (mon.0) 571 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.qszefh=up:replay} 2 up:standby 2024-02-15T18:37:09.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:09 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:09.531142+0000 mgr.smithi033.apxevf (mgr.14626) 299 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:10.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:08.709115+0000 mon.smithi033 (mon.0) 565 : cluster [DBG] osdmap e82: 6 total, 6 up, 6 in 2024-02-15T18:37:10.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:09.092151+0000 mon.smithi033 (mon.0) 566 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-15T18:37:10.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:09.092179+0000 mon.smithi033 (mon.0) 567 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-15T18:37:10.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:09.095995+0000 mon.smithi033 (mon.0) 568 : cluster [INF] Standby daemon mds.cephfs.smithi033.qszefh assigned to filesystem cephfs as rank 0 2024-02-15T18:37:10.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:09.096138+0000 mon.smithi033 (mon.0) 569 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-15T18:37:10.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:09.096375+0000 mon.smithi033 (mon.0) 570 : cluster [DBG] fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-15T18:37:10.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:09.099281+0000 mon.smithi033 (mon.0) 571 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.qszefh=up:replay} 2 up:standby 2024-02-15T18:37:10.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:09 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:09.531142+0000 mgr.smithi033.apxevf (mgr.14626) 299 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:12.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:11.531585+0000 mgr.smithi033.apxevf (mgr.14626) 300 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s rd, 1 op/s 2024-02-15T18:37:13.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:11.531585+0000 mgr.smithi033.apxevf (mgr.14626) 300 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s rd, 1 op/s 2024-02-15T18:37:13.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:12.658345+0000 mon.smithi033 (mon.0) 572 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:13.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:13 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:13.531927+0000 mgr.smithi033.apxevf (mgr.14626) 301 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 8.0 MiB/s rd, 3 op/s 2024-02-15T18:37:13.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:12.658345+0000 mon.smithi033 (mon.0) 572 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:13.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:13 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:13.531927+0000 mgr.smithi033.apxevf (mgr.14626) 301 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 8.0 MiB/s rd, 3 op/s 2024-02-15T18:37:16.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:15.445443+0000 mon.smithi033 (mon.0) 573 : cluster [DBG] mds.? [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] up:reconnect 2024-02-15T18:37:16.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:15.445481+0000 mon.smithi033 (mon.0) 574 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.qszefh=up:reconnect} 2 up:standby 2024-02-15T18:37:16.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:15.447977+0000 mds.cephfs.smithi033.qszefh (mds.0) 1 : cluster [DBG] reconnect by client.24321 v1:172.21.15.33:0/3417379058 after 0.00399994 2024-02-15T18:37:16.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:15.448097+0000 mds.cephfs.smithi033.qszefh (mds.0) 2 : cluster [DBG] reconnect by client.14494 v1:172.21.15.131:0/2340401198 after 0.00399994 2024-02-15T18:37:16.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:15.532375+0000 mgr.smithi033.apxevf (mgr.14626) 302 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-02-15T18:37:16.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:15.445443+0000 mon.smithi033 (mon.0) 573 : cluster [DBG] mds.? [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] up:reconnect 2024-02-15T18:37:16.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:15.445481+0000 mon.smithi033 (mon.0) 574 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.qszefh=up:reconnect} 2 up:standby 2024-02-15T18:37:16.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:15.447977+0000 mds.cephfs.smithi033.qszefh (mds.0) 1 : cluster [DBG] reconnect by client.24321 v1:172.21.15.33:0/3417379058 after 0.00399994 2024-02-15T18:37:16.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:15.448097+0000 mds.cephfs.smithi033.qszefh (mds.0) 2 : cluster [DBG] reconnect by client.14494 v1:172.21.15.131:0/2340401198 after 0.00399994 2024-02-15T18:37:16.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:15.532375+0000 mgr.smithi033.apxevf (mgr.14626) 302 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-02-15T18:37:17.478 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:16.451315+0000 mon.smithi033 (mon.0) 575 : cluster [DBG] mds.? [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] up:rejoin 2024-02-15T18:37:17.478 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:16.451375+0000 mon.smithi033 (mon.0) 576 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.qszefh=up:rejoin} 2 up:standby 2024-02-15T18:37:17.478 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:17 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:16.472199+0000 mon.smithi033 (mon.0) 577 : cluster [INF] daemon mds.cephfs.smithi033.qszefh is now active in filesystem cephfs as rank 0 2024-02-15T18:37:17.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:16.451315+0000 mon.smithi033 (mon.0) 575 : cluster [DBG] mds.? [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] up:rejoin 2024-02-15T18:37:17.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:16.451375+0000 mon.smithi033 (mon.0) 576 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.qszefh=up:rejoin} 2 up:standby 2024-02-15T18:37:17.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:17 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:16.472199+0000 mon.smithi033 (mon.0) 577 : cluster [INF] daemon mds.cephfs.smithi033.qszefh is now active in filesystem cephfs as rank 0 2024-02-15T18:37:18.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:17.449158+0000 mon.smithi033 (mon.0) 578 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T18:37:18.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:17.456662+0000 mon.smithi033 (mon.0) 579 : cluster [DBG] mds.? [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] up:active 2024-02-15T18:37:18.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:17.456743+0000 mon.smithi033 (mon.0) 580 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 2 up:standby 2024-02-15T18:37:18.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:17.532986+0000 mgr.smithi033.apxevf (mgr.14626) 303 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-15T18:37:18.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:17.612905+0000 mon.smithi033 (mon.0) 581 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:18.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:17.613752+0000 mon.smithi033 (mon.0) 582 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:18.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:17.449158+0000 mon.smithi033 (mon.0) 578 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-15T18:37:18.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:17.456662+0000 mon.smithi033 (mon.0) 579 : cluster [DBG] mds.? [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] up:active 2024-02-15T18:37:18.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:17.456743+0000 mon.smithi033 (mon.0) 580 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 2 up:standby 2024-02-15T18:37:18.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:17.532986+0000 mgr.smithi033.apxevf (mgr.14626) 303 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-15T18:37:18.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:17.612905+0000 mon.smithi033 (mon.0) 581 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:18.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:17.613752+0000 mon.smithi033 (mon.0) 582 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:19.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:18.461503+0000 mon.smithi033 (mon.0) 583 : cluster [DBG] mds.? [v2:172.21.15.131:6824/2921613795,v1:172.21.15.131:6825/2921613795] up:boot 2024-02-15T18:37:19.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:18.461578+0000 mon.smithi033 (mon.0) 584 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 3 up:standby 2024-02-15T18:37:19.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:19 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:18.461747+0000 mon.smithi033 (mon.0) 585 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:37:19.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:18.461503+0000 mon.smithi033 (mon.0) 583 : cluster [DBG] mds.? [v2:172.21.15.131:6824/2921613795,v1:172.21.15.131:6825/2921613795] up:boot 2024-02-15T18:37:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:18.461578+0000 mon.smithi033 (mon.0) 584 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 3 up:standby 2024-02-15T18:37:19.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:19 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:18.461747+0000 mon.smithi033 (mon.0) 585 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:37:20.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:19.533460+0000 mgr.smithi033.apxevf (mgr.14626) 304 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 189 B/s wr, 5 op/s 2024-02-15T18:37:20.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:19.533460+0000 mgr.smithi033.apxevf (mgr.14626) 304 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 189 B/s wr, 5 op/s 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.643212+0000 mon.smithi033 (mon.0) 586 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.920409+0000 mon.smithi033 (mon.0) 587 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.921384+0000 mon.smithi033 (mon.0) 588 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:20.922132+0000 mgr.smithi033.apxevf (mgr.14626) 305 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.926558+0000 mon.smithi033 (mon.0) 589 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.932798+0000 mon.smithi033 (mon.0) 590 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.935500+0000 mon.smithi033 (mon.0) 591 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.936941+0000 mon.smithi033 (mon.0) 592 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.938368+0000 mon.smithi033 (mon.0) 593 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.940172+0000 mon.smithi033 (mon.0) 594 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:21.925 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:20.942193+0000 mon.smithi033 (mon.0) 595 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi131.bgnwzs"]}]: dispatch 2024-02-15T18:37:21.926 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:20.942810+0000 mgr.smithi033.apxevf (mgr.14626) 306 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi131.bgnwzs 2024-02-15T18:37:21.926 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:21.534007+0000 mgr.smithi033.apxevf (mgr.14626) 307 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 426 B/s wr, 7 op/s 2024-02-15T18:37:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.643212+0000 mon.smithi033 (mon.0) 586 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.920409+0000 mon.smithi033 (mon.0) 587 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.921384+0000 mon.smithi033 (mon.0) 588 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:37:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:20.922132+0000 mgr.smithi033.apxevf (mgr.14626) 305 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:37:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.926558+0000 mon.smithi033 (mon.0) 589 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.932798+0000 mon.smithi033 (mon.0) 590 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.935500+0000 mon.smithi033 (mon.0) 591 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.936941+0000 mon.smithi033 (mon.0) 592 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.938368+0000 mon.smithi033 (mon.0) 593 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.940172+0000 mon.smithi033 (mon.0) 594 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:20.942193+0000 mon.smithi033 (mon.0) 595 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi131.bgnwzs"]}]: dispatch 2024-02-15T18:37:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:20.942810+0000 mgr.smithi033.apxevf (mgr.14626) 306 : cephadm [INF] Upgrade: It appears safe to stop mds.cephfs.smithi131.bgnwzs 2024-02-15T18:37:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:21.534007+0000 mgr.smithi033.apxevf (mgr.14626) 307 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 12 MiB/s rd, 426 B/s wr, 7 op/s 2024-02-15T18:37:23.578 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:22.369693+0000 mgr.smithi033.apxevf (mgr.14626) 308 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi131.bgnwzs 2024-02-15T18:37:23.578 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:22.375153+0000 mon.smithi033 (mon.0) 596 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:23.578 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:22.376177+0000 mon.smithi033 (mon.0) 597 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.bgnwzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:37:23.578 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:22.376985+0000 mon.smithi033 (mon.0) 598 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:23.578 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:22.377674+0000 mgr.smithi033.apxevf (mgr.14626) 309 : cephadm [INF] Deploying daemon mds.cephfs.smithi131.bgnwzs on smithi131 2024-02-15T18:37:23.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:22.369693+0000 mgr.smithi033.apxevf (mgr.14626) 308 : cephadm [INF] Upgrade: Updating mds.cephfs.smithi131.bgnwzs 2024-02-15T18:37:23.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:22.375153+0000 mon.smithi033 (mon.0) 596 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:23.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:22.376177+0000 mon.smithi033 (mon.0) 597 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.bgnwzs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-15T18:37:23.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:22.376985+0000 mon.smithi033 (mon.0) 598 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:23.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:22.377674+0000 mgr.smithi033.apxevf (mgr.14626) 309 : cephadm [INF] Deploying daemon mds.cephfs.smithi131.bgnwzs on smithi131 2024-02-15T18:37:24.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:23.534413+0000 mgr.smithi033.apxevf (mgr.14626) 310 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 8.2 MiB/s rd, 426 B/s wr, 6 op/s 2024-02-15T18:37:24.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:23.832357+0000 mon.smithi033 (mon.0) 599 : cluster [WRN] daemon mds.cephfs.smithi131.bgnwzs compat changed unexpectedly 2024-02-15T18:37:24.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:23.836873+0000 mon.smithi033 (mon.0) 600 : cluster [DBG] osdmap e83: 6 total, 6 up, 6 in 2024-02-15T18:37:24.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:23.534413+0000 mgr.smithi033.apxevf (mgr.14626) 310 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 8.2 MiB/s rd, 426 B/s wr, 6 op/s 2024-02-15T18:37:24.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:23.832357+0000 mon.smithi033 (mon.0) 599 : cluster [WRN] daemon mds.cephfs.smithi131.bgnwzs compat changed unexpectedly 2024-02-15T18:37:24.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:23.836873+0000 mon.smithi033 (mon.0) 600 : cluster [DBG] osdmap e83: 6 total, 6 up, 6 in 2024-02-15T18:37:25.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:24.380895+0000 mon.smithi033 (mon.0) 601 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 2 up:standby 2024-02-15T18:37:25.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:24.380895+0000 mon.smithi033 (mon.0) 601 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 2 up:standby 2024-02-15T18:37:26.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:25.535106+0000 mgr.smithi033.apxevf (mgr.14626) 311 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T18:37:26.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:25.535106+0000 mgr.smithi033.apxevf (mgr.14626) 311 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s rd, 511 B/s wr, 5 op/s 2024-02-15T18:37:28.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:27.535630+0000 mgr.smithi033.apxevf (mgr.14626) 312 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 413 KiB/s rd, 5.7 KiB/s wr, 6 op/s 2024-02-15T18:37:28.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:27.608879+0000 mon.smithi033 (mon.0) 602 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:37:28.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:27.657606+0000 mon.smithi033 (mon.0) 603 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:27.535630+0000 mgr.smithi033.apxevf (mgr.14626) 312 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 413 KiB/s rd, 5.7 KiB/s wr, 6 op/s 2024-02-15T18:37:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:27.608879+0000 mon.smithi033 (mon.0) 602 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:37:29.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:27.657606+0000 mon.smithi033 (mon.0) 603 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:30.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:29.536115+0000 mgr.smithi033.apxevf (mgr.14626) 313 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.3 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-02-15T18:37:30.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:29.553179+0000 mon.smithi033 (mon.0) 604 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:30.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:29.554108+0000 mon.smithi033 (mon.0) 605 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:30.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:30.177485+0000 mon.smithi033 (mon.0) 606 : cluster [DBG] mds.? [v2:172.21.15.131:6826/2360346875,v1:172.21.15.131:6827/2360346875] up:boot 2024-02-15T18:37:30.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:30.177538+0000 mon.smithi033 (mon.0) 607 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 3 up:standby 2024-02-15T18:37:30.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:30.177625+0000 mon.smithi033 (mon.0) 608 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:37:30.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:29.536115+0000 mgr.smithi033.apxevf (mgr.14626) 313 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.3 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-02-15T18:37:30.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:29.553179+0000 mon.smithi033 (mon.0) 604 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:30.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:29.554108+0000 mon.smithi033 (mon.0) 605 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:30.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:30.177485+0000 mon.smithi033 (mon.0) 606 : cluster [DBG] mds.? [v2:172.21.15.131:6826/2360346875,v1:172.21.15.131:6827/2360346875] up:boot 2024-02-15T18:37:30.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:30.177538+0000 mon.smithi033 (mon.0) 607 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 3 up:standby 2024-02-15T18:37:30.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:30.177625+0000 mon.smithi033 (mon.0) 608 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:37:32.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:31.536682+0000 mgr.smithi033.apxevf (mgr.14626) 314 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.2 KiB/s wr, 2 op/s 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.615055+0000 mon.smithi033 (mon.0) 609 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.615988+0000 mon.smithi033 (mon.0) 610 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.616831+0000 mon.smithi033 (mon.0) 611 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.621419+0000 mon.smithi033 (mon.0) 612 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.627611+0000 mon.smithi033 (mon.0) 613 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.630454+0000 mon.smithi033 (mon.0) 614 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.631893+0000 mon.smithi033 (mon.0) 615 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.633319+0000 mon.smithi033 (mon.0) 616 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.635097+0000 mon.smithi033 (mon.0) 617 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.637115+0000 mon.smithi033 (mon.0) 618 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:32.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.641869+0000 mon.smithi033 (mon.0) 619 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.642739+0000 mon.smithi033 (mon.0) 620 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:37:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.645890+0000 mon.smithi033 (mon.0) 621 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.mcppgd"}]': finished 2024-02-15T18:37:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.646570+0000 mon.smithi033 (mon.0) 622 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:37:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.649815+0000 mon.smithi033 (mon.0) 623 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.qszefh"}]': finished 2024-02-15T18:37:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.650556+0000 mon.smithi033 (mon.0) 624 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:37:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.653720+0000 mon.smithi033 (mon.0) 625 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.bgnwzs"}]': finished 2024-02-15T18:37:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.654525+0000 mon.smithi033 (mon.0) 626 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:37:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.657680+0000 mon.smithi033 (mon.0) 627 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.ywlevz"}]': finished 2024-02-15T18:37:32.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:31.658591+0000 mon.smithi033 (mon.0) 628 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:31.536682+0000 mgr.smithi033.apxevf (mgr.14626) 314 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.2 KiB/s wr, 2 op/s 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.615055+0000 mon.smithi033 (mon.0) 609 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.615988+0000 mon.smithi033 (mon.0) 610 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.616831+0000 mon.smithi033 (mon.0) 611 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.621419+0000 mon.smithi033 (mon.0) 612 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.627611+0000 mon.smithi033 (mon.0) 613 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.630454+0000 mon.smithi033 (mon.0) 614 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.631893+0000 mon.smithi033 (mon.0) 615 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.633319+0000 mon.smithi033 (mon.0) 616 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.635097+0000 mon.smithi033 (mon.0) 617 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.637115+0000 mon.smithi033 (mon.0) 618 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.641869+0000 mon.smithi033 (mon.0) 619 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.642739+0000 mon.smithi033 (mon.0) 620 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.mcppgd"}]: dispatch 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.645890+0000 mon.smithi033 (mon.0) 621 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.mcppgd"}]': finished 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.646570+0000 mon.smithi033 (mon.0) 622 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.qszefh"}]: dispatch 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.649815+0000 mon.smithi033 (mon.0) 623 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi033.qszefh"}]': finished 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.650556+0000 mon.smithi033 (mon.0) 624 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.bgnwzs"}]: dispatch 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.653720+0000 mon.smithi033 (mon.0) 625 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.bgnwzs"}]': finished 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.654525+0000 mon.smithi033 (mon.0) 626 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.ywlevz"}]: dispatch 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.657680+0000 mon.smithi033 (mon.0) 627 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.ywlevz"}]': finished 2024-02-15T18:37:33.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:31.658591+0000 mon.smithi033 (mon.0) 628 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-15T18:37:33.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.225+0000 7f310619d700 1 -- 172.21.15.33:0/638549717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 msgr2=0x7f31000f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.225+0000 7f310619d700 1 --2- 172.21.15.33:0/638549717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 0x7f31000f9110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f30fc004660 tx=0x7f30fc009b30).stop 2024-02-15T18:37:33.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.225+0000 7f310619d700 1 -- 172.21.15.33:0/638549717 shutdown_connections 2024-02-15T18:37:33.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.225+0000 7f310619d700 1 --2- 172.21.15.33:0/638549717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31000f9690 0x7f31000fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.225+0000 7f310619d700 1 --2- 172.21.15.33:0/638549717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 0x7f31000f9110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.225+0000 7f310619d700 1 -- 172.21.15.33:0/638549717 >> 172.21.15.33:0/638549717 conn(0x7f31000f0b90 msgr2=0x7f31000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.225+0000 7f310619d700 1 -- 172.21.15.33:0/638549717 shutdown_connections 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310619d700 1 -- 172.21.15.33:0/638549717 wait complete. 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310619d700 1 Processor -- start 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310619d700 1 -- start start 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310619d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 0x7f3100106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310619d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31000f9690 0x7f3100107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310619d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3100107900 con 0x7f3100060310 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310619d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3100108110 con 0x7f31000f9690 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310519b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 0x7f3100106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:33.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310519b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 0x7f3100106e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58396/0 (socket says 172.21.15.33:58396) 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.226+0000 7f310519b700 1 -- 172.21.15.33:0/156460890 learned_addr learned my addr 172.21.15.33:0/156460890 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f310499a700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31000f9690 0x7f3100107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f310519b700 1 -- 172.21.15.33:0/156460890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31000f9690 msgr2=0x7f3100107300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f310519b700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31000f9690 0x7f3100107300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f310519b700 1 -- 172.21.15.33:0/156460890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc005040 con 0x7f3100060310 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f310499a700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31000f9690 0x7f3100107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f310519b700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 0x7f3100106e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f30fc009f50 tx=0x7f30fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f30f1ffb700 1 -- 172.21.15.33:0/156460890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30fc018070 con 0x7f3100060310 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3100108330 con 0x7f3100060310 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3100108890 con 0x7f3100060310 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f30f1ffb700 1 -- 172.21.15.33:0/156460890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f30fc007ba0 con 0x7f3100060310 2024-02-15T18:37:33.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.227+0000 7f30f1ffb700 1 -- 172.21.15.33:0/156460890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30fc01c3c0 con 0x7f3100060310 2024-02-15T18:37:33.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.228+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e0004fa0 con 0x7f3100060310 2024-02-15T18:37:33.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.229+0000 7f30f1ffb700 1 -- 172.21.15.33:0/156460890 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f30fc01d420 con 0x7f3100060310 2024-02-15T18:37:33.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.229+0000 7f30f1ffb700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f30ec060f70 0x7f30ec063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:33.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.229+0000 7f30f1ffb700 1 -- 172.21.15.33:0/156460890 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f30fc07de70 con 0x7f3100060310 2024-02-15T18:37:33.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.230+0000 7f310499a700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f30ec060f70 0x7f30ec063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:33.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.230+0000 7f310499a700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f30ec060f70 0x7f30ec063430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f30f4009fd0 tx=0x7f30f400b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:33.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.233+0000 7f30f1ffb700 1 -- 172.21.15.33:0/156460890 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f30fc04e1e0 con 0x7f3100060310 2024-02-15T18:37:33.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.422+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30e0000bc0 con 0x7f30ec060f70 2024-02-15T18:37:33.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.423+0000 7f30f1ffb700 1 -- 172.21.15.33:0/156460890 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f30e0000bc0 con 0x7f30ec060f70 2024-02-15T18:37:33.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f30ec060f70 msgr2=0x7f30ec063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f30ec060f70 0x7f30ec063430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f30f4009fd0 tx=0x7f30f400b040).stop 2024-02-15T18:37:33.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 msgr2=0x7f3100106e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 0x7f3100106e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f30fc009f50 tx=0x7f30fc009b30).stop 2024-02-15T18:37:33.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 shutdown_connections 2024-02-15T18:37:33.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f30ec060f70 0x7f30ec063430 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3100060310 0x7f3100106e10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 --2- 172.21.15.33:0/156460890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31000f9690 0x7f3100107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 >> 172.21.15.33:0/156460890 conn(0x7f31000f0b90 msgr2=0x7f31000f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 shutdown_connections 2024-02-15T18:37:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.425+0000 7f310619d700 1 -- 172.21.15.33:0/156460890 wait complete. 2024-02-15T18:37:33.427 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:37:33.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.533+0000 7f82b3fff700 1 -- 172.21.15.33:0/1944885301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40fba60 msgr2=0x7f82b40fde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.533+0000 7f82b3fff700 1 --2- 172.21.15.33:0/1944885301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40fba60 0x7f82b40fde50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f82a8004660 tx=0x7f82a8009b30).stop 2024-02-15T18:37:33.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.533+0000 7f82b3fff700 1 -- 172.21.15.33:0/1944885301 shutdown_connections 2024-02-15T18:37:33.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.533+0000 7f82b3fff700 1 --2- 172.21.15.33:0/1944885301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40fba60 0x7f82b40fde50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.533+0000 7f82b3fff700 1 --2- 172.21.15.33:0/1944885301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40602b0 0x7f82b40fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.533+0000 7f82b3fff700 1 -- 172.21.15.33:0/1944885301 >> 172.21.15.33:0/1944885301 conn(0x7f82b40f0b90 msgr2=0x7f82b40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:33.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.533+0000 7f82b3fff700 1 -- 172.21.15.33:0/1944885301 shutdown_connections 2024-02-15T18:37:33.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.533+0000 7f82b3fff700 1 -- 172.21.15.33:0/1944885301 wait complete. 2024-02-15T18:37:33.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.534+0000 7f82b3fff700 1 Processor -- start 2024-02-15T18:37:33.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.534+0000 7f82b3fff700 1 -- start start 2024-02-15T18:37:33.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.534+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40602b0 0x7f82b4108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.534+0000 7f82b3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40fba60 0x7f82b41094d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.534+0000 7f82b3fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4109a80 con 0x7f82b40602b0 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.534+0000 7f82b3fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4109bc0 con 0x7f82b40fba60 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.534+0000 7f82b2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40602b0 0x7f82b4108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.534+0000 7f82b2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40602b0 0x7f82b4108fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58414/0 (socket says 172.21.15.33:58414) 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.534+0000 7f82b2ffd700 1 -- 172.21.15.33:0/4162759529 learned_addr learned my addr 172.21.15.33:0/4162759529 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f82b27fc700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40fba60 0x7f82b41094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f82b2ffd700 1 -- 172.21.15.33:0/4162759529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40fba60 msgr2=0x7f82b41094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f82b2ffd700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40fba60 0x7f82b41094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f82b2ffd700 1 -- 172.21.15.33:0/4162759529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8005040 con 0x7f82b40602b0 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f82b2ffd700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40602b0 0x7f82b4108fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f82a40026d0 tx=0x7f82a4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f829b7fe700 1 -- 172.21.15.33:0/4162759529 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82a40079c0 con 0x7f82b40602b0 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f829b7fe700 1 -- 172.21.15.33:0/4162759529 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f82a400f040 con 0x7f82b40602b0 2024-02-15T18:37:33.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b410a560 con 0x7f82b40602b0 2024-02-15T18:37:33.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f829b7fe700 1 -- 172.21.15.33:0/4162759529 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82a40149f0 con 0x7f82b40602b0 2024-02-15T18:37:33.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.535+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b410ab20 con 0x7f82b40602b0 2024-02-15T18:37:33.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.536+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b4045ad0 con 0x7f82b40602b0 2024-02-15T18:37:33.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.537+0000 7f829b7fe700 1 -- 172.21.15.33:0/4162759529 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f82a4007b20 con 0x7f82b40602b0 2024-02-15T18:37:33.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.537+0000 7f829b7fe700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f829c060f70 0x7f829c063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:33.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.537+0000 7f829b7fe700 1 -- 172.21.15.33:0/4162759529 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f82a407c0c0 con 0x7f82b40602b0 2024-02-15T18:37:33.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.537+0000 7f82b27fc700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f829c060f70 0x7f829c063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:33.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.538+0000 7f82b27fc700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f829c060f70 0x7f829c063430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f82a8004630 tx=0x7f82a8009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:33.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.541+0000 7f829b7fe700 1 -- 172.21.15.33:0/4162759529 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f82a4050050 con 0x7f82b40602b0 2024-02-15T18:37:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.736+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82b4101170 con 0x7f829c060f70 2024-02-15T18:37:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.738+0000 7f829b7fe700 1 -- 172.21.15.33:0/4162759529 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f82b4101170 con 0x7f829c060f70 2024-02-15T18:37:33.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.739+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f829c060f70 msgr2=0x7f829c063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.739+0000 7f82b3fff700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f829c060f70 0x7f829c063430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f82a8004630 tx=0x7f82a8009b30).stop 2024-02-15T18:37:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.739+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40602b0 msgr2=0x7f82b4108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.739+0000 7f82b3fff700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40602b0 0x7f82b4108fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f82a40026d0 tx=0x7f82a4009de0).stop 2024-02-15T18:37:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.739+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 shutdown_connections 2024-02-15T18:37:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.739+0000 7f82b3fff700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f829c060f70 0x7f829c063430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.739+0000 7f82b3fff700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b40602b0 0x7f82b4108fe0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.739+0000 7f82b3fff700 1 --2- 172.21.15.33:0/4162759529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82b40fba60 0x7f82b41094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.739+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 >> 172.21.15.33:0/4162759529 conn(0x7f82b40f0b90 msgr2=0x7f82b40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.740+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 shutdown_connections 2024-02-15T18:37:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.740+0000 7f82b3fff700 1 -- 172.21.15.33:0/4162759529 wait complete. 2024-02-15T18:37:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:31.617573+0000 mgr.smithi033.apxevf (mgr.14626) 315 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:37:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:31.637797+0000 mgr.smithi033.apxevf (mgr.14626) 316 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-15T18:37:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:31.658374+0000 mgr.smithi033.apxevf (mgr.14626) 317 : cephadm [INF] Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-02-15T18:37:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:32.655659+0000 mon.smithi033 (mon.0) 629 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:37:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.659344+0000 mon.smithi033 (mon.0) 630 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T18:37:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:32.659421+0000 mon.smithi033 (mon.0) 631 : cluster [INF] daemon mds.cephfs.smithi033.mcppgd assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T18:37:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:32.659538+0000 mon.smithi033 (mon.0) 632 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:37:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:32.659798+0000 mon.smithi033 (mon.0) 633 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 3 up:standby 2024-02-15T18:37:33.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:32.662943+0000 mon.smithi033 (mon.0) 634 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi033.qszefh=up:active,1=cephfs.smithi033.mcppgd=up:starting} 2 up:standby 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.668629+0000 mon.smithi033 (mon.0) 635 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:32.669352+0000 mon.smithi033 (mon.0) 636 : cluster [INF] daemon mds.cephfs.smithi033.mcppgd is now active in filesystem cephfs as rank 1 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.669756+0000 mon.smithi033 (mon.0) 637 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.674440+0000 mon.smithi033 (mon.0) 638 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.675623+0000 mon.smithi033 (mon.0) 639 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.679951+0000 mon.smithi033 (mon.0) 640 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.681011+0000 mon.smithi033 (mon.0) 641 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.682156+0000 mon.smithi033 (mon.0) 642 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.686325+0000 mon.smithi033 (mon.0) 643 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.687423+0000 mon.smithi033 (mon.0) 644 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:32.691643+0000 mon.smithi033 (mon.0) 645 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.848+0000 7feee6071700 1 -- 172.21.15.33:0/2558037940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 msgr2=0x7feee00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.848+0000 7feee6071700 1 --2- 172.21.15.33:0/2558037940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 0x7feee00f59e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7feed0004660 tx=0x7feed0009b30).stop 2024-02-15T18:37:33.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.848+0000 7feee6071700 1 -- 172.21.15.33:0/2558037940 shutdown_connections 2024-02-15T18:37:33.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.848+0000 7feee6071700 1 --2- 172.21.15.33:0/2558037940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee00f6860 0x7feee00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.848+0000 7feee6071700 1 --2- 172.21.15.33:0/2558037940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 0x7feee00f59e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.848+0000 7feee6071700 1 -- 172.21.15.33:0/2558037940 >> 172.21.15.33:0/2558037940 conn(0x7feee00f0d40 msgr2=0x7feee00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:33.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.848+0000 7feee6071700 1 -- 172.21.15.33:0/2558037940 shutdown_connections 2024-02-15T18:37:33.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.848+0000 7feee6071700 1 -- 172.21.15.33:0/2558037940 wait complete. 2024-02-15T18:37:33.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.849+0000 7feee6071700 1 Processor -- start 2024-02-15T18:37:33.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.849+0000 7feee6071700 1 -- start start 2024-02-15T18:37:33.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.849+0000 7feee6071700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 0x7feee0105f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:33.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.849+0000 7feee6071700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee00f6860 0x7feee01063f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:33.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.849+0000 7feee6071700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee01069a0 con 0x7feee00f55c0 2024-02-15T18:37:33.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.849+0000 7feee6071700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee0106ae0 con 0x7feee00f6860 2024-02-15T18:37:33.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feedf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 0x7feee0105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feedf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 0x7feee0105f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58430/0 (socket says 172.21.15.33:58430) 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feedf7fe700 1 -- 172.21.15.33:0/65659229 learned_addr learned my addr 172.21.15.33:0/65659229 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feedeffd700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee00f6860 0x7feee01063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feedf7fe700 1 -- 172.21.15.33:0/65659229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee00f6860 msgr2=0x7feee01063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feedf7fe700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee00f6860 0x7feee01063f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feedf7fe700 1 -- 172.21.15.33:0/65659229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed0005040 con 0x7feee00f55c0 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feedf7fe700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 0x7feee0105f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7feed0002040 tx=0x7feed000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feec7fff700 1 -- 172.21.15.33:0/65659229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feed0019070 con 0x7feee00f55c0 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feec7fff700 1 -- 172.21.15.33:0/65659229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7feed0014420 con 0x7feee00f55c0 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee0107420 con 0x7feee00f55c0 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feec7fff700 1 -- 172.21.15.33:0/65659229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feed001d5c0 con 0x7feee00f55c0 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.850+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee0107980 con 0x7feee00f55c0 2024-02-15T18:37:33.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.851+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee0045ad0 con 0x7feee00f55c0 2024-02-15T18:37:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.852+0000 7feec7fff700 1 -- 172.21.15.33:0/65659229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7feed0025070 con 0x7feee00f55c0 2024-02-15T18:37:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.852+0000 7feec7fff700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feec8060f20 0x7feec80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.852+0000 7feec7fff700 1 -- 172.21.15.33:0/65659229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7feed007d0c0 con 0x7feee00f55c0 2024-02-15T18:37:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.852+0000 7feedeffd700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feec8060f20 0x7feec80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:33.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.853+0000 7feedeffd700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feec8060f20 0x7feec80633e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7feed4007f80 tx=0x7feed400b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:33.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:33.856+0000 7feec7fff700 1 -- 172.21.15.33:0/65659229 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7feed0050f20 con 0x7feee00f55c0 2024-02-15T18:37:33.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:31.617573+0000 mgr.smithi033.apxevf (mgr.14626) 315 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:37:33.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:31.637797+0000 mgr.smithi033.apxevf (mgr.14626) 316 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-15T18:37:33.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:31.658374+0000 mgr.smithi033.apxevf (mgr.14626) 317 : cephadm [INF] Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-02-15T18:37:33.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:32.655659+0000 mon.smithi033 (mon.0) 629 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.659344+0000 mon.smithi033 (mon.0) 630 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:32.659421+0000 mon.smithi033 (mon.0) 631 : cluster [INF] daemon mds.cephfs.smithi033.mcppgd assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:32.659538+0000 mon.smithi033 (mon.0) 632 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:32.659798+0000 mon.smithi033 (mon.0) 633 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.qszefh=up:active} 3 up:standby 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:32.662943+0000 mon.smithi033 (mon.0) 634 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi033.qszefh=up:active,1=cephfs.smithi033.mcppgd=up:starting} 2 up:standby 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.668629+0000 mon.smithi033 (mon.0) 635 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:32.669352+0000 mon.smithi033 (mon.0) 636 : cluster [INF] daemon mds.cephfs.smithi033.mcppgd is now active in filesystem cephfs as rank 1 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.669756+0000 mon.smithi033 (mon.0) 637 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.674440+0000 mon.smithi033 (mon.0) 638 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.675623+0000 mon.smithi033 (mon.0) 639 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.679951+0000 mon.smithi033 (mon.0) 640 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.681011+0000 mon.smithi033 (mon.0) 641 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.682156+0000 mon.smithi033 (mon.0) 642 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.686325+0000 mon.smithi033 (mon.0) 643 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:33.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.687423+0000 mon.smithi033 (mon.0) 644 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:33.998 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:32.691643+0000 mon.smithi033 (mon.0) 645 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:34.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.043+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feee00fe010 con 0x7feec8060f20 2024-02-15T18:37:34.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.053+0000 7feec7fff700 1 -- 172.21.15.33:0/65659229 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7feee00fe010 con 0x7feec8060f20 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (12m) 28s ago 14m 21.2M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (4m) 28s ago 14m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (4m) 2s ago 13m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (12m) 28s ago 13m 34.4M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (34s) 28s ago 8m 14.4M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a4a346f4654 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (48s) 28s ago 8m 13.8M - 16.2.14-521-g0e714d9a 1fbc92c859dc e375dd9e3a03 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (5s) 2s ago 8m 13.2M - 16.2.14-521-g0e714d9a 1fbc92c859dc 476396a5b16a 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (17s) 2s ago 8m 11.5M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4201a4414604 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (6m) 28s ago 15m 438M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (5m) 2s ago 13m 390M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (5m) 28s ago 15m 52.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (5m) 2s ago 13m 51.3M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:37:34.043 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (13m) 28s ago 13m 17.2M - 0.18.1 e5a616e4b9cf c3ae46fe0c51 2024-02-15T18:37:34.044 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (12m) 2s ago 12m 17.1M - 0.18.1 e5a616e4b9cf 0900c450bb9e 2024-02-15T18:37:34.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (4m) 28s ago 12m 198M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:37:34.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (3m) 28s ago 12m 200M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:37:34.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (3m) 28s ago 11m 201M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:37:34.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (2m) 2s ago 11m 268M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4030e9f6d6c2 2024-02-15T18:37:34.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (2m) 2s ago 10m 256M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 902c89c867aa 2024-02-15T18:37:34.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (101s) 2s ago 10m 257M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc ba19a3c17a66 2024-02-15T18:37:34.044 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (6m) 28s ago 13m 68.1M - 2.18.1 de242295e225 23b85a25c122 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.054+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feec8060f20 msgr2=0x7feec80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.054+0000 7feee6071700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feec8060f20 0x7feec80633e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7feed4007f80 tx=0x7feed400b040).stop 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.054+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 msgr2=0x7feee0105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.054+0000 7feee6071700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 0x7feee0105f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7feed0002040 tx=0x7feed000b040).stop 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.054+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 shutdown_connections 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.054+0000 7feee6071700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feec8060f20 0x7feec80633e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.054+0000 7feee6071700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee00f55c0 0x7feee0105f00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.054+0000 7feee6071700 1 --2- 172.21.15.33:0/65659229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee00f6860 0x7feee01063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.054+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 >> 172.21.15.33:0/65659229 conn(0x7feee00f0d40 msgr2=0x7feee00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.055+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 shutdown_connections 2024-02-15T18:37:34.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.055+0000 7feee6071700 1 -- 172.21.15.33:0/65659229 wait complete. 2024-02-15T18:37:34.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.155+0000 7f081605f700 1 -- 172.21.15.33:0/2291178933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 msgr2=0x7f08100f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.155+0000 7f081605f700 1 --2- 172.21.15.33:0/2291178933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 0x7f08100f7fe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0804004660 tx=0x7f0804009b30).stop 2024-02-15T18:37:34.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.155+0000 7f081605f700 1 -- 172.21.15.33:0/2291178933 shutdown_connections 2024-02-15T18:37:34.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.155+0000 7f081605f700 1 --2- 172.21.15.33:0/2291178933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 0x7f08100f7fe0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.155+0000 7f081605f700 1 --2- 172.21.15.33:0/2291178933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08100f68e0 0x7f08100f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.155+0000 7f081605f700 1 -- 172.21.15.33:0/2291178933 >> 172.21.15.33:0/2291178933 conn(0x7f08100f2020 msgr2=0x7f08100f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:34.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.155+0000 7f081605f700 1 -- 172.21.15.33:0/2291178933 shutdown_connections 2024-02-15T18:37:34.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.155+0000 7f081605f700 1 -- 172.21.15.33:0/2291178933 wait complete. 2024-02-15T18:37:34.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.156+0000 7f081605f700 1 Processor -- start 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.156+0000 7f081605f700 1 -- start start 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.156+0000 7f081605f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08100f68e0 0x7f0810107200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.156+0000 7f081605f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 0x7f08101076f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.156+0000 7f081605f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810107ca0 con 0x7f08100f7b80 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.156+0000 7f081605f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810107de0 con 0x7f08100f68e0 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.156+0000 7f080effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 0x7f08101076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f080effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 0x7f08101076f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58436/0 (socket says 172.21.15.33:58436) 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f080effd700 1 -- 172.21.15.33:0/2786280447 learned_addr learned my addr 172.21.15.33:0/2786280447 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f080f7fe700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08100f68e0 0x7f0810107200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f080effd700 1 -- 172.21.15.33:0/2786280447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08100f68e0 msgr2=0x7f0810107200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f080effd700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08100f68e0 0x7f0810107200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f080effd700 1 -- 172.21.15.33:0/2786280447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804005040 con 0x7f08100f7b80 2024-02-15T18:37:34.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f080effd700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 0x7f08101076f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f0804009f50 tx=0x7f0804009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:34.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f07f7fff700 1 -- 172.21.15.33:0/2786280447 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0804018070 con 0x7f08100f7b80 2024-02-15T18:37:34.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f07f7fff700 1 -- 172.21.15.33:0/2786280447 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f0804007ba0 con 0x7f08100f7b80 2024-02-15T18:37:34.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0810108720 con 0x7f08100f7b80 2024-02-15T18:37:34.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f07f7fff700 1 -- 172.21.15.33:0/2786280447 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f080401c620 con 0x7f08100f7b80 2024-02-15T18:37:34.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.157+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0810108c80 con 0x7f08100f7b80 2024-02-15T18:37:34.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.158+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0810045ad0 con 0x7f08100f7b80 2024-02-15T18:37:34.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.158+0000 7f07f7fff700 1 -- 172.21.15.33:0/2786280447 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f080401d420 con 0x7f08100f7b80 2024-02-15T18:37:34.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.159+0000 7f07f7fff700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f07f8060f20 0x7f07f80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:34.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.159+0000 7f07f7fff700 1 -- 172.21.15.33:0/2786280447 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f080407df10 con 0x7f08100f7b80 2024-02-15T18:37:34.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.159+0000 7f080f7fe700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f07f8060f20 0x7f07f80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:34.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.159+0000 7f080f7fe700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f07f8060f20 0x7f07f80633e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f08100f79e0 tx=0x7f0800009c00).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:34.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.163+0000 7f07f7fff700 1 -- 172.21.15.33:0/2786280447 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0804051d90 con 0x7f08100f7b80 2024-02-15T18:37:34.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.409+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0810027b40 con 0x7f08100f7b80 2024-02-15T18:37:34.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.410+0000 7f07f7fff700 1 -- 172.21.15.33:0/2786280447 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0810027b40 con 0x7f08100f7b80 2024-02-15T18:37:34.400 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:37:34.400 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:37:34.400 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:37:34.401 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:37:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f07f8060f20 msgr2=0x7f07f80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f07f8060f20 0x7f07f80633e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f08100f79e0 tx=0x7f0800009c00).stop 2024-02-15T18:37:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 msgr2=0x7f08101076f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 0x7f08101076f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f0804009f50 tx=0x7f0804009b30).stop 2024-02-15T18:37:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 shutdown_connections 2024-02-15T18:37:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f07f8060f20 0x7f07f80633e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08100f68e0 0x7f0810107200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 --2- 172.21.15.33:0/2786280447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08100f7b80 0x7f08101076f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 >> 172.21.15.33:0/2786280447 conn(0x7f08100f2020 msgr2=0x7f08100fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:34.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 shutdown_connections 2024-02-15T18:37:34.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.412+0000 7f081605f700 1 -- 172.21.15.33:0/2786280447 wait complete. 2024-02-15T18:37:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/188666058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 msgr2=0x7ffb580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 --2- 172.21.15.33:0/188666058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 0x7ffb580f6cc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ffb44004660 tx=0x7ffb44009b30).stop 2024-02-15T18:37:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/188666058 shutdown_connections 2024-02-15T18:37:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 --2- 172.21.15.33:0/188666058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 0x7ffb580f6cc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 --2- 172.21.15.33:0/188666058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb580f55c0 0x7ffb580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/188666058 >> 172.21.15.33:0/188666058 conn(0x7ffb580f0d40 msgr2=0x7ffb580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/188666058 shutdown_connections 2024-02-15T18:37:34.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/188666058 wait complete. 2024-02-15T18:37:34.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 Processor -- start 2024-02-15T18:37:34.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.516+0000 7ffb5f1b5700 1 -- start start 2024-02-15T18:37:34.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb5f1b5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb580f55c0 0x7ffb58109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:34.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb5f1b5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 0x7ffb5810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:34.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb5f1b5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb58060420 con 0x7ffb580f6860 2024-02-15T18:37:34.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb5f1b5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb58060560 con 0x7ffb580f55c0 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 0x7ffb5810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 0x7ffb5810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58448/0 (socket says 172.21.15.33:58448) 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb57fff700 1 -- 172.21.15.33:0/1459708996 learned_addr learned my addr 172.21.15.33:0/1459708996 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb5cf51700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb580f55c0 0x7ffb58109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb57fff700 1 -- 172.21.15.33:0/1459708996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb580f55c0 msgr2=0x7ffb58109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb57fff700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb580f55c0 0x7ffb58109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb57fff700 1 -- 172.21.15.33:0/1459708996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44005040 con 0x7ffb580f6860 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.517+0000 7ffb57fff700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 0x7ffb5810c170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ffb44009f50 tx=0x7ffb44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.518+0000 7ffb557fa700 1 -- 172.21.15.33:0/1459708996 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb44018070 con 0x7ffb580f6860 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.518+0000 7ffb557fa700 1 -- 172.21.15.33:0/1459708996 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7ffb44007ba0 con 0x7ffb580f6860 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.518+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5810c720 con 0x7ffb580f6860 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.518+0000 7ffb557fa700 1 -- 172.21.15.33:0/1459708996 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb4401c420 con 0x7ffb580f6860 2024-02-15T18:37:34.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.518+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5810cc50 con 0x7ffb580f6860 2024-02-15T18:37:34.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.519+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb580f49b0 con 0x7ffb580f6860 2024-02-15T18:37:34.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.519+0000 7ffb557fa700 1 -- 172.21.15.33:0/1459708996 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ffb4401d420 con 0x7ffb580f6860 2024-02-15T18:37:34.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.519+0000 7ffb557fa700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ffb48060f20 0x7ffb480633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:34.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.520+0000 7ffb557fa700 1 -- 172.21.15.33:0/1459708996 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ffb4407dd30 con 0x7ffb580f6860 2024-02-15T18:37:34.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.520+0000 7ffb5cf51700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ffb48060f20 0x7ffb480633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:34.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.520+0000 7ffb5cf51700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ffb48060f20 0x7ffb480633e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ffb580600a0 tx=0x7ffb4c00b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:34.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.524+0000 7ffb557fa700 1 -- 172.21.15.33:0/1459708996 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ffb4404e180 con 0x7ffb580f6860 2024-02-15T18:37:34.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:32.670512+0000 mgr.smithi033.apxevf (mgr.14626) 318 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-15T18:37:34.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:32.676278+0000 mgr.smithi033.apxevf (mgr.14626) 319 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-15T18:37:34.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:32.682775+0000 mgr.smithi033.apxevf (mgr.14626) 320 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-15T18:37:34.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:32.688079+0000 mgr.smithi033.apxevf (mgr.14626) 321 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-15T18:37:34.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:33.423770+0000 mgr.smithi033.apxevf (mgr.14626) 322 : audit [DBG] from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:34.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:33.537139+0000 mgr.smithi033.apxevf (mgr.14626) 323 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 307 B/s rd, 5.2 KiB/s wr, 2 op/s 2024-02-15T18:37:34.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:33.671411+0000 mon.smithi033 (mon.0) 646 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2386752010,v1:172.21.15.33:6829/2386752010] up:active 2024-02-15T18:37:34.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:33.671469+0000 mon.smithi033 (mon.0) 647 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi033.qszefh=up:active,1=cephfs.smithi033.mcppgd=up:active} 2 up:standby 2024-02-15T18:37:34.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:34.410596+0000 mon.smithi033 (mon.0) 648 : audit [DBG] from='client.? 172.21.15.33:0/2786280447' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:e41 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 41 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:37:33.666082+0000 2024-02-15T18:37:34.746 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 82 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=34334,1=34338} 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:37:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{0:34334} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{1:34338} state up:active seq 10 join_fscid=1 addr [v2:172.21.15.33:6828/2386752010,v1:172.21.15.33:6829/2386752010] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6824/2921613795,v1:172.21.15.131:6825/2921613795] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:37:34.748 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/2360346875,v1:172.21.15.131:6827/2360346875] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:37:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.755+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb58045ad0 con 0x7ffb580f6860 2024-02-15T18:37:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.756+0000 7ffb557fa700 1 -- 172.21.15.33:0/1459708996 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1802 (secure 0 0 0) 0x7ffb440517a0 con 0x7ffb580f6860 2024-02-15T18:37:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.757+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ffb48060f20 msgr2=0x7ffb480633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.757+0000 7ffb5f1b5700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ffb48060f20 0x7ffb480633e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ffb580600a0 tx=0x7ffb4c00b040).stop 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.757+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 msgr2=0x7ffb5810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.757+0000 7ffb5f1b5700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 0x7ffb5810c170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ffb44009f50 tx=0x7ffb44009b30).stop 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.757+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 shutdown_connections 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.757+0000 7ffb5f1b5700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ffb48060f20 0x7ffb480633e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.757+0000 7ffb5f1b5700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb580f55c0 0x7ffb58109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.757+0000 7ffb5f1b5700 1 --2- 172.21.15.33:0/1459708996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb580f6860 0x7ffb5810c170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.757+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 >> 172.21.15.33:0/1459708996 conn(0x7ffb580f0d40 msgr2=0x7ffb580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.758+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 shutdown_connections 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.758+0000 7ffb5f1b5700 1 -- 172.21.15.33:0/1459708996 wait complete. 2024-02-15T18:37:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2024-02-15T18:37:34.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.862+0000 7fd8a4883700 1 -- 172.21.15.33:0/2370330385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 msgr2=0x7fd8a00f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.862+0000 7fd8a4883700 1 --2- 172.21.15.33:0/2370330385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 0x7fd8a00f92a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fd894004660 tx=0x7fd894009b30).stop 2024-02-15T18:37:34.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.862+0000 7fd8a4883700 1 -- 172.21.15.33:0/2370330385 shutdown_connections 2024-02-15T18:37:34.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.862+0000 7fd8a4883700 1 --2- 172.21.15.33:0/2370330385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a00f9820 0x7fd8a00fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.862+0000 7fd8a4883700 1 --2- 172.21.15.33:0/2370330385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 0x7fd8a00f92a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.862+0000 7fd8a4883700 1 -- 172.21.15.33:0/2370330385 >> 172.21.15.33:0/2370330385 conn(0x7fd8a00f0d40 msgr2=0x7fd8a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:34.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.862+0000 7fd8a4883700 1 -- 172.21.15.33:0/2370330385 shutdown_connections 2024-02-15T18:37:34.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.862+0000 7fd8a4883700 1 -- 172.21.15.33:0/2370330385 wait complete. 2024-02-15T18:37:34.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd8a4883700 1 Processor -- start 2024-02-15T18:37:34.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd8a4883700 1 -- start start 2024-02-15T18:37:34.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd8a4883700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 0x7fd8a0106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd8a4883700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a00f9820 0x7fd8a01074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd8a4883700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0107a60 con 0x7fd8a0060310 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd8a4883700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0107ba0 con 0x7fd8a00f9820 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd89e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 0x7fd8a0106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd89e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 0x7fd8a0106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58476/0 (socket says 172.21.15.33:58476) 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd89e59c700 1 -- 172.21.15.33:0/4294508152 learned_addr learned my addr 172.21.15.33:0/4294508152 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.863+0000 7fd89dd9b700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a00f9820 0x7fd8a01074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.864+0000 7fd89e59c700 1 -- 172.21.15.33:0/4294508152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a00f9820 msgr2=0x7fd8a01074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.864+0000 7fd89e59c700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a00f9820 0x7fd8a01074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.864+0000 7fd89e59c700 1 -- 172.21.15.33:0/4294508152 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894005040 con 0x7fd8a0060310 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.864+0000 7fd89e59c700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 0x7fd8a0106fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd894013fb0 tx=0x7fd894009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.864+0000 7fd88effd700 1 -- 172.21.15.33:0/4294508152 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd894018070 con 0x7fd8a0060310 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.864+0000 7fd88effd700 1 -- 172.21.15.33:0/4294508152 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fd894009780 con 0x7fd8a0060310 2024-02-15T18:37:34.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.864+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a01084e0 con 0x7fd8a0060310 2024-02-15T18:37:34.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.864+0000 7fd88effd700 1 -- 172.21.15.33:0/4294508152 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd89401c6f0 con 0x7fd8a0060310 2024-02-15T18:37:34.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.864+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a0108a40 con 0x7fd8a0060310 2024-02-15T18:37:34.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.865+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a0045ad0 con 0x7fd8a0060310 2024-02-15T18:37:34.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.866+0000 7fd88effd700 1 -- 172.21.15.33:0/4294508152 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd89401c8b0 con 0x7fd8a0060310 2024-02-15T18:37:34.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.866+0000 7fd88effd700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd888060f20 0x7fd8880633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:37:34.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.866+0000 7fd88effd700 1 -- 172.21.15.33:0/4294508152 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fd89407e020 con 0x7fd8a0060310 2024-02-15T18:37:34.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.866+0000 7fd89dd9b700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd888060f20 0x7fd8880633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:37:34.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.867+0000 7fd89dd9b700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd888060f20 0x7fd8880633e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd8900041d0 tx=0x7fd890009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:37:34.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:34.870+0000 7fd88effd700 1 -- 172.21.15.33:0/4294508152 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd894051e80 con 0x7fd8a0060310 2024-02-15T18:37:34.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:32.670512+0000 mgr.smithi033.apxevf (mgr.14626) 318 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-15T18:37:34.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:32.676278+0000 mgr.smithi033.apxevf (mgr.14626) 319 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-15T18:37:34.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:32.682775+0000 mgr.smithi033.apxevf (mgr.14626) 320 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-15T18:37:34.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:32.688079+0000 mgr.smithi033.apxevf (mgr.14626) 321 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-15T18:37:34.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:33.423770+0000 mgr.smithi033.apxevf (mgr.14626) 322 : audit [DBG] from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:34.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:33.537139+0000 mgr.smithi033.apxevf (mgr.14626) 323 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 307 B/s rd, 5.2 KiB/s wr, 2 op/s 2024-02-15T18:37:34.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:33.671411+0000 mon.smithi033 (mon.0) 646 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2386752010,v1:172.21.15.33:6829/2386752010] up:active 2024-02-15T18:37:34.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:33.671469+0000 mon.smithi033 (mon.0) 647 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi033.qszefh=up:active,1=cephfs.smithi033.mcppgd=up:active} 2 up:standby 2024-02-15T18:37:34.997 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:34.410596+0000 mon.smithi033 (mon.0) 648 : audit [DBG] from='client.? 172.21.15.33:0/2786280447' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:35.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.063+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8a00ff020 con 0x7fd888060f20 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.064+0000 7fd88effd700 1 -- 172.21.15.33:0/4294508152 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fd8a00ff020 con 0x7fd888060f20 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stdout: "mds", 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:37:35.055 INFO:teuthology.orchestra.run.smithi033.stdout: "osd", 2024-02-15T18:37:35.056 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:37:35.056 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:37:35.056 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "16/21 daemons upgraded", 2024-02-15T18:37:35.056 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-15T18:37:35.056 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:37:35.056 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:37:35.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd888060f20 msgr2=0x7fd8880633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd888060f20 0x7fd8880633e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd8900041d0 tx=0x7fd890009040).stop 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 msgr2=0x7fd8a0106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 0x7fd8a0106fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd894013fb0 tx=0x7fd894009b30).stop 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 shutdown_connections 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd888060f20 0x7fd8880633e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8a0060310 0x7fd8a0106fc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 --2- 172.21.15.33:0/4294508152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a00f9820 0x7fd8a01074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 >> 172.21.15.33:0/4294508152 conn(0x7fd8a00f0d40 msgr2=0x7fd8a00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 shutdown_connections 2024-02-15T18:37:35.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:37:35.066+0000 7fd8a4883700 1 -- 172.21.15.33:0/4294508152 wait complete. 2024-02-15T18:37:35.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:33.738152+0000 mgr.smithi033.apxevf (mgr.14626) 324 : audit [DBG] from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:35.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:34.044877+0000 mgr.smithi033.apxevf (mgr.14626) 325 : audit [DBG] from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:35.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:34.352680+0000 mgr.smithi033.apxevf (mgr.14626) 326 : cephadm [INF] Upgrade: Updating node-exporter.smithi033 (1/2) 2024-02-15T18:37:35.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:34.352824+0000 mgr.smithi033.apxevf (mgr.14626) 327 : cephadm [INF] Deploying daemon node-exporter.smithi033 on smithi033 2024-02-15T18:37:35.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:34.756505+0000 mon.smithi033 (mon.0) 649 : audit [DBG] from='client.? 172.21.15.33:0/1459708996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:37:35.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:33.738152+0000 mgr.smithi033.apxevf (mgr.14626) 324 : audit [DBG] from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:35.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:34.044877+0000 mgr.smithi033.apxevf (mgr.14626) 325 : audit [DBG] from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:35.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:34.352680+0000 mgr.smithi033.apxevf (mgr.14626) 326 : cephadm [INF] Upgrade: Updating node-exporter.smithi033 (1/2) 2024-02-15T18:37:35.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:34.352824+0000 mgr.smithi033.apxevf (mgr.14626) 327 : cephadm [INF] Deploying daemon node-exporter.smithi033 on smithi033 2024-02-15T18:37:35.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:34.756505+0000 mon.smithi033 (mon.0) 649 : audit [DBG] from='client.? 172.21.15.33:0/1459708996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:37:36.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:35.064737+0000 mgr.smithi033.apxevf (mgr.14626) 328 : audit [DBG] from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:36.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:35.537614+0000 mgr.smithi033.apxevf (mgr.14626) 329 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 787 B/s rd, 4.5 KiB/s wr, 3 op/s 2024-02-15T18:37:36.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:35.064737+0000 mgr.smithi033.apxevf (mgr.14626) 328 : audit [DBG] from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:37:36.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:35.537614+0000 mgr.smithi033.apxevf (mgr.14626) 329 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 787 B/s rd, 4.5 KiB/s wr, 3 op/s 2024-02-15T18:37:38.883 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:37.538129+0000 mgr.smithi033.apxevf (mgr.14626) 330 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-02-15T18:37:38.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:37.538129+0000 mgr.smithi033.apxevf (mgr.14626) 330 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-02-15T18:37:40.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:39.538525+0000 mgr.smithi033.apxevf (mgr.14626) 331 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T18:37:40.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:39.784125+0000 mon.smithi033 (mon.0) 650 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:40.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:39.538525+0000 mgr.smithi033.apxevf (mgr.14626) 331 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T18:37:40.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:39.784125+0000 mon.smithi033 (mon.0) 650 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:42.594 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:41.190220+0000 mgr.smithi033.apxevf (mgr.14626) 332 : cephadm [INF] Upgrade: Updating node-exporter.smithi131 (2/2) 2024-02-15T18:37:42.595 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:41.190411+0000 mgr.smithi033.apxevf (mgr.14626) 333 : cephadm [INF] Deploying daemon node-exporter.smithi131 on smithi131 2024-02-15T18:37:42.595 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:41.538999+0000 mgr.smithi033.apxevf (mgr.14626) 334 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T18:37:43.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:41.190220+0000 mgr.smithi033.apxevf (mgr.14626) 332 : cephadm [INF] Upgrade: Updating node-exporter.smithi131 (2/2) 2024-02-15T18:37:43.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:41.190411+0000 mgr.smithi033.apxevf (mgr.14626) 333 : cephadm [INF] Deploying daemon node-exporter.smithi131 on smithi131 2024-02-15T18:37:43.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:41.538999+0000 mgr.smithi033.apxevf (mgr.14626) 334 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T18:37:44.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:43.539456+0000 mgr.smithi033.apxevf (mgr.14626) 335 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T18:37:45.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:43.539456+0000 mgr.smithi033.apxevf (mgr.14626) 335 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T18:37:46.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:45.539862+0000 mgr.smithi033.apxevf (mgr.14626) 336 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.4 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T18:37:46.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:45.596075+0000 mon.smithi033 (mon.0) 651 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:46.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:45.597076+0000 mon.smithi033 (mon.0) 652 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:47.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:45.539862+0000 mgr.smithi033.apxevf (mgr.14626) 336 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.4 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-15T18:37:47.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:45.596075+0000 mon.smithi033 (mon.0) 651 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:47.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:45.597076+0000 mon.smithi033 (mon.0) 652 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:48.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:47.540550+0000 mgr.smithi033.apxevf (mgr.14626) 337 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-02-15T18:37:48.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:47.816200+0000 mon.smithi033 (mon.0) 653 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:48.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:47.540550+0000 mgr.smithi033.apxevf (mgr.14626) 337 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-02-15T18:37:48.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:47.816200+0000 mon.smithi033 (mon.0) 653 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:50.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:49.541066+0000 mgr.smithi033.apxevf (mgr.14626) 338 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-02-15T18:37:50.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:49.541066+0000 mgr.smithi033.apxevf (mgr.14626) 338 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-02-15T18:37:52.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.016651+0000 mon.smithi033 (mon.0) 654 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:52.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.017376+0000 mon.smithi033 (mon.0) 655 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:52.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.018004+0000 mon.smithi033 (mon.0) 656 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:37:52.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:51.018540+0000 mgr.smithi033.apxevf (mgr.14626) 339 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:37:52.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.021434+0000 mon.smithi033 (mon.0) 657 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:52.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.026106+0000 mon.smithi033 (mon.0) 658 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:52.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.028092+0000 mon.smithi033 (mon.0) 659 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.029194+0000 mon.smithi033 (mon.0) 660 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.030251+0000 mon.smithi033 (mon.0) 661 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.031575+0000 mon.smithi033 (mon.0) 662 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.033109+0000 mon.smithi033 (mon.0) 663 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.034011+0000 mon.smithi033 (mon.0) 664 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.034888+0000 mon.smithi033 (mon.0) 665 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.035752+0000 mon.smithi033 (mon.0) 666 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.036591+0000 mon.smithi033 (mon.0) 667 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.037574+0000 mon.smithi033 (mon.0) 668 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:51.038741+0000 mon.smithi033 (mon.0) 669 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:51.541481+0000 mgr.smithi033.apxevf (mgr.14626) 340 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:52.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.016651+0000 mon.smithi033 (mon.0) 654 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:52.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.017376+0000 mon.smithi033 (mon.0) 655 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:37:52.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.018004+0000 mon.smithi033 (mon.0) 656 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:51.018540+0000 mgr.smithi033.apxevf (mgr.14626) 339 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.021434+0000 mon.smithi033 (mon.0) 657 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.026106+0000 mon.smithi033 (mon.0) 658 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.028092+0000 mon.smithi033 (mon.0) 659 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.029194+0000 mon.smithi033 (mon.0) 660 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.030251+0000 mon.smithi033 (mon.0) 661 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.031575+0000 mon.smithi033 (mon.0) 662 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.033109+0000 mon.smithi033 (mon.0) 663 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.034011+0000 mon.smithi033 (mon.0) 664 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.034888+0000 mon.smithi033 (mon.0) 665 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.035752+0000 mon.smithi033 (mon.0) 666 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.036591+0000 mon.smithi033 (mon.0) 667 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.037574+0000 mon.smithi033 (mon.0) 668 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:51.038741+0000 mon.smithi033 (mon.0) 669 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:37:52.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:51.541481+0000 mgr.smithi033.apxevf (mgr.14626) 340 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:54.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:52.671499+0000 mgr.smithi033.apxevf (mgr.14626) 341 : cephadm [INF] Upgrade: Updating prometheus.smithi033 2024-02-15T18:37:54.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:37:52.682612+0000 mgr.smithi033.apxevf (mgr.14626) 342 : cephadm [INF] Deploying daemon prometheus.smithi033 on smithi033 2024-02-15T18:37:54.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:53.541922+0000 mgr.smithi033.apxevf (mgr.14626) 343 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:55.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:52.671499+0000 mgr.smithi033.apxevf (mgr.14626) 341 : cephadm [INF] Upgrade: Updating prometheus.smithi033 2024-02-15T18:37:55.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:37:52.682612+0000 mgr.smithi033.apxevf (mgr.14626) 342 : cephadm [INF] Deploying daemon prometheus.smithi033 on smithi033 2024-02-15T18:37:55.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:53.541922+0000 mgr.smithi033.apxevf (mgr.14626) 343 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:56.898 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:55.542536+0000 mgr.smithi033.apxevf (mgr.14626) 344 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:56.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:55.542536+0000 mgr.smithi033.apxevf (mgr.14626) 344 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:58.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:57.542924+0000 mgr.smithi033.apxevf (mgr.14626) 345 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:58.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:57.542924+0000 mgr.smithi033.apxevf (mgr.14626) 345 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:37:59.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:58.619529+0000 mon.smithi033 (mon.0) 670 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:37:59.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:37:58.620322+0000 mon.smithi033 (mon.0) 671 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:37:59.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:37:59 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:37:59.543431+0000 mgr.smithi033.apxevf (mgr.14626) 346 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:00.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:58.619529+0000 mon.smithi033 (mon.0) 670 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:00.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:37:58.620322+0000 mon.smithi033 (mon.0) 671 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:00.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:37:59 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:37:59.543431+0000 mgr.smithi033.apxevf (mgr.14626) 346 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:02.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:01.544031+0000 mgr.smithi033.apxevf (mgr.14626) 347 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:03.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:01.544031+0000 mgr.smithi033.apxevf (mgr.14626) 347 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.425043+0000 mon.smithi033 (mon.0) 672 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.425833+0000 mon.smithi033 (mon.0) 673 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.426479+0000 mon.smithi033 (mon.0) 674 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:03.427042+0000 mgr.smithi033.apxevf (mgr.14626) 348 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.430117+0000 mon.smithi033 (mon.0) 675 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.436045+0000 mon.smithi033 (mon.0) 676 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.436432+0000 mgr.smithi033.apxevf (mgr.14626) 349 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.437691+0000 mon.smithi033 (mon.0) 677 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.439736+0000 mon.smithi033 (mon.0) 678 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.440852+0000 mon.smithi033 (mon.0) 679 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.441870+0000 mon.smithi033 (mon.0) 680 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.443217+0000 mon.smithi033 (mon.0) 681 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.444739+0000 mon.smithi033 (mon.0) 682 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.445605+0000 mon.smithi033 (mon.0) 683 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.446435+0000 mon.smithi033 (mon.0) 684 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.447282+0000 mon.smithi033 (mon.0) 685 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.448142+0000 mon.smithi033 (mon.0) 686 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.449000+0000 mon.smithi033 (mon.0) 687 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.450175+0000 mon.smithi033 (mon.0) 688 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:03.451209+0000 mon.smithi033 (mon.0) 689 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.547 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:03.544414+0000 mgr.smithi033.apxevf (mgr.14626) 350 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:04.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.425043+0000 mon.smithi033 (mon.0) 672 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:04.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.425833+0000 mon.smithi033 (mon.0) 673 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.426479+0000 mon.smithi033 (mon.0) 674 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:03.427042+0000 mgr.smithi033.apxevf (mgr.14626) 348 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.430117+0000 mon.smithi033 (mon.0) 675 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.436045+0000 mon.smithi033 (mon.0) 676 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.436432+0000 mgr.smithi033.apxevf (mgr.14626) 349 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.437691+0000 mon.smithi033 (mon.0) 677 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.439736+0000 mon.smithi033 (mon.0) 678 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.440852+0000 mon.smithi033 (mon.0) 679 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.441870+0000 mon.smithi033 (mon.0) 680 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.443217+0000 mon.smithi033 (mon.0) 681 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.444739+0000 mon.smithi033 (mon.0) 682 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.445605+0000 mon.smithi033 (mon.0) 683 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.446435+0000 mon.smithi033 (mon.0) 684 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.447282+0000 mon.smithi033 (mon.0) 685 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.448142+0000 mon.smithi033 (mon.0) 686 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.449000+0000 mon.smithi033 (mon.0) 687 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.450175+0000 mon.smithi033 (mon.0) 688 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:03.451209+0000 mon.smithi033 (mon.0) 689 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:04.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:03.544414+0000 mgr.smithi033.apxevf (mgr.14626) 350 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:05.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.183+0000 7fa3dee33700 1 -- 172.21.15.33:0/356254969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 msgr2=0x7fa3d80fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.183+0000 7fa3dee33700 1 --2- 172.21.15.33:0/356254969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 0x7fa3d80fbc70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fa3c4004660 tx=0x7fa3c4009b30).stop 2024-02-15T18:38:05.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.183+0000 7fa3dee33700 1 -- 172.21.15.33:0/356254969 shutdown_connections 2024-02-15T18:38:05.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.183+0000 7fa3dee33700 1 --2- 172.21.15.33:0/356254969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 0x7fa3d80fbc70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.183+0000 7fa3dee33700 1 --2- 172.21.15.33:0/356254969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3d80602b0 0x7fa3d80f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.183+0000 7fa3dee33700 1 -- 172.21.15.33:0/356254969 >> 172.21.15.33:0/356254969 conn(0x7fa3d80f0d40 msgr2=0x7fa3d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.183+0000 7fa3dee33700 1 -- 172.21.15.33:0/356254969 shutdown_connections 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.183+0000 7fa3dee33700 1 -- 172.21.15.33:0/356254969 wait complete. 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.183+0000 7fa3dee33700 1 Processor -- start 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.184+0000 7fa3dee33700 1 -- start start 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.184+0000 7fa3dee33700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3d80602b0 0x7fa3d8106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.184+0000 7fa3dee33700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 0x7fa3d8107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.184+0000 7fa3dee33700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8107a30 con 0x7fa3d80f9880 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.184+0000 7fa3dee33700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8107b70 con 0x7fa3d80602b0 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.184+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 0x7fa3d8107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.184+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 0x7fa3d8107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48400/0 (socket says 172.21.15.33:48400) 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.184+0000 7fa3d7fff700 1 -- 172.21.15.33:0/217313838 learned_addr learned my addr 172.21.15.33:0/217313838 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:05.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.184+0000 7fa3dcbcf700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3d80602b0 0x7fa3d8106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:05.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.185+0000 7fa3d7fff700 1 -- 172.21.15.33:0/217313838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3d80602b0 msgr2=0x7fa3d8106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.185+0000 7fa3d7fff700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3d80602b0 0x7fa3d8106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.185+0000 7fa3d7fff700 1 -- 172.21.15.33:0/217313838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4005040 con 0x7fa3d80f9880 2024-02-15T18:38:05.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.185+0000 7fa3d7fff700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 0x7fa3d8107480 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa3c4004e30 tx=0x7fa3c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:05.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.185+0000 7fa3d57fa700 1 -- 172.21.15.33:0/217313838 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c4018070 con 0x7fa3d80f9880 2024-02-15T18:38:05.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.185+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d81084b0 con 0x7fa3d80f9880 2024-02-15T18:38:05.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.185+0000 7fa3d57fa700 1 -- 172.21.15.33:0/217313838 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa3c4007ba0 con 0x7fa3d80f9880 2024-02-15T18:38:05.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.185+0000 7fa3d57fa700 1 -- 172.21.15.33:0/217313838 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c401c620 con 0x7fa3d80f9880 2024-02-15T18:38:05.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.185+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d8108a10 con 0x7fa3d80f9880 2024-02-15T18:38:05.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.186+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d8045ad0 con 0x7fa3d80f9880 2024-02-15T18:38:05.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.187+0000 7fa3d57fa700 1 -- 172.21.15.33:0/217313838 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa3c401d9a0 con 0x7fa3d80f9880 2024-02-15T18:38:05.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.187+0000 7fa3d57fa700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa3c8060f20 0x7fa3c80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:05.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.187+0000 7fa3d57fa700 1 -- 172.21.15.33:0/217313838 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa3c407df10 con 0x7fa3d80f9880 2024-02-15T18:38:05.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.187+0000 7fa3dcbcf700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa3c8060f20 0x7fa3c80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:05.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.188+0000 7fa3dcbcf700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa3c8060f20 0x7fa3c80633e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa3cc0096c0 tx=0x7fa3cc009be0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:05.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.191+0000 7fa3d57fa700 1 -- 172.21.15.33:0/217313838 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa3c4051d70 con 0x7fa3d80f9880 2024-02-15T18:38:05.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.406+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3d8108c30 con 0x7fa3c8060f20 2024-02-15T18:38:05.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.407+0000 7fa3d57fa700 1 -- 172.21.15.33:0/217313838 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fa3d8108c30 con 0x7fa3c8060f20 2024-02-15T18:38:05.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa3c8060f20 msgr2=0x7fa3c80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa3c8060f20 0x7fa3c80633e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa3cc0096c0 tx=0x7fa3cc009be0).stop 2024-02-15T18:38:05.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 msgr2=0x7fa3d8107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 0x7fa3d8107480 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa3c4004e30 tx=0x7fa3c4009b30).stop 2024-02-15T18:38:05.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 shutdown_connections 2024-02-15T18:38:05.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa3c8060f20 0x7fa3c80633e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3d80602b0 0x7fa3d8106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 --2- 172.21.15.33:0/217313838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3d80f9880 0x7fa3d8107480 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 >> 172.21.15.33:0/217313838 conn(0x7fa3d80f0d40 msgr2=0x7fa3d80f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:05.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 shutdown_connections 2024-02-15T18:38:05.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.409+0000 7fa3dee33700 1 -- 172.21.15.33:0/217313838 wait complete. 2024-02-15T18:38:05.410 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:38:05.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 -- 172.21.15.33:0/643566901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 msgr2=0x7f3e0c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 --2- 172.21.15.33:0/643566901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 0x7f3e0c0f59e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3dfc004660 tx=0x7f3dfc009b30).stop 2024-02-15T18:38:05.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 -- 172.21.15.33:0/643566901 shutdown_connections 2024-02-15T18:38:05.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 --2- 172.21.15.33:0/643566901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e0c0f6860 0x7f3e0c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 --2- 172.21.15.33:0/643566901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 0x7f3e0c0f59e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 -- 172.21.15.33:0/643566901 >> 172.21.15.33:0/643566901 conn(0x7f3e0c0f0d40 msgr2=0x7f3e0c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:05.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 -- 172.21.15.33:0/643566901 shutdown_connections 2024-02-15T18:38:05.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 -- 172.21.15.33:0/643566901 wait complete. 2024-02-15T18:38:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 Processor -- start 2024-02-15T18:38:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.514+0000 7f3e114eb700 1 -- start start 2024-02-15T18:38:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e114eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 0x7f3e0c106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e114eb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e0c0f6860 0x7f3e0c1074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e114eb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c107a90 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e114eb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c107bd0 con 0x7f3e0c0f6860 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e0affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 0x7f3e0c106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e0affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 0x7f3e0c106ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37470/0 (socket says 172.21.15.33:37470) 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e0affd700 1 -- 172.21.15.33:0/1683017626 learned_addr learned my addr 172.21.15.33:0/1683017626 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e0a7fc700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e0c0f6860 0x7f3e0c1074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e0affd700 1 -- 172.21.15.33:0/1683017626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e0c0f6860 msgr2=0x7f3e0c1074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e0affd700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e0c0f6860 0x7f3e0c1074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e0affd700 1 -- 172.21.15.33:0/1683017626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc005040 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e0affd700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 0x7f3e0c106ff0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3dfc004e30 tx=0x7f3dfc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3df37fe700 1 -- 172.21.15.33:0/1683017626 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dfc018070 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3df37fe700 1 -- 172.21.15.33:0/1683017626 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f3dfc007ba0 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c108510 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3df37fe700 1 -- 172.21.15.33:0/1683017626 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dfc01c620 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.515+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c108a70 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.517+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0c045ad0 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.517+0000 7f3df37fe700 1 -- 172.21.15.33:0/1683017626 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f3dfc01d9a0 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.517+0000 7f3df37fe700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f3df4060f20 0x7f3df40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.517+0000 7f3df37fe700 1 -- 172.21.15.33:0/1683017626 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f3dfc07de40 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.517+0000 7f3e0a7fc700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f3df4060f20 0x7f3df40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:05.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.518+0000 7f3e0a7fc700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f3df4060f20 0x7f3df40633e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3e000096c0 tx=0x7f3e00009c20).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.522+0000 7f3df37fe700 1 -- 172.21.15.33:0/1683017626 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3dfc051d20 con 0x7f3e0c0f55c0 2024-02-15T18:38:05.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.714+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e0c0faca0 con 0x7f3df4060f20 2024-02-15T18:38:05.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.715+0000 7f3df37fe700 1 -- 172.21.15.33:0/1683017626 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f3e0c0faca0 con 0x7f3df4060f20 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f3df4060f20 msgr2=0x7f3df40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f3df4060f20 0x7f3df40633e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3e000096c0 tx=0x7f3e00009c20).stop 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 msgr2=0x7f3e0c106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 0x7f3e0c106ff0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3dfc004e30 tx=0x7f3dfc009b30).stop 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 shutdown_connections 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f3df4060f20 0x7f3df40633e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e0c0f55c0 0x7f3e0c106ff0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 --2- 172.21.15.33:0/1683017626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e0c0f6860 0x7f3e0c1074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 >> 172.21.15.33:0/1683017626 conn(0x7f3e0c0f0d40 msgr2=0x7f3e0c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 shutdown_connections 2024-02-15T18:38:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.717+0000 7f3e114eb700 1 -- 172.21.15.33:0/1683017626 wait complete. 2024-02-15T18:38:05.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.818+0000 7f60eabdb700 1 -- 172.21.15.33:0/3457720997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e40f9690 msgr2=0x7f60e40fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.818+0000 7f60eabdb700 1 --2- 172.21.15.33:0/3457720997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e40f9690 0x7f60e40fbae0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f60d4004660 tx=0x7f60d4009b30).stop 2024-02-15T18:38:05.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.818+0000 7f60eabdb700 1 -- 172.21.15.33:0/3457720997 shutdown_connections 2024-02-15T18:38:05.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.818+0000 7f60eabdb700 1 --2- 172.21.15.33:0/3457720997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e40f9690 0x7f60e40fbae0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.818+0000 7f60eabdb700 1 --2- 172.21.15.33:0/3457720997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e4060310 0x7f60e40f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.818+0000 7f60eabdb700 1 -- 172.21.15.33:0/3457720997 >> 172.21.15.33:0/3457720997 conn(0x7f60e40f0b90 msgr2=0x7f60e40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:05.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.819+0000 7f60eabdb700 1 -- 172.21.15.33:0/3457720997 shutdown_connections 2024-02-15T18:38:05.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.819+0000 7f60eabdb700 1 -- 172.21.15.33:0/3457720997 wait complete. 2024-02-15T18:38:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.819+0000 7f60eabdb700 1 Processor -- start 2024-02-15T18:38:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60eabdb700 1 -- start start 2024-02-15T18:38:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60eabdb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e4060310 0x7f60e4108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60eabdb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e40f9690 0x7f60e41094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60eabdb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4109a60 con 0x7f60e4060310 2024-02-15T18:38:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60eabdb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4109ba0 con 0x7f60e40f9690 2024-02-15T18:38:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60e9bd9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e4060310 0x7f60e4108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60e9bd9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e4060310 0x7f60e4108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37492/0 (socket says 172.21.15.33:37492) 2024-02-15T18:38:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60e9bd9700 1 -- 172.21.15.33:0/4195912352 learned_addr learned my addr 172.21.15.33:0/4195912352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60e93d8700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e40f9690 0x7f60e41094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60e9bd9700 1 -- 172.21.15.33:0/4195912352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e40f9690 msgr2=0x7f60e41094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60e9bd9700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e40f9690 0x7f60e41094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60e9bd9700 1 -- 172.21.15.33:0/4195912352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4005040 con 0x7f60e4060310 2024-02-15T18:38:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.820+0000 7f60e9bd9700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e4060310 0x7f60e4108fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f60e00026d0 tx=0x7f60e0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.821+0000 7f60da7fc700 1 -- 172.21.15.33:0/4195912352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e00079c0 con 0x7f60e4060310 2024-02-15T18:38:05.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.821+0000 7f60da7fc700 1 -- 172.21.15.33:0/4195912352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f60e000f040 con 0x7f60e4060310 2024-02-15T18:38:05.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.821+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e410a540 con 0x7f60e4060310 2024-02-15T18:38:05.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.821+0000 7f60da7fc700 1 -- 172.21.15.33:0/4195912352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e00149f0 con 0x7f60e4060310 2024-02-15T18:38:05.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.821+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e410ab00 con 0x7f60e4060310 2024-02-15T18:38:05.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.822+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e4045ad0 con 0x7f60e4060310 2024-02-15T18:38:05.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.822+0000 7f60da7fc700 1 -- 172.21.15.33:0/4195912352 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f60e0007b20 con 0x7f60e4060310 2024-02-15T18:38:05.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.822+0000 7f60da7fc700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f60d0060f70 0x7f60d0063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:05.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.823+0000 7f60da7fc700 1 -- 172.21.15.33:0/4195912352 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f60e007c130 con 0x7f60e4060310 2024-02-15T18:38:05.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.823+0000 7f60e93d8700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f60d0060f70 0x7f60d0063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:05.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.823+0000 7f60e93d8700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f60d0060f70 0x7f60d0063430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f60d4004630 tx=0x7f60d4009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:05.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:05.827+0000 7f60da7fc700 1 -- 172.21.15.33:0/4195912352 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f60e004ff90 con 0x7f60e4060310 2024-02-15T18:38:06.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.013+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f60e40f55f0 con 0x7f60d0060f70 2024-02-15T18:38:06.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.023+0000 7f60da7fc700 1 -- 172.21.15.33:0/4195912352 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f60e40f55f0 con 0x7f60d0060f70 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (12m) 2s ago 14m 21.2M - 0.20.0 0881eb8f169f 427c2409139c 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (5m) 2s ago 14m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (5m) 18s ago 13m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (12m) 2s ago 14m 34.4M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (66s) 2s ago 9m 17.0M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a4a346f4654 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (80s) 2s ago 9m 64.4M - 16.2.14-521-g0e714d9a 1fbc92c859dc e375dd9e3a03 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (37s) 18s ago 9m 14.4M - 16.2.14-521-g0e714d9a 1fbc92c859dc 476396a5b16a 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (49s) 18s ago 9m 11.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4201a4414604 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (6m) 2s ago 16m 440M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (6m) 18s ago 13m 391M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (5m) 2s ago 16m 57.4M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:38:06.014 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (5m) 18s ago 13m 53.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:38:06.015 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (26s) 2s ago 14m 12.5M - 1.3.1 1dbe0e931976 d817b00dddff 2024-02-15T18:38:06.015 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (20s) 18s ago 13m 3632k - 1.3.1 1dbe0e931976 b3854d6e821c 2024-02-15T18:38:06.015 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (4m) 2s ago 13m 201M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:38:06.015 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (4m) 2s ago 12m 206M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:38:06.015 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (3m) 2s ago 12m 207M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:38:06.015 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (3m) 18s ago 11m 268M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4030e9f6d6c2 2024-02-15T18:38:06.015 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (2m) 18s ago 11m 256M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 902c89c867aa 2024-02-15T18:38:06.015 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (2m) 18s ago 11m 257M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc ba19a3c17a66 2024-02-15T18:38:06.015 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (8s) 2s ago 13m 37.7M - 2.33.4 514e6a882f6e b5bc87635fe1 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f60d0060f70 msgr2=0x7f60d0063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f60d0060f70 0x7f60d0063430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f60d4004630 tx=0x7f60d4009b30).stop 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e4060310 msgr2=0x7f60e4108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e4060310 0x7f60e4108fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f60e00026d0 tx=0x7f60e0009de0).stop 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 shutdown_connections 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f60d0060f70 0x7f60d0063430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60e4060310 0x7f60e4108fc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 --2- 172.21.15.33:0/4195912352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e40f9690 0x7f60e41094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 >> 172.21.15.33:0/4195912352 conn(0x7f60e40f0b90 msgr2=0x7f60e40f4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 shutdown_connections 2024-02-15T18:38:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.025+0000 7f60eabdb700 1 -- 172.21.15.33:0/4195912352 wait complete. 2024-02-15T18:38:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.127+0000 7fe127d00700 1 -- 172.21.15.33:0/4102723957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f55c0 msgr2=0x7fe1200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.127+0000 7fe127d00700 1 --2- 172.21.15.33:0/4102723957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f55c0 0x7fe1200f59e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fe11c004660 tx=0x7fe11c009b30).stop 2024-02-15T18:38:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.127+0000 7fe127d00700 1 -- 172.21.15.33:0/4102723957 shutdown_connections 2024-02-15T18:38:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.127+0000 7fe127d00700 1 --2- 172.21.15.33:0/4102723957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1200f6860 0x7fe1200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.127+0000 7fe127d00700 1 --2- 172.21.15.33:0/4102723957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f55c0 0x7fe1200f59e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.127+0000 7fe127d00700 1 -- 172.21.15.33:0/4102723957 >> 172.21.15.33:0/4102723957 conn(0x7fe1200f0d40 msgr2=0x7fe1200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.127+0000 7fe127d00700 1 -- 172.21.15.33:0/4102723957 shutdown_connections 2024-02-15T18:38:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.127+0000 7fe127d00700 1 -- 172.21.15.33:0/4102723957 wait complete. 2024-02-15T18:38:06.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe127d00700 1 Processor -- start 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe127d00700 1 -- start start 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe127d00700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1200f55c0 0x7fe12010c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe127d00700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f6860 0x7fe12010e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe127d00700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1200602b0 con 0x7fe1200f6860 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe127d00700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1200603f0 con 0x7fe1200f55c0 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe12529b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f6860 0x7fe12010e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe12529b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f6860 0x7fe12010e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37508/0 (socket says 172.21.15.33:37508) 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe12529b700 1 -- 172.21.15.33:0/299468063 learned_addr learned my addr 172.21.15.33:0/299468063 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe125a9c700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1200f55c0 0x7fe12010c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe12529b700 1 -- 172.21.15.33:0/299468063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1200f55c0 msgr2=0x7fe12010c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe12529b700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1200f55c0 0x7fe12010c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe12529b700 1 -- 172.21.15.33:0/299468063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c005040 con 0x7fe1200f6860 2024-02-15T18:38:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe125a9c700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1200f55c0 0x7fe12010c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:38:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.128+0000 7fe12529b700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f6860 0x7fe12010e620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fe1140026d0 tx=0x7fe114009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.129+0000 7fe1127fc700 1 -- 172.21.15.33:0/299468063 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe114009320 con 0x7fe1200f6860 2024-02-15T18:38:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.129+0000 7fe1127fc700 1 -- 172.21.15.33:0/299468063 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fe11400f040 con 0x7fe1200f6860 2024-02-15T18:38:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.129+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12010eb10 con 0x7fe1200f6860 2024-02-15T18:38:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.129+0000 7fe1127fc700 1 -- 172.21.15.33:0/299468063 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1140149b0 con 0x7fe1200f6860 2024-02-15T18:38:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.129+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12010ef90 con 0x7fe1200f6860 2024-02-15T18:38:06.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.130+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe120045ad0 con 0x7fe1200f6860 2024-02-15T18:38:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.130+0000 7fe1127fc700 1 -- 172.21.15.33:0/299468063 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe114009480 con 0x7fe1200f6860 2024-02-15T18:38:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.131+0000 7fe1127fc700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe10c060f20 0x7fe10c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.131+0000 7fe1127fc700 1 -- 172.21.15.33:0/299468063 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe11407c600 con 0x7fe1200f6860 2024-02-15T18:38:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.131+0000 7fe125a9c700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe10c060f20 0x7fe10c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.131+0000 7fe125a9c700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe10c060f20 0x7fe10c0633e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe120060040 tx=0x7fe11c009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.135+0000 7fe1127fc700 1 -- 172.21.15.33:0/299468063 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe11404cab0 con 0x7fe1200f6860 2024-02-15T18:38:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.389+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe1200586e0 con 0x7fe1200f6860 2024-02-15T18:38:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.390+0000 7fe1127fc700 1 -- 172.21.15.33:0/299468063 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fe1140500d0 con 0x7fe1200f6860 2024-02-15T18:38:06.380 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:38:06.381 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:38:06.382 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:38:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.391+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe10c060f20 msgr2=0x7fe10c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.391+0000 7fe127d00700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe10c060f20 0x7fe10c0633e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe120060040 tx=0x7fe11c009b30).stop 2024-02-15T18:38:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.391+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f6860 msgr2=0x7fe12010e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.391+0000 7fe127d00700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f6860 0x7fe12010e620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fe1140026d0 tx=0x7fe114009de0).stop 2024-02-15T18:38:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.391+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 shutdown_connections 2024-02-15T18:38:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.391+0000 7fe127d00700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe10c060f20 0x7fe10c0633e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.391+0000 7fe127d00700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1200f55c0 0x7fe12010c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.391+0000 7fe127d00700 1 --2- 172.21.15.33:0/299468063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1200f6860 0x7fe12010e620 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.391+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 >> 172.21.15.33:0/299468063 conn(0x7fe1200f0d40 msgr2=0x7fe1200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.392+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 shutdown_connections 2024-02-15T18:38:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.392+0000 7fe127d00700 1 -- 172.21.15.33:0/299468063 wait complete. 2024-02-15T18:38:06.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.493+0000 7f1fd323c700 1 -- 172.21.15.33:0/1160760307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 msgr2=0x7f1fcc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.493+0000 7f1fd323c700 1 --2- 172.21.15.33:0/1160760307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 0x7f1fcc0f5850 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f1fc8004660 tx=0x7f1fc8009b30).stop 2024-02-15T18:38:06.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.493+0000 7f1fd323c700 1 -- 172.21.15.33:0/1160760307 shutdown_connections 2024-02-15T18:38:06.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.493+0000 7f1fd323c700 1 --2- 172.21.15.33:0/1160760307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fcc0f66d0 0x7f1fcc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.493+0000 7f1fd323c700 1 --2- 172.21.15.33:0/1160760307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 0x7f1fcc0f5850 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.493+0000 7f1fd323c700 1 -- 172.21.15.33:0/1160760307 >> 172.21.15.33:0/1160760307 conn(0x7f1fcc0f0b90 msgr2=0x7f1fcc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:06.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.493+0000 7f1fd323c700 1 -- 172.21.15.33:0/1160760307 shutdown_connections 2024-02-15T18:38:06.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.493+0000 7f1fd323c700 1 -- 172.21.15.33:0/1160760307 wait complete. 2024-02-15T18:38:06.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd323c700 1 Processor -- start 2024-02-15T18:38:06.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd323c700 1 -- start start 2024-02-15T18:38:06.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd323c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 0x7f1fcc106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:06.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd323c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fcc0f66d0 0x7f1fcc1073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd323c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc107960 con 0x7f1fcc0f5430 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd323c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc108160 con 0x7f1fcc0f66d0 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd223a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 0x7f1fcc106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd223a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 0x7f1fcc106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37514/0 (socket says 172.21.15.33:37514) 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd223a700 1 -- 172.21.15.33:0/2685922306 learned_addr learned my addr 172.21.15.33:0/2685922306 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.494+0000 7f1fd1a39700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fcc0f66d0 0x7f1fcc1073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.495+0000 7f1fd223a700 1 -- 172.21.15.33:0/2685922306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fcc0f66d0 msgr2=0x7f1fcc1073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.495+0000 7f1fd223a700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fcc0f66d0 0x7f1fcc1073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.495+0000 7f1fd223a700 1 -- 172.21.15.33:0/2685922306 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc8005040 con 0x7f1fcc0f5430 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.495+0000 7f1fd223a700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 0x7f1fcc106ec0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f1fc8004e30 tx=0x7f1fc8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.495+0000 7f1fc2ffd700 1 -- 172.21.15.33:0/2685922306 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc8018070 con 0x7f1fcc0f5430 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.495+0000 7f1fc2ffd700 1 -- 172.21.15.33:0/2685922306 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f1fc8007ba0 con 0x7f1fcc0f5430 2024-02-15T18:38:06.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.495+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc1083e0 con 0x7f1fcc0f5430 2024-02-15T18:38:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.495+0000 7f1fc2ffd700 1 -- 172.21.15.33:0/2685922306 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc801c620 con 0x7f1fcc0f5430 2024-02-15T18:38:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.495+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc108940 con 0x7f1fcc0f5430 2024-02-15T18:38:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.496+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc059100 con 0x7f1fcc0f5430 2024-02-15T18:38:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.496+0000 7f1fc2ffd700 1 -- 172.21.15.33:0/2685922306 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f1fc801d9a0 con 0x7f1fcc0f5430 2024-02-15T18:38:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.497+0000 7f1fc2ffd700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1fb8060f70 0x7f1fb8063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.497+0000 7f1fc2ffd700 1 -- 172.21.15.33:0/2685922306 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f1fc807df10 con 0x7f1fcc0f5430 2024-02-15T18:38:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.497+0000 7f1fd1a39700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1fb8060f70 0x7f1fb8063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.497+0000 7f1fd1a39700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1fb8060f70 0x7f1fb8063430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f1fbc0096c0 tx=0x7f1fbc009be0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:06.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.501+0000 7f1fc2ffd700 1 -- 172.21.15.33:0/2685922306 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1fc8051d70 con 0x7f1fcc0f5430 2024-02-15T18:38:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.720+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1fcc10d3a0 con 0x7f1fcc0f5430 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.721+0000 7f1fc2ffd700 1 -- 172.21.15.33:0/2685922306 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1802 (secure 0 0 0) 0x7f1fc8051960 con 0x7f1fcc0f5430 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:e41 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 41 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:37:33.666082+0000 2024-02-15T18:38:06.712 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 82 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=34334,1=34338} 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:38:06.713 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{0:34334} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{1:34338} state up:active seq 10 join_fscid=1 addr [v2:172.21.15.33:6828/2386752010,v1:172.21.15.33:6829/2386752010] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6824/2921613795,v1:172.21.15.131:6825/2921613795] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:38:06.714 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/2360346875,v1:172.21.15.131:6827/2360346875] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:38:06.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1fb8060f70 msgr2=0x7f1fb8063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1fb8060f70 0x7f1fb8063430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f1fbc0096c0 tx=0x7f1fbc009be0).stop 2024-02-15T18:38:06.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 msgr2=0x7f1fcc106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 0x7f1fcc106ec0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f1fc8004e30 tx=0x7f1fc8009b30).stop 2024-02-15T18:38:06.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 shutdown_connections 2024-02-15T18:38:06.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1fb8060f70 0x7f1fb8063430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fcc0f5430 0x7f1fcc106ec0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 --2- 172.21.15.33:0/2685922306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fcc0f66d0 0x7f1fcc1073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 >> 172.21.15.33:0/2685922306 conn(0x7f1fcc0f0b90 msgr2=0x7f1fcc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 shutdown_connections 2024-02-15T18:38:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.723+0000 7f1fd323c700 1 -- 172.21.15.33:0/2685922306 wait complete. 2024-02-15T18:38:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.828+0000 7fcd9f50d700 1 -- 172.21.15.33:0/717609356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 msgr2=0x7fcd980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.828+0000 7fcd9f50d700 1 --2- 172.21.15.33:0/717609356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 0x7fcd980f6950 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fcd94004660 tx=0x7fcd94009b30).stop 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.828+0000 7fcd9f50d700 1 -- 172.21.15.33:0/717609356 shutdown_connections 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.828+0000 7fcd9f50d700 1 --2- 172.21.15.33:0/717609356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd980f77d0 0x7fcd980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.828+0000 7fcd9f50d700 1 --2- 172.21.15.33:0/717609356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 0x7fcd980f6950 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.828+0000 7fcd9f50d700 1 -- 172.21.15.33:0/717609356 >> 172.21.15.33:0/717609356 conn(0x7fcd980f1c90 msgr2=0x7fcd980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.828+0000 7fcd9f50d700 1 -- 172.21.15.33:0/717609356 shutdown_connections 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.828+0000 7fcd9f50d700 1 -- 172.21.15.33:0/717609356 wait complete. 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.829+0000 7fcd9f50d700 1 Processor -- start 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.829+0000 7fcd9f50d700 1 -- start start 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.829+0000 7fcd9f50d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 0x7fcd9806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.829+0000 7fcd9f50d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd980f77d0 0x7fcd98069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.829+0000 7fcd9f50d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9806a380 con 0x7fcd980f6530 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.829+0000 7fcd9f50d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9806a4c0 con 0x7fcd980f77d0 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.829+0000 7fcd9e50b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 0x7fcd9806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.829+0000 7fcd9e50b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 0x7fcd9806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37534/0 (socket says 172.21.15.33:37534) 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.829+0000 7fcd9e50b700 1 -- 172.21.15.33:0/251080283 learned_addr learned my addr 172.21.15.33:0/251080283 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd9dd0a700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd980f77d0 0x7fcd98069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd9e50b700 1 -- 172.21.15.33:0/251080283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd980f77d0 msgr2=0x7fcd98069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd9e50b700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd980f77d0 0x7fcd98069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd9e50b700 1 -- 172.21.15.33:0/251080283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94005040 con 0x7fcd980f6530 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd9e50b700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 0x7fcd9806b9a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fcd94004e30 tx=0x7fcd94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd8effd700 1 -- 172.21.15.33:0/251080283 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd94018070 con 0x7fcd980f6530 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd8effd700 1 -- 172.21.15.33:0/251080283 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fcd94007ba0 con 0x7fcd980f6530 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9806a740 con 0x7fcd980f6530 2024-02-15T18:38:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9806aca0 con 0x7fcd980f6530 2024-02-15T18:38:06.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.830+0000 7fcd8effd700 1 -- 172.21.15.33:0/251080283 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9401c620 con 0x7fcd980f6530 2024-02-15T18:38:06.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.831+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd80004fa0 con 0x7fcd980f6530 2024-02-15T18:38:06.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.831+0000 7fcd8effd700 1 -- 172.21.15.33:0/251080283 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fcd9401d9a0 con 0x7fcd980f6530 2024-02-15T18:38:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.832+0000 7fcd8effd700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcd84060f70 0x7fcd84063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.832+0000 7fcd8effd700 1 -- 172.21.15.33:0/251080283 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fcd9407de20 con 0x7fcd980f6530 2024-02-15T18:38:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.832+0000 7fcd9dd0a700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcd84060f70 0x7fcd84063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.832+0000 7fcd9dd0a700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcd84060f70 0x7fcd84063430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcd88009760 tx=0x7fcd88009c60).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:06.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:06.836+0000 7fcd8effd700 1 -- 172.21.15.33:0/251080283 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcd9404e2d0 con 0x7fcd980f6530 2024-02-15T18:38:06.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:05.109221+0000 mgr.smithi033.apxevf (mgr.14626) 351 : cephadm [INF] Upgrade: Updating alertmanager.smithi033 2024-02-15T18:38:06.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:05.115040+0000 mgr.smithi033.apxevf (mgr.14626) 352 : cephadm [INF] Deploying daemon alertmanager.smithi033 on smithi033 2024-02-15T18:38:06.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:05.408413+0000 mgr.smithi033.apxevf (mgr.14626) 353 : audit [DBG] from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:06.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:05.544824+0000 mgr.smithi033.apxevf (mgr.14626) 354 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:06.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:06.391452+0000 mon.smithi033 (mon.0) 690 : audit [DBG] from='client.? 172.21.15.33:0/299468063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:07.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:05.109221+0000 mgr.smithi033.apxevf (mgr.14626) 351 : cephadm [INF] Upgrade: Updating alertmanager.smithi033 2024-02-15T18:38:07.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:05.115040+0000 mgr.smithi033.apxevf (mgr.14626) 352 : cephadm [INF] Deploying daemon alertmanager.smithi033 on smithi033 2024-02-15T18:38:07.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:05.408413+0000 mgr.smithi033.apxevf (mgr.14626) 353 : audit [DBG] from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:07.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:05.544824+0000 mgr.smithi033.apxevf (mgr.14626) 354 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:07.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:06.391452+0000 mon.smithi033 (mon.0) 690 : audit [DBG] from='client.? 172.21.15.33:0/299468063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:07.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.086+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd80000bc0 con 0x7fcd84060f70 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.088+0000 7fcd8effd700 1 -- 172.21.15.33:0/251080283 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fcd80000bc0 con 0x7fcd84060f70 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: "mds", 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: "osd", 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:38:07.079 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:38:07.080 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "16/21 daemons upgraded", 2024-02-15T18:38:07.080 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading alertmanager daemons", 2024-02-15T18:38:07.080 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:38:07.080 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:38:07.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcd84060f70 msgr2=0x7fcd84063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:07.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcd84060f70 0x7fcd84063430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcd88009760 tx=0x7fcd88009c60).stop 2024-02-15T18:38:07.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 msgr2=0x7fcd9806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:07.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 0x7fcd9806b9a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fcd94004e30 tx=0x7fcd94009b30).stop 2024-02-15T18:38:07.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 shutdown_connections 2024-02-15T18:38:07.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcd84060f70 0x7fcd84063430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:07.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd980f6530 0x7fcd9806b9a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:07.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 --2- 172.21.15.33:0/251080283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd980f77d0 0x7fcd98069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:07.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 >> 172.21.15.33:0/251080283 conn(0x7fcd980f1c90 msgr2=0x7fcd980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:07.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 shutdown_connections 2024-02-15T18:38:07.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:07.090+0000 7fcd9f50d700 1 -- 172.21.15.33:0/251080283 wait complete. 2024-02-15T18:38:07.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:05.716636+0000 mgr.smithi033.apxevf (mgr.14626) 355 : audit [DBG] from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:07.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:06.015579+0000 mgr.smithi033.apxevf (mgr.14626) 356 : audit [DBG] from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:07.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:06.722733+0000 mon.smithi033 (mon.0) 691 : audit [DBG] from='client.? 172.21.15.33:0/2685922306' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:38:08.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:05.716636+0000 mgr.smithi033.apxevf (mgr.14626) 355 : audit [DBG] from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:08.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:06.015579+0000 mgr.smithi033.apxevf (mgr.14626) 356 : audit [DBG] from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:08.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:06.722733+0000 mon.smithi033 (mon.0) 691 : audit [DBG] from='client.? 172.21.15.33:0/2685922306' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:38:08.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:07.089219+0000 mgr.smithi033.apxevf (mgr.14626) 357 : audit [DBG] from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:08.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:07.545272+0000 mgr.smithi033.apxevf (mgr.14626) 358 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:09.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:07.089219+0000 mgr.smithi033.apxevf (mgr.14626) 357 : audit [DBG] from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:09.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:07.545272+0000 mgr.smithi033.apxevf (mgr.14626) 358 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:10.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:09.545939+0000 mgr.smithi033.apxevf (mgr.14626) 359 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:10.546 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:09.545939+0000 mgr.smithi033.apxevf (mgr.14626) 359 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:12.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:11.546397+0000 mgr.smithi033.apxevf (mgr.14626) 360 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:12.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:11.546397+0000 mgr.smithi033.apxevf (mgr.14626) 360 : cluster [DBG] pgmap v241: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:14.969 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:13.546938+0000 mgr.smithi033.apxevf (mgr.14626) 361 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:14.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:13.546938+0000 mgr.smithi033.apxevf (mgr.14626) 361 : cluster [DBG] pgmap v242: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:16.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:15.120773+0000 mon.smithi033 (mon.0) 692 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:16.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:15.121535+0000 mon.smithi033 (mon.0) 693 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:16.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:15.547344+0000 mgr.smithi033.apxevf (mgr.14626) 362 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:16.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:15.120773+0000 mon.smithi033 (mon.0) 692 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:16.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:15.121535+0000 mon.smithi033 (mon.0) 693 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:16.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:15.547344+0000 mgr.smithi033.apxevf (mgr.14626) 362 : cluster [DBG] pgmap v243: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:18.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:17.547748+0000 mgr.smithi033.apxevf (mgr.14626) 363 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:19.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:17.547748+0000 mgr.smithi033.apxevf (mgr.14626) 363 : cluster [DBG] pgmap v244: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:20.496 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:19.548221+0000 mgr.smithi033.apxevf (mgr.14626) 364 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:20.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:19.548221+0000 mgr.smithi033.apxevf (mgr.14626) 364 : cluster [DBG] pgmap v245: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.828822+0000 mon.smithi033 (mon.0) 694 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.829585+0000 mon.smithi033 (mon.0) 695 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.830210+0000 mon.smithi033 (mon.0) 696 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:20.830740+0000 mgr.smithi033.apxevf (mgr.14626) 365 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.833691+0000 mon.smithi033 (mon.0) 697 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.839720+0000 mon.smithi033 (mon.0) 698 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.840027+0000 mgr.smithi033.apxevf (mgr.14626) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.840724+0000 mon.smithi033 (mon.0) 699 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi033.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.840949+0000 mgr.smithi033.apxevf (mgr.14626) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi033.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.844615+0000 mon.smithi033 (mon.0) 700 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:22.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.846672+0000 mon.smithi033 (mon.0) 701 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.849877+0000 mon.smithi033 (mon.0) 702 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.851496+0000 mon.smithi033 (mon.0) 703 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.853057+0000 mon.smithi033 (mon.0) 704 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.855128+0000 mon.smithi033 (mon.0) 705 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.856803+0000 mon.smithi033 (mon.0) 706 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.857840+0000 mon.smithi033 (mon.0) 707 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.858820+0000 mon.smithi033 (mon.0) 708 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.860073+0000 mon.smithi033 (mon.0) 709 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.861418+0000 mon.smithi033 (mon.0) 710 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.862371+0000 mon.smithi033 (mon.0) 711 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.863730+0000 mon.smithi033 (mon.0) 712 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.864858+0000 mon.smithi033 (mon.0) 713 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:20.865928+0000 mon.smithi033 (mon.0) 714 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.047 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:21 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:21.548709+0000 mgr.smithi033.apxevf (mgr.14626) 368 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:22.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.828822+0000 mon.smithi033 (mon.0) 694 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:22.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.829585+0000 mon.smithi033 (mon.0) 695 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:22.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.830210+0000 mon.smithi033 (mon.0) 696 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:22.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:20.830740+0000 mgr.smithi033.apxevf (mgr.14626) 365 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:22.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.833691+0000 mon.smithi033 (mon.0) 697 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:22.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.839720+0000 mon.smithi033 (mon.0) 698 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:38:22.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.840027+0000 mgr.smithi033.apxevf (mgr.14626) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-15T18:38:22.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.840724+0000 mon.smithi033 (mon.0) 699 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi033.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T18:38:22.246 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.840949+0000 mgr.smithi033.apxevf (mgr.14626) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi033.front.sepia.ceph.com:9093"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.844615+0000 mon.smithi033 (mon.0) 700 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.846672+0000 mon.smithi033 (mon.0) 701 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.849877+0000 mon.smithi033 (mon.0) 702 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.851496+0000 mon.smithi033 (mon.0) 703 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.853057+0000 mon.smithi033 (mon.0) 704 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.855128+0000 mon.smithi033 (mon.0) 705 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.856803+0000 mon.smithi033 (mon.0) 706 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.857840+0000 mon.smithi033 (mon.0) 707 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.858820+0000 mon.smithi033 (mon.0) 708 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.860073+0000 mon.smithi033 (mon.0) 709 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.861418+0000 mon.smithi033 (mon.0) 710 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.862371+0000 mon.smithi033 (mon.0) 711 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.863730+0000 mon.smithi033 (mon.0) 712 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.247 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.864858+0000 mon.smithi033 (mon.0) 713 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:20.865928+0000 mon.smithi033 (mon.0) 714 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:22.248 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:21 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:21.548709+0000 mgr.smithi033.apxevf (mgr.14626) 368 : cluster [DBG] pgmap v246: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:23.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:22.487295+0000 mgr.smithi033.apxevf (mgr.14626) 369 : cephadm [INF] Upgrade: Updating grafana.smithi033 2024-02-15T18:38:23.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:22.542636+0000 mon.smithi033 (mon.0) 715 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:23.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:22.545765+0000 mon.smithi033 (mon.0) 716 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:23.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:23 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:22.764608+0000 mon.smithi033 (mon.0) 717 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:38:23.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:22.487295+0000 mgr.smithi033.apxevf (mgr.14626) 369 : cephadm [INF] Upgrade: Updating grafana.smithi033 2024-02-15T18:38:23.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:22.542636+0000 mon.smithi033 (mon.0) 715 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:23.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:22.545765+0000 mon.smithi033 (mon.0) 716 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:23.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:22.764608+0000 mon.smithi033 (mon.0) 717 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:38:24.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:22.764953+0000 mgr.smithi033.apxevf (mgr.14626) 370 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:38:24.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:22.769173+0000 mgr.smithi033.apxevf (mgr.14626) 371 : cephadm [INF] Deploying daemon grafana.smithi033 on smithi033 2024-02-15T18:38:24.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:23.549273+0000 mgr.smithi033.apxevf (mgr.14626) 372 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:24.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:22.764953+0000 mgr.smithi033.apxevf (mgr.14626) 370 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-15T18:38:24.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:22.769173+0000 mgr.smithi033.apxevf (mgr.14626) 371 : cephadm [INF] Deploying daemon grafana.smithi033 on smithi033 2024-02-15T18:38:24.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:23.549273+0000 mgr.smithi033.apxevf (mgr.14626) 372 : cluster [DBG] pgmap v247: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:26.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:25.549637+0000 mgr.smithi033.apxevf (mgr.14626) 373 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:27.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:25.549637+0000 mgr.smithi033.apxevf (mgr.14626) 373 : cluster [DBG] pgmap v248: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:28.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:27.550005+0000 mgr.smithi033.apxevf (mgr.14626) 374 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:29.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:27.550005+0000 mgr.smithi033.apxevf (mgr.14626) 374 : cluster [DBG] pgmap v249: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:30.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:29.550615+0000 mgr.smithi033.apxevf (mgr.14626) 375 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:30.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:29.550615+0000 mgr.smithi033.apxevf (mgr.14626) 375 : cluster [DBG] pgmap v250: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:32.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:31.551051+0000 mgr.smithi033.apxevf (mgr.14626) 376 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:33.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:31.551051+0000 mgr.smithi033.apxevf (mgr.14626) 376 : cluster [DBG] pgmap v251: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:34.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:33.551423+0000 mgr.smithi033.apxevf (mgr.14626) 377 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:35.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:33.551423+0000 mgr.smithi033.apxevf (mgr.14626) 377 : cluster [DBG] pgmap v252: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:36.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:35.551908+0000 mgr.smithi033.apxevf (mgr.14626) 378 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:36.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:35.551908+0000 mgr.smithi033.apxevf (mgr.14626) 378 : cluster [DBG] pgmap v253: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:37.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3449235419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f66d0 msgr2=0x7fc1e00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 --2- 172.21.15.33:0/3449235419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f66d0 0x7fc1e00f6b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc1d0004660 tx=0x7fc1d0009b30).stop 2024-02-15T18:38:37.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3449235419 shutdown_connections 2024-02-15T18:38:37.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 --2- 172.21.15.33:0/3449235419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f66d0 0x7fc1e00f6b30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 --2- 172.21.15.33:0/3449235419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e00f5430 0x7fc1e00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3449235419 >> 172.21.15.33:0/3449235419 conn(0x7fc1e00f0b90 msgr2=0x7fc1e00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:37.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3449235419 shutdown_connections 2024-02-15T18:38:37.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3449235419 wait complete. 2024-02-15T18:38:37.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 Processor -- start 2024-02-15T18:38:37.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.212+0000 7fc1e70dc700 1 -- start start 2024-02-15T18:38:37.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e70dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f5430 0x7fc1e00f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:37.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e70dc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e00f66d0 0x7fc1e00f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:37.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e70dc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00f7f70 con 0x7fc1e00f5430 2024-02-15T18:38:37.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e70dc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00f80b0 con 0x7fc1e00f66d0 2024-02-15T18:38:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e60da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f5430 0x7fc1e00f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e60da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f5430 0x7fc1e00f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43286/0 (socket says 172.21.15.33:43286) 2024-02-15T18:38:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e60da700 1 -- 172.21.15.33:0/3363782966 learned_addr learned my addr 172.21.15.33:0/3363782966 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e58d9700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e00f66d0 0x7fc1e00f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e60da700 1 -- 172.21.15.33:0/3363782966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e00f66d0 msgr2=0x7fc1e00f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e60da700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e00f66d0 0x7fc1e00f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e60da700 1 -- 172.21.15.33:0/3363782966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0005040 con 0x7fc1e00f5430 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e60da700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f5430 0x7fc1e00f9590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc1dc002700 tx=0x7fc1dc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1d6ffd700 1 -- 172.21.15.33:0/3363782966 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc009320 con 0x7fc1e00f5430 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1d6ffd700 1 -- 172.21.15.33:0/3363782966 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fc1dc00f040 con 0x7fc1e00f5430 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e00f8390 con 0x7fc1e00f5430 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.213+0000 7fc1d6ffd700 1 -- 172.21.15.33:0/3363782966 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc0149d0 con 0x7fc1e00f5430 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.214+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e010edf0 con 0x7fc1e00f5430 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.214+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e0045ad0 con 0x7fc1e00f5430 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.215+0000 7fc1d6ffd700 1 -- 172.21.15.33:0/3363782966 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fc1dc0077b0 con 0x7fc1e00f5430 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.215+0000 7fc1d6ffd700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc1cc060f70 0x7fc1cc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.215+0000 7fc1d6ffd700 1 -- 172.21.15.33:0/3363782966 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fc1dc07c300 con 0x7fc1e00f5430 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.215+0000 7fc1e58d9700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc1cc060f70 0x7fc1cc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.216+0000 7fc1e58d9700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc1cc060f70 0x7fc1cc063430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fc1d0004e30 tx=0x7fc1d0009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.220+0000 7fc1d6ffd700 1 -- 172.21.15.33:0/3363782966 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc1dc04c7b0 con 0x7fc1e00f5430 2024-02-15T18:38:37.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.411+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1e00fab10 con 0x7fc1cc060f70 2024-02-15T18:38:37.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.413+0000 7fc1d6ffd700 1 -- 172.21.15.33:0/3363782966 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fc1e00fab10 con 0x7fc1cc060f70 2024-02-15T18:38:37.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.414+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc1cc060f70 msgr2=0x7fc1cc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.414+0000 7fc1e70dc700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc1cc060f70 0x7fc1cc063430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fc1d0004e30 tx=0x7fc1d0009b30).stop 2024-02-15T18:38:37.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.414+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f5430 msgr2=0x7fc1e00f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.414+0000 7fc1e70dc700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f5430 0x7fc1e00f9590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc1dc002700 tx=0x7fc1dc009d80).stop 2024-02-15T18:38:37.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.414+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 shutdown_connections 2024-02-15T18:38:37.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.415+0000 7fc1e70dc700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc1cc060f70 0x7fc1cc063430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.415+0000 7fc1e70dc700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e00f5430 0x7fc1e00f9590 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.415+0000 7fc1e70dc700 1 --2- 172.21.15.33:0/3363782966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e00f66d0 0x7fc1e00f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.415+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 >> 172.21.15.33:0/3363782966 conn(0x7fc1e00f0b90 msgr2=0x7fc1e005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:37.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.415+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 shutdown_connections 2024-02-15T18:38:37.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.415+0000 7fc1e70dc700 1 -- 172.21.15.33:0/3363782966 wait complete. 2024-02-15T18:38:37.414 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:38:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.519+0000 7fa476752700 1 -- 172.21.15.33:0/740854745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f7980 msgr2=0x7fa4700f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.519+0000 7fa476752700 1 --2- 172.21.15.33:0/740854745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f7980 0x7fa4700f7de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fa458004660 tx=0x7fa458009b30).stop 2024-02-15T18:38:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.519+0000 7fa476752700 1 -- 172.21.15.33:0/740854745 shutdown_connections 2024-02-15T18:38:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.519+0000 7fa476752700 1 --2- 172.21.15.33:0/740854745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f7980 0x7fa4700f7de0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.519+0000 7fa476752700 1 --2- 172.21.15.33:0/740854745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4700f66e0 0x7fa4700f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.519+0000 7fa476752700 1 -- 172.21.15.33:0/740854745 >> 172.21.15.33:0/740854745 conn(0x7fa4700f1e40 msgr2=0x7fa4700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.519+0000 7fa476752700 1 -- 172.21.15.33:0/740854745 shutdown_connections 2024-02-15T18:38:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.519+0000 7fa476752700 1 -- 172.21.15.33:0/740854745 wait complete. 2024-02-15T18:38:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.519+0000 7fa476752700 1 Processor -- start 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa476752700 1 -- start start 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa476752700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f66e0 0x7fa47006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa476752700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4700f7980 0x7fa470069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa476752700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47006a380 con 0x7fa4700f66e0 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa476752700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47006a4c0 con 0x7fa4700f7980 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa46ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f66e0 0x7fa47006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa46ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f66e0 0x7fa47006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43292/0 (socket says 172.21.15.33:43292) 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa46ffff700 1 -- 172.21.15.33:0/3735313657 learned_addr learned my addr 172.21.15.33:0/3735313657 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa46f7fe700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4700f7980 0x7fa470069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa46ffff700 1 -- 172.21.15.33:0/3735313657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4700f7980 msgr2=0x7fa470069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa46ffff700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4700f7980 0x7fa470069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa46ffff700 1 -- 172.21.15.33:0/3735313657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458005040 con 0x7fa4700f66e0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.520+0000 7fa46ffff700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f66e0 0x7fa47006b9a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa460002700 tx=0x7fa460009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.521+0000 7fa46cff9700 1 -- 172.21.15.33:0/3735313657 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4600079c0 con 0x7fa4700f66e0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.521+0000 7fa46cff9700 1 -- 172.21.15.33:0/3735313657 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa46000f040 con 0x7fa4700f66e0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.521+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47006a7a0 con 0x7fa4700f66e0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.521+0000 7fa46cff9700 1 -- 172.21.15.33:0/3735313657 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa460014940 con 0x7fa4700f66e0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.521+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47010f030 con 0x7fa4700f66e0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.522+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa470045ad0 con 0x7fa4700f66e0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.522+0000 7fa46cff9700 1 -- 172.21.15.33:0/3735313657 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa46001b060 con 0x7fa4700f66e0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.522+0000 7fa46cff9700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa45c060f20 0x7fa45c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.522+0000 7fa46cff9700 1 -- 172.21.15.33:0/3735313657 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa46007c040 con 0x7fa4700f66e0 2024-02-15T18:38:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.522+0000 7fa46f7fe700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa45c060f20 0x7fa45c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.523+0000 7fa46f7fe700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa45c060f20 0x7fa45c0633e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa458004630 tx=0x7fa458009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:37.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.526+0000 7fa46cff9700 1 -- 172.21.15.33:0/3735313657 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa46004c640 con 0x7fa4700f66e0 2024-02-15T18:38:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.717+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4700ff120 con 0x7fa45c060f20 2024-02-15T18:38:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.718+0000 7fa46cff9700 1 -- 172.21.15.33:0/3735313657 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fa4700ff120 con 0x7fa45c060f20 2024-02-15T18:38:37.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa45c060f20 msgr2=0x7fa45c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa45c060f20 0x7fa45c0633e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa458004630 tx=0x7fa458009b30).stop 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f66e0 msgr2=0x7fa47006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f66e0 0x7fa47006b9a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa460002700 tx=0x7fa460009d80).stop 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 shutdown_connections 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa45c060f20 0x7fa45c0633e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4700f66e0 0x7fa47006b9a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 --2- 172.21.15.33:0/3735313657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4700f7980 0x7fa470069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 >> 172.21.15.33:0/3735313657 conn(0x7fa4700f1e40 msgr2=0x7fa4700fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 shutdown_connections 2024-02-15T18:38:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.720+0000 7fa476752700 1 -- 172.21.15.33:0/3735313657 wait complete. 2024-02-15T18:38:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.821+0000 7fa454fca700 1 -- 172.21.15.33:0/87006076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f6530 msgr2=0x7fa4500f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.821+0000 7fa454fca700 1 --2- 172.21.15.33:0/87006076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f6530 0x7fa4500f6950 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fa440004660 tx=0x7fa440009b30).stop 2024-02-15T18:38:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.821+0000 7fa454fca700 1 -- 172.21.15.33:0/87006076 shutdown_connections 2024-02-15T18:38:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.821+0000 7fa454fca700 1 --2- 172.21.15.33:0/87006076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4500f77d0 0x7fa4500f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.821+0000 7fa454fca700 1 --2- 172.21.15.33:0/87006076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f6530 0x7fa4500f6950 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.821+0000 7fa454fca700 1 -- 172.21.15.33:0/87006076 >> 172.21.15.33:0/87006076 conn(0x7fa4500f1c90 msgr2=0x7fa4500f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.821+0000 7fa454fca700 1 -- 172.21.15.33:0/87006076 shutdown_connections 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.821+0000 7fa454fca700 1 -- 172.21.15.33:0/87006076 wait complete. 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.822+0000 7fa454fca700 1 Processor -- start 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.822+0000 7fa454fca700 1 -- start start 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.822+0000 7fa454fca700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4500f6530 0x7fa450106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.822+0000 7fa454fca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f77d0 0x7fa4501073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.822+0000 7fa454fca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa450107960 con 0x7fa4500f77d0 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.822+0000 7fa454fca700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa450108160 con 0x7fa4500f6530 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.822+0000 7fa44effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f77d0 0x7fa4501073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.822+0000 7fa44effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f77d0 0x7fa4501073b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43312/0 (socket says 172.21.15.33:43312) 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.822+0000 7fa44effd700 1 -- 172.21.15.33:0/619458084 learned_addr learned my addr 172.21.15.33:0/619458084 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa44f7fe700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4500f6530 0x7fa450106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa44effd700 1 -- 172.21.15.33:0/619458084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4500f6530 msgr2=0x7fa450106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa44effd700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4500f6530 0x7fa450106ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa44effd700 1 -- 172.21.15.33:0/619458084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440005040 con 0x7fa4500f77d0 2024-02-15T18:38:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa44effd700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f77d0 0x7fa4501073b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fa4440026d0 tx=0x7fa444009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa437fff700 1 -- 172.21.15.33:0/619458084 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4440079c0 con 0x7fa4500f77d0 2024-02-15T18:38:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa450108440 con 0x7fa4500f77d0 2024-02-15T18:38:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa437fff700 1 -- 172.21.15.33:0/619458084 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fa44400f040 con 0x7fa4500f77d0 2024-02-15T18:38:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa437fff700 1 -- 172.21.15.33:0/619458084 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4440149f0 con 0x7fa4500f77d0 2024-02-15T18:38:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.823+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa450108a00 con 0x7fa4500f77d0 2024-02-15T18:38:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.824+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa450059100 con 0x7fa4500f77d0 2024-02-15T18:38:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.825+0000 7fa437fff700 1 -- 172.21.15.33:0/619458084 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa444007b20 con 0x7fa4500f77d0 2024-02-15T18:38:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.825+0000 7fa437fff700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa438060f70 0x7fa438063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.825+0000 7fa437fff700 1 -- 172.21.15.33:0/619458084 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa44407c130 con 0x7fa4500f77d0 2024-02-15T18:38:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.825+0000 7fa44f7fe700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa438060f70 0x7fa438063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.825+0000 7fa44f7fe700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa438060f70 0x7fa438063430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa440004630 tx=0x7fa440009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:37.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:37.829+0000 7fa437fff700 1 -- 172.21.15.33:0/619458084 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa44404ff90 con 0x7fa4500f77d0 2024-02-15T18:38:38.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.021+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4500fef10 con 0x7fa438060f70 2024-02-15T18:38:38.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.031+0000 7fa437fff700 1 -- 172.21.15.33:0/619458084 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa4500fef10 con 0x7fa438060f70 2024-02-15T18:38:38.021 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:38:38.021 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (23s) 17s ago 15m 14.9M - 0.23.0 ba2b418f427c ea890a609c2a 2024-02-15T18:38:38.021 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (5m) 17s ago 15m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:38:38.021 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (5m) 50s ago 14m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:38:38.021 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (13m) 17s ago 14m 34.4M - 6.7.4 557c83e11646 442dff215dc6 2024-02-15T18:38:38.021 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (98s) 17s ago 9m 17.3M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a4a346f4654 2024-02-15T18:38:38.021 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (112s) 17s ago 9m 64.5M - 16.2.14-521-g0e714d9a 1fbc92c859dc e375dd9e3a03 2024-02-15T18:38:38.021 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (69s) 50s ago 9m 14.4M - 16.2.14-521-g0e714d9a 1fbc92c859dc 476396a5b16a 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (81s) 50s ago 9m 11.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4201a4414604 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (7m) 17s ago 16m 440M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (6m) 50s ago 14m 391M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (6m) 17s ago 16m 58.4M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (6m) 50s ago 14m 53.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (58s) 17s ago 14m 12.9M - 1.3.1 1dbe0e931976 d817b00dddff 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (52s) 50s ago 13m 3632k - 1.3.1 1dbe0e931976 b3854d6e821c 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (5m) 17s ago 13m 201M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (4m) 17s ago 13m 206M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (4m) 17s ago 12m 207M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (3m) 50s ago 12m 268M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4030e9f6d6c2 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (3m) 50s ago 11m 256M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 902c89c867aa 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (2m) 50s ago 11m 257M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc ba19a3c17a66 2024-02-15T18:38:38.022 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (40s) 17s ago 14m 59.2M - 2.33.4 514e6a882f6e b5bc87635fe1 2024-02-15T18:38:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa438060f70 msgr2=0x7fa438063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa438060f70 0x7fa438063430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fa440004630 tx=0x7fa440009b30).stop 2024-02-15T18:38:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f77d0 msgr2=0x7fa4501073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f77d0 0x7fa4501073b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fa4440026d0 tx=0x7fa444009de0).stop 2024-02-15T18:38:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 shutdown_connections 2024-02-15T18:38:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa438060f70 0x7fa438063430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4500f6530 0x7fa450106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 --2- 172.21.15.33:0/619458084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4500f77d0 0x7fa4501073b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 >> 172.21.15.33:0/619458084 conn(0x7fa4500f1c90 msgr2=0x7fa4500fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 shutdown_connections 2024-02-15T18:38:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.033+0000 7fa454fca700 1 -- 172.21.15.33:0/619458084 wait complete. 2024-02-15T18:38:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.138+0000 7fae34cc8700 1 -- 172.21.15.33:0/2721991416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f77d0 msgr2=0x7fae300f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.138+0000 7fae34cc8700 1 --2- 172.21.15.33:0/2721991416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f77d0 0x7fae300f7c30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fae24004660 tx=0x7fae24009b30).stop 2024-02-15T18:38:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.138+0000 7fae34cc8700 1 -- 172.21.15.33:0/2721991416 shutdown_connections 2024-02-15T18:38:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.138+0000 7fae34cc8700 1 --2- 172.21.15.33:0/2721991416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f77d0 0x7fae300f7c30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.138+0000 7fae34cc8700 1 --2- 172.21.15.33:0/2721991416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300f6530 0x7fae300f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.138+0000 7fae34cc8700 1 -- 172.21.15.33:0/2721991416 >> 172.21.15.33:0/2721991416 conn(0x7fae300f1c90 msgr2=0x7fae300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.139+0000 7fae34cc8700 1 -- 172.21.15.33:0/2721991416 shutdown_connections 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.139+0000 7fae34cc8700 1 -- 172.21.15.33:0/2721991416 wait complete. 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.139+0000 7fae34cc8700 1 Processor -- start 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.139+0000 7fae34cc8700 1 -- start start 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.139+0000 7fae34cc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f6530 0x7fae30106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.139+0000 7fae34cc8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300f77d0 0x7fae30107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.139+0000 7fae34cc8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae30107910 con 0x7fae300f6530 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.139+0000 7fae34cc8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae30108120 con 0x7fae300f77d0 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae2f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f6530 0x7fae30106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae2f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f6530 0x7fae30106e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43334/0 (socket says 172.21.15.33:43334) 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae2f7fe700 1 -- 172.21.15.33:0/1833848280 learned_addr learned my addr 172.21.15.33:0/1833848280 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae2effd700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300f77d0 0x7fae30107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae2f7fe700 1 -- 172.21.15.33:0/1833848280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300f77d0 msgr2=0x7fae30107310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae2f7fe700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300f77d0 0x7fae30107310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae2f7fe700 1 -- 172.21.15.33:0/1833848280 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24005040 con 0x7fae300f6530 2024-02-15T18:38:38.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae2f7fe700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f6530 0x7fae30106e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fae20002700 tx=0x7fae20009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:38.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae17fff700 1 -- 172.21.15.33:0/1833848280 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae20009320 con 0x7fae300f6530 2024-02-15T18:38:38.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae301083a0 con 0x7fae300f6530 2024-02-15T18:38:38.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae17fff700 1 -- 172.21.15.33:0/1833848280 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7fae2000f040 con 0x7fae300f6530 2024-02-15T18:38:38.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae17fff700 1 -- 172.21.15.33:0/1833848280 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae200149d0 con 0x7fae300f6530 2024-02-15T18:38:38.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.140+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae30108960 con 0x7fae300f6530 2024-02-15T18:38:38.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.141+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae30059100 con 0x7fae300f6530 2024-02-15T18:38:38.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.142+0000 7fae17fff700 1 -- 172.21.15.33:0/1833848280 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fae20014b30 con 0x7fae300f6530 2024-02-15T18:38:38.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.142+0000 7fae17fff700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae18060f70 0x7fae18063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:38.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.142+0000 7fae17fff700 1 -- 172.21.15.33:0/1833848280 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fae2007c4a0 con 0x7fae300f6530 2024-02-15T18:38:38.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.142+0000 7fae2effd700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae18060f70 0x7fae18063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:38.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.143+0000 7fae2effd700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae18060f70 0x7fae18063430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fae24004630 tx=0x7fae24009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.146+0000 7fae17fff700 1 -- 172.21.15.33:0/1833848280 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fae2004ca20 con 0x7fae300f6530 2024-02-15T18:38:38.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.392+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fae30045ad0 con 0x7fae300f6530 2024-02-15T18:38:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.392+0000 7fae17fff700 1 -- 172.21.15.33:0/1833848280 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fae20050040 con 0x7fae300f6530 2024-02-15T18:38:38.382 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:38:38.382 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:38:38.382 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:38:38.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:38:38.383 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:38:38.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae18060f70 msgr2=0x7fae18063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae18060f70 0x7fae18063430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fae24004630 tx=0x7fae24009b30).stop 2024-02-15T18:38:38.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f6530 msgr2=0x7fae30106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f6530 0x7fae30106e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fae20002700 tx=0x7fae20009d80).stop 2024-02-15T18:38:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 shutdown_connections 2024-02-15T18:38:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae18060f70 0x7fae18063430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae300f6530 0x7fae30106e20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 --2- 172.21.15.33:0/1833848280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae300f77d0 0x7fae30107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 >> 172.21.15.33:0/1833848280 conn(0x7fae300f1c90 msgr2=0x7fae300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 shutdown_connections 2024-02-15T18:38:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.394+0000 7fae34cc8700 1 -- 172.21.15.33:0/1833848280 wait complete. 2024-02-15T18:38:38.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.497+0000 7f94c3274700 1 -- 172.21.15.33:0/1976841680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f55c0 msgr2=0x7f94bc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.497+0000 7f94c3274700 1 --2- 172.21.15.33:0/1976841680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f55c0 0x7f94bc0f59e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f94b8004660 tx=0x7f94b8009b30).stop 2024-02-15T18:38:38.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.497+0000 7f94c3274700 1 -- 172.21.15.33:0/1976841680 shutdown_connections 2024-02-15T18:38:38.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.497+0000 7f94c3274700 1 --2- 172.21.15.33:0/1976841680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94bc0f6860 0x7f94bc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.497+0000 7f94c3274700 1 --2- 172.21.15.33:0/1976841680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f55c0 0x7f94bc0f59e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.497+0000 7f94c3274700 1 -- 172.21.15.33:0/1976841680 >> 172.21.15.33:0/1976841680 conn(0x7f94bc0f0d40 msgr2=0x7f94bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:38.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.497+0000 7f94c3274700 1 -- 172.21.15.33:0/1976841680 shutdown_connections 2024-02-15T18:38:38.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.497+0000 7f94c3274700 1 -- 172.21.15.33:0/1976841680 wait complete. 2024-02-15T18:38:38.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c3274700 1 Processor -- start 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c3274700 1 -- start start 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c3274700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f6860 0x7f94bc106090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c3274700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94bc106580 0x7f94bc107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c3274700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc106a50 con 0x7f94bc0f6860 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c3274700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc106b90 con 0x7f94bc106580 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c1010700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f6860 0x7f94bc106090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c1010700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f6860 0x7f94bc106090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43342/0 (socket says 172.21.15.33:43342) 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c1010700 1 -- 172.21.15.33:0/4271167922 learned_addr learned my addr 172.21.15.33:0/4271167922 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c080f700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94bc106580 0x7f94bc107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c1010700 1 -- 172.21.15.33:0/4271167922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94bc106580 msgr2=0x7f94bc107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c1010700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94bc106580 0x7f94bc107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c1010700 1 -- 172.21.15.33:0/4271167922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8005040 con 0x7f94bc0f6860 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.498+0000 7f94c1010700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f6860 0x7f94bc106090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f94b8000c00 tx=0x7f94b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:38.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.499+0000 7f94b1ffb700 1 -- 172.21.15.33:0/4271167922 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94b801b070 con 0x7f94bc0f6860 2024-02-15T18:38:38.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.499+0000 7f94b1ffb700 1 -- 172.21.15.33:0/4271167922 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f94b8007dd0 con 0x7f94bc0f6860 2024-02-15T18:38:38.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.499+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94bc1079c0 con 0x7f94bc0f6860 2024-02-15T18:38:38.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.499+0000 7f94b1ffb700 1 -- 172.21.15.33:0/4271167922 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94b8012620 con 0x7f94bc0f6860 2024-02-15T18:38:38.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.499+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94bc107f20 con 0x7f94bc0f6860 2024-02-15T18:38:38.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.500+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94bc045ad0 con 0x7f94bc0f6860 2024-02-15T18:38:38.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.501+0000 7f94b1ffb700 1 -- 172.21.15.33:0/4271167922 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f94b8026030 con 0x7f94bc0f6860 2024-02-15T18:38:38.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.501+0000 7f94b1ffb700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94a8065380 0x7f94a8067840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:38.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.501+0000 7f94b1ffb700 1 -- 172.21.15.33:0/4271167922 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f94b807d2c0 con 0x7f94bc0f6860 2024-02-15T18:38:38.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.503+0000 7f94c080f700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94a8065380 0x7f94a8067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:38.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.503+0000 7f94c080f700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94a8065380 0x7f94a8067840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f94ac004c40 tx=0x7f94ac00b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:38.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.506+0000 7f94b1ffb700 1 -- 172.21.15.33:0/4271167922 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f94b8051060 con 0x7f94bc0f6860 2024-02-15T18:38:38.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.726+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94bc108140 con 0x7f94bc0f6860 2024-02-15T18:38:38.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.726+0000 7f94b1ffb700 1 -- 172.21.15.33:0/4271167922 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1802 (secure 0 0 0) 0x7f94b8024720 con 0x7f94bc0f6860 2024-02-15T18:38:38.716 INFO:teuthology.orchestra.run.smithi033.stdout:e41 2024-02-15T18:38:38.716 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:38:38.716 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:38:38.716 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 41 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:37:33.666082+0000 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:38:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 82 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=34334,1=34338} 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:38:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{0:34334} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:38:38.719 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{1:34338} state up:active seq 10 join_fscid=1 addr [v2:172.21.15.33:6828/2386752010,v1:172.21.15.33:6829/2386752010] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:38:38.719 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:38:38.719 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:38:38.719 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:38:38.719 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:38:38.719 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6824/2921613795,v1:172.21.15.131:6825/2921613795] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:38:38.719 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/2360346875,v1:172.21.15.131:6827/2360346875] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94a8065380 msgr2=0x7f94a8067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94a8065380 0x7f94a8067840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f94ac004c40 tx=0x7f94ac00b040).stop 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f6860 msgr2=0x7f94bc106090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f6860 0x7f94bc106090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f94b8000c00 tx=0x7f94b8009b30).stop 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 shutdown_connections 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f94a8065380 0x7f94a8067840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94bc0f6860 0x7f94bc106090 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 --2- 172.21.15.33:0/4271167922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f94bc106580 0x7f94bc107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 >> 172.21.15.33:0/4271167922 conn(0x7f94bc0f0d40 msgr2=0x7f94bc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.728+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 shutdown_connections 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.729+0000 7f94c3274700 1 -- 172.21.15.33:0/4271167922 wait complete. 2024-02-15T18:38:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2024-02-15T18:38:38.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.843+0000 7f929d87b700 1 -- 172.21.15.33:0/1213506751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 msgr2=0x7f92980f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.843+0000 7f929d87b700 1 --2- 172.21.15.33:0/1213506751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 0x7f92980f6b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f9284004660 tx=0x7f9284009b30).stop 2024-02-15T18:38:38.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.843+0000 7f929d87b700 1 -- 172.21.15.33:0/1213506751 shutdown_connections 2024-02-15T18:38:38.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.843+0000 7f929d87b700 1 --2- 172.21.15.33:0/1213506751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 0x7f92980f6b30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.843+0000 7f929d87b700 1 --2- 172.21.15.33:0/1213506751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980f5430 0x7f92980f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.843+0000 7f929d87b700 1 -- 172.21.15.33:0/1213506751 >> 172.21.15.33:0/1213506751 conn(0x7f92980f0b90 msgr2=0x7f92980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:38.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.843+0000 7f929d87b700 1 -- 172.21.15.33:0/1213506751 shutdown_connections 2024-02-15T18:38:38.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.843+0000 7f929d87b700 1 -- 172.21.15.33:0/1213506751 wait complete. 2024-02-15T18:38:38.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.844+0000 7f929d87b700 1 Processor -- start 2024-02-15T18:38:38.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.844+0000 7f929d87b700 1 -- start start 2024-02-15T18:38:38.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.844+0000 7f929d87b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980f5430 0x7f9298109ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:38.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.844+0000 7f929d87b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 0x7f929810bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:38.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f929d87b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980603c0 con 0x7f92980f66d0 2024-02-15T18:38:38.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f929d87b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298060500 con 0x7f92980f5430 2024-02-15T18:38:38.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f9297fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 0x7f929810bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f9297fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 0x7f929810bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43364/0 (socket says 172.21.15.33:43364) 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f9297fff700 1 -- 172.21.15.33:0/2809739678 learned_addr learned my addr 172.21.15.33:0/2809739678 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f929c879700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980f5430 0x7f9298109ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f9297fff700 1 -- 172.21.15.33:0/2809739678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980f5430 msgr2=0x7f9298109ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f9297fff700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980f5430 0x7f9298109ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f9297fff700 1 -- 172.21.15.33:0/2809739678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284005040 con 0x7f92980f66d0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f9297fff700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 0x7f929810bfd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9284009f50 tx=0x7f9284009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f92957fa700 1 -- 172.21.15.33:0/2809739678 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9284018070 con 0x7f92980f66d0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929810c520 con 0x7f92980f66d0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f92957fa700 1 -- 172.21.15.33:0/2809739678 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1137+0+0 (secure 0 0 0) 0x7f9284007ba0 con 0x7f92980f66d0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f92957fa700 1 -- 172.21.15.33:0/2809739678 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928401c420 con 0x7f92980f66d0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.845+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929810ca50 con 0x7f92980f66d0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.846+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9298059100 con 0x7f92980f66d0 2024-02-15T18:38:38.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.847+0000 7f92957fa700 1 -- 172.21.15.33:0/2809739678 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f928401d420 con 0x7f92980f66d0 2024-02-15T18:38:38.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.847+0000 7f92957fa700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9288060f70 0x7f9288063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:38:38.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.847+0000 7f92957fa700 1 -- 172.21.15.33:0/2809739678 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f928407de10 con 0x7f92980f66d0 2024-02-15T18:38:38.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.847+0000 7f929c879700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9288060f70 0x7f9288063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:38:38.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.848+0000 7f929c879700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9288060f70 0x7f9288063430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f9298060040 tx=0x7f928c00b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:38:38.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:38.851+0000 7f92957fa700 1 -- 172.21.15.33:0/2809739678 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f928404e1e0 con 0x7f92980f66d0 2024-02-15T18:38:38.925 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:37.413137+0000 mgr.smithi033.apxevf (mgr.14626) 379 : audit [DBG] from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:38.925 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:37.552369+0000 mgr.smithi033.apxevf (mgr.14626) 380 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:38.925 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:38.393239+0000 mon.smithi033 (mon.0) 718 : audit [DBG] from='client.? 172.21.15.33:0/1833848280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:38.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:37.413137+0000 mgr.smithi033.apxevf (mgr.14626) 379 : audit [DBG] from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:38.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:37.552369+0000 mgr.smithi033.apxevf (mgr.14626) 380 : cluster [DBG] pgmap v254: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:38.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:38.393239+0000 mon.smithi033 (mon.0) 718 : audit [DBG] from='client.? 172.21.15.33:0/1833848280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:39.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.045+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92980fde80 con 0x7f9288060f70 2024-02-15T18:38:39.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.046+0000 7f92957fa700 1 -- 172.21.15.33:0/2809739678 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f92980fde80 con 0x7f9288060f70 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "in_progress": true, 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "services_complete": [ 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr", 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "mds", 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "mon", 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "osd", 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "crash" 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "progress": "16/21 daemons upgraded", 2024-02-15T18:38:39.036 INFO:teuthology.orchestra.run.smithi033.stdout: "message": "Currently upgrading grafana daemons", 2024-02-15T18:38:39.037 INFO:teuthology.orchestra.run.smithi033.stdout: "is_paused": false 2024-02-15T18:38:39.037 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:38:39.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9288060f70 msgr2=0x7f9288063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:39.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9288060f70 0x7f9288063430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f9298060040 tx=0x7f928c00b040).stop 2024-02-15T18:38:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 msgr2=0x7f929810bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:38:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 0x7f929810bfd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9284009f50 tx=0x7f9284009b30).stop 2024-02-15T18:38:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 shutdown_connections 2024-02-15T18:38:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9288060f70 0x7f9288063430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92980f5430 0x7f9298109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 --2- 172.21.15.33:0/2809739678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92980f66d0 0x7f929810bfd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:38:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 >> 172.21.15.33:0/2809739678 conn(0x7f92980f0b90 msgr2=0x7f92980fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:38:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 shutdown_connections 2024-02-15T18:38:39.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:38:39.048+0000 7f929d87b700 1 -- 172.21.15.33:0/2809739678 wait complete. 2024-02-15T18:38:39.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:37.718614+0000 mgr.smithi033.apxevf (mgr.14626) 381 : audit [DBG] from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:39.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:38.023280+0000 mgr.smithi033.apxevf (mgr.14626) 382 : audit [DBG] from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:39.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:39 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:38.727229+0000 mon.smithi033 (mon.0) 719 : audit [DBG] from='client.? 172.21.15.33:0/4271167922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:38:39.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:37.718614+0000 mgr.smithi033.apxevf (mgr.14626) 381 : audit [DBG] from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:39.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:38.023280+0000 mgr.smithi033.apxevf (mgr.14626) 382 : audit [DBG] from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:39.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:39 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:38.727229+0000 mon.smithi033 (mon.0) 719 : audit [DBG] from='client.? 172.21.15.33:0/4271167922' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:38:40.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:39.046452+0000 mgr.smithi033.apxevf (mgr.14626) 383 : audit [DBG] from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:40.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:39.552750+0000 mgr.smithi033.apxevf (mgr.14626) 384 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:40.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:40.374226+0000 mon.smithi033 (mon.0) 720 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:40.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:40.374989+0000 mon.smithi033 (mon.0) 721 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:40.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:39.046452+0000 mgr.smithi033.apxevf (mgr.14626) 383 : audit [DBG] from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:38:40.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:39.552750+0000 mgr.smithi033.apxevf (mgr.14626) 384 : cluster [DBG] pgmap v255: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:40.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:40.374226+0000 mon.smithi033 (mon.0) 720 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:40.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:40.374989+0000 mon.smithi033 (mon.0) 721 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:42.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:41.553314+0000 mgr.smithi033.apxevf (mgr.14626) 385 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:43.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:41.553314+0000 mgr.smithi033.apxevf (mgr.14626) 385 : cluster [DBG] pgmap v256: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:43.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:43.553692+0000 mgr.smithi033.apxevf (mgr.14626) 386 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:44.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:43.553692+0000 mgr.smithi033.apxevf (mgr.14626) 386 : cluster [DBG] pgmap v257: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:46.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.357555+0000 mon.smithi033 (mon.0) 722 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:45.554060+0000 mgr.smithi033.apxevf (mgr.14626) 387 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:46.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.679258+0000 mon.smithi033 (mon.0) 723 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.679918+0000 mon.smithi033 (mon.0) 724 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.684051+0000 mon.smithi033 (mon.0) 725 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.690005+0000 mon.smithi033 (mon.0) 726 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.691051+0000 mon.smithi033 (mon.0) 727 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi033.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.695018+0000 mon.smithi033 (mon.0) 728 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.697629+0000 mon.smithi033 (mon.0) 729 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.701622+0000 mon.smithi033 (mon.0) 730 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.703264+0000 mon.smithi033 (mon.0) 731 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.704563+0000 mon.smithi033 (mon.0) 732 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.706066+0000 mon.smithi033 (mon.0) 733 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.707851+0000 mon.smithi033 (mon.0) 734 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.708822+0000 mon.smithi033 (mon.0) 735 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.709962+0000 mon.smithi033 (mon.0) 736 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.747 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.710996+0000 mon.smithi033 (mon.0) 737 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.712081+0000 mon.smithi033 (mon.0) 738 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.713027+0000 mon.smithi033 (mon.0) 739 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.714221+0000 mon.smithi033 (mon.0) 740 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.715257+0000 mon.smithi033 (mon.0) 741 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.716289+0000 mon.smithi033 (mon.0) 742 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.717312+0000 mon.smithi033 (mon.0) 743 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.722066+0000 mon.smithi033 (mon.0) 744 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.722716+0000 mon.smithi033 (mon.0) 745 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.725715+0000 mon.smithi033 (mon.0) 746 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.726266+0000 mon.smithi033 (mon.0) 747 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.728890+0000 mon.smithi033 (mon.0) 748 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.729425+0000 mon.smithi033 (mon.0) 749 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.732080+0000 mon.smithi033 (mon.0) 750 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-15T18:38:46.748 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.732626+0000 mon.smithi033 (mon.0) 751 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.735254+0000 mon.smithi033 (mon.0) 752 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.735828+0000 mon.smithi033 (mon.0) 753 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.738372+0000 mon.smithi033 (mon.0) 754 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.738950+0000 mon.smithi033 (mon.0) 755 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.741549+0000 mon.smithi033 (mon.0) 756 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.742117+0000 mon.smithi033 (mon.0) 757 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.744687+0000 mon.smithi033 (mon.0) 758 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.745242+0000 mon.smithi033 (mon.0) 759 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.745780+0000 mon.smithi033 (mon.0) 760 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.748414+0000 mon.smithi033 (mon.0) 761 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.748984+0000 mon.smithi033 (mon.0) 762 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.751531+0000 mon.smithi033 (mon.0) 763 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.752079+0000 mon.smithi033 (mon.0) 764 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.752613+0000 mon.smithi033 (mon.0) 765 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.749 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.753137+0000 mon.smithi033 (mon.0) 766 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.753682+0000 mon.smithi033 (mon.0) 767 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.754201+0000 mon.smithi033 (mon.0) 768 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.756977+0000 mon.smithi033 (mon.0) 769 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.757799+0000 mon.smithi033 (mon.0) 770 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.759676+0000 mon.smithi033 (mon.0) 771 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.760025+0000 mon.smithi033 (mon.0) 772 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.761336+0000 mon.smithi033 (mon.0) 773 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.761910+0000 mon.smithi033 (mon.0) 774 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.765230+0000 mon.smithi033 (mon.0) 775 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.769953+0000 mon.smithi033 (mon.0) 776 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.771154+0000 mon.smithi033 (mon.0) 777 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.771725+0000 mon.smithi033 (mon.0) 778 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:46.750 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.775339+0000 mon.smithi033 (mon.0) 779 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.357555+0000 mon.smithi033 (mon.0) 722 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:45.554060+0000 mgr.smithi033.apxevf (mgr.14626) 387 : cluster [DBG] pgmap v258: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.679258+0000 mon.smithi033 (mon.0) 723 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.679918+0000 mon.smithi033 (mon.0) 724 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.684051+0000 mon.smithi033 (mon.0) 725 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.690005+0000 mon.smithi033 (mon.0) 726 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:38:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.691051+0000 mon.smithi033 (mon.0) 727 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi033.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T18:38:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.695018+0000 mon.smithi033 (mon.0) 728 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.697629+0000 mon.smithi033 (mon.0) 729 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.701622+0000 mon.smithi033 (mon.0) 730 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.703264+0000 mon.smithi033 (mon.0) 731 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.704563+0000 mon.smithi033 (mon.0) 732 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.706066+0000 mon.smithi033 (mon.0) 733 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.707851+0000 mon.smithi033 (mon.0) 734 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.708822+0000 mon.smithi033 (mon.0) 735 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.709962+0000 mon.smithi033 (mon.0) 736 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.710996+0000 mon.smithi033 (mon.0) 737 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.712081+0000 mon.smithi033 (mon.0) 738 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.713027+0000 mon.smithi033 (mon.0) 739 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.714221+0000 mon.smithi033 (mon.0) 740 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.715257+0000 mon.smithi033 (mon.0) 741 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.716289+0000 mon.smithi033 (mon.0) 742 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.717312+0000 mon.smithi033 (mon.0) 743 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:38:46.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.722066+0000 mon.smithi033 (mon.0) 744 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.722716+0000 mon.smithi033 (mon.0) 745 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.725715+0000 mon.smithi033 (mon.0) 746 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.726266+0000 mon.smithi033 (mon.0) 747 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.728890+0000 mon.smithi033 (mon.0) 748 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.729425+0000 mon.smithi033 (mon.0) 749 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.732080+0000 mon.smithi033 (mon.0) 750 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.732626+0000 mon.smithi033 (mon.0) 751 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.735254+0000 mon.smithi033 (mon.0) 752 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.735828+0000 mon.smithi033 (mon.0) 753 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.738372+0000 mon.smithi033 (mon.0) 754 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.738950+0000 mon.smithi033 (mon.0) 755 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.741549+0000 mon.smithi033 (mon.0) 756 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.742117+0000 mon.smithi033 (mon.0) 757 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.744687+0000 mon.smithi033 (mon.0) 758 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-15T18:38:46.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.745242+0000 mon.smithi033 (mon.0) 759 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.745780+0000 mon.smithi033 (mon.0) 760 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.748414+0000 mon.smithi033 (mon.0) 761 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.748984+0000 mon.smithi033 (mon.0) 762 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.751531+0000 mon.smithi033 (mon.0) 763 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.752079+0000 mon.smithi033 (mon.0) 764 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.752613+0000 mon.smithi033 (mon.0) 765 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.753137+0000 mon.smithi033 (mon.0) 766 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.753682+0000 mon.smithi033 (mon.0) 767 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.754201+0000 mon.smithi033 (mon.0) 768 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.756977+0000 mon.smithi033 (mon.0) 769 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.757799+0000 mon.smithi033 (mon.0) 770 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.759676+0000 mon.smithi033 (mon.0) 771 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-15T18:38:46.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.760025+0000 mon.smithi033 (mon.0) 772 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:46.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.761336+0000 mon.smithi033 (mon.0) 773 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:46.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.761910+0000 mon.smithi033 (mon.0) 774 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:46.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.765230+0000 mon.smithi033 (mon.0) 775 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:46.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.769953+0000 mon.smithi033 (mon.0) 776 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:38:46.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.771154+0000 mon.smithi033 (mon.0) 777 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:38:46.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.771725+0000 mon.smithi033 (mon.0) 778 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:38:46.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.775339+0000 mon.smithi033 (mon.0) 779 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:47.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:45.680435+0000 mgr.smithi033.apxevf (mgr.14626) 388 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:47.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.690345+0000 mgr.smithi033.apxevf (mgr.14626) 389 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:38:47.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:45.691305+0000 mgr.smithi033.apxevf (mgr.14626) 390 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi033.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T18:38:47.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:45.717860+0000 mgr.smithi033.apxevf (mgr.14626) 391 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-15T18:38:47.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:45.757462+0000 mgr.smithi033.apxevf (mgr.14626) 392 : cephadm [INF] Upgrade: Complete! 2024-02-15T18:38:47.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:45.762433+0000 mgr.smithi033.apxevf (mgr.14626) 393 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:47.746 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:38:45.772228+0000 mgr.smithi033.apxevf (mgr.14626) 394 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:47.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:45.680435+0000 mgr.smithi033.apxevf (mgr.14626) 388 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:47.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.690345+0000 mgr.smithi033.apxevf (mgr.14626) 389 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-15T18:38:47.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:45.691305+0000 mgr.smithi033.apxevf (mgr.14626) 390 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi033.front.sepia.ceph.com:3000"}]: dispatch 2024-02-15T18:38:47.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:45.717860+0000 mgr.smithi033.apxevf (mgr.14626) 391 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-15T18:38:47.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:45.757462+0000 mgr.smithi033.apxevf (mgr.14626) 392 : cephadm [INF] Upgrade: Complete! 2024-02-15T18:38:47.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:45.762433+0000 mgr.smithi033.apxevf (mgr.14626) 393 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:47.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:38:45.772228+0000 mgr.smithi033.apxevf (mgr.14626) 394 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:38:48.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:47.554534+0000 mgr.smithi033.apxevf (mgr.14626) 395 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:48.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:38:47.818218+0000 mon.smithi033 (mon.0) 780 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:48.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:47.554534+0000 mgr.smithi033.apxevf (mgr.14626) 395 : cluster [DBG] pgmap v259: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:48.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:38:47.818218+0000 mon.smithi033 (mon.0) 780 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:38:50.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:49.555005+0000 mgr.smithi033.apxevf (mgr.14626) 396 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:50.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:49.555005+0000 mgr.smithi033.apxevf (mgr.14626) 396 : cluster [DBG] pgmap v260: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:52.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:51.555425+0000 mgr.smithi033.apxevf (mgr.14626) 397 : cluster [DBG] pgmap v261: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:53.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:51.555425+0000 mgr.smithi033.apxevf (mgr.14626) 397 : cluster [DBG] pgmap v261: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:54.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:53.556101+0000 mgr.smithi033.apxevf (mgr.14626) 398 : cluster [DBG] pgmap v262: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:55.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:53.556101+0000 mgr.smithi033.apxevf (mgr.14626) 398 : cluster [DBG] pgmap v262: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:56.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:56 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:55.556743+0000 mgr.smithi033.apxevf (mgr.14626) 399 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:57.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:56 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:55.556743+0000 mgr.smithi033.apxevf (mgr.14626) 399 : cluster [DBG] pgmap v263: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:58.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:38:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:57.557138+0000 mgr.smithi033.apxevf (mgr.14626) 400 : cluster [DBG] pgmap v264: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:38:59.046 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:38:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:57.557138+0000 mgr.smithi033.apxevf (mgr.14626) 400 : cluster [DBG] pgmap v264: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:00.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:38:59.557577+0000 mgr.smithi033.apxevf (mgr.14626) 401 : cluster [DBG] pgmap v265: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:00.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:38:59.557577+0000 mgr.smithi033.apxevf (mgr.14626) 401 : cluster [DBG] pgmap v265: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:02.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:01.558126+0000 mgr.smithi033.apxevf (mgr.14626) 402 : cluster [DBG] pgmap v266: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:03.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:01.558126+0000 mgr.smithi033.apxevf (mgr.14626) 402 : cluster [DBG] pgmap v266: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:04.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:03.558571+0000 mgr.smithi033.apxevf (mgr.14626) 403 : cluster [DBG] pgmap v267: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:05.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:03.558571+0000 mgr.smithi033.apxevf (mgr.14626) 403 : cluster [DBG] pgmap v267: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:06.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:05.559107+0000 mgr.smithi033.apxevf (mgr.14626) 404 : cluster [DBG] pgmap v268: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:07.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:05.559107+0000 mgr.smithi033.apxevf (mgr.14626) 404 : cluster [DBG] pgmap v268: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:08.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:08 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:07.559748+0000 mgr.smithi033.apxevf (mgr.14626) 405 : cluster [DBG] pgmap v269: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:09.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:08 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:07.559748+0000 mgr.smithi033.apxevf (mgr.14626) 405 : cluster [DBG] pgmap v269: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.163+0000 7fcb60b5b700 1 -- 172.21.15.33:0/2396520580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c060250 msgr2=0x7fcb5c0f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.163+0000 7fcb60b5b700 1 --2- 172.21.15.33:0/2396520580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c060250 0x7fcb5c0f91d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fcb4c004660 tx=0x7fcb4c009b30).stop 2024-02-15T18:39:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.163+0000 7fcb60b5b700 1 -- 172.21.15.33:0/2396520580 shutdown_connections 2024-02-15T18:39:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.163+0000 7fcb60b5b700 1 --2- 172.21.15.33:0/2396520580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb5c0f96c0 0x7fcb5c0fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.163+0000 7fcb60b5b700 1 --2- 172.21.15.33:0/2396520580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c060250 0x7fcb5c0f91d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.163+0000 7fcb60b5b700 1 -- 172.21.15.33:0/2396520580 >> 172.21.15.33:0/2396520580 conn(0x7fcb5c0f0b90 msgr2=0x7fcb5c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:39:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.163+0000 7fcb60b5b700 1 -- 172.21.15.33:0/2396520580 shutdown_connections 2024-02-15T18:39:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.163+0000 7fcb60b5b700 1 -- 172.21.15.33:0/2396520580 wait complete. 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb60b5b700 1 Processor -- start 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb60b5b700 1 -- start start 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb60b5b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb5c060250 0x7fcb5c0f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb60b5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c0f96c0 0x7fcb5c0f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb60b5b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0f5630 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb60b5b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0f5770 con 0x7fcb5c060250 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb5affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c0f96c0 0x7fcb5c0f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb5affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c0f96c0 0x7fcb5c0f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56118/0 (socket says 172.21.15.33:56118) 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb5affd700 1 -- 172.21.15.33:0/1521901591 learned_addr learned my addr 172.21.15.33:0/1521901591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.164+0000 7fcb5b7fe700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb5c060250 0x7fcb5c0f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.165+0000 7fcb5affd700 1 -- 172.21.15.33:0/1521901591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb5c060250 msgr2=0x7fcb5c0f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.165+0000 7fcb5affd700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb5c060250 0x7fcb5c0f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:09.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.165+0000 7fcb5affd700 1 -- 172.21.15.33:0/1521901591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c005040 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.165+0000 7fcb5affd700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c0f96c0 0x7fcb5c0f50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fcb440026d0 tx=0x7fcb44009d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:39:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.165+0000 7fcb53fff700 1 -- 172.21.15.33:0/1521901591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb440079c0 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.165+0000 7fcb53fff700 1 -- 172.21.15.33:0/1521901591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fcb4400f040 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.165+0000 7fcb53fff700 1 -- 172.21.15.33:0/1521901591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb44014850 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.165+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c0f5a50 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.165+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c10ee40 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.166+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5c045ad0 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.167+0000 7fcb53fff700 1 -- 172.21.15.33:0/1521901591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fcb4401b060 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.167+0000 7fcb53fff700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcb48060f70 0x7fcb48063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:39:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.167+0000 7fcb53fff700 1 -- 172.21.15.33:0/1521901591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fcb4407bf40 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.167+0000 7fcb5b7fe700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcb48060f70 0x7fcb48063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:39:09.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.168+0000 7fcb5b7fe700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcb48060f70 0x7fcb48063430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fcb4c004630 tx=0x7fcb4c009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:39:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.171+0000 7fcb53fff700 1 -- 172.21.15.33:0/1521901591 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcb4404c390 con 0x7fcb5c0f96c0 2024-02-15T18:39:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.362+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb5c0fef60 con 0x7fcb48060f70 2024-02-15T18:39:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.363+0000 7fcb53fff700 1 -- 172.21.15.33:0/1521901591 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fcb5c0fef60 con 0x7fcb48060f70 2024-02-15T18:39:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcb48060f70 msgr2=0x7fcb48063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcb48060f70 0x7fcb48063430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fcb4c004630 tx=0x7fcb4c009b30).stop 2024-02-15T18:39:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c0f96c0 msgr2=0x7fcb5c0f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c0f96c0 0x7fcb5c0f50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fcb440026d0 tx=0x7fcb44009d40).stop 2024-02-15T18:39:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 shutdown_connections 2024-02-15T18:39:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcb48060f70 0x7fcb48063430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb5c060250 0x7fcb5c0f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 --2- 172.21.15.33:0/1521901591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb5c0f96c0 0x7fcb5c0f50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 >> 172.21.15.33:0/1521901591 conn(0x7fcb5c0f0b90 msgr2=0x7fcb5c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:39:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 shutdown_connections 2024-02-15T18:39:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:09.365+0000 7fcb60b5b700 1 -- 172.21.15.33:0/1521901591 wait complete. 2024-02-15T18:39:10.229 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-15T18:39:10.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:39:09.364605+0000 mgr.smithi033.apxevf (mgr.14626) 406 : audit [DBG] from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:39:10.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:09.560329+0000 mgr.smithi033.apxevf (mgr.14626) 407 : cluster [DBG] pgmap v270: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:10.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:39:09.364605+0000 mgr.smithi033.apxevf (mgr.14626) 406 : audit [DBG] from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:39:10.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:09.560329+0000 mgr.smithi033.apxevf (mgr.14626) 407 : cluster [DBG] pgmap v270: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.510+0000 7f98e4305700 1 -- 172.21.15.33:0/1886581820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f7980 msgr2=0x7f98dc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.510+0000 7f98e4305700 1 --2- 172.21.15.33:0/1886581820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f7980 0x7f98dc0f7de0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f98d0004660 tx=0x7f98d0009b30).stop 2024-02-15T18:39:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.511+0000 7f98e4305700 1 -- 172.21.15.33:0/1886581820 shutdown_connections 2024-02-15T18:39:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.511+0000 7f98e4305700 1 --2- 172.21.15.33:0/1886581820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f7980 0x7f98dc0f7de0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.511+0000 7f98e4305700 1 --2- 172.21.15.33:0/1886581820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98dc0f66e0 0x7f98dc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.511+0000 7f98e4305700 1 -- 172.21.15.33:0/1886581820 >> 172.21.15.33:0/1886581820 conn(0x7f98dc0f1e40 msgr2=0x7f98dc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:39:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.511+0000 7f98e4305700 1 -- 172.21.15.33:0/1886581820 shutdown_connections 2024-02-15T18:39:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.511+0000 7f98e4305700 1 -- 172.21.15.33:0/1886581820 wait complete. 2024-02-15T18:39:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.511+0000 7f98e4305700 1 Processor -- start 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.511+0000 7f98e4305700 1 -- start start 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e4305700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f66e0 0x7f98dc107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e4305700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98dc0f7980 0x7f98dc1074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e4305700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc107aa0 con 0x7f98dc0f66e0 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e4305700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc107be0 con 0x7f98dc0f7980 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e20a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f66e0 0x7f98dc107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e20a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f66e0 0x7f98dc107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56134/0 (socket says 172.21.15.33:56134) 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e20a1700 1 -- 172.21.15.33:0/1566774245 learned_addr learned my addr 172.21.15.33:0/1566774245 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e20a1700 1 -- 172.21.15.33:0/1566774245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98dc0f7980 msgr2=0x7f98dc1074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e20a1700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98dc0f7980 0x7f98dc1074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e20a1700 1 -- 172.21.15.33:0/1566774245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0005040 con 0x7f98dc0f66e0 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e20a1700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f66e0 0x7f98dc107000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f98d800c530 tx=0x7f98d8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:39:12.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98ceffd700 1 -- 172.21.15.33:0/1566774245 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d800f650 con 0x7f98dc0f66e0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc108580 con 0x7f98dc0f66e0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98ceffd700 1 -- 172.21.15.33:0/1566774245 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f98d800fca0 con 0x7f98dc0f66e0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98ceffd700 1 -- 172.21.15.33:0/1566774245 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d8012e60 con 0x7f98dc0f66e0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.512+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc108b40 con 0x7f98dc0f66e0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.513+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc045ad0 con 0x7f98dc0f66e0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.514+0000 7f98ceffd700 1 -- 172.21.15.33:0/1566774245 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f98d8019030 con 0x7f98dc0f66e0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.514+0000 7f98ceffd700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f98c8060f20 0x7f98c80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.514+0000 7f98ceffd700 1 -- 172.21.15.33:0/1566774245 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f98d807bdd0 con 0x7f98dc0f66e0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.514+0000 7f98e18a0700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f98c8060f20 0x7f98c80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.515+0000 7f98e18a0700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f98c8060f20 0x7f98c80633e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f98d0009f50 tx=0x7f98d0009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:39:12.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.519+0000 7f98ceffd700 1 -- 172.21.15.33:0/1566774245 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f98d8048f60 con 0x7f98dc0f66e0 2024-02-15T18:39:12.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.703+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f98dc108dc0 con 0x7f98c8060f20 2024-02-15T18:39:12.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.713+0000 7f98ceffd700 1 -- 172.21.15.33:0/1566774245 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f98dc108dc0 con 0x7f98c8060f20 2024-02-15T18:39:12.703 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:39:12.703 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (58s) 27s ago 15m 17.1M - 0.23.0 ba2b418f427c ea890a609c2a 2024-02-15T18:39:12.703 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (6m) 27s ago 15m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:39:12.703 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (6m) 84s ago 14m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (33s) 27s ago 15m 44.4M - 8.3.5 dad864ee21e9 a1b2e8785b59 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (2m) 27s ago 10m 17.9M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a4a346f4654 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (2m) 27s ago 10m 64.5M - 16.2.14-521-g0e714d9a 1fbc92c859dc e375dd9e3a03 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (103s) 84s ago 10m 14.4M - 16.2.14-521-g0e714d9a 1fbc92c859dc 476396a5b16a 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (115s) 84s ago 10m 11.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4201a4414604 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (7m) 27s ago 17m 442M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (7m) 84s ago 14m 391M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (7m) 27s ago 17m 59.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (6m) 84s ago 14m 53.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (93s) 27s ago 15m 13.5M - 1.3.1 1dbe0e931976 d817b00dddff 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (87s) 84s ago 14m 3632k - 1.3.1 1dbe0e931976 b3854d6e821c 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (6m) 27s ago 14m 201M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:39:12.704 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (5m) 27s ago 13m 206M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:39:12.705 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (4m) 27s ago 13m 206M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:39:12.705 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (4m) 84s ago 12m 268M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4030e9f6d6c2 2024-02-15T18:39:12.705 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (3m) 84s ago 12m 256M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 902c89c867aa 2024-02-15T18:39:12.705 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (3m) 84s ago 12m 257M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc ba19a3c17a66 2024-02-15T18:39:12.705 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (74s) 27s ago 15m 61.7M - 2.33.4 514e6a882f6e b5bc87635fe1 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f98c8060f20 msgr2=0x7f98c80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f98c8060f20 0x7f98c80633e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f98d0009f50 tx=0x7f98d0009b30).stop 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f66e0 msgr2=0x7f98dc107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f66e0 0x7f98dc107000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f98d800c530 tx=0x7f98d8007e10).stop 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 shutdown_connections 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f98c8060f20 0x7f98c80633e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98dc0f66e0 0x7f98dc107000 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 --2- 172.21.15.33:0/1566774245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98dc0f7980 0x7f98dc1074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 >> 172.21.15.33:0/1566774245 conn(0x7f98dc0f1e40 msgr2=0x7f98dc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 shutdown_connections 2024-02-15T18:39:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:12.715+0000 7f98e4305700 1 -- 172.21.15.33:0/1566774245 wait complete. 2024-02-15T18:39:12.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:11.560921+0000 mgr.smithi033.apxevf (mgr.14626) 408 : cluster [DBG] pgmap v271: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:13.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:11.560921+0000 mgr.smithi033.apxevf (mgr.14626) 408 : cluster [DBG] pgmap v271: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:13.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-15T18:39:14.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:39:12.706019+0000 mgr.smithi033.apxevf (mgr.14626) 409 : audit [DBG] from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:39:14.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:13.561282+0000 mgr.smithi033.apxevf (mgr.14626) 410 : cluster [DBG] pgmap v272: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:15.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:39:12.706019+0000 mgr.smithi033.apxevf (mgr.14626) 409 : audit [DBG] from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:39:15.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:13.561282+0000 mgr.smithi033.apxevf (mgr.14626) 410 : cluster [DBG] pgmap v272: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.609+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1896759646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f8610 msgr2=0x7f90d80f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.609+0000 7f90dd7a0700 1 --2- 172.21.15.33:0/1896759646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f8610 0x7f90d80f4820 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f90c0004660 tx=0x7f90c0009b30).stop 2024-02-15T18:39:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.609+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1896759646 shutdown_connections 2024-02-15T18:39:15.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.609+0000 7f90dd7a0700 1 --2- 172.21.15.33:0/1896759646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f8610 0x7f90d80f4820 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:15.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.609+0000 7f90dd7a0700 1 --2- 172.21.15.33:0/1896759646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d80f7d00 0x7f90d80f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:15.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.609+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1896759646 >> 172.21.15.33:0/1896759646 conn(0x7f90d80f0540 msgr2=0x7f90d80f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:39:15.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.609+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1896759646 shutdown_connections 2024-02-15T18:39:15.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.609+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1896759646 wait complete. 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.610+0000 7f90dd7a0700 1 Processor -- start 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.610+0000 7f90dd7a0700 1 -- start start 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90dd7a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f7d00 0x7f90d8106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90dd7a0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d80f8610 0x7f90d8107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90dd7a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8107a40 con 0x7f90d80f7d00 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90dd7a0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8107b80 con 0x7f90d80f8610 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f7d00 0x7f90d8106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f7d00 0x7f90d8106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52662/0 (socket says 172.21.15.33:52662) 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90d6ffd700 1 -- 172.21.15.33:0/1903344710 learned_addr learned my addr 172.21.15.33:0/1903344710 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:39:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90d67fc700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d80f8610 0x7f90d8107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90d6ffd700 1 -- 172.21.15.33:0/1903344710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d80f8610 msgr2=0x7f90d8107490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90d6ffd700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d80f8610 0x7f90d8107490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90d6ffd700 1 -- 172.21.15.33:0/1903344710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0005040 con 0x7f90d80f7d00 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90d6ffd700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f7d00 0x7f90d8106fa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f90c80026d0 tx=0x7f90c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90cf7fe700 1 -- 172.21.15.33:0/1903344710 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c80079c0 con 0x7f90d80f7d00 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90cf7fe700 1 -- 172.21.15.33:0/1903344710 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f90c800f040 con 0x7f90d80f7d00 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d8108520 con 0x7f90d80f7d00 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.611+0000 7f90cf7fe700 1 -- 172.21.15.33:0/1903344710 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c80149f0 con 0x7f90d80f7d00 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.612+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d8108ae0 con 0x7f90d80f7d00 2024-02-15T18:39:15.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.613+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d8045ad0 con 0x7f90d80f7d00 2024-02-15T18:39:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.613+0000 7f90cf7fe700 1 -- 172.21.15.33:0/1903344710 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f90c8007b20 con 0x7f90d80f7d00 2024-02-15T18:39:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.613+0000 7f90cf7fe700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f90c4060f20 0x7f90c40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:39:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.613+0000 7f90cf7fe700 1 -- 172.21.15.33:0/1903344710 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f90c807c130 con 0x7f90d80f7d00 2024-02-15T18:39:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.614+0000 7f90d67fc700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f90c4060f20 0x7f90c40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:39:15.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.614+0000 7f90d67fc700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f90c4060f20 0x7f90c40633e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f90c0004630 tx=0x7f90c0009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:39:15.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.618+0000 7f90cf7fe700 1 -- 172.21.15.33:0/1903344710 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f90c804ff90 con 0x7f90d80f7d00 2024-02-15T18:39:15.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.865+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90d80ff0d0 con 0x7f90d80f7d00 2024-02-15T18:39:15.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.866+0000 7f90cf7fe700 1 -- 172.21.15.33:0/1903344710 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f90c804fb80 con 0x7f90d80f7d00 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:39:15.857 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:39:15.858 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:39:15.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:39:15.858 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:39:15.858 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:39:15.858 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:39:15.858 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:39:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f90c4060f20 msgr2=0x7f90c40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f90c4060f20 0x7f90c40633e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f90c0004630 tx=0x7f90c0009b30).stop 2024-02-15T18:39:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f7d00 msgr2=0x7f90d8106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:39:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f7d00 0x7f90d8106fa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f90c80026d0 tx=0x7f90c8009de0).stop 2024-02-15T18:39:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 shutdown_connections 2024-02-15T18:39:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f90c4060f20 0x7f90c40633e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90d80f7d00 0x7f90d8106fa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 --2- 172.21.15.33:0/1903344710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d80f8610 0x7f90d8107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:39:15.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 >> 172.21.15.33:0/1903344710 conn(0x7f90d80f0540 msgr2=0x7f90d80fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:39:15.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 shutdown_connections 2024-02-15T18:39:15.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:39:15.868+0000 7f90dd7a0700 1 -- 172.21.15.33:0/1903344710 wait complete. 2024-02-15T18:39:16.631 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-15T18:39:16.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:15.561693+0000 mgr.smithi033.apxevf (mgr.14626) 411 : cluster [DBG] pgmap v273: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:16.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:16 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:39:15.867794+0000 mon.smithi033 (mon.0) 781 : audit [DBG] from='client.? 172.21.15.33:0/1903344710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:39:17.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:15.561693+0000 mgr.smithi033.apxevf (mgr.14626) 411 : cluster [DBG] pgmap v273: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:17.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:16 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:39:15.867794+0000 mon.smithi033 (mon.0) 781 : audit [DBG] from='client.? 172.21.15.33:0/1903344710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:39:18.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:17.562356+0000 mgr.smithi033.apxevf (mgr.14626) 412 : cluster [DBG] pgmap v274: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:18.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:17.562356+0000 mgr.smithi033.apxevf (mgr.14626) 412 : cluster [DBG] pgmap v274: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:19.028 INFO:teuthology.orchestra.run.smithi033.stdout:wait for servicemap items w/ changing names to refresh 2024-02-15T18:39:19.712 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'sleep 60' 2024-02-15T18:39:20.413 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:19.562829+0000 mgr.smithi033.apxevf (mgr.14626) 413 : cluster [DBG] pgmap v275: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:20.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:19.562829+0000 mgr.smithi033.apxevf (mgr.14626) 413 : cluster [DBG] pgmap v275: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:22.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:21.563275+0000 mgr.smithi033.apxevf (mgr.14626) 414 : cluster [DBG] pgmap v276: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:23.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:21.563275+0000 mgr.smithi033.apxevf (mgr.14626) 414 : cluster [DBG] pgmap v276: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:24.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:23.563882+0000 mgr.smithi033.apxevf (mgr.14626) 415 : cluster [DBG] pgmap v277: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:25.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:23.563882+0000 mgr.smithi033.apxevf (mgr.14626) 415 : cluster [DBG] pgmap v277: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:26.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:25.564377+0000 mgr.smithi033.apxevf (mgr.14626) 416 : cluster [DBG] pgmap v278: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:27.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:26 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:25.564377+0000 mgr.smithi033.apxevf (mgr.14626) 416 : cluster [DBG] pgmap v278: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:28.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:27.564995+0000 mgr.smithi033.apxevf (mgr.14626) 417 : cluster [DBG] pgmap v279: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:29.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:27.564995+0000 mgr.smithi033.apxevf (mgr.14626) 417 : cluster [DBG] pgmap v279: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:30.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:29.565424+0000 mgr.smithi033.apxevf (mgr.14626) 418 : cluster [DBG] pgmap v280: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:30.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:29.565424+0000 mgr.smithi033.apxevf (mgr.14626) 418 : cluster [DBG] pgmap v280: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:32.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:31.565991+0000 mgr.smithi033.apxevf (mgr.14626) 419 : cluster [DBG] pgmap v281: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:33.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:31.565991+0000 mgr.smithi033.apxevf (mgr.14626) 419 : cluster [DBG] pgmap v281: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:34.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:33.566662+0000 mgr.smithi033.apxevf (mgr.14626) 420 : cluster [DBG] pgmap v282: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:35.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:34 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:33.566662+0000 mgr.smithi033.apxevf (mgr.14626) 420 : cluster [DBG] pgmap v282: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:36.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:35.567235+0000 mgr.smithi033.apxevf (mgr.14626) 421 : cluster [DBG] pgmap v283: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:37.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:35.567235+0000 mgr.smithi033.apxevf (mgr.14626) 421 : cluster [DBG] pgmap v283: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:37.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:37.567642+0000 mgr.smithi033.apxevf (mgr.14626) 422 : cluster [DBG] pgmap v284: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:38.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:37 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:37.567642+0000 mgr.smithi033.apxevf (mgr.14626) 422 : cluster [DBG] pgmap v284: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:40.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:39.568108+0000 mgr.smithi033.apxevf (mgr.14626) 423 : cluster [DBG] pgmap v285: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:40.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:39.568108+0000 mgr.smithi033.apxevf (mgr.14626) 423 : cluster [DBG] pgmap v285: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:42.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:41.568571+0000 mgr.smithi033.apxevf (mgr.14626) 424 : cluster [DBG] pgmap v286: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:43.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:41.568571+0000 mgr.smithi033.apxevf (mgr.14626) 424 : cluster [DBG] pgmap v286: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:44.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:43.569152+0000 mgr.smithi033.apxevf (mgr.14626) 425 : cluster [DBG] pgmap v287: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:45.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:43.569152+0000 mgr.smithi033.apxevf (mgr.14626) 425 : cluster [DBG] pgmap v287: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:46.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:45.569582+0000 mgr.smithi033.apxevf (mgr.14626) 426 : cluster [DBG] pgmap v288: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:46.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:39:45.780227+0000 mon.smithi033 (mon.0) 782 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:39:46.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:39:46.086964+0000 mon.smithi033 (mon.0) 783 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:39:46.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:39:46.087664+0000 mon.smithi033 (mon.0) 784 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:39:46.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:39:46.091920+0000 mon.smithi033 (mon.0) 785 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:39:47.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:45.569582+0000 mgr.smithi033.apxevf (mgr.14626) 426 : cluster [DBG] pgmap v288: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:47.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:39:45.780227+0000 mon.smithi033 (mon.0) 782 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:39:47.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:39:46.086964+0000 mon.smithi033 (mon.0) 783 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:39:47.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:39:46.087664+0000 mon.smithi033 (mon.0) 784 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:39:47.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:39:46.091920+0000 mon.smithi033 (mon.0) 785 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:39:47.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:39:46.088229+0000 mgr.smithi033.apxevf (mgr.14626) 427 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:39:47.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:47.570126+0000 mgr.smithi033.apxevf (mgr.14626) 428 : cluster [DBG] pgmap v289: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:48.044 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:39:46.088229+0000 mgr.smithi033.apxevf (mgr.14626) 427 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:39:48.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:47.570126+0000 mgr.smithi033.apxevf (mgr.14626) 428 : cluster [DBG] pgmap v289: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:50.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:49.570564+0000 mgr.smithi033.apxevf (mgr.14626) 429 : cluster [DBG] pgmap v290: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:50.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:49.570564+0000 mgr.smithi033.apxevf (mgr.14626) 429 : cluster [DBG] pgmap v290: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:52.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:52 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:51.571050+0000 mgr.smithi033.apxevf (mgr.14626) 430 : cluster [DBG] pgmap v291: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:53.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:51.571050+0000 mgr.smithi033.apxevf (mgr.14626) 430 : cluster [DBG] pgmap v291: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:54.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:54 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:53.571585+0000 mgr.smithi033.apxevf (mgr.14626) 431 : cluster [DBG] pgmap v292: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:55.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:54 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:53.571585+0000 mgr.smithi033.apxevf (mgr.14626) 431 : cluster [DBG] pgmap v292: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:55.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:55 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:55.572144+0000 mgr.smithi033.apxevf (mgr.14626) 432 : cluster [DBG] pgmap v293: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:56.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:55.572144+0000 mgr.smithi033.apxevf (mgr.14626) 432 : cluster [DBG] pgmap v293: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:58.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:39:58 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:57.572670+0000 mgr.smithi033.apxevf (mgr.14626) 433 : cluster [DBG] pgmap v294: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:39:59.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:39:58 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:57.572670+0000 mgr.smithi033.apxevf (mgr.14626) 433 : cluster [DBG] pgmap v294: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:00.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:39:59.573084+0000 mgr.smithi033.apxevf (mgr.14626) 434 : cluster [DBG] pgmap v295: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:00.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:00 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:00.000185+0000 mon.smithi033 (mon.0) 786 : cluster [WRN] overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-15T18:40:00.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:39:59.573084+0000 mgr.smithi033.apxevf (mgr.14626) 434 : cluster [DBG] pgmap v295: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:00.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:00 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:00.000185+0000 mon.smithi033 (mon.0) 786 : cluster [WRN] overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-15T18:40:02.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:02 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:01.573562+0000 mgr.smithi033.apxevf (mgr.14626) 435 : cluster [DBG] pgmap v296: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:03.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:02 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:01.573562+0000 mgr.smithi033.apxevf (mgr.14626) 435 : cluster [DBG] pgmap v296: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:04.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:04 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:03.574098+0000 mgr.smithi033.apxevf (mgr.14626) 436 : cluster [DBG] pgmap v297: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:05.044 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:04 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:03.574098+0000 mgr.smithi033.apxevf (mgr.14626) 436 : cluster [DBG] pgmap v297: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:06.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:06 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:05.574554+0000 mgr.smithi033.apxevf (mgr.14626) 437 : cluster [DBG] pgmap v298: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:07.044 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:06 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:05.574554+0000 mgr.smithi033.apxevf (mgr.14626) 437 : cluster [DBG] pgmap v298: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:07.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:07 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:07.575264+0000 mgr.smithi033.apxevf (mgr.14626) 438 : cluster [DBG] pgmap v299: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:08.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:07 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:07.575264+0000 mgr.smithi033.apxevf (mgr.14626) 438 : cluster [DBG] pgmap v299: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:10.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:10 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:09.575761+0000 mgr.smithi033.apxevf (mgr.14626) 439 : cluster [DBG] pgmap v300: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:10.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:09.575761+0000 mgr.smithi033.apxevf (mgr.14626) 439 : cluster [DBG] pgmap v300: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:12.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:12 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:11.576202+0000 mgr.smithi033.apxevf (mgr.14626) 440 : cluster [DBG] pgmap v301: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:13.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:12 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:11.576202+0000 mgr.smithi033.apxevf (mgr.14626) 440 : cluster [DBG] pgmap v301: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:14.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:14 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:13.576716+0000 mgr.smithi033.apxevf (mgr.14626) 441 : cluster [DBG] pgmap v302: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:15.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:14 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:13.576716+0000 mgr.smithi033.apxevf (mgr.14626) 441 : cluster [DBG] pgmap v302: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:15.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:15 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:15.577115+0000 mgr.smithi033.apxevf (mgr.14626) 442 : cluster [DBG] pgmap v303: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:16.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:15 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:15.577115+0000 mgr.smithi033.apxevf (mgr.14626) 442 : cluster [DBG] pgmap v303: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:18.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:17.577583+0000 mgr.smithi033.apxevf (mgr.14626) 443 : cluster [DBG] pgmap v304: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:19.044 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:18 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:17.577583+0000 mgr.smithi033.apxevf (mgr.14626) 443 : cluster [DBG] pgmap v304: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:20.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:20 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:19.577983+0000 mgr.smithi033.apxevf (mgr.14626) 444 : cluster [DBG] pgmap v305: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:20.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:20 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:19.577983+0000 mgr.smithi033.apxevf (mgr.14626) 444 : cluster [DBG] pgmap v305: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:22.670 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph orch ps' 2024-02-15T18:40:22.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:21.578535+0000 mgr.smithi033.apxevf (mgr.14626) 445 : cluster [DBG] pgmap v306: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:23.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:22 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:21.578535+0000 mgr.smithi033.apxevf (mgr.14626) 445 : cluster [DBG] pgmap v306: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:24.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:24 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:23.578918+0000 mgr.smithi033.apxevf (mgr.14626) 446 : cluster [DBG] pgmap v307: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:24.996 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:23.578918+0000 mgr.smithi033.apxevf (mgr.14626) 446 : cluster [DBG] pgmap v307: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.001+0000 7f042d82f700 1 -- 172.21.15.33:0/2719217081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 msgr2=0x7f04280fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.001+0000 7f042d82f700 1 --2- 172.21.15.33:0/2719217081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 0x7f04280fbce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f041c004690 tx=0x7f041c009b30).stop 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.001+0000 7f042d82f700 1 -- 172.21.15.33:0/2719217081 shutdown_connections 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.001+0000 7f042d82f700 1 --2- 172.21.15.33:0/2719217081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 0x7f04280fbce0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.001+0000 7f042d82f700 1 --2- 172.21.15.33:0/2719217081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0428060290 0x7f04280f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.001+0000 7f042d82f700 1 -- 172.21.15.33:0/2719217081 >> 172.21.15.33:0/2719217081 conn(0x7f04280f0de0 msgr2=0x7f04280f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.001+0000 7f042d82f700 1 -- 172.21.15.33:0/2719217081 shutdown_connections 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.001+0000 7f042d82f700 1 -- 172.21.15.33:0/2719217081 wait complete. 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.001+0000 7f042d82f700 1 Processor -- start 2024-02-15T18:40:25.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f042d82f700 1 -- start start 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f042d82f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0428060290 0x7f04280f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f042d82f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 0x7f04280f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f042d82f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280f5860 con 0x7f04280f98f0 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f042d82f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280f59a0 con 0x7f0428060290 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f04267fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 0x7f04280f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f04267fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 0x7f04280f5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39640/0 (socket says 172.21.15.33:39640) 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f04267fc700 1 -- 172.21.15.33:0/2353711062 learned_addr learned my addr 172.21.15.33:0/2353711062 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f0426ffd700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0428060290 0x7f04280f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f04267fc700 1 -- 172.21.15.33:0/2353711062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0428060290 msgr2=0x7f04280f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f04267fc700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0428060290 0x7f04280f6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.002+0000 7f04267fc700 1 -- 172.21.15.33:0/2353711062 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c005040 con 0x7f04280f98f0 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.003+0000 7f04267fc700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 0x7f04280f5300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f041c004d70 tx=0x7f041c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.003+0000 7f040f7fe700 1 -- 172.21.15.33:0/2353711062 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041c019070 con 0x7f04280f98f0 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.003+0000 7f040f7fe700 1 -- 172.21.15.33:0/2353711062 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f041c01e420 con 0x7f04280f98f0 2024-02-15T18:40:25.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.003+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04280f5c20 con 0x7f04280f98f0 2024-02-15T18:40:25.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.003+0000 7f040f7fe700 1 -- 172.21.15.33:0/2353711062 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041c014660 con 0x7f04280f98f0 2024-02-15T18:40:25.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.003+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04280f6100 con 0x7f04280f98f0 2024-02-15T18:40:25.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.004+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0428045ad0 con 0x7f04280f98f0 2024-02-15T18:40:25.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.004+0000 7f040f7fe700 1 -- 172.21.15.33:0/2353711062 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f041c01ea70 con 0x7f04280f98f0 2024-02-15T18:40:25.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.005+0000 7f040f7fe700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0410060f20 0x7f04100633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:25.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.005+0000 7f040f7fe700 1 -- 172.21.15.33:0/2353711062 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f041c07d630 con 0x7f04280f98f0 2024-02-15T18:40:25.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.005+0000 7f0426ffd700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0410060f20 0x7f04100633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:25.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.005+0000 7f0426ffd700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0410060f20 0x7f04100633e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0418009fd0 tx=0x7f041800b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:25.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.009+0000 7f040f7fe700 1 -- 172.21.15.33:0/2353711062 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f041c04da60 con 0x7f04280f98f0 2024-02-15T18:40:25.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.190+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 --> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f04280ff0c0 con 0x7f0410060f20 2024-02-15T18:40:25.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.200+0000 7f040f7fe700 1 -- 172.21.15.33:0/2353711062 <== mgr.14626 v2:172.21.15.33:6800/2986322533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f04280ff0c0 con 0x7f0410060f20 2024-02-15T18:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-15T18:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (2m) 99s ago 17m 17.1M - 0.23.0 ba2b418f427c ea890a609c2a 2024-02-15T18:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (7m) 99s ago 17m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc cf5da16ab407 2024-02-15T18:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi131 smithi131 running (7m) 2m ago 16m 6639k - 16.2.14-521-g0e714d9a 1fbc92c859dc 774dd750ef77 2024-02-15T18:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (105s) 99s ago 16m 44.4M - 8.3.5 dad864ee21e9 a1b2e8785b59 2024-02-15T18:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.mcppgd smithi033 running (3m) 99s ago 11m 17.9M - 16.2.14-521-g0e714d9a 1fbc92c859dc 8a4a346f4654 2024-02-15T18:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.qszefh smithi033 running (3m) 99s ago 11m 64.5M - 16.2.14-521-g0e714d9a 1fbc92c859dc e375dd9e3a03 2024-02-15T18:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.bgnwzs smithi131 running (2m) 2m ago 11m 14.4M - 16.2.14-521-g0e714d9a 1fbc92c859dc 476396a5b16a 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi131.ywlevz smithi131 running (3m) 2m ago 11m 11.7M - 16.2.14-521-g0e714d9a 1fbc92c859dc 4201a4414604 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.apxevf smithi033 *:8443,9283 running (9m) 99s ago 18m 442M - 16.2.14-521-g0e714d9a 1fbc92c859dc 57bc9eb222ed 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi131.buibla smithi131 *:8443,9283 running (8m) 2m ago 16m 391M - 16.2.14-521-g0e714d9a 1fbc92c859dc 35066c40ca69 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (8m) 99s ago 18m 59.9M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc 4a968e2a086e 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi131 smithi131 running (7m) 2m ago 15m 53.2M 2048M 16.2.14-521-g0e714d9a 1fbc92c859dc dd645d692186 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (2m) 99s ago 16m 13.5M - 1.3.1 1dbe0e931976 d817b00dddff 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi131 smithi131 *:9100 running (2m) 2m ago 15m 3632k - 1.3.1 1dbe0e931976 b3854d6e821c 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 99s ago 15m 201M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc d5594d5916e2 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (6m) 99s ago 14m 206M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 43a42c7e9049 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (5m) 99s ago 14m 206M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc fc3ec254b448 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi131 running (5m) 2m ago 14m 268M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 4030e9f6d6c2 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi131 running (5m) 2m ago 13m 256M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc 902c89c867aa 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi131 running (4m) 2m ago 13m 257M 4096M 16.2.14-521-g0e714d9a 1fbc92c859dc ba19a3c17a66 2024-02-15T18:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (2m) 99s ago 16m 61.7M - 2.33.4 514e6a882f6e b5bc87635fe1 2024-02-15T18:40:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0410060f20 msgr2=0x7f04100633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0410060f20 0x7f04100633e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0418009fd0 tx=0x7f041800b040).stop 2024-02-15T18:40:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 msgr2=0x7f04280f5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 0x7f04280f5300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f041c004d70 tx=0x7f041c00b040).stop 2024-02-15T18:40:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 shutdown_connections 2024-02-15T18:40:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0410060f20 0x7f04100633e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0428060290 0x7f04280f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 --2- 172.21.15.33:0/2353711062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04280f98f0 0x7f04280f5300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:25.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 >> 172.21.15.33:0/2353711062 conn(0x7f04280f0de0 msgr2=0x7f04280f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:25.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 shutdown_connections 2024-02-15T18:40:25.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:25.202+0000 7f042d82f700 1 -- 172.21.15.33:0/2353711062 wait complete. 2024-02-15T18:40:25.884 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:25.193141+0000 mgr.smithi033.apxevf (mgr.14626) 447 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:40:25.884 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:25 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:25.579485+0000 mgr.smithi033.apxevf (mgr.14626) 448 : cluster [DBG] pgmap v308: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:25.907 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions' 2024-02-15T18:40:25.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:25.193141+0000 mgr.smithi033.apxevf (mgr.14626) 447 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-15T18:40:25.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:25.579485+0000 mgr.smithi033.apxevf (mgr.14626) 448 : cluster [DBG] pgmap v308: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:28.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.444+0000 7ff43b6d2700 1 -- 172.21.15.33:0/518087108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4340f9830 msgr2=0x7ff4340fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:28.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.444+0000 7ff43b6d2700 1 --2- 172.21.15.33:0/518087108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4340f9830 0x7ff4340fbc80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ff428004660 tx=0x7ff428009b30).stop 2024-02-15T18:40:28.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.444+0000 7ff43b6d2700 1 -- 172.21.15.33:0/518087108 shutdown_connections 2024-02-15T18:40:28.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.444+0000 7ff43b6d2700 1 --2- 172.21.15.33:0/518087108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4340f9830 0x7ff4340fbc80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:28.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.444+0000 7ff43b6d2700 1 --2- 172.21.15.33:0/518087108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff434060270 0x7ff4340f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:28.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.444+0000 7ff43b6d2700 1 -- 172.21.15.33:0/518087108 >> 172.21.15.33:0/518087108 conn(0x7ff4340f0d40 msgr2=0x7ff4340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:28.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.444+0000 7ff43b6d2700 1 -- 172.21.15.33:0/518087108 shutdown_connections 2024-02-15T18:40:28.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.444+0000 7ff43b6d2700 1 -- 172.21.15.33:0/518087108 wait complete. 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff43b6d2700 1 Processor -- start 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff43b6d2700 1 -- start start 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff43b6d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434060270 0x7ff4340f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff43b6d2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4340f9830 0x7ff4340f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff43b6d2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340f57a0 con 0x7ff434060270 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff43b6d2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340f58e0 con 0x7ff4340f9830 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff43946e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434060270 0x7ff4340f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff43946e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434060270 0x7ff4340f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40584/0 (socket says 172.21.15.33:40584) 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff43946e700 1 -- 172.21.15.33:0/3478085745 learned_addr learned my addr 172.21.15.33:0/3478085745 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.445+0000 7ff438c6d700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4340f9830 0x7ff4340f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.446+0000 7ff43946e700 1 -- 172.21.15.33:0/3478085745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4340f9830 msgr2=0x7ff4340f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:28.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.446+0000 7ff43946e700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4340f9830 0x7ff4340f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:28.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.446+0000 7ff43946e700 1 -- 172.21.15.33:0/3478085745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428005040 con 0x7ff434060270 2024-02-15T18:40:28.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.446+0000 7ff43946e700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434060270 0x7ff4340f6dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ff4300026d0 tx=0x7ff430009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:28.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.446+0000 7ff425ffb700 1 -- 172.21.15.33:0/3478085745 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4300079c0 con 0x7ff434060270 2024-02-15T18:40:28.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.446+0000 7ff425ffb700 1 -- 172.21.15.33:0/3478085745 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7ff43000f040 con 0x7ff434060270 2024-02-15T18:40:28.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.446+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4340f5bc0 con 0x7ff434060270 2024-02-15T18:40:28.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.446+0000 7ff425ffb700 1 -- 172.21.15.33:0/3478085745 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4300149f0 con 0x7ff434060270 2024-02-15T18:40:28.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.446+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43410efe0 con 0x7ff434060270 2024-02-15T18:40:28.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.447+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff434045ad0 con 0x7ff434060270 2024-02-15T18:40:28.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.448+0000 7ff425ffb700 1 -- 172.21.15.33:0/3478085745 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ff430007b20 con 0x7ff434060270 2024-02-15T18:40:28.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.448+0000 7ff425ffb700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff420060f20 0x7ff4200633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:28.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.448+0000 7ff425ffb700 1 -- 172.21.15.33:0/3478085745 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff43007c000 con 0x7ff434060270 2024-02-15T18:40:28.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.448+0000 7ff438c6d700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff420060f20 0x7ff4200633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:28.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.449+0000 7ff438c6d700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff420060f20 0x7ff4200633e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff428004630 tx=0x7ff428009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:28.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.452+0000 7ff425ffb700 1 -- 172.21.15.33:0/3478085745 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff43004c4b0 con 0x7ff434060270 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.699+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff434027a00 con 0x7ff434060270 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.699+0000 7ff425ffb700 1 -- 172.21.15.33:0/3478085745 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff43004fad0 con 0x7ff434060270 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 2 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:40:28.690 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2024-02-15T18:40:28.691 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 6 2024-02-15T18:40:28.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:40:28.691 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-02-15T18:40:28.691 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 4 2024-02-15T18:40:28.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-02-15T18:40:28.691 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2024-02-15T18:40:28.691 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)": 14 2024-02-15T18:40:28.691 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-02-15T18:40:28.691 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff420060f20 msgr2=0x7ff4200633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff420060f20 0x7ff4200633e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff428004630 tx=0x7ff428009b30).stop 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434060270 msgr2=0x7ff4340f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434060270 0x7ff4340f6dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ff4300026d0 tx=0x7ff430009de0).stop 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 shutdown_connections 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff420060f20 0x7ff4200633e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434060270 0x7ff4340f6dc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 --2- 172.21.15.33:0/3478085745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4340f9830 0x7ff4340f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 >> 172.21.15.33:0/3478085745 conn(0x7ff4340f0d40 msgr2=0x7ff4340f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 shutdown_connections 2024-02-15T18:40:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:28.701+0000 7ff43b6d2700 1 -- 172.21.15.33:0/3478085745 wait complete. 2024-02-15T18:40:28.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:27.580025+0000 mgr.smithi033.apxevf (mgr.14626) 449 : cluster [DBG] pgmap v309: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:29.044 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:28 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:27.580025+0000 mgr.smithi033.apxevf (mgr.14626) 449 : cluster [DBG] pgmap v309: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:29.506 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-15T18:40:29.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:29 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:28.701301+0000 mon.smithi033 (mon.0) 787 : audit [DBG] from='client.? 172.21.15.33:0/3478085745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:40:29.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:28.701301+0000 mon.smithi033 (mon.0) 787 : audit [DBG] from='client.? 172.21.15.33:0/3478085745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:40:30.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:29.580379+0000 mgr.smithi033.apxevf (mgr.14626) 450 : cluster [DBG] pgmap v310: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:31.044 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:30 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:29.580379+0000 mgr.smithi033.apxevf (mgr.14626) 450 : cluster [DBG] pgmap v310: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:31.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.700+0000 7ff78cb69700 1 -- 172.21.15.33:0/1623460493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 msgr2=0x7ff7880f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:31.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.700+0000 7ff78cb69700 1 --2- 172.21.15.33:0/1623460493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 0x7ff7880f6b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7ff77c0099e0 tx=0x7ff77c004d10).stop 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.700+0000 7ff78cb69700 1 -- 172.21.15.33:0/1623460493 shutdown_connections 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.700+0000 7ff78cb69700 1 --2- 172.21.15.33:0/1623460493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 0x7ff7880f6b30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.700+0000 7ff78cb69700 1 --2- 172.21.15.33:0/1623460493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880f5430 0x7ff7880f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.700+0000 7ff78cb69700 1 -- 172.21.15.33:0/1623460493 >> 172.21.15.33:0/1623460493 conn(0x7ff7880f0b90 msgr2=0x7ff7880f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.700+0000 7ff78cb69700 1 -- 172.21.15.33:0/1623460493 shutdown_connections 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.700+0000 7ff78cb69700 1 -- 172.21.15.33:0/1623460493 wait complete. 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.700+0000 7ff78cb69700 1 Processor -- start 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff78cb69700 1 -- start start 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff78cb69700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880f5430 0x7ff7880f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff78cb69700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 0x7ff7880f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff78cb69700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7880f8000 con 0x7ff7880f66d0 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff78cb69700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7880f8140 con 0x7ff7880f5430 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff786ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 0x7ff7880f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff786ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 0x7ff7880f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40604/0 (socket says 172.21.15.33:40604) 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff786ffd700 1 -- 172.21.15.33:0/2852114401 learned_addr learned my addr 172.21.15.33:0/2852114401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff7877fe700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880f5430 0x7ff7880f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff786ffd700 1 -- 172.21.15.33:0/2852114401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880f5430 msgr2=0x7ff7880f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff786ffd700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880f5430 0x7ff7880f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff786ffd700 1 -- 172.21.15.33:0/2852114401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c009640 con 0x7ff7880f66d0 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.701+0000 7ff786ffd700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 0x7ff7880f7a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7ff77c004b70 tx=0x7ff77c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.702+0000 7ff76ffff700 1 -- 172.21.15.33:0/2852114401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff77c00e070 con 0x7ff7880f66d0 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.702+0000 7ff76ffff700 1 -- 172.21.15.33:0/2852114401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7ff77c007df0 con 0x7ff7880f66d0 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.702+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7880f83c0 con 0x7ff7880f66d0 2024-02-15T18:40:31.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.702+0000 7ff76ffff700 1 -- 172.21.15.33:0/2852114401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff77c018070 con 0x7ff7880f66d0 2024-02-15T18:40:31.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.702+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78810eff0 con 0x7ff7880f66d0 2024-02-15T18:40:31.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.703+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff788059100 con 0x7ff7880f66d0 2024-02-15T18:40:31.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.703+0000 7ff76ffff700 1 -- 172.21.15.33:0/2852114401 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ff77c013b10 con 0x7ff7880f66d0 2024-02-15T18:40:31.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.703+0000 7ff76ffff700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff770060f70 0x7ff770063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:31.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.704+0000 7ff76ffff700 1 -- 172.21.15.33:0/2852114401 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff77c07dc70 con 0x7ff7880f66d0 2024-02-15T18:40:31.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.704+0000 7ff7877fe700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff770060f70 0x7ff770063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:31.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.704+0000 7ff7877fe700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff770060f70 0x7ff770063430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff7880f9320 tx=0x7ff778008040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:31.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.708+0000 7ff76ffff700 1 -- 172.21.15.33:0/2852114401 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff77c04e0a0 con 0x7ff7880f66d0 2024-02-15T18:40:31.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:31 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:31.581092+0000 mgr.smithi033.apxevf (mgr.14626) 451 : cluster [DBG] pgmap v311: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:31.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.955+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff78810f760 con 0x7ff7880f66d0 2024-02-15T18:40:31.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.955+0000 7ff76ffff700 1 -- 172.21.15.33:0/2852114401 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff77c0516c0 con 0x7ff7880f66d0 2024-02-15T18:40:31.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff770060f70 msgr2=0x7ff770063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:31.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff770060f70 0x7ff770063430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff7880f9320 tx=0x7ff778008040).stop 2024-02-15T18:40:31.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 msgr2=0x7ff7880f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:31.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 0x7ff7880f7a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7ff77c004b70 tx=0x7ff77c004d10).stop 2024-02-15T18:40:31.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 shutdown_connections 2024-02-15T18:40:31.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff770060f70 0x7ff770063430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:31.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7880f5430 0x7ff7880f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:31.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 --2- 172.21.15.33:0/2852114401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7880f66d0 0x7ff7880f7a10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:31.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 >> 172.21.15.33:0/2852114401 conn(0x7ff7880f0b90 msgr2=0x7ff78805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:31.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 shutdown_connections 2024-02-15T18:40:31.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:31.957+0000 7ff78cb69700 1 -- 172.21.15.33:0/2852114401 wait complete. 2024-02-15T18:40:31.956 INFO:teuthology.orchestra.run.smithi033.stdout:true 2024-02-15T18:40:31.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:31.581092+0000 mgr.smithi033.apxevf (mgr.14626) 451 : cluster [DBG] pgmap v311: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:32.723 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:32 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:31.956099+0000 mon.smithi033 (mon.0) 788 : audit [DBG] from='client.? 172.21.15.33:0/2852114401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:40:32.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-15T18:40:32.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:31.956099+0000 mon.smithi033 (mon.0) 788 : audit [DBG] from='client.? 172.21.15.33:0/2852114401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:40:33.920 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:33 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:33.581505+0000 mgr.smithi033.apxevf (mgr.14626) 452 : cluster [DBG] pgmap v312: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:33.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:33.581505+0000 mgr.smithi033.apxevf (mgr.14626) 452 : cluster [DBG] pgmap v312: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:35.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.900+0000 7f0918a1f700 1 -- 172.21.15.33:0/1853819618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 msgr2=0x7f09140f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:35.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.900+0000 7f0918a1f700 1 --2- 172.21.15.33:0/1853819618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 0x7f09140f6ee0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f0904004660 tx=0x7f0904009b30).stop 2024-02-15T18:40:35.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.900+0000 7f0918a1f700 1 -- 172.21.15.33:0/1853819618 shutdown_connections 2024-02-15T18:40:35.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.900+0000 7f0918a1f700 1 --2- 172.21.15.33:0/1853819618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09140f57d0 0x7f09140f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:35.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.900+0000 7f0918a1f700 1 --2- 172.21.15.33:0/1853819618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 0x7f09140f6ee0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.900+0000 7f0918a1f700 1 -- 172.21.15.33:0/1853819618 >> 172.21.15.33:0/1853819618 conn(0x7f09140f0320 msgr2=0x7f09140f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.900+0000 7f0918a1f700 1 -- 172.21.15.33:0/1853819618 shutdown_connections 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.900+0000 7f0918a1f700 1 -- 172.21.15.33:0/1853819618 wait complete. 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f0918a1f700 1 Processor -- start 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f0918a1f700 1 -- start start 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f0918a1f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09140f57d0 0x7f0914105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f0918a1f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 0x7f0914106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f0918a1f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09141067d0 con 0x7f09140f6ac0 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f0918a1f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914106fd0 con 0x7f09140f57d0 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f091259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 0x7f0914106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f091259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 0x7f0914106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40618/0 (socket says 172.21.15.33:40618) 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f091259c700 1 -- 172.21.15.33:0/179532926 learned_addr learned my addr 172.21.15.33:0/179532926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:35.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f0912d9d700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09140f57d0 0x7f0914105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f091259c700 1 -- 172.21.15.33:0/179532926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09140f57d0 msgr2=0x7f0914105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f091259c700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09140f57d0 0x7f0914105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f091259c700 1 -- 172.21.15.33:0/179532926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904005040 con 0x7f09140f6ac0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f091259c700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 0x7f0914106220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f090800e7f0 tx=0x7f090800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.901+0000 7f08fb7fe700 1 -- 172.21.15.33:0/179532926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09080092e0 con 0x7f09140f6ac0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.902+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09141072b0 con 0x7f09140f6ac0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.902+0000 7f08fb7fe700 1 -- 172.21.15.33:0/179532926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f090800f040 con 0x7f09140f6ac0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.902+0000 7f08fb7fe700 1 -- 172.21.15.33:0/179532926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0908014850 con 0x7f09140f6ac0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.902+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914107870 con 0x7f09140f6ac0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.903+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0914059100 con 0x7f09140f6ac0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.903+0000 7f08fb7fe700 1 -- 172.21.15.33:0/179532926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f090801b030 con 0x7f09140f6ac0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.903+0000 7f08fb7fe700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f08fc060f70 0x7f08fc063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.903+0000 7f08fb7fe700 1 -- 172.21.15.33:0/179532926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f090807be80 con 0x7f09140f6ac0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.903+0000 7f0912d9d700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f08fc060f70 0x7f08fc063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:35.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.904+0000 7f0912d9d700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f08fc060f70 0x7f08fc063430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0904009720 tx=0x7f0904016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:35.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:34.908+0000 7f08fb7fe700 1 -- 172.21.15.33:0/179532926 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f090804fd90 con 0x7f09140f6ac0 2024-02-15T18:40:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.152+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f09140fddb0 con 0x7f09140f6ac0 2024-02-15T18:40:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.153+0000 7f08fb7fe700 1 -- 172.21.15.33:0/179532926 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f0908019070 con 0x7f09140f6ac0 2024-02-15T18:40:35.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f08fc060f70 msgr2=0x7f08fc063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f08fc060f70 0x7f08fc063430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0904009720 tx=0x7f0904016040).stop 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 msgr2=0x7f0914106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 0x7f0914106220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f090800e7f0 tx=0x7f090800b040).stop 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 shutdown_connections 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f08fc060f70 0x7f08fc063430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09140f57d0 0x7f0914105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 --2- 172.21.15.33:0/179532926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09140f6ac0 0x7f0914106220 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 >> 172.21.15.33:0/179532926 conn(0x7f09140f0320 msgr2=0x7f09140fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.154+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 shutdown_connections 2024-02-15T18:40:35.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:35.155+0000 7f0918a1f700 1 -- 172.21.15.33:0/179532926 wait complete. 2024-02-15T18:40:35.153 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)" 2024-02-15T18:40:35.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:35.153445+0000 mon.smithi033 (mon.0) 789 : audit [DBG] from='client.? 172.21.15.33:0/179532926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:40:35.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:35 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:35.153445+0000 mon.smithi033 (mon.0) 789 : audit [DBG] from='client.? 172.21.15.33:0/179532926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-15T18:40:35.927 DEBUG:teuthology.parallel:result is None 2024-02-15T18:40:35.928 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-15T18:40:35.940 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:40:35.940 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-15T18:40:36.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:35.582056+0000 mgr.smithi033.apxevf (mgr.14626) 453 : cluster [DBG] pgmap v313: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:36.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:36 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:35.582056+0000 mgr.smithi033.apxevf (mgr.14626) 453 : cluster [DBG] pgmap v313: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.147+0000 7f9283515700 1 -- 172.21.15.33:0/2800705619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 msgr2=0x7f927c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.147+0000 7f9283515700 1 --2- 172.21.15.33:0/2800705619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 0x7f927c0f7de0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f926c0045a0 tx=0x7f926c009b30).stop 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.148+0000 7f9283515700 1 -- 172.21.15.33:0/2800705619 shutdown_connections 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.148+0000 7f9283515700 1 --2- 172.21.15.33:0/2800705619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 0x7f927c0f7de0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.148+0000 7f9283515700 1 --2- 172.21.15.33:0/2800705619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f927c0f66e0 0x7f927c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.148+0000 7f9283515700 1 -- 172.21.15.33:0/2800705619 >> 172.21.15.33:0/2800705619 conn(0x7f927c0f1e40 msgr2=0x7f927c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.148+0000 7f9283515700 1 -- 172.21.15.33:0/2800705619 shutdown_connections 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.148+0000 7f9283515700 1 -- 172.21.15.33:0/2800705619 wait complete. 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.148+0000 7f9283515700 1 Processor -- start 2024-02-15T18:40:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.148+0000 7f9283515700 1 -- start start 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9283515700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f927c0f66e0 0x7f927c107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9283515700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 0x7f927c1074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9283515700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c107aa0 con 0x7f927c0f7980 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9283515700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c107be0 con 0x7f927c0f66e0 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9280ab0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 0x7f927c1074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9280ab0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 0x7f927c1074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47856/0 (socket says 172.21.15.33:47856) 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9280ab0700 1 -- 172.21.15.33:0/754022331 learned_addr learned my addr 172.21.15.33:0/754022331 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f92812b1700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f927c0f66e0 0x7f927c107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9280ab0700 1 -- 172.21.15.33:0/754022331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f927c0f66e0 msgr2=0x7f927c107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9280ab0700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f927c0f66e0 0x7f927c107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9280ab0700 1 -- 172.21.15.33:0/754022331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c005040 con 0x7f927c0f7980 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9280ab0700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 0x7f927c1074f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f926c009d30 tx=0x7f926c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9271ffb700 1 -- 172.21.15.33:0/754022331 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f926c00e070 con 0x7f927c0f7980 2024-02-15T18:40:38.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9271ffb700 1 -- 172.21.15.33:0/754022331 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f926c007e80 con 0x7f927c0f7980 2024-02-15T18:40:38.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c108520 con 0x7f927c0f7980 2024-02-15T18:40:38.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.149+0000 7f9271ffb700 1 -- 172.21.15.33:0/754022331 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f926c019070 con 0x7f927c0f7980 2024-02-15T18:40:38.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.150+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c108a00 con 0x7f927c0f7980 2024-02-15T18:40:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.151+0000 7f9271ffb700 1 -- 172.21.15.33:0/754022331 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f926c025070 con 0x7f927c0f7980 2024-02-15T18:40:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.151+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c045ad0 con 0x7f927c0f7980 2024-02-15T18:40:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.151+0000 7f9271ffb700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9268060ec0 0x7f9268063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.151+0000 7f9271ffb700 1 -- 172.21.15.33:0/754022331 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f926c07cf00 con 0x7f927c0f7980 2024-02-15T18:40:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.152+0000 7f92812b1700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9268060ec0 0x7f9268063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.152+0000 7f92812b1700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9268060ec0 0x7f9268063380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9278009880 tx=0x7f927800b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:38.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.156+0000 7f9271ffb700 1 -- 172.21.15.33:0/754022331 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f926c050d60 con 0x7f927c0f7980 2024-02-15T18:40:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.373+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f927c0fefb0 con 0x7f927c0f7980 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.374+0000 7f9271ffb700 1 -- 172.21.15.33:0/754022331 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+1802 (secure 0 0 0) 0x7f926c023020 con 0x7f927c0f7980 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:e41 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 41 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-02-15T18:28:36.638158+0000 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-02-15T18:37:33.666082+0000 2024-02-15T18:40:38.363 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 82 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 2 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=34334,1=34338} 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-02-15T18:40:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.qszefh{0:34334} state up:active seq 11 join_fscid=1 addr [v2:172.21.15.33:6826/1293923765,v1:172.21.15.33:6827/1293923765] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.mcppgd{1:34338} state up:active seq 10 join_fscid=1 addr [v2:172.21.15.33:6828/2386752010,v1:172.21.15.33:6829/2386752010] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.ywlevz{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6824/2921613795,v1:172.21.15.131:6825/2921613795] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:40:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi131.bgnwzs{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/2360346875,v1:172.21.15.131:6827/2360346875] compat {c=[1],r=[1],i=[7ff]}] 2024-02-15T18:40:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.375+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9268060ec0 msgr2=0x7f9268063380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.375+0000 7f9283515700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9268060ec0 0x7f9268063380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9278009880 tx=0x7f927800b040).stop 2024-02-15T18:40:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.375+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 msgr2=0x7f927c1074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.375+0000 7f9283515700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 0x7f927c1074f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f926c009d30 tx=0x7f926c00b040).stop 2024-02-15T18:40:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.376+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 shutdown_connections 2024-02-15T18:40:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.376+0000 7f9283515700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9268060ec0 0x7f9268063380 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.376+0000 7f9283515700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f927c0f66e0 0x7f927c107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.376+0000 7f9283515700 1 --2- 172.21.15.33:0/754022331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f927c0f7980 0x7f927c1074f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.376+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 >> 172.21.15.33:0/754022331 conn(0x7f927c0f1e40 msgr2=0x7f927c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.376+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 shutdown_connections 2024-02-15T18:40:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:38.376+0000 7f9283515700 1 -- 172.21.15.33:0/754022331 wait complete. 2024-02-15T18:40:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2024-02-15T18:40:38.647 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:37.582790+0000 mgr.smithi033.apxevf (mgr.14626) 454 : cluster [DBG] pgmap v314: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:38.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:38 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:38.374664+0000 mon.smithi033 (mon.0) 790 : audit [DBG] from='client.? 172.21.15.33:0/754022331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:40:38.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:37.582790+0000 mgr.smithi033.apxevf (mgr.14626) 454 : cluster [DBG] pgmap v314: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:38.995 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:38 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:38.374664+0000 mon.smithi033 (mon.0) 790 : audit [DBG] from='client.? 172.21.15.33:0/754022331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-15T18:40:39.164 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-15T18:40:39.176 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-15T18:40:39.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.318+0000 7f5e98141700 1 -- 172.21.15.33:0/699644838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f53b0 msgr2=0x7f5e900f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.318+0000 7f5e98141700 1 --2- 172.21.15.33:0/699644838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f53b0 0x7f5e900f57d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5e8c004660 tx=0x7f5e8c009b30).stop 2024-02-15T18:40:39.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.318+0000 7f5e98141700 1 -- 172.21.15.33:0/699644838 shutdown_connections 2024-02-15T18:40:39.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.318+0000 7f5e98141700 1 --2- 172.21.15.33:0/699644838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900f5cc0 0x7f5e900f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.318+0000 7f5e98141700 1 --2- 172.21.15.33:0/699644838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f53b0 0x7f5e900f57d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.318+0000 7f5e98141700 1 -- 172.21.15.33:0/699644838 >> 172.21.15.33:0/699644838 conn(0x7f5e900f0bd0 msgr2=0x7f5e900f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.318+0000 7f5e98141700 1 -- 172.21.15.33:0/699644838 shutdown_connections 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.318+0000 7f5e98141700 1 -- 172.21.15.33:0/699644838 wait complete. 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.319+0000 7f5e98141700 1 Processor -- start 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.319+0000 7f5e98141700 1 -- start start 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.319+0000 7f5e98141700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900f53b0 0x7f5e90106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.319+0000 7f5e98141700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f5cc0 0x7f5e90107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.319+0000 7f5e98141700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e90107880 con 0x7f5e900f5cc0 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.319+0000 7f5e98141700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e901079c0 con 0x7f5e900f53b0 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.319+0000 7f5e956dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f5cc0 0x7f5e90107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.319+0000 7f5e956dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f5cc0 0x7f5e90107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47874/0 (socket says 172.21.15.33:47874) 2024-02-15T18:40:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.319+0000 7f5e956dc700 1 -- 172.21.15.33:0/3544432645 learned_addr learned my addr 172.21.15.33:0/3544432645 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e95edd700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900f53b0 0x7f5e90106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e956dc700 1 -- 172.21.15.33:0/3544432645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900f53b0 msgr2=0x7f5e90106d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e956dc700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900f53b0 0x7f5e90106d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e956dc700 1 -- 172.21.15.33:0/3544432645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c005040 con 0x7f5e900f5cc0 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e956dc700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f5cc0 0x7f5e90107240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f5e84009390 tx=0x7f5e84006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e827fc700 1 -- 172.21.15.33:0/3544432645 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e84013640 con 0x7f5e900f5cc0 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9010c460 con 0x7f5e900f5cc0 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e827fc700 1 -- 172.21.15.33:0/3544432645 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f5e84013c90 con 0x7f5e900f5cc0 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e827fc700 1 -- 172.21.15.33:0/3544432645 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e84012de0 con 0x7f5e900f5cc0 2024-02-15T18:40:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.320+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9010ca20 con 0x7f5e900f5cc0 2024-02-15T18:40:39.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.321+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e90046330 con 0x7f5e900f5cc0 2024-02-15T18:40:39.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.321+0000 7f5e827fc700 1 -- 172.21.15.33:0/3544432645 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f5e8401a060 con 0x7f5e900f5cc0 2024-02-15T18:40:39.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.322+0000 7f5e827fc700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5e7c060fe0 0x7f5e7c0634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:39.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.322+0000 7f5e827fc700 1 -- 172.21.15.33:0/3544432645 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f5e8407c200 con 0x7f5e900f5cc0 2024-02-15T18:40:39.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.322+0000 7f5e95edd700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5e7c060fe0 0x7f5e7c0634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:39.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.322+0000 7f5e95edd700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5e7c060fe0 0x7f5e7c0634a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5e8c004e30 tx=0x7f5e8c009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:39.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.326+0000 7f5e827fc700 1 -- 172.21.15.33:0/3544432645 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5e84050060 con 0x7f5e900f5cc0 2024-02-15T18:40:39.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.500+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e900fdd50 con 0x7f5e900f5cc0 2024-02-15T18:40:39.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.501+0000 7f5e827fc700 1 -- 172.21.15.33:0/3544432645 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+14909 (secure 0 0 0) 0x7f5e8404fc50 con 0x7f5e900f5cc0 2024-02-15T18:40:39.490 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:39.490 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":83,"fsid":"fd0b1c90-cc2e-11ee-95ba-87774f69a715","created":"2024-02-15T18:21:46.103137+0000","modified":"2024-02-15T18:37:23.832403+0000","last_up_change":"2024-02-15T18:36:02.580082+0000","last_in_change":"2024-02-15T18:26:50.170774+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-15T18:26:18.348861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-15T18:28:35.597195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-15T18:28:36.072183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0ff15bf7-6db5-4333-82b6-b609dccf7266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":1034368821},{"type":"v1","addr":"172.21.15.33:6803","nonce":1034368821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":1034368821},{"type":"v1","addr":"172.21.15.33:6805","nonce":1034368821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":1034368821},{"type":"v1","addr":"172.21.15.33:6809","nonce":1034368821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":1034368821},{"type":"v1","addr":"172.21.15.33:6807","nonce":1034368821}]},"public_addr":"172.21.15.33:6803/1034368821","cluster_addr":"172.21.15.33:6805/1034368821","heartbeat_back_addr":"172.21.15.33:6809/1034368821","heartbeat_front_addr":"172.21.15.33:6807/1034368821","state":["exists","up"]},{"osd":1,"uuid":"7b795f15-d524-44fd-8dca-d5b4653dafbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":827707777},{"type":"v1","addr":"172.21.15.33:6811","nonce":827707777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":827707777},{"type":"v1","addr":"172.21.15.33:6813","nonce":827707777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":827707777},{"type":"v1","addr":"172.21.15.33:6817","nonce":827707777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":827707777},{"type":"v1","addr":"172.21.15.33:6815","nonce":827707777}]},"public_addr":"172.21.15.33:6811/827707777","cluster_addr":"172.21.15.33:6813/827707777","heartbeat_back_addr":"172.21.15.33:6817/827707777","heartbeat_front_addr":"172.21.15.33:6815/827707777","state":["exists","up"]},{"osd":2,"uuid":"47a30c41-97a6-451b-9941-8e225aff3535","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3790166603},{"type":"v1","addr":"172.21.15.33:6819","nonce":3790166603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3790166603},{"type":"v1","addr":"172.21.15.33:6821","nonce":3790166603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3790166603},{"type":"v1","addr":"172.21.15.33:6825","nonce":3790166603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3790166603},{"type":"v1","addr":"172.21.15.33:6823","nonce":3790166603}]},"public_addr":"172.21.15.33:6819/3790166603","cluster_addr":"172.21.15.33:6821/3790166603","heartbeat_back_addr":"172.21.15.33:6825/3790166603","heartbeat_front_addr":"172.21.15.33:6823/3790166603","state":["exists","up"]},{"osd":3,"uuid":"d342c704-b853-421a-8f27-803f201e73c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4028459199},{"type":"v1","addr":"172.21.15.131:6801","nonce":4028459199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4028459199},{"type":"v1","addr":"172.21.15.131:6803","nonce":4028459199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4028459199},{"type":"v1","addr":"172.21.15.131:6807","nonce":4028459199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4028459199},{"type":"v1","addr":"172.21.15.131:6805","nonce":4028459199}]},"public_addr":"172.21.15.131:6801/4028459199","cluster_addr":"172.21.15.131:6803/4028459199","heartbeat_back_addr":"172.21.15.131:6807/4028459199","heartbeat_front_addr":"172.21.15.131:6805/4028459199","state":["exists","up"]},{"osd":4,"uuid":"6a318488-8764-4284-b2c7-811c9bf5f312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":33,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3577732459},{"type":"v1","addr":"172.21.15.131:6809","nonce":3577732459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3577732459},{"type":"v1","addr":"172.21.15.131:6811","nonce":3577732459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3577732459},{"type":"v1","addr":"172.21.15.131:6815","nonce":3577732459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3577732459},{"type":"v1","addr":"172.21.15.131:6813","nonce":3577732459}]},"public_addr":"172.21.15.131:6809/3577732459","cluster_addr":"172.21.15.131:6811/3577732459","heartbeat_back_addr":"172.21.15.131:6815/3577732459","heartbeat_front_addr":"172.21.15.131:6813/3577732459","state":["exists","up"]},{"osd":5,"uuid":"26789e21-a7cc-431d-b59e-5c06f9e676b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1938605794},{"type":"v1","addr":"172.21.15.131:6817","nonce":1938605794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1938605794},{"type":"v1","addr":"172.21.15.131:6819","nonce":1938605794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1938605794},{"type":"v1","addr":"172.21.15.131:6823","nonce":1938605794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1938605794},{"type":"v1","addr":"172.21.15.131:6821","nonce":1938605794}]},"public_addr":"172.21.15.131:6817/1938605794","cluster_addr":"172.21.15.131:6819/1938605794","heartbeat_back_addr":"172.21.15.131:6823/1938605794","heartbeat_front_addr":"172.21.15.131:6821/1938605794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:06.812056+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:25:38.581855+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:03.660797+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:22.777140+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:26:44.193385+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-15T18:27:06.090258+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6825/1245860707":"2024-02-16T18:37:08.704490+0000","172.21.15.131:0/3512804351":"2024-02-16T18:31:26.933966+0000","172.21.15.33:0/9598196":"2024-02-16T18:22:37.704559+0000","172.21.15.33:6801/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:6800/3962763243":"2024-02-16T18:22:37.704559+0000","172.21.15.33:6801/2905208543":"2024-02-16T18:22:16.059979+0000","172.21.15.131:0/1497476874":"2024-02-16T18:31:26.933966+0000","172.21.15.131:0/2354360120":"2024-02-16T18:31:26.933966+0000","172.21.15.33:6800/1351334089":"2024-02-16T18:30:32.495466+0000","172.21.15.33:0/805181307":"2024-02-16T18:22:16.059979+0000","172.21.15.131:0/2071659558":"2024-02-16T18:31:26.933966+0000","172.21.15.33:0/2117788911":"2024-02-16T18:22:54.446695+0000","172.21.15.33:0/446078726":"2024-02-16T18:30:32.495466+0000","172.21.15.33:6800/2905208543":"2024-02-16T18:22:16.059979+0000","172.21.15.131:6824/1245860707":"2024-02-16T18:37:08.704490+0000","172.21.15.33:0/1847321696":"2024-02-16T18:22:37.704559+0000","172.21.15.33:0/1388323627":"2024-02-16T18:22:16.059979+0000","172.21.15.33:0/1585662851":"2024-02-16T18:30:32.495466+0000","172.21.15.33:0/2037477695":"2024-02-16T18:22:54.446695+0000","172.21.15.131:6828/3968122283":"2024-02-16T18:31:26.933966+0000","172.21.15.33:6801/1651162060":"2024-02-16T18:22:54.446695+0000","172.21.15.131:6829/3968122283":"2024-02-16T18:31:26.933966+0000","172.21.15.33:6801/1351334089":"2024-02-16T18:30:32.495466+0000","172.21.15.33:6800/1651162060":"2024-02-16T18:22:54.446695+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.502+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5e7c060fe0 msgr2=0x7f5e7c0634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.502+0000 7f5e98141700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5e7c060fe0 0x7f5e7c0634a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5e8c004e30 tx=0x7f5e8c009b30).stop 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.502+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f5cc0 msgr2=0x7f5e90107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.502+0000 7f5e98141700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f5cc0 0x7f5e90107240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f5e84009390 tx=0x7f5e84006e20).stop 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.502+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 shutdown_connections 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.502+0000 7f5e98141700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f5e7c060fe0 0x7f5e7c0634a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.502+0000 7f5e98141700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e900f53b0 0x7f5e90106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.502+0000 7f5e98141700 1 --2- 172.21.15.33:0/3544432645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e900f5cc0 0x7f5e90107240 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.502+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 >> 172.21.15.33:0/3544432645 conn(0x7f5e900f0bd0 msgr2=0x7f5e9005fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.503+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 shutdown_connections 2024-02-15T18:40:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.503+0000 7f5e98141700 1 -- 172.21.15.33:0/3544432645 wait complete. 2024-02-15T18:40:39.504 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-15T18:26:18.348861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-15T18:28:35.597195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-15T18:28:36.072183+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-15T18:40:39.504 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-15T18:40:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.639+0000 7f512846d700 1 -- 172.21.15.33:0/869453012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 msgr2=0x7f51200fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.639+0000 7f512846d700 1 --2- 172.21.15.33:0/869453012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 0x7f51200fb9f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f5110004660 tx=0x7f5110009b30).stop 2024-02-15T18:40:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.639+0000 7f512846d700 1 -- 172.21.15.33:0/869453012 shutdown_connections 2024-02-15T18:40:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.639+0000 7f512846d700 1 --2- 172.21.15.33:0/869453012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 0x7f51200fb9f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.639+0000 7f512846d700 1 --2- 172.21.15.33:0/869453012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f512005fe30 0x7f51200f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.639+0000 7f512846d700 1 -- 172.21.15.33:0/869453012 >> 172.21.15.33:0/869453012 conn(0x7f51200f0b70 msgr2=0x7f51200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.639+0000 7f512846d700 1 -- 172.21.15.33:0/869453012 shutdown_connections 2024-02-15T18:40:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.639+0000 7f512846d700 1 -- 172.21.15.33:0/869453012 wait complete. 2024-02-15T18:40:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f512846d700 1 Processor -- start 2024-02-15T18:40:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f512846d700 1 -- start start 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f512846d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f512005fe30 0x7f5120106c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f512846d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 0x7f5120107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f512846d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5120107780 con 0x7f51200f9600 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f512846d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51201078f0 con 0x7f512005fe30 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f5125a08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 0x7f5120107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f5125a08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 0x7f5120107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47884/0 (socket says 172.21.15.33:47884) 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f5125a08700 1 -- 172.21.15.33:0/2000643571 learned_addr learned my addr 172.21.15.33:0/2000643571 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.640+0000 7f5126209700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f512005fe30 0x7f5120106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.641+0000 7f5125a08700 1 -- 172.21.15.33:0/2000643571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f512005fe30 msgr2=0x7f5120106c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.641+0000 7f5125a08700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f512005fe30 0x7f5120106c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.641+0000 7f5125a08700 1 -- 172.21.15.33:0/2000643571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5110005040 con 0x7f51200f9600 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.641+0000 7f5125a08700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 0x7f5120107180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5110009f50 tx=0x7f5110009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.641+0000 7f5116ffd700 1 -- 172.21.15.33:0/2000643571 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5110018070 con 0x7f51200f9600 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.641+0000 7f5116ffd700 1 -- 172.21.15.33:0/2000643571 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f5110007c70 con 0x7f51200f9600 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.641+0000 7f5116ffd700 1 -- 172.21.15.33:0/2000643571 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511001c620 con 0x7f51200f9600 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.641+0000 7f512846d700 1 -- 172.21.15.33:0/2000643571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512010c300 con 0x7f51200f9600 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.641+0000 7f512846d700 1 -- 172.21.15.33:0/2000643571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512010c830 con 0x7f51200f9600 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.642+0000 7f5114ff9700 1 -- 172.21.15.33:0/2000643571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5120046330 con 0x7f51200f9600 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.642+0000 7f5116ffd700 1 -- 172.21.15.33:0/2000643571 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f511001da10 con 0x7f51200f9600 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.643+0000 7f5116ffd700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f510c060f20 0x7f510c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.643+0000 7f5116ffd700 1 -- 172.21.15.33:0/2000643571 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f511007dff0 con 0x7f51200f9600 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.643+0000 7f5126209700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f510c060f20 0x7f510c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:39.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.643+0000 7f5126209700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f510c060f20 0x7f510c0633e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5120107b80 tx=0x7f511c009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.647+0000 7f5116ffd700 1 -- 172.21.15.33:0/2000643571 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f511004e4a0 con 0x7f51200f9600 2024-02-15T18:40:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.820+0000 7f5114ff9700 1 -- 172.21.15.33:0/2000643571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f51200fed70 con 0x7f51200f9600 2024-02-15T18:40:39.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.820+0000 7f5116ffd700 1 -- 172.21.15.33:0/2000643571 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v83) v1 ==== 110+0+10 (secure 0 0 0) 0x7f511004ce60 con 0x7f51200f9600 2024-02-15T18:40:39.809 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-02-15T18:40:39.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 -- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f510c060f20 msgr2=0x7f510c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f510c060f20 0x7f510c0633e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5120107b80 tx=0x7f511c009040).stop 2024-02-15T18:40:39.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 -- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 msgr2=0x7f5120107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 0x7f5120107180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5110009f50 tx=0x7f5110009b30).stop 2024-02-15T18:40:39.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 -- 172.21.15.33:0/2000643571 shutdown_connections 2024-02-15T18:40:39.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f510c060f20 0x7f510c0633e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f512005fe30 0x7f5120106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 --2- 172.21.15.33:0/2000643571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51200f9600 0x7f5120107180 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 -- 172.21.15.33:0/2000643571 >> 172.21.15.33:0/2000643571 conn(0x7f51200f0b70 msgr2=0x7f51200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:39.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 -- 172.21.15.33:0/2000643571 shutdown_connections 2024-02-15T18:40:39.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.822+0000 7f5114ff9700 1 -- 172.21.15.33:0/2000643571 wait complete. 2024-02-15T18:40:39.823 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.956+0000 7f2cfb52a700 1 -- 172.21.15.33:0/3389310326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f7730 msgr2=0x7f2cf40f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.956+0000 7f2cfb52a700 1 --2- 172.21.15.33:0/3389310326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f7730 0x7f2cf40f7b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f2ce4004660 tx=0x7f2ce4009b30).stop 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.956+0000 7f2cfb52a700 1 -- 172.21.15.33:0/3389310326 shutdown_connections 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.956+0000 7f2cfb52a700 1 --2- 172.21.15.33:0/3389310326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f7730 0x7f2cf40f7b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.956+0000 7f2cfb52a700 1 --2- 172.21.15.33:0/3389310326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf40f6490 0x7f2cf40f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.956+0000 7f2cfb52a700 1 -- 172.21.15.33:0/3389310326 >> 172.21.15.33:0/3389310326 conn(0x7f2cf40f1bd0 msgr2=0x7f2cf40f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.956+0000 7f2cfb52a700 1 -- 172.21.15.33:0/3389310326 shutdown_connections 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cfb52a700 1 -- 172.21.15.33:0/3389310326 wait complete. 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cfb52a700 1 Processor -- start 2024-02-15T18:40:39.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cfb52a700 1 -- start start 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cfb52a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f6490 0x7f2cf4106ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cfb52a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf40f7730 0x7f2cf41071d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cfb52a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf41077d0 con 0x7f2cf40f6490 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cfb52a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4107910 con 0x7f2cf40f7730 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cf92c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f6490 0x7f2cf4106ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cf92c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f6490 0x7f2cf4106ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47904/0 (socket says 172.21.15.33:47904) 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cf92c6700 1 -- 172.21.15.33:0/730423366 learned_addr learned my addr 172.21.15.33:0/730423366 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.957+0000 7f2cf8ac5700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf40f7730 0x7f2cf41071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.958+0000 7f2cf92c6700 1 -- 172.21.15.33:0/730423366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf40f7730 msgr2=0x7f2cf41071d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.958+0000 7f2cf92c6700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf40f7730 0x7f2cf41071d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.958+0000 7f2cf92c6700 1 -- 172.21.15.33:0/730423366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4005040 con 0x7f2cf40f6490 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.958+0000 7f2cf92c6700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f6490 0x7f2cf4106ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2cf0002700 tx=0x7f2cf0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.958+0000 7f2ce9ffb700 1 -- 172.21.15.33:0/730423366 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf00079c0 con 0x7f2cf40f6490 2024-02-15T18:40:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.958+0000 7f2ce9ffb700 1 -- 172.21.15.33:0/730423366 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f2cf000f040 con 0x7f2cf40f6490 2024-02-15T18:40:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.958+0000 7f2ce9ffb700 1 -- 172.21.15.33:0/730423366 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf0014940 con 0x7f2cf40f6490 2024-02-15T18:40:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.958+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf410c320 con 0x7f2cf40f6490 2024-02-15T18:40:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.958+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf410c8e0 con 0x7f2cf40f6490 2024-02-15T18:40:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.959+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf4027a00 con 0x7f2cf40f6490 2024-02-15T18:40:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.959+0000 7f2ce9ffb700 1 -- 172.21.15.33:0/730423366 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f2cf001b060 con 0x7f2cf40f6490 2024-02-15T18:40:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.960+0000 7f2ce9ffb700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2ce0060f20 0x7f2ce00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.960+0000 7f2ce9ffb700 1 -- 172.21.15.33:0/730423366 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f2cf007bef0 con 0x7f2cf40f6490 2024-02-15T18:40:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.960+0000 7f2cf8ac5700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2ce0060f20 0x7f2ce00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.960+0000 7f2cf8ac5700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2ce0060f20 0x7f2ce00633e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f2ce4004630 tx=0x7f2ce4009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:39.964+0000 7f2ce9ffb700 1 -- 172.21.15.33:0/730423366 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2cf004c3a0 con 0x7f2cf40f6490 2024-02-15T18:40:40.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.135+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f2cf40fed60 con 0x7f2cf40f6490 2024-02-15T18:40:40.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.135+0000 7f2ce9ffb700 1 -- 172.21.15.33:0/730423366 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2cf004f9c0 con 0x7f2cf40f6490 2024-02-15T18:40:40.124 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T18:40:40.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2ce0060f20 msgr2=0x7f2ce00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2ce0060f20 0x7f2ce00633e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f2ce4004630 tx=0x7f2ce4009b30).stop 2024-02-15T18:40:40.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f6490 msgr2=0x7f2cf4106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f6490 0x7f2cf4106ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2cf0002700 tx=0x7f2cf0009d80).stop 2024-02-15T18:40:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 shutdown_connections 2024-02-15T18:40:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2ce0060f20 0x7f2ce00633e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cf40f6490 0x7f2cf4106ce0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 --2- 172.21.15.33:0/730423366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cf40f7730 0x7f2cf41071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 >> 172.21.15.33:0/730423366 conn(0x7f2cf40f1bd0 msgr2=0x7f2cf40fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 shutdown_connections 2024-02-15T18:40:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.137+0000 7f2cfb52a700 1 -- 172.21.15.33:0/730423366 wait complete. 2024-02-15T18:40:40.138 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-15T18:40:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.274+0000 7f2be1584700 1 -- 172.21.15.33:0/2754024186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc060320 msgr2=0x7f2bdc0f90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.274+0000 7f2be1584700 1 --2- 172.21.15.33:0/2754024186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc060320 0x7f2bdc0f90b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f2bcc004660 tx=0x7f2bcc009b30).stop 2024-02-15T18:40:40.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.274+0000 7f2be1584700 1 -- 172.21.15.33:0/2754024186 shutdown_connections 2024-02-15T18:40:40.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.274+0000 7f2be1584700 1 --2- 172.21.15.33:0/2754024186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bdc0f9630 0x7f2bdc0fba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.274+0000 7f2be1584700 1 --2- 172.21.15.33:0/2754024186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc060320 0x7f2bdc0f90b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.274+0000 7f2be1584700 1 -- 172.21.15.33:0/2754024186 >> 172.21.15.33:0/2754024186 conn(0x7f2bdc0f0b30 msgr2=0x7f2bdc0f2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:40.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.274+0000 7f2be1584700 1 -- 172.21.15.33:0/2754024186 shutdown_connections 2024-02-15T18:40:40.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.274+0000 7f2be1584700 1 -- 172.21.15.33:0/2754024186 wait complete. 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.275+0000 7f2be1584700 1 Processor -- start 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.275+0000 7f2be1584700 1 -- start start 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.275+0000 7f2be1584700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bdc060320 0x7f2bdc0f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.275+0000 7f2be1584700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc0f9630 0x7f2bdc0f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.275+0000 7f2be1584700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0f6eb0 con 0x7f2bdc0f9630 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.275+0000 7f2be1584700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0f54a0 con 0x7f2bdc060320 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.275+0000 7f2bda7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc0f9630 0x7f2bdc0f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.275+0000 7f2bda7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc0f9630 0x7f2bdc0f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47926/0 (socket says 172.21.15.33:47926) 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.275+0000 7f2bda7fc700 1 -- 172.21.15.33:0/2279262457 learned_addr learned my addr 172.21.15.33:0/2279262457 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2bdaffd700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bdc060320 0x7f2bdc0f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2bda7fc700 1 -- 172.21.15.33:0/2279262457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bdc060320 msgr2=0x7f2bdc0f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2bda7fc700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bdc060320 0x7f2bdc0f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2bda7fc700 1 -- 172.21.15.33:0/2279262457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc005040 con 0x7f2bdc0f9630 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2bdaffd700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bdc060320 0x7f2bdc0f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2bda7fc700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc0f9630 0x7f2bdc0f4fb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2bd0002700 tx=0x7f2bd0009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2bc37fe700 1 -- 172.21.15.33:0/2279262457 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd0009320 con 0x7f2bdc0f9630 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2bc37fe700 1 -- 172.21.15.33:0/2279262457 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f2bd000f040 con 0x7f2bdc0f9630 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc0f5780 con 0x7f2bdc0f9630 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2bc37fe700 1 -- 172.21.15.33:0/2279262457 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd00148d0 con 0x7f2bdc0f9630 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.276+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc0f5d40 con 0x7f2bdc0f9630 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.277+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc027a00 con 0x7f2bdc0f9630 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.277+0000 7f2bc37fe700 1 -- 172.21.15.33:0/2279262457 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f2bd0014b90 con 0x7f2bdc0f9630 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.278+0000 7f2bc37fe700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2bc4060f20 0x7f2bc40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.278+0000 7f2bc37fe700 1 -- 172.21.15.33:0/2279262457 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f2bd007c770 con 0x7f2bdc0f9630 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.278+0000 7f2bdaffd700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2bc4060f20 0x7f2bc40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.278+0000 7f2bdaffd700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2bc4060f20 0x7f2bc40633e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2bcc005010 tx=0x7f2bcc009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:40.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.282+0000 7f2bc37fe700 1 -- 172.21.15.33:0/2279262457 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2bd00505f0 con 0x7f2bdc0f9630 2024-02-15T18:40:40.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.454+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f2bdc0fedc0 con 0x7f2bdc0f9630 2024-02-15T18:40:40.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.455+0000 7f2bc37fe700 1 -- 172.21.15.33:0/2279262457 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2bd0009dd0 con 0x7f2bdc0f9630 2024-02-15T18:40:40.444 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-02-15T18:40:40.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2bc4060f20 msgr2=0x7f2bc40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2bc4060f20 0x7f2bc40633e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2bcc005010 tx=0x7f2bcc009b30).stop 2024-02-15T18:40:40.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc0f9630 msgr2=0x7f2bdc0f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc0f9630 0x7f2bdc0f4fb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2bd0002700 tx=0x7f2bd0009d60).stop 2024-02-15T18:40:40.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 shutdown_connections 2024-02-15T18:40:40.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2bc4060f20 0x7f2bc40633e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2bdc060320 0x7f2bdc0f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 --2- 172.21.15.33:0/2279262457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bdc0f9630 0x7f2bdc0f4fb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 >> 172.21.15.33:0/2279262457 conn(0x7f2bdc0f0b30 msgr2=0x7f2bdc0f2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:40.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 shutdown_connections 2024-02-15T18:40:40.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.457+0000 7f2be1584700 1 -- 172.21.15.33:0/2279262457 wait complete. 2024-02-15T18:40:40.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:39.501096+0000 mon.smithi033 (mon.0) 791 : audit [DBG] from='client.? 172.21.15.33:0/3544432645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:40:40.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:39.583176+0000 mgr.smithi033.apxevf (mgr.14626) 455 : cluster [DBG] pgmap v315: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:40.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:39.821055+0000 mon.smithi033 (mon.0) 792 : audit [DBG] from='client.? 172.21.15.33:0/2000643571' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:40:40.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:40 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:40.136018+0000 mon.smithi033 (mon.0) 793 : audit [DBG] from='client.? 172.21.15.33:0/730423366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T18:40:40.458 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-15T18:40:40.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:39.501096+0000 mon.smithi033 (mon.0) 791 : audit [DBG] from='client.? 172.21.15.33:0/3544432645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-15T18:40:40.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:39.583176+0000 mgr.smithi033.apxevf (mgr.14626) 455 : cluster [DBG] pgmap v315: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:40.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:39.821055+0000 mon.smithi033 (mon.0) 792 : audit [DBG] from='client.? 172.21.15.33:0/2000643571' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-15T18:40:40.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:40 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:40.136018+0000 mon.smithi033 (mon.0) 793 : audit [DBG] from='client.? 172.21.15.33:0/730423366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-15T18:40:40.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.590+0000 7f82de60f700 1 -- 172.21.15.33:0/21851029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f5cc0 msgr2=0x7f82d80f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.590+0000 7f82de60f700 1 --2- 172.21.15.33:0/21851029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f5cc0 0x7f82d80f66f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f82cc004660 tx=0x7f82cc009b30).stop 2024-02-15T18:40:40.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.590+0000 7f82de60f700 1 -- 172.21.15.33:0/21851029 shutdown_connections 2024-02-15T18:40:40.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.590+0000 7f82de60f700 1 --2- 172.21.15.33:0/21851029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f5cc0 0x7f82d80f66f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.590+0000 7f82de60f700 1 --2- 172.21.15.33:0/21851029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d80f53b0 0x7f82d80f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.590+0000 7f82de60f700 1 -- 172.21.15.33:0/21851029 >> 172.21.15.33:0/21851029 conn(0x7f82d80f0bd0 msgr2=0x7f82d80f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.590+0000 7f82de60f700 1 -- 172.21.15.33:0/21851029 shutdown_connections 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.590+0000 7f82de60f700 1 -- 172.21.15.33:0/21851029 wait complete. 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82de60f700 1 Processor -- start 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82de60f700 1 -- start start 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82de60f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f53b0 0x7f82d805fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82de60f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d80f5cc0 0x7f82d810ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82de60f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d810bf00 con 0x7f82d80f53b0 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82de60f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d810c040 con 0x7f82d80f5cc0 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f53b0 0x7f82d805fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f53b0 0x7f82d805fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47950/0 (socket says 172.21.15.33:47950) 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82d7fff700 1 -- 172.21.15.33:0/4262688102 learned_addr learned my addr 172.21.15.33:0/4262688102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82d77fe700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d80f5cc0 0x7f82d810ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82d7fff700 1 -- 172.21.15.33:0/4262688102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d80f5cc0 msgr2=0x7f82d810ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82d7fff700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d80f5cc0 0x7f82d810ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.591+0000 7f82d7fff700 1 -- 172.21.15.33:0/4262688102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc005040 con 0x7f82d80f53b0 2024-02-15T18:40:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.592+0000 7f82d7fff700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f53b0 0x7f82d805fd00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f82c8002700 tx=0x7f82c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.592+0000 7f82d4ff9700 1 -- 172.21.15.33:0/4262688102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82c8009320 con 0x7f82d80f53b0 2024-02-15T18:40:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.592+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d810c2a0 con 0x7f82d80f53b0 2024-02-15T18:40:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.592+0000 7f82d4ff9700 1 -- 172.21.15.33:0/4262688102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f82c800f040 con 0x7f82d80f53b0 2024-02-15T18:40:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.592+0000 7f82d4ff9700 1 -- 172.21.15.33:0/4262688102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82c80149b0 con 0x7f82d80f53b0 2024-02-15T18:40:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.592+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d810c860 con 0x7f82d80f53b0 2024-02-15T18:40:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.593+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d8027a00 con 0x7f82d80f53b0 2024-02-15T18:40:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.593+0000 7f82d4ff9700 1 -- 172.21.15.33:0/4262688102 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f82c8009480 con 0x7f82d80f53b0 2024-02-15T18:40:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.594+0000 7f82d4ff9700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f82c0060fe0 0x7f82c00634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.594+0000 7f82d4ff9700 1 -- 172.21.15.33:0/4262688102 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f82c807c670 con 0x7f82d80f53b0 2024-02-15T18:40:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.594+0000 7f82d77fe700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f82c0060fe0 0x7f82c00634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.594+0000 7f82d77fe700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f82c0060fe0 0x7f82c00634a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f82cc004630 tx=0x7f82cc009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:40.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.598+0000 7f82d4ff9700 1 -- 172.21.15.33:0/4262688102 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f82c8050540 con 0x7f82d80f53b0 2024-02-15T18:40:40.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.813+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82d80fdcb0 con 0x7f82d80f53b0 2024-02-15T18:40:40.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.814+0000 7f82d4ff9700 1 -- 172.21.15.33:0/4262688102 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4639 (secure 0 0 0) 0x7f82c8050130 con 0x7f82d80f53b0 2024-02-15T18:40:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:40.803 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44301,"name":"cephfs.smithi131.ywlevz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2921613795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2921613795},{"type":"v1","addr":"172.21.15.131:6825","nonce":2921613795}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44305,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/2360346875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2360346875},{"type":"v1","addr":"172.21.15.131:6827","nonce":2360346875}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:33.666082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34334,"mds_1":34338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:active","state_seq":11,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34338":{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":1,"incarnation":40,"state":"up:active","state_seq":10,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:40.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f82c0060fe0 msgr2=0x7f82c00634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f82c0060fe0 0x7f82c00634a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f82cc004630 tx=0x7f82cc009b30).stop 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f53b0 msgr2=0x7f82d805fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f53b0 0x7f82d805fd00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f82c8002700 tx=0x7f82c8009de0).stop 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 shutdown_connections 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f82c0060fe0 0x7f82c00634a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d80f53b0 0x7f82d805fd00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 --2- 172.21.15.33:0/4262688102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d80f5cc0 0x7f82d810ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 >> 172.21.15.33:0/4262688102 conn(0x7f82d80f0bd0 msgr2=0x7f82d80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 shutdown_connections 2024-02-15T18:40:40.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.816+0000 7f82de60f700 1 -- 172.21.15.33:0/4262688102 wait complete. 2024-02-15T18:40:40.806 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2024-02-15T18:40:40.817 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 2, 'flags': 18} 2024-02-15T18:40:40.817 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 13 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.950+0000 7f9d59847700 1 -- 172.21.15.33:0/3781259481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f6490 msgr2=0x7f9d540f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.950+0000 7f9d59847700 1 --2- 172.21.15.33:0/3781259481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f6490 0x7f9d540f68b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9d3c004660 tx=0x7f9d3c009b30).stop 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.950+0000 7f9d59847700 1 -- 172.21.15.33:0/3781259481 shutdown_connections 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.950+0000 7f9d59847700 1 --2- 172.21.15.33:0/3781259481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d540f7730 0x7f9d540f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.950+0000 7f9d59847700 1 --2- 172.21.15.33:0/3781259481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f6490 0x7f9d540f68b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.950+0000 7f9d59847700 1 -- 172.21.15.33:0/3781259481 >> 172.21.15.33:0/3781259481 conn(0x7f9d540f1bd0 msgr2=0x7f9d540f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.950+0000 7f9d59847700 1 -- 172.21.15.33:0/3781259481 shutdown_connections 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.950+0000 7f9d59847700 1 -- 172.21.15.33:0/3781259481 wait complete. 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d59847700 1 Processor -- start 2024-02-15T18:40:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d59847700 1 -- start start 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d59847700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d540f6490 0x7f9d54106d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d59847700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f7730 0x7f9d541071f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d59847700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d541077f0 con 0x7f9d540f7730 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d59847700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54107930 con 0x7f9d540f6490 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d527fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f7730 0x7f9d541071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d527fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f7730 0x7f9d541071f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47978/0 (socket says 172.21.15.33:47978) 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d527fc700 1 -- 172.21.15.33:0/380562358 learned_addr learned my addr 172.21.15.33:0/380562358 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d52ffd700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d540f6490 0x7f9d54106d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d527fc700 1 -- 172.21.15.33:0/380562358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d540f6490 msgr2=0x7f9d54106d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d527fc700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d540f6490 0x7f9d54106d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d527fc700 1 -- 172.21.15.33:0/380562358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c005040 con 0x7f9d540f7730 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d52ffd700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d540f6490 0x7f9d54106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.951+0000 7f9d527fc700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f7730 0x7f9d541071f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f9d4400c790 tx=0x7f9d44007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.952+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/380562358 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d4400e680 con 0x7f9d540f7730 2024-02-15T18:40:40.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.952+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/380562358 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f9d4400ecd0 con 0x7f9d540f7730 2024-02-15T18:40:40.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.952+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5410c340 con 0x7f9d540f7730 2024-02-15T18:40:40.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.952+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/380562358 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d44013ea0 con 0x7f9d540f7730 2024-02-15T18:40:40.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.952+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5410c900 con 0x7f9d540f7730 2024-02-15T18:40:40.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.953+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d54027a00 con 0x7f9d540f7730 2024-02-15T18:40:40.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.953+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/380562358 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f9d4401a060 con 0x7f9d540f7730 2024-02-15T18:40:40.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.953+0000 7f9d4b7fe700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9d40060f20 0x7f9d400633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:40.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.953+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/380562358 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f9d4407c3c0 con 0x7f9d540f7730 2024-02-15T18:40:40.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.953+0000 7f9d52ffd700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9d40060f20 0x7f9d400633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:40.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.954+0000 7f9d52ffd700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9d40060f20 0x7f9d400633e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9d3c009d60 tx=0x7f9d3c009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:40.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:40.957+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/380562358 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9d4404c7f0 con 0x7f9d540f7730 2024-02-15T18:40:41.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.172+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) v1 -- 0x7f9d540fed60 con 0x7f9d540f7730 2024-02-15T18:40:41.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.173+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/380562358 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v41) v1 ==== 107+0+4635 (secure 0 0 0) 0x7f9d4404fe10 con 0x7f9d540f7730 2024-02-15T18:40:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:41.162 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14432,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6827/3858685802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3858685802},{"type":"v1","addr":"172.21.15.33:6827","nonce":3858685802}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:28:52.769887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9d40060f20 msgr2=0x7f9d400633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9d40060f20 0x7f9d400633e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9d3c009d60 tx=0x7f9d3c009b30).stop 2024-02-15T18:40:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f7730 msgr2=0x7f9d541071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f7730 0x7f9d541071f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f9d4400c790 tx=0x7f9d44007d70).stop 2024-02-15T18:40:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 shutdown_connections 2024-02-15T18:40:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f9d40060f20 0x7f9d400633e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d540f6490 0x7f9d54106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 --2- 172.21.15.33:0/380562358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d540f7730 0x7f9d541071f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 >> 172.21.15.33:0/380562358 conn(0x7f9d540f1bd0 msgr2=0x7f9d540fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:41.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 shutdown_connections 2024-02-15T18:40:41.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.175+0000 7f9d59847700 1 -- 172.21.15.33:0/380562358 wait complete. 2024-02-15T18:40:41.165 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2024-02-15T18:40:41.176 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-02-15T18:40:41.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.308+0000 7fae47ebc700 1 -- 172.21.15.33:0/699394586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae4005fe30 msgr2=0x7fae400f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.308+0000 7fae47ebc700 1 --2- 172.21.15.33:0/699394586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae4005fe30 0x7fae400f9110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fae3c004660 tx=0x7fae3c009b30).stop 2024-02-15T18:40:41.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.308+0000 7fae47ebc700 1 -- 172.21.15.33:0/699394586 shutdown_connections 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.308+0000 7fae47ebc700 1 --2- 172.21.15.33:0/699394586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae400f9600 0x7fae400fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.308+0000 7fae47ebc700 1 --2- 172.21.15.33:0/699394586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae4005fe30 0x7fae400f9110 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.308+0000 7fae47ebc700 1 -- 172.21.15.33:0/699394586 >> 172.21.15.33:0/699394586 conn(0x7fae400f0b70 msgr2=0x7fae400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.308+0000 7fae47ebc700 1 -- 172.21.15.33:0/699394586 shutdown_connections 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.308+0000 7fae47ebc700 1 -- 172.21.15.33:0/699394586 wait complete. 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae47ebc700 1 Processor -- start 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae47ebc700 1 -- start start 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae47ebc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae4005fe30 0x7fae40106d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae47ebc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae400f9600 0x7fae40107210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae47ebc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae401078a0 con 0x7fae400f9600 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae47ebc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4010c2a0 con 0x7fae4005fe30 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae45457700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae400f9600 0x7fae40107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:41.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae45457700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae400f9600 0x7fae40107210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47998/0 (socket says 172.21.15.33:47998) 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae45457700 1 -- 172.21.15.33:0/2066652253 learned_addr learned my addr 172.21.15.33:0/2066652253 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae45c58700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae4005fe30 0x7fae40106d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae45457700 1 -- 172.21.15.33:0/2066652253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae4005fe30 msgr2=0x7fae40106d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae45457700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae4005fe30 0x7fae40106d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae45457700 1 -- 172.21.15.33:0/2066652253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c005040 con 0x7fae400f9600 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae45c58700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae4005fe30 0x7fae40106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.309+0000 7fae45457700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae400f9600 0x7fae40107210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fae3400b410 tx=0x7fae34006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.310+0000 7fae327fc700 1 -- 172.21.15.33:0/2066652253 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae340125f0 con 0x7fae400f9600 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.310+0000 7fae327fc700 1 -- 172.21.15.33:0/2066652253 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fae3400be80 con 0x7fae400f9600 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.310+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4010c440 con 0x7fae400f9600 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.310+0000 7fae327fc700 1 -- 172.21.15.33:0/2066652253 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae34002bc0 con 0x7fae400f9600 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.310+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4010c950 con 0x7fae400f9600 2024-02-15T18:40:41.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.311+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae40027a00 con 0x7fae400f9600 2024-02-15T18:40:41.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.311+0000 7fae327fc700 1 -- 172.21.15.33:0/2066652253 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fae3400f030 con 0x7fae400f9600 2024-02-15T18:40:41.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.312+0000 7fae327fc700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae2c060f20 0x7fae2c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:41.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.312+0000 7fae327fc700 1 -- 172.21.15.33:0/2066652253 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fae3407c5f0 con 0x7fae400f9600 2024-02-15T18:40:41.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.312+0000 7fae45c58700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae2c060f20 0x7fae2c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:41.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.312+0000 7fae45c58700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae2c060f20 0x7fae2c0633e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fae40108210 tx=0x7fae3c009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:41.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.316+0000 7fae327fc700 1 -- 172.21.15.33:0/2066652253 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fae3404c9e0 con 0x7fae400f9600 2024-02-15T18:40:41.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:40.455635+0000 mon.smithi033 (mon.0) 794 : audit [DBG] from='client.? 172.21.15.33:0/2279262457' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T18:40:41.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:40.814688+0000 mon.smithi033 (mon.0) 795 : audit [DBG] from='client.? 172.21.15.33:0/4262688102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:40:41.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:41 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:41.173604+0000 mon.smithi033 (mon.0) 796 : audit [DBG] from='client.? 172.21.15.33:0/380562358' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-02-15T18:40:41.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.533+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7fae400fedf0 con 0x7fae400f9600 2024-02-15T18:40:41.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.533+0000 7fae327fc700 1 -- 172.21.15.33:0/2066652253 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v41) v1 ==== 107+0+4634 (secure 0 0 0) 0x7fae34050000 con 0x7fae400f9600 2024-02-15T18:40:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:41.522 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14432,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6827/3858685802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3858685802},{"type":"v1","addr":"172.21.15.33:6827","nonce":3858685802}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:28:52.769887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:41.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae2c060f20 msgr2=0x7fae2c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae2c060f20 0x7fae2c0633e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fae40108210 tx=0x7fae3c009b30).stop 2024-02-15T18:40:41.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae400f9600 msgr2=0x7fae40107210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae400f9600 0x7fae40107210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fae3400b410 tx=0x7fae34006ef0).stop 2024-02-15T18:40:41.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 shutdown_connections 2024-02-15T18:40:41.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fae2c060f20 0x7fae2c0633e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae4005fe30 0x7fae40106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 --2- 172.21.15.33:0/2066652253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae400f9600 0x7fae40107210 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 >> 172.21.15.33:0/2066652253 conn(0x7fae400f0b70 msgr2=0x7fae400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:41.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 shutdown_connections 2024-02-15T18:40:41.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.535+0000 7fae47ebc700 1 -- 172.21.15.33:0/2066652253 wait complete. 2024-02-15T18:40:41.525 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 14 2024-02-15T18:40:41.535 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:40.455635+0000 mon.smithi033 (mon.0) 794 : audit [DBG] from='client.? 172.21.15.33:0/2279262457' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-15T18:40:41.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:40.814688+0000 mon.smithi033 (mon.0) 795 : audit [DBG] from='client.? 172.21.15.33:0/4262688102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-15T18:40:41.570 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:41 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:41.173604+0000 mon.smithi033 (mon.0) 796 : audit [DBG] from='client.? 172.21.15.33:0/380562358' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-02-15T18:40:41.571 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 -- 172.21.15.33:0/11671911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 msgr2=0x7f18580fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 --2- 172.21.15.33:0/11671911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 0x7f18580fb9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f1848004660 tx=0x7f1848009b30).stop 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 -- 172.21.15.33:0/11671911 shutdown_connections 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 --2- 172.21.15.33:0/11671911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 0x7f18580fb9f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 --2- 172.21.15.33:0/11671911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185805fe30 0x7f18580f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 -- 172.21.15.33:0/11671911 >> 172.21.15.33:0/11671911 conn(0x7f18580f0b70 msgr2=0x7f18580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 -- 172.21.15.33:0/11671911 shutdown_connections 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 -- 172.21.15.33:0/11671911 wait complete. 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 Processor -- start 2024-02-15T18:40:41.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 -- start start 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185805fe30 0x7f18580f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 0x7f18580f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18580f6f60 con 0x7f18580f9600 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.705+0000 7f185c975700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18580f5500 con 0x7f185805fe30 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1855d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 0x7f18580f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1855d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 0x7f18580f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48008/0 (socket says 172.21.15.33:48008) 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1855d9b700 1 -- 172.21.15.33:0/1155678680 learned_addr learned my addr 172.21.15.33:0/1155678680 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f185659c700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185805fe30 0x7f18580f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1855d9b700 1 -- 172.21.15.33:0/1155678680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185805fe30 msgr2=0x7f18580f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1855d9b700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185805fe30 0x7f18580f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1855d9b700 1 -- 172.21.15.33:0/1155678680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848005040 con 0x7f18580f9600 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f185659c700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185805fe30 0x7f18580f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1855d9b700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 0x7f18580f5010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f1848009f50 tx=0x7f1848009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1846ffd700 1 -- 172.21.15.33:0/1155678680 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1848018070 con 0x7f18580f9600 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18580f5720 con 0x7f18580f9600 2024-02-15T18:40:41.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1846ffd700 1 -- 172.21.15.33:0/1155678680 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f1848007ba0 con 0x7f18580f9600 2024-02-15T18:40:41.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f1846ffd700 1 -- 172.21.15.33:0/1155678680 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184801c620 con 0x7f18580f9600 2024-02-15T18:40:41.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.706+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18580f5c80 con 0x7f18580f9600 2024-02-15T18:40:41.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.707+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1858046330 con 0x7f18580f9600 2024-02-15T18:40:41.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.708+0000 7f1846ffd700 1 -- 172.21.15.33:0/1155678680 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f184801c890 con 0x7f18580f9600 2024-02-15T18:40:41.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.708+0000 7f1846ffd700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1840060f20 0x7f18400633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:41.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.708+0000 7f1846ffd700 1 -- 172.21.15.33:0/1155678680 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f184807dfb0 con 0x7f18580f9600 2024-02-15T18:40:41.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.708+0000 7f185659c700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1840060f20 0x7f18400633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:41.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.708+0000 7f185659c700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1840060f20 0x7f18400633e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f185805fc00 tx=0x7f184c009c00).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.712+0000 7f1846ffd700 1 -- 172.21.15.33:0/1155678680 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1848051e10 con 0x7f18580f9600 2024-02-15T18:40:41.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.928+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f1858027a00 con 0x7f18580f9600 2024-02-15T18:40:41.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.929+0000 7f1846ffd700 1 -- 172.21.15.33:0/1155678680 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v41) v1 ==== 107+0+3855 (secure 0 0 0) 0x7f1848051a00 con 0x7f18580f9600 2024-02-15T18:40:41.917 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:41.918 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:28:52.769887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1840060f20 msgr2=0x7f18400633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1840060f20 0x7f18400633e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f185805fc00 tx=0x7f184c009c00).stop 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 msgr2=0x7f18580f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 0x7f18580f5010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f1848009f50 tx=0x7f1848009b30).stop 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 shutdown_connections 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f1840060f20 0x7f18400633e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f185805fe30 0x7f18580f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 --2- 172.21.15.33:0/1155678680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18580f9600 0x7f18580f5010 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 >> 172.21.15.33:0/1155678680 conn(0x7f18580f0b70 msgr2=0x7f18580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 shutdown_connections 2024-02-15T18:40:41.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:41.931+0000 7f185c975700 1 -- 172.21.15.33:0/1155678680 wait complete. 2024-02-15T18:40:41.921 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 15 2024-02-15T18:40:41.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-02-15T18:40:42.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.064+0000 7f4985ca4700 1 -- 172.21.15.33:0/1486848254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5ca0 msgr2=0x7f49800f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.064+0000 7f4985ca4700 1 --2- 172.21.15.33:0/1486848254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5ca0 0x7f49800f66d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f4970004660 tx=0x7f4970009b30).stop 2024-02-15T18:40:42.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.064+0000 7f4985ca4700 1 -- 172.21.15.33:0/1486848254 shutdown_connections 2024-02-15T18:40:42.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.064+0000 7f4985ca4700 1 --2- 172.21.15.33:0/1486848254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5ca0 0x7f49800f66d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.064+0000 7f4985ca4700 1 --2- 172.21.15.33:0/1486848254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49800f5390 0x7f49800f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.064+0000 7f4985ca4700 1 -- 172.21.15.33:0/1486848254 >> 172.21.15.33:0/1486848254 conn(0x7f49800f0b70 msgr2=0x7f49800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:42.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.064+0000 7f4985ca4700 1 -- 172.21.15.33:0/1486848254 shutdown_connections 2024-02-15T18:40:42.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.064+0000 7f4985ca4700 1 -- 172.21.15.33:0/1486848254 wait complete. 2024-02-15T18:40:42.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.064+0000 7f4985ca4700 1 Processor -- start 2024-02-15T18:40:42.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f4985ca4700 1 -- start start 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f4985ca4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5390 0x7f498005fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f4985ca4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49800f5ca0 0x7f498010ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f4985ca4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498010bf80 con 0x7f49800f5390 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f4985ca4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498010c0c0 con 0x7f49800f5ca0 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f497f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5390 0x7f498005fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f497f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5390 0x7f498005fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48032/0 (socket says 172.21.15.33:48032) 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f497f7fe700 1 -- 172.21.15.33:0/2616375334 learned_addr learned my addr 172.21.15.33:0/2616375334 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f497effd700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49800f5ca0 0x7f498010ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f497f7fe700 1 -- 172.21.15.33:0/2616375334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49800f5ca0 msgr2=0x7f498010ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f497f7fe700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49800f5ca0 0x7f498010ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f497f7fe700 1 -- 172.21.15.33:0/2616375334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970005040 con 0x7f49800f5390 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.065+0000 7f497f7fe700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5390 0x7f498005fcf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f496800e7f0 tx=0x7f496800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.066+0000 7f4977fff700 1 -- 172.21.15.33:0/2616375334 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49680092e0 con 0x7f49800f5390 2024-02-15T18:40:42.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.066+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498010c350 con 0x7f49800f5390 2024-02-15T18:40:42.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.066+0000 7f4977fff700 1 -- 172.21.15.33:0/2616375334 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f496800f040 con 0x7f49800f5390 2024-02-15T18:40:42.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.066+0000 7f4977fff700 1 -- 172.21.15.33:0/2616375334 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4968014850 con 0x7f49800f5390 2024-02-15T18:40:42.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.066+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498010c910 con 0x7f49800f5390 2024-02-15T18:40:42.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.067+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4980027a00 con 0x7f49800f5390 2024-02-15T18:40:42.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.067+0000 7f4977fff700 1 -- 172.21.15.33:0/2616375334 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f496801b030 con 0x7f49800f5390 2024-02-15T18:40:42.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.067+0000 7f4977fff700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f496c060f20 0x7f496c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:42.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.067+0000 7f4977fff700 1 -- 172.21.15.33:0/2616375334 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f496807be80 con 0x7f49800f5390 2024-02-15T18:40:42.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.067+0000 7f497effd700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f496c060f20 0x7f496c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:42.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.068+0000 7f497effd700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f496c060f20 0x7f496c0633e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f4970009720 tx=0x7f4970016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:42.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.071+0000 7f4977fff700 1 -- 172.21.15.33:0/2616375334 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f496804fd90 con 0x7f49800f5390 2024-02-15T18:40:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.288+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f49800586e0 con 0x7f49800f5390 2024-02-15T18:40:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.288+0000 7f4977fff700 1 -- 172.21.15.33:0/2616375334 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v41) v1 ==== 107+0+4632 (secure 0 0 0) 0x7f4968019020 con 0x7f49800f5390 2024-02-15T18:40:42.277 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:42.277 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:28:52.769887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.290+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f496c060f20 msgr2=0x7f496c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.290+0000 7f4985ca4700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f496c060f20 0x7f496c0633e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f4970009720 tx=0x7f4970016040).stop 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.290+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5390 msgr2=0x7f498005fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.290+0000 7f4985ca4700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5390 0x7f498005fcf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f496800e7f0 tx=0x7f496800b040).stop 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.290+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 shutdown_connections 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.290+0000 7f4985ca4700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f496c060f20 0x7f496c0633e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.290+0000 7f4985ca4700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49800f5390 0x7f498005fcf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.290+0000 7f4985ca4700 1 --2- 172.21.15.33:0/2616375334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49800f5ca0 0x7f498010ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.291+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 >> 172.21.15.33:0/2616375334 conn(0x7f49800f0b70 msgr2=0x7f49800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.291+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 shutdown_connections 2024-02-15T18:40:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.291+0000 7f4985ca4700 1 -- 172.21.15.33:0/2616375334 wait complete. 2024-02-15T18:40:42.281 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-02-15T18:40:42.292 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-02-15T18:40:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 -- 172.21.15.33:0/1960396909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 msgr2=0x7f296c0f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 --2- 172.21.15.33:0/1960396909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 0x7f296c0f68b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f295c004660 tx=0x7f295c009b30).stop 2024-02-15T18:40:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 -- 172.21.15.33:0/1960396909 shutdown_connections 2024-02-15T18:40:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 --2- 172.21.15.33:0/1960396909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f7730 0x7f296c0f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 --2- 172.21.15.33:0/1960396909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 0x7f296c0f68b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 -- 172.21.15.33:0/1960396909 >> 172.21.15.33:0/1960396909 conn(0x7f296c0f1bd0 msgr2=0x7f296c0f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:42.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 -- 172.21.15.33:0/1960396909 shutdown_connections 2024-02-15T18:40:42.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 -- 172.21.15.33:0/1960396909 wait complete. 2024-02-15T18:40:42.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 Processor -- start 2024-02-15T18:40:42.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.424+0000 7f29726e7700 1 -- start start 2024-02-15T18:40:42.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f29726e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 0x7f296c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f29726e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f7730 0x7f296c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f29726e7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c107910 con 0x7f296c0f6490 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f29726e7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c10c310 con 0x7f296c0f7730 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f296bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 0x7f296c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f296bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 0x7f296c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48064/0 (socket says 172.21.15.33:48064) 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f296bfff700 1 -- 172.21.15.33:0/3315460478 learned_addr learned my addr 172.21.15.33:0/3315460478 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f296b7fe700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f7730 0x7f296c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f296bfff700 1 -- 172.21.15.33:0/3315460478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f7730 msgr2=0x7f296c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f296bfff700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f7730 0x7f296c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f296bfff700 1 -- 172.21.15.33:0/3315460478 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c005040 con 0x7f296c0f6490 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f296bfff700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 0x7f296c106d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f295c013fd0 tx=0x7f295c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f2968ff9700 1 -- 172.21.15.33:0/3315460478 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295c018070 con 0x7f296c0f6490 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c10c450 con 0x7f296c0f6490 2024-02-15T18:40:42.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f2968ff9700 1 -- 172.21.15.33:0/3315460478 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f295c007d70 con 0x7f296c0f6490 2024-02-15T18:40:42.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f2968ff9700 1 -- 172.21.15.33:0/3315460478 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295c01c660 con 0x7f296c0f6490 2024-02-15T18:40:42.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.425+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c10c900 con 0x7f296c0f6490 2024-02-15T18:40:42.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.426+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c046330 con 0x7f296c0f6490 2024-02-15T18:40:42.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.427+0000 7f2968ff9700 1 -- 172.21.15.33:0/3315460478 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f295c01da10 con 0x7f296c0f6490 2024-02-15T18:40:42.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.427+0000 7f2968ff9700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2958060f20 0x7f29580633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:42.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.427+0000 7f2968ff9700 1 -- 172.21.15.33:0/3315460478 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f295c07e090 con 0x7f296c0f6490 2024-02-15T18:40:42.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.427+0000 7f296b7fe700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2958060f20 0x7f29580633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:42.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.427+0000 7f296b7fe700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2958060f20 0x7f29580633e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f295400b790 tx=0x7f2954008040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:42.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.431+0000 7f2968ff9700 1 -- 172.21.15.33:0/3315460478 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f295c04e460 con 0x7f296c0f6490 2024-02-15T18:40:42.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:41.533983+0000 mon.smithi033 (mon.0) 797 : audit [DBG] from='client.? 172.21.15.33:0/2066652253' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-02-15T18:40:42.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:41.583687+0000 mgr.smithi033.apxevf (mgr.14626) 456 : cluster [DBG] pgmap v316: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:42.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:42 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:41.929488+0000 mon.smithi033 (mon.0) 798 : audit [DBG] from='client.? 172.21.15.33:0/1155678680' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-15T18:40:42.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:41.533983+0000 mon.smithi033 (mon.0) 797 : audit [DBG] from='client.? 172.21.15.33:0/2066652253' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-02-15T18:40:42.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:41.583687+0000 mgr.smithi033.apxevf (mgr.14626) 456 : cluster [DBG] pgmap v316: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:42.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:42 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:41.929488+0000 mon.smithi033 (mon.0) 798 : audit [DBG] from='client.? 172.21.15.33:0/1155678680' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-15T18:40:42.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.646+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f296c027a00 con 0x7f296c0f6490 2024-02-15T18:40:42.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.647+0000 7f2968ff9700 1 -- 172.21.15.33:0/3315460478 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v41) v1 ==== 107+0+4631 (secure 0 0 0) 0x7f295c051a80 con 0x7f296c0f6490 2024-02-15T18:40:42.636 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:42.636 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:28:52.769887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.648+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2958060f20 msgr2=0x7f29580633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.648+0000 7f29726e7700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2958060f20 0x7f29580633e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f295400b790 tx=0x7f2954008040).stop 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.649+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 msgr2=0x7f296c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.649+0000 7f29726e7700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 0x7f296c106d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f295c013fd0 tx=0x7f295c009b30).stop 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.649+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 shutdown_connections 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.649+0000 7f29726e7700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f2958060f20 0x7f29580633e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.649+0000 7f29726e7700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f296c0f6490 0x7f296c106d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.649+0000 7f29726e7700 1 --2- 172.21.15.33:0/3315460478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f296c0f7730 0x7f296c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.649+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 >> 172.21.15.33:0/3315460478 conn(0x7f296c0f1bd0 msgr2=0x7f296c0fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.649+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 shutdown_connections 2024-02-15T18:40:42.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.649+0000 7f29726e7700 1 -- 172.21.15.33:0/3315460478 wait complete. 2024-02-15T18:40:42.639 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 17 2024-02-15T18:40:42.650 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.782+0000 7feef99c1700 1 -- 172.21.15.33:0/3927543262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f6490 msgr2=0x7feef40f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.782+0000 7feef99c1700 1 --2- 172.21.15.33:0/3927543262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f6490 0x7feef40f68b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7feee4004660 tx=0x7feee4009b30).stop 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.782+0000 7feef99c1700 1 -- 172.21.15.33:0/3927543262 shutdown_connections 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.782+0000 7feef99c1700 1 --2- 172.21.15.33:0/3927543262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feef40f7730 0x7feef40f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.782+0000 7feef99c1700 1 --2- 172.21.15.33:0/3927543262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f6490 0x7feef40f68b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.782+0000 7feef99c1700 1 -- 172.21.15.33:0/3927543262 >> 172.21.15.33:0/3927543262 conn(0x7feef40f1bd0 msgr2=0x7feef40f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.782+0000 7feef99c1700 1 -- 172.21.15.33:0/3927543262 shutdown_connections 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.782+0000 7feef99c1700 1 -- 172.21.15.33:0/3927543262 wait complete. 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef99c1700 1 Processor -- start 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef99c1700 1 -- start start 2024-02-15T18:40:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef99c1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feef40f6490 0x7feef4106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef99c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f7730 0x7feef4107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef99c1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef4107920 con 0x7feef40f7730 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef99c1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef410c320 con 0x7feef40f6490 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f7730 0x7feef4107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f7730 0x7feef4107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48078/0 (socket says 172.21.15.33:48078) 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef27fc700 1 -- 172.21.15.33:0/1303057129 learned_addr learned my addr 172.21.15.33:0/1303057129 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef27fc700 1 -- 172.21.15.33:0/1303057129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feef40f6490 msgr2=0x7feef4106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef27fc700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feef40f6490 0x7feef4106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.783+0000 7feef27fc700 1 -- 172.21.15.33:0/1303057129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4005040 con 0x7feef40f7730 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.784+0000 7feef27fc700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f7730 0x7feef4107290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7feee800b410 tx=0x7feee8006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.784+0000 7feedb7fe700 1 -- 172.21.15.33:0/1303057129 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee80125f0 con 0x7feef40f7730 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.784+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef410c4c0 con 0x7feef40f7730 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.784+0000 7feedb7fe700 1 -- 172.21.15.33:0/1303057129 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7feee800be80 con 0x7feef40f7730 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.784+0000 7feedb7fe700 1 -- 172.21.15.33:0/1303057129 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feee8002bc0 con 0x7feef40f7730 2024-02-15T18:40:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.784+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef410c9d0 con 0x7feef40f7730 2024-02-15T18:40:42.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.785+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef4046330 con 0x7feef40f7730 2024-02-15T18:40:42.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.785+0000 7feedb7fe700 1 -- 172.21.15.33:0/1303057129 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7feee800f030 con 0x7feef40f7730 2024-02-15T18:40:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.785+0000 7feedb7fe700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feedc060f20 0x7feedc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.785+0000 7feedb7fe700 1 -- 172.21.15.33:0/1303057129 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7feee807c600 con 0x7feef40f7730 2024-02-15T18:40:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.786+0000 7feef2ffd700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feedc060f20 0x7feedc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.786+0000 7feef2ffd700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feedc060f20 0x7feedc0633e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7feee4009f50 tx=0x7feee4009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:42.790+0000 7feedb7fe700 1 -- 172.21.15.33:0/1303057129 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7feee804ca30 con 0x7feef40f7730 2024-02-15T18:40:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.007+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7feef4027a00 con 0x7feef40f7730 2024-02-15T18:40:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.007+0000 7feedb7fe700 1 -- 172.21.15.33:0/1303057129 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v41) v1 ==== 107+0+4632 (secure 0 0 0) 0x7feee8050050 con 0x7feef40f7730 2024-02-15T18:40:42.996 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:42.997 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:30:34.499671+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[1],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.009+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feedc060f20 msgr2=0x7feedc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.009+0000 7feef99c1700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feedc060f20 0x7feedc0633e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7feee4009f50 tx=0x7feee4009b30).stop 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.009+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f7730 msgr2=0x7feef4107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.009+0000 7feef99c1700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f7730 0x7feef4107290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7feee800b410 tx=0x7feee8006ef0).stop 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.009+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 shutdown_connections 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.009+0000 7feef99c1700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7feedc060f20 0x7feedc0633e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.009+0000 7feef99c1700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feef40f6490 0x7feef4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.009+0000 7feef99c1700 1 --2- 172.21.15.33:0/1303057129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feef40f7730 0x7feef4107290 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.009+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 >> 172.21.15.33:0/1303057129 conn(0x7feef40f1bd0 msgr2=0x7feef40fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.010+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 shutdown_connections 2024-02-15T18:40:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.010+0000 7feef99c1700 1 -- 172.21.15.33:0/1303057129 wait complete. 2024-02-15T18:40:43.000 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 18 2024-02-15T18:40:43.010 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-15T18:40:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.142+0000 7fd56f95f700 1 -- 172.21.15.33:0/210612738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 msgr2=0x7fd5680f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.142+0000 7fd56f95f700 1 --2- 172.21.15.33:0/210612738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 0x7fd5680f7b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fd558004660 tx=0x7fd558009b30).stop 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.142+0000 7fd56f95f700 1 -- 172.21.15.33:0/210612738 shutdown_connections 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.142+0000 7fd56f95f700 1 --2- 172.21.15.33:0/210612738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 0x7fd5680f7b90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.142+0000 7fd56f95f700 1 --2- 172.21.15.33:0/210612738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5680f6490 0x7fd5680f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.142+0000 7fd56f95f700 1 -- 172.21.15.33:0/210612738 >> 172.21.15.33:0/210612738 conn(0x7fd5680f1bd0 msgr2=0x7fd5680f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56f95f700 1 -- 172.21.15.33:0/210612738 shutdown_connections 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56f95f700 1 -- 172.21.15.33:0/210612738 wait complete. 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56f95f700 1 Processor -- start 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56f95f700 1 -- start start 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56f95f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5680f6490 0x7fd568106d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56f95f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 0x7fd568107200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56f95f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568107800 con 0x7fd5680f7730 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56f95f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568107940 con 0x7fd5680f6490 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56cefa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 0x7fd568107200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56cefa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 0x7fd568107200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48088/0 (socket says 172.21.15.33:48088) 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.143+0000 7fd56cefa700 1 -- 172.21.15.33:0/1122142939 learned_addr learned my addr 172.21.15.33:0/1122142939 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.144+0000 7fd56cefa700 1 -- 172.21.15.33:0/1122142939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5680f6490 msgr2=0x7fd568106d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.144+0000 7fd56cefa700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5680f6490 0x7fd568106d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.144+0000 7fd56cefa700 1 -- 172.21.15.33:0/1122142939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558005040 con 0x7fd5680f7730 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.144+0000 7fd56cefa700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 0x7fd568107200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd558009f50 tx=0x7fd558009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.144+0000 7fd55dffb700 1 -- 172.21.15.33:0/1122142939 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd558018070 con 0x7fd5680f7730 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.144+0000 7fd55dffb700 1 -- 172.21.15.33:0/1122142939 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fd558007ba0 con 0x7fd5680f7730 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.144+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56810c2f0 con 0x7fd5680f7730 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.144+0000 7fd55dffb700 1 -- 172.21.15.33:0/1122142939 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd55801c620 con 0x7fd5680f7730 2024-02-15T18:40:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.144+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56810c850 con 0x7fd5680f7730 2024-02-15T18:40:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.145+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568027a00 con 0x7fd5680f7730 2024-02-15T18:40:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.145+0000 7fd55dffb700 1 -- 172.21.15.33:0/1122142939 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fd55801d420 con 0x7fd5680f7730 2024-02-15T18:40:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.146+0000 7fd55dffb700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd554060f20 0x7fd5540633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.146+0000 7fd55dffb700 1 -- 172.21.15.33:0/1122142939 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fd55807dfd0 con 0x7fd5680f7730 2024-02-15T18:40:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.146+0000 7fd56d6fb700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd554060f20 0x7fd5540633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:43.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.146+0000 7fd56d6fb700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd554060f20 0x7fd5540633e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd568108200 tx=0x7fd5640099e0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:43.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.150+0000 7fd55dffb700 1 -- 172.21.15.33:0/1122142939 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd5580acf60 con 0x7fd5680f7730 2024-02-15T18:40:43.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:42.289196+0000 mon.smithi033 (mon.0) 799 : audit [DBG] from='client.? 172.21.15.33:0/2616375334' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-15T18:40:43.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:42.647504+0000 mon.smithi033 (mon.0) 800 : audit [DBG] from='client.? 172.21.15.33:0/3315460478' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-15T18:40:43.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:43 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:43.008246+0000 mon.smithi033 (mon.0) 801 : audit [DBG] from='client.? 172.21.15.33:0/1303057129' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-15T18:40:43.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.366+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fd5680fed60 con 0x7fd5680f7730 2024-02-15T18:40:43.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.367+0000 7fd55dffb700 1 -- 172.21.15.33:0/1122142939 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v41) v1 ==== 107+0+4633 (secure 0 0 0) 0x7fd55804e360 con 0x7fd5680f7730 2024-02-15T18:40:43.356 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:43.356 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:31:16.192509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[1],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[0],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd554060f20 msgr2=0x7fd5540633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd554060f20 0x7fd5540633e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd568108200 tx=0x7fd5640099e0).stop 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 msgr2=0x7fd568107200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 0x7fd568107200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd558009f50 tx=0x7fd558009b30).stop 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 shutdown_connections 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fd554060f20 0x7fd5540633e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5680f6490 0x7fd568106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 --2- 172.21.15.33:0/1122142939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5680f7730 0x7fd568107200 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 >> 172.21.15.33:0/1122142939 conn(0x7fd5680f1bd0 msgr2=0x7fd5680fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 shutdown_connections 2024-02-15T18:40:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.369+0000 7fd56f95f700 1 -- 172.21.15.33:0/1122142939 wait complete. 2024-02-15T18:40:43.359 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 19 2024-02-15T18:40:43.370 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.503+0000 7f75eadef700 1 -- 172.21.15.33:0/4069223313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f6490 msgr2=0x7f75e40f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.503+0000 7f75eadef700 1 --2- 172.21.15.33:0/4069223313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f6490 0x7f75e40f68b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f75d8004660 tx=0x7f75d8009b30).stop 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.503+0000 7f75eadef700 1 -- 172.21.15.33:0/4069223313 shutdown_connections 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.503+0000 7f75eadef700 1 --2- 172.21.15.33:0/4069223313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e40f7730 0x7f75e40f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.503+0000 7f75eadef700 1 --2- 172.21.15.33:0/4069223313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f6490 0x7f75e40f68b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.503+0000 7f75eadef700 1 -- 172.21.15.33:0/4069223313 >> 172.21.15.33:0/4069223313 conn(0x7f75e40f1bd0 msgr2=0x7f75e40f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.503+0000 7f75eadef700 1 -- 172.21.15.33:0/4069223313 shutdown_connections 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.503+0000 7f75eadef700 1 -- 172.21.15.33:0/4069223313 wait complete. 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.504+0000 7f75eadef700 1 Processor -- start 2024-02-15T18:40:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.504+0000 7f75eadef700 1 -- start start 2024-02-15T18:40:43.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.504+0000 7f75eadef700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e40f6490 0x7f75e4106d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:43.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.504+0000 7f75eadef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f7730 0x7f75e41071f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:43.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75eadef700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e41077f0 con 0x7f75e40f7730 2024-02-15T18:40:43.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75eadef700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e4107930 con 0x7f75e40f6490 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f7730 0x7f75e41071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f7730 0x7f75e41071f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48102/0 (socket says 172.21.15.33:48102) 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e3fff700 1 -- 172.21.15.33:0/764351678 learned_addr learned my addr 172.21.15.33:0/764351678 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e8b8b700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e40f6490 0x7f75e4106d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e3fff700 1 -- 172.21.15.33:0/764351678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e40f6490 msgr2=0x7f75e4106d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e3fff700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e40f6490 0x7f75e4106d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e3fff700 1 -- 172.21.15.33:0/764351678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8005040 con 0x7f75e40f7730 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e8b8b700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e40f6490 0x7f75e4106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e3fff700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f7730 0x7f75e41071f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f75d00026d0 tx=0x7f75d0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e17fa700 1 -- 172.21.15.33:0/764351678 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75d0009320 con 0x7f75e40f7730 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e17fa700 1 -- 172.21.15.33:0/764351678 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f75d000f040 con 0x7f75e40f7730 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e410c340 con 0x7f75e40f7730 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75e17fa700 1 -- 172.21.15.33:0/764351678 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75d00149b0 con 0x7f75e40f7730 2024-02-15T18:40:43.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.505+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e410c900 con 0x7f75e40f7730 2024-02-15T18:40:43.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.506+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e4027a00 con 0x7f75e40f7730 2024-02-15T18:40:43.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:42.289196+0000 mon.smithi033 (mon.0) 799 : audit [DBG] from='client.? 172.21.15.33:0/2616375334' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-15T18:40:43.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:42.647504+0000 mon.smithi033 (mon.0) 800 : audit [DBG] from='client.? 172.21.15.33:0/3315460478' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-15T18:40:43.497 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:43 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:43.008246+0000 mon.smithi033 (mon.0) 801 : audit [DBG] from='client.? 172.21.15.33:0/1303057129' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-15T18:40:43.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.507+0000 7f75e17fa700 1 -- 172.21.15.33:0/764351678 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f75d0009480 con 0x7f75e40f7730 2024-02-15T18:40:43.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.508+0000 7f75e17fa700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f75d4060f20 0x7f75d40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:43.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.508+0000 7f75e17fa700 1 -- 172.21.15.33:0/764351678 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f75d007ca50 con 0x7f75e40f7730 2024-02-15T18:40:43.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.508+0000 7f75e8b8b700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f75d4060f20 0x7f75d40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:43.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.508+0000 7f75e8b8b700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f75d4060f20 0x7f75d40633e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f75e41081f0 tx=0x7f75d8009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:43.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.511+0000 7f75e17fa700 1 -- 172.21.15.33:0/764351678 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f75d0050930 con 0x7f75e40f7730 2024-02-15T18:40:43.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.730+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f75e40fed60 con 0x7f75e40f7730 2024-02-15T18:40:43.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.731+0000 7f75e17fa700 1 -- 172.21.15.33:0/764351678 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v41) v1 ==== 107+0+4632 (secure 0 0 0) 0x7f75d0050520 con 0x7f75e40f7730 2024-02-15T18:40:43.720 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:43.720 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:35:21.569761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[1],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f75d4060f20 msgr2=0x7f75d40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f75d4060f20 0x7f75d40633e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f75e41081f0 tx=0x7f75d8009b30).stop 2024-02-15T18:40:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f7730 msgr2=0x7f75e41071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f7730 0x7f75e41071f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f75d00026d0 tx=0x7f75d0009de0).stop 2024-02-15T18:40:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 shutdown_connections 2024-02-15T18:40:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f75d4060f20 0x7f75d40633e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75e40f6490 0x7f75e4106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 --2- 172.21.15.33:0/764351678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75e40f7730 0x7f75e41071f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 >> 172.21.15.33:0/764351678 conn(0x7f75e40f1bd0 msgr2=0x7f75e40fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:43.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 shutdown_connections 2024-02-15T18:40:43.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.733+0000 7f75eadef700 1 -- 172.21.15.33:0/764351678 wait complete. 2024-02-15T18:40:43.723 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 20 2024-02-15T18:40:43.734 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-15T18:40:43.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.866+0000 7fac478b7700 1 -- 172.21.15.33:0/1627251617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 msgr2=0x7fac400f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.866+0000 7fac478b7700 1 --2- 172.21.15.33:0/1627251617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 0x7fac400f57b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fac3c004660 tx=0x7fac3c009b30).stop 2024-02-15T18:40:43.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.866+0000 7fac478b7700 1 -- 172.21.15.33:0/1627251617 shutdown_connections 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.866+0000 7fac478b7700 1 --2- 172.21.15.33:0/1627251617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac400f5ca0 0x7fac400f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.866+0000 7fac478b7700 1 --2- 172.21.15.33:0/1627251617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 0x7fac400f57b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.866+0000 7fac478b7700 1 -- 172.21.15.33:0/1627251617 >> 172.21.15.33:0/1627251617 conn(0x7fac400f0b70 msgr2=0x7fac400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac478b7700 1 -- 172.21.15.33:0/1627251617 shutdown_connections 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac478b7700 1 -- 172.21.15.33:0/1627251617 wait complete. 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac478b7700 1 Processor -- start 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac478b7700 1 -- start start 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac478b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 0x7fac4005fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac478b7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac400f5ca0 0x7fac4010dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac478b7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac401078a0 con 0x7fac400f5390 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac478b7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4010e3b0 con 0x7fac400f5ca0 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac45653700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 0x7fac4005fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac45653700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 0x7fac4005fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48132/0 (socket says 172.21.15.33:48132) 2024-02-15T18:40:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac45653700 1 -- 172.21.15.33:0/3657455965 learned_addr learned my addr 172.21.15.33:0/3657455965 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.867+0000 7fac44e52700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac400f5ca0 0x7fac4010dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.868+0000 7fac45653700 1 -- 172.21.15.33:0/3657455965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac400f5ca0 msgr2=0x7fac4010dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.868+0000 7fac45653700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac400f5ca0 0x7fac4010dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.868+0000 7fac45653700 1 -- 172.21.15.33:0/3657455965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c005040 con 0x7fac400f5390 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.868+0000 7fac45653700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 0x7fac4005fc90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fac3c009f50 tx=0x7fac3c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.868+0000 7fac35ffb700 1 -- 172.21.15.33:0/3657455965 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3c018070 con 0x7fac400f5390 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.868+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4010e4f0 con 0x7fac400f5390 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.868+0000 7fac35ffb700 1 -- 172.21.15.33:0/3657455965 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fac3c007d70 con 0x7fac400f5390 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.868+0000 7fac35ffb700 1 -- 172.21.15.33:0/3657455965 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3c01c620 con 0x7fac400f5390 2024-02-15T18:40:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.868+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4010ea20 con 0x7fac400f5390 2024-02-15T18:40:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.869+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac40046330 con 0x7fac400f5390 2024-02-15T18:40:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.869+0000 7fac35ffb700 1 -- 172.21.15.33:0/3657455965 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fac3c01c8e0 con 0x7fac400f5390 2024-02-15T18:40:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.870+0000 7fac35ffb700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fac2c060f20 0x7fac2c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.870+0000 7fac35ffb700 1 -- 172.21.15.33:0/3657455965 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fac3c07e140 con 0x7fac400f5390 2024-02-15T18:40:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.870+0000 7fac44e52700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fac2c060f20 0x7fac2c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.870+0000 7fac44e52700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fac2c060f20 0x7fac2c0633e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fac300041d0 tx=0x7fac30009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:43.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:43.874+0000 7fac35ffb700 1 -- 172.21.15.33:0/3657455965 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fac3c051f20 con 0x7fac400f5390 2024-02-15T18:40:44.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.091+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fac400586e0 con 0x7fac400f5390 2024-02-15T18:40:44.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.091+0000 7fac35ffb700 1 -- 172.21.15.33:0/3657455965 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v41) v1 ==== 107+0+4631 (secure 0 0 0) 0x7fac3c051b10 con 0x7fac400f5390 2024-02-15T18:40:44.080 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:44.080 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:35:44.660678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fac2c060f20 msgr2=0x7fac2c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fac2c060f20 0x7fac2c0633e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fac300041d0 tx=0x7fac30009040).stop 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 msgr2=0x7fac4005fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 0x7fac4005fc90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fac3c009f50 tx=0x7fac3c009b30).stop 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 shutdown_connections 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fac2c060f20 0x7fac2c0633e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac400f5390 0x7fac4005fc90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 --2- 172.21.15.33:0/3657455965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac400f5ca0 0x7fac4010dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 >> 172.21.15.33:0/3657455965 conn(0x7fac400f0b70 msgr2=0x7fac400fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.093+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 shutdown_connections 2024-02-15T18:40:44.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.094+0000 7fac478b7700 1 -- 172.21.15.33:0/3657455965 wait complete. 2024-02-15T18:40:44.084 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 21 2024-02-15T18:40:44.094 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-15T18:40:44.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 -- 172.21.15.33:0/2333668872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 msgr2=0x7fa5dc0f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 --2- 172.21.15.33:0/2333668872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 0x7fa5dc0f7b90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fa5cc004660 tx=0x7fa5cc009b30).stop 2024-02-15T18:40:44.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 -- 172.21.15.33:0/2333668872 shutdown_connections 2024-02-15T18:40:44.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 --2- 172.21.15.33:0/2333668872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 0x7fa5dc0f7b90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 --2- 172.21.15.33:0/2333668872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5dc0f6490 0x7fa5dc0f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 -- 172.21.15.33:0/2333668872 >> 172.21.15.33:0/2333668872 conn(0x7fa5dc0f1bd0 msgr2=0x7fa5dc0f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:44.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 -- 172.21.15.33:0/2333668872 shutdown_connections 2024-02-15T18:40:44.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 -- 172.21.15.33:0/2333668872 wait complete. 2024-02-15T18:40:44.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 Processor -- start 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.227+0000 7fa5e15a7700 1 -- start start 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5e15a7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5dc0f6490 0x7fa5dc06b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5e15a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 0x7fa5dc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5e15a7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc06bd70 con 0x7fa5dc0f7730 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5e15a7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc06a310 con 0x7fa5dc0f6490 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5da7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 0x7fa5dc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5da7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 0x7fa5dc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48162/0 (socket says 172.21.15.33:48162) 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5da7fc700 1 -- 172.21.15.33:0/3414498836 learned_addr learned my addr 172.21.15.33:0/3414498836 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5daffd700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5dc0f6490 0x7fa5dc06b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5da7fc700 1 -- 172.21.15.33:0/3414498836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5dc0f6490 msgr2=0x7fa5dc06b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5da7fc700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5dc0f6490 0x7fa5dc06b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5da7fc700 1 -- 172.21.15.33:0/3414498836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc005040 con 0x7fa5dc0f7730 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5da7fc700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 0x7fa5dc069e20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa5cc009f50 tx=0x7fa5cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5c37fe700 1 -- 172.21.15.33:0/3414498836 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5cc018070 con 0x7fa5dc0f7730 2024-02-15T18:40:44.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc06a530 con 0x7fa5dc0f7730 2024-02-15T18:40:44.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5c37fe700 1 -- 172.21.15.33:0/3414498836 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fa5cc007ba0 con 0x7fa5dc0f7730 2024-02-15T18:40:44.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5c37fe700 1 -- 172.21.15.33:0/3414498836 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5cc01c620 con 0x7fa5dc0f7730 2024-02-15T18:40:44.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.228+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc06aa90 con 0x7fa5dc0f7730 2024-02-15T18:40:44.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.229+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc046330 con 0x7fa5dc0f7730 2024-02-15T18:40:44.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.230+0000 7fa5c37fe700 1 -- 172.21.15.33:0/3414498836 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa5cc01c890 con 0x7fa5dc0f7730 2024-02-15T18:40:44.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.230+0000 7fa5c37fe700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa5c4060f20 0x7fa5c40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:44.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.230+0000 7fa5c37fe700 1 -- 172.21.15.33:0/3414498836 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa5cc07dfb0 con 0x7fa5dc0f7730 2024-02-15T18:40:44.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.230+0000 7fa5daffd700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa5c4060f20 0x7fa5c40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:44.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.231+0000 7fa5daffd700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa5c4060f20 0x7fa5c40633e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa5dc0f7590 tx=0x7fa5d0009c00).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:44.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.234+0000 7fa5c37fe700 1 -- 172.21.15.33:0/3414498836 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa5cc051e10 con 0x7fa5dc0f7730 2024-02-15T18:40:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.459+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fa5dc027a00 con 0x7fa5dc0f7730 2024-02-15T18:40:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.460+0000 7fa5c37fe700 1 -- 172.21.15.33:0/3414498836 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v41) v1 ==== 107+0+4631 (secure 0 0 0) 0x7fa5cc051a00 con 0x7fa5dc0f7730 2024-02-15T18:40:44.449 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:44.449 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:35:56.901870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa5c4060f20 msgr2=0x7fa5c40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa5c4060f20 0x7fa5c40633e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa5dc0f7590 tx=0x7fa5d0009c00).stop 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 msgr2=0x7fa5dc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 0x7fa5dc069e20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa5cc009f50 tx=0x7fa5cc009b30).stop 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 shutdown_connections 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa5c4060f20 0x7fa5c40633e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5dc0f6490 0x7fa5dc06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 --2- 172.21.15.33:0/3414498836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5dc0f7730 0x7fa5dc069e20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 >> 172.21.15.33:0/3414498836 conn(0x7fa5dc0f1bd0 msgr2=0x7fa5dc0fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 shutdown_connections 2024-02-15T18:40:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.462+0000 7fa5e15a7700 1 -- 172.21.15.33:0/3414498836 wait complete. 2024-02-15T18:40:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2024-02-15T18:40:44.461 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:43.367775+0000 mon.smithi033 (mon.0) 802 : audit [DBG] from='client.? 172.21.15.33:0/1122142939' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-15T18:40:44.461 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:43.584045+0000 mgr.smithi033.apxevf (mgr.14626) 457 : cluster [DBG] pgmap v317: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:44.462 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:43.731681+0000 mon.smithi033 (mon.0) 803 : audit [DBG] from='client.? 172.21.15.33:0/764351678' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-15T18:40:44.462 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:44 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:44.092067+0000 mon.smithi033 (mon.0) 804 : audit [DBG] from='client.? 172.21.15.33:0/3657455965' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-15T18:40:44.463 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-02-15T18:40:44.463 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-15T18:40:44.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:43.367775+0000 mon.smithi033 (mon.0) 802 : audit [DBG] from='client.? 172.21.15.33:0/1122142939' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-15T18:40:44.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:43.584045+0000 mgr.smithi033.apxevf (mgr.14626) 457 : cluster [DBG] pgmap v317: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:44.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:43.731681+0000 mon.smithi033 (mon.0) 803 : audit [DBG] from='client.? 172.21.15.33:0/764351678' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-15T18:40:44.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:44 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:44.092067+0000 mon.smithi033 (mon.0) 804 : audit [DBG] from='client.? 172.21.15.33:0/3657455965' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-15T18:40:44.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.595+0000 7fcdf0c23700 1 -- 172.21.15.33:0/440020907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 msgr2=0x7fcdec0f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.595+0000 7fcdf0c23700 1 --2- 172.21.15.33:0/440020907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 0x7fcdec0f66d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fcdd4004660 tx=0x7fcdd4009b30).stop 2024-02-15T18:40:44.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.595+0000 7fcdf0c23700 1 -- 172.21.15.33:0/440020907 shutdown_connections 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.595+0000 7fcdf0c23700 1 --2- 172.21.15.33:0/440020907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 0x7fcdec0f66d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.595+0000 7fcdf0c23700 1 --2- 172.21.15.33:0/440020907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0f5390 0x7fcdec0f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.595+0000 7fcdf0c23700 1 -- 172.21.15.33:0/440020907 >> 172.21.15.33:0/440020907 conn(0x7fcdec0f0b70 msgr2=0x7fcdec0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcdf0c23700 1 -- 172.21.15.33:0/440020907 shutdown_connections 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcdf0c23700 1 -- 172.21.15.33:0/440020907 wait complete. 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcdf0c23700 1 Processor -- start 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcdf0c23700 1 -- start start 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcdf0c23700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0f5390 0x7fcdec0f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcdf0c23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 0x7fcdec0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcdf0c23700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0f9960 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcdf0c23700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0f7f00 con 0x7fcdec0f5390 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcde9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 0x7fcdec0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcde9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 0x7fcdec0f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48180/0 (socket says 172.21.15.33:48180) 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.596+0000 7fcde9d9b700 1 -- 172.21.15.33:0/4210039822 learned_addr learned my addr 172.21.15.33:0/4210039822 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcdea59c700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0f5390 0x7fcdec0f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcde9d9b700 1 -- 172.21.15.33:0/4210039822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0f5390 msgr2=0x7fcdec0f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcde9d9b700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0f5390 0x7fcdec0f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcde9d9b700 1 -- 172.21.15.33:0/4210039822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd4005040 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcde9d9b700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 0x7fcdec0f7a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fcdd4000c00 tx=0x7fcdd400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcde2ffd700 1 -- 172.21.15.33:0/4210039822 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd4019070 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcde2ffd700 1 -- 172.21.15.33:0/4210039822 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fcdd4014420 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec0f8120 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcde2ffd700 1 -- 172.21.15.33:0/4210039822 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd401d600 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.597+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdec0f8680 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.598+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdec046330 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.598+0000 7fcde2ffd700 1 -- 172.21.15.33:0/4210039822 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fcdd4025070 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.599+0000 7fcde2ffd700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcdd8060f20 0x7fcdd80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.599+0000 7fcde2ffd700 1 -- 172.21.15.33:0/4210039822 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fcdd407d120 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.599+0000 7fcdea59c700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcdd8060f20 0x7fcdd80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.599+0000 7fcdea59c700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcdd8060f20 0x7fcdd80633e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fcddc007f80 tx=0x7fcddc00b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.603+0000 7fcde2ffd700 1 -- 172.21.15.33:0/4210039822 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcdd4050f80 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.820+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fcdec0fdc90 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.821+0000 7fcde2ffd700 1 -- 172.21.15.33:0/4210039822 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v41) v1 ==== 107+0+4633 (secure 0 0 0) 0x7fcdd4023020 con 0x7fcdec0f5ca0 2024-02-15T18:40:44.810 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:44.810 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:35:56.905772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcdd8060f20 msgr2=0x7fcdd80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcdd8060f20 0x7fcdd80633e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fcddc007f80 tx=0x7fcddc00b040).stop 2024-02-15T18:40:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 msgr2=0x7fcdec0f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 0x7fcdec0f7a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fcdd4000c00 tx=0x7fcdd400b040).stop 2024-02-15T18:40:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 shutdown_connections 2024-02-15T18:40:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fcdd8060f20 0x7fcdd80633e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcdec0f5390 0x7fcdec0f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 --2- 172.21.15.33:0/4210039822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdec0f5ca0 0x7fcdec0f7a10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 >> 172.21.15.33:0/4210039822 conn(0x7fcdec0f0b70 msgr2=0x7fcdec05fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:44.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 shutdown_connections 2024-02-15T18:40:44.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.823+0000 7fcdf0c23700 1 -- 172.21.15.33:0/4210039822 wait complete. 2024-02-15T18:40:44.813 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-02-15T18:40:44.823 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-02-15T18:40:44.824 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-15T18:40:44.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.956+0000 7f06c06a9700 1 -- 172.21.15.33:0/1854546406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 msgr2=0x7f06b80f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.956+0000 7f06c06a9700 1 --2- 172.21.15.33:0/1854546406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 0x7f06b80f66d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f06a8004660 tx=0x7f06a8009b30).stop 2024-02-15T18:40:44.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.956+0000 7f06c06a9700 1 -- 172.21.15.33:0/1854546406 shutdown_connections 2024-02-15T18:40:44.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.956+0000 7f06c06a9700 1 --2- 172.21.15.33:0/1854546406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 0x7f06b80f66d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.956+0000 7f06c06a9700 1 --2- 172.21.15.33:0/1854546406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06b80f5390 0x7f06b80f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:44.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.956+0000 7f06c06a9700 1 -- 172.21.15.33:0/1854546406 >> 172.21.15.33:0/1854546406 conn(0x7f06b80f0b70 msgr2=0x7f06b80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:44.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.956+0000 7f06c06a9700 1 -- 172.21.15.33:0/1854546406 shutdown_connections 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.956+0000 7f06c06a9700 1 -- 172.21.15.33:0/1854546406 wait complete. 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.957+0000 7f06c06a9700 1 Processor -- start 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.957+0000 7f06c06a9700 1 -- start start 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.957+0000 7f06c06a9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06b80f5390 0x7f06b8106cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.957+0000 7f06c06a9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 0x7f06b81071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.957+0000 7f06c06a9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b81077c0 con 0x7f06b80f5ca0 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.957+0000 7f06c06a9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8107900 con 0x7f06b80f5390 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.957+0000 7f06bdc44700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 0x7f06b81071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.957+0000 7f06bdc44700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 0x7f06b81071c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48208/0 (socket says 172.21.15.33:48208) 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.957+0000 7f06bdc44700 1 -- 172.21.15.33:0/3538873764 learned_addr learned my addr 172.21.15.33:0/3538873764 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.958+0000 7f06bdc44700 1 -- 172.21.15.33:0/3538873764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06b80f5390 msgr2=0x7f06b8106cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.958+0000 7f06bdc44700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06b80f5390 0x7f06b8106cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.958+0000 7f06bdc44700 1 -- 172.21.15.33:0/3538873764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8005040 con 0x7f06b80f5ca0 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.958+0000 7f06bdc44700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 0x7f06b81071c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f06a8009f50 tx=0x7f06a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.958+0000 7f06aeffd700 1 -- 172.21.15.33:0/3538873764 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a8018070 con 0x7f06b80f5ca0 2024-02-15T18:40:44.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.958+0000 7f06aeffd700 1 -- 172.21.15.33:0/3538873764 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f06a8007d70 con 0x7f06b80f5ca0 2024-02-15T18:40:44.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.958+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b810c2b0 con 0x7f06b80f5ca0 2024-02-15T18:40:44.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.958+0000 7f06aeffd700 1 -- 172.21.15.33:0/3538873764 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a801c620 con 0x7f06b80f5ca0 2024-02-15T18:40:44.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.958+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b810c810 con 0x7f06b80f5ca0 2024-02-15T18:40:44.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.959+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b80fdc90 con 0x7f06b80f5ca0 2024-02-15T18:40:44.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.959+0000 7f06aeffd700 1 -- 172.21.15.33:0/3538873764 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f06a801c8e0 con 0x7f06b80f5ca0 2024-02-15T18:40:44.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.960+0000 7f06aeffd700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f06a4060f20 0x7f06a40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:44.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.960+0000 7f06aeffd700 1 -- 172.21.15.33:0/3538873764 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f06a807e0c0 con 0x7f06b80f5ca0 2024-02-15T18:40:44.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.960+0000 7f06be445700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f06a4060f20 0x7f06a40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:44.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.960+0000 7f06be445700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f06a4060f20 0x7f06a40633e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f06b81081c0 tx=0x7f06b4007a40).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:44.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:44.964+0000 7f06aeffd700 1 -- 172.21.15.33:0/3538873764 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f06a804e4f0 con 0x7f06b80f5ca0 2024-02-15T18:40:45.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.178+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f06b810d250 con 0x7f06b80f5ca0 2024-02-15T18:40:45.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.179+0000 7f06aeffd700 1 -- 172.21.15.33:0/3538873764 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v41) v1 ==== 107+0+4634 (secure 0 0 0) 0x7f06a8051b10 con 0x7f06b80f5ca0 2024-02-15T18:40:45.168 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:45.168 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:36:06.605483+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":24255,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi131.bgnwzs","rank":1,"incarnation":8,"state":"up:stopping","state_seq":2,"addr":"172.21.15.131:6827/3549169411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3549169411},{"type":"v1","addr":"172.21.15.131:6827","nonce":3549169411}]},"join_fscid":1,"export_targets":[0],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:45.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.180+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f06a4060f20 msgr2=0x7f06a40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.180+0000 7f06c06a9700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f06a4060f20 0x7f06a40633e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f06b81081c0 tx=0x7f06b4007a40).stop 2024-02-15T18:40:45.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.180+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 msgr2=0x7f06b81071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.180+0000 7f06c06a9700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 0x7f06b81071c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f06a8009f50 tx=0x7f06a8009b30).stop 2024-02-15T18:40:45.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.180+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 shutdown_connections 2024-02-15T18:40:45.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.180+0000 7f06c06a9700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f06a4060f20 0x7f06a40633e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.180+0000 7f06c06a9700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06b80f5390 0x7f06b8106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:45.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.180+0000 7f06c06a9700 1 --2- 172.21.15.33:0/3538873764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06b80f5ca0 0x7f06b81071c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.181+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 >> 172.21.15.33:0/3538873764 conn(0x7f06b80f0b70 msgr2=0x7f06b805f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:45.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.181+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 shutdown_connections 2024-02-15T18:40:45.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.181+0000 7f06c06a9700 1 -- 172.21.15.33:0/3538873764 wait complete. 2024-02-15T18:40:45.171 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2024-02-15T18:40:45.182 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-02-15T18:40:45.182 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-15T18:40:45.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.314+0000 7fb35e2bc700 1 -- 172.21.15.33:0/1669515121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 msgr2=0x7fb3580fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.314+0000 7fb35e2bc700 1 --2- 172.21.15.33:0/1669515121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 0x7fb3580fb9f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fb34c004660 tx=0x7fb34c009b30).stop 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.314+0000 7fb35e2bc700 1 -- 172.21.15.33:0/1669515121 shutdown_connections 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.314+0000 7fb35e2bc700 1 --2- 172.21.15.33:0/1669515121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 0x7fb3580fb9f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.314+0000 7fb35e2bc700 1 --2- 172.21.15.33:0/1669515121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb35805fe30 0x7fb3580f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.314+0000 7fb35e2bc700 1 -- 172.21.15.33:0/1669515121 >> 172.21.15.33:0/1669515121 conn(0x7fb3580f0b70 msgr2=0x7fb3580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.315+0000 7fb35e2bc700 1 -- 172.21.15.33:0/1669515121 shutdown_connections 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.315+0000 7fb35e2bc700 1 -- 172.21.15.33:0/1669515121 wait complete. 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.315+0000 7fb35e2bc700 1 Processor -- start 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.315+0000 7fb35e2bc700 1 -- start start 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.315+0000 7fb35e2bc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb35805fe30 0x7fb358106cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.315+0000 7fb35e2bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 0x7fb3581071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:45.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.315+0000 7fb35e2bc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581077c0 con 0x7fb3580f9600 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.315+0000 7fb35e2bc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb358107900 con 0x7fb35805fe30 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb3577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 0x7fb3581071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb3577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 0x7fb3581071c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48230/0 (socket says 172.21.15.33:48230) 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb3577fe700 1 -- 172.21.15.33:0/717711324 learned_addr learned my addr 172.21.15.33:0/717711324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb357fff700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb35805fe30 0x7fb358106cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb3577fe700 1 -- 172.21.15.33:0/717711324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb35805fe30 msgr2=0x7fb358106cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb3577fe700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb35805fe30 0x7fb358106cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb3577fe700 1 -- 172.21.15.33:0/717711324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c005040 con 0x7fb3580f9600 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb357fff700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb35805fe30 0x7fb358106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb3577fe700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 0x7fb3581071c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fb34c013fb0 tx=0x7fb34c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb354ff9700 1 -- 172.21.15.33:0/717711324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34c018070 con 0x7fb3580f9600 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb354ff9700 1 -- 172.21.15.33:0/717711324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fb34c0097d0 con 0x7fb3580f9600 2024-02-15T18:40:45.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35810c2b0 con 0x7fb3580f9600 2024-02-15T18:40:45.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb354ff9700 1 -- 172.21.15.33:0/717711324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34c01c7c0 con 0x7fb3580f9600 2024-02-15T18:40:45.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.316+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35810c810 con 0x7fb3580f9600 2024-02-15T18:40:45.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.317+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb358027a00 con 0x7fb3580f9600 2024-02-15T18:40:45.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.317+0000 7fb354ff9700 1 -- 172.21.15.33:0/717711324 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fb34c01c980 con 0x7fb3580f9600 2024-02-15T18:40:45.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.318+0000 7fb354ff9700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb340060f20 0x7fb3400633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:45.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.318+0000 7fb354ff9700 1 -- 172.21.15.33:0/717711324 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb34c07e100 con 0x7fb3580f9600 2024-02-15T18:40:45.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.318+0000 7fb357fff700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb340060f20 0x7fb3400633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:45.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.318+0000 7fb357fff700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb340060f20 0x7fb3400633e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb3581081c0 tx=0x7fb348009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:45.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.322+0000 7fb354ff9700 1 -- 172.21.15.33:0/717711324 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb34c04e530 con 0x7fb3580f9600 2024-02-15T18:40:45.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:44.460462+0000 mon.smithi033 (mon.0) 805 : audit [DBG] from='client.? 172.21.15.33:0/3414498836' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-15T18:40:45.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:44.821317+0000 mon.smithi033 (mon.0) 806 : audit [DBG] from='client.? 172.21.15.33:0/4210039822' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-15T18:40:45.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:45 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:45.179321+0000 mon.smithi033 (mon.0) 807 : audit [DBG] from='client.? 172.21.15.33:0/3538873764' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-15T18:40:45.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.541+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fb3580fed70 con 0x7fb3580f9600 2024-02-15T18:40:45.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.541+0000 7fb354ff9700 1 -- 172.21.15.33:0/717711324 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v41) v1 ==== 107+0+3835 (secure 0 0 0) 0x7fb34c051b50 con 0x7fb3580f9600 2024-02-15T18:40:45.530 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:45.530 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:36:31.592839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:45.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb340060f20 msgr2=0x7fb3400633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb340060f20 0x7fb3400633e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb3581081c0 tx=0x7fb348009040).stop 2024-02-15T18:40:45.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 msgr2=0x7fb3581071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 0x7fb3581071c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fb34c013fb0 tx=0x7fb34c009b30).stop 2024-02-15T18:40:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 shutdown_connections 2024-02-15T18:40:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb340060f20 0x7fb3400633e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb35805fe30 0x7fb358106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 --2- 172.21.15.33:0/717711324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3580f9600 0x7fb3581071c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 >> 172.21.15.33:0/717711324 conn(0x7fb3580f0b70 msgr2=0x7fb3580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 shutdown_connections 2024-02-15T18:40:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.543+0000 7fb35e2bc700 1 -- 172.21.15.33:0/717711324 wait complete. 2024-02-15T18:40:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 25 2024-02-15T18:40:45.543 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:44.460462+0000 mon.smithi033 (mon.0) 805 : audit [DBG] from='client.? 172.21.15.33:0/3414498836' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-15T18:40:45.543 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:44.821317+0000 mon.smithi033 (mon.0) 806 : audit [DBG] from='client.? 172.21.15.33:0/4210039822' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-15T18:40:45.543 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:45 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:45.179321+0000 mon.smithi033 (mon.0) 807 : audit [DBG] from='client.? 172.21.15.33:0/3538873764' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-15T18:40:45.544 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-02-15T18:40:45.545 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-15T18:40:45.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 -- 172.21.15.33:0/1325868401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 msgr2=0x7f93a40f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 --2- 172.21.15.33:0/1325868401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 0x7f93a40f66d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9394004660 tx=0x7f9394009b30).stop 2024-02-15T18:40:45.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 -- 172.21.15.33:0/1325868401 shutdown_connections 2024-02-15T18:40:45.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 --2- 172.21.15.33:0/1325868401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 0x7f93a40f66d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 --2- 172.21.15.33:0/1325868401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a40f5390 0x7f93a40f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 -- 172.21.15.33:0/1325868401 >> 172.21.15.33:0/1325868401 conn(0x7f93a40f0b70 msgr2=0x7f93a40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:45.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 -- 172.21.15.33:0/1325868401 shutdown_connections 2024-02-15T18:40:45.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 -- 172.21.15.33:0/1325868401 wait complete. 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 Processor -- start 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.677+0000 7f93a9296700 1 -- start start 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a9296700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a40f5390 0x7f93a4105c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a9296700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 0x7f93a41060f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a9296700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a41066f0 con 0x7f93a40f5ca0 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a9296700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4106830 con 0x7f93a40f5390 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 0x7f93a41060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 0x7f93a41060f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42758/0 (socket says 172.21.15.33:42758) 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a27fc700 1 -- 172.21.15.33:0/30408320 learned_addr learned my addr 172.21.15.33:0/30408320 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a2ffd700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a40f5390 0x7f93a4105c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a27fc700 1 -- 172.21.15.33:0/30408320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a40f5390 msgr2=0x7f93a4105c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a27fc700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a40f5390 0x7f93a4105c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a27fc700 1 -- 172.21.15.33:0/30408320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9394005040 con 0x7f93a40f5ca0 2024-02-15T18:40:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a27fc700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 0x7f93a41060f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9394009f50 tx=0x7f9394009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f938b7fe700 1 -- 172.21.15.33:0/30408320 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9394018070 con 0x7f93a40f5ca0 2024-02-15T18:40:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a410b1e0 con 0x7f93a40f5ca0 2024-02-15T18:40:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f938b7fe700 1 -- 172.21.15.33:0/30408320 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f9394007ba0 con 0x7f93a40f5ca0 2024-02-15T18:40:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f938b7fe700 1 -- 172.21.15.33:0/30408320 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f939401c620 con 0x7f93a40f5ca0 2024-02-15T18:40:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.678+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a410b740 con 0x7f93a40f5ca0 2024-02-15T18:40:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.679+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a4027a00 con 0x7f93a40f5ca0 2024-02-15T18:40:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.680+0000 7f938b7fe700 1 -- 172.21.15.33:0/30408320 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f939401c890 con 0x7f93a40f5ca0 2024-02-15T18:40:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.680+0000 7f938b7fe700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f938c060f20 0x7f938c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.681+0000 7f938b7fe700 1 -- 172.21.15.33:0/30408320 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f939407e3b0 con 0x7f93a40f5ca0 2024-02-15T18:40:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.681+0000 7f93a2ffd700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f938c060f20 0x7f938c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.681+0000 7f93a2ffd700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f938c060f20 0x7f938c0633e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f93a41070f0 tx=0x7f9398009be0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.684+0000 7f938b7fe700 1 -- 172.21.15.33:0/30408320 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f939404e780 con 0x7f93a40f5ca0 2024-02-15T18:40:45.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.899+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f93a40fdc90 con 0x7f93a40f5ca0 2024-02-15T18:40:45.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.899+0000 7f938b7fe700 1 -- 172.21.15.33:0/30408320 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v41) v1 ==== 107+0+4614 (secure 0 0 0) 0x7f9394051da0 con 0x7f93a40f5ca0 2024-02-15T18:40:45.888 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:45.888 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14486,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.33:6827/737113278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":737113278},{"type":"v1","addr":"172.21.15.33:6827","nonce":737113278}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:36:31.592839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.901+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f938c060f20 msgr2=0x7f938c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.901+0000 7f93a9296700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f938c060f20 0x7f938c0633e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f93a41070f0 tx=0x7f9398009be0).stop 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.901+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 msgr2=0x7f93a41060f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.901+0000 7f93a9296700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 0x7f93a41060f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9394009f50 tx=0x7f9394009b30).stop 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.901+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 shutdown_connections 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.901+0000 7f93a9296700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f938c060f20 0x7f938c0633e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.901+0000 7f93a9296700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93a40f5390 0x7f93a4105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.901+0000 7f93a9296700 1 --2- 172.21.15.33:0/30408320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93a40f5ca0 0x7f93a41060f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.901+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 >> 172.21.15.33:0/30408320 conn(0x7f93a40f0b70 msgr2=0x7f93a40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.902+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 shutdown_connections 2024-02-15T18:40:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:45.902+0000 7f93a9296700 1 -- 172.21.15.33:0/30408320 wait complete. 2024-02-15T18:40:45.892 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 26 2024-02-15T18:40:45.902 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-02-15T18:40:45.903 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-15T18:40:46.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.034+0000 7fc5ae946700 1 -- 172.21.15.33:0/3454462707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 msgr2=0x7fc5a80f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.034+0000 7fc5ae946700 1 --2- 172.21.15.33:0/3454462707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 0x7fc5a80f66d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fc59c004660 tx=0x7fc59c009b30).stop 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.034+0000 7fc5ae946700 1 -- 172.21.15.33:0/3454462707 shutdown_connections 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.034+0000 7fc5ae946700 1 --2- 172.21.15.33:0/3454462707 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 0x7fc5a80f66d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.034+0000 7fc5ae946700 1 --2- 172.21.15.33:0/3454462707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a80f5390 0x7fc5a80f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.034+0000 7fc5ae946700 1 -- 172.21.15.33:0/3454462707 >> 172.21.15.33:0/3454462707 conn(0x7fc5a80f0b70 msgr2=0x7fc5a80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.034+0000 7fc5ae946700 1 -- 172.21.15.33:0/3454462707 shutdown_connections 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.034+0000 7fc5ae946700 1 -- 172.21.15.33:0/3454462707 wait complete. 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.035+0000 7fc5ae946700 1 Processor -- start 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.035+0000 7fc5ae946700 1 -- start start 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5ae946700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a80f5390 0x7fc5a8105c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5ae946700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 0x7fc5a8106100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5ae946700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8106790 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5ae946700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a810b190 con 0x7fc5a80f5390 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 0x7fc5a8106100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 0x7fc5a8106100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42786/0 (socket says 172.21.15.33:42786) 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1382499540 learned_addr learned my addr 172.21.15.33:0/1382499540 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a7fff700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a80f5390 0x7fc5a8105c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1382499540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a80f5390 msgr2=0x7fc5a8105c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a77fe700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a80f5390 0x7fc5a8105c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a77fe700 1 -- 172.21.15.33:0/1382499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c005040 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a7fff700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a80f5390 0x7fc5a8105c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a77fe700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 0x7fc5a8106100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fc59c009830 tx=0x7fc59c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a4ff9700 1 -- 172.21.15.33:0/1382499540 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc59c01a070 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a4ff9700 1 -- 172.21.15.33:0/1382499540 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fc59c012ac0 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a805f1e0 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5a4ff9700 1 -- 172.21.15.33:0/1382499540 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc59c01faf0 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.036+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a805f6c0 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.037+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a8046330 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.038+0000 7fc5a4ff9700 1 -- 172.21.15.33:0/1382499540 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fc59c012c30 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.038+0000 7fc5a4ff9700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc590060f10 0x7fc5900633d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:46.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.038+0000 7fc5a4ff9700 1 -- 172.21.15.33:0/1382499540 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fc59c080500 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.038+0000 7fc5a7fff700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc590060f10 0x7fc5900633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:46.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.039+0000 7fc5a7fff700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc590060f10 0x7fc5900633d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fc5a8107100 tx=0x7fc598008040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:46.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.042+0000 7fc5a4ff9700 1 -- 172.21.15.33:0/1382499540 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc59c0508d0 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.265+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fc5a80ffca0 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.265+0000 7fc5a4ff9700 1 -- 172.21.15.33:0/1382499540 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v41) v1 ==== 107+0+3838 (secure 0 0 0) 0x7fc59c026300 con 0x7fc5a80f5ca0 2024-02-15T18:40:46.255 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:46.255 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:36:31.592839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc590060f10 msgr2=0x7fc5900633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc590060f10 0x7fc5900633d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fc5a8107100 tx=0x7fc598008040).stop 2024-02-15T18:40:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 msgr2=0x7fc5a8106100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 0x7fc5a8106100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fc59c009830 tx=0x7fc59c009b30).stop 2024-02-15T18:40:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 shutdown_connections 2024-02-15T18:40:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fc590060f10 0x7fc5900633d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5a80f5390 0x7fc5a8105c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 --2- 172.21.15.33:0/1382499540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5a80f5ca0 0x7fc5a8106100 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 >> 172.21.15.33:0/1382499540 conn(0x7fc5a80f0b70 msgr2=0x7fc5a80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 shutdown_connections 2024-02-15T18:40:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.269+0000 7fc5ae946700 1 -- 172.21.15.33:0/1382499540 wait complete. 2024-02-15T18:40:46.259 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-02-15T18:40:46.271 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-02-15T18:40:46.271 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-15T18:40:46.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.411+0000 7f55dd971700 1 -- 172.21.15.33:0/4069975970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d80f9660 msgr2=0x7f55d80fba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.411+0000 7f55dd971700 1 --2- 172.21.15.33:0/4069975970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d80f9660 0x7f55d80fba50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f55cc004660 tx=0x7f55cc009b30).stop 2024-02-15T18:40:46.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.411+0000 7f55dd971700 1 -- 172.21.15.33:0/4069975970 shutdown_connections 2024-02-15T18:40:46.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.411+0000 7f55dd971700 1 --2- 172.21.15.33:0/4069975970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d80f9660 0x7f55d80fba50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.411+0000 7f55dd971700 1 --2- 172.21.15.33:0/4069975970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d805fdd0 0x7f55d80f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.411+0000 7f55dd971700 1 -- 172.21.15.33:0/4069975970 >> 172.21.15.33:0/4069975970 conn(0x7f55d80f0b70 msgr2=0x7f55d80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.411+0000 7f55dd971700 1 -- 172.21.15.33:0/4069975970 shutdown_connections 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.411+0000 7f55dd971700 1 -- 172.21.15.33:0/4069975970 wait complete. 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55dd971700 1 Processor -- start 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55dd971700 1 -- start start 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55dd971700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d805fdd0 0x7f55d8106ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55dd971700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d80f9660 0x7f55d8107190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55dd971700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d8107790 con 0x7f55d805fdd0 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55dd971700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d8107900 con 0x7f55d80f9660 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d805fdd0 0x7f55d8106ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d805fdd0 0x7f55d8106ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42810/0 (socket says 172.21.15.33:42810) 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55d6ffd700 1 -- 172.21.15.33:0/2395457033 learned_addr learned my addr 172.21.15.33:0/2395457033 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:46.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55d67fc700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d80f9660 0x7f55d8107190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55d6ffd700 1 -- 172.21.15.33:0/2395457033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d80f9660 msgr2=0x7f55d8107190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55d6ffd700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d80f9660 0x7f55d8107190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.412+0000 7f55d6ffd700 1 -- 172.21.15.33:0/2395457033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc005040 con 0x7f55d805fdd0 2024-02-15T18:40:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.413+0000 7f55d6ffd700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d805fdd0 0x7f55d8106ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f55c800e7c0 tx=0x7f55c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.413+0000 7f55bf7fe700 1 -- 172.21.15.33:0/2395457033 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c80092e0 con 0x7f55d805fdd0 2024-02-15T18:40:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.413+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d810c370 con 0x7f55d805fdd0 2024-02-15T18:40:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.413+0000 7f55bf7fe700 1 -- 172.21.15.33:0/2395457033 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f55c800f040 con 0x7f55d805fdd0 2024-02-15T18:40:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.413+0000 7f55bf7fe700 1 -- 172.21.15.33:0/2395457033 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c80149f0 con 0x7f55d805fdd0 2024-02-15T18:40:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.413+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d810c900 con 0x7f55d805fdd0 2024-02-15T18:40:46.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.414+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d8046330 con 0x7f55d805fdd0 2024-02-15T18:40:46.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.414+0000 7f55bf7fe700 1 -- 172.21.15.33:0/2395457033 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f55c8014c30 con 0x7f55d805fdd0 2024-02-15T18:40:46.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.415+0000 7f55bf7fe700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f55c0060f20 0x7f55c00633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.415+0000 7f55bf7fe700 1 -- 172.21.15.33:0/2395457033 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f55c807c1e0 con 0x7f55d805fdd0 2024-02-15T18:40:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.415+0000 7f55d67fc700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f55c0060f20 0x7f55c00633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.415+0000 7f55d67fc700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f55c0060f20 0x7f55c00633e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f55cc009720 tx=0x7f55cc016040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.419+0000 7f55bf7fe700 1 -- 172.21.15.33:0/2395457033 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f55c804c610 con 0x7f55d805fdd0 2024-02-15T18:40:46.494 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:45.542015+0000 mon.smithi033 (mon.0) 808 : audit [DBG] from='client.? 172.21.15.33:0/717711324' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-15T18:40:46.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:45.584495+0000 mgr.smithi033.apxevf (mgr.14626) 458 : cluster [DBG] pgmap v318: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:46.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:45.900087+0000 mon.smithi033 (mon.0) 809 : audit [DBG] from='client.? 172.21.15.33:0/30408320' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-15T18:40:46.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:46 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:46.096578+0000 mon.smithi033 (mon.0) 810 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:40:46.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:45.542015+0000 mon.smithi033 (mon.0) 808 : audit [DBG] from='client.? 172.21.15.33:0/717711324' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-15T18:40:46.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:45.584495+0000 mgr.smithi033.apxevf (mgr.14626) 458 : cluster [DBG] pgmap v318: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:46.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:45.900087+0000 mon.smithi033 (mon.0) 809 : audit [DBG] from='client.? 172.21.15.33:0/30408320' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-15T18:40:46.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:46 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:46.096578+0000 mon.smithi033 (mon.0) 810 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-15T18:40:46.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.637+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f55d8058780 con 0x7f55d805fdd0 2024-02-15T18:40:46.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.638+0000 7f55bf7fe700 1 -- 172.21.15.33:0/2395457033 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v41) v1 ==== 107+0+4617 (secure 0 0 0) 0x7f55c804fc30 con 0x7f55d805fdd0 2024-02-15T18:40:46.627 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:46.627 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14446,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/1297796613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1297796613},{"type":"v1","addr":"172.21.15.33:6829","nonce":1297796613}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:36:31.592839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f55c0060f20 msgr2=0x7f55c00633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f55c0060f20 0x7f55c00633e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f55cc009720 tx=0x7f55cc016040).stop 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d805fdd0 msgr2=0x7f55d8106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d805fdd0 0x7f55d8106ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f55c800e7c0 tx=0x7f55c800b040).stop 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 shutdown_connections 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f55c0060f20 0x7f55c00633e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55d805fdd0 0x7f55d8106ca0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 --2- 172.21.15.33:0/2395457033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d80f9660 0x7f55d8107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 >> 172.21.15.33:0/2395457033 conn(0x7f55d80f0b70 msgr2=0x7f55d80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 shutdown_connections 2024-02-15T18:40:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.640+0000 7f55dd971700 1 -- 172.21.15.33:0/2395457033 wait complete. 2024-02-15T18:40:46.630 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-02-15T18:40:46.641 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-02-15T18:40:46.641 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-15T18:40:46.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.774+0000 7f2417eaa700 1 -- 172.21.15.33:0/4134890178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 msgr2=0x7f24100f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.774+0000 7f2417eaa700 1 --2- 172.21.15.33:0/4134890178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 0x7f24100f57b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f240c004660 tx=0x7f240c009b30).stop 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.774+0000 7f2417eaa700 1 -- 172.21.15.33:0/4134890178 shutdown_connections 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.774+0000 7f2417eaa700 1 --2- 172.21.15.33:0/4134890178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24100f5ca0 0x7f24100f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.774+0000 7f2417eaa700 1 --2- 172.21.15.33:0/4134890178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 0x7f24100f57b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.774+0000 7f2417eaa700 1 -- 172.21.15.33:0/4134890178 >> 172.21.15.33:0/4134890178 conn(0x7f24100f0b70 msgr2=0x7f24100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.774+0000 7f2417eaa700 1 -- 172.21.15.33:0/4134890178 shutdown_connections 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.774+0000 7f2417eaa700 1 -- 172.21.15.33:0/4134890178 wait complete. 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2417eaa700 1 Processor -- start 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2417eaa700 1 -- start start 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2417eaa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 0x7f241005fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2417eaa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24100f5ca0 0x7f241010baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2417eaa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241010bf90 con 0x7f24100f5390 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2417eaa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241010c0d0 con 0x7f24100f5ca0 2024-02-15T18:40:46.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2415c46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 0x7f241005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2415c46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 0x7f241005fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42836/0 (socket says 172.21.15.33:42836) 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2415c46700 1 -- 172.21.15.33:0/2504711131 learned_addr learned my addr 172.21.15.33:0/2504711131 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.775+0000 7f2415445700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24100f5ca0 0x7f241010baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.776+0000 7f2415c46700 1 -- 172.21.15.33:0/2504711131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24100f5ca0 msgr2=0x7f241010baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.776+0000 7f2415c46700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24100f5ca0 0x7f241010baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.776+0000 7f2415c46700 1 -- 172.21.15.33:0/2504711131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c005040 con 0x7f24100f5390 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.776+0000 7f2415c46700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 0x7f241005fcb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f240c009830 tx=0x7f240c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.776+0000 7f24067fc700 1 -- 172.21.15.33:0/2504711131 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240c018070 con 0x7f24100f5390 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.776+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241010c2d0 con 0x7f24100f5390 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.776+0000 7f24067fc700 1 -- 172.21.15.33:0/2504711131 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f240c007ba0 con 0x7f24100f5390 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.776+0000 7f24067fc700 1 -- 172.21.15.33:0/2504711131 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240c01c620 con 0x7f24100f5390 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.776+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241010c830 con 0x7f24100f5390 2024-02-15T18:40:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.777+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2410027a00 con 0x7f24100f5390 2024-02-15T18:40:46.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.777+0000 7f24067fc700 1 -- 172.21.15.33:0/2504711131 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f240c01c890 con 0x7f24100f5390 2024-02-15T18:40:46.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.778+0000 7f24067fc700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23fc060f20 0x7f23fc0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:46.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.778+0000 7f24067fc700 1 -- 172.21.15.33:0/2504711131 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f240c07dfe0 con 0x7f24100f5390 2024-02-15T18:40:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.778+0000 7f2415445700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23fc060f20 0x7f23fc0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.778+0000 7f2415445700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23fc060f20 0x7f23fc0633e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f24000096c0 tx=0x7f2400009be0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:46.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.782+0000 7f24067fc700 1 -- 172.21.15.33:0/2504711131 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f240c051da0 con 0x7f24100f5390 2024-02-15T18:40:46.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.994+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f24100586e0 con 0x7f24100f5390 2024-02-15T18:40:46.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.994+0000 7f24067fc700 1 -- 172.21.15.33:0/2504711131 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v41) v1 ==== 107+0+3838 (secure 0 0 0) 0x7f240c051990 con 0x7f24100f5390 2024-02-15T18:40:46.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:46.984 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:36:31.592839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23fc060f20 msgr2=0x7f23fc0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23fc060f20 0x7f23fc0633e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f24000096c0 tx=0x7f2400009be0).stop 2024-02-15T18:40:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 msgr2=0x7f241005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 0x7f241005fcb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f240c009830 tx=0x7f240c009b30).stop 2024-02-15T18:40:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 shutdown_connections 2024-02-15T18:40:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23fc060f20 0x7f23fc0633e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24100f5390 0x7f241005fcb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 --2- 172.21.15.33:0/2504711131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24100f5ca0 0x7f241010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 >> 172.21.15.33:0/2504711131 conn(0x7f24100f0b70 msgr2=0x7f24100fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 shutdown_connections 2024-02-15T18:40:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:46.996+0000 7f2417eaa700 1 -- 172.21.15.33:0/2504711131 wait complete. 2024-02-15T18:40:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 29 2024-02-15T18:40:46.997 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-02-15T18:40:46.998 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 -- 172.21.15.33:0/1818017221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f7730 msgr2=0x7fb31c0f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 --2- 172.21.15.33:0/1818017221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f7730 0x7fb31c0f7b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb318004660 tx=0x7fb318009b30).stop 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 -- 172.21.15.33:0/1818017221 shutdown_connections 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 --2- 172.21.15.33:0/1818017221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f7730 0x7fb31c0f7b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 --2- 172.21.15.33:0/1818017221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb31c0f6490 0x7fb31c0f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 -- 172.21.15.33:0/1818017221 >> 172.21.15.33:0/1818017221 conn(0x7fb31c0f1bd0 msgr2=0x7fb31c0f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 -- 172.21.15.33:0/1818017221 shutdown_connections 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 -- 172.21.15.33:0/1818017221 wait complete. 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 Processor -- start 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 -- start start 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f6490 0x7fb31c06b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb31c0f7730 0x7fb31c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c06bd70 con 0x7fb31c0f6490 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.130+0000 7fb3244cc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c06a310 con 0x7fb31c0f7730 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb322268700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f6490 0x7fb31c06b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb322268700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f6490 0x7fb31c06b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42854/0 (socket says 172.21.15.33:42854) 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb322268700 1 -- 172.21.15.33:0/3641582721 learned_addr learned my addr 172.21.15.33:0/3641582721 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb321a67700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb31c0f7730 0x7fb31c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb322268700 1 -- 172.21.15.33:0/3641582721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb31c0f7730 msgr2=0x7fb31c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb322268700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb31c0f7730 0x7fb31c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb322268700 1 -- 172.21.15.33:0/3641582721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318005040 con 0x7fb31c0f6490 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb321a67700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb31c0f7730 0x7fb31c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb322268700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f6490 0x7fb31c06b7c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fb30c002700 tx=0x7fb30c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb312ffd700 1 -- 172.21.15.33:0/3641582721 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb30c009320 con 0x7fb31c0f6490 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb312ffd700 1 -- 172.21.15.33:0/3641582721 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fb30c00f040 con 0x7fb31c0f6490 2024-02-15T18:40:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c06a590 con 0x7fb31c0f6490 2024-02-15T18:40:47.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb312ffd700 1 -- 172.21.15.33:0/3641582721 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb30c0149b0 con 0x7fb31c0f6490 2024-02-15T18:40:47.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.131+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c06aad0 con 0x7fb31c0f6490 2024-02-15T18:40:47.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.132+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c046330 con 0x7fb31c0f6490 2024-02-15T18:40:47.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.132+0000 7fb312ffd700 1 -- 172.21.15.33:0/3641582721 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fb30c009480 con 0x7fb31c0f6490 2024-02-15T18:40:47.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.133+0000 7fb312ffd700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb308060f70 0x7fb308063430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:47.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.133+0000 7fb312ffd700 1 -- 172.21.15.33:0/3641582721 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb30c07c470 con 0x7fb31c0f6490 2024-02-15T18:40:47.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.133+0000 7fb321a67700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb308060f70 0x7fb308063430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:47.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.133+0000 7fb321a67700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb308060f70 0x7fb308063430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb318005010 tx=0x7fb318009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:47.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.137+0000 7fb312ffd700 1 -- 172.21.15.33:0/3641582721 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb30c050300 con 0x7fb31c0f6490 2024-02-15T18:40:47.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:46.266085+0000 mon.smithi033 (mon.0) 811 : audit [DBG] from='client.? 172.21.15.33:0/1382499540' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-15T18:40:47.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:46.419814+0000 mon.smithi033 (mon.0) 812 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:40:47.295 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:46.420506+0000 mon.smithi033 (mon.0) 813 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:40:47.295 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cephadm 2024-02-15T18:40:46.421051+0000 mgr.smithi033.apxevf (mgr.14626) 459 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:40:47.295 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:46.424435+0000 mon.smithi033 (mon.0) 814 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:40:47.295 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:46.638634+0000 mon.smithi033 (mon.0) 815 : audit [DBG] from='client.? 172.21.15.33:0/2395457033' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-15T18:40:47.295 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:47 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:46.995155+0000 mon.smithi033 (mon.0) 816 : audit [DBG] from='client.? 172.21.15.33:0/2504711131' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-15T18:40:47.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.352+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fb31c027a00 con 0x7fb31c0f6490 2024-02-15T18:40:47.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.353+0000 7fb312ffd700 1 -- 172.21.15.33:0/3641582721 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v41) v1 ==== 107+0+4617 (secure 0 0 0) 0x7fb30c04fef0 con 0x7fb31c0f6490 2024-02-15T18:40:47.342 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:47.342 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:36:31.592839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi131.ywlevz","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.131:6825/1245860707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":1245860707},{"type":"v1","addr":"172.21.15.131:6825","nonce":1245860707}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb308060f70 msgr2=0x7fb308063430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb308060f70 0x7fb308063430 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb318005010 tx=0x7fb318009b30).stop 2024-02-15T18:40:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f6490 msgr2=0x7fb31c06b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f6490 0x7fb31c06b7c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fb30c002700 tx=0x7fb30c009e00).stop 2024-02-15T18:40:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 shutdown_connections 2024-02-15T18:40:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fb308060f70 0x7fb308063430 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb31c0f6490 0x7fb31c06b7c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 --2- 172.21.15.33:0/3641582721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb31c0f7730 0x7fb31c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 >> 172.21.15.33:0/3641582721 conn(0x7fb31c0f1bd0 msgr2=0x7fb31c0fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 shutdown_connections 2024-02-15T18:40:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.355+0000 7fb3244cc700 1 -- 172.21.15.33:0/3641582721 wait complete. 2024-02-15T18:40:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2024-02-15T18:40:47.356 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-02-15T18:40:47.356 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-15T18:40:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.488+0000 7fa7cca1b700 1 -- 172.21.15.33:0/1280962236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 msgr2=0x7fa7c80f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.488+0000 7fa7cca1b700 1 --2- 172.21.15.33:0/1280962236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 0x7fa7c80f57b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fa7b0004660 tx=0x7fa7b0009b30).stop 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.488+0000 7fa7cca1b700 1 -- 172.21.15.33:0/1280962236 shutdown_connections 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.488+0000 7fa7cca1b700 1 --2- 172.21.15.33:0/1280962236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c80f5ca0 0x7fa7c80f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.488+0000 7fa7cca1b700 1 --2- 172.21.15.33:0/1280962236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 0x7fa7c80f57b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.488+0000 7fa7cca1b700 1 -- 172.21.15.33:0/1280962236 >> 172.21.15.33:0/1280962236 conn(0x7fa7c80f0b70 msgr2=0x7fa7c80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.488+0000 7fa7cca1b700 1 -- 172.21.15.33:0/1280962236 shutdown_connections 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.488+0000 7fa7cca1b700 1 -- 172.21.15.33:0/1280962236 wait complete. 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.488+0000 7fa7cca1b700 1 Processor -- start 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7cca1b700 1 -- start start 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7cca1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 0x7fa7c8105c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7cca1b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c80f5ca0 0x7fa7c8106150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7cca1b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c81067e0 con 0x7fa7c80f5390 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7cca1b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c810b1e0 con 0x7fa7c80f5ca0 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 0x7fa7c8105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 0x7fa7c8105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42874/0 (socket says 172.21.15.33:42874) 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7c659c700 1 -- 172.21.15.33:0/2953569047 learned_addr learned my addr 172.21.15.33:0/2953569047 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7c659c700 1 -- 172.21.15.33:0/2953569047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c80f5ca0 msgr2=0x7fa7c8106150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7c659c700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c80f5ca0 0x7fa7c8106150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7c659c700 1 -- 172.21.15.33:0/2953569047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0005040 con 0x7fa7c80f5390 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7c659c700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 0x7fa7c8105c60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa7b0013fb0 tx=0x7fa7b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7beffd700 1 -- 172.21.15.33:0/2953569047 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7b0018070 con 0x7fa7c80f5390 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7beffd700 1 -- 172.21.15.33:0/2953569047 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fa7b00097d0 con 0x7fa7c80f5390 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c810b320 con 0x7fa7c80f5390 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.489+0000 7fa7beffd700 1 -- 172.21.15.33:0/2953569047 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7b001c7c0 con 0x7fa7c80f5390 2024-02-15T18:40:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.490+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c810b7d0 con 0x7fa7c80f5390 2024-02-15T18:40:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.490+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c8027a00 con 0x7fa7c80f5390 2024-02-15T18:40:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.491+0000 7fa7beffd700 1 -- 172.21.15.33:0/2953569047 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa7b001c980 con 0x7fa7c80f5390 2024-02-15T18:40:47.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.491+0000 7fa7beffd700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa7b4060f20 0x7fa7b40633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:47.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.491+0000 7fa7beffd700 1 -- 172.21.15.33:0/2953569047 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa7b007e060 con 0x7fa7c80f5390 2024-02-15T18:40:47.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.491+0000 7fa7c5d9b700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa7b4060f20 0x7fa7b40633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:47.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.492+0000 7fa7c5d9b700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa7b4060f20 0x7fa7b40633e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa7b8009610 tx=0x7fa7b8006ab0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.495+0000 7fa7beffd700 1 -- 172.21.15.33:0/2953569047 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa7b004e510 con 0x7fa7c80f5390 2024-02-15T18:40:47.494 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:46.266085+0000 mon.smithi033 (mon.0) 811 : audit [DBG] from='client.? 172.21.15.33:0/1382499540' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-15T18:40:47.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:46.419814+0000 mon.smithi033 (mon.0) 812 : audit [DBG] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-15T18:40:47.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:46.420506+0000 mon.smithi033 (mon.0) 813 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-15T18:40:47.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cephadm 2024-02-15T18:40:46.421051+0000 mgr.smithi033.apxevf (mgr.14626) 459 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2024-02-15T18:40:47.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:46.424435+0000 mon.smithi033 (mon.0) 814 : audit [INF] from='mgr.14626 172.21.15.33:0/2146693817' entity='mgr.smithi033.apxevf' 2024-02-15T18:40:47.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:46.638634+0000 mon.smithi033 (mon.0) 815 : audit [DBG] from='client.? 172.21.15.33:0/2395457033' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-15T18:40:47.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:47 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:46.995155+0000 mon.smithi033 (mon.0) 816 : audit [DBG] from='client.? 172.21.15.33:0/2504711131' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-15T18:40:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.714+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fa7c8058710 con 0x7fa7c80f5390 2024-02-15T18:40:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.714+0000 7fa7beffd700 1 -- 172.21.15.33:0/2953569047 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v41) v1 ==== 107+0+3826 (secure 0 0 0) 0x7fa7b0051b30 con 0x7fa7c80f5390 2024-02-15T18:40:47.703 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:47.703 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:09.091867+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.716+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa7b4060f20 msgr2=0x7fa7b40633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.716+0000 7fa7cca1b700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa7b4060f20 0x7fa7b40633e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa7b8009610 tx=0x7fa7b8006ab0).stop 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.716+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 msgr2=0x7fa7c8105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.716+0000 7fa7cca1b700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 0x7fa7c8105c60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fa7b0013fb0 tx=0x7fa7b0009b30).stop 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.716+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 shutdown_connections 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.716+0000 7fa7cca1b700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa7b4060f20 0x7fa7b40633e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.716+0000 7fa7cca1b700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c80f5390 0x7fa7c8105c60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.717+0000 7fa7cca1b700 1 --2- 172.21.15.33:0/2953569047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7c80f5ca0 0x7fa7c8106150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.717+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 >> 172.21.15.33:0/2953569047 conn(0x7fa7c80f0b70 msgr2=0x7fa7c80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.717+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 shutdown_connections 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.717+0000 7fa7cca1b700 1 -- 172.21.15.33:0/2953569047 wait complete. 2024-02-15T18:40:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 31 2024-02-15T18:40:47.718 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-02-15T18:40:47.718 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-15T18:40:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.851+0000 7f417c6ab700 1 -- 172.21.15.33:0/2507563862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f64e0 msgr2=0x7f41740f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.851+0000 7f417c6ab700 1 --2- 172.21.15.33:0/2507563862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f64e0 0x7f41740f6900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f4170004660 tx=0x7f4170009b30).stop 2024-02-15T18:40:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.851+0000 7f417c6ab700 1 -- 172.21.15.33:0/2507563862 shutdown_connections 2024-02-15T18:40:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.851+0000 7f417c6ab700 1 --2- 172.21.15.33:0/2507563862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41740f7780 0x7f41740f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.851+0000 7f417c6ab700 1 --2- 172.21.15.33:0/2507563862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f64e0 0x7f41740f6900 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.851+0000 7f417c6ab700 1 -- 172.21.15.33:0/2507563862 >> 172.21.15.33:0/2507563862 conn(0x7f41740f1c40 msgr2=0x7f41740f4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.851+0000 7f417c6ab700 1 -- 172.21.15.33:0/2507563862 shutdown_connections 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.851+0000 7f417c6ab700 1 -- 172.21.15.33:0/2507563862 wait complete. 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.852+0000 7f417c6ab700 1 Processor -- start 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.852+0000 7f417c6ab700 1 -- start start 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.852+0000 7f417c6ab700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41740f64e0 0x7f4174106d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.852+0000 7f417c6ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f7780 0x7f4174107210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.852+0000 7f417c6ab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4174107810 con 0x7f41740f7780 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.852+0000 7f417c6ab700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4174107950 con 0x7f41740f64e0 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.852+0000 7f4179c46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f7780 0x7f4174107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.852+0000 7f4179c46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f7780 0x7f4174107210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42898/0 (socket says 172.21.15.33:42898) 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.852+0000 7f4179c46700 1 -- 172.21.15.33:0/2920408523 learned_addr learned my addr 172.21.15.33:0/2920408523 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f417a447700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41740f64e0 0x7f4174106d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f4179c46700 1 -- 172.21.15.33:0/2920408523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41740f64e0 msgr2=0x7f4174106d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f4179c46700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41740f64e0 0x7f4174106d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:47.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f4179c46700 1 -- 172.21.15.33:0/2920408523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170005040 con 0x7f41740f7780 2024-02-15T18:40:47.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f4179c46700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f7780 0x7f4174107210 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f416800c790 tx=0x7f4168007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:47.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f4166ffd700 1 -- 172.21.15.33:0/2920408523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4168002590 con 0x7f41740f7780 2024-02-15T18:40:47.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417410c360 con 0x7f41740f7780 2024-02-15T18:40:47.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f4166ffd700 1 -- 172.21.15.33:0/2920408523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f4168002be0 con 0x7f41740f7780 2024-02-15T18:40:47.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f4166ffd700 1 -- 172.21.15.33:0/2920408523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41680123b0 con 0x7f41740f7780 2024-02-15T18:40:47.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.853+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417410c920 con 0x7f41740f7780 2024-02-15T18:40:47.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.854+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4174027a00 con 0x7f41740f7780 2024-02-15T18:40:47.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.855+0000 7f4166ffd700 1 -- 172.21.15.33:0/2920408523 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f416801a060 con 0x7f41740f7780 2024-02-15T18:40:47.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.855+0000 7f4166ffd700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4160060f20 0x7f41600633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:47.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.855+0000 7f4166ffd700 1 -- 172.21.15.33:0/2920408523 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f416807c5a0 con 0x7f41740f7780 2024-02-15T18:40:47.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.855+0000 7f417a447700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4160060f20 0x7f41600633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:47.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.855+0000 7f417a447700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4160060f20 0x7f41600633e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4174108210 tx=0x7f4170009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:47.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:47.859+0000 7f4166ffd700 1 -- 172.21.15.33:0/2920408523 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f416804ca50 con 0x7f41740f7780 2024-02-15T18:40:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.073+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f41740fedb0 con 0x7f41740f7780 2024-02-15T18:40:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.073+0000 7f4166ffd700 1 -- 172.21.15.33:0/2920408523 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v41) v1 ==== 107+0+3837 (secure 0 0 0) 0x7f4168050070 con 0x7f41740f7780 2024-02-15T18:40:48.062 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:48.062 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:09.096049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34334},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4160060f20 msgr2=0x7f41600633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4160060f20 0x7f41600633e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4174108210 tx=0x7f4170009b30).stop 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f7780 msgr2=0x7f4174107210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f7780 0x7f4174107210 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f416800c790 tx=0x7f4168007d70).stop 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 shutdown_connections 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4160060f20 0x7f41600633e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41740f64e0 0x7f4174106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 --2- 172.21.15.33:0/2920408523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41740f7780 0x7f4174107210 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 >> 172.21.15.33:0/2920408523 conn(0x7f41740f1c40 msgr2=0x7f41740fb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 shutdown_connections 2024-02-15T18:40:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.075+0000 7f417c6ab700 1 -- 172.21.15.33:0/2920408523 wait complete. 2024-02-15T18:40:48.066 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 32 2024-02-15T18:40:48.076 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-02-15T18:40:48.076 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-15T18:40:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.208+0000 7f0e82b08700 1 -- 172.21.15.33:0/251600168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 msgr2=0x7f0e7c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.208+0000 7f0e82b08700 1 --2- 172.21.15.33:0/251600168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 0x7f0e7c0f9110 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f0e70004660 tx=0x7f0e70009b30).stop 2024-02-15T18:40:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.208+0000 7f0e82b08700 1 -- 172.21.15.33:0/251600168 shutdown_connections 2024-02-15T18:40:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.208+0000 7f0e82b08700 1 --2- 172.21.15.33:0/251600168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c0f9600 0x7f0e7c0fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.208+0000 7f0e82b08700 1 --2- 172.21.15.33:0/251600168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 0x7f0e7c0f9110 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.208+0000 7f0e82b08700 1 -- 172.21.15.33:0/251600168 >> 172.21.15.33:0/251600168 conn(0x7f0e7c0f0b70 msgr2=0x7f0e7c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.208+0000 7f0e82b08700 1 -- 172.21.15.33:0/251600168 shutdown_connections 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.208+0000 7f0e82b08700 1 -- 172.21.15.33:0/251600168 wait complete. 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e82b08700 1 Processor -- start 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e82b08700 1 -- start start 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e82b08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 0x7f0e7c0f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e82b08700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c0f9600 0x7f0e7c0f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e82b08700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0f6f60 con 0x7f0e7c05fe30 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e82b08700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0f5500 con 0x7f0e7c0f9600 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e808a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 0x7f0e7c0f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e808a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 0x7f0e7c0f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42924/0 (socket says 172.21.15.33:42924) 2024-02-15T18:40:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e808a4700 1 -- 172.21.15.33:0/3113660743 learned_addr learned my addr 172.21.15.33:0/3113660743 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.209+0000 7f0e7bfff700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c0f9600 0x7f0e7c0f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.210+0000 7f0e808a4700 1 -- 172.21.15.33:0/3113660743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c0f9600 msgr2=0x7f0e7c0f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.210+0000 7f0e808a4700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c0f9600 0x7f0e7c0f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.210+0000 7f0e808a4700 1 -- 172.21.15.33:0/3113660743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70005040 con 0x7f0e7c05fe30 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.210+0000 7f0e808a4700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 0x7f0e7c0f69b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f0e700043d0 tx=0x7f0e70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.210+0000 7f0e797fa700 1 -- 172.21.15.33:0/3113660743 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e70018070 con 0x7f0e7c05fe30 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.210+0000 7f0e797fa700 1 -- 172.21.15.33:0/3113660743 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f0e70007ba0 con 0x7f0e7c05fe30 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.210+0000 7f0e797fa700 1 -- 172.21.15.33:0/3113660743 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e7001dea0 con 0x7f0e7c05fe30 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.210+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c0f5720 con 0x7f0e7c05fe30 2024-02-15T18:40:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.210+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c0f5c80 con 0x7f0e7c05fe30 2024-02-15T18:40:48.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.211+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c046330 con 0x7f0e7c05fe30 2024-02-15T18:40:48.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.211+0000 7f0e797fa700 1 -- 172.21.15.33:0/3113660743 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f0e7001d420 con 0x7f0e7c05fe30 2024-02-15T18:40:48.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.212+0000 7f0e797fa700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0e6c060f20 0x7f0e6c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:48.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.212+0000 7f0e797fa700 1 -- 172.21.15.33:0/3113660743 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f0e7007dd60 con 0x7f0e7c05fe30 2024-02-15T18:40:48.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.212+0000 7f0e7bfff700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0e6c060f20 0x7f0e6c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:48.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.212+0000 7f0e7bfff700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0e6c060f20 0x7f0e6c0633e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f0e68004c40 tx=0x7f0e6800b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:48.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.216+0000 7f0e797fa700 1 -- 172.21.15.33:0/3113660743 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0e70051bc0 con 0x7f0e7c05fe30 2024-02-15T18:40:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.428+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f0e7c027a00 con 0x7f0e7c05fe30 2024-02-15T18:40:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.429+0000 7f0e797fa700 1 -- 172.21.15.33:0/3113660743 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v41) v1 ==== 107+0+3840 (secure 0 0 0) 0x7f0e700517b0 con 0x7f0e7c05fe30 2024-02-15T18:40:48.418 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:48.418 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:15.442086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34334},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":9,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:48.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0e6c060f20 msgr2=0x7f0e6c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0e6c060f20 0x7f0e6c0633e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f0e68004c40 tx=0x7f0e6800b040).stop 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 msgr2=0x7f0e7c0f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 0x7f0e7c0f69b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f0e700043d0 tx=0x7f0e70009b30).stop 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 shutdown_connections 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f0e6c060f20 0x7f0e6c0633e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e7c05fe30 0x7f0e7c0f69b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 --2- 172.21.15.33:0/3113660743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c0f9600 0x7f0e7c0f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 >> 172.21.15.33:0/3113660743 conn(0x7f0e7c0f0b70 msgr2=0x7f0e7c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 shutdown_connections 2024-02-15T18:40:48.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.431+0000 7f0e82b08700 1 -- 172.21.15.33:0/3113660743 wait complete. 2024-02-15T18:40:48.421 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 33 2024-02-15T18:40:48.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:47.353758+0000 mon.smithi033 (mon.0) 817 : audit [DBG] from='client.? 172.21.15.33:0/3641582721' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-15T18:40:48.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:47.584908+0000 mgr.smithi033.apxevf (mgr.14626) 460 : cluster [DBG] pgmap v319: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:48.430 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:47.715185+0000 mon.smithi033 (mon.0) 818 : audit [DBG] from='client.? 172.21.15.33:0/2953569047' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-15T18:40:48.431 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:48 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:48.074113+0000 mon.smithi033 (mon.0) 819 : audit [DBG] from='client.? 172.21.15.33:0/2920408523' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-15T18:40:48.431 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-02-15T18:40:48.432 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-15T18:40:48.494 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:47.353758+0000 mon.smithi033 (mon.0) 817 : audit [DBG] from='client.? 172.21.15.33:0/3641582721' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-15T18:40:48.494 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:47.584908+0000 mgr.smithi033.apxevf (mgr.14626) 460 : cluster [DBG] pgmap v319: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:48.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:47.715185+0000 mon.smithi033 (mon.0) 818 : audit [DBG] from='client.? 172.21.15.33:0/2953569047' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-15T18:40:48.495 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:48 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:48.074113+0000 mon.smithi033 (mon.0) 819 : audit [DBG] from='client.? 172.21.15.33:0/2920408523' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-15T18:40:48.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.565+0000 7f23ddace700 1 -- 172.21.15.33:0/2122020665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 msgr2=0x7f23d80f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.565+0000 7f23ddace700 1 --2- 172.21.15.33:0/2122020665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 0x7f23d80f5760 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f23c8004660 tx=0x7f23c8009b30).stop 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.565+0000 7f23ddace700 1 -- 172.21.15.33:0/2122020665 shutdown_connections 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.565+0000 7f23ddace700 1 --2- 172.21.15.33:0/2122020665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23d80f5c50 0x7f23d80f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.565+0000 7f23ddace700 1 --2- 172.21.15.33:0/2122020665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 0x7f23d80f5760 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.565+0000 7f23ddace700 1 -- 172.21.15.33:0/2122020665 >> 172.21.15.33:0/2122020665 conn(0x7f23d80f0b60 msgr2=0x7f23d80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.565+0000 7f23ddace700 1 -- 172.21.15.33:0/2122020665 shutdown_connections 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.565+0000 7f23ddace700 1 -- 172.21.15.33:0/2122020665 wait complete. 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.565+0000 7f23ddace700 1 Processor -- start 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23ddace700 1 -- start start 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23ddace700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 0x7f23d805fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23ddace700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23d80f5c50 0x7f23d810b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23ddace700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d810be90 con 0x7f23d80f5340 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23ddace700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d810bfd0 con 0x7f23d80f5c50 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23d77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 0x7f23d805fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23d77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 0x7f23d805fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42942/0 (socket says 172.21.15.33:42942) 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23d77fe700 1 -- 172.21.15.33:0/3706106773 learned_addr learned my addr 172.21.15.33:0/3706106773 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23d6ffd700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23d80f5c50 0x7f23d810b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23d77fe700 1 -- 172.21.15.33:0/3706106773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23d80f5c50 msgr2=0x7f23d810b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23d77fe700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23d80f5c50 0x7f23d810b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23d77fe700 1 -- 172.21.15.33:0/3706106773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8005040 con 0x7f23d80f5340 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23d6ffd700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23d80f5c50 0x7f23d810b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23d77fe700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 0x7f23d805fc60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f23c8009830 tx=0x7f23c8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23cffff700 1 -- 172.21.15.33:0/3706106773 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c8018070 con 0x7f23d80f5340 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23cffff700 1 -- 172.21.15.33:0/3706106773 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f23c8007ba0 con 0x7f23d80f5340 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d810c1d0 con 0x7f23d80f5340 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.566+0000 7f23cffff700 1 -- 172.21.15.33:0/3706106773 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c801c620 con 0x7f23d80f5340 2024-02-15T18:40:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.567+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d810c730 con 0x7f23d80f5340 2024-02-15T18:40:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.567+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d8027a00 con 0x7f23d80f5340 2024-02-15T18:40:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.568+0000 7f23cffff700 1 -- 172.21.15.33:0/3706106773 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f23c801c890 con 0x7f23d80f5340 2024-02-15T18:40:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.568+0000 7f23cffff700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23c4060fe0 0x7f23c40634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.568+0000 7f23cffff700 1 -- 172.21.15.33:0/3706106773 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f23c807dfa0 con 0x7f23d80f5340 2024-02-15T18:40:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.568+0000 7f23d6ffd700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23c4060fe0 0x7f23c40634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.569+0000 7f23d6ffd700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23c4060fe0 0x7f23c40634a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f23c0009fd0 tx=0x7f23c000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.572+0000 7f23cffff700 1 -- 172.21.15.33:0/3706106773 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f23c8051da0 con 0x7f23d80f5340 2024-02-15T18:40:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.788+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f23d80586e0 con 0x7f23d80f5340 2024-02-15T18:40:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.788+0000 7f23cffff700 1 -- 172.21.15.33:0/3706106773 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v41) v1 ==== 107+0+3838 (secure 0 0 0) 0x7f23c8051990 con 0x7f23d80f5340 2024-02-15T18:40:48.777 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:48.778 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:16.444056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34334},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.790+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23c4060fe0 msgr2=0x7f23c40634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.790+0000 7f23ddace700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23c4060fe0 0x7f23c40634a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f23c0009fd0 tx=0x7f23c000b040).stop 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.790+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 msgr2=0x7f23d805fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.790+0000 7f23ddace700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 0x7f23d805fc60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f23c8009830 tx=0x7f23c8009b30).stop 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.791+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 shutdown_connections 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.791+0000 7f23ddace700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f23c4060fe0 0x7f23c40634a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.791+0000 7f23ddace700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23d80f5340 0x7f23d805fc60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.791+0000 7f23ddace700 1 --2- 172.21.15.33:0/3706106773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23d80f5c50 0x7f23d810b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.791+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 >> 172.21.15.33:0/3706106773 conn(0x7f23d80f0b60 msgr2=0x7f23d80fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.791+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 shutdown_connections 2024-02-15T18:40:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.791+0000 7f23ddace700 1 -- 172.21.15.33:0/3706106773 wait complete. 2024-02-15T18:40:48.781 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 34 2024-02-15T18:40:48.791 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-02-15T18:40:48.792 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-15T18:40:48.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.923+0000 7f4f3299d700 1 -- 172.21.15.33:0/111155368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 msgr2=0x7f4f2c0f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.923+0000 7f4f3299d700 1 --2- 172.21.15.33:0/111155368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 0x7f4f2c0f57b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f4f1c004660 tx=0x7f4f1c009b30).stop 2024-02-15T18:40:48.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.923+0000 7f4f3299d700 1 -- 172.21.15.33:0/111155368 shutdown_connections 2024-02-15T18:40:48.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.923+0000 7f4f3299d700 1 --2- 172.21.15.33:0/111155368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c0f5ca0 0x7f4f2c0f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:48.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.923+0000 7f4f3299d700 1 --2- 172.21.15.33:0/111155368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 0x7f4f2c0f57b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.923+0000 7f4f3299d700 1 -- 172.21.15.33:0/111155368 >> 172.21.15.33:0/111155368 conn(0x7f4f2c0f0b70 msgr2=0x7f4f2c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:48.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.923+0000 7f4f3299d700 1 -- 172.21.15.33:0/111155368 shutdown_connections 2024-02-15T18:40:48.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.923+0000 7f4f3299d700 1 -- 172.21.15.33:0/111155368 wait complete. 2024-02-15T18:40:48.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.924+0000 7f4f3299d700 1 Processor -- start 2024-02-15T18:40:48.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.924+0000 7f4f3299d700 1 -- start start 2024-02-15T18:40:48.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.924+0000 7f4f3299d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 0x7f4f2c05fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:48.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.924+0000 7f4f3299d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c0f5ca0 0x7f4f2c10bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:48.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.924+0000 7f4f3299d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c10c020 con 0x7f4f2c0f5390 2024-02-15T18:40:48.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.924+0000 7f4f3299d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c10c160 con 0x7f4f2c0f5ca0 2024-02-15T18:40:48.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.924+0000 7f4f2bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 0x7f4f2c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:48.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f2bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 0x7f4f2c05fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42960/0 (socket says 172.21.15.33:42960) 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f2bfff700 1 -- 172.21.15.33:0/2448425234 learned_addr learned my addr 172.21.15.33:0/2448425234 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f2b7fe700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c0f5ca0 0x7f4f2c10bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f2bfff700 1 -- 172.21.15.33:0/2448425234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c0f5ca0 msgr2=0x7f4f2c10bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f2bfff700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c0f5ca0 0x7f4f2c10bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f2bfff700 1 -- 172.21.15.33:0/2448425234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c005040 con 0x7f4f2c0f5390 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f2b7fe700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c0f5ca0 0x7f4f2c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f2bfff700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 0x7f4f2c05fcb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f4f1c009f50 tx=0x7f4f1c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f28ff9700 1 -- 172.21.15.33:0/2448425234 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f1c018070 con 0x7f4f2c0f5390 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c10c3e0 con 0x7f4f2c0f5390 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f28ff9700 1 -- 172.21.15.33:0/2448425234 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f4f1c007d70 con 0x7f4f2c0f5390 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f28ff9700 1 -- 172.21.15.33:0/2448425234 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f1c01c620 con 0x7f4f2c0f5390 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.925+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c10c8c0 con 0x7f4f2c0f5390 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.926+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c027a00 con 0x7f4f2c0f5390 2024-02-15T18:40:48.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.926+0000 7f4f28ff9700 1 -- 172.21.15.33:0/2448425234 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f4f1c01c8e0 con 0x7f4f2c0f5390 2024-02-15T18:40:48.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.927+0000 7f4f28ff9700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4f14060f20 0x7f4f140633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:48.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.927+0000 7f4f28ff9700 1 -- 172.21.15.33:0/2448425234 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f4f1c07e0c0 con 0x7f4f2c0f5390 2024-02-15T18:40:48.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.927+0000 7f4f2b7fe700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4f14060f20 0x7f4f140633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:48.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.927+0000 7f4f2b7fe700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4f14060f20 0x7f4f140633e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4f2000b830 tx=0x7f4f20008040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:48.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:48.931+0000 7f4f28ff9700 1 -- 172.21.15.33:0/2448425234 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4f1c051f20 con 0x7f4f2c0f5390 2024-02-15T18:40:49.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.149+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f4f2c0586e0 con 0x7f4f2c0f5390 2024-02-15T18:40:49.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.149+0000 7f4f28ff9700 1 -- 172.21.15.33:0/2448425234 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v41) v1 ==== 107+0+3838 (secure 0 0 0) 0x7f4f1c051b10 con 0x7f4f2c0f5390 2024-02-15T18:40:49.138 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:49.139 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:17.449076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34334},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:active","state_seq":11,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.151+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4f14060f20 msgr2=0x7f4f140633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4f14060f20 0x7f4f140633e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4f2000b830 tx=0x7f4f20008040).stop 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 msgr2=0x7f4f2c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 0x7f4f2c05fcb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f4f1c009f50 tx=0x7f4f1c009b30).stop 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 shutdown_connections 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f4f14060f20 0x7f4f140633e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f5390 0x7f4f2c05fcb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 --2- 172.21.15.33:0/2448425234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c0f5ca0 0x7f4f2c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 >> 172.21.15.33:0/2448425234 conn(0x7f4f2c0f0b70 msgr2=0x7f4f2c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 shutdown_connections 2024-02-15T18:40:49.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.152+0000 7f4f3299d700 1 -- 172.21.15.33:0/2448425234 wait complete. 2024-02-15T18:40:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 35 2024-02-15T18:40:49.153 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-02-15T18:40:49.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-02-15T18:40:49.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.287+0000 7f59160ce700 1 -- 172.21.15.33:0/265724104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 msgr2=0x7f59100f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.287+0000 7f59160ce700 1 --2- 172.21.15.33:0/265724104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 0x7f59100f66e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f5904004660 tx=0x7f5904009b30).stop 2024-02-15T18:40:49.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.287+0000 7f59160ce700 1 -- 172.21.15.33:0/265724104 shutdown_connections 2024-02-15T18:40:49.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.287+0000 7f59160ce700 1 --2- 172.21.15.33:0/265724104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 0x7f59100f66e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.287+0000 7f59160ce700 1 --2- 172.21.15.33:0/265724104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59100f53a0 0x7f59100f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.287+0000 7f59160ce700 1 -- 172.21.15.33:0/265724104 >> 172.21.15.33:0/265724104 conn(0x7f59100f0ba0 msgr2=0x7f59100f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:49.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.287+0000 7f59160ce700 1 -- 172.21.15.33:0/265724104 shutdown_connections 2024-02-15T18:40:49.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.287+0000 7f59160ce700 1 -- 172.21.15.33:0/265724104 wait complete. 2024-02-15T18:40:49.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.288+0000 7f59160ce700 1 Processor -- start 2024-02-15T18:40:49.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.288+0000 7f59160ce700 1 -- start start 2024-02-15T18:40:49.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.288+0000 7f59160ce700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59100f53a0 0x7f5910105bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:49.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.288+0000 7f59160ce700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 0x7f59101060b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:49.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.288+0000 7f59160ce700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5910106660 con 0x7f59100f5cb0 2024-02-15T18:40:49.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.288+0000 7f59160ce700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59101067a0 con 0x7f59100f53a0 2024-02-15T18:40:49.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f590effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 0x7f59101060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f590effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 0x7f59101060b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42986/0 (socket says 172.21.15.33:42986) 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f590effd700 1 -- 172.21.15.33:0/1517617836 learned_addr learned my addr 172.21.15.33:0/1517617836 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f590effd700 1 -- 172.21.15.33:0/1517617836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59100f53a0 msgr2=0x7f5910105bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f590effd700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59100f53a0 0x7f5910105bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f590effd700 1 -- 172.21.15.33:0/1517617836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904005040 con 0x7f59100f5cb0 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f590effd700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 0x7f59101060b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5904009f50 tx=0x7f5904009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f58f7fff700 1 -- 172.21.15.33:0/1517617836 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5904018070 con 0x7f59100f5cb0 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591010b1e0 con 0x7f59100f5cb0 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f58f7fff700 1 -- 172.21.15.33:0/1517617836 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f5904007d70 con 0x7f59100f5cb0 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f58f7fff700 1 -- 172.21.15.33:0/1517617836 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f590401c620 con 0x7f59100f5cb0 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.289+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591010b7a0 con 0x7f59100f5cb0 2024-02-15T18:40:49.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.290+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5910027a00 con 0x7f59100f5cb0 2024-02-15T18:40:49.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.291+0000 7f58f7fff700 1 -- 172.21.15.33:0/1517617836 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f590401c8e0 con 0x7f59100f5cb0 2024-02-15T18:40:49.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.291+0000 7f58f7fff700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f58f8060f20 0x7f58f80633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:49.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.291+0000 7f58f7fff700 1 -- 172.21.15.33:0/1517617836 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f590407e0c0 con 0x7f59100f5cb0 2024-02-15T18:40:49.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.292+0000 7f590f7fe700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f58f8060f20 0x7f58f80633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:49.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.292+0000 7f590f7fe700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f58f8060f20 0x7f58f80633e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5900004870 tx=0x7f59000079c0).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:49.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.297+0000 7f58f7fff700 1 -- 172.21.15.33:0/1517617836 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5904051f20 con 0x7f59100f5cb0 2024-02-15T18:40:49.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.510+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f59100fdca0 con 0x7f59100f5cb0 2024-02-15T18:40:49.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.511+0000 7f58f7fff700 1 -- 172.21.15.33:0/1517617836 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v41) v1 ==== 107+0+4620 (secure 0 0 0) 0x7f59100fdca0 con 0x7f59100f5cb0 2024-02-15T18:40:49.500 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:49.500 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44279,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/112791917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":112791917},{"type":"v1","addr":"172.21.15.131:6827","nonce":112791917}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":44301,"name":"cephfs.smithi131.ywlevz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2921613795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2921613795},{"type":"v1","addr":"172.21.15.131:6825","nonce":2921613795}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:17.449076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34334},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:active","state_seq":11,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f58f8060f20 msgr2=0x7f58f80633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f58f8060f20 0x7f58f80633e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f5900004870 tx=0x7f59000079c0).stop 2024-02-15T18:40:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 msgr2=0x7f59101060b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 0x7f59101060b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5904009f50 tx=0x7f5904009b30).stop 2024-02-15T18:40:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 shutdown_connections 2024-02-15T18:40:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f58f8060f20 0x7f58f80633e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59100f53a0 0x7f5910105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:49.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 --2- 172.21.15.33:0/1517617836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59100f5cb0 0x7f59101060b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 >> 172.21.15.33:0/1517617836 conn(0x7f59100f0ba0 msgr2=0x7f59100fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:49.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 shutdown_connections 2024-02-15T18:40:49.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.513+0000 7f59160ce700 1 -- 172.21.15.33:0/1517617836 wait complete. 2024-02-15T18:40:49.503 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 36 2024-02-15T18:40:49.512 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:48.429635+0000 mon.smithi033 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.33:0/3113660743' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-15T18:40:49.512 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:48.789289+0000 mon.smithi033 (mon.0) 821 : audit [DBG] from='client.? 172.21.15.33:0/3706106773' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-15T18:40:49.513 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:49 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:49.150331+0000 mon.smithi033 (mon.0) 822 : audit [DBG] from='client.? 172.21.15.33:0/2448425234' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-15T18:40:49.514 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-02-15T18:40:49.514 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.646+0000 7f823e07c700 1 -- 172.21.15.33:0/89298879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 msgr2=0x7f82380f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.646+0000 7f823e07c700 1 --2- 172.21.15.33:0/89298879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 0x7f82380f66d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f8220004660 tx=0x7f8220009b30).stop 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.646+0000 7f823e07c700 1 -- 172.21.15.33:0/89298879 shutdown_connections 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.646+0000 7f823e07c700 1 --2- 172.21.15.33:0/89298879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 0x7f82380f66d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.646+0000 7f823e07c700 1 --2- 172.21.15.33:0/89298879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82380f5390 0x7f82380f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.646+0000 7f823e07c700 1 -- 172.21.15.33:0/89298879 >> 172.21.15.33:0/89298879 conn(0x7f82380f0b70 msgr2=0x7f82380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.646+0000 7f823e07c700 1 -- 172.21.15.33:0/89298879 shutdown_connections 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.646+0000 7f823e07c700 1 -- 172.21.15.33:0/89298879 wait complete. 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.646+0000 7f823e07c700 1 Processor -- start 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f823e07c700 1 -- start start 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f823e07c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82380f5390 0x7f82380f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:49.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f823e07c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 0x7f82380f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f823e07c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82380f9960 con 0x7f82380f5ca0 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f823e07c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82380f7f00 con 0x7f82380f5390 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f8236ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 0x7f82380f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f8236ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 0x7f82380f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43000/0 (socket says 172.21.15.33:43000) 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f8236ffd700 1 -- 172.21.15.33:0/1465436548 learned_addr learned my addr 172.21.15.33:0/1465436548 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f82377fe700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82380f5390 0x7f82380f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f8236ffd700 1 -- 172.21.15.33:0/1465436548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82380f5390 msgr2=0x7f82380f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f8236ffd700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82380f5390 0x7f82380f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f8236ffd700 1 -- 172.21.15.33:0/1465436548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8220005040 con 0x7f82380f5ca0 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f8236ffd700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 0x7f82380f7a10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f8220009f50 tx=0x7f8220009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.647+0000 7f822ffff700 1 -- 172.21.15.33:0/1465436548 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8220018070 con 0x7f82380f5ca0 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.648+0000 7f822ffff700 1 -- 172.21.15.33:0/1465436548 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7f8220007c70 con 0x7f82380f5ca0 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.648+0000 7f822ffff700 1 -- 172.21.15.33:0/1465436548 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f822001c620 con 0x7f82380f5ca0 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.648+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82380f8120 con 0x7f82380f5ca0 2024-02-15T18:40:49.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.648+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82380f8630 con 0x7f82380f5ca0 2024-02-15T18:40:49.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.648+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8238046330 con 0x7f82380f5ca0 2024-02-15T18:40:49.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.649+0000 7f822ffff700 1 -- 172.21.15.33:0/1465436548 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7f822001da10 con 0x7f82380f5ca0 2024-02-15T18:40:49.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.649+0000 7f822ffff700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8224060f20 0x7f82240633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:49.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.650+0000 7f822ffff700 1 -- 172.21.15.33:0/1465436548 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f822007e0d0 con 0x7f82380f5ca0 2024-02-15T18:40:49.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.650+0000 7f82377fe700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8224060f20 0x7f82240633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:49.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.650+0000 7f82377fe700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8224060f20 0x7f82240633e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f8228007fd0 tx=0x7f8228009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:49.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.654+0000 7f822ffff700 1 -- 172.21.15.33:0/1465436548 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8220051f30 con 0x7f82380f5ca0 2024-02-15T18:40:49.744 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:48.429635+0000 mon.smithi033 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.33:0/3113660743' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-15T18:40:49.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:48.789289+0000 mon.smithi033 (mon.0) 821 : audit [DBG] from='client.? 172.21.15.33:0/3706106773' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-15T18:40:49.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:49 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:49.150331+0000 mon.smithi033 (mon.0) 822 : audit [DBG] from='client.? 172.21.15.33:0/2448425234' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-15T18:40:49.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.866+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f82380fdc90 con 0x7f82380f5ca0 2024-02-15T18:40:49.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.866+0000 7f822ffff700 1 -- 172.21.15.33:0/1465436548 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v41) v1 ==== 107+0+3841 (secure 0 0 0) 0x7f8220051b20 con 0x7f82380f5ca0 2024-02-15T18:40:49.855 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:49.855 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44301,"name":"cephfs.smithi131.ywlevz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2921613795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2921613795},{"type":"v1","addr":"172.21.15.131:6825","nonce":2921613795}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:17.449076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34334},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:active","state_seq":11,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8224060f20 msgr2=0x7f82240633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8224060f20 0x7f82240633e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f8228007fd0 tx=0x7f8228009040).stop 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 msgr2=0x7f82380f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 0x7f82380f7a10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f8220009f50 tx=0x7f8220009b30).stop 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 shutdown_connections 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7f8224060f20 0x7f82240633e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82380f5390 0x7f82380f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 --2- 172.21.15.33:0/1465436548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82380f5ca0 0x7f82380f7a10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 >> 172.21.15.33:0/1465436548 conn(0x7f82380f0b70 msgr2=0x7f823805fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.868+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 shutdown_connections 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:49.869+0000 7f823e07c700 1 -- 172.21.15.33:0/1465436548 wait complete. 2024-02-15T18:40:49.858 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2024-02-15T18:40:49.869 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-02-15T18:40:49.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-02-15T18:40:49.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.001+0000 7fe66914e700 1 -- 172.21.15.33:0/2443614594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 msgr2=0x7fe6640f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.001+0000 7fe66914e700 1 --2- 172.21.15.33:0/2443614594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 0x7fe6640f66d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fe658004660 tx=0x7fe658009b30).stop 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.001+0000 7fe66914e700 1 -- 172.21.15.33:0/2443614594 shutdown_connections 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.001+0000 7fe66914e700 1 --2- 172.21.15.33:0/2443614594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 0x7fe6640f66d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.001+0000 7fe66914e700 1 --2- 172.21.15.33:0/2443614594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6640f5390 0x7fe6640f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.001+0000 7fe66914e700 1 -- 172.21.15.33:0/2443614594 >> 172.21.15.33:0/2443614594 conn(0x7fe6640f0b70 msgr2=0x7fe6640f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.001+0000 7fe66914e700 1 -- 172.21.15.33:0/2443614594 shutdown_connections 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.001+0000 7fe66914e700 1 -- 172.21.15.33:0/2443614594 wait complete. 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe66914e700 1 Processor -- start 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe66914e700 1 -- start start 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe66914e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6640f5390 0x7fe6640f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe66914e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 0x7fe6640f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe66914e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640f9960 con 0x7fe6640f5ca0 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe66914e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640f7f00 con 0x7fe6640f5390 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe66259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 0x7fe6640f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe66259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 0x7fe6640f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43024/0 (socket says 172.21.15.33:43024) 2024-02-15T18:40:49.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe66259c700 1 -- 172.21.15.33:0/613698163 learned_addr learned my addr 172.21.15.33:0/613698163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.002+0000 7fe662d9d700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6640f5390 0x7fe6640f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.003+0000 7fe66259c700 1 -- 172.21.15.33:0/613698163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6640f5390 msgr2=0x7fe6640f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.003+0000 7fe66259c700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6640f5390 0x7fe6640f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.003+0000 7fe66259c700 1 -- 172.21.15.33:0/613698163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658005040 con 0x7fe6640f5ca0 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.003+0000 7fe66259c700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 0x7fe6640f7a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe658009f50 tx=0x7fe658009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.003+0000 7fe64b7fe700 1 -- 172.21.15.33:0/613698163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe658018070 con 0x7fe6640f5ca0 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.003+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6640f8120 con 0x7fe6640f5ca0 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.003+0000 7fe64b7fe700 1 -- 172.21.15.33:0/613698163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fe658007c70 con 0x7fe6640f5ca0 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.003+0000 7fe64b7fe700 1 -- 172.21.15.33:0/613698163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe65801c620 con 0x7fe6640f5ca0 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.003+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6640f8680 con 0x7fe6640f5ca0 2024-02-15T18:40:49.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.004+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe664046330 con 0x7fe6640f5ca0 2024-02-15T18:40:49.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.004+0000 7fe64b7fe700 1 -- 172.21.15.33:0/613698163 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fe65801da10 con 0x7fe6640f5ca0 2024-02-15T18:40:49.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.005+0000 7fe64b7fe700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe64c060f20 0x7fe64c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:49.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.005+0000 7fe64b7fe700 1 -- 172.21.15.33:0/613698163 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe65807e0c0 con 0x7fe6640f5ca0 2024-02-15T18:40:49.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.005+0000 7fe662d9d700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe64c060f20 0x7fe64c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:49.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.005+0000 7fe662d9d700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe64c060f20 0x7fe64c0633e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe6540041d0 tx=0x7fe654009040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:49.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.009+0000 7fe64b7fe700 1 -- 172.21.15.33:0/613698163 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe658051f20 con 0x7fe6640f5ca0 2024-02-15T18:40:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.223+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7fe6640fdc90 con 0x7fe6640f5ca0 2024-02-15T18:40:50.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.223+0000 7fe64b7fe700 1 -- 172.21.15.33:0/613698163 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v41) v1 ==== 107+0+4623 (secure 0 0 0) 0x7fe658019270 con 0x7fe6640f5ca0 2024-02-15T18:40:50.212 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:50.212 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44301,"name":"cephfs.smithi131.ywlevz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2921613795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2921613795},{"type":"v1","addr":"172.21.15.131:6825","nonce":2921613795}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44305,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/2360346875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2360346875},{"type":"v1","addr":"172.21.15.131:6827","nonce":2360346875}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:17.449076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34334},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:active","state_seq":11,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:50.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe64c060f20 msgr2=0x7fe64c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe64c060f20 0x7fe64c0633e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe6540041d0 tx=0x7fe654009040).stop 2024-02-15T18:40:50.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 msgr2=0x7fe6640f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 0x7fe6640f7a10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe658009f50 tx=0x7fe658009b30).stop 2024-02-15T18:40:50.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 shutdown_connections 2024-02-15T18:40:50.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fe64c060f20 0x7fe64c0633e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6640f5390 0x7fe6640f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 --2- 172.21.15.33:0/613698163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6640f5ca0 0x7fe6640f7a10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 >> 172.21.15.33:0/613698163 conn(0x7fe6640f0b70 msgr2=0x7fe66405fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:50.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 shutdown_connections 2024-02-15T18:40:50.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.225+0000 7fe66914e700 1 -- 172.21.15.33:0/613698163 wait complete. 2024-02-15T18:40:50.215 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 38 2024-02-15T18:40:50.226 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-02-15T18:40:50.226 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-02-15T18:40:50.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.359+0000 7fa1559ad700 1 -- 172.21.15.33:0/1777523606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f6490 msgr2=0x7fa1500f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.359+0000 7fa1559ad700 1 --2- 172.21.15.33:0/1777523606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f6490 0x7fa1500f68b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fa140004660 tx=0x7fa140009b30).stop 2024-02-15T18:40:50.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.359+0000 7fa1559ad700 1 -- 172.21.15.33:0/1777523606 shutdown_connections 2024-02-15T18:40:50.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.359+0000 7fa1559ad700 1 --2- 172.21.15.33:0/1777523606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1500f7730 0x7fa1500f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.359+0000 7fa1559ad700 1 --2- 172.21.15.33:0/1777523606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f6490 0x7fa1500f68b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.359+0000 7fa1559ad700 1 -- 172.21.15.33:0/1777523606 >> 172.21.15.33:0/1777523606 conn(0x7fa1500f1bd0 msgr2=0x7fa1500f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.360+0000 7fa1559ad700 1 -- 172.21.15.33:0/1777523606 shutdown_connections 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.360+0000 7fa1559ad700 1 -- 172.21.15.33:0/1777523606 wait complete. 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.360+0000 7fa1559ad700 1 Processor -- start 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.360+0000 7fa1559ad700 1 -- start start 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.360+0000 7fa1559ad700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1500f6490 0x7fa150106ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.360+0000 7fa1559ad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f7730 0x7fa1501071d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.360+0000 7fa1559ad700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501077d0 con 0x7fa1500f7730 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.360+0000 7fa1559ad700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150107910 con 0x7fa1500f6490 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa14e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f7730 0x7fa1501071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa14e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f7730 0x7fa1501071d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43030/0 (socket says 172.21.15.33:43030) 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa14e7fc700 1 -- 172.21.15.33:0/3622434406 learned_addr learned my addr 172.21.15.33:0/3622434406 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa14e7fc700 1 -- 172.21.15.33:0/3622434406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1500f6490 msgr2=0x7fa150106ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa14e7fc700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1500f6490 0x7fa150106ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa14e7fc700 1 -- 172.21.15.33:0/3622434406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140005040 con 0x7fa1500f7730 2024-02-15T18:40:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa14e7fc700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f7730 0x7fa1501071d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fa1380026d0 tx=0x7fa138009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa1477fe700 1 -- 172.21.15.33:0/3622434406 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa138009320 con 0x7fa1500f7730 2024-02-15T18:40:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa1477fe700 1 -- 172.21.15.33:0/3622434406 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7fa13800f040 con 0x7fa1500f7730 2024-02-15T18:40:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15010c320 con 0x7fa1500f7730 2024-02-15T18:40:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa1477fe700 1 -- 172.21.15.33:0/3622434406 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1380149b0 con 0x7fa1500f7730 2024-02-15T18:40:50.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.361+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15010c8e0 con 0x7fa1500f7730 2024-02-15T18:40:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.362+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa150027a00 con 0x7fa1500f7730 2024-02-15T18:40:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.363+0000 7fa1477fe700 1 -- 172.21.15.33:0/3622434406 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7fa138009480 con 0x7fa1500f7730 2024-02-15T18:40:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.363+0000 7fa1477fe700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa13c060f20 0x7fa13c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.363+0000 7fa1477fe700 1 -- 172.21.15.33:0/3622434406 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa13807c620 con 0x7fa1500f7730 2024-02-15T18:40:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.363+0000 7fa14effd700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa13c060f20 0x7fa13c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:50.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.363+0000 7fa14effd700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa13c060f20 0x7fa13c0633e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa140000c00 tx=0x7fa140009b30).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:50.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.367+0000 7fa1477fe700 1 -- 172.21.15.33:0/3622434406 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa13804cad0 con 0x7fa1500f7730 2024-02-15T18:40:50.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:49.511846+0000 mon.smithi033 (mon.0) 823 : audit [DBG] from='client.? 172.21.15.33:0/1517617836' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-15T18:40:50.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: cluster 2024-02-15T18:40:49.585277+0000 mgr.smithi033.apxevf (mgr.14626) 461 : cluster [DBG] pgmap v320: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:50.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:49.867166+0000 mon.smithi033 (mon.0) 824 : audit [DBG] from='client.? 172.21.15.33:0/1465436548' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-15T18:40:50.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:50 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:50.224028+0000 mon.smithi033 (mon.0) 825 : audit [DBG] from='client.? 172.21.15.33:0/613698163' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-15T18:40:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.581+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7fa1500fed60 con 0x7fa1500f7730 2024-02-15T18:40:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.582+0000 7fa1477fe700 1 -- 172.21.15.33:0/3622434406 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v41) v1 ==== 107+0+4623 (secure 0 0 0) 0x7fa1380500f0 con 0x7fa1500f7730 2024-02-15T18:40:50.570 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:50.571 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44301,"name":"cephfs.smithi131.ywlevz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2921613795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2921613795},{"type":"v1","addr":"172.21.15.131:6825","nonce":2921613795}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44305,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/2360346875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2360346875},{"type":"v1","addr":"172.21.15.131:6827","nonce":2360346875}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:32.655530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0],"up":{"mds_0":34334},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:active","state_seq":11,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa13c060f20 msgr2=0x7fa13c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa13c060f20 0x7fa13c0633e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa140000c00 tx=0x7fa140009b30).stop 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f7730 msgr2=0x7fa1501071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f7730 0x7fa1501071d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fa1380026d0 tx=0x7fa138009de0).stop 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 shutdown_connections 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7fa13c060f20 0x7fa13c0633e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1500f6490 0x7fa150106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 --2- 172.21.15.33:0/3622434406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1500f7730 0x7fa1501071d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 >> 172.21.15.33:0/3622434406 conn(0x7fa1500f1bd0 msgr2=0x7fa1500fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 shutdown_connections 2024-02-15T18:40:50.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.584+0000 7fa1559ad700 1 -- 172.21.15.33:0/3622434406 wait complete. 2024-02-15T18:40:50.574 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 39 2024-02-15T18:40:50.585 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-02-15T18:40:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.717+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3558366664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 msgr2=0x7ff6280f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.717+0000 7ff62d5ae700 1 --2- 172.21.15.33:0/3558366664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 0x7ff6280f6900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ff618004660 tx=0x7ff618009b30).stop 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.717+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3558366664 shutdown_connections 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.717+0000 7ff62d5ae700 1 --2- 172.21.15.33:0/3558366664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6280f7780 0x7ff6280f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.717+0000 7ff62d5ae700 1 --2- 172.21.15.33:0/3558366664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 0x7ff6280f6900 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.717+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3558366664 >> 172.21.15.33:0/3558366664 conn(0x7ff6280f1c40 msgr2=0x7ff6280f4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.717+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3558366664 shutdown_connections 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.717+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3558366664 wait complete. 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.717+0000 7ff62d5ae700 1 Processor -- start 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff62d5ae700 1 -- start start 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff62d5ae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 0x7ff628106d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff62d5ae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6280f7780 0x7ff628107210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff62d5ae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff628107810 con 0x7ff6280f64e0 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff62d5ae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff628107950 con 0x7ff6280f7780 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff626ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 0x7ff628106d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff626ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 0x7ff628106d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43054/0 (socket says 172.21.15.33:43054) 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff626ffd700 1 -- 172.21.15.33:0/3608921156 learned_addr learned my addr 172.21.15.33:0/3608921156 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff6267fc700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6280f7780 0x7ff628107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff626ffd700 1 -- 172.21.15.33:0/3608921156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6280f7780 msgr2=0x7ff628107210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff626ffd700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6280f7780 0x7ff628107210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff626ffd700 1 -- 172.21.15.33:0/3608921156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618005040 con 0x7ff6280f64e0 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff626ffd700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 0x7ff628106d20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff6180043d0 tx=0x7ff618009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff61f7fe700 1 -- 172.21.15.33:0/3608921156 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff618018070 con 0x7ff6280f64e0 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff61f7fe700 1 -- 172.21.15.33:0/3608921156 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1143+0+0 (secure 0 0 0) 0x7ff618007ba0 con 0x7ff6280f64e0 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62810c300 con 0x7ff6280f64e0 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.718+0000 7ff61f7fe700 1 -- 172.21.15.33:0/3608921156 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff61801dea0 con 0x7ff6280f64e0 2024-02-15T18:40:50.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.719+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62810c860 con 0x7ff6280f64e0 2024-02-15T18:40:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.719+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff628027a00 con 0x7ff6280f64e0 2024-02-15T18:40:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.720+0000 7ff61f7fe700 1 -- 172.21.15.33:0/3608921156 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 30) v1 ==== 77144+0+0 (secure 0 0 0) 0x7ff61801d420 con 0x7ff6280f64e0 2024-02-15T18:40:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.720+0000 7ff61f7fe700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff614060f20 0x7ff6140633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-15T18:40:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.720+0000 7ff61f7fe700 1 -- 172.21.15.33:0/3608921156 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff61807dc70 con 0x7ff6280f64e0 2024-02-15T18:40:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.720+0000 7ff6267fc700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff614060f20 0x7ff6140633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-15T18:40:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.721+0000 7ff6267fc700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff614060f20 0x7ff6140633e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7ff610004c40 tx=0x7ff61000b040).ready entity=mgr.14626 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-15T18:40:50.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.725+0000 7ff61f7fe700 1 -- 172.21.15.33:0/3608921156 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff61804e120 con 0x7ff6280f64e0 2024-02-15T18:40:50.744 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:49.511846+0000 mon.smithi033 (mon.0) 823 : audit [DBG] from='client.? 172.21.15.33:0/1517617836' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-15T18:40:50.744 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: cluster 2024-02-15T18:40:49.585277+0000 mgr.smithi033.apxevf (mgr.14626) 461 : cluster [DBG] pgmap v320: 65 pgs: 65 active+clean; 152 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-15T18:40:50.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:49.867166+0000 mon.smithi033 (mon.0) 824 : audit [DBG] from='client.? 172.21.15.33:0/1465436548' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-15T18:40:50.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:50 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:50.224028+0000 mon.smithi033 (mon.0) 825 : audit [DBG] from='client.? 172.21.15.33:0/613698163' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-15T18:40:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.939+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7ff6280fedb0 con 0x7ff6280f64e0 2024-02-15T18:40:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.940+0000 7ff61f7fe700 1 -- 172.21.15.33:0/3608921156 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v41) v1 ==== 107+0+4640 (secure 0 0 0) 0x7ff618051740 con 0x7ff6280f64e0 2024-02-15T18:40:50.929 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-02-15T18:40:50.929 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44301,"name":"cephfs.smithi131.ywlevz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2921613795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2921613795},{"type":"v1","addr":"172.21.15.131:6825","nonce":2921613795}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":44305,"name":"cephfs.smithi131.bgnwzs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/2360346875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2360346875},{"type":"v1","addr":"172.21.15.131:6827","nonce":2360346875}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-15T18:28:36.638158+0000","modified":"2024-02-15T18:37:32.659474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34334,"mds_1":34338},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34334":{"gid":34334,"name":"cephfs.smithi033.qszefh","rank":0,"incarnation":32,"state":"up:active","state_seq":11,"addr":"172.21.15.33:6827/1293923765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1293923765},{"type":"v1","addr":"172.21.15.33:6827","nonce":1293923765}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34338":{"gid":34338,"name":"cephfs.smithi033.mcppgd","rank":1,"incarnation":40,"state":"up:starting","state_seq":1,"addr":"172.21.15.33:6829/2386752010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2386752010},{"type":"v1","addr":"172.21.15.33:6829","nonce":2386752010}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.941+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff614060f20 msgr2=0x7ff6140633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.941+0000 7ff62d5ae700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff614060f20 0x7ff6140633e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7ff610004c40 tx=0x7ff61000b040).stop 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.941+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 msgr2=0x7ff628106d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.941+0000 7ff62d5ae700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 0x7ff628106d20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff6180043d0 tx=0x7ff618009b30).stop 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.942+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 shutdown_connections 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.942+0000 7ff62d5ae700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:6800/2986322533,v1:172.21.15.33:6801/2986322533] conn(0x7ff614060f20 0x7ff6140633e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.942+0000 7ff62d5ae700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6280f64e0 0x7ff628106d20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.942+0000 7ff62d5ae700 1 --2- 172.21.15.33:0/3608921156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6280f7780 0x7ff628107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.942+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 >> 172.21.15.33:0/3608921156 conn(0x7ff6280f1c40 msgr2=0x7ff6280fb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.942+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 shutdown_connections 2024-02-15T18:40:50.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-02-15T18:40:50.942+0000 7ff62d5ae700 1 -- 172.21.15.33:0/3608921156 wait complete. 2024-02-15T18:40:50.932 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 40 2024-02-15T18:40:50.942 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-15T18:40:50.954 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-15T18:40:50.954 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-15T18:40:50.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-15T18:40:50.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-15T18:40:50.994 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:40:50.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:40:50.994 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-15T18:40:51.073 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-15T18:40:51.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-15T18:40:51.074 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-15T18:40:51.121 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T18:40:51.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:40:51.122 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-15T18:40:51.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:40:51.168 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-02-15T18:40:51.187 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-15T18:40:51.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:40:51.187 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-15T18:40:51.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:40:51.281 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-02-15T18:40:51.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:40:51.363 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-02-15T18:40:51.384 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-15T18:40:51.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:40:51.385 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-15T18:40:51.452 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:50.582352+0000 mon.smithi033 (mon.0) 826 : audit [DBG] from='client.? 172.21.15.33:0/3622434406' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-15T18:40:51.452 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:51 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: audit 2024-02-15T18:40:50.940507+0000 mon.smithi033 (mon.0) 827 : audit [DBG] from='client.? 172.21.15.33:0/3608921156' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-15T18:40:51.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-15T18:40:51.480 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-02-15T18:40:51.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:50.582352+0000 mon.smithi033 (mon.0) 826 : audit [DBG] from='client.? 172.21.15.33:0/3622434406' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-15T18:40:51.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:51 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: audit 2024-02-15T18:40:50.940507+0000 mon.smithi033 (mon.0) 827 : audit [DBG] from='client.? 172.21.15.33:0/3608921156' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-02-15T18:40:51.583 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-15T18:40:51.594 INFO:tasks.cephadm:Teardown begin 2024-02-15T18:40:51.595 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:40:51.625 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:40:51.654 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-15T18:40:51.654 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-15T18:40:51.684 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-15T18:40:51.712 INFO:tasks.cephadm:Stopping all daemons... 2024-02-15T18:40:51.712 INFO:tasks.cephadm.mon.smithi033:Stopping mon.smithi033... 2024-02-15T18:40:51.713 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033 2024-02-15T18:40:52.044 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:51 smithi033 systemd[1]: Stopping Ceph mon.smithi033 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:40:52.045 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:51 smithi033 bash[99803]: Error: no container with name or ID "ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi033" found: no such container 2024-02-15T18:40:52.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:40:52.113+0000 7ff979cd8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi033 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:40:52.545 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:52 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033[77544]: debug 2024-02-15T18:40:52.113+0000 7ff979cd8700 -1 mon.smithi033@0(leader) e2 *** Got Signal Terminated *** 2024-02-15T18:40:53.044 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 15 18:40:52 smithi033 bash[99843]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi033 2024-02-15T18:40:53.409 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi033.service' 2024-02-15T18:40:53.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:40:53.469 INFO:tasks.cephadm.mon.smithi033:Stopped mon.smithi033 2024-02-15T18:40:53.469 INFO:tasks.cephadm.mon.smithi131:Stopping mon.smithi131... 2024-02-15T18:40:53.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi131 2024-02-15T18:40:53.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:53 smithi131 systemd[1]: Stopping Ceph mon.smithi131 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:40:53.755 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:53 smithi131 bash[70556]: Error: no container with name or ID "ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon.smithi131" found: no such container 2024-02-15T18:40:54.245 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:40:53.765+0000 7fab4335c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi131 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-15T18:40:54.245 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:53 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131[59364]: debug 2024-02-15T18:40:53.765+0000 7fab4335c700 -1 mon.smithi131@1(peon) e2 *** Got Signal Terminated *** 2024-02-15T18:40:54.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Feb 15 18:40:54 smithi131 bash[70597]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-mon-smithi131 2024-02-15T18:40:54.878 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@mon.smithi131.service' 2024-02-15T18:40:54.947 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:40:54.948 INFO:tasks.cephadm.mon.smithi131:Stopped mon.smithi131 2024-02-15T18:40:54.948 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-15T18:40:54.948 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.0 2024-02-15T18:40:55.256 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:40:54 smithi033 systemd[1]: Stopping Ceph osd.0 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:40:55.257 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:40:55 smithi033 bash[99973]: Error: no container with name or ID "ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.0" found: no such container 2024-02-15T18:40:55.544 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:40:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-0[80872]: debug 2024-02-15T18:40:55.267+0000 7f8d0da5f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:40:55.545 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:40:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-0[80872]: debug 2024-02-15T18:40:55.267+0000 7f8d0da5f700 -1 osd.0 83 *** Got signal Terminated *** 2024-02-15T18:40:55.545 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:40:55 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-0[80872]: debug 2024-02-15T18:40:55.267+0000 7f8d0da5f700 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:41:01.044 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 15 18:41:00 smithi033 bash[100014]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-0 2024-02-15T18:41:02.894 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.0.service' 2024-02-15T18:41:02.943 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:41:02.943 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-15T18:41:02.943 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-15T18:41:02.943 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.1 2024-02-15T18:41:03.224 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:41:02 smithi033 systemd[1]: Stopping Ceph osd.1 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:41:03.224 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:41:03 smithi033 bash[100255]: Error: no container with name or ID "ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.1" found: no such container 2024-02-15T18:41:03.544 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:41:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-1[83714]: debug 2024-02-15T18:41:03.235+0000 7fb23d3a7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:41:03.544 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:41:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-1[83714]: debug 2024-02-15T18:41:03.235+0000 7fb23d3a7700 -1 osd.1 83 *** Got signal Terminated *** 2024-02-15T18:41:03.544 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:41:03 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-1[83714]: debug 2024-02-15T18:41:03.235+0000 7fb23d3a7700 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:41:08.794 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 15 18:41:08 smithi033 bash[100296]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-1 2024-02-15T18:41:10.379 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.1.service' 2024-02-15T18:41:10.425 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:41:10.425 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-15T18:41:10.425 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-15T18:41:10.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.2 2024-02-15T18:41:10.727 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:41:10 smithi033 systemd[1]: Stopping Ceph osd.2 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:41:10.727 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:41:10 smithi033 bash[100537]: Error: no container with name or ID "ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.2" found: no such container 2024-02-15T18:41:11.044 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:41:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-2[86439]: debug 2024-02-15T18:41:10.737+0000 7fde7efec700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:41:11.044 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:41:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-2[86439]: debug 2024-02-15T18:41:10.737+0000 7fde7efec700 -1 osd.2 83 *** Got signal Terminated *** 2024-02-15T18:41:11.044 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:41:10 smithi033 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-2[86439]: debug 2024-02-15T18:41:10.737+0000 7fde7efec700 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:41:16.544 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 15 18:41:16 smithi033 bash[100577]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-2 2024-02-15T18:41:17.862 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.2.service' 2024-02-15T18:41:17.911 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:41:17.911 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-15T18:41:17.911 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-15T18:41:17.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.3 2024-02-15T18:41:18.244 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:41:17 smithi131 systemd[1]: Stopping Ceph osd.3 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:41:18.245 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:41:17 smithi131 bash[70726]: Error: no container with name or ID "ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.3" found: no such container 2024-02-15T18:41:18.744 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:41:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-3[61792]: debug 2024-02-15T18:41:18.268+0000 7fc21f6ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:41:18.744 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:41:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-3[61792]: debug 2024-02-15T18:41:18.268+0000 7fc21f6ea700 -1 osd.3 83 *** Got signal Terminated *** 2024-02-15T18:41:18.745 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:41:18 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-3[61792]: debug 2024-02-15T18:41:18.268+0000 7fc21f6ea700 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:41:23.244 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:41:22 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-3[61792]: debug 2024-02-15T18:41:22.768+0000 7fc21865f700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:59.292378+0000 front 2024-02-15T18:40:59.292417+0000 (oldest deadline 2024-02-15T18:41:22.192358+0000) 2024-02-15T18:41:23.745 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:41:23 smithi131 bash[70765]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-3 2024-02-15T18:41:23.745 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:23 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:23.428+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:24.467 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:24.069+0000 7f289e15d700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:58.377760+0000 front 2024-02-15T18:40:58.377747+0000 (oldest deadline 2024-02-15T18:41:23.077791+0000) 2024-02-15T18:41:24.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:24 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:24.478+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:25.245 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:25.089+0000 7f289e15d700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:58.377760+0000 front 2024-02-15T18:40:58.377747+0000 (oldest deadline 2024-02-15T18:41:23.077791+0000) 2024-02-15T18:41:25.532 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:41:25 smithi131 systemd[1]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.3.service: Succeeded. 2024-02-15T18:41:25.532 INFO:journalctl@ceph.osd.3.smithi131.stdout:Feb 15 18:41:25 smithi131 systemd[1]: Stopped Ceph osd.3 for fd0b1c90-cc2e-11ee-95ba-87774f69a715. 2024-02-15T18:41:25.533 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:25.452+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:25.533 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.3.service' 2024-02-15T18:41:25.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:41:25.574 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-15T18:41:25.574 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-15T18:41:25.575 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.4 2024-02-15T18:41:25.916 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:25 smithi131 systemd[1]: Stopping Ceph osd.4 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:41:25.916 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:25 smithi131 bash[70997]: Error: no container with name or ID "ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.4" found: no such container 2024-02-15T18:41:26.244 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:25.926+0000 7f28a31e4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:41:26.244 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:25.926+0000 7f28a31e4700 -1 osd.4 83 *** Got signal Terminated *** 2024-02-15T18:41:26.245 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:25 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:25.926+0000 7f28a31e4700 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:41:26.245 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:26.091+0000 7f289e15d700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:58.377760+0000 front 2024-02-15T18:40:58.377747+0000 (oldest deadline 2024-02-15T18:41:23.077791+0000) 2024-02-15T18:41:26.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:26 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:26.430+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:27.413 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:27.120+0000 7f289e15d700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:58.377760+0000 front 2024-02-15T18:40:58.377747+0000 (oldest deadline 2024-02-15T18:41:23.077791+0000) 2024-02-15T18:41:27.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:27 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:27.423+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:28.494 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:28.153+0000 7f289e15d700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:58.377760+0000 front 2024-02-15T18:40:58.377747+0000 (oldest deadline 2024-02-15T18:41:23.077791+0000) 2024-02-15T18:41:28.495 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:28 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:28.401+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:29.431 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:29.153+0000 7f289e15d700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:58.377760+0000 front 2024-02-15T18:40:58.377747+0000 (oldest deadline 2024-02-15T18:41:23.077791+0000) 2024-02-15T18:41:29.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:29.442+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:29.745 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:29 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:29.442+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T18:41:02.570010+0000 front 2024-02-15T18:41:02.570081+0000 (oldest deadline 2024-02-15T18:41:28.469895+0000) 2024-02-15T18:41:30.407 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4[64094]: debug 2024-02-15T18:41:30.152+0000 7f289e15d700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:58.377760+0000 front 2024-02-15T18:40:58.377747+0000 (oldest deadline 2024-02-15T18:41:23.077791+0000) 2024-02-15T18:41:30.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:30.417+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:30.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:30 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:30.418+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T18:41:02.570010+0000 front 2024-02-15T18:41:02.570081+0000 (oldest deadline 2024-02-15T18:41:28.469895+0000) 2024-02-15T18:41:31.494 INFO:journalctl@ceph.osd.4.smithi131.stdout:Feb 15 18:41:31 smithi131 bash[71037]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-4 2024-02-15T18:41:31.495 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:31.456+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:31.495 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:31 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:31.456+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T18:41:02.570010+0000 front 2024-02-15T18:41:02.570081+0000 (oldest deadline 2024-02-15T18:41:28.469895+0000) 2024-02-15T18:41:32.745 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:32.475+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:32.745 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:32 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:32.475+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T18:41:02.570010+0000 front 2024-02-15T18:41:02.570081+0000 (oldest deadline 2024-02-15T18:41:28.469895+0000) 2024-02-15T18:41:33.060 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.4.service' 2024-02-15T18:41:33.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:41:33.101 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-15T18:41:33.101 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-15T18:41:33.101 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.5 2024-02-15T18:41:33.419 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:33 smithi131 systemd[1]: Stopping Ceph osd.5 for fd0b1c90-cc2e-11ee-95ba-87774f69a715... 2024-02-15T18:41:33.419 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:33 smithi131 bash[71273]: Error: no container with name or ID "ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd.5" found: no such container 2024-02-15T18:41:33.419 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:33.429+0000 7f8bd2985700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-15T18:41:33.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:33.429+0000 7f8bd2985700 -1 osd.5 83 *** Got signal Terminated *** 2024-02-15T18:41:33.745 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:33.429+0000 7f8bd2985700 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-15T18:41:33.745 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:33.479+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:33.745 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:33 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:33.479+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T18:41:02.570010+0000 front 2024-02-15T18:41:02.570081+0000 (oldest deadline 2024-02-15T18:41:28.469895+0000) 2024-02-15T18:41:34.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:34.436+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:34.745 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:34 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:34.436+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T18:41:02.570010+0000 front 2024-02-15T18:41:02.570081+0000 (oldest deadline 2024-02-15T18:41:28.469895+0000) 2024-02-15T18:41:35.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:35.417+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:35.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:35 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:35.417+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T18:41:02.570010+0000 front 2024-02-15T18:41:02.570081+0000 (oldest deadline 2024-02-15T18:41:28.469895+0000) 2024-02-15T18:41:36.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:36.423+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:36.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:36 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:36.423+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T18:41:02.570010+0000 front 2024-02-15T18:41:02.570081+0000 (oldest deadline 2024-02-15T18:41:28.469895+0000) 2024-02-15T18:41:37.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:37.459+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-02-15T18:40:56.669513+0000 front 2024-02-15T18:40:56.669539+0000 (oldest deadline 2024-02-15T18:41:22.569450+0000) 2024-02-15T18:41:37.744 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:37 smithi131 ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5[66326]: debug 2024-02-15T18:41:37.459+0000 7f8bd0103700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.33:6814 osd.1 since back 2024-02-15T18:41:02.570010+0000 front 2024-02-15T18:41:02.570081+0000 (oldest deadline 2024-02-15T18:41:28.469895+0000) 2024-02-15T18:41:39.244 INFO:journalctl@ceph.osd.5.smithi131.stdout:Feb 15 18:41:38 smithi131 bash[71313]: ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715-osd-5 2024-02-15T18:41:40.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fd0b1c90-cc2e-11ee-95ba-87774f69a715@osd.5.service' 2024-02-15T18:41:40.653 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-15T18:41:40.653 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-15T18:41:40.654 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-15T18:42:02.911 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-15T18:42:14.427 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:42:14.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-15T18:42:14.497 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-15T18:42:14.498 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672/remote/ubuntu@smithi033.front.sepia.ceph.com/crash 2024-02-15T18:42:14.499 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/crash -- . 2024-02-15T18:42:14.540 INFO:teuthology.orchestra.run.smithi033.stderr:tar: /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-15T18:42:14.540 INFO:teuthology.orchestra.run.smithi033.stderr:tar: Error is not recoverable: exiting now 2024-02-15T18:42:14.542 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672/remote/ubuntu@smithi131.front.sepia.ceph.com/crash 2024-02-15T18:42:14.543 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/crash -- . 2024-02-15T18:42:14.569 INFO:teuthology.orchestra.run.smithi131.stderr:tar: /var/lib/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/crash: Cannot open: No such file or directory 2024-02-15T18:42:14.569 INFO:teuthology.orchestra.run.smithi131.stderr:tar: Error is not recoverable: exiting now 2024-02-15T18:42:14.570 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-15T18:42:14.570 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v 'Degraded data redundancy' | egrep -v '\(PG_' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T18:42:14.621 INFO:teuthology.orchestra.run.smithi033.stdout:2024-02-15T18:28:46.677499+0000 mon.smithi033 (mon.0) 506 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T18:42:14.622 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-15T18:42:14.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[SEC\]' /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v 'Degraded data redundancy' | egrep -v '\(PG_' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T18:42:14.699 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]' /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v 'Degraded data redundancy' | egrep -v '\(PG_' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T18:42:14.774 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[WRN\]' /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v 'Degraded data redundancy' | egrep -v '\(PG_' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-15T18:42:14.848 INFO:teuthology.orchestra.run.smithi033.stdout:2024-02-15T18:28:46.677499+0000 mon.smithi033 (mon.0) 506 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-15T18:42:14.849 INFO:tasks.cephadm:Compressing logs... 2024-02-15T18:42:14.849 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T18:42:14.890 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-15T18:42:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-15T18:42:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-15T18:42:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.mcppgd.log 2024-02-15T18:42:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi033.log 2024-02-15T18:42:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.mcppgd.log: gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi033.apxevf.log 2024-02-15T18:42:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-15T18:42:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi033.log: /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi033.apxevf.log: gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.2.log 2024-02-15T18:42:14.922 INFO:teuthology.orchestra.run.smithi131.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-15T18:42:14.922 INFO:teuthology.orchestra.run.smithi131.stderr:: No such file or directory 2024-02-15T18:42:14.922 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-15T18:42:14.922 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 /var/log/ceph/cephadm.log: --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-15T18:42:14.922 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-15T18:42:14.923 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi131.bgnwzs.log 2024-02-15T18:42:14.923 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.3.log 2024-02-15T18:42:14.923 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi131.bgnwzs.log: 86.9% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-15T18:42:14.923 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.3.log: 91.4% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-15T18:42:14.923 INFO:teuthology.orchestra.run.smithi131.stderr: 89.5% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-15T18:42:14.923 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi131.ywlevz.log 2024-02-15T18:42:14.923 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi131.log 2024-02-15T18:42:14.923 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi131.ywlevz.log: gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi131.buibla.log 2024-02-15T18:42:14.924 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi131.log: gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log 2024-02-15T18:42:14.925 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-volume.log: /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.2.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-15T18:42:14.925 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-15T18:42:14.925 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-15T18:42:14.925 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.audit.log: /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log: 90.5% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-15T18:42:14.925 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.0.log 2024-02-15T18:42:14.925 INFO:teuthology.orchestra.run.smithi033.stderr: 86.7% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-15T18:42:14.925 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.qszefh.log 2024-02-15T18:42:14.926 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi131.buibla.log: /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log: 90.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-15T18:42:14.926 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-15T18:42:14.926 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.4.log 2024-02-15T18:42:14.926 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.5.log 2024-02-15T18:42:14.927 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.0.log: /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.qszefh.log: 91.2% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-15T18:42:14.929 INFO:teuthology.orchestra.run.smithi033.stderr: 93.7% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.mcppgd.log.gz 2024-02-15T18:42:14.930 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log 2024-02-15T18:42:14.930 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.1.log 2024-02-15T18:42:14.933 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log: /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.1.log: 88.0% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-15T18:42:14.959 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.4.log: /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.5.log: 89.5% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi131.buibla.log.gz 2024-02-15T18:42:15.126 INFO:teuthology.orchestra.run.smithi131.stderr: 92.6% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi131.log.gz 2024-02-15T18:42:15.248 INFO:teuthology.orchestra.run.smithi033.stderr: 90.8% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mgr.smithi033.apxevf.log.gz 2024-02-15T18:42:15.783 INFO:teuthology.orchestra.run.smithi033.stderr: 90.6% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mon.smithi033.log.gz 2024-02-15T18:42:18.439 INFO:teuthology.orchestra.run.smithi033.stderr: 93.4% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.2.log.gz 2024-02-15T18:42:18.604 INFO:teuthology.orchestra.run.smithi131.stderr: 93.3% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.4.log.gz 2024-02-15T18:42:18.788 INFO:teuthology.orchestra.run.smithi033.stderr: 95.2% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi033.qszefh.log.gz 2024-02-15T18:42:19.060 INFO:teuthology.orchestra.run.smithi033.stderr: 93.5% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.0.log.gz 2024-02-15T18:42:19.641 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.5.log.gz 2024-02-15T18:42:19.663 INFO:teuthology.orchestra.run.smithi033.stderr: 93.4% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.1.log.gz 2024-02-15T18:42:19.664 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-02-15T18:42:19.665 INFO:teuthology.orchestra.run.smithi033.stderr:real 0m4.758s 2024-02-15T18:42:19.665 INFO:teuthology.orchestra.run.smithi033.stderr:user 0m16.872s 2024-02-15T18:42:19.665 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m0.605s 2024-02-15T18:42:21.330 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-osd.3.log.gz 2024-02-15T18:42:52.383 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi131.ywlevz.log.gz 2024-02-15T18:43:03.087 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/fd0b1c90-cc2e-11ee-95ba-87774f69a715/ceph-mds.cephfs.smithi131.bgnwzs.log.gz 2024-02-15T18:43:03.089 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-02-15T18:43:03.089 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m48.181s 2024-02-15T18:43:03.089 INFO:teuthology.orchestra.run.smithi131.stderr:user 1m37.032s 2024-02-15T18:43:03.089 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m3.362s 2024-02-15T18:43:03.089 INFO:tasks.cephadm:Archiving logs... 2024-02-15T18:43:03.090 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672/remote/ubuntu@smithi033.front.sepia.ceph.com/log 2024-02-15T18:43:03.091 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T18:43:05.533 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672/remote/ubuntu@smithi131.front.sepia.ceph.com/log 2024-02-15T18:43:05.534 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-15T18:43:20.403 INFO:tasks.cephadm:Removing cluster... 2024-02-15T18:43:20.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 --force 2024-02-15T18:43:20.748 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fd0b1c90-cc2e-11ee-95ba-87774f69a715 --force 2024-02-15T18:43:21.181 INFO:tasks.cephadm:Removing cephadm ... 2024-02-15T18:43:21.182 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-15T18:43:21.202 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-15T18:43:21.219 INFO:tasks.cephadm:Teardown complete 2024-02-15T18:43:21.220 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-15T18:43:21.234 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-15T18:43:21.235 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T18:43:21.244 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-15T18:43:21.334 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-15T18:43:21.348 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-15T18:43:21.349 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T18:43:21.351 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-15T18:43:21.367 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2024-02-15T18:43:21.368 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2024-02-15T18:43:21.371 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T18:43:21.371 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-02-15T18:43:21.371 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 2 +1257us[+1257us] +/- 114ms 2024-02-15T18:43:21.371 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 +185us[ +199us] +/- 65ms 2024-02-15T18:43:21.372 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 -938us[ -938us] +/- 72ms 2024-02-15T18:43:21.372 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:43:21.373 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-15T18:43:21.374 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-02-15T18:43:21.374 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 1 +1262us[+1262us] +/- 114ms 2024-02-15T18:43:21.374 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv02.front.sepia.ceph.com 3 6 377 1 +196us[ +220us] +/- 65ms 2024-02-15T18:43:21.374 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -928us[ -928us] +/- 72ms 2024-02-15T18:43:21.374 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-15T18:43:21.374 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-15T18:43:21.390 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-15T18:43:21.391 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-15T18:43:21.426 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T18:43:21.494 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-15T18:43:21.556 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T18:43:21.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:43:21.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-15T18:43:21.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:43:21.617 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-15T18:43:21.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-15T18:43:21.660 INFO:teuthology.task.internal:Duration was 1925.585479 seconds 2024-02-15T18:43:21.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-15T18:43:21.711 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-15T18:43:21.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T18:43:21.713 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-15T18:43:21.759 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T18:43:21.759 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-15T18:43:22.056 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-15T18:43:22.056 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-02-15T18:43:22.056 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T18:43:22.080 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-02-15T18:43:22.080 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-15T18:43:22.105 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-15T18:43:22.106 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T18:43:22.122 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-15T18:43:22.201 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-15T18:43:22.202 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T18:43:22.204 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-15T18:43:22.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-15T18:43:22.341 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-15T18:43:22.341 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T18:43:22.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-15T18:43:22.397 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-15T18:43:22.410 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T18:43:22.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-15T18:43:22.437 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-02-15T18:43:22.464 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-02-15T18:43:22.476 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T18:43:22.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:43:22.509 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-15T18:43:22.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-15T18:43:22.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-15T18:43:22.550 INFO:teuthology.task.internal:Transferring archived files... 2024-02-15T18:43:22.551 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672/remote/smithi033 2024-02-15T18:43:22.551 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T18:43:22.598 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672/remote/smithi131 2024-02-15T18:43:22.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-15T18:43:22.641 INFO:teuthology.task.internal:Removing archive directory... 2024-02-15T18:43:22.641 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T18:43:22.644 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-15T18:43:22.693 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-15T18:43:22.709 INFO:teuthology.task.internal:Not uploading archives. 2024-02-15T18:43:22.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-15T18:43:22.746 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-15T18:43:22.747 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T18:43:22.749 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-15T18:43:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 18:43 /home/ubuntu/cephtest 2024-02-15T18:43:22.767 INFO:teuthology.orchestra.run.smithi131.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 15 18:43 /home/ubuntu/cephtest 2024-02-15T18:43:22.768 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-15T18:43:22.796 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-15T18:43:22.893 INFO:teuthology.nuke:Checking targets against current locks 2024-02-15T18:43:22.916 DEBUG:teuthology.nuke:shortname: smithi033 2024-02-15T18:43:22.917 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T18:43:22.940 DEBUG:teuthology.nuke:shortname: smithi131 2024-02-15T18:43:22.940 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-15T18:43:22.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 18:02:03.844136', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLp96ZRxQN9N+nH0qrq0TEywwWP32HcKsQuOKtxOu8hH12MvrhU7+yZ+awHgK64KBGnoKlNadKXVduU2+hRz6NI='} 2024-02-15T18:43:22.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-15_17:32:20-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7561672', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-15 18:02:03.845875', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGUvwgyOe28lqMqMlRL7eAi84fSEoBjU5lI2ulahbQK5RRWkr0mgW0q1/gMr1/UKChD3vDp6gYEvlgIHfjzzcKg='} 2024-02-15T18:43:22.992 INFO:teuthology.orchestra.console.smithi033:Power off 2024-02-15T18:43:22.992 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T18:43:23.025 INFO:teuthology.orchestra.console.smithi131:Power off 2024-02-15T18:43:23.025 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-15T18:43:23.035 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-02-15T18:43:23.036 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:43:23.052 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2024-02-15T18:43:23.053 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:43:23.063 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-02-15T18:43:23.080 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-02-15T18:43:27.064 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:43:27.081 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:43:27.175 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-02-15T18:43:27.191 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-02-15T18:43:31.180 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:43:31.192 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-15T18:43:31.290 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-02-15T18:43:31.301 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-02-15T18:43:31.391 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-02-15T18:43:31.402 INFO:teuthology.orchestra.console.smithi131:Power off completed 2024-02-15T18:43:31.510 INFO:teuthology.run:Summary data: description: rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} duration: 1925.585479259491 failure_reason: '"2024-02-15T18:28:46.677499+0000 mon.smithi033 (mon.0) 506 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log' flavor: default owner: scheduled_lflores@teuthology success: false 2024-02-15T18:43:31.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-15T18:43:31.592 INFO:teuthology.run:FAIL