Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

squid: qa: cephfs quiesce thrasher #57555

Closed
wants to merge 8 commits into from
Closed

Conversation

leonid-s-usov
Copy link
Contributor

@leonid-s-usov leonid-s-usov commented May 20, 2024

Fixes: https://tracker.ceph.com/issues/66103

Backport 1:

Original-issue: https://tracker.ceph.com/issues/63669
Original-PR: #55823

Backport 2:

Original-issue: https://tracker.ceph.com/issues/65823
Original-PR: #57302

Backport 3:

Original-issue: https://tracker.ceph.com/issues/66046
Original-PR: #57274

Show available Jenkins commands
  • jenkins retest this please
  • jenkins test classic perf
  • jenkins test crimson perf
  • jenkins test signed
  • jenkins test make check
  • jenkins test make check arm64
  • jenkins test submodules
  • jenkins test dashboard
  • jenkins test dashboard cephadm
  • jenkins test api
  • jenkins test docs
  • jenkins render docs
  • jenkins test ceph-volume all
  • jenkins test ceph-volume tox
  • jenkins test windows
  • jenkins test rook e2e

Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
(cherry picked from commit ed6e3f8)
Fixes: https://tracker.ceph.com/issues/66103
The new mode of the vstart_runner allows for passing
paths to yaml configs that will be merged and then
run just as the teuthology would do it.
Building on the standard run method we can even
pass "-" as the config name and provide one on the stdin like

    python3 ../qa/tasks/vstart_runner.py --config-mode "-" << END
    tasks:
      - quiescer:
          quiesce_factor: 0.5
          min_quiesce: 10
          max_quiesce: 10
          initial_delay: 5
          cancelations_cap: 2
          paths:
            - a
            - b
            - c
      - waiter:
          on_exit: 100
    END

This commit does the minimum to allow testing of the quiescer,
but it also lays the groundwork for running arbitrary configs.

The cornerstone of the approach is to inject our local implementations
of the main fs suite classes. To be able to do that, some minor
refactoring was required in the corresponding modules:
the standard classes were renamed to have a *Base suffix, and the
former class name without the suffix is made a module level variable
initialized with the *Base implementation. This refactoring
is meant to be backward compatible.

Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
(cherry picked from commit 274849e)
Fixes: https://tracker.ceph.com/issues/66103
…e context

Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
(cherry picked from commit 329edd3)
Fixes: https://tracker.ceph.com/issues/66103
Fixes: https://tracker.ceph.com/issues/63669
Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
(cherry picked from commit 7773c5d)
Fixes: https://tracker.ceph.com/issues/66103
Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
(cherry picked from commit d6f8d65)
Fixes: https://tracker.ceph.com/issues/66103
@leonid-s-usov leonid-s-usov requested a review from a team May 20, 2024 07:22
@github-actions github-actions bot added cephfs Ceph File System tests labels May 20, 2024
Since this --flags=locks takes the mds_lock and dumps thousands of ops, this
may take a long time to complete for each individual MDS. The entire quiesce
set may timeout (and all q ops killed) before we finish dumping ops.

Fixes: https://tracker.ceph.com/issues/65823
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 15f734e)
Fixes: https://tracker.ceph.com/issues/66103
Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
Fixes: https://tracker.ceph.com/issues/65803
(cherry picked from commit ae6b388)
Fixes: https://tracker.ceph.com/issues/66103
Signed-off-by: Leonid Usov <leonid.usov@ibm.com>
Fixes: https://tracker.ceph.com/issues/65803
(cherry picked from commit a4dc881)
Fixes: https://tracker.ceph.com/issues/66103
@leonid-s-usov
Copy link
Contributor Author

These fixes will be part of the batch backport PR #57730

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cephfs Ceph File System tests
Projects
None yet
3 participants