Feature Requests & Ideas

For bug reports and questions, please use the in-app chat or support@mabl.com.

On/Off toggle for Tests at the Test level

Statements:
AC1. As a mabl user, I want to disable individual tests on the Test detail page, so that I don't have to edit n-number of Plans whenever a Test needs to be turned off for any reason.

AC2. As a mabl user, I want to disable individual tests on the Tests landing page, so that I don't have to edit n-number of Plans whenever a Test needs to be turned off for any reason.

Current workflow:
- Open the Test
- Note the Plan(s) it's a member of
- Open each Plan
- Edit each Plan
- Scroll down to the tests list
- Remove the Test
- Save the Plan

Proposed workflows:
AC1. Open the Test
- (new) Click the Test On/Off toggle button
- (new) mabl only runs Test(s) that are Enabled as part of any Plan execution, potentially with an ad-hoc override option for "Run disabled tests too?" at the Plan-level

AC2. Go to Tests page
- (new) Click the Test On/Off toggle button on a per row item basis

Business cases:
In my particular use case, our trial of mabl ended and the tests using the trial-only features had to be disabled.  Instead of just turning them off (like we can do at the Plan-level for Plans), I had to open/edit/save 6 separate Plans to remove the affected Tests.  Additionally I'll now have to go back and re-add all of those tests where they were originally.

I could very easily see this being useful in cases where a flaky test has flaked one-too-many times, an unexpected app crash is blocking other automation from executing, the edits necessary to accommodate breaking UI changes aren't ready yet, and a number of others where you need to disable a Test but don't want the headache of having to remap it to all of its Plan(s).

  • Stephen
  • Jan 3 2020
  • For Consideration
  • Attach files
  • Admin
    Anton Hristov commented
    06 Jan 13:58

    Thanks for the detailed feedback, Stephen. We are definitely considering ways to provide more flexibility when it comes to managing and running tests independent of plans. In the meantime, you can try managing the plans for a given test from the the plans tab on the test details page as showing in the attached screenshot. From there you can quickly remove/add a test to multiple plans instead of going to each plan.


     
  • Stephen commented
    10 Jan 16:44

    Np and thanks for the suggestion Anton!
    The affected Plans have both sequential (logged in user) and parallel (anon user) sets of Tests assigned to them so I can't just add/remove en masse.   I realize I could probably rework the Plans into a different setup but haven't spent the time to pick it apart yet.

Copyright © 2019 mabl Inc. All rights reserved.