Actions

Testing Area/Manual regression testing: Difference between revisions

From Mahara Wiki

< Testing Area
Line 110: Line 110:
<div class="toccolours mw-collapsible mw-collapsed" style="background:#c7d6c6">
<div class="toccolours mw-collapsible mw-collapsed" style="background:#c7d6c6">


====Manual Test script scenarios for default Dashboard page====
====Manual test scenarios for Dashboard page====
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">


<div class="toccolours mw-collapsible mw-collapsed">
<div class="toccolours mw-collapsible mw-collapsed">
:::'''Manual Test Scenario:''' Person should see correct page styling
:::'''Dashboard Scenario 1:''' Site admin should see correct Dashboard page content and styling
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
{| style="float:right; margin-left: 10px;"
{| style="float:right; margin-left: 10px;"
|----
|----
|[[File:Raw theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px| Raw theme]]
|[[File:Primary school theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Primary school theme]]
|[[File:Primary school theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Primary school theme]]
|[[File:Raw theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px| Raw theme]]
|[[File:Default theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Default theme]]
|[[File:Default theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Default theme]]
|[[File:Ocean theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Ocean theme]]
|[[File:Ocean theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Ocean theme]]
Line 127: Line 125:
|----
|----
|}  
|}  
::::'''Given''' person is logged in
::::'''Given''' Site admin has an active Mahara site administrator account
::::'''When''' user is on the "Mahara homepage"
::::'''When''' they successfully complete the Mahara log in process
::::'''Then''' user should see "Raw" theme colours
::::'''Then''' they should see correct page content and styling for the default site administrator Dashboard page.
<!-- <span style="color:red">Compare the page with the screenshots for correct theme colours</span> -->
<!-- <span style="color:red">Compare the page with the screenshots for correct theme colours</span> -->


</div>
</div>
</div>
</div>


<div class="toccolours mw-collapsible mw-collapsed">
<div class="toccolours mw-collapsible mw-collapsed">
:::'''Manual Test Scenario:''' "Registration" links to "Registration" page
:::'''Dashboard Scenario 2:''' PersonA should see correct page content and styling
<div class="mw-collapsible-content">
<div class="mw-collapsible-content">
{| style="float:right; margin-left: 10px;"
{| style="float:right; margin-left: 10px;"
|----
|----
|[[File:Ocean theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Registration page Ocean theme]]
|[[File:Raw theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px| Raw theme]]
|[[File:Modern theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Registration page Modern theme]]
|[[File:Primary school theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Primary school theme]]
|[[File:Primary school theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Registration page Primary school theme]]
|[[File:Default theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Default theme]]
|[[File:Raw theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Registration page Raw theme]]
|[[File:Ocean theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Ocean theme]]
|[[File:Modern theme - Dashboard - Mahara - 04 - 04 - 2018.png|thumb|200px|Modern theme]]
|----
|----
|}
|}  
 
::::'''Given''' PersonA has an active non-administrative Mahara account
::::'''Given''' I am on homepage
::::'''When''' they successfully complete the Mahara log in process
::::'''When''' I follow "Register"
::::'''Then''' they should see correct page content and styling for the default Dashboard page.
::::''' And I fill in the following:
<!-- <span style="color:red">Compare the page with the screenshots for correct theme colours</span> -->
::::::: | First name | Lightening |
::::::: | Last name | McQueen |
::::::: | Email address | [email protected] |
::::::: | Registration reason | I will absolutely make this institution more amazing!! |
::::'''And''' I press "Send request"
::::'''Then''' I should see "You should receive an email shortly with a link that you can use to change the password for your account."
::::'''And''' email is recieved <span style="color:red">- this requires a manual inspection of email address to ensure email was sent and is correct</span>


</div>
</div>

Revision as of 17:16, 6 Haziran 2020

This page outlines the manual regression testing for Mahara releases (6 monthly cycle; YY.04 and YY.10). Automated (unit and Behat) and manual testing is performed during the release development period for each Launchpad/Gerrit change ticket prior to its merge into the master branch. Regression testing is then performed upon the release candidate prior to its actual go-live. This page contains an overview of the manual regression testing i.e. coverage of functionality, such as email interaction that is not yet being addressed by automated testing, and overall browser based screen presentation. Further regression testing detail can be found in the release based regression testing spreadsheets that are saved in the Seafile based Mahara community file share area at <somewhere, put link in>.

Manual Regression Testing Preconditions

For manual regression testing it is assumed that:

  1. a fresh install of Mahara has taken place and "Password" and "email" are set for the initial Site admin login
  2. there is a fresh database with no data
  3. Mahara emails have been set to be delivered to an inbox the tester has access to (via config.php & see next point's 'Site settings')
  4. the theme will be (re-)set by the Site admin in Admin menu > Configure site > Site options > Site settings
  5. at least one account (named PersonA) other than the Site admin account is active (via manual individual account add or csv file account creation)
  6. the default browser (used to take the actual result screen shots) is currently Chrome running on a Windows10 (virtual) machine
  7. other test platforms include Win10-Edge and Win10-Firefox (OSx-Safari if time permits)
  8. the latest stable browser versions are used.


Manual test scenarios for LogIn and Logged Out (Home) pages

Manual Test Scenario: Mahara "Homepage" content and styling.
Raw theme
Primary school theme
Ocean theme
Modern theme
Given person has their browser open
When person enters the correct URL for Mahara
Then they should see the "Mahara homepage" content displayed in the correct theme colours and style.
Manual Test Scenario: "Registration" links to "Registration" page
Raw theme
Primary school theme
Ocean theme
Modern theme
Given I am on homepage
When I follow "Register"
And I fill in the following:
| First name | Lightening |
| Last name | McQueen |
| Email address | [email protected] |
| Registration reason | Mid year Institution transfer (refer to correspondence id 347856). |
And I press "Send request"
Then I should see "You should receive an email shortly with a link that you can use to change the password for your account."
And an email is received - manually inspect email to ensure email was sent and is correct.
Manual Test Scenario: Successfully reset password
Reset Email Instructions
Given I am on homepage
When I follow "Lost username / password"
And I fill in "Email address or username" with "PersonA"
And I press "Send request"
Then I should see "You should receive an email shortly with a link that you can use to change the password for your account."
And an email is received - manually inspect inbox to ensure email was sent and is correct.
When I follow "Email confirmation link"
Then I fill in "New password" with ".3Kg@4!O"
And I fill in "Re-enter password" with ".3Kg@4!O"
And I press "Send request"
Then I should see my Dashboard displayed.
Manual Test Scenario: Logged out person should see correct page content and styling
Raw theme
Primary school theme
Ocean theme
Modern theme
Given person has their browser open
When person enters the correct URL for Mahara
Then they should see the "Mahara homepage" content displayed in the correct theme colour and style.


Manual test scenarios for Dashboard page

Dashboard Scenario 1: Site admin should see correct Dashboard page content and styling
Raw theme
Primary school theme
Ocean theme
Modern theme
Given Site admin has an active Mahara site administrator account
When they successfully complete the Mahara log in process
Then they should see correct page content and styling for the default site administrator Dashboard page.
Dashboard Scenario 2: PersonA should see correct page content and styling
Raw theme
Primary school theme
Ocean theme
Modern theme
Given PersonA has an active non-administrative Mahara account
When they successfully complete the Mahara log in process
Then they should see correct page content and styling for the default Dashboard page.


Manual Test Scenario: User clicks "Lost username / password" to receive an email to log into site
Reset Email Instructions
Given I am on homepage
When I follow "Lost username / password"
And I fill in "Email address or username" with "UserA"
And I press "Send request"
Then I should see "You should receive an email shortly with a link that you can use to change the password for your account."
And email is recieved - this requires a manual inspection of email address to ensure email was sent and is correct



Manual Test script scenarios for Profile pages

Manual Test Scenario: User should see correct page styling
Ocean theme
Modern theme
Primary school theme
Raw theme


  1. Visual check
    1. Profile page uses correct colour "Raw"
    2. header elements displayed
    3. Static Profile Page title h1 displayed
    4. online users block displayed
    5. footer is displayed and links functioning correctly
  2. Change page "Layout" functionality works
  3. Change page "Skin" functionality works
  4. Page edit functionality works Create edit and delete page blocks
  5. Page links working Tester can use Chrome extension Link Checker or dev tools to determine "200 code return"
Manual Test Scenario: Multiple Email Functionality
Multiple Email
Scenario: Only one email address: There should not be a delete button as the only email address cannot be deleted.
Given user logged in
And has one email address
And is on the Profile > Contact information page
When user clicks the delete icon to right of email address
Then user should see message "You cannot remove your primary email address." displayed
And the email address will not be deleted


Scenario: One or more email addresses: The primary email does not have delete button. When the primary address is changed, it should receive the delete button and the now primary email address gets it removed.
Multiple Email Addresses
Given user logged in
And has more than one email address
And user has validated the email mail address
When user is on the Profile > Contact information page
And user has selected the second email address
And clicks the delete icon associated with the first email in the list
And then the first email in the list will be deleted



Manual test scenarios for Create pages

Manual Test Scenario: User should see correct page styling
Raw theme
Primary school theme
Ocean theme
Modern theme
  1. Visual check
    1. Profile page uses correct colour "Raw"
    2. header elements displayed
    3. Static Profile Page title h1 displayed
    4. online users block displayed
    5. footer is displayed and links functioning correctly
  2. Change page "Layout" functionality works
  3. Change page "Skin" functionality works
  4. Page edit functionality works Create edit and delete page blocks
  5. Page links working Tester can use Chrome extension Link Checker or dev tools to determine "200 code return"


Manual Test script scenarios for Leap2A import

Manual Test Scenario: User can upload a Leap2A file
Leap2a import page
Leap2A imported data


Preconditions:

  1. User has a Leap2A zip file from a previous export of all of "Admin User" data.
  2. user has unzipped the file which should include
    1. files folder containing image files, document files that have been used on users's profile/portfolio
    2. leap2a.xml file

Test Script:

  1. user (someone other than admin) log in
  2. Browse to Main menu > Portfolio > Import
  3. Click the choose a file and upload the "leap2a.xml" file of the Admin User profile
  4. Click the import button
  5. Confirm you see the all the data that will be imported
  6. Select the information you want to ignore, append, replace or add new
  7. click the "Import" button
  8. Note that you will have to upload the files into the folders
  9. view the areas that you have added ie Portfolio pages
  10. confirm that the new pages are displayed with the content on the pages





Manual Test script scenarios for Content Files

Manual Test Scenario: User should see correct page styling
Files page 24-05-18-10-52-37.png


  1. Visual check
    1. Files page uses correct colour
    2. header elements displayed
    3. online users block displayed
    4. Quota block displayed
    5. footer is displayed and links functioning correctly



Manual Test Scenario: User "Quota" block updates as files are added
  1. Confirm that when files are added the Quota block updates and the display bar is filled in accordingly.



Manual Test Scenario: Image files can be edited and rotated
Preconditions:
  1. User has Image files loaded into Mahara
  2. User has document files loaded into Mahara
Test Script:
  1. User browse to Main menu > Content > Files
  2. User edit an Image file by clicking the pencil icon to right of image file
  3. Confirm there is an rotate icon to right of image in the Edit file section of the page
  4. Click the rotate icon
  5. Confirm that the image preview rotates 1/4 turn to the right each time the rotate icon is clicked



Manual Test script scenarios for Drag N Drop Functionality

Manual Test Scenario: User should be able to drag and drop files to a page for upload
Files Drag N Drop Feature 22-06-18-13-25-43.png
Preconditions:
  1. User has Image files on their local machine
  2. User has document files on their local machine
Test Script:
  1. User browse to Main menu > Content > Files
  2. Confirm that there is a "Drop files here to upload" section on the page
  3. User open the file browser for their local machine
  4. User browse to a file to upload to Mahara
  5. using the cursor, hover over the desired file
  6. click and hold while draging the file to the dark grey Drag N Drop section of the Page
  7. release the click
  8. Confirm that the file is uploaded and a message is displayed as follows :Upload of <file name> complete
  9. Repeat the above steps for different file types that Mahara will accept (ie.. image file types jpg png, document file types docx, PDF)