Acceptance Criteria, Test Scripts & Testing
Spec Teams, SME Teams and SA's will be called upon to participate in the testing of OLE. This begins during the documentation of User Requirements (Acceptance Criteria), continues as coding is begun to formulate Test Scripts, and culminates in user testing/executing Test Scripts.
<A href="https://docs.google.com/a/kuali.org/leaf?id=0BwTriR_vU83hTXB1c3BiM2tTQmEtWWNJM1gzbzBqUQ&hl=en_US
" mce_href="https://docs.google.com/a/kuali.org/leaf?id=0BwTriR_vU83hTXB1c3BiM2tTQmEtWWNJM1gzbzBqUQ&hl=en_US
" target="_Blank">OLE QA/Testing</A>
(link to Google Docs)
Testing Approach
- Specification team or SME Team nomination of a team member to be the testing coordinator for the stories
- Acceptance criteria needs to be very clear
- QA/SA anticipate producing an independent document back to the team and/or testing coordinator for sign off
- After acceptance criteria generated and during the coding effort, QA Manager/Testing team will work with the spec team testing coordinator (or designate) to develop step by step detailed test scripts
- Once coding is complete, QA Manager will work with the testing coordinator to actually test the code based on the scripts
- We expect at least one tester will make a recording of the test script with Selenium IDE (a test script recorder)
- Training and directions for storing the recording will be provided by QA Manager.
Acceptance Criteria
Sample from Loading Records:
Sample: Acceptance Criteria
Acceptance criteria (otherwise known as "fit criteria" or "test completion criteria") define the boundaries of a user story, and are used to confirm when a story is completed and working as intended. AC should quantify the behavior, the performance or some other demonstrable quality of the final end product (coded function).
Including acceptance criteria is required as part of User Stories & Requirements so that:
- Users think through how a feature or piece of functionality will work from the user’s perspective
- We remove ambiguity from requirements
- AC form the basis for user tests & test scripts that will confirm that a feature or piece of functionality is working and complete.
Acceptance criteria may test the entire user story, or if multiple user stories are combined into one spec, then multiple acceptance criteria may need to be written.
Examples:
- User Story:As a Data Creator, I create purchase orders for a resource linked to a bib and/or item record (create PO).
- Acceptance Criteria:
- A user must be able to allocate multiple fund codes across line items and within each line item being ordered.
- An Item record is created for every PO line item.
- I must be able to place orders to vendors in USD or foreign currency.
- User Story:As a Selector, I need a holding area for items for potential future actions (Order Holding Queue).
- Acceptance Criteria:
- A selector must be able to search Requisitions, and then select requisitions to calculate totals across multiple requisitions selected.
- A selector, with proper permissions, should be able to "take" or "assign" requisitions to Selectors.
Test Scripts
Test Scripts will require additional "testing" designated SMEs from Spec teams or functional areas to work with the QA Manager to develop Test Scripts based on the Acceptance Criteria developed in User Requirements.
Additional KFS-related Test Script Resources:
- KFS Functional Testing (reference only)
- Resources/Templates: KFS-Jira Test Scenarios for PURAP.
- Maintenance Docs run-throughs: KFS Maintenance Docs
- Vendor run-throughs: KFS Vendor test docs
- KFS PURAP e-doc tests:(to formulate search, biz rules)
- See: KFS 4.1 Driver's Manual (scenarios)
- Users/Routing Template: KFS PURAP Roles-Permissions
User Acceptance Testing
(coming soon)
<A href=" https://docs.google.com/a/kuali.org/document/d/1s_tNEEDo19uSpMeyEXzzxwStzfnc4Tw8A_s03-mSYKk/edit?hl=en_US" mce_href=" https://docs.google.com/a/kuali.org/document/d/1s_tNEEDo19uSpMeyEXzzxwStzfnc4Tw8A_s03-mSYKk/edit?hl=en_US" target="_Blank">Draft OLE QA Plan</A>
, May 2011
SME Team Spec Testers
SME Team |
SME SA |
Spec Team |
Spec Team Lead |
Tester Member |
---|---|---|---|---|
Deliver |
Stuart Miller |
Circulation |
Stuart Miller; Chris Case |
Karen Newbery (Duke) Keith Welch (IU) Andrea Loigman (Penn) |
Deliver |
Stuart Miller |
Course Reserve |
|
|
Deliver |
Stuart Miller |
ILL |
|
|
Deliver |
Stuart Miller |
Patron Records |
Stuart Miller; Chris Case |
Cheryl Malmborg |
Describe |
Michelle Suranofsky |
Authority |
|
Research Group Only – nothing to test |
Describe |
Michelle Suranofsky |
Instance |
Jackie Byrd |
Gary Charbonneau, Jackie Byrd |
Describe |
Michelle Suranofsky |
Editor |
Michelle Suranofsky |
Doreen Herold |
S&A/MER |
Emily Lynema |
Sturgis/License |
Tim McGeary |
Clara Ruttenberg |
S&A/MER |
Emily Lynema |
Trials |
Roseann Bowerman; Jean Johnson; Michelle Suranofsky |
|
S&A |
Bob Persing |
Darby |
Carlen Ruschoff |
Gloria Hamilton |
S&A |
Bob Persing |
Financial Integrations |
|
|
S&A |
Bob Persing |
Load Records |
Gwyneth Duncan |
Janet Fox |
S&A |
Bob Persing |
Order Resource |
Michele Crump; Stuart Miller |
|
S&A |
Bob Persing |
Pay for Item |
Marty Berryman |
Shelia Webb |
S&A |
Bob Persing |
Receive Resource |
Bev Dowdy; Ros Raeford |
Angie Ohler |
S&A |
Bob Persing |
Redwood/Budgeting |
Bob Persing |
Marty Berryman |
S&A |
Bob Persing |
Serials |
Julie Stauffer |
Pam Owens |
Operated as a Community Resource by the Open Library Foundation