Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integration Test #2 SMILE Teacher + SMILE Plug Server #118

Closed
truedat101 opened this issue Jan 20, 2014 · 7 comments
Closed

Integration Test #2 SMILE Teacher + SMILE Plug Server #118

truedat101 opened this issue Jan 20, 2014 · 7 comments
Assignees
@chrqls

Comments

@truedat101
Copy link
Contributor

We need to complete a full batch of testing against the current versions. The description below is a complete matrix of the testing needed. The task will be to run through a complete integration test using the test plan below. Copy the results into subsequent comments to this issue. It is expected that complete test runs may not be possible if there are P1 issues found. We may need to re-run the test plan. In these cases, provide a new cut-n-paste of the results below with details of the test run. We must only be testing tagged & released code at this point. @truedat101 will provide the tags to use for testing.

Successful completion will allow us to continue with a test against the firmware on a SMILE Plug: SMILEConsortium/smileplug-bsp#19

Test Plan

DATE:, < INSERT DATE >
Tester Github ID:, < INSERT TESTER ID >
SMILE Android Version:,< INSERT VERSION >
SMILE Server Version:, < INSERT VERSION >
HOST OS:, < INSERT VERSION >
Android Device Model:, < INSERT MODEL >
Android OS Version:, < INSERT OS VERSION >
Android Browser & Version:, < INSERT BROWSER and VERSION >
*Desktop Browser & Version, < INSERT BROWSER and VERSION >
Number of Student Web Clients:, 3

Scenario 1: Run session and let students create the questions

  1. ,TEACHER APP : Start teacher app, Pass 👍 [ ] Fail 👎 [ ]
  2. ,_TEACHER_APP : Verify Login Panel appears well formated for screen, Pass 👍 [ ] Fail 👎 [ ]
  3. ,TEACHER APP : Verify IP address is default: 10.1.0.1, Pass 👍 [ ] Fail 👎 [ ]
  4. ,TEACHER APP : Verify invalid IP address is not possible, Pass 👍 [ ] Fail 👎 [ ]
  5. ,TEACHER APP : Start teacher app, Pass 👍 [ ] Fail 👎 [ ]
  6. ,SERVER: Startup server as root on port 80, Pass 👍 [ ] Fail 👎 [ ]
  7. ,TEACHER APP : Verify connect success, Pass 👍 [ ] Fail 👎 [ ]
  8. ,TEACHER APP : Verify cancel button, Pass 👍 [ ] Fail 👎 [ ]
  9. ,TEACHER APP : Verify connect (again), Pass 👍 [ ] Fail 👎 [ ]
  10. ,STUDENT WEB : Verify user can reach login page, Pass 👍 [ ] Fail 👎 [ ]
  11. ,STUDENT WEB : Verify user can login, Pass 👍 [ ] Fail 👎 [ ]
  12. ,STUDENT WEB : Verify user on 'Get Ready' phase, Pass 👍 [ ] Fail 👎 [ ]
  13. ,TEACHER APP : Input Teacher session info and hit create, Pass 👍 [ ] Fail 👎 [ ]
  14. ,TEACHER APP : Verify Teacher can select Start Making Questions, Pass 👍 [ ] Fail 👎 [ ]
  15. ,TEACHER APP : Verify connect success, Pass 👍 [ ] Fail 👎 [ ]
  16. ,TEACHER APP : Verify at Students Screen with at least one student present, Pass 👍 [ ] Fail 👎 [ ]
  17. ,STUDENT WEB : Verify Student at Start Make Questions phase, Pass 👍 [ ] Fail 👎 [ ]
  18. ,STUDENT WEB : Verify there are no major layout or UI defects, Pass 👍 [ ] Fail 👎 [ ]
  19. ,STUDENT WEB : Verify Student can make a question without an image, Pass 👍 [ ] Fail 👎 [ ]
  20. ,STUDENT WEB : Verify Student can make a question with an image (must use image < 1MB), Pass 👍 [ ] Fail 👎 [ ]
  21. ,STUDENT WEB : Repeat previous two steps for each additional web client, Pass 👍 [ ] Fail 👎 [ ]
  22. ,TEACHER APP : Verify questions are received for each student, Pass 👍 [ ] Fail 👎 [ ]
  23. ,TEACHER APP : Verify teacher can view Question Detail (images should be available to view) for each question sent, Pass 👍 [ ] Fail 👎 [ ]
  24. ,TEACHER APP : Verify 'Start Solving Questions' button is available, and starts 'solving' phase when clicked, Pass 👍 [ ] Fail 👎 [ ]
  25. ,STUDENT WEB : Verify Student in 'Answer Questions' phase, Pass 👍 [ ] Fail 👎 [ ]
  26. ,STUDENT WEB : Verify Number of Questions listed is equal to number of questions teacher sees, Pass 👍 [ ] Fail 👎 [ ]
  27. ,STUDENT WEB : Verify Student can answer questions and select a positive or negative rating, Pass 👍 [ ] Fail 👎 [ ]
  28. ,STUDENT WEB : Repeat previous two steps for each additional web client, Pass 👍 [ ] Fail 👎 [ ]
  29. ,STUDENT WEB : Verify Student can submit answers when finished, should see 'waiting' message, Pass 👍 [ ] Fail 👎 [ ]
  30. ,TEACHER APP : Verify in Students tab that all students have answered all questions, Pass 👍 [ ] Fail 👎 [ ]
  31. ,TEACHER APP : Verify click on 'Finish Show Results' causes results to display, Pass 👍 [ ] Fail 👎 [ ]
  32. ,STUDENT WEB : Verify Student can review results, Pass 👍 [ ] Fail 👎 [ ]
  33. ,STUDENT WEB : Verify Student can view question details for each question: Pass 👍 [ ] Fail 👎 [ ]
  34. ,TEACHER APP : Verify in Students Tab the results are showing with correct Top Scorer Correct % completion Correct % right Pass 👍 [ ] Fail 👎 [ ]
  35. ,TEACHER APP : Verify Teacher can save all questions into new iqset "IT2 set 1", Pass 👍 [ ] Fail 👎 [ ]
  36. ,TEACHER APP : Verify "Restart" menu sends each student back to Login Screen , Pass 👍 [ ] Fail 👎 [ ]
  37. ,IQManager : Verify Session was created and is viewable in the sessions list , Pass 👍 [ ] Fail 👎 [ ]
  38. ,IQManager : Verify Details of Session , Pass 👍 [ ] Fail 👎 [ ]
  39. ,IQManager : Verify IQ Set exists called "IT2 set1" , Pass 👍 [ ] Fail 👎 [ ]
  40. ,IQManager : Verify IQ Set details are correct and images can be loaded, Pass 👍 [ ] Fail 👎 [ ]

Scenario 2: Run session and use prepared questions

  1. ,TEACHER APP : Start teacher app, Pass 👍 [ ] Fail 👎 [ ]
  2. ,_TEACHER_APP : Verify Login Panel appears well formated for screen, Pass 👍 [ ] Fail 👎 [ ]
  3. ,TEACHER APP : Verify IP address is default: 10.1.0.1, Pass 👍 [ ] Fail 👎 [ ]
  4. ,TEACHER APP : Verify invalid IP address is not possible, Pass 👍 [ ] Fail 👎 [ ]
  5. ,TEACHER APP : Start teacher app, Pass 👍 [ ] Fail 👎 [ ]
  6. ,SERVER: Startup server as root on port 80, Pass 👍 [ ] Fail 👎 [ ]
  7. ,TEACHER APP : Verify connect success, Pass 👍 [ ] Fail 👎 [ ]
  8. ,TEACHER APP : Verify cancel button, Pass 👍 [ ] Fail 👎 [ ]
  9. ,TEACHER APP : Verify connect (again), Pass 👍 [ ] Fail 👎 [ ]
  10. ,STUDENT WEB : Verify user can reach login page, Pass 👍 [ ] Fail 👎 [ ]
  11. ,STUDENT WEB : Verify user can login, Pass 👍 [ ] Fail 👎 [ ]
  12. ,STUDENT WEB : Verify user on 'Get Ready' phase, Pass 👍 [ ] Fail 👎 [ ]
  13. ,TEACHER APP : Input Teacher session info and hit create, Pass 👍 [ ] Fail 👎 [ ]
  14. ,TEACHER APP : Verify Teacher can select Use Prepared Questions, Pass 👍 [ ] Fail 👎 [ ]
  15. ,TEACHER APP : Verify Teacher is presented a list of prepared questions, properly formatted and listing number of questions, Pass 👍 [ ] Fail 👎 [ ]
  16. ,TEACHER APP : Verify Teacher can select "IT2 set 1" , Pass 👍 [ ] Fail 👎 [ ]
  17. ,TEACHER APP : Verify connect success, Pass 👍 [ ] Fail 👎 [ ]
  18. ,TEACHER APP : Verify in Questions Tab that correct number of questions are loaded, Pass 👍 [ ] Fail 👎 [ ]
  19. ,TEACHER APP : Verify at Students Screen with at least one student present, Pass 👍 [ ] Fail 👎 [ ]
  20. ,STUDENT WEB : Verify Student at Start Make Questions phase, Pass 👍 [ ] Fail 👎 [ ]
  21. ,STUDENT WEB : Verify there are no major layout or UI defects, Pass 👍 [ ] Fail 👎 [ ]
  22. ,TEACHER APP : Verify Teacher can click Start Solving Questions, Pass 👍 [ ] Fail 👎 [ ]
  23. ,TEACHER APP : Verify questions are properly loaded and that images are present, Pass 👍 [ ] Fail 👎 [ ]
  24. ,STUDENT WEB : Verify Student at Answer Questions phase, Pass 👍 [ ] Fail 👎 [ ]
  25. ,TEACHER APP : Verify questions are received for each student, Pass 👍 [ ] Fail 👎 [ ]
  26. ,TEACHER APP : Verify teacher can view Question Detail (images should be available to view) for each question sent, Pass 👍 [ ] Fail 👎 [ ]
  27. ,TEACHER APP : Verify 'Start Solving Questions' button is available, and starts 'solving' phase when clicked, Pass 👍 [ ] Fail 👎 [ ]
  28. ,STUDENT WEB : Verify Student in 'Answer Questions' phase, Pass 👍 [ ] Fail 👎 [ ]
  29. ,STUDENT WEB : Verify Number of Questions listed is equal to number of questions teacher sees, Pass 👍 [ ] Fail 👎 [ ]
  30. ,STUDENT WEB : Verify Student can answer questions and select a positive or negative rating, Pass 👍 [ ] Fail 👎 [ ]
  31. ,STUDENT WEB : Verify Student can submit answers when finished, should see 'waiting' message, Pass 👍 [ ] Fail 👎 [ ]
  32. ,STUDENT WEB : Repeat previous two steps for each additional web client, Pass 👍 [ ] Fail 👎 [ ]
  33. ,TEACHER APP : Verify in Students tab that all students have answered all questions, Pass 👍 [ ] Fail 👎 [ ]
  34. ,TEACHER APP : Verify click on 'Finish Show Results' causes results to display, Pass 👍 [ ] Fail 👎 [ ]
  35. ,STUDENT WEB : Verify Student can review results, Pass 👍 [ ] Fail 👎 [ ]
  36. ,STUDENT WEB : Verify Student can view question details for each question: Pass 👍 [ ] Fail 👎 [ ]
  37. ,TEACHER APP : Verify in Students Tab the results are showing with correct Top Scorer Correct % completion Correct % right, Pass 👍 [ ] Fail 👎 [ ]
  38. ,TEACHER APP : Verify "Restart" menu sends each student back to Login Screen , Pass 👍 [ ] Fail 👎 [ ]
  39. ,IQManager : Verify Session was created and is viewable in the sessions list , Pass 👍 [ ] Fail 👎 [ ]
  40. ,IQManager : Verify Details of Session, make sure all session data is there along with images , Pass 👍 [ ] Fail 👎 [ ]

Scenario 3: One-time things to verify

  1. ,TEACHER APP : Verify Teacher can view "About" menu and proper version # is displayed, 👍 [ ] Fail 👎 [ ]
  2. ,TEACHER APP : Verify Send Report button works and sends to server issue on github, Pass 👍 [ ] Fail 👎 [ ]
  3. ,TEACHER APP : Verify deletion of at least two questions in the same IQSet during the Make Questions phase choosing questions in the middle of the set, Pass 👍 [ ] Fail 👎 [ ]
  4. ,IQManager : Upload IQSet works with the three JAMsj csv files, Pass 👍 [ ] Fail 👎 [ ]
  5. ,IQManager : Verify upload succeeds for each IQSet and view them in the IQSet list, Pass 👍 [ ] Fail 👎 [ ]

Scenario 4: Repeat Scenario 2, but use 15 Web Clients (Use browser on server host, use http://localhost, with each client in a tab)

  1. ,TEACHER APP : Start teacher app, Pass 👍 [ ] Fail 👎 [ ]
  2. ,_TEACHER_APP : Verify Login Panel appears well formated for screen, Pass 👍 [ ] Fail 👎 [ ]
  3. ,TEACHER APP : Verify IP address is default: 10.1.0.1, Pass 👍 [ ] Fail 👎 [ ]
  4. ,TEACHER APP : Verify invalid IP address is not possible, Pass 👍 [ ] Fail 👎 [ ]
  5. ,TEACHER APP : Start teacher app, Pass 👍 [ ] Fail 👎 [ ]
  6. ,SERVER: Startup server as root on port 80, Pass 👍 [ ] Fail 👎 [ ]
  7. ,TEACHER APP : Verify connect success, Pass 👍 [ ] Fail 👎 [ ]
  8. ,TEACHER APP : Verify cancel button, Pass 👍 [ ] Fail 👎 [ ]
  9. ,TEACHER APP : Verify connect (again), Pass 👍 [ ] Fail 👎 [ ]
  10. ,STUDENT WEB : Verify user can reach login page, Pass 👍 [ ] Fail 👎 [ ]
  11. ,STUDENT WEB : Verify user can login, Pass 👍 [ ] Fail 👎 [ ]
  12. ,STUDENT WEB : Verify user on 'Get Ready' phase, Pass 👍 [ ] Fail 👎 [ ]
  13. ,TEACHER APP : Input Teacher session info and hit create, Pass 👍 [ ] Fail 👎 [ ]
  14. ,TEACHER APP : Verify Teacher can select Use Prepared Questions, Pass 👍 [ ] Fail 👎 [ ]
  15. ,TEACHER APP : Verify Teacher is presented a list of prepared questions, properly formatted and listing number of questions, Pass 👍 [ ] Fail 👎 [ ]
  16. ,TEACHER APP : Verify connect success, Pass 👍 [ ] Fail 👎 [ ]
  17. ,TEACHER APP : Verify in Questions Tab that correct number of questions are loaded, Pass 👍 [ ] Fail 👎 [ ]
  18. ,TEACHER APP : Verify at Students Screen with at least one student present, Pass 👍 [ ] Fail 👎 [ ]
  19. ,STUDENT WEB : Verify Student at Start Make Questions phase, Pass 👍 [ ] Fail 👎 [ ]
  20. ,STUDENT WEB : Verify there are no major layout or UI defects, Pass 👍 [ ] Fail 👎 [ ]
  21. ,TEACHER APP : Verify Teacher can click Start Solving Questions, Pass 👍 [ ] Fail 👎 [ ]
  22. ,STUDENT WEB : Verify Student at Answer Questions phase, Pass 👍 [ ] Fail 👎 [ ]
  23. ,TEACHER APP : Verify questions are received for each student, Pass 👍 [ ] Fail 👎 [ ]
  24. ,TEACHER APP : Verify teacher can view Question Detail (images should be available to view) for each question sent, Pass 👍 [ ] Fail 👎 [ ]
  25. ,TEACHER APP : Verify 'Start Solving Questions' button is available, and starts 'solving' phase when clicked, Pass 👍 [ ] Fail 👎 [ ]
  26. ,STUDENT WEB : Verify Student in 'Answer Questions' phase, Pass 👍 [ ] Fail 👎 [ ]
  27. ,STUDENT WEB : Verify Number of Questions listed is equal to number of questions teacher sees, Pass 👍 [ ] Fail 👎 [ ]
  28. ,STUDENT WEB : Verify Student can answer questions and select a positive or negative rating, Pass 👍 [ ] Fail 👎 [ ]
  29. ,STUDENT WEB : Verify Student can submit answers when finished, should see 'waiting' message, Pass 👍 [ ] Fail 👎 [ ]
  30. ,STUDENT WEB : Repeat previous two steps for each additional web client, Pass 👍 [ ] Fail 👎 [ ]
  31. ,TEACHER APP : Verify in Students tab that all students have answered all questions, Pass 👍 [ ] Fail 👎 [ ]
  32. ,TEACHER APP : Verify click on 'Finish Show Results' causes results to display, Pass 👍 [ ] Fail 👎 [ ]
  33. ,STUDENT WEB : Verify Student can review results, Pass 👍 [ ] Fail 👎 [ ]
  34. ,STUDENT WEB : Verify Student can view question details for each question: Pass 👍 [ ] Fail 👎 [ ]
  35. ,TEACHER APP : Verify in Students Tab the results are showing with correct Top Scorer Correct % completion Correct % right, Pass 👍 [ ] Fail 👎 [ ]
  36. ,TEACHER APP : Verify "Restart" menu sends each student back to Login Screen , Pass 👍 [ ] Fail 👎 [ ]
  37. ,IQManager : Verify Session was created and is viewable in the sessions list , Pass 👍 [ ] Fail 👎 [ ]
  38. ,IQManager : Verify Details of Session , Pass 👍 [ ] Fail 👎 [ ]
@ghost ghost assigned chrqls Jan 20, 2014
@truedat101
Copy link
Contributor Author

@chrqls I'll get some tags set up and we should retest everything.

@truedat101
Copy link
Contributor Author

Please use SMILE Teacher tag: 0.9.9b2-jamsj
Please use SMILE Server tag: 1.0.2-jamsj

@truedat101 truedat101 mentioned this issue Jan 23, 2014
Closed
@truedat101
Copy link
Contributor Author

I'm pretty sure we've got a bug in SMILEConsortium/node-smile-server#74 . Can you verify #74 is working properly before doing anything else. I hate to spend this time to prepare a release if an issue is left open and has introduced a regression. If we can't start testing this, please let me know, and we'll need to spin a new release once you've verified this other issue is fixed.

@truedat101
Copy link
Contributor Author

Please use SMILE Teacher tag: 0.9.9b3-jamsj
Please use SMILE Server tag: 1.0.3-jamsj

@chrqls
Copy link

chrqls commented Feb 2, 2014

Ok

@chrqls
Copy link

chrqls commented Feb 4, 2014

  • DATE: February 1, 2014
  • Tester Github ID: @chrqls
  • SMILE Android Version: 0.9.9b3-jamsj
  • SMILE Server Version: 1.0.3-jamsj
  • HOST OS: Ubuntu 12.10 (server, web client), OSX Mavericks (web client)
  • Android Device Model: Nexus 7
  • Android OS Version: 4.2.2
  • Android Browser & Version: Chrome 31.0.1650.59
  • Desktop Browser & Version: Firefox 26.0
  • Number of Student Web Clients: 3 students for scenario {1,2,3} and 15 for scenario {4}

Scenario 1: Run session and let students create the questions

  • 1. TEACHER APP : Start teacher app
  • 2. TEACHER APP : Verify Login Panel appears well formatted for screen
  • 3. TEACHER APP : Verify IP address is default: 10.1.0.1
  • 4. TEACHER APP : Verify invalid IP address is not possible
  • 5. TEACHER APP : Start teacher app
  • 6. SERVER: Startup server as root on port 80
  • 7. TEACHER APP : Verify connect success
  • 8. TEACHER APP : Verify cancel button
  • 9. TEACHER APP : Verify connect (again)
  • 10. STUDENT WEB : Verify user can reach login page
  • 11. STUDENT WEB : Verify user can login
  • 12. STUDENT WEB : Verify user on 'Get Ready' phase
  • 13. TEACHER APP : Input Teacher session info and hit create
  • 14. TEACHER APP : Verify Teacher can select Start Making Questions
  • 15. TEACHER APP : Verify connect success
  • 16. TEACHER APP : Verify at Students Screen with at least one student present
  • 17. STUDENT WEB : Verify Student at Start Make Questions phase
  • 18. STUDENT WEB : Verify there are no major layout or UI defects
  • 19. STUDENT WEB : Verify Student can make a question without an image
  • 20. STUDENT WEB : Verify Student can make a question with an image (must use image < 1MB)
  • 21. STUDENT WEB : Repeat previous two steps for each additional web client
  • 22. TEACHER APP : Verify questions are received for each student
  • 23. TEACHER APP : Verify teacher can view Question Detail (images should be available to view) for each question sent
  • 24. TEACHER APP : Verify 'Start Solving Questions' button is available, and starts 'solving' phase when clicked
  • 25. STUDENT WEB : Verify Student in 'Answer Questions' phase
  • 26. STUDENT WEB : Verify Number of Questions listed is equal to number of questions teacher sees
  • 27. STUDENT WEB : Verify Student can answer questions and select a positive or negative rating
  • 28. STUDENT WEB : Repeat previous two steps for each additional web client
  • 29. STUDENT WEB : Verify Student can submit answers when finished, should see 'waiting' message
  • 30. TEACHER APP : Verify in Students tab that all students have answered all questions
  • 31. TEACHER APP : Verify click on 'Finish Show Results' causes results to display
  • 32. STUDENT WEB : Verify Student can review results
  • 33. STUDENT WEB : Verify Student can view question details for each question
  • 34. TEACHER APP : Verify in Students Tab the results are showing with correct Top Scorer Correct % completion Correct % right
  • 35. TEACHER APP : Verify "Restart" menu sends each student back to Login Screen
  • 36. IQManager : Verify Session was created and is viewable in the sessions list
  • 37. IQManager : Verify Details of Session
    ==> The picture is always available when it has to, but sometimes the picture loaded is not the good one

Scenario 2: Run session and use prepared questions

  • 1. TEACHER APP : Start teacher app
  • 2. TEACHERAPP : Verify Login Panel appears well formated for screen
  • 3. TEACHER APP : Verify IP address is default: 10.1.0.1
  • 4. TEACHER APP : Verify invalid IP address is not possible
  • 5. TEACHER APP : Start teacher app
  • 6. SERVER: Startup server as root on port 80
  • 7. TEACHER APP : Verify connect success
  • 8. TEACHER APP : Verify cancel button
  • 9. TEACHER APP : Verify connect (again)
  • 10. STUDENT WEB : Verify user can reach login page
  • 11. STUDENT WEB : Verify user can login
  • 12. STUDENT WEB : Verify user on 'Get Ready' phase
  • 13. TEACHER APP : Input Teacher session info and hit create
  • 14. TEACHER APP : Verify Teacher can select Use Prepared Questions
  • 15. TEACHER APP : Verify Teacher is presented a list of prepared questions, properly formatted and listing number of questions
  • 16. TEACHER APP : Verify connect success
  • 17. TEACHER APP : Verify in Questions Tab that correct number of questions are loaded
  • 18. TEACHER APP : Verify at Students Screen with at least one student present
  • 19. STUDENT WEB : Verify Student at Start Make Questions phase
  • 20. STUDENT WEB : Verify there are no major layout or UI defects
  • 21. TEACHER APP : Verify Teacher can click Start Solving Questions
  • 22. STUDENT WEB : Verify Student at Answer Questions phase
  • 23. TEACHER APP : Verify questions are received for each student
  • 24. TEACHER APP : Verify teacher can view Question Detail (images should be available to view) for each question sent
  • 25. TEACHER APP : Verify 'Start Solving Questions' button is available, and starts 'solving' phase when clicked
  • 26. STUDENT WEB : Verify Student in 'Answer Questions' phase
  • 27. STUDENT WEB : Verify Number of Questions listed is equal to number of questions teacher sees
  • 28. STUDENT WEB : Verify Student can answer questions and select a positive or negative rating
  • 29. STUDENT WEB : Verify Student can submit answers when finished, should see 'waiting' message
  • 30. STUDENT WEB : Repeat previous two steps for each additional web client
  • 31. TEACHER APP : Verify in Students tab that all students have answered all questions
  • 32. TEACHER APP : Verify click on 'Finish Show Results' causes results to display
  • 33. STUDENT WEB : Verify Student can review results
  • 34. STUDENT WEB : Verify Student can view question details for each question
  • 35. TEACHER APP : Verify in Students Tab the results are showing with correct Top Scorer Correct % completion Correct % right
  • 36. TEACHER APP : Verify "Restart" menu sends each student back to Login Screen
  • 37. IQManager : Verify Session was created and is viewable in the sessions list
  • 38. IQManager : Verify Details of Session
    ==> The picture is always available when it has to, but sometimes the picture loaded is not the good one

Scenario 3: One-time things to verify

  • 1. TEACHER APP : Verify Teacher can view "About" menu and proper version # is displayed
  • 2. TEACHER APP : Verify Send Report button works and sends to server issue on Github
  • 3. TEACHER APP : Verify deletion of at least two questions in the same IQSet during the Make Questions phase choosing questions in the middle of the set
  • 4. IQManager : Upload IQSet works with the three JAMsj csv files
  • 5. IQManager : Verify upload succeeds for each IQSet and view them in the IQSet list

Scenario 4: Repeat Scenario 2, but use 15 Web Clients (Use browser on server host, use http://localhost, with each client in a tab)

  • 1. TEACHER APP : Start teacher app
  • 2. TEACHER APP : Verify Login Panel appears well formatted for screen
  • 3. TEACHER APP : Verify IP address is default: 10.1.0.1
  • 4. TEACHER APP : Verify invalid IP address is not possible
  • 5. TEACHER APP : Start teacher app
  • 6. SERVER: Startup server as root on port 80
  • 7. TEACHER APP : Verify connect success
  • 8. TEACHER APP : Verify cancel button
  • 9. TEACHER APP : Verify connect (again)
  • 10. STUDENT WEB : Verify user can reach login page
  • 11. STUDENT WEB : Verify user can login
  • 12. STUDENT WEB : Verify user on 'Get Ready' phase
  • 13. TEACHER APP : Input Teacher session info and hit create
  • 14. TEACHER APP : Verify Teacher can select Use Prepared Questions
  • 15. TEACHER APP : Verify Teacher is presented a list of prepared questions, properly formatted and listing number of questions
  • 16. TEACHER APP : Verify connect success
  • 17. TEACHER APP : Verify in Questions Tab that correct number of questions are loaded
  • 18. TEACHER APP : Verify at Students Screen with at least one student present
  • 19. STUDENT WEB : Verify Student at Start Make Questions phase
  • 20. STUDENT WEB : Verify there are no major layout or UI defects
  • 21. TEACHER APP : Verify Teacher can click Start Solving Questions
  • 22. STUDENT WEB : Verify Student at Answer Questions phase
  • 23. TEACHER APP : Verify questions are received for each student
  • 24. TEACHER APP : Verify teacher can view Question Detail (images should be available to view) for each question sent
  • 25. TEACHER APP : Verify 'Start Solving Questions' button is available, and starts 'solving' phase when clicked
  • 26. STUDENT WEB : Verify Student in 'Answer Questions' phase
  • 27. STUDENT WEB : Verify Number of Questions listed is equal to number of questions teacher sees
  • 28. STUDENT WEB : Verify Student can answer questions and select a positive or negative rating
  • 29. STUDENT WEB : Verify Student can submit answers when finished, should see 'waiting' message
  • 30. STUDENT WEB : Repeat previous two steps for each additional web client
  • 31. TEACHER APP : Verify in Students tab that all students have answered all questions
  • 32. TEACHER APP : Verify click on 'Finish Show Results' causes results to display
  • 33. STUDENT WEB : Verify Student can review results
  • 34. STUDENT WEB : Verify Student can view question details for each question
  • 35. TEACHER APP : Verify in Students Tab the results are showing with correct Top Scorer Correct % completion Correct % right
  • 36. TEACHER APP : Verify "Restart" menu sends each student back to Login Screen
  • 37. IQManager : Verify Session was created and is viewable in the sessions list
  • 38. IQManager : Verify Details of Session
    ==> The picture is always available when it has to, but sometimes the picture loaded is not the good one

@truedat101
Copy link
Contributor Author

Great. Will start building a firmware based on these tags. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@chrqls chrqls

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@truedat101 @chrqls