Difference between revisions of "LAT Help Center"

From YouTestMe Wiki
Jump to navigation Jump to search
(256 intermediate revisions by 6 users not shown)
Line 1: Line 1:
=Customer Support Contact Information=
+
=Customer support contact information=
  
 
{|class="wikitable"
 
{|class="wikitable"
Line 6: Line 6:
 
|| '''Phone:''' || +1 888 418 1718 and +1 647 558 6017
 
|| '''Phone:''' || +1 888 418 1718 and +1 647 558 6017
 
|-
 
|-
|| '''Email Address:''' || support@youtestme.com
+
|| '''Email Address:''' || [mailto:support@youtestme.com support@youtestme.com]
 
|}
 
|}
  
Line 13: Line 13:
 
{|class="wikitable"
 
{|class="wikitable"
 
|-
 
|-
|| '''Link to Trial Instance:''' || https://lat.youtestme.com
+
|| '''Link to the production environment:''' || https://lat.youtestme.com
 
+
|-
 +
|| '''Link to the sandbox environment (for the UAT):''' || https://lat-sandbox.youtestme.com
 
|}
 
|}
  
Line 50: Line 51:
 
|}
 
|}
  
=Standard Instructional Materials=
+
=Standard instructional materials=
  
 
This chapter contains instructional documents and videos for administrators on how to use YouTestMe GetCertified application.
 
This chapter contains instructional documents and videos for administrators on how to use YouTestMe GetCertified application.
  
===Getting Started with YouTestMe===
+
===Getting started with YouTestMe===
  
 
{|class="wikitable"
 
{|class="wikitable"
Line 64: Line 65:
 
|| Aims to provide the complete guide to getting started with YouTestMe and recommendations for the best use cases, enabling clients to organize the whole testing process easily.
 
|| Aims to provide the complete guide to getting started with YouTestMe and recommendations for the best use cases, enabling clients to organize the whole testing process easily.
 
|-
 
|-
|[https://www.youtube.com/watch?v=u-iZEZZkWGU Application overview] || One-minute overview of the main modules in YouTestMe GetCertified 10.0
+
|[https://www.youtube.com/watch?v=u-iZEZZkWGU Application overview]
 +
|| One-minute overview of the main modules in YouTestMe GetCertified 10.0
 +
|-
 +
|[{{SERVER}}/youtestme/youtestmedoc/Document%20Templates/Clients/Software%20Information/YouTestMe%20-%20Naming%20Conventions.pdf Naming conventions]
 +
|| Rules for naming components in YouTestMe GetCertified
 
|-
 
|-
 
|}
 
|}
Line 98: Line 103:
 
|-
 
|-
 
|-
 
|-
|| 1 || [https://www.youtube.com/watch?v=dwb0idaAZc8 Creating a simple test] || Explanation on how to create a simple test without sections and assign candidates to it. || Video
+
 
|-
 
|| 2 || [https://www.youtube.com/watch?v=JAHF3lqpeNY Creating a test with sections] || Explanation on how to create a test with sections that can represent different areas of knowledge. || Video
 
|-
 
|| 3 || [https://www.youtube.com/watch?v=I1tW2oY4eRI How to create a test using test generator] || Instructions on how to to use a test generator to create a number of different versions of the same test. || Video
 
 
|-
 
|-
 
|| 4 ||[https://www.youtube.com/watch?v=obhsrRVClpE&feature=emb_imp_woyt How to predefine feedback to answers] || Instructions on how to provide candidates feedback to selected answers that will be displayed during the test-taking process. || Video
 
|| 4 ||[https://www.youtube.com/watch?v=obhsrRVClpE&feature=emb_imp_woyt How to predefine feedback to answers] || Instructions on how to provide candidates feedback to selected answers that will be displayed during the test-taking process. || Video
Line 117: Line 118:
 
|}
 
|}
  
===Questions and Question Pools===
+
===Questions and question Pools===
 
Follow the steps below to explore this module.
 
Follow the steps below to explore this module.
 
{|class="wikitable"
 
{|class="wikitable"
Line 156: Line 157:
 
|-
 
|-
 
| 16 ||[https://www.youtube.com/watch?v=xamFBkjtWno Collaborative Content Management (Questions)] || Demonstration of two ways of collaborative content management (of questions and question pools) in YouTestMe GetCertified. || Video
 
| 16 ||[https://www.youtube.com/watch?v=xamFBkjtWno Collaborative Content Management (Questions)] || Demonstration of two ways of collaborative content management (of questions and question pools) in YouTestMe GetCertified. || Video
 +
|-
 +
| 17 ||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/2021-08-10%20How%20to%20create%20custom%20question%20properties.pdf How to create custom question properties] || This article explains how to create custom question properties that can be used when creating questions. || Article
 +
|-
 +
| 18 ||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/2021-13-10%20How%20to%20create%20dropdown%20type%20of%20custom%20question%20property.pdf How to create dropdown type of custom question property] || This article explains how to create a custom question property (dropdown type) that can be used when creating questions. || Article
  
 
|}
 
|}
Line 217: Line 222:
 
Learn how to schedule jobs to run at specified time intervals, automate import, export, or any communication between YouTestMe GetCertified and external systems or processes within the YouTestMe system.
 
Learn how to schedule jobs to run at specified time intervals, automate import, export, or any communication between YouTestMe GetCertified and external systems or processes within the YouTestMe system.
 
| Video
 
| Video
 +
 +
|-
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/How%20to%20customize%20interface%20application%20text.pdf How to customize interface application text] || This article explains how to use the language bundles feature to customize interface application text.|| Link
 
|}
 
|}
  
Line 225: Line 233:
 
! Type
 
! Type
  
 +
|-
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/How%20to%20migrate%20and%20import%20QTI%20package.pdf Migrating and Importing QTI Package] || How to migrate and import QTI package. || Article
 
|-
 
|-
 
|| [https://owncloud.youtestme.com/owncloud/s/fIa6mbhP6OkQXzq QTI Question Importer] || How to create a question pool and import questions using YouTestMe QTI importer.|| Video
 
|| [https://owncloud.youtestme.com/owncloud/s/fIa6mbhP6OkQXzq QTI Question Importer] || How to create a question pool and import questions using YouTestMe QTI importer.|| Video
 
|-
 
|-
|| [https://www.youtestme.com/kb/how-to-import-qti-package-into-the-question-pool/?doing_wp_cron=1631192655.6810190677642822265625 QTI Question Importer] || How to create a question pool and import questions using YouTestMe QTI importer.|| Article
+
|| [https://www.youtestme.com/kb/how-to-import-qti-package-into-the-question-pool/ QTI Question Importer] || How to create a question pool and import questions using YouTestMe QTI importer.|| Article
 +
|-
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/How%20to%20import%20multiple%20question%20pools%20from%20an%20Excel%20file%20.pdf Swiss Importer] || How to import multiple question pools from an Excel file into the YouTestMe GetCertified.|| Article
 +
|-
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/LTI%20Integration.pdf LTI Integration] || How to connect the YouTestMe test to the ILIAS, start the test from ILIAS course, and review the grade sent from YouTestMe. || Article
 
|-
 
|-
  
 
|}
 
|}
  
=UAT Instructional Materials=
+
<!--=UAT Instructional Materials=
  
'''Note:'''The order of test cases shown below is a recommendation on testing the functionalities; however, you can always sort the table by Test IDs and test in the order you have defined.
+
'''Note:''' The order of test cases shown below is a recommendation on testing the functionalities; however, you can always sort the table by Test IDs, as well.
  
 
{|class="wikitable sortable" style="border: none; background: none;"
 
{|class="wikitable sortable" style="border: none; background: none;"
Line 324: Line 338:
 
|-
 
|-
  
 +
|}
 +
 +
=Requirements=
 +
'''Note:''' These videos do not explain the entire requirement but only the parts of it that were unclear after the UAT from October 2020.
 +
 +
{|class="wikitable"
 +
|-
 +
! #
 +
! Requirement
 +
! Link
 +
|-
 +
|| 1
 +
|| SSO: OpenID Connect SSO settings; Account mapping settings; SSO flow; Token authorization and validation, user account create/update.
 +
||
 +
|-
 +
|| 2
 +
|| Tests can be called from the LMS, e.g., via an LTI interface.
 +
||
 +
|-
 +
|| 3
 +
||  QTI-based importer for questions.
 +
|-
 +
|| 4
 +
|| Custom Excel-based importer for questions and question pools.
 +
||
 +
|-
 +
|| 5
 +
|| Information presented to the students before the test (time available), during the test (amount of questions),
 +
and after the test (required percentage to pass the test) should be configurable.
 +
||
 +
|-
 +
|| 6
 +
|| Archiving the tests for a specific number of years with all information stored during that time.
 +
||
 +
|-
 +
|| 7
 +
|| Enabling zooming the pictures in and out, and not only displaying them in their original size.
 +
||
 +
|-
 +
|| 8
 +
|| Error hint from question upload not correct:
 +
If a cell in the Excel file is empty but should contain data, the error message does not indicate the correct cell. For example, in the attached Excel file the cell 4B is empty, but the error message indicates cell 4C.
 +
||
 +
|-
 +
|| 9
 +
|| Evaluation of wrongly answered questions in a test:
 +
It is possible to access via "Questions" a test and to have an overview of the success ratio of each question. There is no possibility to define a limit or range of success ratio to get an evaluation of a specific test.
 +
||
 +
|-
 +
|| 10
 +
|| A field where the student can write down feedback to a specific question that will be visible to the question pool manager.
 +
||
 +
|-
 +
|| 11
 +
|| Improving the caption on the Import from Excel button:
 +
When clicking the Import from Excel button in the Question pools page and then selecting a valid Excel file with questions/answers according to the YTM specification, an error "Excel file not found" is displayed, and no question pool is created. If the function triggered by the button is not what it says, either the caption should be changed, or the functionality should be corrected to adapt to the button caption.
 +
||
 +
|-
 +
|| 12
 +
|| Displaying the information about the number of attempts left on the My assignments panel.
 +
||
 +
|-
 +
|| 13
 +
|| Allowing continuation after an interruption of a test started using the LTI standard.
 +
||
 +
|-
 +
|| 14
 +
|| Allowing breaks/continuation with tests started using the LTI standard.
 +
||
 +
|-
 +
|| 15
 +
|| Improving the log message for the QTI-based question job importer.
 +
||
 +
|-
 +
|| 16
 +
|| Extending the score report with:
 +
1. Qualification and function of the student (if available)
 +
2. The time when the test was taken
 +
3. Test unique ID number
 +
4. Number of questions asked and number of questions answered correctly.
 +
||
 +
|-
 +
|| 17
 +
|| Manual adjustment on results
 +
||
 +
|-
 +
|| 18
 +
|| Possibility to hide the report after finishing the test.
 +
||
 +
|-
 +
|| 19
 +
||Introducing an automatism that analyses the percentage of correct answers:
 +
1.Overall, in the question pool
 +
2.In a test of a specific group
 +
This automatism should include a variable definition of the number of answers and the threshold of the percentage of correct answers.
 +
||
 +
|-
 +
|| 20
 +
|| Possibility to create a question with a "formula". The idea behind this question is that the trainee must insert certain values within formulae defined by the question. With these values, a result will be calculated. The correct result is defined by a numeric range.
 +
||
 +
|-
 +
|| 21
 +
|| Option to create a question where the trainee must mark "errors" or "wrong words".
 +
||
 +
|-
 +
|| 22
 +
|| Additional options on the Personal report page:
 +
1. Score and details only on wrong answers
 +
2. No report available for student
 +
||
 +
|-
 +
|| 23
 +
|| Review test results within a defined time period.
 +
||
 +
|-
 +
|| 24
 +
|| Special scenarios for importing questions using Excel in SWISS format.
 +
||
 +
|-
 +
|| 25
 +
|| Optimizing TAB keyboard key for skipping to the next field in the forms visible in the application.
 +
||
 +
|-
 +
|| 26
 +
|| Displaying the passing mark in the personal report.
 +
||
 +
|-
 +
|| 27
 +
|| Student's screens need to be fully optimized for mobile phones, tablets, and all standard screen sizes.
 +
||
 +
|-
 +
|| 28
 +
|| The "Waiting for report" message needs to appear at the appropriate time.
 +
||[https://www.youtestme.com/kb/how-to-show-report-immediately-after-finishing-the-test/ Link]
 +
|-
 +
|| 29
 +
|| Displaying the appropriate hint when the test is suspended.
 +
||
 +
|-
 +
|| 30
 +
|| Always displaying the home page after login.
 +
||
 +
|-
 +
|| 31
 +
|| Custom e-mail invitation for tests.
 +
||
 +
|-
 +
|| 32
 +
|| After reading and parsing the QTI file, the user should be presented with all the questions contained therein in an appealing manner and then given the opportunity to select the questions that are to be effectively imported into the system. Default would be "all questions".
 +
||
 +
|-
 +
|| 33
 +
|| Allow students to create ad-hoc tests by choosing how many questions do they want from specific question pools. Possibility for the student to create himself tests with own selection criteria (like learning subjects, test mode with a limited time, only medium or difficult questions (defined by the question amanger and/ or by each student individually), etc.).
 +
||
 +
|-
 +
|| 34
 +
|| Assign eTest user qualifications automatically from a qualification list (SWISS ActiveDirectory list).
 +
||
 +
|-
 +
|| 35
 +
|| The option to comment on the changes applied to a test.
 +
||
 +
|-
 +
|| 36
 +
|| Option to create a copy of a question pool.
 +
||
 +
|-
 +
|| 37
 +
|| Confirmation notification after deletion of a user.
 +
||
 +
|-
 +
|| 38
 +
|| The Excel file should be extended so that questions can be imported for both LATCH and SWISS in their format. It has to be clarified in detail which question attributes are to be supported and whether taxonomies can also be defined for the import.
 +
||
 +
|-
 +
|| 39
 +
|| When displaying a question pool, the table with the questions can become quite wide so that when looking at columns on the far right, the action column on the left edge of the table is no longer visible. Therefore, it would be quite good if the action column would remain constantly visible (freeze) and clickable to make working with the questions in a question pool more efficient.
 +
||
 +
|-
 +
|| 40
 +
|| Offer the option of downloading an eTest to complete it offline with subsequent synchronization possibility.
 +
||
 +
|-
 +
|| 41
 +
|| Instructions for supported keyboard keys.
 +
||
 +
|-
 +
|| 42
 +
|| Restoring system text snippets to the original state.
 +
||
 +
|-
 +
|| 43
 +
|| Sans serif font for system e-mails.
 +
||
 +
|-
 +
|| 44
 +
|| The system should remember how many rows a user wanted to have displayed in a table view. And this setting should be remembered over sessions.
 +
||
 +
|-
 +
|| 45
 +
|| When creating a new question property, the custom types should be displayed in the drop-down list in ascending sort order by name.
 +
||
 +
|-
 +
|| 46
 +
|| The option to display entered data immediately after the creation of a new user.
 +
||
 +
|-
 +
|| 47
 +
|| The option to display entered data immediately after the creation of a new user.
 +
||
 +
|-
 +
|| 48
 +
|| The system should be fully optimized for smaller screens.
 +
||
 +
|-
 +
|| 49
 +
|| Refreshing the page after the import of a question pool.
 +
||
 +
|-
 +
|| 50
 +
|| Use of the statistics for a better evaluation of the weak areas (subjects or parts of subjects) individually per student and clear presentations of these areas.
 +
||
 +
|-
 +
|| 51
 +
|| Possibility to mark questions where the mark does not disappear once the test is finished to help the student review these questions later.
 +
||
 +
|-
 +
|| 52
 +
|| An "individual" evaluation with the possibility to define whether this question is easy, medium, or difficult for the student him-/herself.
 +
||
 +
|-
 +
|| 53
 +
|| The dashboard for managing workspaces (edit existing workspaces and create new ones).
 +
||
 +
|-
 +
|| 54
 +
|| A security layer that allows data separation and permission to access workspaces.
 +
||
 +
|-
 +
|| 55
 +
|| Possibility to create an unlimited number of workspaces (departments).
 +
||
 +
|-
 +
|| 56
 +
|| Adding a unique workspace identifier into tests.
 +
||
 +
|-
 +
|| 57
 +
|| Introducing the role of a super admin, who can enter and switch between the workspaces.
 +
||
 +
|-
 +
|| 58
 +
|| Allowing the creation of multiple super admins.
 +
||
 +
|-
 +
|| 59
 +
|| Introducing the role of a department admin - who can see the results of tests in their workspace.
 +
||
 +
|-
 +
|| 60
 +
|| Enabling automatic assignment of user roles to pools/tests/user groups.
 +
||
 +
|-
 +
|| 61
 +
|| Allowing super admins to access and compare the individual reports between the workspaces:
 +
Basic reporting - the number of tests, questions, users, and question pools for each workspace.
 +
||
 +
|-
 +
|| 62
 +
|| Allowing super admins to access and compare the individual reports between the workspaces:
 +
Reports that show workspace activity (the number of test attempts and created items such as user groups, questions, users, pools, training courses, etc.) during a weekly, monthly, or yearly period.
 +
||
 +
|-
 +
|| 63
 +
|| Allowing unique logo design and color theme for each workspace
 +
||
 +
|-
 +
|| 64
 +
|| Including custom properties in test generator as criteria for generating tests.
 +
||
 +
|-
 +
|| 65
 +
|| Adding the option to create custom question properties on the Question pools page.
 +
|| [https://www.youtestme.com/kb/how-to-create-custom-question-properties/ Link]
 +
|-
 +
|| 66
 +
|| Define an unlimited number of custom question properties.
 +
||
 +
|-
 +
|| 67
 +
|| Associate more than 1 value with a single question:
 +
For example, for the Phase field, you will be able to select T1 and T2a and T2b and T3.
 +
||
 +
|-
 +
|| 68
 +
|| Create hierarchically organized values of a single custom question property.
 +
||
 +
|-
 +
|| 69
 +
|| The Excel template used for bulk importing questions will contain an additional column for each question property created by the system users.
 +
||
 +
|-
 +
|| 70
 +
|| The client will be able to include custom question properties in custom-made reports generated using report builder and apply advanced search filters on the report based on those properties.
 +
||
 +
|-
 +
|| 71
 +
|| Adding the Comments field in the question changelog.
 +
||
 +
|-
 +
|| 72
 +
|| Adding the Revert / Preview options in the question changelog
 +
||
 +
|-
 +
|} -->
 +
=Development cycle 1=
 +
'''NOTE''': Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/
 +
==Taxonomies and Test Generator==
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| 71
 +
|| Create hierarchically organized values of a single custom question property.
 +
| rowspan = 2 |[https://trackspace.lhsystems.com/browse/LATTAS-517 LATTAS-517]
 +
| rowspan = 5 |[https://www.youtestme.com/kb/how-to-generate-tests-based-on-question-categories/ Article]
 +
 +
|-
 +
|| 69
 +
|| Define an unlimited number of custom question properties.
 +
 +
|-
 +
| 68
 +
| Adding the option to create custom question properties on the Question pools page.
 +
| rowspan = 2 |[https://trackspace.lhsystems.com/browse/LATTAS-519 LATTAS-519]
 +
 +
|-
 +
|| 70
 +
|| Associate more than 1 value with a single question: For example, for the Phase field, you will be able to select T1 and T2a and T2b and T3.
 +
 +
|-
 +
|| 67
 +
|| Including custom properties in test generator as criteria for generating tests.
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-520 LATTAS-520]
 +
 +
|-
 +
|| 67
 +
|| Using question pools as Learning topics.
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-593 LATTAS-593]
 +
|[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Using%20question%20pools%20as%20Learning%20topics.pdf Article]
 +
 +
|-
 +
|| UAT
 +
|| The mechanism for checking the test generator rules before editing questions in question pools.
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-605 LATTAS-605]
 +
|[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/The%20mechanism%20for%20checking%20the%20test%20generator%20rules%20before%20editing%20questions%20in%20question%20pools.pdf Article]
 +
|-
 +
|}
 +
 +
==Bug fixes==
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| 8
 +
|| Error hint from question upload not correct: If a cell in the Excel file is empty but should contain data, the error message does not indicate the correct cell. <br /> For example, in the attached Excel file the cell 4B is empty, but the error message indicates cell 4C.
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-528 LATTAS-528]
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Error%20hint%20from%20question%20upload%20not%20correct.pdf PDF]
 +
|-
 +
|| 11
 +
|| Improving the caption on the Import from Excel button: When clicking the Import from Excel button in the Question pools page and then selecting a valid Excel file with questions/answers according to the YTM specification, an error "Excel file not found" is displayed, and no question pool is created. If the function triggered by the button is not what it says, either the caption should be changed, or the functionality should be corrected to adapt<br /> to the button caption.
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-534 LATTAS-534]
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Improving%20the%20caption%20on%20the%20Import%20from%20Excel%20button.pdf PDF]
 +
|-
 +
|| 23
 +
|| Review test results within a defined time period.
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-531 LATTAS-531]
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Review%20test%20results%20within%20a%20defined%20time%20period.pdf PDF]
 +
 +
|-
 +
|| 26
 +
|| Displaying the passing mark in the personal report.
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-530 LATTAS-530]
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Displaying%20the%20passing%20mark%20in%20the%20personal%20report.pdf PDF]
 +
 +
|-
 +
|| 28
 +
|| The "Waiting for report" message needs to appear at the appropriate time.
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-535 LATTAS-535]
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/The%20Waiting%20for%20report%20message%20needs%20to%20appear%20at%20the%20appropriate%20time.pdf PDF]
 +
 +
|-
 +
|| 49
 +
|| Refreshing the page after the import of a question pool.
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-529 LATTAS-529]
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Refreshing%20the%20page%20after%20the%20import%20of%20a%20question%20pool.pdf PDF]
 +
|-
 +
 +
|-
 +
|| 53
 +
|| Lookup test results of previous test run
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-553 LATTAS-553]
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Lookup%20test%20results%20of%20previous%20test%20run.pdf PDF]
 +
|}
 +
 +
==LTI==
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| 2
 +
|| Tests can be called from the LMS, e.g., via an LTI interface
 +
| rowspan = 3 | [https://trackspace.lhsystems.com/browse/LATTAS-556 LATTAS-556]
 +
| rowspan = 3 | [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Integration%20with%20ILIAS%20via%20LTI.pdf Article]
 +
|-
 +
|| 13
 +
|| Allowing continuation after an interruption of a test started
 +
 +
|-
 +
|| 14
 +
|| Allowing breaks/continuation with tests started
 +
 +
|}
 +
 +
==Importers==
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| 3
 +
|| QTI-based importer for questions
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-564 LATTAS-564]
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/How%20to%20migrate%20and%20import%20QTI%20package.pdf Article]
 +
 +
|-
 +
|| 4
 +
|| Custom Excel-based importer for questions and question pools
 +
'''Note''': The article is corrected according to the requirements from newer development cycles.
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-566 LATTAS-566]
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/How%20to%20Import%20Question%20Pools%20via%20Excel%20File.pdf Article]
 +
 +
|-
 +
|| 72
 +
|| The Excel template used for bulk importing questions - additional column
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-561 LATTAS-561]
 +
|| [https://www.youtestme.com/kb/how-to-import-questions-with-additional-category-values-using-excel-file/ Article]
 +
 +
|}
 +
 +
==Clarifications==
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| 17
 +
|| Manual adjustment on results
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-395 LATTAS-395]
 +
|| [https://www.youtestme.com/kb/how-to-grade-a-test-attempt-manually/ Article]
 +
 +
|-
 +
|| 18
 +
|| Possibility to hide the report after finishing the test
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-397 LATTAS-397]
 +
|| [https://www.youtestme.com/kb/how-to-prevent-a-candidate-from-seeing-test-results-before-the-managers-approval/ Article]
 +
 +
|-
 +
|| 42
 +
|| Restoring system text snippets to the original state
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-418 LATTAS-418]
 +
|| [https://www.youtestme.com/kb/how-to-customize-applications-interface-text/ Article]
 +
 +
|}
 +
 +
==Resources==
 +
{|class="wikitable"
 +
|-
 +
! Requirement
 +
! Description
 +
! Resource
 +
 +
|-
 +
|| 3
 +
|| Download and use the following file when migrating data from ILIAS to YouTestMe GetCertified.
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/Resources/ims_qtiasiv1p2p1.dtd DTD File]
 +
 +
|-
 +
|| 4
 +
|| Download and use the following files for easier testing of requirement #4.
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/Resources/Requirement%2011%20-%20Sample%201.zip Sample 1]<br/>
 +
[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/Resources/Requirement%2011%20-%20Sample%202.zip Sample 2]<br/>
 +
[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/Resources/Requirement%2011%20-%20Sample%203.zip Sample 3]<br/>
 +
 +
|-
 +
|| 8
 +
|| Download and use the following file for easier testing of requirement #8. By importing this file, you will trigger the required error.
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/Resources/Requirement%208.xlsx File]
 +
 +
|-
 +
|| 11
 +
|| Download and use the following file for easier testing of requirement #11. By importing this files, you will trigger the necessary messages.
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/Resources/Requirement%2011%20-%20Sample%201.zip Sample 1]<br/>
 +
[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/Resources/Requirement%2011%20-%20Sample%202.zip Sample 2]<br/>
 +
[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/Resources/Requirement%2011%20-%20Sample%203.zip Sample 3]
 +
|}
 +
 +
=Development cycle 2=
 +
'''NOTE''': Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/
 +
==OpenID Connect SSO==
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| 1
 +
|| OpendID SSO
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-641 LATTAS-641]
 +
||[{{SERVER}}/youtestme/youtestmedoc/Projects/YTM%20Get%20Certified/Modules/OpenID%20Connect%20SSO/Open%20ID%20Article%20data.pdf Article]
 +
 +
|}
 +
 +
==Student screens==
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
 +
 +
|-
 +
|| 27
 +
|| Student's screens need to be fully optimized - Mobile phone
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-648 LATTAS-648]
 +
 +
|-
 +
|| 27
 +
|| Student's screens need to be fully optimized - Tables
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-654 LATTAS-654]
 +
 +
|-
 +
|| 27
 +
|| Student's screens need to be fully optimized - Standard screen sizes
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-655 LATTAS-655]
 +
|}
 +
 +
==Bug fix==
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
 +
|-
 +
|| N/A
 +
|| The notification message is shown only shortly when moving questions from one pool to another
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-621 LATTAS-621]
 +
|}
 +
 +
== Retake attempt via LTI ==
 +
{| class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| N/A
 +
|| Retake attempt via LTI
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-660 LATTAS-660]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Retake%20Attempt%20and%20Access%20Personal%20Report%20via%20LTI.pdf Article]
 +
 +
|}
 +
=Development cycle 3=
 +
'''NOTE''': Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
|-
 +
|5
 +
|Information presented to the students
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-733 LATTAS-733]
 +
||[https://www.youtestme.com/kb/how-to-customize-test-instructions-dialog/ Article]
 +
|-
 +
|7
 +
|Enabling zooming the pictures in and out, and not only displaying them in their original size
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-736 LATTAS-736]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Possibility%20to%20zoom%20in%20and%20out%20of%20the%20pictures%20during%20the%20test.pdf Article]
 +
|-
 +
|10
 +
|A field where the student can write down feedback to a specific question
 +
|rowspan = 2 |[https://trackspace.lhsystems.com/browse/LATTAS-758 LATTAS-758]
 +
|rowspan = 2 |[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Writing%20feedback%20and%20determining%20question's%20difficulty.pdf Article]
 +
|-
 +
|52
 +
|An "individual" evaluation with the possibility to define whether this question is easy, medium, or difficult for the student him-/herself
 +
|-
 +
|24
 +
|Special scenarios for importing questions using Excel in SWISS format
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-757 LATTAS-757]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Special%20scenarios%20for%20importing%20questions%20using%20Excel%20in%20SWISS%20format.pdf Article]
 +
|-
 +
|31
 +
|Custom e-mail invitation for tests
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-755 LATTAS-755]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Custom%20e-mail%20invitation%20for%20tests.pdf Article]
 +
|-
 +
|32
 +
|After reading and parsing the QTI file, the user should be presented with all the questions contained therein and then given the opportunity to select the questions that are to be imported
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-756 LATTAS-756]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/QTI%20file%20-%20presentation%20to%20the%20users.pdf Article]
 +
|-
 +
|| 35
 +
|| The option to comment on the changes applied to a test
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-718 LATTAS-718]
 +
||[https://www.youtestme.com/kb/how-to-add-comments-to-changes-made-in-a-test/ Article]
 +
|-
 +
|45
 +
|When creating a new question property, the custom types should be displayed in the drop-down list in ascending sort order by name
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-722 LATTAS-722]
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Displaying%20category%20values%20in%20ascending%20order.pdf Article]
 +
 +
|-
 +
|51
 +
|Possibility to mark questions where the mark does not disappear once the test is finished to help the student review these questions later
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-737 LATTAS-737]
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Possibility%20to%20mark%20questions%20during%20the%20test%20and%20be%20able%20to%20review%20them%20in%20the%20test%20report.pdf Article]
 +
|-
 +
|74
 +
|Adding the Comments field in the question changelog
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-759 LATTAS-759]
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Adding%20the%20Comments%20field%20in%20the%20question%20changelog.pdf Article]
 +
|-
 +
|75
 +
|Adding the Revert / Preview options in the question changelog
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-760 LATTAS-760]
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/„Revert“%20and%20„Preview“%20options.pdf Article]
 +
|}
 +
 +
== Improvements ==
 +
{| class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| N/A
 +
|| Accessing personal report via LTI
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-793 LATTAS-793]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Retake%20Attempt%20and%20Access%20Personal%20Report%20via%20LTI.pdf Article]
 +
 +
|-
 +
|| N/A
 +
|| Fill in the blanks: Blanks within the text and not listed below
 +
||[https://trackspace.lhsystems.com/browse/LATTAS-536 LATTAS-536]
 +
||-
 +
 +
|-
 +
|| N/A
 +
|| Grey out chosen answers in the candidate's personal report when I don't know option is selected
 +
||[https://trackspace.lhsystems.com/browse/LATTAS-537 LATTAS-537]
 +
||-
 +
 +
|}
 +
 +
=Development cycle 4=
 +
'''NOTE''': Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
|-
 +
|12
 +
| Displaying the information about the number of attempts left on the My assignments panel
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-814 LATTAS-814]
 +
||[https://www.youtestme.com/kb/how-to-customize-test-instructions-dialog/ Article]
 +
|-
 +
|15
 +
|Improving the log message for the QTI-based question job importer
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-815 LATTAS-815]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Improving%20the%20log%20message%20for%20the%20QTI.pdf Article]
 +
|-
 +
|22
 +
|Additional options on the Personal report page:
 +
<p>- Score and details only on wrong answers</p>
 +
<p>- No report available for student</p>
 +
||[https://trackspace.lhsystems.com/browse/LATTAS-820 LATTAS-820]
 +
||-
 +
|-
 +
|29
 +
|Displaying the appropriate hint when the test is suspended
 +
||[https://trackspace.lhsystems.com/browse/LATTAS-816 LATTAS-816]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Hint%20for%20a%20suspended%20test.pdf Article]
 +
|-
 +
|36
 +
|Option to create a copy of a question pool
 +
||[https://trackspace.lhsystems.com/browse/LATTAS-817 LATTAS-817]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Option%20to%20create%20a%20copy%20of%20a%20question%20pool.pdf Article]
 +
|-
 +
|37
 +
|Confirmation notification after deletion of a user <p><b> Note:</b> This requirement has been implemented before, so it is already resolved.</p>
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-701 LATTAS-701]
 +
||-
 +
|-
 +
|39
 +
|When displaying a question pool, the table with the questions can become quite wide so that when looking at columns on the far right, the action column on the left edge of the table is no longer visible. <p>Therefore, it would be quite good if the action column would remain constantly visible (freeze) and clickable to make working with the questions in a question pool more efficient
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-818 LATTAS-818]
 +
||-
 +
|-
 +
|| 46
 +
||The option to display entered data immediately after the creation of a new user
 +
||[https://trackspace.lhsystems.com/browse/LATTAS-819 LATTAS-819]
 +
||-
 +
|-
 +
|66
 +
|Allowing unique logo design and color theme for each workspace
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-839 LATTAS-839]
 +
|rowspan = 13|[https://wiki.youtestme.com/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/Workspace%20requirements.pdf Article]
 +
|-
 +
|54
 +
|The dashboard for managing workspaces (edit existing workspaces and create new ones)
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-848 LATTAS-848] <p> [https://trackspace.lhsystems.com/browse/LATTAS-833 LATTAS-833]</p>
 +
|-
 +
|55
 +
|A security layer that allows data separation and permission to access workspaces
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-840 LATTAS-840]
 +
|-
 +
|56
 +
|Possibility to create an unlimited number of workspaces (departments)
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-831 LATTAS-831]
 +
|-
 +
|57
 +
|Adding a unique workspace identifier into tests <p> '''Note:''' To perform testing of this requirement implementation, please test the requirement LATTAS-846 first.
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-846 LATTAS-846]
 +
[https://trackspace.lhsystems.com/browse/LATTAS-841 LATTAS-841]
 +
|-
 +
|58
 +
|Introducing the role of a super admin, who can enter and switch between the workspaces
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-835 LATTAS-835]
 +
|-
 +
|59
 +
|Allowing the creation of multiple super admins
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-838 LATTAS-838]
 +
|-
 +
|60
 +
|Introducing the role of a department admin - who can see the results of tests in their workspace
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-846 LATTAS-846]
 +
|-
 +
|61
 +
|Enabling automatic assignment of user roles to pools/tests/user groups
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-847 LATTAS-847]
 +
|-
 +
|62
 +
|Enabling multi-layer creation of custom question properties - Department admins can see only custom question properties created for their department
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-845 LATTAS-845]
 +
|-
 +
|63
 +
|Enabling department admins to have access to the current full set of standard reports within the workspace scope
 +
'''Note:''' To perform testing of this requirement implementation, both test cases LATTAS-846 and LATTAS-844 should be done in this order.
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-846 LATTAS-846]
 +
[https://trackspace.lhsystems.com/browse/LATTAS-844 LATTAS-844]
 +
|-
 +
|64
 +
|Allowing super admins to access and compare the individual reports between the workspaces:
 +
- Basic reporting - the number of tests, questions, users, and question pools for each workspace
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-842 LATTAS-842]
 +
|-
 +
|65
 +
|Allowing super admins to access and compare the individual reports between the workspaces:
 +
- Reports that show workspace activity (the number of test attempts and created items such as user groups, questions, users, pools, training courses, etc.) during a weekly, monthly, or yearly period
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-843 LATTAS-843]
 +
|-
 +
|34
 +
|Assign users automatically to tests
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-859 LATTAS-859]
 +
|[https://wiki.youtestme.com/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Req%2034%20-%20Assign%20eTest%20user%20qualifications%20automatically%20(SWISS%20Active%20Directory%20list).pdf Article]
 +
|-
 +
|}
 +
== Additional requirements ==
 +
{| class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| N/A
 +
|| Possibility of going back to the previous question when the real-time option is enabled without the possibility of changing answers
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-821 LATTAS-821]
 +
||[{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/Possibility%20of%20going%20back%20to%20the%20previous%20question.pdf Article]
 +
|-
 +
|N/A
 +
|Students to access only test sections for which they have the corresponding qualifications based on their profile. Each student will get an overall score for all sections.
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-905 LATTAS-905]
 +
|[https://wiki.youtestme.com/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/Allowing%20users%20to%20get%20only%20specific%20test%20sections%20based%20on%20their%20data%20information.pdf Article]
 +
|-
 +
|N/A
 +
|In a regular OIDC implementation this shouldn't be the case and more importantly there mustn't be any YTM generated passwords for this accounts.
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-904 LATTAS-904]
 +
|<nowiki>-</nowiki>
 +
|}
 +
=Development cycle 5=
 +
'''NOTE''': Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/
 +
{|class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
|-
 +
|25
 +
| Optimizing TAB keyboard key  for skipping to the next field in the forms visible in the application.
 +
|rowspan = 2|[https://trackspace.lhsystems.com/browse/LATTAS-910 LATTAS-910]
 +
|rowspan = 3|[https://wiki.youtestme.com/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/Requirements/PDF/User%20interface%20navigation%20by%20keyboard.pdf Article]
 +
|-
 +
|47
 +
|Keyboard support for the  user interface.
 +
|-
 +
|41
 +
|Instructions for supported  keyboard keys.
 +
||[https://trackspace.lhsystems.com/browse/LATTAS-914 LATTAS-914]
 +
|-
 +
|30
 +
|Always displaying the home  page after login.
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-913 LATTAS-913]
 +
|| -
 +
|-
 +
|43
 +
|Sans serif font for system  e-mails.
 +
||[https://trackspace.lhsystems.com/browse/LATTAS-912 LATTAS-912]
 +
||-
 +
|-
 +
|44
 +
|The system should remember  how many rows a user wanted to have displayed in a table view. And this setting  should be remembered over sessions.
 +
||[https://trackspace.lhsystems.com/browse/LATTAS-915 LATTAS-915]
 +
||-
 +
|-
 +
|16
 +
|Extending the score report  with:
 +
 +
- qualification and function of the student (if available)
 +
 +
- the time when the test was taken
 +
 +
- test unique ID number
 +
 +
- number of questions asked and number of questions answered correctly
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-911 LATTAS-911]
 +
||[https://www.youtestme.com/kb/how-to-export-detailed-personal-exam-report/ Article]
 +
|-
 +
|9
 +
|Evaluation of wrongly  answered questions in a test:
 +
 +
It is possible to access via "Questions" a test and to have an  overview of the success ratio of each question. There is no possibility to  define a limit or range of success ratio to get an evaluation of a specific  test.
 +
| rowspan="2" |[https://trackspace.lhsystems.com/browse/LATTAS-928 LATTAS-928]
 +
 +
[https://trackspace.lhsystems.com/browse/LATTAS-929 LATTAS-929]
 +
| rowspan="2" |[https://www.youtestme.com/kb/success-ratio-and-pool-question-statistics-reports/ Article]
 +
|-
 +
|19
 +
|Introducing an automatism  that analyses the percentage of correct answers:
 +
 +
- overall, in the question pool
 +
 +
- in a test of a specific group
 +
 +
This automatism should include a variable definition of the number of answers  and the threshold of the percentage of correct answers.
 +
|-
 +
|}
 +
== Additional requirements ==
 +
{| class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
|| N/A
 +
|| Option to delete the test  template even when it is used
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-858 LATTAS-858]
 +
||-
 +
|-
 +
|N/A
 +
|Dialog popping up only when editing a question
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-916 LATTAS-916]
 +
|<nowiki>-</nowiki>
 +
|-
 +
|N/A
 +
|Question ID next to the question notes or display the notes directly in the questions tab
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-908 LATTAS-908]
 +
|<nowiki>-</nowiki>
 +
|-
 +
|N/A
 +
|Option of adding feedback after submitting the answer
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-391 LATTAS-391]
 +
|<nowiki>-</nowiki>
 +
|-
 +
|N/A
 +
|Notification of Instructors  after Feedback on a question
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-930 LATTAS-930]
 +
 +
[https://trackspace.lhsystems.com/browse/LATTAS-931 LATTAS-931]
 +
|[https://www.youtestme.com/kb/test-results-and-question-feedback-statistics-reports/ Article]
 +
|-
 +
|-
 +
|N/A
 +
|SCORM Export of test for  stand-alone use in LMS  - Layout improvement
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-715 LATTAS-715]
 +
| -
 +
|-
 +
|N/A
 +
|Change color of the Submit button when real-time grading option is enabled
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-778 LATTAS-778]
 +
| -
 +
|}
 +
=Development cycle 6=
 +
'''NOTE''': Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/
 +
{| class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
|-
 +
|33
 +
|Allow students to choose questions in tests
 +
|| [https://trackspace.lhsystems.com/browse/LATTAS-1001 LATTAS-1001]
 +
|| [https://www.youtestme.com/kb/self-creation-of-practice-tests/ Article]
 +
|}
 +
===Additional requirements===
 +
{| class="wikitable"
 +
|-
 +
! Req #
 +
! Requirement
 +
! TrackSpace
 +
! Instructions
 +
 +
|-
 +
| N/A
 +
| Fill in the blanks question type improvements
 +
| |[https://trackspace.lhsystems.com/browse/LATTAS-1002 LATTAS-1002]
 +
|  -
 +
|-
 +
|N/A
 +
|Inlude in test all questions from question pool
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-1037 LATTAS-983]
 +
|[https://www.youtestme.com/kb/how-to-generate-tests-with-all-questions-included-from-the-pool/ Article]
 +
|-
 +
|N/A
 +
|How to time and track changes of questions
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-1044 LATTAS-1044]
 +
[https://trackspace.lhsystems.com/browse/LATTAS-1149 LATTAS-1149]
 +
|[https://www.youtestme.com/kb/how-to-manage-question-version-activation/ Article]
 +
|-
 +
|N/A
 +
|Audit trail/View previous versions: highlight changes
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-1045 LATTAS-1045]
 +
|[https://www.youtestme.com/kb/how-to-track-changes-in-questions/ Article]
 +
|-
 +
|N/A
 +
|Bulk editing questions
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-1072 LATTAS-1072]
 +
|[https://www.youtestme.com/kb/how-to-bulk-edit-questions/ Article]
 +
|-
 +
|N/A
 +
|Automatic update of questions in manually created tests
 +
|[https://trackspace.lhsystems.com/browse/LATTAS-1073 LATTAS-1073]
 +
|[https://www.youtestme.com/kb/automated-updates-for-questions-in-manually-created-tests/ Article]
 +
|}
 +
 +
=Training=
 +
 +
Instructional matrial regarding topics that have been covered in the Lufthansa training sessions could be found in the links listed in the tables below.
 +
 +
===Overview of the application===
 +
 +
{|class="wikitable"
 +
! Link
 +
! Description
 +
! Type
 +
 +
|-
 +
| [https://owncloud.youtestme.com/owncloud/s/bSX2EcUAB3XqSiQ Lufthansa training session - DAY 1] || Overview of the basic workflow in the YouTestMe GetCertified Application || Video
 +
|-
 +
| [https://wiki2.youtestme.com/youtestme/youtestmedoc/Procedures/Support%20Procedures/Getting%20Started%20with%20YouTestMe%20GetCertified.pdf Getting started with YouTestMe GetCertified]
 +
|| Aims to provide the complete guide to getting started with YouTestMe and recommendations for the best use cases, enabling clients to organize the whole testing process easily. ||  Article
 +
|-
 +
| [https://www.youtube.com/watch?v=u-iZEZZkWGU Application overview] || One-minute overview of the main modules in YouTestMe GetCertified 10.0 || Video
 +
|-
 +
|[{{SERVER}}/youtestme/youtestmedoc/Document%20Templates/Clients/Software%20Information/YouTestMe%20-%20Naming%20Conventions.pdf Naming conventions]
 +
|| Rules for naming components in YouTestMe GetCertified || Article
 +
|-
 +
| [https://www.youtube.com/watch?v=WexINhY0EfQ&ab_channel=YouTestMe Roles and permissions] || Explanation of the roles and permissions, default system roles with their different levels of access, and step by step instructions on creating a new role with custom permissions. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=I1tW2oY4eRI How to create a test using test generator] || Instructions on how to to use a test generator to create a number of different versions of the same test. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=UqYth6A9i1Q YouTestMe GetCertified 10.0 - Reports Overview]
 +
|| A quick overview of reporting module that contains over 40 types of Predefined Reports, sophisticated Report Builder, the system for scheduling reports, and a section for the most important ones. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=1YMT33apMFc How to change application theme and branding] || Instructions on how to change application theme, the appearance of the login page, logo, and favicon.|| Video
 +
|-
 +
| [https://www.youtube.com/watch?v=vw37vS8EJug How to configure notifications] || Instructions on how to edit in-application and email notifications in the system, notification preview from the user’s perspective, and a quick explanation of basic notification events.|| Video
 +
|-
 +
|}
 +
 +
===Taxonomies===
 +
 +
{|class="wikitable"
 +
! Link
 +
! Description
 +
! Type
 +
 +
|-
 +
| [https://owncloud.youtestme.com/owncloud/s/PzUizisk8Rez2iB Lufthansa training session - DAY 2]  ||It ims to explain how to generate tests based on question categories you previously created and assigned to the test questions. || Video
 +
|-
 +
| [https://www.youtestme.com/kb/how-to-generate-tests-based-on-question-categories/ How to generate tests based on question categories with YouTestMe GetCertified]
 +
|| Aims to expalin how to generate tests based on question categories you previously created and assigned to the test questions ||  Article
 +
|-
 +
|}
 +
 +
===Question pools===
 +
 +
{|class="wikitable"
 +
! Link
 +
! Description
 +
! Type
 +
 +
|-
 +
| [https://owncloud.youtestme.com/owncloud/s/65KnofaxyXXdmhC Lufthansa training session - DAY 3]  || It aims to explain question pool functionality and confirguration of all question types. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=qjnQdR11jS4&t=116s Question pools] || In this video, you will learn about question pool functionalities and 10 question types supported by YouTestMe GetCertified. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=NVl_iiCX-Yc Question tags] || Explanation of question tags, instructions on how to add them through question pools, and how to filter them in question pools later by the tags they contain. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=WqUompofJEY Single choice question] || Instructions on how to create a single choice question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=AO5oK3aUkMY Multiple choice question] || Instructions on how to create a multiple choice question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=z__Xyx-3ZJY True/False question] || Instructions on creating a true/false question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=iyLxrfgnwkk Ordering (Arrangement) question] || Instructions on how to create ordering question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=43cjVvmuiXg Essay question] || Instructions on how to create essay question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=utGzmJtI8Us Open-ended (Numerical answer, Formula) question] || Instructions on creating open-ended question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=WG7vl-pJqcQ Matching (Mapping) question] || Instructions on how to create matching question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=pe8VxRj0ZtQ Hot spot (Mark errors, Imagemap) question] || Instructions on how to create hot spot question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=ZgQH5UV5G6c Fill in the blanks (Cloze question, Name terms) question] || Instructions on how to create fill in the blanks question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=QX565hlA4lo Matrix (Kprim choice) question] || Instructions on how to create matrix question type, explanation of its configurations, and a preview of it in a test-taking process. || Video
 +
|-
 +
|}
 +
 +
===Question importers===
 +
 +
{|class="wikitable"
 +
! Link
 +
! Description
 +
! Type
 +
 +
|-
 +
| [https://owncloud.youtestme.com/owncloud/s/j0CxCOhYJznv0In Lufthansa training session - DAY 4]  || It aims to explain the question importers. || Video
 +
|-
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/How%20to%20migrate%20and%20import%20QTI%20package.pdf How to migrate and import QTI package into YTM] ||  QTI-based importer for questions.|| Article
 +
|-
 +
| [https://www.youtestme.com/kb/how-to-import-questions-with-additional-category-values-using-excel-file/ How to import questions pools with additional custom columns using an Excel file] || Custom Excel-based importer for questions and question pools.|| Article
 +
|-
 +
| [https://www.youtestme.com/kb/how-to-import-questions-with-additional-category-values-using-excel-file/ How to import questions with additional category values using Excel file]|| The Excel template used for bulk importing questions - additional column || Article
 +
|-
 +
|}
 +
 +
===Test creation, testing sessions and users===
 +
 +
{|class="wikitable"
 +
! Link
 +
! Description
 +
! Type
 +
 +
|-
 +
| [https://owncloud.youtestme.com/owncloud/s/lnEZ30FxeDndHBe Lufthansa training session - DAY 5]  || It aims to explain test creeation process, testing sessions and users. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=dwb0idaAZc8 Creating a simple test] || Explanation on how to create a simple test without sections and assign candidates to it. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=JAHF3lqpeNY Creating a test with sections] || Explanation on how to create a test with sections that can represent different areas of knowledge. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=I1tW2oY4eRI How to create a test using test generator] || Instructions on how to to use a test generator to create a number of different versions of the same test. || Video
 +
|-
 +
| [https://www.youtestme.com/kb/how-to-edit-published-test-settings-in-the-genereted-test/?doing_wp_cron=1647900942.7284989356994628906250/ How to edit published test settings in the genereted test]
 +
|| It aims to explain how to edit settings in the draft and published version of the test.|| Article
 +
|-
 +
| [https://www.youtube.com/watch?v=WexINhY0EfQ&ab_channel=YouTestMe Roles and permissions] || Explanation of the roles and permissions, default system roles with their different levels of access, and step by step instructions on creating a new role with custom permissions. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=qdoi4UtUkE0&ab_channel=YouTestMe How to create user group manager] || Instructions on creating a role in the application that has permission to access, create, and/or manage user groups. || Video
 +
|-
 +
| [https://www.youtestme.com/kb/how-to-bulk-import-users/ How to bulk import users] || Explanation of how to import multiple users at once using an Excel template. || Article
 +
|-
 +
| [https://www.youtube.com/watch?v=I4fKL2tVtqM User groups] || A quick overview of User Groups module, instructions on how to organize users into groups, and examine group statistics. || Video
 +
|-
 +
|}
 +
 +
===LTI Integration and Test-taking process===
 +
 +
{|class="wikitable"
 +
! Link
 +
! Description
 +
! Type
 +
 +
|-
 +
| [https://owncloud.youtestme.com/owncloud/s/BftCOmPyjIkde3X Lufthansa training session - DAY 6]  || It aims to explain LTI Integration and test-taking process.|| Video
 +
|-
 +
| [https://www.youtube.com/watch?v=obhsrRVClpE&feature=emb_imp_woyt How to predefine feedback to answers] || Instructions on how to provide candidates feedback to selected answers that will be displayed during the test-taking process. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=xGejwQDhfMY How to set up report content] || Instructions on how to set up reports containing test results – configure the content, report lifespan, and report visibility time for test-takers. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=1ozq0yXNTfo How to define grading scales and passing marks] || Explanation of the grading scales, their configurations, instructions on applying automatic grading to test with or without sections, and step-by-step instructions on how to create a new one. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=R3lMwXW1Wbc Test-taking process] || Candidate's perspective of the Test-taking Process and quick overview of all question types. || Video
 +
|-
 +
| [https://www.youtube.com/watch?v=pZSZxncy6A8 Multilingual tests] || Instructions on how to create different language versions for each question, distribute multilingual tests, and allow candidates to take the test in the preferred language. || Video
 +
|-
 +
|| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Lufthansa/PDF/LTI%20Integration.pdf LTI Integration] || How to connect the YouTestMe test to the ILIAS, start the test from ILIAS course, and review the grade sent from YouTestMe. || Article
 +
|-
 +
|}
 +
 +
===Reporting===
 +
 +
{|class="wikitable"
 +
! Link
 +
! Description
 +
! Type
 +
 +
|-
 +
| [https://owncloud.youtestme.com/owncloud/s/wHa4NtK0jShr5zi Lufthansa training session - DAY 7]  || It aims to explain LTI Integration and test-taking process.|| Video
 +
|-
 +
| [https://www.youtube.com/watch?v=UqYth6A9i1Q YouTestMe GetCertified 10.0 - Reports Overview]
 +
|| A quick overview of reporting module that contains over 40 types of Predefined Reports, sophisticated Report Builder, the system for scheduling reports, and a section for the most important ones.
 +
| Video
 +
|-
 +
| [https://www.youtube.com/watch?v=pyVW47-4mrc YouTestMe GetCertified 10.0 - Report Builder]
 +
|| Instructions on how to obtain a detailed insight into test/survey statistics or compare individual items by creating completely customized and unique reports with employed advanced search filters.
 +
| Video
 +
|-
 +
| [https://www.youtestme.com/kb/how-to-access-and-use-predefined-reports/ How to access and use predefined reports]
 +
|| Step-by-step instructions on how to access and use predefined reports to see organized and aggregated information from the database. Usually, reports are displayed in a tabular format, but some of them have additional graphical representations.
 +
| Article
 +
|-
 +
| [https://www.youtube.com/watch?v=KQ0I3QfCAwk YouTestMe GetCertified 10.0 - How to Schedule Reports]
 +
|| Step-by-step instructions on how to schedule automated report sending by email at specified times.
 +
| Video
 +
|-
 +
| [https://www.youtube.com/watch?v=YB9BNnvUwWA YouTestMe GetCertified 10.0 - How to Track Login and Logout Activites]
 +
|| Instructions on how to track login and logout activities of single or all users in the system and export log events as pdf or excel files.
 +
| Video
 +
|-
 +
|}
 +
 +
===Recovring topics from the previous training lessons (after UAT analyses)===
 +
 +
{|class="wikitable"
 +
! Link
 +
! Description
 +
! Type
 +
 +
|-
 +
|[https://owncloud.youtestme.com/owncloud/s/WeO2NPAp6ccmLsP Lufthansa training session - DAY 8] || It aims to recover topics from the previous training lessons (after UAT analyses)
 +
| Video
 +
|-
 +
|[https://www.youtestme.com/kb/how-to-import-questions-to-the-question-pool-using-an-excel-template/?doing_wp_cron=1649956388.4426910877227783203125 How to bulk import questions to the question pool using an Excel file]
 +
|| Instructions on how to import questions into the question pool quickly and efficiently using a predefined YTM Excel format
 +
| Article
 +
|-
 +
|[https://www.youtestme.com/kb/how-to-create-generated-tests-that-contain-questions-with-the-scoring-method-by-answer-weight/ How to create generated tests that contain questions with the Scoring method "By answer weight"]
 +
|| Instructions on how to create generated tests that contain questions with the Scoring method "By answer weight"
 +
|Article
 +
|-
 +
|[https://www.youtestme.com/kb/personal-report-settings/ How to customize personal report settings]
 +
|| Instructions on how to customize personal report settings for the desired tests. You can customize the report content visible to candidates taking the test.
 +
| Article
 +
|-
 +
|[https://www.youtestme.com/kb/how-to-edit-published-test-settings/ How to edit published test settings]
 +
||  Instructions on how to edit published test settings, add new questions, or delete existing ones, change the passing mark for the test and preview all the changes.
 +
| Article
 +
|-
 
|}
 
|}

Revision as of 15:34, 4 April 2024

Customer support contact information

Phone: +1 888 418 1718 and +1 647 558 6017
Email Address: support@youtestme.com

Important links

Link to the production environment: https://lat.youtestme.com
Link to the sandbox environment (for the UAT): https://lat-sandbox.youtestme.com

Terminology

YouTestMe Term Term Description
Matrix question Kprim choice Questions represented in a grid format. The rows present the questions, and the columns offer a set of predefined answer choices that apply to each question in the row..
Hot Spot question Mark errors, Imagemap Users are required to mark "spots" on an image as an answer.
Fill in the blanks question Cloze question, Name terms Users need to fill in the sentences' missing parts. Grade this question manually or create offered answers in the drop-down form, which can be automatically graded..
Open-ended question Numerical answer, Formula question Blank space needs to be filled with the correct answer that the system will automatically compare with the predefined correct answer..
Ordering question Arrangement question Users need to rearrange answers into the correct order.
Matching question Mapping question Users have to pair objects on the left with the objects on the right side.

Standard instructional materials

This chapter contains instructional documents and videos for administrators on how to use YouTestMe GetCertified application.

Getting started with YouTestMe

Link Description
Getting started with YouTestMe GetCertified Aims to provide the complete guide to getting started with YouTestMe and recommendations for the best use cases, enabling clients to organize the whole testing process easily.
Application overview One-minute overview of the main modules in YouTestMe GetCertified 10.0
Naming conventions Rules for naming components in YouTestMe GetCertified

Users

Follow the steps below to explore this module.

Steps Link Description Type
1 Roles and permissions Explanation of the roles and permissions, default system roles with their different levels of access, and step by step instructions on creating a new role with custom permissions. Video
2 How to create user group manager Instructions on creating a role in the application that has permission to access, create, and/or manage user groups. Video
3 How to bulk import users Explanation of how to import multiple users at once using an Excel template. Article
4 User groups A quick overview of User Groups module, instructions on how to organize users into groups, and examine group statistics. Video

Tests

Follow the steps below to explore this module.

Steps Link Description Type
4 How to predefine feedback to answers Instructions on how to provide candidates feedback to selected answers that will be displayed during the test-taking process. Video
5 How to set up report content Instructions on how to set up reports containing test results – configure the content, report lifespan, and report visibility time for test-takers. Video
6 How to define grading scales and passing marks Explanation of the grading scales, their configurations, instructions on applying automatic grading to test with or without sections, and step-by-step instructions on how to create a new one. Video
7 Test-taking process Candidate's perspective of the Test-taking Process and quick overview of all question types. Video
8 Multilingual tests Instructions on how to create different language versions for each question, distribute multilingual tests, and allow candidates to take the test in the preferred language. Video

Questions and question Pools

Follow the steps below to explore this module.

Steps Link Description Type
1 Question pools In this video, you will learn about question pool functionalities and 10 question types supported by YouTestMe GetCertified. Video
2 How to create question pool manager Additional user-defined fields attached to exam questions in order to search for questions containing word(s) in these fields. Video
3 Question tags Explanation of question tags, instructions on how to add them through question pools, and how to filter them in question pools later by the tags they contain. Video
4 Single choice question Instructions on how to create a single choice question type, explanation of its configurations, and a preview of it in a test-taking process. Video
5 Multiple choice question Instructions on how to create a multiple choice question type, explanation of its configurations, and a preview of it in a test-taking process. Video
6 True/False question Instructions on creating a true/false question type, explanation of its configurations, and a preview of it in a test-taking process. Video
7 Ordering (Arrangement) question Instructions on how to create ordering question type, explanation of its configurations, and a preview of it in a test-taking process. Video
8 Essay question Instructions on how to create essay question type, explanation of its configurations, and a preview of it in a test-taking process. Video
9 Open-ended (Numerical answer, Formula) question Instructions on creating open-ended question type, explanation of its configurations, and a preview of it in a test-taking process. Video
10 Matching (Mapping) question Instructions on how to create matching question type, explanation of its configurations, and a preview of it in a test-taking process. Video
11 Hot spot (Mark errors, Imagemap) question Instructions on how to create hot spot question type, explanation of its configurations, and a preview of it in a test-taking process. Video
12 Fill in the blanks (Cloze question, Name terms) question Instructions on how to create fill in the blanks question type, explanation of its configurations, and a preview of it in a test-taking process. Video
13 Matrix (Kprim choice) question Instructions on how to create matrix question type, explanation of its configurations, and a preview of it in a test-taking process. Video
14 Branching questions Instructions on how to enable the branching feature for several question types to create the subsequent questions based on the chosen answer/response. Video
15 How to randomize questions & answers Instructions on how to randomize the order of questions and answers in a (draft) test, when questions are added manually, or test is created using a test generator. Video
16 Collaborative Content Management (Questions) Demonstration of two ways of collaborative content management (of questions and question pools) in YouTestMe GetCertified. Video
17 How to create custom question properties This article explains how to create custom question properties that can be used when creating questions. Article
18 How to create dropdown type of custom question property This article explains how to create a custom question property (dropdown type) that can be used when creating questions. Article

Reporting

Link Description Type
YouTestMe GetCertified 10.0 - Reports Overview A quick overview of reporting module that contains over 40 types of Predefined Reports, sophisticated Report Builder, the system for scheduling reports, and a section for the most important ones. Video
YouTestMe GetCertified 10.0 - Report Builder Instructions on how to obtain a detailed insight into test/survey statistics or compare individual items by creating completely customized and unique reports with employed advanced search filters. Video
How to access and use predefined reports Step-by-step instructions on how to access and use predefined reports to see organized and aggregated information from the database. Usually, reports are displayed in a tabular format, but some of them have additional graphical representations. Article
YouTestMe GetCertified 10.0 - How to Schedule Reports Step-by-step instructions on how to schedule automated report sending by email at specified times. Video
YouTestMe GetCertified 10.0 - How to Track Login and Logout Activites Instructions on how to track login and logout activities of single or all users in the system and export log events as pdf or excel files. Video

System

Link Description Type
How to change application theme and branding Instructions on how to change application theme, the appearance of the login page, logo, and favicon. Video
How to configure notifications Instructions on how to edit in-application and email notifications in the system, notification preview from the user’s perspective, and a quick explanation of basic notification events. Video
How to change and reset the password Instructions on how to change and reset the personal password and change other user's passwords. Video
How to set up SSO configuration Instructions on how to set up SSO configuration. GetCertified can act as a Service Provider through the SAML 2.0 protocol, which allows the exchange of authorization data with an Identity Provider. Article
How to integrate YouTestMe GetCertified with your LMS This article will explain how to integrate YouTestMe GetCertified with your LMS. Article
Communication with LRS via xAPI Step-by-step instructions on how to set up integration with any Learning Record Store (LRS) to transfer data from YouTestMe GetCertified. Video
API Development Portal This documentation provides you with GetCertified REST API endpoint requirements, sample JSON, request parameters, and response content. Link
Job Scheduler Job scheduling system of YouTestMe GetCertified controls unattended background program execution of jobs, whereas a job represents a work unit.

Learn how to schedule jobs to run at specified time intervals, automate import, export, or any communication between YouTestMe GetCertified and external systems or processes within the YouTestMe system.

Video
How to customize interface application text This article explains how to use the language bundles feature to customize interface application text. Link

Data Migration

Link Description Type
Migrating and Importing QTI Package How to migrate and import QTI package. Article
QTI Question Importer How to create a question pool and import questions using YouTestMe QTI importer. Video
QTI Question Importer How to create a question pool and import questions using YouTestMe QTI importer. Article
Swiss Importer How to import multiple question pools from an Excel file into the YouTestMe GetCertified. Article
LTI Integration How to connect the YouTestMe test to the ILIAS, start the test from ILIAS course, and review the grade sent from YouTestMe. Article

Development cycle 1

NOTE: Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/

Taxonomies and Test Generator

Req # Requirement TrackSpace Instructions
71 Create hierarchically organized values of a single custom question property. LATTAS-517 Article
69 Define an unlimited number of custom question properties.
68 Adding the option to create custom question properties on the Question pools page. LATTAS-519
70 Associate more than 1 value with a single question: For example, for the Phase field, you will be able to select T1 and T2a and T2b and T3.
67 Including custom properties in test generator as criteria for generating tests. LATTAS-520
67 Using question pools as Learning topics. LATTAS-593 Article
UAT The mechanism for checking the test generator rules before editing questions in question pools. LATTAS-605 Article

Bug fixes

Req # Requirement TrackSpace Instructions
8 Error hint from question upload not correct: If a cell in the Excel file is empty but should contain data, the error message does not indicate the correct cell.
For example, in the attached Excel file the cell 4B is empty, but the error message indicates cell 4C.
LATTAS-528 PDF
11 Improving the caption on the Import from Excel button: When clicking the Import from Excel button in the Question pools page and then selecting a valid Excel file with questions/answers according to the YTM specification, an error "Excel file not found" is displayed, and no question pool is created. If the function triggered by the button is not what it says, either the caption should be changed, or the functionality should be corrected to adapt
to the button caption.
LATTAS-534 PDF
23 Review test results within a defined time period. LATTAS-531 PDF
26 Displaying the passing mark in the personal report. LATTAS-530 PDF
28 The "Waiting for report" message needs to appear at the appropriate time. LATTAS-535 PDF
49 Refreshing the page after the import of a question pool. LATTAS-529 PDF
53 Lookup test results of previous test run LATTAS-553 PDF

LTI

Req # Requirement TrackSpace Instructions
2 Tests can be called from the LMS, e.g., via an LTI interface LATTAS-556 Article
13 Allowing continuation after an interruption of a test started
14 Allowing breaks/continuation with tests started

Importers

Req # Requirement TrackSpace Instructions
3 QTI-based importer for questions LATTAS-564 Article
4 Custom Excel-based importer for questions and question pools

Note: The article is corrected according to the requirements from newer development cycles.

LATTAS-566 Article
72 The Excel template used for bulk importing questions - additional column LATTAS-561 Article

Clarifications

Req # Requirement TrackSpace Instructions
17 Manual adjustment on results LATTAS-395 Article
18 Possibility to hide the report after finishing the test LATTAS-397 Article
42 Restoring system text snippets to the original state LATTAS-418 Article

Resources

Requirement Description Resource
3 Download and use the following file when migrating data from ILIAS to YouTestMe GetCertified. DTD File
4 Download and use the following files for easier testing of requirement #4. Sample 1

Sample 2
Sample 3

8 Download and use the following file for easier testing of requirement #8. By importing this file, you will trigger the required error. File
11 Download and use the following file for easier testing of requirement #11. By importing this files, you will trigger the necessary messages. Sample 1

Sample 2
Sample 3

Development cycle 2

NOTE: Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/

OpenID Connect SSO

Req # Requirement TrackSpace Instructions
1 OpendID SSO LATTAS-641 Article

Student screens

Req # Requirement TrackSpace


27 Student's screens need to be fully optimized - Mobile phone LATTAS-648
27 Student's screens need to be fully optimized - Tables LATTAS-654
27 Student's screens need to be fully optimized - Standard screen sizes LATTAS-655

Bug fix

Req # Requirement TrackSpace
N/A The notification message is shown only shortly when moving questions from one pool to another LATTAS-621

Retake attempt via LTI

Req # Requirement TrackSpace Instructions
N/A Retake attempt via LTI LATTAS-660 Article

Development cycle 3

NOTE: Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/

Req # Requirement TrackSpace Instructions
5 Information presented to the students LATTAS-733 Article
7 Enabling zooming the pictures in and out, and not only displaying them in their original size LATTAS-736 Article
10 A field where the student can write down feedback to a specific question LATTAS-758 Article
52 An "individual" evaluation with the possibility to define whether this question is easy, medium, or difficult for the student him-/herself
24 Special scenarios for importing questions using Excel in SWISS format LATTAS-757 Article
31 Custom e-mail invitation for tests LATTAS-755 Article
32 After reading and parsing the QTI file, the user should be presented with all the questions contained therein and then given the opportunity to select the questions that are to be imported LATTAS-756 Article
35 The option to comment on the changes applied to a test LATTAS-718 Article
45 When creating a new question property, the custom types should be displayed in the drop-down list in ascending sort order by name LATTAS-722 Article
51 Possibility to mark questions where the mark does not disappear once the test is finished to help the student review these questions later LATTAS-737 Article
74 Adding the Comments field in the question changelog LATTAS-759 Article
75 Adding the Revert / Preview options in the question changelog LATTAS-760 Article

Improvements

Req # Requirement TrackSpace Instructions
N/A Accessing personal report via LTI LATTAS-793 Article
N/A Fill in the blanks: Blanks within the text and not listed below LATTAS-536 -
N/A Grey out chosen answers in the candidate's personal report when I don't know option is selected LATTAS-537 -

Development cycle 4

NOTE: Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/

Req # Requirement TrackSpace Instructions
12 Displaying the information about the number of attempts left on the My assignments panel LATTAS-814 Article
15 Improving the log message for the QTI-based question job importer LATTAS-815 Article
22 Additional options on the Personal report page:

- Score and details only on wrong answers

- No report available for student

LATTAS-820 -
29 Displaying the appropriate hint when the test is suspended LATTAS-816 Article
36 Option to create a copy of a question pool LATTAS-817 Article
37 Confirmation notification after deletion of a user

Note: This requirement has been implemented before, so it is already resolved.

LATTAS-701 -
39 When displaying a question pool, the table with the questions can become quite wide so that when looking at columns on the far right, the action column on the left edge of the table is no longer visible.

Therefore, it would be quite good if the action column would remain constantly visible (freeze) and clickable to make working with the questions in a question pool more efficient

LATTAS-818 -
46 The option to display entered data immediately after the creation of a new user LATTAS-819 -
66 Allowing unique logo design and color theme for each workspace LATTAS-839 Article
54 The dashboard for managing workspaces (edit existing workspaces and create new ones) LATTAS-848

LATTAS-833

55 A security layer that allows data separation and permission to access workspaces LATTAS-840
56 Possibility to create an unlimited number of workspaces (departments) LATTAS-831
57 Adding a unique workspace identifier into tests

Note: To perform testing of this requirement implementation, please test the requirement LATTAS-846 first.

LATTAS-846

LATTAS-841

58 Introducing the role of a super admin, who can enter and switch between the workspaces LATTAS-835
59 Allowing the creation of multiple super admins LATTAS-838
60 Introducing the role of a department admin - who can see the results of tests in their workspace LATTAS-846
61 Enabling automatic assignment of user roles to pools/tests/user groups LATTAS-847
62 Enabling multi-layer creation of custom question properties - Department admins can see only custom question properties created for their department LATTAS-845
63 Enabling department admins to have access to the current full set of standard reports within the workspace scope

Note: To perform testing of this requirement implementation, both test cases LATTAS-846 and LATTAS-844 should be done in this order.

LATTAS-846

LATTAS-844

64 Allowing super admins to access and compare the individual reports between the workspaces:

- Basic reporting - the number of tests, questions, users, and question pools for each workspace

LATTAS-842
65 Allowing super admins to access and compare the individual reports between the workspaces:

- Reports that show workspace activity (the number of test attempts and created items such as user groups, questions, users, pools, training courses, etc.) during a weekly, monthly, or yearly period

LATTAS-843
34 Assign users automatically to tests LATTAS-859 Article

Additional requirements

Req # Requirement TrackSpace Instructions
N/A Possibility of going back to the previous question when the real-time option is enabled without the possibility of changing answers LATTAS-821 Article
N/A Students to access only test sections for which they have the corresponding qualifications based on their profile. Each student will get an overall score for all sections. LATTAS-905 Article
N/A In a regular OIDC implementation this shouldn't be the case and more importantly there mustn't be any YTM generated passwords for this accounts. LATTAS-904 -

Development cycle 5

NOTE: Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/

Req # Requirement TrackSpace Instructions
25 Optimizing TAB keyboard key for skipping to the next field in the forms visible in the application. LATTAS-910 Article
47 Keyboard support for the user interface.
41 Instructions for supported keyboard keys. LATTAS-914
30 Always displaying the home page after login. LATTAS-913 -
43 Sans serif font for system e-mails. LATTAS-912 -
44 The system should remember how many rows a user wanted to have displayed in a table view. And this setting should be remembered over sessions. LATTAS-915 -
16 Extending the score report with:

- qualification and function of the student (if available)

- the time when the test was taken

- test unique ID number

- number of questions asked and number of questions answered correctly

LATTAS-911 Article
9 Evaluation of wrongly answered questions in a test:

It is possible to access via "Questions" a test and to have an overview of the success ratio of each question. There is no possibility to define a limit or range of success ratio to get an evaluation of a specific test.

LATTAS-928

LATTAS-929

Article
19 Introducing an automatism that analyses the percentage of correct answers:

- overall, in the question pool

- in a test of a specific group

This automatism should include a variable definition of the number of answers and the threshold of the percentage of correct answers.

Additional requirements

Req # Requirement TrackSpace Instructions
N/A Option to delete the test template even when it is used LATTAS-858 -
N/A Dialog popping up only when editing a question LATTAS-916 -
N/A Question ID next to the question notes or display the notes directly in the questions tab LATTAS-908 -
N/A Option of adding feedback after submitting the answer LATTAS-391 -
N/A Notification of Instructors after Feedback on a question LATTAS-930

LATTAS-931

Article
N/A SCORM Export of test for stand-alone use in LMS  - Layout improvement LATTAS-715 -
N/A Change color of the Submit button when real-time grading option is enabled LATTAS-778 -

Development cycle 6

NOTE: Please use the following environment for the user acceptance testing (UAT): https://lat-sandbox.youtestme.com/

Req # Requirement TrackSpace Instructions
33 Allow students to choose questions in tests LATTAS-1001 Article

Additional requirements

Req # Requirement TrackSpace Instructions
N/A Fill in the blanks question type improvements LATTAS-1002 -
N/A Inlude in test all questions from question pool LATTAS-983 Article
N/A How to time and track changes of questions LATTAS-1044

LATTAS-1149

Article
N/A Audit trail/View previous versions: highlight changes LATTAS-1045 Article
N/A Bulk editing questions LATTAS-1072 Article
N/A Automatic update of questions in manually created tests LATTAS-1073 Article

Training

Instructional matrial regarding topics that have been covered in the Lufthansa training sessions could be found in the links listed in the tables below.

Overview of the application

Link Description Type
Lufthansa training session - DAY 1 Overview of the basic workflow in the YouTestMe GetCertified Application Video
Getting started with YouTestMe GetCertified Aims to provide the complete guide to getting started with YouTestMe and recommendations for the best use cases, enabling clients to organize the whole testing process easily. Article
Application overview One-minute overview of the main modules in YouTestMe GetCertified 10.0 Video
Naming conventions Rules for naming components in YouTestMe GetCertified Article
Roles and permissions Explanation of the roles and permissions, default system roles with their different levels of access, and step by step instructions on creating a new role with custom permissions. Video
How to create a test using test generator Instructions on how to to use a test generator to create a number of different versions of the same test. Video
YouTestMe GetCertified 10.0 - Reports Overview A quick overview of reporting module that contains over 40 types of Predefined Reports, sophisticated Report Builder, the system for scheduling reports, and a section for the most important ones. Video
How to change application theme and branding Instructions on how to change application theme, the appearance of the login page, logo, and favicon. Video
How to configure notifications Instructions on how to edit in-application and email notifications in the system, notification preview from the user’s perspective, and a quick explanation of basic notification events. Video

Taxonomies

Link Description Type
Lufthansa training session - DAY 2 It ims to explain how to generate tests based on question categories you previously created and assigned to the test questions. Video
How to generate tests based on question categories with YouTestMe GetCertified Aims to expalin how to generate tests based on question categories you previously created and assigned to the test questions Article

Question pools

Link Description Type
Lufthansa training session - DAY 3 It aims to explain question pool functionality and confirguration of all question types. Video
Question pools In this video, you will learn about question pool functionalities and 10 question types supported by YouTestMe GetCertified. Video
Question tags Explanation of question tags, instructions on how to add them through question pools, and how to filter them in question pools later by the tags they contain. Video
Single choice question Instructions on how to create a single choice question type, explanation of its configurations, and a preview of it in a test-taking process. Video
Multiple choice question Instructions on how to create a multiple choice question type, explanation of its configurations, and a preview of it in a test-taking process. Video
True/False question Instructions on creating a true/false question type, explanation of its configurations, and a preview of it in a test-taking process. Video
Ordering (Arrangement) question Instructions on how to create ordering question type, explanation of its configurations, and a preview of it in a test-taking process. Video
Essay question Instructions on how to create essay question type, explanation of its configurations, and a preview of it in a test-taking process. Video
Open-ended (Numerical answer, Formula) question Instructions on creating open-ended question type, explanation of its configurations, and a preview of it in a test-taking process. Video
Matching (Mapping) question Instructions on how to create matching question type, explanation of its configurations, and a preview of it in a test-taking process. Video
Hot spot (Mark errors, Imagemap) question Instructions on how to create hot spot question type, explanation of its configurations, and a preview of it in a test-taking process. Video
Fill in the blanks (Cloze question, Name terms) question Instructions on how to create fill in the blanks question type, explanation of its configurations, and a preview of it in a test-taking process. Video
Matrix (Kprim choice) question Instructions on how to create matrix question type, explanation of its configurations, and a preview of it in a test-taking process. Video

Question importers

Link Description Type
Lufthansa training session - DAY 4 It aims to explain the question importers. Video
How to migrate and import QTI package into YTM QTI-based importer for questions. Article
How to import questions pools with additional custom columns using an Excel file Custom Excel-based importer for questions and question pools. Article
How to import questions with additional category values using Excel file The Excel template used for bulk importing questions - additional column Article

Test creation, testing sessions and users

Link Description Type
Lufthansa training session - DAY 5 It aims to explain test creeation process, testing sessions and users. Video
Creating a simple test Explanation on how to create a simple test without sections and assign candidates to it. Video
Creating a test with sections Explanation on how to create a test with sections that can represent different areas of knowledge. Video
How to create a test using test generator Instructions on how to to use a test generator to create a number of different versions of the same test. Video
How to edit published test settings in the genereted test It aims to explain how to edit settings in the draft and published version of the test. Article
Roles and permissions Explanation of the roles and permissions, default system roles with their different levels of access, and step by step instructions on creating a new role with custom permissions. Video
How to create user group manager Instructions on creating a role in the application that has permission to access, create, and/or manage user groups. Video
How to bulk import users Explanation of how to import multiple users at once using an Excel template. Article
User groups A quick overview of User Groups module, instructions on how to organize users into groups, and examine group statistics. Video

LTI Integration and Test-taking process

Link Description Type
Lufthansa training session - DAY 6 It aims to explain LTI Integration and test-taking process. Video
How to predefine feedback to answers Instructions on how to provide candidates feedback to selected answers that will be displayed during the test-taking process. Video
How to set up report content Instructions on how to set up reports containing test results – configure the content, report lifespan, and report visibility time for test-takers. Video
How to define grading scales and passing marks Explanation of the grading scales, their configurations, instructions on applying automatic grading to test with or without sections, and step-by-step instructions on how to create a new one. Video
Test-taking process Candidate's perspective of the Test-taking Process and quick overview of all question types. Video
Multilingual tests Instructions on how to create different language versions for each question, distribute multilingual tests, and allow candidates to take the test in the preferred language. Video
LTI Integration How to connect the YouTestMe test to the ILIAS, start the test from ILIAS course, and review the grade sent from YouTestMe. Article

Reporting

Link Description Type
Lufthansa training session - DAY 7 It aims to explain LTI Integration and test-taking process. Video
YouTestMe GetCertified 10.0 - Reports Overview A quick overview of reporting module that contains over 40 types of Predefined Reports, sophisticated Report Builder, the system for scheduling reports, and a section for the most important ones. Video
YouTestMe GetCertified 10.0 - Report Builder Instructions on how to obtain a detailed insight into test/survey statistics or compare individual items by creating completely customized and unique reports with employed advanced search filters. Video
How to access and use predefined reports Step-by-step instructions on how to access and use predefined reports to see organized and aggregated information from the database. Usually, reports are displayed in a tabular format, but some of them have additional graphical representations. Article
YouTestMe GetCertified 10.0 - How to Schedule Reports Step-by-step instructions on how to schedule automated report sending by email at specified times. Video
YouTestMe GetCertified 10.0 - How to Track Login and Logout Activites Instructions on how to track login and logout activities of single or all users in the system and export log events as pdf or excel files. Video

Recovring topics from the previous training lessons (after UAT analyses)

Link Description Type
Lufthansa training session - DAY 8 It aims to recover topics from the previous training lessons (after UAT analyses) Video
How to bulk import questions to the question pool using an Excel file Instructions on how to import questions into the question pool quickly and efficiently using a predefined YTM Excel format Article
How to create generated tests that contain questions with the Scoring method "By answer weight" Instructions on how to create generated tests that contain questions with the Scoring method "By answer weight" Article
How to customize personal report settings Instructions on how to customize personal report settings for the desired tests. You can customize the report content visible to candidates taking the test. Article
How to edit published test settings Instructions on how to edit published test settings, add new questions, or delete existing ones, change the passing mark for the test and preview all the changes. Article