Difference between revisions of "Customer Wiki Page"

From YouTestMe Wiki
Jump to navigation Jump to search
Line 556: Line 556:
 
|| R033
 
|| R033
 
|| The test or survey creator needs the flexibility to create a test or survey with all possible question types described in this RFI within one test or survey. Example: A pull down menu in which the creator can pick a single question with one correct answer then the second question might be a fill-in-the blank, the third may be a branching question, etc. Text and images may be needed to be displayed for one question or all test questions. The test or survey creator needs to be able to create sections where some test questions cannot be revisited and others can be revisited.
 
|| The test or survey creator needs the flexibility to create a test or survey with all possible question types described in this RFI within one test or survey. Example: A pull down menu in which the creator can pick a single question with one correct answer then the second question might be a fill-in-the blank, the third may be a branching question, etc. Text and images may be needed to be displayed for one question or all test questions. The test or survey creator needs to be able to create sections where some test questions cannot be revisited and others can be revisited.
 +
|-
 +
|}
 +
=Knowledge Base Workflows v1.0.0=
 +
{|class="wikitable"
 +
! Requirement
 +
! Link
 +
! Type
 +
|-
 +
|| 1011, 1012
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/2020-12-12%20How%20to%20Create%20and%20Schedule%20Jobs%20for%20Automated%20Import%20and%20Export.pdf Automating the Integration with AGILE and Allow Updating User Profiles when Importing CSV Files]
 +
|| PDF
 +
|-
 +
|| 1013
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/2020-12-12%20How%20to%20Set%20up%20Note-Taking%20Options.pdf Adding the Option to Refresh (reset) Notes after Edits]
 +
|| PDF
 +
|-
 +
|| 1014
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/2021-02-01%20How%20to%20customize%20application%E2%80%99s%20interface%20text.pdf Customizable Messages, Labels, Hints, and Notifications]
 +
|| PDF
 +
|-
 +
|| 1015
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/YouTestMe%20-%20How%20to%20Change%20Answer%20Ordinal%20Markup.pdf Using the Alphabet Instead of Numbers to Represent Answers in the Report Builder]
 +
|| PDF
 +
|-
 +
|| 1016
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/YouTestMe%20-%20Uploading%20Questions%20with%20an%20External%20ID%20and%20Data%20Source.pdf Adding a Field for a 6-digit External Id for Questions]
 +
|| PDF
 +
|-
 +
|| 1017
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/2021-01-16%201017%20-%20Adjust%20the%20Report%20Builder%20Format%20and%20Header%20Names%20per%20New%20Samples.pdf Adjust the Report Builder Format and Header Names per New Samples]
 +
|| PDF
 +
|-
 +
|| 1015/1017
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/YouTestMe%20-%20Create%20a%20Survey%20Report%20Builder.pdf Create a Survey Report Builder]
 +
|| PDF
 +
|-
 +
|| 1018
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/2020-12-12%20How%20to%20customize%20a%20preformatted%20letter.pdf Make the Preformatted Letter Customizable]
 +
|| PDF
 +
|-
 +
|| 1019
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/Allow%20Full%20Editing%20of%20Published%20Exams.pdf Allow Full Editing of Published Exams]
 +
|| PDF
 +
|-
 +
|| 1020
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/2021-02-12%20Create%20an%20Option%20to%20Add%20Additional%20Custom%20Fields%20for%20the%20User%20Personal%20Information.pdf Create an Option to Add Additional Custom Fields for the User's Personal Information]
 +
|| PDF
 +
|-
 +
|| FR10
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/YTM%20How%20to%20store%20attachment%20in%20library.pdf How to Store Attachment in Library]
 +
|| PDF
 +
|-
 +
|| FR10
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/YTM%20How%20to%20Create%20Questions%20Attachments.pdf How to Create Questions Attachments]
 +
|| PDF
 +
|-
 +
|| FR10
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/YTM%20How%20to%20Create%20a%20Test%20with%20Attachments.pdf How to Create a Test with Attachments]
 +
|| PDF
 +
|-
 +
|| FR10
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/YTM%20How%20to%20Label%20Questions%20Using%20Custom%20Question%20Properties.pdf How to Label Questions Using Custom Question Properties (Topic Area and TLO)]
 +
|| PDF
 +
|-
 +
|| FR10
 +
| [{{SERVER}}/youtestme/youtestmedoc/YTM%20Customer%20Support/Client%20onboarding%20documentation%20(best%20practices%20for%20common%20scenarios,%20how-to)/YTM%20How%20to%20Use%20Custom%20Question%20Properties%20for%20Reporting.pdf How to Use Custom Question Properties for Reporting]
 +
|| PDF
 
|-
 
|-
 
|}
 
|}

Revision as of 19:06, 21 October 2022

Customer Support Contact Information

Phone: Toll-free (888) 614-6143
Email Address: dia-support@youtestme.com
Sandbox instance https://sandbox-data.youtestme.com

FAQ

Question Answer
Does all question type have the branching option? No. Branching option is available with a single choice, multiple-choice, and true/false. The multiple-choice branching is available only with the "Combination of answers" scoring method.
Where can I find the test results of the candidates? If you are the manager of the test, you will be able to see the test results of the candidates on the Candidates tab on the Manage tests page.
Can the system automatically grade the questions? The system can automatically grade all questions type but Essay.
Where can I see the uploaded users? When you upload users into the system, you will get a confirmation message, and all uploaded users should be displayed on the "List of all users" tab.
Is it possible for a user to be a member of multiple user groups? Yes. A single user can be a member of any number of groups within the system.
Can the tests be time-limited? Yes. You can set the time limit for the whole test, per each question. As for the test with sections, you can limit the time for each section differently.
What are user roles? User roles are formed based on permissions that grant users different authorization rights within the application, where different authorization rights convey different levels of access to the application.

There are a couple of default roles in the system, but many new, custom roles (question manager, user group manager, etc.) can easily be created by selecting the permissions.

Can I change other user access permissions? Access permissions can be changed only by the user that has an administrator role.

An administrator should set up a new role and customize it by assigning the desired permissions and then assigning it to users.

Examples of such custom roles are question pool manager and user group manager. The question pool manager can access only question banks and create, edit, or delete questions in the system, while the user group manager can access, create, and/or manage user groups.

Terminology

Basic Terminology

YouTestMe Term Term2 Term3 Description
Notes Passage Window Introduction Window Specific rules or guidelines that students need to acknowledge in a pop-up dialogue before they start the test and in the notes during the whole test-taking process.
Testing Sessions Scheduled Offerings N/A Testing sessions allow you to schedule a test for users located at different time zones, states, continents, etc.
Sections Modules N/A Sections can be used to represent different areas of knowledge or topics the test covers (e.g. Math, Physics, etc.). Each section can have different settings.
Score Report by question properties Feedback Form Preformatted Letter To provide candidates meaningful feedback regarding their performance on the assessment.
Question property reports with Passing Requirements Core Section Analysis Combine question properties into groups, define passing mark criteria that need to be achieved in order to pass the test.
Dropdown question property Topic Area Terminal Learning Objective Custom properties are additional fields that can be used to label the questions. Use custom question properties to group questions or provide additional data to search and manage them easily.

AGILE-EXCEL User Upload Terminology

Agile Template Header GetCertified Template Header
AGILE User ID External ID
User PKI Username
Employee ID Employee ID
First Name First Name
Last Name Last Name
Middle Name Middle Name
User Primary Email Address Email
User Role Role (external id)
AGILE DOMAIN the user is in Location external id
Affiliation Affiliation
Phone number Phone number
Source providing information Data source
User Availability User Status

AGILE-EXCEL Upload Test Shells Terminology

Agile Template Header GetCertified Template Header
AGILE Item ID External ID
AGILE Course Name Name
AGILE DOMAIN for the Item (Location) external ID, (Location) name
Classification of Item Test label
Source providing information Data source

AGILE-EXCEL Upload Scheduled Offering (Testing session) Terminology

Agile Template Header GetCertified Template Header
AGILE Item ID (Test) External ID
AGILE Scheduled Offering ID External Session ID
AGILE DOMAIN in Scheduled Offering (Location) external ID, (Location) name
Start Date Available from
End Date Available to
Source providing information (AGILE) Data source

Knowledge Base Workflows v1.0.0

Admin

Requirements and Training Materials

# Requirement Link
R01 Branching of test questions - Ability to branch to different questions based on response. Article
R02 Multiple response (select more than 1 choice - pick the best 3 of 8 possible responses). Must be able to limit the number of selections the student can make. Ability to assign different point values to each choice option. Article
R03 Matching: Relate items in column A with items in Column B. For example:

• Drag and drop • Choose the appropriate number or matching letter • Type in the corresponding match • Drag a line to it

Article
R04 Multiple choice: Select only one choice option. Article
R05 Must be able to have at least 10 choice options on a question. Article
R06 Matrix question: Have several statements with Likert options in a table. Article
R07 Multiple fill-in-the-blanks question: Each blank has its own drop-down list of choices. Article
R08 Fill-in-the-blank: Student can type a response. Article
R09 Variable scoring for each question (+1, +2 etc, 0 or -1, -2 etc) Article
R010 Permit text or images to be used during exam, allow split and adjustable screens for text or images to be presented next to, above or below test questions. Article
R011 Ability to provide feedback immediately after answering question. Article
R012 Feedback can be specific to each choice option.

The ability to withhold feedback on tests must also be an option.

Article
R013 Ability to provide informational screens in between questions. Article
R014 Ability for a candidate to flag a question to come back to later or for the application to inform the user of the questions not answered prior to submitting/completing the exam. Article
R015 Ability for a candidate to un-answer a question (paired with a notification/reminder) to come back to later prior to submitting/completing the exam. Article
R016 Ability to have a final submission button at the end of the test. (ensures the candidate has completed all testing requirements and alleviates the chance of a candidate not getting credit due to lack of submission for a test section (if a multiple section exam). Article
R017 Section(s) for an exam: Allow administrators to assign test questions to sections within a single exam. Article
R018 Allow scoring segregated by section with the option to aggregate scoring for the entire exam. Article
R019 Allow administrators to create, edit, copy, and delete exam items. Article
R020 Allow administrators to copy exams. Article
R021 Allow separate exam forms and/or surveys to be administered within a single exam site. Article
R022 Ability to link specific questions to terminal learning objectives.

Specifics: By ""learning objectives,"" we also mean test sections. We require the ability to tag, or link, test questions to objectives/sections. Labels for these objectives/sections will be created by the test developers. For example, if we create a test on driving knowledge, we may decide to divide questions into sections on ""traffic signs"", ""car operation"", and ""suggested guidelines"". If this test includes 50 questions, we may decide to tag (i.e., link) questions 1-15 to ""traffic signs"", questions 16-30 to ""car operation"", and questions 31-50 with ""suggested guidelines."" The ability to do this allows us (i.e., test developers) to know the proportion of a test dedicated to each section, and to see how each test-taker scored on each section of a test.

Article
R023 Allow candidates to navigate through multiple exam sections without triggering automatic removal from system. Article
R024 Ability administrator to determine if questions are be presented one at a time or all at once. Article
R025 Ability for administrator to determine if student can go back to previous questions, or can only go forward. Article
R026 Allow the final exam score to be revealed or hidden Article
R027 Allow for auto and manual scoring Article
R031 Allow administrators to restrict exam access based on user-role at different points of exam session (i.e., before, during, after).

o For example, candidates (and proctors) should be able to view exam only when given access during an exam session.

Article
R032 Provide the ability to "see" if unauthorized access to the exam has occurred. This should include the identity of the individual, when the unauthorized access occurred, and how long the individual had access to the exam. Unauthorized access is not possible. None of the users who are not assigned as test candidates for a particular test can access that test.
R033 The test or survey creator needs the flexibility to create a test or survey with all possible question types described in this RFI within one test or survey. Example: A pull down menu in which the creator can pick a single question with one correct answer then the second question might be a fill-in-the blank, the third may be a branching question, etc. Text and images may be needed to be displayed for one question or all test questions. The test or survey creator needs to be able to create sections where some test questions cannot be revisited and others can be revisited. Article
R034 Allow a single exam to be administered on separate dates and multiple administrations at different testing locations on a single date.

o For example, Exam A will be administered on 50 separate dates in 2018. On 10 of these dates, there will be two exam sessions. o Individual exam administrations should be given a unique identifier, and it should be possible to determine the location and date of each exam administration.

Article
R035 Allow creation of different user and administrative roles to ensure multiple layers of security.

o For example, exam ""administrators"" have control over all aspects to include when the exam is available, who has access to exams (proctors and candidates), and password control. o Exam ""Proctors"" are able to enroll/dis-enroll candidates but cannot edit exam items. Candidates can view exam items during exam session but cannot access any other controls.

Article
R039 Program should provide the ability for exam administrators (not proctors or candidates) to immediately view exam results within multiple categories for each candidate. Article
R040 The ability to pull multiple scheduled offerings data (metrics) at one time (blocks of dates) Article
R041 The ability to track scheduled offerings of tests by date and location. Article
R043 The solution needs a dashboard for the course managers that show a grade center comprised of the following columns with each student taking the exam in the table: Last name, first name, last access, overall raw score (defined through grading scheme) overall scaled score (raw scored converted to 800 point scale), overall pass/fail, predefined total of specific groups of exam scaled score, predefined group pass/fail, pass/fail entry for LMS. Article
R044 Include the capability to produce a customizable, downloadable, and Excel-compatible report of exam data. Article
R045 Test administrators/users should have access to the following metrics and be able to include any of these fields in any of these customizable reports: : candidate ID, exam date, total exam time, time to answer each item, response to each unscored item (e.g., demographic survey questions), response to each exam item, correct response to each exam item, score on each exam item, score on each exam section (e.g., score on Section A, score on Section B , score on Section C , and overall score. Below is an example of a report we may produce:

http://prntscr.com/oo0qku

Article
R046 Allow data to be aggregated across multiple exam sessions.

o For example, if Exam A is administered on three separate sessions, administrators must have the ability to download results of all three administrations into a single report. There should not be a limit to the number of exam sessions; we have to aggregate all exams given during a calendar or fiscal year for our annual report.

Article
R047 Allow customizable determinations of pass/fail based on comparison of obtained exam scores to passing standards.

o For example, candidates must earn 70% of possible points on Section A and Section B, and 75% of possible points on all sections (A-F) combined to pass. Candidates who pass all hurdles ""pass"" the exam; candidates who fail a hurdle ""fail"" the exam.

Article
R048 Integrate with LMS. Overall pass/fail determination must be publishable in candidates' LMS records. Article
R049 Ability ingest data from LMS and autofill registration information before an exam. Article
FR49.2 Importing test candidates (user enrollments) by manually uploading Excel files Article
R050 Ability to autofill a preformatted letter to the student with their scores. Article
R051 Ability to pull metrics on all terminal learning objectives (to include means, averages, grouped TLOs for grading) Article
R052 Ability to automatically transfer exam completion data from testing system to LMS. Article
R053 Output needs to be compatible with one or more of the following formats, but minimally with SCORM 1.2:

• SCORM 1.2 • SCORM 2004 (up to 4th edition) • AICC • IMS • NLN • Tin Can API

Article
R055 Integrate with Customer learning technology components, preferably through flat files interfaces:

• Receive course data (i.e. Course ID, Title) • Receive course session data (i.e. Course ID, Session ID, Start Date, End Date) • Receive student data (i.e. Name, User ID, Department ID, Email) • Receive enrollment data (i.e. User ID, Enrollment Status, Enrollment Date) • Send completion data (i.e. User ID, Session ID, Completion Status, Grade, Completion Date)

Article
FR55.2 Importing users by manually uploading Excel files. Article
FR55.4 Importing test shell (item) and testing locations by manually uploading Excel files. Article
FR55.6 Importing testing sessions (scheduled offerings) by manually uploading Excel files. Article
R056 The ability to import/export of data from your application Article
R058 Simulate a "LockDown Browser" when delivering an exam/assessment. For example: Do not allow student to cut, save or print anything on the screen to personal or shared drive. Disable keyboard shortcuts. Article

Proctor

Requirements and Training Materials

# Requirement Link
R028 Provide the ability to prevent candidates from beginning the exam until the proctor script is read and the exam password provided. - OPT 2 Article
R029 Provide proctors with notification that candidates have successfully submitted completed exams, or allow proctors to check candidate exam status.
R030 Provide a way for proctors to make the exam unavailable to candidates as they complete the exam (dis-enroll candidates when they complete the exam).
R037 Under the proctor role add a "dashboard" so proctors can see if an applicant has completed all the parts of the test and submitted each part completely before leaving the testing facility.
R038 Provide a functional internal timer that ends the exam when the designated time limit ends. Proctors must have the ability to pause the exam timer for all participants in a given event and then resume the exam without losing candidates' exam data.

Student

Requirements and Training Materials

# Requirement Link
R01 Branching of test questions - Ability to branch to different questions based on response. Article
R02 Multiple response (select more than 1 choice - pick the best 3 of 8 possible responses). Must be able to limit the number of selections the student can make. Ability to assign different point values to each choice option.
R03 Matching: Relate items in column A with items in Column B.
R04 Multiple choice: Select only one choice option.
R06 Matrix question: Have several statements with Likert options in a table.
R07 Multiple fill-in-the-blanks question: Each blank has its own drop-down list of choices.
R08 Fill-in-the-blank: Student can type a response.
R09 Variable scoring for each question (+1, +2 etc, 0 or -1, -2 etc)
R010 Permit text or images to be used during exam, allow split and adjustable screens for text or images to be presented next to, above or below test questions.
R011 Ability to provide feedback immediately after answering question.
R012 Feedback can be specific to each choice option.
R014 Ability for a candidate to flag a question to come back to later or for the application to inform the user of the questions not answered prior to submitting/completing the exam.
R015 Ability for a candidate to un-answer a question (paired with a notification/reminder) to come back to later prior to submitting/completing the exam.
R022 Ability to link specific questions to terminal learning objectives.

Specifics: By ""learning objectives,"" we also mean test sections. We require the ability to tag, or link, test questions to objectives/sections. Labels for these objectives/sections will be created by the test developers. For example, if we create a test on driving knowledge, we may decide to divide questions into sections on ""traffic signs"", ""car operation"", and ""suggested guidelines"". If this test includes 50 questions, we may decide to tag (i.e., link) questions 1-15 to ""traffic signs"", questions 16-30 to ""car operation"", and questions 31-50 with ""suggested guidelines."" The ability to do this allows us (i.e., test developers) to know the proportion of a test dedicated to each section, and to see how each test-taker scored on each section of a test.

R036 Ensure there is no way candidates can accidentally click on any links that will inadvertently exit them from the exam.
R013 Ability to provide informational screens in between questions. Article
R016 Ability to have a final submission button at the end of the test. (ensures the candidate has completed all testing requirements and alleviates the chance of a candidate not getting credit due to lack of submission for a test section (if a multiple section exam).
R017 Section(s) for an exam: Allow administrators to assign test questions to sections within a single exam.
R018 Allow scoring segregated by section with the option to aggregate scoring for the entire exam.
R021 Allow separate exam forms and/or surveys to be administered within a single exam site.
R023 Allow candidates to navigate through multiple exam sections without triggering automatic removal from system.
R024 Ability administrator to determine if questions are be presented one at a time or all at once.
R025 Ability for administrator to determine if student can go back to previous questions, or can only go forward.
R033 The test or survey creator needs the flexibility to create a test or survey with all possible question types described in this RFI within one test or survey. Example: A pull down menu in which the creator can pick a single question with one correct answer then the second question might be a fill-in-the blank, the third may be a branching question, etc. Text and images may be needed to be displayed for one question or all test questions. The test or survey creator needs to be able to create sections where some test questions cannot be revisited and others can be revisited.

Knowledge Base Workflows v1.0.0

Requirement Link Type
1011, 1012 Automating the Integration with AGILE and Allow Updating User Profiles when Importing CSV Files PDF
1013 Adding the Option to Refresh (reset) Notes after Edits PDF
1014 Customizable Messages, Labels, Hints, and Notifications PDF
1015 Using the Alphabet Instead of Numbers to Represent Answers in the Report Builder PDF
1016 Adding a Field for a 6-digit External Id for Questions PDF
1017 Adjust the Report Builder Format and Header Names per New Samples PDF
1015/1017 Create a Survey Report Builder PDF
1018 Make the Preformatted Letter Customizable PDF
1019 Allow Full Editing of Published Exams PDF
1020 Create an Option to Add Additional Custom Fields for the User's Personal Information PDF
FR10 How to Store Attachment in Library PDF
FR10 How to Create Questions Attachments PDF
FR10 How to Create a Test with Attachments PDF
FR10 How to Label Questions Using Custom Question Properties (Topic Area and TLO) PDF
FR10 How to Use Custom Question Properties for Reporting PDF