Customer Help Center
Customer Support Contact Information
| Phone: | Toll-free (888) 614-6143 |
| Email Address: | dia-support@youtestme.com |
FAQ
| Question | Answer |
|---|---|
| Does all question type have the branching option? | No. Branching option is available with a single choice, multiple-choice, and true/false. The multiple-choice branching is available only with the
"Combination of answers" scoring method. |
| Where can I find the test results of the candidates? | If you are the manager of the test, you will be able to see the test results of the candidates on the Candidates tab on the Manage tests page. |
| Can the system automatically grade the questions? | The system can automatically grade all questions type but Essay. |
| Where can I see the uploaded users? | When you upload users into the system, you will get a confirmation message, and all uploaded users should be displayed on the "List of all users" tab. |
| Is it possible for a user to be a member of multiple user groups? | Yes. A single user can be a member of any number of groups within the system. |
| Can the tests be time-limited? | Yes. You can set the time limit for the whole test, per each question. As for the test with sections, you can limit the time for each section differently. |
| Is it possible to edit the test settings once it is created? | When a test is published, you can only edit the following test settings: Name, Description, Label, Report displaying content (only score, or score and details), Test retaking settings, Pause/continue settings, Browser lockdown, Auto-logout after finishing the test, Yes/No updating personal information, Certificate settings, External attributes editing, Add/remove test sessions/candidates/proctors/test managers.
The only way to fully edit the test is to create a copy of it and manage it in the "Draft" state. |
| Is there the ability to lock the tests? | No. Only testing sessions can be locked. This way candidates are prevented from accessing the test. |
| Is it possible for question order to be randomized? | Yes, questions can be shown in random order, and with a large enough pool of questions, each student can have a different set of questions. |
| For which type of questions the answers are randomized for, for which type not, and in which scenarios? |
Answers of Ordering and Matching types of questions are always randomized. Answers of Essay, True/false, Matrix, Open-ended, and Hotspot types of questions are never randomized, always have the same answer order. Multiple and Single choice questions always have the same answer order by default, but can be randomized by enabling the answer randomization option. |
| Is it possible to group users? | Yes, users can be organized into groups. It is even possible to create sub-groups to groups, segmenting into as many levels as necessary. |
Terminology
| YouTestMe Term | Term2 | Term3 | Description |
|---|---|---|---|
| Question Pools | Topic Areas | Terminal Learning Objectives | A question pool is a stored set of questions that enables you to add questions into one or more tests easily, simultaneously, and efficiently. |
| Notes | Passage Window | Introduction Window | Specific rules or guidelines that students need to acknowledge in a pop-up dialog before they start the test and in the notes during the whole test-taking process. |
| Testing Sessions | Scheduled Offerings | N/A | Testing sessions allow you to organize a test for users located at different time zones, states, continents, etc. |
| Sections | Modules | N/A | Sections can be used to represent different areas of knowledge or topics the test covers (e.g. Math, Physics, etc.). Each section can have different settings. |
| Score Report | Feedback Form | Performance Letter | Update the verification date of the candidates' report to the current date. Reports that are verified can have their completion status exported. |
| Section Group with Passing Requirements | Core Section | Analysis | Combine test sections into groups, define passing mark criteria that need to be achieved in order to pass the test. |
AGILE-EXCEL User Upload Terminology
| Agile Template Header | GetCertified Template Header |
|---|---|
| AGILE User ID | External ID |
| User PKI | Username |
| Employee ID | Employee ID |
| First Name | First Name |
| Last Name | Last Name |
| Middle Name | Middle Name |
| User Primary Email Address | |
| User Role | Role (external id) |
| AGILE DOMAIN the user is in | Location external id |
| Affiliation | Affiliation |
| Phone number | Phone number |
| Source providing information | Data source |
| User Availability | User Status |
AGILE-EXCEL Upload Test Shells Terminology
| Agile Template Header | GetCertified Template Header |
|---|---|
| AGILE Item ID | External ID |
| AGILE Course Name | Name |
| AGILE DOMAIN for the Item | (Location) external ID, (Location) name |
| Classification of Item | Test label |
| Source providing information | Data source |
AGILE-EXCEL Upload Scheduled Offering (Testing session) Terminology
| Agile Template Header | GetCertified Template Header |
|---|---|
| AGILE Item ID | (Test) External ID |
| AGILE Scheduled Offering ID | External Session ID |
| AGILE DOMAIN in Scheduled Offering | (Location) external ID, (Location) name |
| Start Date | Available from |
| End Date | Available to |
| Source providing information (AGILE) | Data source |
Requirements
Note: These videos do not explain the entire requirement but only the parts of it that were unclear after the UAT from October 2020.
| # | Requirement | Link |
|---|---|---|
| R01 | Branching of test questions - Ability to branch to different questions based on response. | Video |
| R02 | Multiple response (select more than 1 choice - pick the best 3 of 8 possible responses). Must be able to limit the number of selections the student can make. Ability to assign different point values to each choice option. | Video |
| R03 | Matching: Relate items in column A with items in Column B. For example:
• Drag and drop • Choose the appropriate number or matching letter • Type in the corresponding match • Drag a line to it |
Video |
| R04 | Multiple choice: Select only one choice option. | Video |
| R05 | Must be able to have at least 10 choice options on a question. | Video |
| R06 | Matrix question: Have several statements with Likert options in a table. | Video |
| R07 | Multiple fill-in-the-blanks question: Each blank has its own drop-down list of choices. | Video |
| R08 | Fill-in-the-blank: Student can type a response. | Video |
| R09 | Variable scoring for each question (+1, +2 etc, 0 or -1, -2 etc) | Video |
| R010 | Permit text or images to be used during exam, allow split and adjustable screens for text or images to be presented next to, above or below test questions. | Video |
| R011 | Ability to provide feedback immediately after answering question. | Video |
| R012 | Feedback can be specific to each choice option.
The ability to withhold feedback on tests must also be an option. |
Video |
| R013 | Ability to provide informational screens in between questions. | Video |
| R014 | Ability for a candidate to flag a question to come back to later or for the application to inform the user of the questions not answered prior to submitting/completing the exam. | Video |
| R015 | Ability for a candidate to un-answer a question (paired with a notification/reminder) to come back to later prior to submitting/completing the exam. | Video |
| R016 | Ability to have a final submission button at the end of the test. (ensures the candidate has completed all testing requirements and alleviates the chance of a candidate not getting credit due to lack of submission for a test section (if a multiple section exam). | |
| R017 | Section(s) for an exam: Allow administrators to assign test questions to sections within a single exam. | |
| R018 | Allow scoring segregated by section with the option to aggregate scoring for the entire exam. | |
| R019 | Allow administrators to create, edit, copy, and delete exam items. | |
| R020 | Allow administrators to copy exams. | |
| R021 | Allow separate exam forms and/or surveys to be administered within a single exam site. | |
| R022 | Ability to link specific questions to terminal learning objectives.
Specifics: By ""learning objectives,"" we also mean test sections. We require the ability to tag, or link, test questions to objectives/sections. Labels for these objectives/sections will be created by the test developers. For example, if we create a test on driving knowledge, we may decide to divide questions into sections on ""traffic signs"", ""car operation"", and ""suggested guidelines"". If this test includes 50 questions, we may decide to tag (i.e., link) questions 1-15 to ""traffic signs"", questions 16-30 to ""car operation"", and questions 31-50 with ""suggested guidelines."" The ability to do this allows us (i.e., test developers) to know the proportion of a test dedicated to each section, and to see how each test-taker scored on each section of a test. |
|
| R023 | Allow candidates to navigate through multiple exam sections without triggering automatic removal from system. | |
| R024 | Ability administrator to determine if questions are be presented one at a time or all at once. | |
| R025 | Ability for administrator to determine if student can go back to previous questions, or can only go forward. | |
| R026 | Allow the final exam score to be revealed or hidden | |
| R027 | Allow for auto and manual scoring | |
| R028 | Provide the ability to prevent candidates from beginning the exam until the proctor script is read and the exam password provided. - OPT 2 | |
| R029 | Provide proctors with notification that candidates have successfully submitted completed exams, or allow proctors to check candidate exam status. | |
| R030 | Provide a way for proctors to make the exam unavailable to candidates as they complete the exam (dis-enroll candidates when they complete the exam). | |
| R031 | Allow administrators to restrict exam access based on user-role at different points of exam session (i.e., before, during, after).
o For example, candidates (and proctors) should be able to view exam only when given access during an exam session. |
|
| R032 | Provide the ability to "see" if unauthorized access to the exam has occurred. This should include the identity of the individual, when the unauthorized access occurred, and how long the individual had access to the exam. | |
| R033 | The test or survey creator needs the flexibility to create a test or survey with all possible question types described in this RFI within one test or survey. Example: A pull down menu in which the creator can pick a single question with one correct answer then the second question might be a fill-in-the blank, the third may be a branching question, etc. Text and images may be needed to be displayed for one question or all test questions. The test or survey creator needs to be able to create sections where some test questions cannot be revisited and others can be revisited. | Video |
| R034 | Allow a single exam to be administered on separate dates and multiple administrations at different testing locations on a single date.
o For example, Exam A will be administered on 50 separate dates in 2018. On 10 of these dates, there will be two exam sessions. o Individual exam administrations should be given a unique identifier, and it should be possible to determine the location and date of each exam administration. |
|
| R035 | Allow creation of different user and administrative roles to ensure multiple layers of security.
o For example, exam ""administrators"" have control over all aspects to include when the exam is available, who has access to exams (proctors and candidates), and password control. o Exam ""Proctors"" are able to enroll/dis-enroll candidates but cannot edit exam items. Candidates can view exam items during exam session but cannot access any other controls. |
|
| R036 | Ensure there is no way candidates can accidentally click on any links that will inadvertently exit them from the exam. | |
| R037 | Under the proctor role add a "dashboard" so proctors can see if an applicant has completed all the parts of the test and submitted each part completely before leaving the testing facility. | |
| R038 | Provide a functional internal timer that ends the exam when the designated time limit ends. Proctors must have the ability to pause the exam timer for all participants in a given event and then resume the exam without losing candidates' exam data. | |
| R039 | Program should provide the ability for exam administrators (not proctors or
candidates) to immediately view exam results within multiple categories for each candidate. |
|
| R040 | The ability to pull multiple scheduled offerings data (metrics) at one time (blocks of dates) | Video |
| R041 | The ability to track scheduled offerings of tests by date and location. | Video |
| R042 | Must be functional on JWICS and SIPR. | |
| R043 | The solution needs a dashboard for the course managers that show a grade center comprised of the following columns with each student taking the exam in the table: Last name, first name, last access, overall raw score (defined through grading scheme) overall scaled score (raw scored converted to 800 point scale), overall pass/fail, predefined total of specific groups of exam scaled score, predefined group pass/fail, pass/fail entry for LMS. | Video |
| R044 | Include the capability to produce a customizable, downloadable, and Excel-compatible report of exam data. | |
| R045 | Test administrators/users should have access to the following metrics and be able to include any of these fields in any of these customizable reports: : candidate ID, exam date, total exam time, time to answer each item, response to each unscored item (e.g., demographic survey questions), response to each exam item, correct response to each exam item, score on each exam item, score on each exam section (e.g., score on Section A, score on Section B , score on Section C , and overall score. Below is an example of a report we may produce: | Video |
| R046 | Allow data to be aggregated across multiple exam sessions.
o For example, if Exam A is administered on three separate sessions, administrators must have the ability to download results of all three administrations into a single report. There should not be a limit to the number of exam sessions; we have to aggregate all exams given during a calendar or fiscal year for our annual report. |
Video |
| R047 | Allow customizable determinations of pass/fail based on comparison of obtained exam scores to passing standards.
o For example, candidates must earn 70% of possible points on Section A and Section B, and 75% of possible points on all sections (A-F) combined to pass. Candidates who pass all hurdles ""pass"" the exam; candidates who fail a hurdle ""fail"" the exam. |
|
| R048 | Integrate with LMS. Overall pass/fail determination must be publishable in candidates' LMS records. | Video |
| R049 | Ability ingest data from LMS and autofill registration information before an exam. | |
| FR49.2 | Importing test candidates (user enrollments) by manually uploading Excel files | Video |
| R050 | Ability to autofill a preformatted letter to the student with their scores. | |
| R051 | Ability to pull metrics on all terminal learning objectives (to include means, averages, grouped TLOs for grading) | Video |
| R052 | Ability to automatically transfer exam completion data from testing system to LMS. | |
| R053 | Output needs to be compatible with one or more of the following formats, but minimally with SCORM 1.2:
• SCORM 1.2 • SCORM 2004 (up to 4th edition) • AICC • IMS • NLN • Tin Can API |
|
| R055 | Integrate with DIA learning technology components, preferably through flat files interfaces:
• Receive course data (i.e. Course ID, Title) • Receive course session data (i.e. Course ID, Session ID, Start Date, End Date) • Receive student data (i.e. Name, User ID, Department ID, Email) • Receive enrollment data (i.e. User ID, Enrollment Status, Enrollment Date) • Send completion data (i.e. User ID, Session ID, Completion Status, Grade, Completion Date) |
|
| FR55.2 | Importing users by manually uploading Excel files. | Video |
| FR55.4 | Importing test shell (item) and testing locations by manually uploading Excel files. | Video |
| FR55.6 | Importing testing sessions (scheduled offerings) by manually uploading Excel files. | Video |
| R056 | The ability to import/export of data from your application | Video |
| R058 | Simulate a "LockDown Browser" when delivering an exam/assessment. For example: Do not allow student to cut, save or print anything on the screen to personal or shared drive. Disable keyboard shortcuts. |
Knowledge base
Instructional Materials
Introductory Videos
A set of videos intended to walk you through the main modules and functionalities of YouTestMe GetCertified.
| Link | Description | Type |
|---|---|---|
| Full Demonstration | One-hour demonstration of the main functionalities in YouTestMe GetCertified. | Video |
| Question Types | One-minute video that demonstrates all of the question types supported in YouTestMe GetCertified. | Video |
| Scheduling Tests | One-minute video that explains how to use testing sessions to schedule tests in YouTestMe GetCertified. | Video |
Role Manuals
| Link | Description | Type |
|---|---|---|
| Administrator's Manual | Main testing-related activities of Administrators in YouTestMe GetCertified | |
| Student's Manual | Main testing-related activities of Students in YouTestMe GetCertified | |
| Proctor's Manual | Main testing-related activities of Proctors in YouTestMe GetCertified |
Tests
| Link | Description | Type |
|---|---|---|
| Create And Use Test Template | How to create and use test template | |
| Question Groups | How to create a question group | |
| Suspend and Delete a Test | How to suspend or permanently delete your published tests | Video |
| Monitor a Test | How to monitor a test successfully (examples and best practices) |
Question Pools
| Link | Description | Type |
|---|---|---|
| How to Upload and Store Questions | How to upload large number of questions and store them in the question pool | |
| Creating Multiple Choice Question with Different Scoring Method | How to create multiple choice question with different scoring method | |
| Branching Questions | How to create branching questions | |
| Fill In The Blanks - Automatic Grading | How to set up automatic grading on fill in the blanks question type | Video |
GetCertified Advanced Features
| Link | Description | Type |
|---|---|---|
| Test Creation, Test-taking and Reporting using the Integration with AGILE | How to import users, tests, testing sessions and test candidates from AGILE.
Examining a personal report (preformatted letter) and exporting completion statuses |
Users
| Link | Description | Type |
|---|---|---|
| User Group | How to create a user group and enroll that group in a testing session | |
| Remove Users from the System | How to remove users and manage their status | Video |
| Import Users From AGILE | How to import users from AGILE |