Question sets work best the shorter they are, especially for completers. Approximately 70 questions (depending on the type and complexity) is often where “diminishing returns to size” set in. Freetext questions are the simplest question type, but generally take the longest for completers to answer by a large margin, and the data cannot be extracted easily by the system for use. Question sets work best with a single focus and theme, rather than multiple competing scoring mechanisms, requiring different areas of expertise from completers and reviewers alike. The first uploaded changes will require a member of the Crossword team to upload a scoring algorithm for the private assessment. Until the algorithm is uploaded the assessment reporting will show submission information only. If an assessment is completed before the algorithm is uploaded, the assessment answers can be refreshed and the full report will generate. Subsequent uploads will only require a member of the Crossword team to assist if the change affects the scoring algorithm.
|