Creating Tests

 

Did the title of this section conjure up images of students bent over a sheet of paper with pencils marking answers? Probably. If so, or if you were looking for the electronic version of the paper test, this is the section you are looking for. If you were hoping for something more creative - another way to assess student learning - check out the other section on this page called "Alternative Assessment Methods".

Traditional Word Processing :

You can use Microsoft Word to create a basic question and answer set. The value is that it is a tool you are likely familiar with and you don't need to learn another program.

However, Word isn't very flexible. If you want to create a variation of the original test or to incorporate questions from multiple tests, you usually find yourself juggling multiple files.

What if?

What if you placed all your questions into one file and then could pick which questions you wanted included on a test. Or had the computer randomly choose questions so that the tests were unique without additional work on your part?

Questions pooled together, also known as a "test bank", are often stored in a structure known as a database. This gives the flexibility that can reduce your time and effort over the long term.

Many textbook publishers include their test bank along with the instructor's copy of the textbook. Some faculty members prefer to make their own test questions and some prefer to mix their questions with those from the textbook publisher.

   Respondus:

Respondus is an easy-to-use test creation tool that will allow you the flexibility of working with just the textbook test bank or creating your own or combining the two. It can create both paper-based tests and it can also "publish" the questions and create quizzes within the Web-based Course Management System known as GeorgiaVIEW Vista, a.k.a. WebCT Vista.

Note: Respondus is available through your ASU office computer. Click the PC Management star icon to reveal Campus Software, All Departments, Respondus. You will need to install both the installation file and the license information. Contact the ITS HelpDesk at 706-737-1482 if you need assistance.

Many textbook publishers already make their test banks available in Respondus format. A simple request form on the Respondus site sends the link information with username and password ( after verifying that it is you and not a student - grin}. If the test bank is not yet available in Respondus format, the staff at Respondus will contact the publisher for you.

If the textbook company is not willing to work with the folks at Respondus, Instructional Services can assist you with alternative methods for bringing those questions into the Respondus program.

GeorgiaVIEW Vista:

The GeorgiaVIEW Vista course management system includes a question database feature. However, because the Respondus forms are very simple, most instructors prefer to use the Respondus program to create the questions and then "publish" the questions. This method has the added advantage of having the questions and quizzes in a format that permits a quick printing of a test. So, using the Respondus program instead of directing entering questions into GeorgiaVIEW Vista is the method recommended by Instructional Services.

Go to top

Types of Test Questions

 

Dr. Benjamin S. Bloom authored Taxonomy of educational objectives in which he classified questions into the following levels of learning: "knowledge" - I know this exists, "comprehension" - I understand what you are teaching, "application" - I can put this into practice, "analysis" - I see the pattern..., "synthesis" - I can take that basic idea and alter it slightly to ..., and "evaluation" - I can verify the value of ... .

A synopsis of Bloom's Taxonomy is here in PDF format. Notice the "Question Cues". Are you getting the highest levels of learning from your students or are you just trying for basic knowledge?

Note: Respondus can create each of these question types. See each question type for specific comments about GeorgiaVIEW Vista or Microsoft Word's ability to handle the question type.

1. Multiple Choice. Select the one correct answer from several answers listed. This is the most common question in textbook test banks because they are easily machine scored.

GeorgiaVIEW Vista can present and score multiple choice questions.

2. Multiple Selection. Here's a list of answers, select all that are correct answers to the question. Similar to multiple choice but there is more than one answer that is correct.

Example:

Which of the following are fruit?
a. truck
b. apple
c. horse
d. mango

Because this question type is difficult to machine score, multiple selection questions are often turned into multiple choice questions by offering answers that combine two or more of the other answers, like "a and b are correct" or "a, c, and d are correct.". Mentally, these combination answers can be difficult to follow.

GeorgiaVIEW Vista can present and score this question type. Each answer is presented with a checkbox in front and students can select as many answers as apply. This alleviates the mental confusion of matching answer letter combinations.

3. True and False. Judge the truth of the statement provided. The is the second most common question type found in textbook publisher test banks.

GeorgiaVIEW Vista can present and score true and false questions.

4. Matching. Here's a term, date,or topic, what's the matching term, date,or topic ?

GeorgiaVIEW Vista can present and score matching questions.

5. Short Answer. This is the question type most commonly seen as a math problem that needs to be solved. To machine score such questions, they are often translated into multiple choice questions.

GeorgiaVIEW Vista can present and score short answer questions. A blank is presented and typed in answers are compared with a listing of acceptable answers. This allows for variations in typed in answers, such as "Georgia", "GA", or "Ga.".

6. Fill-In-The-Blank. This is similar to "Short Answer" but the expected response is a blank within a statement, not a response to a question.

GeorgiaVIEW Vista can present and score fill-in-the-blank questions. A blank is presented and typed in answers are compared with a listing of acceptable answers. This allows for variations in typed in answers, such as "Georgia", "GA", or "Ga.".

7. Jumbled Sentence. In a Jumbled Sentence question all words are presented to the student, but in a scrambled order. The student must place the words in the correct order. Don't "pigeon hole" this question type as being only for foreign language or English questions. It can also be used to test "What order should ...". Example: "When giving first aid, you should check first for ______, then __________, and then _________. Possible answers are "control shock", "control bleeding", and "check for a clear airway".

GeorgiaVIEW Vista can present and score jumbled sentence questions. A pull down list of the possible answers is presented in place of each blank.

8. Paragraph. This a free-form type of answer, designed to be less wordy than a full essay. Example: Which Civil War battle do you feel was most significant and why?

GeorgiaVIEW Vista can present a paragraph question and record the response in a text box, but it CANNOT SCORE the question. The instructor must do the evaluation.

9. Calculated. This question type cannot be created in Microsoft Word. The calculated question "type" was designed to make life easier for mathematical or formula based tests. Calculated questions follow an established pattern and the actual questions are generated from that pattern and presented as if it were a short answer question.

For example, you tell Respondus or GeorgiaVIEW Vista that you want to create 10 questions following the formula "the square root of x" (expressed in standard math symbols) and you also say that x is any whole number between 4 and 100. Respondus or GeorgiaVIEW Vista will then randomly select the values of x and create the short answer style question from those values. It also calculates the correct answer, hence the name for this style of question. This relieves the instructor of having to create and solve a number of identical questions.

SPECIAL NOTE: Respondus can record and GeorgiaVIEW Vista can record and present feedback to students. Feedback, automated comments provided by the instructor, can be displayed for individual answers or for the question as a whole. This makes the GeorgiaVIEW Vista environment excellent for presenting self-tests to help students learn.

Go to top

Scoring Paper-based Tests

 

Paper-based tests may be scored manually or electronically using the "bubble forms". Many departments have test scanners within the department. Check with your department regarding the location of its scanner and the forms required to be used on that scanner.

If your department does not have a test scanner or you prefer to not use it, Information Technology Services has a test scanner and will score your tests. See the IT Services page at http://www.aug.edu/its/technology_resources.html#scanning for more details. The results returned to you includes a statistical analysis of student answers.

Go to top

Scoring On-LIne Tests

 

Depending upon the program, most question types are scored within the application presenting the on-line test. The most notable exception is the handling of paragraph-style questions which must be scored by an instructor.

The GeorgiaVIEW Vista program will not only score the tests, it will place the scores into the class gradebook. Students may or may not see those grades based upon the settings chosen by the instructor. Of course, the instructor may elect to not show the grades until they have been reviewed and then show (release) the grades after the review. However, students appreciate the quick return of their scores and often show a greater concern for the outcome than when the test results are delayed.

GeorgiaVIEW Vista will also provide statistics related to student achievement and answer distribution.

Go to top

Alternative Assessment Methods

 

Tests are not the only way to assess student learning.

Consider these alternative methods of assessment, some traditional and some that are now available through technology. This listing is not meant to be inclusive. If you know of a method not listed here, please share it with Instructional Services.

Papers/Student Writings:

Traditional "papers". These are student writings that are usually submitted in standardized formats, such as MLA or APA styles. The length of these writings vary but are typically the longest writings submitted during the course.

Reflection paper. Students write down their thoughts and comments on a particular teaching point. These papers are typically one to two pages in length, depending upon the complexity of the teaching point. Example: In your personal life, how does the concept of economic price elasticity apply? Discuss and give specific examples.

Three-minute paper. This student writing is generally done during the last five minutes of class. Students are asked to reflect upon the day's lesson. What did they learn? What points are they still confused about? What would they like to see in the test review? Etc. This paper is most often used to help shape the instructor's presentation that used as a graded exercise.

Application papers. Students are asked to apply what was taught. Example - after a lesson in cross-cultural communications - : Design a commercial for a futuristic car that can be used in both the United States and in Mexico.

Visual Presentation of Materials

Posters. Students create posters (large or small) reflecting some teaching point, like the muscles in the arm.

Charts and Diagrams. Students can create charts and diagrams to show relationships between concepts or processes.

Slide Shows and Presentations. (Most commonly - PowerPoint format) You can make students responsible for presenting a teaching point to their fellow students. (Note: This does not exempt the teacher from being prepared to teach. It is up to the instructor to make sure all relevant points have been presented in such a way as to encourage learning.) Students have a tendency to listen attentively when their peers are presenting.

Practical Usage

Demonstrations. Students demonstrate the usage of the information in the teaching points. For example: Students learning the proper methods for drawing medicine into a syringe demonstrate the techniques.

Practicums and Internships . Students apply the material in a real-world setting.

Community Involvement. Students can report on their community involvement in support of the teaching points.

Let's Talk About It

Student-Led Discussions. Students can lead discussions of primary points.

Note: GeorgiaVIEW Vista will allow you to create a "graded discussion" allowing you to give points for participation. It also allows you to create small groups and restrict discussion areas to a specific group of students. This facilitates student interaction within their group and allows the instructor to view and, if needed, steer the group along the learning path.

Student Interviews. Student can conduct and record interviews with persons appropriate to the topic at hand.

Note: GeorgiaVIEW Vista's assignment tool allows submitted items to be "published" (made available to the other students in the class).

What is your favorite alternative assessment method? Share it with Instructional Services so that it can be shared with others.

What other alternative assessment methods can be shared here? Share it with Instructional Services so that it can be shared with others.

Go to top

Testing Non-Students

 

Perhaps you would like to use auto-graded tests but the methods described above require accounts that are created for students. Sometimes you need to automate a test for someone that doesn't have an "official" status as yet - like for a placement exam.

IT Services will assist you with the creation of Adobe Acrobat-based tests that will allow for the automated grading and the security that you desire. Please contact the HelpDesk at 706-737-1482 to request one of our specialists contact you for the test particulars. Note that this process is time-consuming; please give us as much time as possible to create the test and test the automated grading, security, and routing functions.

Go to top