Faculty & Administrators

The focus for the 2013/2014 academic year will be to assist Deans, Chairs & Program Coordinators in mapping Course Evaluation data to student/program learning outcomes for program accreditation, QEP and other assessment needs. In late Summer 2013, we launched a new reporting tool that allows administrators (Chairs/Deans) to easily map aggregate responses of selected courses to specific learning outcomes in their assessment plans. For assistance in setting up Program Outcomes Reporting (POR), please contact Institutional Research.

Also, as of Fall 2013, faculty and administrators can use the Results Feedback feature within the Project Results module. This feature supports a dialogue about the results between instructors and administrators. Instructors can review their results and send comments to their department chair or administrator, and administrators can review the results for those instructors they oversee and then easily provide feedback to each of their instructors. Feedback from this process is centralized within EvaluationKIT along with the results, and users can export a PDF of their dialogue, and choose to email their feedback outside of the system too.

Beginning with the March 2012 Worldwide term and Summer 2012 residential terms, we activated a student notification window to remind students of open evaluations. This window appeared when the student signed into their Canvas account. Online courses showed a greater bump in response rates than did ground or traditional courses. In July 2012, the “Custom Questions” functionality opened to faculty and administrators at Worldwide, with a roll-out to the residential campuses in Fall 2012. Custom Questions allows additional questions to be added to the end of the evaluations to address: teaching effectiveness; assessment; program review; QEP and/or other accreditation needs. Additionally, we attended department meetings and customized the conversation to address their response rates, the new enhancements, and additional training on longitudinal reporting.

During Spring 2010 we conducted student focus groups and engaged in conversations with the residential campus’ SGA and Faculty Senate to gather feedback regarding options to increase course evaluation response rates. Enhancements that were implemented included: increased survey window to 14 days; increased student reminders to 4, 10 & 13 days after survey start date; added faculty and administrator reminder at 7 days after the survey start date; encouraged faculty to share how they use evaluations in class and to include evaluations into the syllabus; made reports available to faculty of respondents/non-respondents for personal follow-up (only emails, name and id appear on report); revised the language in the student emails; increased advertising; and included presentations regarding the value of evaluations in our College Success courses.

In the summer of 2007, Embry-Riddle began its migration from paper course evaluations to an online system. With a successful launch at our Worldwide campus (150+ teaching centers and online courses), our two residential campuses (Daytona Beach, FL, and Prescott, AZ) went live for Fall 2007 evaluations with response rates in the low 60%’s. Our Worldwide centers had more variable response rates (20% to 50%) depending on course delivery mode (teaching center (ground) or virtual classrooms (online)). During the first year of online evaluations, incentives were offered (gift cards, iPods, GPS, etc) and heavy advertising took place. With budget constraints, incentives were discontinued and advertising tapered off.

One year out, our residential campuses response rates began to decline (53% and 57% respectively) as did response rates for our Worldwide campuses (25-30% ground, 45-50% online). At this time we re-evaluated our course evaluation system and moved to a system that had more flexibility in reports and administrative tools and a more user friendly dashboard. Fall 2009 online evaluations had their own challenges – the rollout of a new vendor system, retraining of faculty to the new system and bad timing of a new email system to the entire student body. Response rates plummeted to an unacceptable level of 30% & 50% for our residential campuses.

How do I access my online course evaluations?
You can access your evaluations by the following methods:
From Ernie:
  • Sign into Ernie, locate the “Tools” module on the right side, click “All tools” in the bottom right corner, then click the link for EvaluationKIT. You can also add this link to your Ernie homepage by using the settings option in the upper right corner of the Tools module.
    Faculty FAQ 1Faculty FAQ 2
  • From Canvas:
  • Sign into your Canvas course. Click on the link on the left course menu which will take you to your EvaluationKIT dashboard:
    Faculty FAQ 10 Or you can access using your Canvas global settings by clicking on "Account" then "Settings" on the left menu in Canvas:Faculty FAQ 11
  • I am unable to download reports in EvaluationKIT.
    I am having problems viewing my EvaluationKIT dashboard.
    There are several things you can try:
    How do I download a respondent/non-respondent list for my course?
    • Once you are at your EvaluationKIT dashboard, be sure you are signed in as an ‘instructor’ in the top right corner. You can also select your role on the left side of the dashboard. If no, use the drop down navigation arrow to switch your role to ‘instructor’. You will see the “Response Rate tracker” Module in the center. This response rate shows the aggregate response rate for all courses you are teaching in a term. Click on the project (term) (or view all if no current projects are showing) that you would like to generate a Respondent/Non-respondent list for.
      Faculty FAQ 3
    • The next screen will show your individual response rate for each course. Click on the download button and then click on the ‘respondent’ link to begin the download. This list is only available after you have 4 respondents in the course.
      Faculty FAQ 3b
    • This list ONLY contains: Course code, Student first and last name, email, ERAU Username, Student ID and submit date/time. Data is never associated with any student identifying marks and is only available to faculty after grades are submitted.
      Faculty FAQ 3c
    I received an email saying that my course evaluation report is ready. How do I view it?
    • Once you are at your EvaluationKIT dashboard, be sure you are signed in as an ‘instructor’ in the top right corner. If not, use the drop down navigation arrow to switch your role to ‘instructor’. You will see the “Project Results” Module in the middle of the dashboard. Click on the project (term) that you would like to view. (For more details, click on ‘?’ in the upper right corner of your EvaluationKIT dashboard.)
      Faculty FAQ 4
    What are the benefits of the online course evaluation system?
    • We will save over 150,000 pieces of paper each year.
    • Students have more time to complete thoughtful responses and provide meaningful comments.
    • Faculty will no longer have to take class time to allow students an opportunity to complete their evaluations.
    • Faculty will receive summary reports, including student comments, much more quickly. Reports can be distributed shortly after grades are submitted.
    • Faculty will be able to easily create custom longitudinal reports for performance review and tenure package.
    What should I tell my students about the online course evaluation system?
    The most important way to ensure a good response rate and receive thoughtful feedback from students is to communicate the importance of course evaluations to the success of our academic programs. Faculty can stress the various ways of accessing evaluations (Canvas, Email link, and Mobile Devices) and how they have used results of past evaluations to enhance their course and/or teaching skills. Please encourage your students to complete their online evaluations.
    How do I increase my response rates?
    There are numerous ways to increase your response rates.
    • Encourage your students to complete the evaluationsStudents need to know that you value their input and that completing the evaluations is worth their time.
    • Let students know they can access their evaluations by:
      • In Ernie, under the tool module click on the EvaluationKIT App link.
      • In their course in Canvas, click on the course evaluation link on the left course menu.
    • For face-to-face courses have students bring their laptops or mobile devices to class and follow either of the easy access instructions listed above.
    • Check your response rates by following the access instructions listed above. You will be able to see your response rates for each class. If you have more than 4 respondents, you are able to download a list of non-respondents for personal follow-up. Note: The list ONLY contains: Course ID, Student first and last name, email, ERNIE user ID, Student ID and Submit date. No data is associated with this list.
    Can faculty ask additional questions on the evaluations?
    Yes. Custom questions open for chairs and faculty approximately 10 days before the evaluations open for the students. Questions must be uploaded the day before the survey opens. You can add up to 5 questions to each of your course evaluations. If you need assistance in creating questions, please email eraueval@erau.edu.
    How do I add additional questions to the evaluations?
    • Select the link on the right to access EvaluationKit information within Ernie (under Tools)
    • When a project is available it will be listed in the box ‘Custom Questions’ on your home page (e.g., Fall_2015_PC_2321). ‘Access From’ and ‘Access Until’ dates will display indicating the days that you will be able to add custom questions. The delivery date indicates the date the course evaluation will be sent to students. Custom questions cannot be added once the course evaluation has been sent to students.
    • Click the project name link to go the Custom Question Survey page.
    • Click on “Create New Survey”
    • Add a Title such as ‘EGR200 Custom Questions’ and select ‘Save New’. (Note: Adding a description is optional).
    • For ‘Select Question Type’, use the pull-down arrow to select the question type. Note: The ‘Single Selection’ question type is a common question format. The process for creating a ‘Single Selection’ question will be outlined in the steps that follow. Please see below for an explanation of the various types of question formats available.
      1. ‘Single Selection’: allow the student to choose only one option from multiple response options.
      2. ‘Multiple Selection’: Allows the student to check all response options that apply.
      3. ‘Matrix’: Has a common response scale with multiple items being evaluated and displays the questions as a matrix table. Students are allowed to choose only one response option per item.
      4. ‘Open Ended Text Response’: These questions provide a text box which allows the student to write out their response
    • Under ‘Question Text’, type in your question.
    • Under ‘Response Options’, change Options 1-5 to reflect the appropriate scale (e.g., Strongly Agree, Agree, Neutral, Disagree, Strongly Disagree).
    • Note: It is common practice to associate more positive response options with higher numeric values in order to more readily interpret mean scores. For example, using a 5-pt scale, Strongly Agree to Strongly Disagree, the numeric values should be coded as follows: 5-Strong Agree, 4-Agree, 3-Neutral, 2-Disagree, 1-Strongly Disagree. Thus, higher mean scores would suggest stronger agreement. In order to weight the response items correctly, you will likely need to select the ‘Reverse Code Response Options’ box. You can determine the value associated with your response options by referencing the ‘Numeric Weighting’ box.
    • Review your survey question and select the edit icon (‘pencil’ icon on the right) if necessary.
    • Once you have added all of your custom questions (there is a maximum of 5), select ‘Save’ at the top of the page.
    • Select the ‘Attach Surveys to Projects’ tab at the top of the page.
    • Click the link to the Project Name.
    • Select ‘Add Custom Question Survey’
    • Select the checkmark on the right next to your survey name and then click ‘Select Courses’ at the bottom of the page
    • Click the ‘Add Courses’ button at the bottom of the next page. This will open a dialog box that will allow you to check the box next to the course(s) to which you want to add the custom questions. When you have selected all the appropriate courses click the ‘Add Selected Courses’ button at the bottom of the page. A confirmation window will pop up confirming that you have added the custom questions- click ok.
    How will I know when my evaluation results are available?
    Faculty will receive an email from ERAUEval@evaluationkit.com indicating that the results are available.
    How do I save a copy of my course evaluation results?
    When they become available, results may be downloaded as a PDF or Excel file.
    Can I see my results from past semesters?
    Results from Spring 2009 forward are available in your EvaluationKIT dashboard.
    Who will have access to the results of my course evaluations?
    The results are available to you, your department head, and the college Dean. If you teach a course at a regional campus, your regional campus director will receive the results for the courses you teach at that campus.
    What if I am an instructor and I am taking courses?
    In this scenario, you can view response rates as an instructor and submit evaluations if you are also taking courses. When you navigate to your EvaluationKIT dashboard, you are automatically signed in at your highest access level. After logging into the EvaluationKIT system, you will need to change your current role by clicking on the dropdown section beside your name. In the example below, the current role is “instructor”. In order to modify the role to “student”, click the dropdown and select “student/respondent”.
    You should now view any evaluations you have pending as a student/respondent. Once you have completed any evaluations, simply modify your role to “instructor” again to view course response rates for any courses you are teaching.
    Who do I contact if I have more questions about the process or if I have difficulty accessing my response rates or results?
    Please contact the Office of Institutional Research at eraueval@erau.edu or 386-226-6225.