>> Back to Feedback Forum
Focus Group Activity: Online Video Demonstrations
Number of Participants: 20
Completion Date: November 15, 2005
Activity Length: 60 minutes or less
Focus Group Method: Online
Results Summary
Survey Response
Background
Focus Group Activity
Provide Feedback
Twenty focus group participants reviewed an average of five online video demonstrations pertaining to Banner SCT, Faculty Self Service, or Microsoft Outlook. They were asked to provide constructive feedback regarding computer functionality, training effectiveness, and video format via an online survey. Click here to review the videos available for selection.
All focus group participants reported the online video demonstrations were beneficial to the Rowan University campus community. Each participant noted the online videos were highly valuable to somewhat valuable; 94% would recommend the use of online videos to a colleague. Several individuals provided topic suggestions for future videos. Eighty percent of participants noted satisfactory audio and visual legibility. Recommendations were made to adjust the audio levels to be consistent across all videos and ensure the video screen is not cut off or pixilated. In addition, participants recommended that more direction be provided at the end of each video such as a completion window and opportunity to continue to the next video in the series.
Based on the results of this focus group activity and other methods of feedback, Information Resources Training Services recommends the continued production of online videos. This includes pursuing more advanced software and recording devices to meet the expectations of savvy online learners. A communication plan will be designed to appropriately market online videos. In addition, alternatives to videos must be provided for those individuals with incompatible hardware/software or lacking technical skills to participate.
Participant feedback may be paraphrased
Computer Functionality
- Participants included 16 Personal Computer and 4 Macintosh users.
- 1 individual did not have external speakers and was not able to use the videos due to hardware malfunction.
- 100% of participants noted videos ran average to excellent on computer; 74% noted excellent performance.
- 2 individuals reported they needed to install Macromedia Flash Player, but did not encounter any problems during the installation.
Video Format
- 80% noted the video screen was legible. Those who indicated visual problems, noted distraction when video screen was cut off (i.e. extra tool bar on browser), screen pixilation (“broken up”), video not precisely following the audio, button to select was not visible on screen (i.e. start button), and playback/control buttons were not available.
- 80% indicated the audio level was appropriate. Those who noted audio problems indicated audio levels were not consistent between videos. Overall, audio levels were too low. One video (Banner Person Search) had a distorted echo.
Training Effectiveness
- 94% of respondents indicated topic was delivered in a clear and concise manner.
- All participants noted the pace of the videos was “Just Right.”
- 85% indicated the overall length of videos is “Just Right”, the remaining indicated “Too Short.”
- All participants reported videos were somewhat to highly valuable; 67% indicated highly valuable.
- 94% would recommend an online video to a colleague.
- All noted online videos were somewhat or highly conducive to learning style; 78% noted highly conducive.
How can we improve online video demonstrations?
“I think your work needs better PR. Many instructors know they must input their grades but haven’t had time for the training. They could be trained via their computer at home.”
- Provide more direction at the end of the video such as a complete window indicating that the video has finished and provide more direction for “what to do next.”
- At the end of video provide print-out for future reference.
- Link videos to written/printable instructions.
- Make red directional errors more transparent so it does not block screen.
- Group related topics together and provide mechanism to “select next video” to continue topic or exit.
- Make sure video is not cut off, that all buttons/references are visible.
- Provide playback/control buttons allowing for pause, stop, forward, and back.
- For videos over 1 minute, allow option to stop video and return to stopping point at later date.
- Invest in higher-quality recording equipment. Audio appears amateurish (breaths and background noise) to individuals accustomed to using professionally recorded computer-based training.
- Allow for interactive practice.
- Provide more details and explanation in videos.
- Need to better market videos. People need to know this resource is available.
Additional comments:
“Keep up the great work. I’d like more of these videos on other topics.”
- Offer more videos on other topics.
- Offer Macintosh-related topics.
- In the Distribution Lists video, add how to edit or remove people. Also discuss how to set up a list for e-mailing students.
- Offer how to install the VPN for Library video.
- Provide videos for more advanced topics. Current videos pertain to beginner-level users.
Focus group participation comments:
“I very much enjoy reviewing processes that help employees improve their skill levels. This, by far is one of the best. The videos can be used to learn, review or enhance skills and since they can be viewed in private, at one’s own pace, eliminates the embarrassment or unease of asking questions at a live workshop. Please include me in future forums if you find my feedback of value. Thank you.”
- 74% indicated the focus group instructions were clear and concise.
- All reported actual activity completion time was 60 minutes or less.
- All indicated they wish to participate in future focus groups; 94% would recommend participation to their colleagues.
- Great opportunity, looking forward to future focus groups.
- Need to provide more direction regarding the use of online survey tool www.Surveymonkey.com
- Lickert (rating) scale is biased. Include selection for “met expectations” and “above expectations.”
- Provide option to enter comments for all survey questions. Allow option to comment regardless of whether you entered Yes/No or selected from rating scale.
Focus group statistics:
Total number of participants: 20
Number of PC users: 16
Number of Mac users: 4
Average number of videos viewed: 5
Most frequently viewed video: Microsoft Outlook—Create a distribution list (17)
Least frequently viewed videos: Banner—Getting Started with Self Service Banner (5); Faculty Self Service—Class Lists (5); Faculty Self Service—Grades (5)
Information Resources Training Services offers online video demonstrations addressing frequently requested training topics. As production of video demos can be a lengthy process, we wish to assess the effectiveness of existing videos to ensure they are of benefit to the campus community. If the video demonstrations are found to be of benefit, we wish to determine how we can improve production and delivery of future videos.
Have a question or want clarification on this activity? Please contact focus group facilitator Susan Hersh at hersh@rowan.edu or extension 4481.
1. Select online videos of interest
Identify three or more online videos you wish to watch pertaining to Banner SCT, Faculty Self Service, or Microsoft Outlook. Click here to choose a video.
2. Watch three or more online videos of your choice
Video length varies from 30 seconds to 5 minutes each. If you typically mute your computer volume or keep it low, please be sure to adjust prior to watching a video. If video does not run, it may be necessary for you to install Macromedia Flash Player on your computer. Go to http://www.rowan.edu/download/ to download a free copy.
3. Note the title of each video and your thoughts pertaining to the following areas:
Computer Functionality
Did the video run well on your computer? Was the screen legible? Was the audio level appropriate (after adjusting audio on your computer)? Did your computer run excessively slow?
Training Effectiveness
Was the topic delivered in a clear and concise manner? How was the pace of the training? Do you feel that you learned the content?
Video Format
What do you think of the video format? Were the text call-outs helpful? Were you able to clearly identify where you should be looking and follow along?
Overall
Would you like additional training videos be made available? Would you recommend a video demonstration to a colleague? What can we do to improve the training videos?
Please complete the questionnaire available at http://www.surveymonkey.com/s.asp?u=824241458840 (survey closed)
PLEASE NOTE: We respect your anonymity. If you choose to provide input anonymously you will not receive a letter of participation in the focus group for your files.
