Survey Results

Members of the Learning CONSORTIUM and participants from our Learning Systems Roundtable (April 15-16, 2009) responded to our latest survey on Learning Systems.  Below you’ll find a summary of the 199 responses we received.  The data provides interesting insight into how the world of Learning Systems is evolving.


 

1. How many Learning Systems do you have in your organization (i.e., Learning Management Systems and Learning Content Management Systems)?
Item Percent %
1 48%
2-3 35%
4 or More 17%
Total responses to this question: 199


2.How many are LMS's?
Item Percent %
1 67%
3 or More 17%
2 16%
Total responses to this question: 199


3.How long has your organization had its current Learning System?
Item Percent %
1-3 Years 40%
6 Years or More 32%
4-5 Years 20%
Less than 1 Year 9%
Total responses to this question: 199


4. Organization Size:
Item Percent %
10,000+ 70%
500-9,999 25%
100-499 3%
N/A 2%
20-99 1%
Total responses to this question: 199


5. When it was first installed, what was initially the primary function of your Learning System?
Item Percent %
Employee Development 57%
Compliance 29%
Other 10%
Performance Management 2%
Talent Management 2%
Competency Management 1%
Total responses to this question: 199


6.Currently, what is the single most important function of your Learning System?
Item Percent %
Employee Development 49%
Compliance 36%
Other 7%
Performance Management 3%
Talent Management 2%
Competency Management 2%
Collaboration 1%
Managerial Development 1%
Total responses to this question: 199

7. How effective is your Learning System at enabling your organization’s business strategy and goals?
Item Percent %
Somewhat Effective 54%
Somewhat Ineffective 20%
Highly Effective 15%
Highly Ineffective 11%
Not At All Effective 1%
Total responses to this question: 199

8.Do you feel that your Learning System supports the organization's bottom line (i.e., through a better performing workforce)?
Item Percent %
Yes 71%
No 29%
Total responses to this question: 197


9. Do you feel certain that the Learning System that was purchased is the correct product for your organization?
Item Percent %
No 50%
Yes 50%
Total responses to this question: 198


10. Assuming you had the authority and resources, would you replace your current Learning System?
Item Percent %
Yes 61%
No 39%
Total responses to this question: 195


11. What would you expect to be better/different if you were to replace your current Learning System?"
Item Percent %
Reporting Options 70%
Usability 69%
Administration/Management 57%
Interface/Look and Feel 54%
Ease of Content Interoperability 52%
Data Accuracy 20%
Other 14%
Total responses to this question: 186


12. Are employees learning more effectively because of your Learning System?
Item Percent %
Yes 69%
No 31%
Total responses to this question: 194


13. Rank order the importance of platforms you use to deliver instruction (today and 1-2 years from now)
Value 1 2 3 4 5 6 7 Average Rank
Pre-Recorded Video or Audio 6 5 15 35 58 55 20 5.0
Live Video or Audio 7 9 15 20 26 56 61 5.4
Web-Based Training 59 55 33 20 15 7 5 2.6
Face-to-face 62 39 28 27 15 6 17 2.9
Webinars 9 27 39 41 29 22 27 4.2
Performance support documents (e.g., job aids) 27 26 37 33 31 20 20 3.8
Computer-Based Training 24 33 27 18 20 28 44 4.2
Total responses to this question: 194


14. How many people comprise your learning governance team?
Item Percent %
6-15 47%
5 or Fewer 34%
16-25 12%
26 or More 7%
Total responses to this question: 194


15. Our training department is:
Item Percent %
Decentralized 51%
Centralized 49%
Total responses to this question: 196


16. How far along are you with implementing your most recent Learning System at your organization?
Item Percent %
Fully 68%
Somewhat 28%
Not Implemented 4%
Total responses to this question: 196


17. After your Learning System was implemented, did you need to increase or decrease the staff support to manage it?
Item Percent %
Stayed the same 50%
Increase 31%
Decrease 19%
Total responses to this question: 133


18. Is your Learning System primarily centralized or decentralized?
Item Percent %
Centralized 81%
Decentralized 19%
Total responses to this question: 196


19. What percentage of your Learning System dollars do you spend on customizations and enhancements?
Item Percent %
< 5% 45%
Between 6 -15% 27%
Between 16-25% 12%
More than 35% 10%
Between 26-35% 5%
Total responses to this question: 185


20. How satisfied would you say your employees are with your Learning System?
Item Percent %
Somewhat Satisfied 56%
Somewhat Dissatisfied 25%
Highly Satisfied 11%
Highly Dissatisfied 9%
Total responses to this question: 195


21. When do you plan to upgrade or change your Learning System?
Item Percent %
Next 6 Months 23%
1 year 21%
No Plans 21%
Don’t Know 20%
2 years 13%
Total responses to this question: 196


22. Are you implementing Web 2.0 tools?
Item Percent %
No 50%
Yes 50%
Total responses to this question: 188


23. Which ones?
Item Percent %
Social Networking 74%
Wiki 68%
Blog 66%
Chat 47%
Other 19%
Others: Other
SharePoint 2
but not within the LMS, part of complete review of performance support suite 1
Community Platforms 1
content ratings, vClassroom 1
Faculty choice 1
Forums which are like Social Networking sites 1
Google Apps 1
Google collaboration tools 1
Mobile 1
Podcasting 1
RSS, pod casts, discussion forums 1
sharepoint and notes connection (I don't really consider these 2.0 but IT does) 1
teaming 1
Threaded discussionh 1
Web Collaboration 1
Yammer 1
Yammer and other variations 1
Youtube 1
Total responses to this question: 94


24. How do you manage standards?
Item Percent %
SCORM 1.2 77%
SCORM 2004 23%
Total responses to this question: 165


25. How effective are the reporting capabilities of your Learning System?
Item Percent %
Somewhat Effective 45%
Somewhat Ineffective 26%
Highly Ineffective 16%
Highly Effective 9%
Not At All Effective 5%
Total responses to this question: 195


26. To what extent does the reporting functionality of your Learning System meet your current needs?
Item Percent %
Somewhat 72%
To a Great Degree 16%
Not At All 12%
Total responses to this question: 194


27. To what extent are you confident that the training data in your Learning System is accurate?
Item Percent %
Very Confident 51%
Somewhat Confident 43%
Not At All Confident 6%
Total responses to this question: 196


28. We use reporting data to:
Item Percent %
Monitor training participation 92%
Generate compliance reporting information 84%
Generate exception reporting information 60%
Monitor system usage 56%
Assess the impact of training on business results 48%
Other 12%
Total responses to this question: 195


29. Do you have access to all of your back-end Learning System data in order to "data-mine"?
Item Percent %
Yes 62%
No 38%
Total responses to this question: 193


30. What types of improvements or additions would you make to your current Learning System to improve data/metrics collection?
Item Percent %
Ability to More Easily Generate Ad-Hoc Reports 82%
Dashboarding 73%
Business Analytics 64%
Better "Canned" Reports 59%
Other 12%
Total responses to this question: 188


31. How customizable and flexible would you like your Learning System reporting to be?
Item Percent %
I want the capabilities above plus the ability to email reports automatically and ad hoc to customers 58%
I want to be able to create reports on-the-fly using any data field and filtering needed 40%
Not at all. I use the “canned” reports 2%
Total responses to this question: 191


32. Does your system have a built-in process for tracking training impact?
Item Percent %
No 78%
Yes 22%
Total responses to this question: 194


33. Can you provide the ROI of procuring your Learning System?
Item Percent %
No 74%
Yes 26%
Total responses to this question: 193


34. Have you seen an increase in employee productivity since implementing your Learning System?
Item Percent %
No 51%
Yes 49%
Total responses to this question: 185


35. Of the top ten reports you use, how many of them are "canned" or "out of the box"?
Item Percent %
More than half 32%
Less than half 26%
About half 19%
All 12%
None 11%
Total responses to this question: 193


36. What do you use to evaluate employee/learner satisfaction?
Item Percent %
Evaluations 74%
Usage Metrics 11%
Help Desk Need/Reduction 8%
# of Unique Users 3%
Penetration of Population 3%
Return Users 1%
Total responses to this question: 189


37. If you used a 3rd party vendor to implement your Learning System, how satisfied are you with their level of customer service?
Item Percent %
No 3rd Party Vendor 40%
Somewhat Satisfied 28%
Highly Satisfied 12%
Somewhat Dissatisfied 12%
Highly Dissatisfied 9%
Total responses to this question: 179


38. Knowing what you know today, would you choose the vendor again?
Item Percent %
No 53%
Yes 47%
Total responses to this question: 103


39. What are the best features of your Learning System? (Select All)
Item Percent %
Robust Functionality 40%
Performance 38%
Ease of Use 36%
Other 22%
Support and Services 22%
Reporting 21%
Ease of Implementation 16%
Total responses to this question: 174


40. Do the benefits of having your Learning System outweigh the costs?
Item Percent %
Yes 85%
No 15%
Total responses to this question: 192


41. What aspect of your Learning System are you most dissatisfied with?
Item Percent %
Product Limitations 36%
Lack of Flexibility 34%
Other 12%
Customer Service 11%
Poor Implementation 7%
Total responses to this question: 190


42. Over time, my satisfaction with my Learning System has:
Item Percent %
Increased Somewhat 36%
Stayed the Same 25%
Decreased Somewhat 20%
Decreased Significantly 10%
Increased Significantly 9%
Total responses to this question: 194


43. Does your vendor charge extra for customer service?
Item Percent %
Yes 59%
No 41%
Total responses to this question: 178


44. How responsive is your vendor to tickets/issues with your system?
Item Percent %
Somewhat Responsive 54%
Highly Responsive 28%
Highly Unresponsive 13%
Not at all Responsive 5%
Total responses to this question: 176


45. Is your vendor open to new ideas/product improvements?
Item Percent %
Yes 80%
No 20%
Total responses to this question: 174


46. Are you involved in testing new functionality for/with your Learning System vendor?
Item Percent %
No 53%
Yes 47%
Total responses to this question: 184


47. Is it functionality you requested?
Item Percent %
Yes 76%
No 24%
Total responses to this question: 88


48. How does your organization develop learning content?
Item Percent %
Use a Hybrid Model 68%
In-House Development 27%
External Development 6%
Total responses to this question: 195


49. In your opinion, which is more effective: content that is purchased or developed in-house?
Item Percent %
Both are Equally Effective 54%
In-House 36%
Don't Know 5%
Purchased 5%
Total responses to this question: 196


50. Which does your organization do more of?
Item Percent %
Build Learning Content 56%
Build and Buy Content at About the Same Rate 25%
Buy Learning Content 18%

Total responses to this question: 193


51. If your organization utilizes audio/video content for learning, do you primarily:

Item Percent %
Keep it Internal 47%
Both Outsource and Develop Internally 40%
Outsource Production 13%
Total responses to this question: 183


52. Do you involve learners in the learning design?
Item Percent %
Yes 71%
No 29%
Total responses to this question: 190


53. Where does your Learning System live?
Item Percent %
In-House 48%
Hosted 40%
Outside Firm 12%
Total responses to this question: 193


54. What features, if any, does your Learning System provide for you that you don’t need?
Item Percent %
Employee Retention 27%
Collaboration 26%
Competency Management 26%
Other 24%
Talent Management 23%
Performance Management 22%
Compliance 9%
Managerial Development 9%
Employee Development 6%
Total responses to this question: 78


55. What is your most important business need you have that your Learning System does not support?
Item Percent %
Collaboration 32%
Talent Management 29%
Competency Management 24%
Performance Management 24%
Other 18%
Employee Retention 16%
Employee Development 11%
Managerial Development 6%
Compliance 4%
Total responses to this question: 143


56. To what extent have you customized your current system?
Item Percent %
Somewhat 58%
To a Great Extent 24%
Not at All 18%
Total responses to this question: 193


57. Which feature require(d) the most customization?
Item Percent %
User Interface 43%
Reporting 37%
Other 18%
Content Player 1%
Total responses to this question: 159


58. Rate the ease of use of your Learning System in the following areas:
Item Highly Effective Somewhat Effective Somewhat Ineffective Highly Ineffective Not at All Effective Total
Course Administration 26% 53% 15% 5% 1% 193
User Administration 23% 55% 16% 5% 1% 193
General System Administration 19% 58% 18% 5%
193
Reporting 9% 33% 29% 21% 8% 191
Average % 19.5% 50.0% 19.2% 9.0% 2.3% 770.0
Total responses to this question: 193

59. Do you wish that your Learning System provided social networking tools and opportunities for your organization?
Item Percent %
Yes 69%
No 31%

Total responses to this question: 190


60. Can your Learning System track license usage for commercial courseware?
Item Percent %
No 59%
Yes 41%
Total responses to this question: 175


61. Do you have a consistent look and feel for your courseware?
Item Percent %
Yes 56%
No 44%
Total responses to this question: 191


62. Would you like to have a consistent look and feel for your courseware?
Item Percent %
Yes 55%
No 45%
Total responses to this question: 83


63. Which of the following systems does your Learning System currently exchange data with?
Item Percent %
HR or Talent Management 74%
Intranet 28%
Other LMS/LCMS Systems 28%
Other 15%
Payroll 14%
Financial 13%
Sales 6%
Production 5%
Total responses to this question: 176


64. Integrating with which of the following system(s) provides the greatest future opportunity?
Item Percent %
HR or Talent Management 57%
Other LMS/LCMS Systems 26%
Financial 22%
Intranet 18%
Sales 17%
Other 15%
Production 9%
Payroll 7%
Total responses to this question: 168


65. Is your Learning System user-friendly for those with limited computer skills?
Item Percent %
Yes 57%
No 43%
Total responses to this question: 192


66. Are you subject to section 508?
Item Percent %
No 64%
Yes 36%
Total responses to this question: 155


67. Is your system validated for regulatory groups (e.g., FDA)?
Item Percent %
No 64%
Yes 36%
Total responses to this question: 173


68. Do you feel learning content is easy to find?
Item Percent %
No 53%
Yes 47%
Total responses to this question: 189


69. Do you feel learning content is freely shared across the organization?
Item Percent %
Yes 56%
No 44%
Total responses to this question: 187