University of Hawaii Community Colleges
Academic Support Annual Report of Program Data (ARPD)

Select the desired review year, college, and program from the drop down menus. Once a program has been selected, the results will be displayed.

Review Year: College: Program:

College: Kauai Community College
Program: Testing Services

Printer Friendly

PDF PDF

Program did not provide date of the last comprehensive review.

Program Description

Testing Center Mission Statement: Kauai Community College’s Testing Center supports student and community success by providing academic and professional examination facilities both internally to faculty, staff, and students and externally to the Kauai community. The Testing Center is committed to maintaining the highest compliance with professional testing standards and practices, safeguarding confidentiality of records and exams, and creating an optimal testing environment.

The TC is staffed by one person with an additional 0.15 FTE of regular help from the University Center (UC), with some support from Media Services in handling UH Distance Learning exams when regular staff is away. TC also works with Student Counseling & Advising (C&A) in administering placement tests, such that C&A handle the scheduling and paperwork for students taking COMPASS. Due to the UC staff member moving on to another position at the end of December 2012, hours were shortened in Spring 2013 and currently trained staff from Academic Support and C&A helped to cover daytime hours that would have otherwise been lost.

The TC offered 39.75 hours per week for regular testing, including two evenings until 7:00 PM, during Fall 2012. For Spring 2013, the TC offered only 36.75 hours per week, including only one evening until 7:00 PM. Again, this was due to the lost evening coverage by the University Center. Trained staff from Academic Support and C&A covered 3-hours/week during the day to provide longer access to users. Off-duty hours allow for daily administrative and other duties, and a lunch break. As a one-person office, proctoring by appointment allows staff to work on other assigned duties and remain an active part of the Kauai CC community. Additional TC information and availability calendar may be found at www.tinyurl.com/kcctest. 

Part I. Quantitative Indicators

Overall Program Health: Healthy

Student and Faculty Information Program Year  
10-11 11-12 12-13
1 Annual Unduplicated Student Headcount   1,718 1,801  
2 Annual FTE Faculty   71 72
2a Annual FTE Staff   85 93
3 Annual FTE Student   780 802

Demand Indicators Program Year Demand Health Call
10-11 11-12 12-13
4 Number of placement test sessions administered per year per student FTE   1.5 1.5 Healthy
5 Number of Distance Learning tests administered per year per student FTE   0.9 1.1
6 Local campus tests proctored per year per student FTE   2.7 2.8

Efficiency Indicators Program Year Efficiency Health Call
10-11 11-12 12-13
7 Number of test sessions administered per FTE testing center staff     3,834.2 Healthy
8 Annual operational testing center budget allocation per number of test sessions administered   $0 $0

Effectiveness Indicators Program Year Effectiveness Health Call
10-11 11-12 12-13
Satisfaction measurements using Common Survey questions Healthy
9-1 The hours at the Testing Center meet my needs     96.2%
9-2 The atmosphere at the Testing Center is conducive to testing     98.7%
9-3 The services at the Testing Center are satisfactory     100%
9-4 My test was administered in a timely and efficient manner     100%
Last Updated: November 4, 2013

Glossary

Part II. Analysis of the Program

Demand/Efficiency:  Demand for placement tests (1,172 sessions) has remained high, seeing a slight increase over the previous year’s data by 1.1%. It aligns with the positive change in headcount enrollment from F’11 to F’12 of 4.3% (UH IRO Fall 2013 CENSUS Headcount).  A tiny part of the increase is also due to including other placement tests in the count. Previously, only COMPASS placement tests were counted. For FY2013, the TC administered 10 additional placement tests, 4 for campus courses, 1 for another UH program, and 5 for other schools.

The demand for Distance Learning (DL) proctoring (871 sessions) continues to see high positive growth. For this reporting year, the number of DL exams administered increased by 19.32% over the previous year. Again, indicating that more Kauai-based students are taking distance courses. Proctoring of Non-UH exams has seen a slight decrease of 26% going from 100 exams proctored in FY2012 to 74 exams proctored in FY2013. The number of students taking exams for non-UH courses also decreased by about 26%, from 38 students down to 28.

Campus testing (2,177 sessions) saw a slight increase, at 2.3% in comparison to last year’s 61.4%. This much smaller change is expected as accounting practices have improved. The campus has also increased its DL offerings, from 6 courses/135 registrations in F’11 to 14 courses/240 registrations in F’12 (UH IRO Dynamic Reporting, Distance Education Classes, UHCCs). Exams for these courses are counted as DL courses in our scheduling system which may partly explain the jump in DL test administrations and the smaller increase in campus test administrations.

Our policy of proctoring "by appointment only" continues to allow efficient scheduling of full-class testing without adversely affecting many other students as evidenced by the continued high satisfaction in the services that we offer (4.88 on a 5-point scale). Though there was a slight decrease in satisfaction with our hours, this is most likely due to the loss of staffing from the UC that led to us only offering one night per week until 7pm in Spring 2013 (when the survey was conducted), instead of two nights per week as we had previously.

In FY2012, the TC began offering testing services for professional exams. These exams are not included in any of the Academic Support Metrics counts. However, we provided services for 224 professional exams to 82 individuals. Ten exams were administered for the Hawaii Dept of Transportation Airports division Aircraft Rescue Fire Fighting promotional testing. We administered 198 Automotive Services Excellence (ASE) certification exams to 59 different candidates. Of these 59 candidates, 29 ASE candidates sat for recertification exams only, 24 sat for new, not previously held certifications only, and 6 sat for both new certifications and recertification exams.  We began offering the ASE exam at the Testing Center in April 2012 because the paper option was discontinued by ASE in Nov 2011. No certified facilities were available for computerized ASE testing on Kauai at the time, forcing our automotive service professionals and alumni to look off-island for certification. In FY 2013, service professionals from Maui made appointments to test on Kauai since it was not yet available there. UH-MCC has since become a satellite testing center. This past spring, we also began offering the National Restaurant Association’s ServSafe certification. The original request came from Chef Martina Hilldorfer, who needed the certification to teach the ServSafe program to our Culinary Arts students. Though we did not administer the Certified Nurses Aid exam for our students, we did provide facilities meeting the standards in the Prometric agreement for testing.

Efficiency indicators have changed this year. Instead of looking at the number of seats available per student FTE, the metric now looks at the number of exams administered by FTE testing staff. Previously this was 1.15. This past December, however, we lost the regular UC coverage of 6 hours/week. Academic Support and C&A provided 3 hours/week in Spring so the TC could remain open until 4pm on Thursdays. Averaging out the coverage over the semesters, FTE testing staff was 1.11 this year. This year, the TC administered 3,834 exams per FTE testing staff. A 9.73% increase over the 3,494 exams per FTE testing staff administered last year. Again, these numbers do not include the 224 professional exams administered this year and the 97 administered last year.

In conclusion, the demand for testing is growing and remains healthy. Testing efficiency also remains stable and healthy.

Effectiveness:  Satisfaction indicators continue to remain high in student surveys; all are at 4.65 to 4.90 on a 5-point scale. Overall satisfaction is 4.81, a slight decrease over last year mainly due to a change in survey questions and the decrease in evening service hours. However, with the change in effectiveness measures by the UHCC System office from a weighted average point-scale number to a percentage of positive marks received number, it's easier to see that satisfaction with overall TC services remains healthy--98.7% of satisfaction responses were marked agreed or strongly agree.

As done during the previous reporting year, the "white noise" fan was again not used this year. Additional sound barrier acoustics were installed between the C&A meeting room wall and the TC. Improved satisfaction with atmosphere can possibly be attributed to this new installation.

Ten additional noise cancelling headsets were also purchased this year, in response to the 20 requests for them in the F'12 Student Satisfaction Survey. This purchase allows the TC to provide 20 headsets for its 33 seats. Still, there was a comment about needing more headsets in the current student survey.

There still are, however, issues with noise through untreated walls and doors, and from the administrator station in the testing area. Though the noise cancellation headsets provide more options to help students concentrate, a more permanent solution must be made.

The largest change in satisfaction was regarding hours. This is as expected due to change in FTE staff and the TC's decreased ability to provide evening access. We continue to highlight the later hours on our office availability sign and continue to take extra effort to inform callers of our later hours when making appointments.

Significant Program Actions (new certificates, stop-out; gain/loss of positions, results of prior year’s action plan)

Seats Available / Accessibility: The TC maintains 33 seats for testing, one seat is a hand-cranked adjustable height accessible table provided by the Disability Services Office. This table continues to be useful for students using scooters, electric wheelchairs, and students with other injuries or less-visible disabilities who cannot comfortably work at other tables in the TC. The table has also been used for a student who preferred to stand during an exam. Our appointment policy ensures access to students who may need that table.

In June 2013, the TC moved off the Windows based version of COMPASS testing. We have used the eCompass online version exclusively since then.  This was not possible with our old machines, as the proprietary software for eCompass could not be installed on them. This did make it more difficult to schedule students for tests requiring MS-Office or other special software, and to schedule ASE exams since they did not work on the thin clients. However, in July 2013, the remaining 12 thin clients and three older desktop PCs were replaced, completing the computer upgrades for the TC. Because of the completed upgrade, the July 2013 HESI testing for Nursing was the first time in two years that I did not need to borrow computers from the Library to have enough computers for this test. Now every seat can handle all test platforms, with the exception of those tests requiring MS-Office 2010.  However, with the purchase of four more site licenses through last year's APRU, the TC now provides 10 seats for exams requiring MS-Office 2010 products. MS-Office 2007 is available on other machines through licensing provided by Information Technology.

Atmosphere / Accessibility: As stated in previous APRUs, issues with the Testing Center layout remain. As a one-big-room operation, noise distractions from students checking-in, making appointments in-person, phone calls, and printing continue to be an issue. Because there were not enough for every seat, the TC's 20 noise-cancellation headsets were left in a box at the front of the room where students could borrow them at any time.  Once seated, though, most students did not stand up to get them even if they seemed to be distracted by surrounding noises.  Funds from the TC account were used in June 2013 to purchase 13 additional headsets so that one is available on each desk.

Students with accommodations such as readers and/or transcribers are still scheduled in either the University Center's Testing room or the Career Library. The Disabilities Services Office helped some of these students by proctoring them in their office.  The TC has recently installed free text-to-speech software on two machines in the TC. So far a student with reading accommodations has used the software and found it helpful. Having this software in the TC provides more options for the student as testing can now be conducted in the TC and does not depend on availability of someone to read the exam and availability of an alternate testing location.

In our 2012 APRU, additional sound barrier acoustics were approved for the wall between C&A's meeting room and the TC. Though we had requested money to install sound barrier acoustic panels similar to those installed the previous year on the wall between the TC and hallway, we were able to find a more cost-effective sound barrier product for use on the C&A office wall. The eco-friendly product is made from recycled rubber tires is installed on the wall then covered with a finishing product. In the case of the C&A wall, drywall was installed over the barrier, then finished and painted. The installation makes conversations from the meeting room much less discernible and possibly less distracting.

Due to other campus priorities, the Quiet Door kit still needs to be installed. Thus, noise from the gap below the TC's main entrance continues to be an issue.

Safety and Security: Over the summer, lockers for TC use were installed near the OSC water fountains. Though a shelf inside the TC for baggage included in previous action plans, another Campus committee provided these lockers. The lockers will provide secure storage of bags and improve safety in the TC by reducing the tripping and fire hazards. They also help us meet some of the professional testing center standards

For staff/student safety and exam security, a stand-alone camera system and additional four cameras were installed in the TC.

Certifications: In March 2012, we finalized our contract with Prometric to be a certified Prometric Satellite Testing Center for Automotive Service Excellence (ASE) certification exams. Three people are also authorized proctors for the test. Our partnership with ASE/Prometric is a stepping stone to other professional certification possibilities. In spring 2013, the TC began offering the National Restaurant Association's ServSafe certification. In early fall 2013, we also became a certified testing center for DSST exams.

Although Kauai CC does not take DSST scores, we are providing a service to community members taking courses from other campuses who do take them. This is not a completely new agreement to the campus as someone else administered the DSST before the TC existed. Through community contact requesting DSST testing services, it was discovered that KCC was still listed as a testing site even though the person who originally signed the contract had retired. At the time, the TC's equipment did not meet DSST standards for testing, however with the new machines, we easily meet their standards and were able to complete the agreement.  

We are in the final phase of contract negotiations with ETS to offer CLEP testing, and have, again, been contacted by ETS to provide computerized testing of their PRAXIS exam. The TC is also undergoing contract review to become a PearsonVue Test Center. Funding for some of this is coming through a Perkins grant awarded to Mark Anderson for our CISCO Academy students.

As part of a Perkins grant by Mark Anderson for our CISCO Academy students, he received money for a test administration "server," lockable storage, a printer, a camera, and electronic signature pad as required by the test vendor. However, the vendor's agreement also states that the administrator's station needs to be outside the testing area and that all the check-in processing (taking the candidate's picture and getting their electronic signature) must be done outside of the testing area. Currently, our only options are to have check-in provided by a different office, or have a rolling station with laptop, camera, and signature pad so candidates could be checked-in outside the TC door.

UHCC System has negotiated an agreement with Hawaii's Public Safety Department to provide computerized testing services to their potential employees at the CCs for a modest fee. The College has agreed to participate for now with the option to refuse future participation.

Part III. Action Plan

Goal Alignment UH System Goals, Kaua‘i Community College Goals, and Strategic Goals

Program Goals

UH Goal 1:  Educational Effectiveness and Student Success

KCC Goal 1: Access &

KCC Goal 2: Learning and Teaching

Strategic Goals: Student Recruitment, Retention and Success of All Students and Particularly

  • Native Hawaiian students
  • Increase success of Remedial/Developmental Students
  • Non-traditional Students in Career and Technical Programs
  • Increased Completion of Degrees, Certificates, and Licensure
  • Improve partnerships with K-12 to improve college preparation and to ensure that students are aware of specific opportunities that KCC provides

 

Relevant Curriculum Development

  • Sustainability/Green Jobs
  • Health
  • DOE-KCC English Alignment
  • Increase and improve design and delivery of distance education offerings
  • Increase transfer rates by strengthening four-year pathways, particularly in STEM fields

 

Completion of               

  • Course Student Learning Outcomes (CLOs)
    • Program Learning Outcomes (PLOs)
    • Institutional Learning Outcomes (ILOs)
  • Course Action Forms (CAFs)

 

Assessment Activities and Analysis

 

 

 

TC Goal 1: Access

  1. Provide an accessible location for students for complete their exams.
  2. Provide a local testing site for students to earn credit-by-examination in order to support non-traditional students in completing their degrees.
  3. Provide a local testing site for workforce members to complete professional certifications and specialized academic testing.

TC Goal 2: Learning & Teaching

  1. Assist students in completing their courses by providing an alternate site and schedule for testing.
  2. Alleviate some instructor load regarding make-up exams or special testing situations so that they can focus on teaching.
  3. Uphold academic integrity and security of testing materials and environment.
  4. Assist students in completing their degrees, regardless of which college/university they attend, by offering proctoring services to students who are not part of our system.

UH Goal 2:  A Learning, Research and Service Network

KCC Goal 3: Workforce Development & KCC Goal 5: Community Development

Strategic Goals: Increased Job Placement and/or Performance through

  • Revised or New Curriculum
  • Better Coordination with Business and Industry

 

 

TC Goal 3:Workforce Development

  1. Provide a local testing site for workforce members to complete professional certifications and specialized academic testing.
  2. Provide a local testing site for students to earn credit-by-examination in order to support non-traditional students in completing their degrees.

UH Goal 3:  A Model Local, Regional and Global University

KCC Goal 6 Diversity

Strategic Goals:

  • Fostering Global Understanding and Intercultural Competence
  • Increased Enrollment and Success of International Students

 

UH Goal 4:  Investment in Faculty, Staff, Students and Their Environment

KCC Goal 4: Personal Development

Strategic Goals:

  • Professional Development Directed to Any of the Above Goals
  • Enriching Student Experience, Particularly Directed to Any of the Above Goals
  • Increasing the Efficiency, Effectiveness and Sustainability of the KCC Environment

 

UH Goal 5:  Resources and Stewardship

KCC Goal 5 Community Development

Strategic Goals:

  • Reduce Deferred Maintenance
  • Address Health and Safety Issues
  • Promote Sustainability

TC Goal 4: Community Development

  1. Provide a safe testing environment for students and test center staff.

 Action Plan(s)

Program Goal

Action Item

Resources Needed

Person(s) Responsible

Timeline

Indicator of Improvement

PLO impacted

Status

TC1a, TC2a-b

Purchase specialized text reading software and OCR software

NaturalReader Platinum Version

Esther Miller

Spring 2014

Decreased number of reading proctoring sessions by  DSO Counselor; use of software in TC by student with accommodations

 

10% done (Free reader installed)

TC1a - TC4a

Soundproof/sound dampening proctor station area1

Construction of sound booth or installation of acoustic that will dampen activities at the proctor station while still allowing clear view of the testing area

Esther Miller / Maintenance / Carpentry?

Summer 2015

Student comments on survey will be reduced and question on atmosphere will increase above 4.93.

 

 

TC1a & TC2a

Reduce noise from neighboring offices/hallway

Acoustic panels

Esther Miller / Maintenance

Summer 2013

Student comments on survey will be reduced and question on atmosphere will increase above 4.9%

 

55% done

TC1b & TC3b

Pursue CLEP and DSST test site partnerships

New computer stations

Esther Miller / Student Services

Fall 2013

Improve access to more potential students-

Administered tests increase from 3047. 

 

85% done

TC1c & TC3a

Reopen discussion with PRAXIS representative to offer internet based testing (iBT)

New computer stations

Esther Miller / Others

Summer 2014

Improve community access to education.

Administered tests increase from 3047. 

 

20% done

TC1a & TC2a

Reduce noise transmitted through door between Student Counseling & Advising and Test Center

Quiet Door  installation kit

Esther Miller / Maintenance

Fall 2012

Student comments on survey will be reduced and question on atmosphere will increase above 4.9%

 

Awaiting installation

TC1a & TC2a

Reduce noise from entry door opening/closing

Door check / door damper

Maintenance

Fall 2012

Student comments on survey will be reduced and question on atmosphere will increase above 4.9%

 

 

 "

TC2b

Provide alternate test drop site/method for after hours

Partnership or lockable drop box

Esther Miller / Maintenance

Fall  2013

Faculty survey scores for hours will be higher than 40% satisfaction rate.

 

 

TC2b

Streamline proctoring request method for campus testing

none

Esther Miller / various faculty

Fall 2013

Faculty satisfaction will increase above 48%

 

 

TC2a

 Improve marketing efforts to increase student and faculty awareness of available hours and services

None

Esther Miller

Spring 2013

Faculty satisfaction will increase above 48%

 

 

TC2c

Provide secure storage for testing supplies and additional equipment3

Lockable storage cabinet

Esther Miller

Summer 2013

Improve safety, security, and proctoring

 

10%

TC2c &  TC4a

Repurpose current Proctor station machine as the "server" for our digital video camera security system AND purchase preconfigured multi-camera system.4

Larger hard drive, additional memory, network clearance; camera system, network clearance.

Esther Miller / Tom Kajihara

Summer 2013

Improve safety, security, and proctoring

 

90% done

TC2c

Have some sort of assistance or panic button in case of emergency.5

Alert/panic button

Esther Miller / Pat Watase?

Spring 2014

Improved safety of staff and users

 

 

TC1a - TC2b, TC2d - TC3b

Update computer equipment to meet testing requirements for a variety of tests.

33 computer stations

Esther Miller / Tom Kajihara

Fall 2013

Ability to meet the needs of class testing and new compass testing

 

Done

 

Move over to eCompass placement testing

New computer systems

Esther Miller / Tom Kajihara

Spring 2013

Improved technical administration of COMPASS

 

Done

TC1c & TC3a

Complete ASE Prometric agreement

New computer stations

Esther Miller / Others

Spring 2012

Improve access -

Administered tests increase from 3047. 

 

Done

TC1a & TC2a

Provide noise blocking headsets for every seat

33 noise-reduction headsets

Esther Miller

Summer 2013

Student comments on survey will be reduced and question on atmosphere will increase above 4.9

 

Done

TC4a,

TC2a

Provide safe and ample seating for students

Three adjustable, wheeled office chairs

Esther Miller

Summer 2013

 

 

Done

TC4a & TC2c

Provide a storage space for student belongings in the TC away from testing stations to ensure easy access to exits in case of fire and to uphold academic integrity in testing2

Sturdy wooden shelf similar to those in Bookstore

Esther Miller/ Maintenance/ Carpentry?

Summer 2013

Improved security of student items, safe exiting in an emergency, decreased cheating incidents

 

Done

 

Action Plan Notes

  1. Having an enclosed sound-barrier space will help us conduct business more efficiently while maintaining a high level of security. It will also help us maintain student confidentiality.   Our current setup does not comply with our contracts in effect. This could be a hindrance in securing additional testing partnerships and offerings.  With the newest contract in the works, PearsonVue Test Center (PVTC), administration must be done outside of the room while PVTC testing is going on. It also means that the phone will need to be turned off. The need for a separated administration space is increasing.
  2. With full-class reservations, the number of bags left at the front of the room could be considered a fire and safety hazard.  Calvin Shirai provided 18 lockers as part of a Buildings & Grounds committee proposal.
  3. Additional supplies and spare equipment are currently stored in a tall file cabinet that has a lock but no key and on an open table at the far end of the room. Replacing the "supplies table" with a locking cabinet would reduce the "visual noise" at the back of the room and help provide a more professional look to the center.
  4. Funding for the new camera system provided for a DVR system and no longer requires a computer for support. The new system can support an additional two cameras. We may want to expand coverage in the future, but for now we will evaluate the need for additional cameras.
  5. We have begun to see more students with anxiety issues that manifest in loud, imposing behavior.  Most times we can quiet them or have them step outside to discuss their issues further. Sometimes this doesn't work. There is only one staff member on duty at any time and in such situations, staff and student safety is a concern. A panic button would make getting help while ensuring other students' safety more efficient.

Part IV. Resource Implications

Summer 2015

 

  1. Proctor station "room" build out

$12,500

TOTAL

$12,500

 

 

Program Student Learning Outcomes

For the 2012-2013 program year, some or all of the following P-SLOs were reviewed by the program:

Assessed
this year?
Program Student Learning Outcomes

1

Yes
KCC Testing Center supports instructional and academic advising faculty by providing ADA-compliant access to course-related and COMPASS tests.

2

Yes
KCC Testing Services supports professional and workforce development by providing professional certification examination facilities that meet requirements as set forth by test originators and professional agencies.

3

Yes
KCC Testing Services provide and maintain a safe, secure testing environment in the highest compliance with professional testing standards and practices.

A) Expected Level Achievement

Current numbers will be used as benchmarks for achievement.
 

B) Courses Assessed

N/A
 

C) Assessment Strategy/Instrument

Service Outcomes and Assessment Measures for Testing Center

In 2012, the Testing Center formally developed three service outcomes. The first relates to supporting instructional faculty and academic advising faculty by providing ADA-compliant access to course-related and placement testing. Although we have always provided this service, it was not a formal outcome, nor something we tracked. Measurements will include the number of tests administered to students with documented accommodations forms per year per student FTE, contrasted with number of overall tests per student FTE. The second service outcome relates to supporting professional and workforce development by providing professional certification examination facilities that meet test vendors’ requirements. Measurements for this will include the number of professional tests administered per year for students and community members. The third service outcome relates to providing a secure testing environment in the highest compliance with academic and professional testing standards. Measurements will include student and faculty satisfaction survey results, and inspection reports (when conducted) by external testing agencies.

D) Results of Program Assessment

These newly devised assessments are still being formalized, especially for ADA Access.

ADA Access  - Tests to ADA students/FTE, tests/FTE

Because the ADA Access numbers were not tracked in FY 2012, this estimation is created by cross-checking IDs of students who disclosed to the Disabilities Services Office against IDs in our appointment system. During FY 2012, 40 students with accommodations took an exam at the TC (38 KCC, 2 Non-UH).  Of these 40, only 19 (17 KCC, 2 Non-UH) could be identified, with confidence, to have used their accommodation for their exam. These 19 students took 55 exams which granted and accommodation during FY 2012.

55 tests with Accommodations / 780 FTE = 0.070513

Pro Cert - # for students & comm members

FY2012 - 77 ASE, 20 Airport Fire Rescue – 97 exams administered

FY 2013 - 198 ASE, 10 Airport Fire Rescue, 1 ServSafe, 10 CNA, 5 others - 224 exams administered

Student Satisfaction results about environment/services

Secure testing environment in highest compliance w/ academic & pro testing standards – student/fac satisfaction, inspection reports (none yet)

Atmosphere is conducive to testing – F’12 is 4.79

Services are satisfactory – F’12 is 4.86

E) Other Comments

No content.

F) Next Steps

Better formalize the method for gathering accommodated testing accounting.