Language selection

Search

Internal Audit of the Canada School of Public Service's Language Training and Maintenance Program

May 1, 2012

Table of Contents


Executive Summary

Internal Audit Objective and Criteria

The internal audit objective was to assess the adequacy of management actions to ensure the Canada School of Public Service offers relevant, high-quality language training services that offer best value for money to clients.

The internal audit opinion is based on an assessment of the extent to which the following two criteria were achieved: measures taken to ensure relevance of language training and maintenance services; and measures taken to ensure high-quality of those services.

The internal audit objective and criteria, taken from the Canada School of Public Service's (the School) Report on Plans and Priorities for 2011-2012, were approved by the Deputy Minister on September 14, 2011, and supported by the Departmental Audit Committee at its next meeting on October 24, 2011.

Internal Audit Scope

The internal audit examination focused on the School's implementation of the new delivery model prescribed for its Language Training and Maintenance Program by the Treasury Board decision that was communicated to the School on January 25, 2006.

The findings presented in Section 5 of this report cover the period from 2007-2008 until March 9, 2012.

The scope of the examination includes Language Training and Maintenance Program activities undertaken by the School across Canada. There were no scope exclusions.

Internal Audit Opinion

In my professional opinion as the School's Chief Audit Executive, the actions that the School's management has undertaken in relation to its Language Training and Maintenance Program were adequate to ensure that the federal public servants that it served were offered relevant, high-quality language training services that offered best value for money. This internal audit opinion is based on an assessment of the management actions undertaken in implementing the 2006 Treasury Board decision concerning the School's Language Training and Maintenance Program. The management actions adequately addressed the four parts of the Treasury Board decision which directed the School to develop and implement a "new model premised on a) a vision of the School's Language Training Centre as a Centre of Expertise and b) a stronger partnership with external suppliers including private, industry, community colleges, universities...." This new model set the School's direction for relevant and high-quality language training services.

Main Findings

Since 2007-2008, the School has provided a broad range of advice on implementing and sustaining a bilingual workplace culture and developing integrated learning solutions, both at a departmental/organizational level, as well as an individual level. Further textment of roles and responsibilities of the School in regards to language training, consistent with the 2006 Treasury Board decision and reaffirmed in the Addendum to Five Year Report to Parliament (2008), is being achieved through a revised integrated organizational structure which is being resourced and introduced in April 2012 with a refocused and enhanced Centre of Expertise.

Effective April 1, 2012, the School no longer provides direct delivery of language training to public servants. This represents the final step in implementing the 2006 Treasury Board decision. While the School continues to work with Public Works and Government Services Canada on a national procurement vehicle, departments can access language training through existing mechanisms of procurement.

Since 2006, the School continues to play an active role in setting standards, developing learning evaluation tools, training pre-qualified external providers on the School's programs, products and tools, monitoring, measuring, reporting and following up on the performance of external service providers.

The School has used, and continues to use, its A-base funding to provide quality and accessible language learning tools to federal public servants through the use of emerging technologies and research activities. Modernizing and digitizing core language training programs and infrastructure, as well as developing self-paced language learning products, were the principle focus of activity since 2007. As of April 1, 2012, a strengthened organizational structure focused on a Centre of Expertise allows for a better focus on research on new methodologies and on the transfer of results to the language industry. These actions have been, and will continue to be, subject to quality monitoring.

There was no need to make internal audit recommendations.

Statement of Assurance

In my professional judgment, sufficient and appropriate audit procedures have been conducted, and evidence gathered, to support the accuracy of the opinion provided and contained in this report. The opinion is based on a comparison of the conditions, as they existed at the time, against pre-established audit criteria that were agreed on with management. The opinion is applicable only to the entity examined. In my judgment, the evidence that has been gathered is sufficient to provide senior management with a high level of assurance for the accuracy of the opinion from this internal audit.

Original signed by:
Basil Orsini, CIA, CGAP, CCSA, CFE, MPA
Chief Audit Executive
Canada School of Public Service

Ottawa, Ontario
March 26, 2012


As required by the Treasury Board Policy on Internal Audit, this final report was approved by the Deputy Minister/President of the Canada School of Public Service, Guy Mc Kenzie, on May 1, 2012.

1. Background

The Canada School of Public Service (the School) was created in 2004 by bringing together three organizations: the Canadian Centre for Management Development, Training and Development Canada and Language Training Canada. The Policy on Official languages for Human Resources Management (April 2004) states: "Institutions provide language training to incumbents of bilingual positions who need to acquire the skills in order to meet the language requirements of their positions."

Until 2007, the School received appropriations to provide statutory language training to public servants for direct delivery. Beginning in 2007-2008, direct delivery was funded on a cost-recovery basis. There were long waiting lists to access this service and overall dissatisfaction with this method of delivery. The Mitchell Report, based on consultations with a group of Assistant Deputy Ministers, was issued in 2004-2005. It led to the 2006 Treasury Board decision in which the School's future roles and responsibilities were explicitly stated. The School continued to receive annual funding in support of its role as a Centre of Expertise, including developing and supporting external providers of language training and maintenance services to federal public servants.

In 2006, the Treasury Board issued its decision (quoted below) which defined the future role and responsibilities of the School in regards to Language Training. "The new model is premised on a) a vision of the School's Language Training Centre as a Centre of Expertise and b) a stronger partnership with external suppliers including private, industry, community colleges, universities…."

Specifically, according to the 2006 Treasury Board decision:

"The School's objective is to play a leadership role in building and maintaining individual and organizational second language capacity through foundation training and professional development. It recognizes that the acquisition of a second language is, like other job competencies, acquired and maintained through continuous, lifelong learning.

Under the new model, the aim is to ensure:

  1. Language training will become an integral part of each department's human resources strategy. The School will provide advice on implementing and sustaining a bilingual workplace culture and the development of integrated learning solutions.
  2. Departments will take increased responsibility for language training. The School will no longer provide statutory language training free of charge to departments, although it will provide cost-recovered services when the expertise and/or services of pre-qualified partners are not available. Language training program delivery costs will be assumed by departments/agencies contracting with service providers. The School will work with Public Works and Government Services Canada (PWGSC) to put in place a Master Standing Offer to ensure access to quality-assured, pre-qualified service providers.
  3. The School will set standards, develop learning evaluation tools, train providers on the School's programs, products and tools, monitor, measure and report on performance. As a result, departments will have better access to high-quality language training services without having to wait in line.
  4. Individuals will be responsible for maintaining their language skills. The School will provide access to learning tools. It will modernize and digitize core language training programs and infrastructure for delivery through e-learning. It will also develop self-paced language learning products and make them accessible to public servants. To ensure that public servants have access to the best possible language learning opportunities, the School will conduct research on learning technologies and methodologies as well as on learning disabilities. Research results will be tested in pilot classrooms, and then transferred to the language industry."

Later, the Addendum to Five Year Report to Parliament, tabled and published on June 18, 2008, reaffirmed the direction and actions being taken by the Canada School of Public Service, consistent with the Treasury Board decision in 2006.

The excerpt from the Addendum to Five Year Report to Parliament (2008), repeated below, is found on the School's Web site.

"Adopting Leading Practices in Official Language Maintenance: The Public Service's language training model recognizes bilingualism, like other leadership competencies, can be acquired and maintained through continuous learning. Public servants need to be able to acquire language skills early in their careers and be provided with the tools to maintain and improve those skills throughout their career. The School should continue to develop learning tools using technologies to support maintenance and improvement of language skills.

The School continues to deliver training only where there is no alternate qualified market, in instances where a department has specifically requested that the training be provided by the School and for persons with learning disabilities. For those departments and agencies that access language training through the School, the School provides timely and accurate language training plans for their employees and assures that they have access to quality-assured and cost-effective language training. The School should also continue to provide quality assurance of those qualified private sector training providers who provide services under the Standing Offer for language training in the National Capital Region. The School will continue to seek external qualified language providers in the regions."

The School's Language Training activities in the National Capital Region (NCR) and other regions support public servants in acquiring and maintaining language skills, providing students with access to the School's online language training tools. The School leads the design, development, research and pilot of language learning programs, products, tools and methodologies. It also provides advice to departments to help them meet their language training needs.

Profile of the School's Human Resources dedicated to Language Training and Maintenance Endnotes4

Projection of Canada School's Financial Position for Language Training and Maintenance based on continued direct delivery. Read down the first column to find measures of the School's financial position, including revenue and A-base funding, expenditures, and deficit. The second column lists the projection of the School's financial position based on continued direct delivery for years 2010-2011. The third column lists the projection for years 2011-2012. The fourth column lists the projection for years 2012-2013.">
Date Indeterminate Term Casual Assignment In
(Seconded In)
Student Total
March 31, 201086903410211 Endnotes1
March 31, 201177923020201 Endnotes2
March 21, 2012691011900189 Endnotes3

The School's Program management advised that the human resources allocation for 2012-2013 is 65 full-time equivalents (FTE).

2. Internal Audit Objective and Criteria

The internal audit objective was to assess the adequacy of management actions to ensure the School offers relevant, high-quality language training services that offer best value for money to clients.

The internal audit opinion is based on an assessment of the extent to which the following two criteria were achieved: measures taken to ensure relevance of language training and maintenance services; and measures taken to ensure high-quality of those services.

The internal audit objective and criteria, taken from the School's Report on Plans and Priorities for 2011-2012, were approved by the Deputy Minister on September 14, 2011, and supported by the Departmental Audit Committee at its next meeting on October 24, 2011.

3. Internal Audit Scope and Approach

The internal audit examination focused on the School's implementation of the new delivery model prescribed for its language training and maintenance program by the Treasury Board decision that was communicated to the School on January 25, 2006.

The findings presented below in Section 5 cover the period from 2007-2008 until March 9, 2012.

The scope of the examination includes Language Training and Maintenance Program activities undertaken by the School across Canada. There were no scope exclusions. Program and corporate management in the School provided the following kinds of information in support of their actions that were examined by internal audit: accountability reports published by the School; data from School financial and human resource systems; internal analyses and reports on activities; contractual arrangements with pre-qualified external providers; and finally, testimony from 20 national and regional managers on the accuracy of the draft internal audit findings.

The 2006 Treasury Board decision provided the basis for the internal audit examination, assessment and detailed reporting. Findings are presented in relation to the four parts of the Treasury Board decision on the Language Training and Maintenance Program. The Treasury Board and the Treasury Board Secretariat provided the School with flexibility in how it would implement the 2006 decision. In addition, the School reported on its program activity in its annual Reports on Plans and Priorities as well as in its annual Departmental Performance Reports. Accordingly, this internal audit focused on obtaining sufficient and appropriate evidence that reasonable management actions were being taken consistently, and that management had adequate controls to implement the Treasury Board decision and achieve the School's objectives of relevance and high quality. Internal audit evidence was gathered in accordance with Treasury Board policy, directives and standards, as well as the standards of The Institute of Internal Auditors.

4. Internal Audit Opinion and Statement of Assurance

In my professional opinion as the School's Chief Audit Executive, the actions that the School's management has undertaken in relation to its Language Training and Maintenance Program were adequate to ensure that the federal public servants that it served were offered relevant, high-quality language training services that offered best value for money. This internal audit opinion is based on an assessment of the management actions undertaken in implementing the 2006 Treasury Board decision concerning the School's Language Training and Maintenance Program. The management actions adequately addressed the four parts of the Treasury Board decision which directed the School to develop and implement a "new model premised on a) a vision of the School's Language Training Centre as a Centre of Expertise and b) a stronger partnership with external suppliers including private, industry, community colleges, universities...." This new model set the School's direction for relevant and high-quality language training services.

In my professional judgment, sufficient and appropriate audit procedures have been conducted, and evidence gathered, to support the accuracy of the opinion provided and contained in this report. The opinion is based on a comparison of the conditions, as they existed at the time, against pre-established audit criteria that were agreed on with management. The opinion is applicable only to the entity examined. In my judgment, the evidence that has been gathered is sufficient to provide senior management with a high level of assurance for the accuracy of the opinion from this internal audit.

Basil Orsini, CIA, CGAP, CCSA, CFE, MPA
Chief Audit Executive
Canada School of Public Service

As required by the Treasury Board Policy on Internal Audit, this final report was approved by the Deputy Minister/President of the Canada School of Public Service, Guy Mc Kenzie, on May 1, 2012.

5. Findings

ANNEX: Excerpts from Annex A, Section 3 of the Offer and Call-up Authority for Regional Master Standing Offers

The following are excerpts from Annex A, Section 3 of the Offer and Call-up Authority for Regional Master Standing Offers showing how the School sets standards for language training.

TRAINING REQUIREMENTS

3.1 Training

The Offeror shall deliver second language training services in the NCR to students identified by the Identified User. The second language training will be for the French and English official languages of Canada, as identified in the call-up.

The Offeror shall deliver the training through continuous courses on a full-time basis using the CSPS (Canada School of Public Service) Training Programs on an "if and when requested" basis. The training services include, as a minimum, classroom instruction, the development of weekly training plans, keeping a class register (logbook), keeping a follow-up log on the training students and submitting student progress reports and individual follow-up plans, all as detailed herein.

The Offeror shall deliver the plans, registers, follow-up logs and individual follow-up plans if requested to do so by the Technical Authority. All items shall be delivered no later than two (2) Business Days following Technical Authority's (TA) request for their delivery.

The Offeror shall ensure that the requirements of this SO (Standing Offer) are not modified as a result of student requests. Example: students are required to receive training during the Training Delivery Days listed herein and no modification is permitted.

3.2 Use of CSPS Training Program

This Standing Offer contains Training Programs designed by the CSPS ("CSPS Training Programs"). The Offeror may use parts of its own training programs to supplement or reinforce the CSPS Training Programs; however no parts of this SO may be changed.

Learning Plans for Students (Service provided by the CSPS for both Training Formats)

Employee Linguistic Assessment

Federal institutions will provide the CSPS with identification of employees they wish to send on language training. The CSPS will administer either of the following tests to employees (potential students at this point) in order to determine the employee's learning pace:

In addition, the CSPS will assess certain linguistic achievements in the test in order to determine the total quantity of hours deemed required by the student to meet the required language proficiency level.

The CSPS will then identify a Training Program corresponding to the student's learning pace and the required quantity of hours. A "Student Learning Plan" will be prepared by the CSPS and will include the results, Training Program, pace of learning and required number of hours. The CSPS will forward this Student Learning Plan to the federal institution.

The Student Learning Plan will form part of a resulting call-up. The Offeror shall utilize, as a minimum, the requisite CSPS Training Programs to correspond to the Student's Learning Plan.

CSPS TRAINING PROGRAMS

The training methodology, course configurations and the corresponding materials designed by the CSPS and detailed below are defined as "Training Programs" or "Programs" or "the CSPS Training Programs".

The Offeror shall utilize the CSPS Training Programs listed below, and, the specific CSPS Training Programs used must correspond to the starting objectives or book as identified in the Student Learning Plan.

The Offeror is reminded that it can use its own program to complement and the CSPS Training Programs, however, the provisions of SECTION I: 2.3.5 of this SOR applies.

The CSPS Training Programs are:

1. for the French language: Programme de français langue seconde (PFL2), levels A, B, C and the Make-up course, of the CSPS.

2. for the English language: Communicative English at Work Program (CEWP), levels A, B, C and the Make-up course of the CSPS.

Familiarization Sessions for Teachers and Pedagogical Counsellors

Following the authorization of the Standing Offer, teachers and pedagogical counsellors proposed to conduct the Work pursuant to a call-up, and accepted by the CSPS for same, will be offered Familiarization Sessions detailing the CSPS's Training Programs and Oral Interaction Assessments. The purpose of these sessions is to have these teachers and pedagogical counsellors become familiar with the CSPS's Training Programs and evaluation tools to facilitate the Offeror's requirement to have these resources utilize the CSPS Training Programs and tools in carrying out the training.

Pedagogical Counsellor Supervision

Each pedagogical counsellor assigned to a class group shall visit the class group at least once every two (2) weeks to ensure that the courses are delivered according to the requirements of the Training Program and that the teaching methods respect the andragogic principles. For each class group visit the pedagogical counsellor shall report his/her findings on a monthly basis, in a written report, and submit this report monthly to the Identified User and the Technical Authority on the first working day of the month following the month reported. The report shall be delivered via e-mail or facsimile. The following items must be addressed in each report; as a minimum:

The TA will analyze the report findings. If classroom/teacher/student difficulties are found or reported and there is no indication of the Offeror having addressed the issues, the TA will determine the cause of the difficulties and if:

Teachers

The Offeror shall ensure that, in addition to the seven (7) training hours delivered to the students, the teachers dedicate a minimum of five (5) hours per week to class preparation for each class group. Upon request from CSPS or Identified User, the Offeror shall provide documentation showing the preparation time used each week by each teacher for each group. This documentation shall be delivered to the requestor no later than three (3) Business Days of the request.

The Offeror shall ensure that the teacher is prepared to start daily classes at least 15 minutes prior to the start time of 8:00 a.m.

In the case of an unforeseen need to replace a teacher, only those teachers already meeting the Training Resources Qualification Requirements herein and who are confirmed or who have already been trained by the Offeror's pedagogical counsellor on the use of the CSPS products applicable to the Training Program (in particular PFL2 A, B and C and CEWP A, B and C), may be a substitute teacher.

The teacher shall carry out student learning performance monitoring and progress report activities as detailed in article 10.1 herein.

SPECIFIC QUALITY ASSURANCE / PERFORMANCE MEASUREMENTS

10.1 Student Learning Attendance, Progress and Performance Reporting – conducted by the Offeror

10.1.1 Student Attendance Report

The teacher must track the daily attendance. All instances of partial or full-day absences must be recorded. The pedagogical counsellor shall provide, by e-mail or facsimile, a written attendance report to the Identified User no later than the first Business Day of every month following the preceding month for which the attendance was tracked. An attendance report template will be provided to the Offeror by the CSPS.

These attendance reports must be signed by the students before being submitted to the CSPS Technical Authority or to the Identified User.

In addition, the Offeror shall notify the Identified User and the TA of all students who are absent for five (5) or more consecutive days (includes full or partial days). The Offeror must deliver this notice no later than forty-eight (48) business hours following the fifth (5th) day of the absence.

10.1.2 Student Learning Progress Report

A template of this report will be provided to the Offeror by the CSPS. The pedagogical counsellor shall ensure that the duly completed monthly student progress report (prepared by the teachers) is sent to the Identified User by e-mail or facsimile by the first Business Day of the month following the month evaluated.

10.3 Satisfaction Questionnaire

At the phases corresponding to the CSPS Training Programs Objectives, the Offeror will instruct students to complete a satisfaction questionnaire regarding their level of satisfaction with the training received. The Offeror will inform the CSPS when the group has completed each satisfaction questionnaire.

This questionnaire will be in electronic form and the Offeror must ensure that its computer equipment will accommodate this questionnaire to allow student completion of the questionnaire, by computer, and direct transmission to the Technical Authority and to the Identified User. The Offeror shall schedule this activity as part of the training. The Offeror shall not intervene with the content of the questionnaire, or with the students' responses to the questionnaire.

The TA will prepare a summary of remarks and will forward same to the Offeror and a copy to the Client Institution/Identified User.

This questionnaire will evaluate the physical environment, the teaching resources (teachers and pedagogical counsellors), the training program, the training methods, and, the responsibility of the employee relative to his/her own training.

This questionnaire will be used to develop measures that will be addressed during Educational Session to correct aspects signalling difficulties impacting the learning of the student. The purpose is to ensure the training services meet the learning needs of the student.



Date modified: