Dan Spalding (2014:97) says that there are few standards in adult education. This is a bless and a curse. A bless because we do not have much to be accountable to and at the same time a curse because we get to be evaluated in a more arbitrary basis. This is not much different in … Overall program evaluation process at my institution. Leer más »
Dan Spalding (2014:97) says that there are few standards in adult education. This is a bless and a curse. A bless because we do not have much to be accountable to and at the same time a curse because we get to be evaluated in a more arbitrary basis. This is not much different in our own school. At ISEA (Instituto Superior de Educación Abierta) we are given what our authorities call competency curriculum, which by the way is far beyond what a real competence curriculum should be, most of the learning outcomes do not have an active verb and there are literally hundreds of content pages. At the end of the academic year all we do is hand over to our education ministry authorities a list with the names of our students and the grades they got. Our supervisors only get tons of paper forms filled out by the teachers themselves. This gives us a great deal of independence but at the same time, like James Kirkpatrick says; the need to provide compelling evidence that training delivers bottom – line results (2016:4) is something we ought to do not because the law but because we serve people, we offer these adult students that once they graduate they will be able to find a better job; get into college and pursue a better life; if they cannot do that after they leave school then we are not much different than those fortune teller ladies that will tell anyone whatever they want to hear without even worrying if it´ll ever became true. So, to get into the matter, James Kirkpatrick (2015) once said that the four levels are not to be taken like a bullet list, we can easily start from level 4 and then come down to level 1, in our case, since 2012 we started a process of aligning instructional objectives to official curriculum standards; and we started on level 4, we put those standards as desired results and then planned backwards using the Grant (McThyghe, 2005) framework. The Peter Oliva model. When evaluating the entire curriculum, we have find Peter Oliva´s framework somewhat more suited to our needs. The late professor Oliva proposed a framework model of evaluation called the 5P Critics argue that Oliva´s model is too linear and outdated. Anyways, in our culture it is much better than Kirkpatrick´s four levels. The four levels can be used to evaluate training, which is going to be used almost immediately, while Oliva´s model can be used to evaluate the entire process like in our school where a learning intervention could last from one to three years and, like those fortune teller gypsies, we do not really know if what our students, teachers and authorities want will eventually come true. PROGRAMS: At this moment we evaluate curriculum standards and the extent to what the instructional objectives are aligned to those standards. PROVISION: In this stage we evaluate whether the school, teachers and every student have the resources needed to accomplish what is expected from the curriculum standards. PROCESSES: Here we examine the “how” each assignment will be carried out. We have mapped all standards, content, units, task and evaluations at institution, teacher and student levels. PROCEDURES: This is the smallest part of the learning process. Here each student is expected to carry out some steps to create a learning product, at this level we provide them with a description of what is expected; a list of resources or conditions needed to execute that task, a procedure and product characteristics to be handed over to the teacher. PRODUCT: At this level we examine the following: The product the student delivered and the grading of those products; the product of the teacher (planning, content delivery and learning outcomes); and at the institution level we examine whether we have succeeded in translating those curriculum standards into actual learning transfer. I have to admit that is very difficult to measure something once our students have left school, we have a database but over a couple of years most students have changed cell numbers or moved from where they used to live, we like to think that this movement is a result of a better life after graduating from their GED but, like the gypsy lady, we just hope… References Kirkpatrick, J. (2015). The Four Leves of Evaluation. ATD International Conference (pág. S.D.). Orlando FL: ATD Press. Kirkpatrick, J. a. (2016). Four Levels of Training Evaluation. Alexandria VA: ATD Press. McThyghe, G. W. (2005). Understanding by Design. Alexandria VA: ASCD. Oliva, P. (2013). Developing the Curriculum. Boston: PEARSON. Spalding, D. (2014). How to teach adults. San Francisco CA: Jossey-Bass.