Thursday, August 16, 2012

Capacity focus, 55c: Using the Vygotsky ZPD window of learning opportunity concept, a spiral curriculum structure and the Bloom two-sigma learning challenge to develop mastery learning based courses of study

(Two Sigma/Digital learning transformation series 
1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12 )

As I look at the heading for this post, I think: we are getting close to being seriously technical about curriculum development. 

I will have to watch that, and try to lay out the post in a way that we can all use it! 
(NB: This stuff is very important to us as educators, as parents, and as citizens and stakeholders of education in our communities; if we are to create viable alternatives to a "business as usual" path that seems headed for trouble, so I must try, do let me know how well I do . . . )
I think the Vygotsky concept of a zone of proximal development -- the window of opportunity for learning -- that we can access at a given time based on our current level of capacity and potential, is a good pivot for our thoughts. 

So, let's look at it again:


What this is telling us, is that we need to start where we are and make progress in gradual steps in any given period where we are trying to learn. It is also showing us that, with well-structured help from More Knowledgeable Others [MKO's] -- teachers, parents, mentors, books, web and multimedia resources, even fellow classmates etc -- we can learn significantly more than we can on our own. And, as we saw, mastery based approaches that emphasise finding and fixing gaps through diagnostic and development exercises step by step can make a significant difference.

Let us also remind ourselves about the way a mastery based curriculum is structured:


Taking in Jerome Bruner's concept of spiralling curricula, the point that a spiral goes round and round in circles but makes progress from loop to loop, and the concept that certain key themes form a cluster of anchor points that ground an effective body of knowledge and skills -- and dashing in a bit of inspiration from our friendly local spider's web --  we can then come to a version of the spiral-web as a basic structure (more strictly, architecture) for the curriculum:

The Spiral learning web curriculum architecture (cf. details here)
This model applies in general terms at several levels, e.g. from the layout of a six-week half-term unit of study to the design of a whole school level or degree programme across several years, depending on the interpretation of "Unit." 

However the main level we have in mind is the design of a definite semester-length or year-length course in a programme of study, and the related design and related development of the course web site and resources. It is also directly applicable to designing a six-week, half-term module of study that I believe should be the basis for high school curricula.

In key steps of thought:
1 --> The Vygotsky ZPD/window of learning opportunity picture of what can reasonably be learned in the given time available, in light of experience of how much an "average" student of a given intake level can absorb, gives us a yardstick for how much content should be put into a given course or module of study. (This is rather like saying that when we construct a family budget, it should start with experience of what things cost and how much we spend per week or month.)

2 --> The other constraint is of course, what level of knowledge and skills, and what key knowledge, principles, skills, techniques etc are required for effective performance in the world of work etc, in the given area. That will pretty much give us an idea of how many courses we will need to gain the required competence.

3 --> We can use the full-time course of study workload as a yardstick of how much students should be doing per week. About 45 hours total effort is a College yardstick, and in High School, the typical workday is six or so hours in class and an expected 2 - 3 hours average -- this includes that some of that would be done during the weekend -- when students get home. That comes up to the same about 45 hours.

4 --> This is in fact the basis for the Carnegie Unit of Credit, the mysterious "credit" that we so often see in College prospectuses. The idea is that students should do about 45 hours of effort per week, across a 15 - 17 week semester. (NB: I favour 17 week semesters, but that puts me in a distinct minority! The more typical 15 - 16 week semester will have about 11 - 12 weeks available for main class time with the extra time being used up in major assignments, presentations and exams to round out the semester.)

5 --> A good yardstick is that each Credit for such a semester is 45 hours of effort, often divided across 15 hours contact time in a lecture/seminar based course, with the other 30 hours being for associated student effort on study, reading, assignments etc. 

6 --> That boils down to saying that full time students do 15 credits worth of courses per semester (where labs etc have a pro-rated credit-hour loading, but that is a complication we need not go into here), which corresponds to a nominal weekly workload of 45 hours for the hypothetical average student. Unfortunately, there is a tendency to over-load courses.

7 --> To convert to a part-time basis, a good rule of thumb is to run at the equivalent of a semester per year, i.e. you go at half the rate, nominal. (Bye-bye, sleep, entertainment and hobbies . . . )

8 --> These can be adjusted to the 11 - 13 week term-based, 30 classroom hour per week  high school system, by reckoning with the implication that students have about 15 hours per week of expected homework, readings, study, assignment/project time etc. (That means, homework should be balanced, with a "fair" allocation being based on the number of periods per subject. In short, study, reading, home work etc for a subject, should on average use up about half the classroom contact time, per week. And, remember, typical students are probably reading at 300 words/minute, teachers speak at 100 - 150 words per minute, and students will write only a fraction of that. Maybe 20 - 30 or less in a class, and 15 or so under test conditions? [Try a test to see where your students are. Also see how many words fill a sheet of paper: letter size paper, single spaced at 12 point Times Roman, handwritten on a typical sheet of paper etc.  As a rough guess, for that now "standard" typescript, maybe 600 - 700, for reasonable handwriting, maybe 250 or 300. Cf wiki here. ] )

 9 --> I have taken time to focus these issues, because in the Caribbean, we do not tend to plan based on reasonable, empirically grounded estimates of amount of work required to do a job. So, we tend to overload students, in effect biasing the window of learning opportunity to the "brighter" students. (And BTW, this seems to go all the way to university and CXC curriculum levels.)

10 --> This job loading question also extends to teaching staff. Overloaded teachers will cut corners and quality of learning for average-poor students will suffer. 
(And BTW, it should by now be clear that it is unreasonable to expect busy classroom teachers to do major curriculum development exercises in "spare" time. A sounder strategy is to have curriculum developers work with teachers and to give a class time load reduction corresponding to the effort to go into the development exercise. Failing this or something substantially equivalent, the curriculum development exercise will suffer. On this I recall being upbraided by a senior manager in front of my immediate managers once as being "lazy" while I was spending 12+ hours per day working, average, as a curriculum development project lead person on a programme that was a critical national strategic imperative. "On the cheap" does not work when the issue is that we as a region must now reshape the most critical strategic resource in our region: what we have between our ears.)
11 --> It is critical to profile three things to guide all else: where the students are at intake, where they can reasonably be on completing the period of study/course in the time available, and the key themes that define the knowledge, insights, and skills etc that are critical to success in the tasks that those who take the course will be expected to undertake. Which includes following periods of study.

12 --> This allows us to lay out the intake profile, the learning targets, and the pivotal points of content that define the key themes. 

13 --> Units of study then become the reasonable, experience based sequence of activities and content that moves from intake to outcome with high likelihood of success. 

14 --> As the mastery learning structure diagram shows, each unit will have to include in-unit diagnosis and remediation of gaps, as well as enrichment for the ones who are ahead of the game. 

15 --> A trick my mother used when she found herself teaching classes of 90 and more in primary school in the baby-boom 1960's was to use the high-achiever students as in effect tutoring assistants, in small groups. This has the effect of consolidating their achievement [if you want to really learn something try to teach it!], and develops all sorts of associated positive skills and attitudes. (And some students will get a taste for teaching, too.)

16 --> Such study groups multiply interactivity, give feedback and assistance with correcting gaps, i.e. they are capturing some of what the mastery learning research highlights as keys to instructional effectiveness.

17 --> Similarly, realistic student-chosen projects as major assignments are powerful motivators and help find and fix gaps in knowledge based on testing for performance. They also give confidence in the level of knowledge acquired, and in being able to perform in the real world.

18 --> Thus, we can see a pattern for learning activities that lead to success: a spiral path that starts where students are, responds to their needs, uses key case studies to frame what is needed by way of knowledge, skills, key principles, etc, and proceeds to systematically build up same.

19 --> the Assiniboine Community College (Canada) IDEAS model for instructional units has always appealed to me ever since I ran across it:
I -- INTRODUCTION that sets a context for the unit and brings out the key case study

D -- DETAILS are then examined and elaborated step by step (I love diagrams and short videos, multimedia slide shows, well structured readings, fill in the blanks summary recall exercises etc)

E -- EXERCISES & EXAMPLES help develop problem solving skills

A -- ASSIGNMENTS give realistic tasks and set projects thsat reinforce and show capacity developed

S -- SUMMARIES draw together the key substance in a way that promotes early, frequent review and retention
20 --> A portfolio of achievements then allows for realistic, reliable and credible certification of learning outcomes.

21 --> Such a course should then be embedded in a wider curriculum, which I think should, generally speaking, follow the Tee-model at secondary level (and a version of the same for college level programmes, but reflecting the career-based paraprofessional or professional specialisations that are being pursued at that level):
 22 --> Beyond the above, a curriculum should be integrated with national development long term needs and strategic priorities, conceptualised in a 20 year framework of thought. 

23 --> Onward, the issues of sustainability and national capacity development have to be factored in, if we are to have a sound base for progress.

24 --> Primary school level and early childhood programme development face some of the same factors, multiplied by the implications of the early stages of growth and development that are ongoing in children of the relevant ages. (The scope for that is beyond what can reasonably be dealt with in a blog post. Besides, this is the area that seems to have had the most effort put in across time in our region. What I would say is that it is reasonable to expect that at age 11 or so, students should be literate and numerate, should be able to write a well organised composition in sound English, and should have the rudiments of science, general knowledge, civics and digital literacy. On that basis, much can be done. Without it, frustration is sure to follow.)
In short, a High School level or college level curriculum development effort is a significant task, and requires a major, sustained, supported effort backed up by education managers who understand what is being undertaken. 

A syllabus is not a curriculum, and a classroom teacher's scheme of work to be done is not a curriculum. When courses are a part of a wider programme, they need to be co-ordinated to ensure that students are always in their windows of opportunity for learning, i.e. the scope, sequence and structure of the units across a programme have to be very carefully integrated for success. Curriculum is not a piecemeal ad hoc matter.

I could go on and on, giving war stories and more, but I think the above is enough to begin to guide planning and development.

What remains here is to highlight that the digital technology revolution transforms accessible learning resources and the possibility for capturing enough of the key mastery learning interventions to get much of the Bloom two-sigma effect. 

I am particularly impressed with the potential for the 7" Android Tablet in a folio with a keyboard, and hosting e-books, a version of the Open Office free office productivity suite, software development tools, and even Bible study software, etc:


 The question is, are we willing to make the effort?

And like unto it, what happens if we don't?

So, I again ask: Why not now, why not here, why not us? END

Wednesday, August 15, 2012

Capacity focus, 55b: What about those who are not (yet) ready to learn -- drawing on ideas from Piaget, Vygotsky, Bloom, Skemp and Demetriou etc to use models of cognitive development, learning and intelligence to foster curriculum transformation

 (Two Sigma/Digital learning transformation series  
1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)

Some people are just not ready to learn a given topic, others need a lot of help -- and with that help can make a good "go" of it --  and some "breeze through" easily. 

Why is that? 

Where do intelligence and cognitive development fit in? 

And, how does this affect the idea we have been examining, that by shifting how we go about teaching and learning, we can make a big difference to outcomes? (A difference that credibly can make a difference not only for our students, but for our region's prospects in the emerging high tech world.)

The second question is much easier to answer: the implicit assumption in Bloom's studies on the impact of mastery learning and 1:1 tutorials, etc, was that we were dealing with people who were reasonably "ready" for the new units of study in view.

Lev Vygotsky has a useful "window of opportunity" model that allows us to draw out a bit on what "readiness" to learn is, and so to open the door to looking at relevant  issues about learning, intelligence, cognitive development etc etc:

Vygotsky's Zone of Proximal Development (ZPD) which shows what has been mastered, what can be learned with some help ("scaffolding") from More Knowledgeable Others [MKO's], what would need much help to be learned, and what could not reasonably be learned in the current period even with much help
What this model does is it shows us how some students, given what they have already mastered, can easily progress, and why some will need a lot of structured help (live and/or "canned" from books, videos, web media etc), and why some will not be able to master new materials in the available time. 

That brings up the organisation  -- the architecture -- of Benjamin Bloom's Mastery learning curriculum approach: 


Bloom's mastery learning approach uses small successive units [1 and 2], which have "formative assessment" modules [A and B] that allow for enrichment and corrective study, so that students master one stage before they move on to the next. This allows us to inject a degree of individualisation, interactivity, feedback and flexibility, but requires a considerable investment in developing the specific structure in light of the challenges that students may have and the opportunities for enrichment.

Obviously, if a student is trying to operate beyond his or her window of learning opportunity -- zone of proximal development (ZPD) -- s/he is very likely to be frustrated and fail rather badly, even if there is a lot of help. Those who can only progress with considerable help -- "weak students" -- will be heavily dependent on the way a curriculum progresses, especially how it helps them find and fix gaps in their base of knowledge, or new gaps that emerge as the learning period progresses. The ones who have a strong base -- the "bright" or "gifted" students -- will easily learn with minimal support, but may then be held back as the class deals with the problems being encountered by "slower" students. That brings up the significance of "enrichment" and the need for individualisation at the high achievement end.

A subtlety here, is that when we construct assessments of learning, we may so emphasise recall and recipe based application to set-piece standard exercise problems, that at one level of study, students may seem to understand more than they do. Then, at the next level, where "real understanding" is actually needed to do serious analysis, creative designs and evaluations, they will predictably run into readiness problems. 

In short, because of defects or inherent difficulties in how we assess students (whether as part of feedback and adjustment of the learning process or as a summing up certification), students can seem to be more ready to learn onward topics than they really are. And, it is tempting to subtly downgrade the way a course is delivered, to make it "easier" for students, creating problems for later or parallel units of study. 

(BTW, this is why it is very important for an overall curriculum across several subjects and periods of study to be carefully structured so it is coherent and not too difficult for all but the "brightest.")

That brings up Richard Skemp's distinction between instrumental and what we could call insightful understanding (Skemp uses "relational"):
 It was brought to my attention  some years ago by Stieg Mellin-Olsen, of Bergen University, that there are in current  use  two  meanings  of  this  word.  These  he  distinguishes  by calling  them  ‘relational  understanding’  and  ‘instrumental  understand-ing’. By the former is meant what I have always meant by  understand-ing, and probably most readers of this article: knowing both what to do and why.  Instrumental understanding I  would  until  recently  not  have regarded as understanding at all. It is what I have in the past  described as ‘rules without  reasons’, without  realising that  for many pupils  and their teachers the possession  of such a rule, and ability to use it,  was
why they meant by ‘understanding’ . . .
That is, one of the challenges we have is to understand understanding itself. For, when we need genuine insight to move forward, but only have a memorise- and- use- blindly- because- it- works level of actual learning, we are setting up trouble. Which sounds uncomfortably familiar.

Especially, in situations where that sort of "practical knowledge" level of instrumental understanding is "good enough for government work." 

Boiling down, we can easily see a gap emerging between say O Level 4th and 5th form studies [Grades 10 - 11] and requisites for more sophisticated studies starting with A levels [6th form or Grades 12 - "13" the last being an effectively an advanced College level placement].

Sounds familiar?

It should.

How do we escape this trap?

The 2001 revision of benjamin Bloom's taxonomy of learning objectives for the cognitive [~ "academic"] domain, as presented as a table by Fisher of Oregon State University, will be helpful here:

Table1. Bloom's Taxonomy
The Knowledge Dimension The Cognitive Process Dimension
Remember Understand Apply Analyze Evaluate Create
Factual Knowledge List Summarize Classify Order Rank Combine
Conceptual Knowledge Describe Interpret Experiment Explain Assess Plan
Procedural Knowledge Tabulate Predict Calculate Differentiate Conclude Compose
Meta-Cognitive Knowledge Appropriate Use Execute Construct Achieve Action Actualize
Copyright (c) 2005 Extended Campus -- Oregon State University http://oregonstate.edu/instruct/coursedev/models/id/taxonomy/#table Designer/Developer - Dianna Fisher

In effect, we need to ensure that students are actually analysing, evaluating and creating, which requires that they be able to work with novel situations and topics. This is part of the valid reason for building independent research and projects in the curriculum. The challenge here, is that a lot of students will require "scaffolding" to help them do that, and we have to reckon with the evidence that only about 1/3 of adults in even "advanced"/ "developed" societies actually achieve Jean Piaget's formal operations stage of cognitive development.  Unfortunately, this is the precise level required for full mastery of logical and mathematical reasoning:

Even in "advanced" countries, only a fairly small proportion of the population achieve Piaget's formal operations stage of development, perhaps up to 30 - 35%
That brings up Piaget's model of how we come to understand, and onward, of how our cognitive abilities tend to develop, which he initially developed from his experience of working with young children as he realised that there are differences of kind in the ways children of different ages form and use ideas. As, at root, a biologist, he set his thinking in a biological context, where several stages emerge in succession as the child matures, and in part in response to the challenges of an environment. (This last becomes important to those who come after, especially for the transition to formal operations.) 

According to Piaget, two major principles guide intellectual growth and biological development: adaptation and organization. For individuals to survive in an environment, they must adapt to physical and mental stimuli. Assimilation and accommodation are both part of the adaptation process. Piaget believed that human beings possess mental structures that assimilate external events, and convert them to fit their mental structures. Moreover, mental structures accommodate themselves to new, unusual, and constantly changing aspects of the external environment. 

Piaget's second principle, organization, refers to the nature of these adaptive mental structures. He suggests that the mind is organized in complex and integrated ways. The simplest level is the schema, a mental representation of some physical or mental action that can be performed on an object, event, or phenomenon.
Let us glance at a summary of Piaget's stages, adequate for our purposes of forming a rough-cut model for doing some practical curriculum transformation for the digital age, rather than getting into the gory details of an academic study of Piaget's thought and that of the Neo Piagetians such as Demitriou:
Piaget identified four stages in cognitive development:
  1. Sensorimotor stage (Infancy [~ 0 - 2 yrs]). In this period (which has 6 stages), intelligence is demonstrated through motor activity without the use of symbols. Knowledge of the world is limited (but developing) because its based on physical interactions / experiences. Children acquire object permanence at about 7 months of age (memory). Physical development (mobility) allows the child to begin developing new intellectual abilities. Some symbollic (language) abilities are developed at the end of this stage.
  2. Pre-operational stage (Toddler and Early Childhood [2 - 7 yrs]). In this period (which has two substages), intelligence is demonstrated through the use of symbols, language use matures, and memory and imagination are developed, but thinking is done in a nonlogical, nonreversable manner. Egocentric thinking predominates
  3. Concrete operational stage (Elementary and early adolescence [7 - 11 years]). In this stage (characterized by 7 types of conservation: number, length, liquid, mass, weight, area, volume), intelligence is demonstarted through logical and systematic manipulation of symbols related to concrete objects. Operational thinking develops (mental actions that are reversible). Egocentric thought diminishes.
  4. Formal operational stage (Adolescence and adulthood). In this stage, intelligence is demonstrated through the logical use of symbols related to abstract concepts. Early in the period there is a return to egocentric thought. Only 35% of high school graduates in industrialized countries obtain formal operations; many people do not think formally during adulthood.
There has been a debate on how much of this development is empirically well warranted, and on how much is socially influenced, etc. It suffices to know that this has shaped further thought, and has established the idea of emerging stages of capacity linked to how fast we can process information to meet challenges or opportunities, how we organise and manage the processing, how much we can store in a working register [1 or 2 up to about 7 "units"] and in short term memory, the connexion (if any) to underlying "plastic" general intelligence -- and about how much this can be shaped by environment and experience --  and more. As I recall, there is some report of chunks of long term storage of up to about 50,000 items, that form the basis for expert performance, etc.

An excerpt from Adey et al, in the face of an intense political debate tinged by class-elitism and racial prejudices etc. (which they argue, can be moulded by environment and learning experiences . . . ), may help:
[W]ithout re-introducing general cognitive ability into the educational discourse, efforts at theorizing educational goals, setting standards and conceptualizing assessment frameworks cannot be successful . . . .  

If you ask teachers anywhere in the world what counts to them as a ‘clever’ or ‘smart’ response from a student, you get a remarkably consistent sets of characteristics (Adey, 2007). High in the lists of common answers are a set of essentially convergent abilities (‘thinks logically’, ‘applies knowledge from one context to another’, ‘demonstrates deep understanding of a concept’) and also a set of generally divergent abilities (‘creative’, ‘asks surprising questions’, ‘goes beyond the given’). These responses explicate professional, intuitive, experienced-based conceptions of general ability . . . .
[P]ractitioners’ conceptions of general ability always include features which require that the student make some sort of connection in their mind between, for example, one context and another, actuality and possibilities, or between data items such that a pattern is perceived. The professionals who are in the business of teaching and learning therefore see connectivity as a central characteristic of smart behaviour. ‘Connectivity’ here is used in the simple sense of the conscious or unconscious making of connections in the mind between one idea and another. In this sense, making comparisons, extrapolating, relating causes to effects, or the elucidation of any relationship between variables all involve connectivity . . . . 

[The ideas and findings of recent researchers] converge to a common denominator . . .  From the point of view of development, it reflects the brain’s and thus the mind’s increasing ability to construct and use goal-relevant and appropriate mental structures and skills and the responsiveness of the developing brain to environmental stimuli. From the differential point of view, it reflects the fact that differences between individuals in plasticity will eventually demonstrate themselves as differences in actual intellectual constructions and achievements.
In short, it is reasonable or at least a viable view to accept that there is an underlying general intelligence that supports both learning and performance, develops in a partly biologically grounded way and partly based on environment and experiences, which brings out the significance of education. 

But there is no sufficiently solid warrant for the formerly dominant view that sees intelligence as a fixed, genetically determined entity that is often obvious and correlated with certain classes, races and sexes, that then warrants an education system based on filtering off the sheep from the goats. Unfortunately, the 11+ Common Entrance system of education was based on this former view, and -- quite disturbingly -- in turn Sir Cyril Burt's separated twins studies that seemed to ground it, were based on questionable statistical investigations involving apparently cooked numbers and some of the collaborators listed may not have existed or were not what they were represented as.

Yes, there is some evidence of general intelligence and there is some evidence of diversity of intelligence in major domains. Highly gifted and talented people can have surprising gaps in their capacities, and there are autistic savants who are otherwise severely retarded but can perform astonishing feats of say arithmetic. The overall evidence is complex and the literature is even more complex.

However, as a supplement to the zone of proximate development model in light of Piaget's genral stages, it is well worth drawing on a learning and development oriented model by Andreas Demetriou (who was not only a professor of education but at one point Cyprus' minister of education!):

Demetriou's model of developing conceptual schemes in domains of learning and capacity
 As I look on this diagram in general terms (what we really need for our immediate purposes):

1 --> I see a growing, transparent model of something like a tree-trunk, with a core and rings, some of which are segmented. It is worth noting on the visual-spatial skills involved in reading this model:


a: I can "see" with my mind's eye not only the three-dimensional tree trunk, but I can make it become coloured and transparent, i.e. I am moving from the projection to a three dimensional mental image. (Someone I discussed this with said how for her, it could "pop" out of the page for a moment, then it would collapse back into being simply lines on paper.)

b: I can see the three-dimensional model in a vague back and over the head position normally, but I can move it in front of me, rotate it, watch it grow or shrink, etc.

c: I can bring up other elements such as the Vygotsky window diagram or the Bloom taxonomy, and compare and make connexions. (But usually just to one or two such at a time. Beyond that, details get fuzzy, though I can zoom. I can suspend several fuzzy related diagrams then zoom in on each in succession.)

d: I can make up a mental movie, that seems to float in a chiaroscuro, black background world with vivid colours. I suspect the colours bear a suspicious resemblance to the palette of an LCD computer screen

e: I suspect that from this I can make a storyboard, and could either make a video animation, or could use the pattern to construct an interactive simulation, with help in the detailed coding.

f: As a related exercise, I think about how I struggled at first to understand how the inverting operational amplifier circuit worked. For this, I found it very helpful to get a sheet of paper and draw the diagram, then play out the calculation that yields the gain expression.  That tells me a limit on my personal mental chalkboard. Here, courtesy Wiki [I feel too lazy to draw it this morning], is the inverter circuit, where the triangle is the amp, the lines are wires and the zig-zags are the resistors:




g: I then put the Bloom taxonomy next to it. Recalling and recognising and correctly placing the elements in the diagram was simple, and so was recalling that Ohm's law, the summing point restraints that say that the feedback network drives the voltage between the differential signal input terminals to zero, while the terminals do not draw any current. Here is a model of the idealised innards of the amp, also showing power supply terminals but leaving off offset and compensation terminals or the like:




h: I then saw that the derivation that moves from that to deriving the gain expression requires Bloom's analysis. That analysis requires significant algebra and ability to interpret electronic circuit symbols in light of a graphical-algebraic model. So, probably there were weaknesses there when I first met this diagram and the related analysis.

i: Going on to understand how to "take out" the idealisations requires evaluation of the weaknesses involved and a fair understanding of the innards of the op amp, which is usually based on some sort of long tail pair differential amplifier driving gain and power stages. (The linked diagram is for the classic 741.) In Integrated Circuit (IC) op amps -- and to follow the pinouts of the chip package is itself a little exercise in several levels of reasoning -- there are often current mirrors, which requires some understanding of IC creation techniques.  The realities of these techniques drive the behaviour of real world as opposed to idealised op amps. (This in turn leads to the value of chopper stabilisation and other modifications that improve behaviour.)

j: I then could generalise the derivation, to deduce integrators, differentiators, logging and antilogging amps, filters, oscillators etc. Real world considerations then ground design of practical circuits that have to work in the practical world, e.g. I remember being puzzled at first by how we move from having a ratio of resistances etc to a good practical value from the various series of standard values.  (As a couple of rules of thumb, a reasonably high resistance will not load input transducers or stages over-much, but too high a resistance brings to bear noise and parasitic filter effects that can undermine a design. If you want precision, count on having to pay for high quality, low tolerance components. Don't expect to find wound components that will be precise. But, there are op amp circuits that can simulate their behaviour; if you absolutely need such in an instrument.)

k: This shows me that capacities from earlier learning do make a difference to how one can progress in a new area, and that analysis and evaluation do often precede design or genuine creation. (Canned cookbook designs based on following the usual cookbooks or magazines etc don't count. Of course, all too often often cookbook designs may not work with the particular cluster of tolerances in a given circuit and it has to be fiddled with through debugging or troubleshooting.)
2 --> Back to the Demetriou diagram. There are four main stages of growth as can be seen on the left. We start with Piaget's sensorimotor stage then we begin to "see" relationships, reaching stage 2. This is also the stage where we first begin to use and develop symbols and related concepts and organised systems of concepts etc [i.e. Piaget's schemes], especially through language.

3 --> Three-dimensional spatial thinking and abstract thinking follow, at stages 3 and 4. It is obvious that it is much easier to deal with these concretely with physical models at first, then use computer simulations to gradually build up mental visualisation capability. After that, sketches on paper etc can be mentally transformed into the mind's "Star Trek 3-D holodeck"! (H'mm: watching star trek as homework . . . )

4 --> The squiggles in the right hand wedge on the disgram show the emergence of Piaget's schemas, connected networks of concepts etc.

5 --> At first level, concepts are abstracted from experiences, and become a basis for further abstractions to form a network. 

6 --> When our schemes are accurate and useful models we can say we have formed good and insightful understandings.

7 --> As a bonus, we have a handle on why models, simulations and theories are so important in science, and a glimpse onward at the significance of worldviews.

Much of the educational challenge before us, we can now see, comes in the need to develop new stages of ability to form abstractions, and thus from the intersection of the different wedges with Vygotsky's zone of proximal development. For, it is gaps in the underlying framework of knowledge, understanding and skills that so often lead to failure as onward stages of learning call on the higher order learning that Bloom identified, and which may well not be there.

So, we have scoped out a picture of areas we need to work on if our curriculum transformation efforts are to succeed.

The creation of interactive supportive learning structures with  the ability to adapt to the needs of individual learners, also emerges as a vital capacity for educational transformation. This points straight to the importance of the multimedia, web connected computer as a major educational instrument. Indeed, maybe many of the more knowledgeable others in the learning activity space will be coming to us digitally!

 And, given the high tech digital world we now face, we have to try for such a transformation. END

Tuesday, August 14, 2012

Capacity focus, 55a: Spotlighting the Benjamin Bloom Two-Sigma "problem," as a step towards educational reformation towards widespread mastery-based learning

(Two Sigma/Digital learning transformation series 
 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12  )

Last time, when we looked at Daphne Koller's TED talk, we highlighted a pivotal 1984 result from famous education researcher Benjamin Bloom, the Two-Sigma "problem":

The two-sigma challenge: the effect of mastery approaches (cf. here & here also) and individualised, interactive, high-feedback, highly responsive and flexible learning processes

Here, we see how students taught in 1:1 or very small group tutorials using methods that emphasise mastering content step by step, outperform those taught in conventional classes to the point where a "C-student" would get an A, and 98% of students taught that way would be at or above the level of performance of the top 20% of students taught conventionally.

That has significant implications for how we usually think about education approaches, resulting student performance and the "bright" vs. the "dunce." 

(Including, the vicious spiral of frustration, inappropriately pigeonholing some students as "hopeless" for a given subject, and failure. Thence, wasted potential capacity relevant to -- or even crucial for -- development of our region. And, while it is common to point fingers at today's teachers who are always seen as not as good as those who went before [they were saying much the same 20 years ago, too, and they probably will say the same in twenty years time], it also points to the way we set up and operate education as an organisational system.)

Wiki, in its article on the two-sigma issue, has an apt, pointed summary:
Considering the significant outcomes of these studies on student performance, educational researchers can make a number of implications and conjectures for follow-up studies. Among them:
  • Labeling students as low achievers is less relevant, since altering one or two variables can have significant positive effects on the average learner.
  • Technology may simulate tutoring affects without the high cost of providing a live tutor for each student.
  • Social aspects present in one-to-one tutoring may imply a larger role for consideration of sociality in (or the social nature of) learning.
A blogger at Incremental Thought has captured some of my own feelings:
Bloom wrote:
“The tutoring process demonstrates that most of the students do have the potential to reach this high level of learning.  I believe an important task of research and instruction is to seek ways of accomplishing this under more practical and realistic conditions than the one-to-one tutoring, which is too costly for most societies to bear on a large scale.  This is the ‘2 sigma’ problem.”
I had three immediate reactions to Bloom’s statement.  First, I am more determined than ever to be heavily involved in tutoring my children regardless of whether we go with a home school, private school or public school approach.  Second, what does it say about our society that even the home cannot be a “safe bet” for one-to-one tutoring?  Regardless of the reasons, I am troubled that an entire value system has been built that deems it “too costly” for us to bear.  I wonder what the general attitude and level of education in our nation would be if families didn’t assume that education was something to be outsourced to an already overburdened and complicated public school system?  Third, it struck me in the context of workplace mentoring.  How often do I make myself available to be a mentor for junior software developers?  How often am I seeking out other senior developers or managers to mentor me?
Another blogger, at isegoria.net, remarks:
My first reaction is surprise at the degree of the effect, but it should be obvious that advancing 30 students in lock-step means that many will be bored, a few will be in the sweet spot, and many will fall further and further behind, as the material builds on previous material they never learned.
So, my conclusion would be that conventional classroom teaching is largely a waste of time — but that’s not where educational experts place their emphasis:
Although much recent attention has focused on gaps in the achievement of different groups of students, the problem has been with us for decades. This paper presents the problem as one of reducing variation in students’ achievement, and reviews the work of renowned educator Benjamin Bloom on this problem. Bloom argued that to reduce variation in students’ achievement and to have all students learn well, we must increase variation in instructional approaches and learning time.
I suppose they see it as Bloom’s Paradox.
In his original paper, Bloom notes that a full-size classroom can get one-sigma results by switching to mastery learning, where students are tested not just for a final grade on a unit but to uncover where they need to do further corrective work, so they keep at it until they get it right . . . .

It is odd, when you think about it, that we give students As, Bs, and Cs, and then advance them all to the next course, when they really should study the material until they earn a solid A before moving on — unless the goal of education isn’t conveying information but ranking students.
Now, you may wonder why I am highlighting the thoughts of bloggers who have happened on the results, instead of going to the professional literature.
I do so to highlight that a common-sense look at the data (which seems to be widely accepted by educators, though how they package it is of course in light of their own systems of thought and agendas) leads us to wonder what has been going on, and to think that maybe we need to change.

Yup: we need to change.

Which is always going to come up against all sorts of resistance and inertia that blocks or slows down change, sometimes for very good reason. Change is not a good in itself. (We need the right sort of change, and we need to be able to recognise it for what it is.)

But too often we stoutly, even angrily resist changes that are credibly beneficial for reasons that -- once we walk away from the power systems that prop up the conventional wisdom and actually listen to external stakeholders -- cannot stand the light of even basic common sense reflection.

This has the potential to be one of those cases.

So, we need to think very carefully indeed about what the research is telling us, and about what the digital technology revolution may be opening up for us. 

(My agenda is of course the AACCS, but I am very interested in what is going on in secondary and primary level education as well. Not least, because the bridging studies, second chance secondary education component of the proposal, has to address finding and plugging the holes in the education of a good slice of the 80% or so of our region's young people who complete secondary level schooling -- as opposed to learning or education -- without an adequate level of certification or (much worse) actual useful and permanently acquired learning. I am also frankly concerned that our region may be drifting into a state where we are by default schooling our youth to become hewers of wood and drawers of water in a high tech digital age. [Note my suggestions here and here. Also, here, as a way to get out of thralldom to the major digital empires.])

As a step, I suggest that the astonishing potential impact of 1:1 tutoring is not so much in that itself, but in what it naturally promotes, a highly interactive, personalised, rapidly responsive, high-feedback and adjustment learning environment. (And BTW, I want to suggest that for certain strategic interventions, we need to have 1:1 or small group tutoring on the plate as key interventions. This also points out one of the reasons why cell groups and small work teams can be very effective, i.e. the high interactivity promotes effectiveness.) 

So, let us now look at a table of useful interventions investigated by Bloom et al, as presented by Vockell of Perdue, redoing the table highlights to better reveal a pattern:
Bloom proposes the impressive but possibly attainable goal of trying to make group instruction as effective as individual tutoring. Bloom identifies several alterable variables that have been shown to provide a partial "solution" to this two-sigma problem.
Note that this emphasis on the two-sigma problem does not contradict the importance of academic learning time [--> ALT, aka "Time on Task"] discussed earlier in this chapter. Indeed, the main reason these strategies have such impact is because they promote the effective use of academic learning time.
Table 2.7 lists modifiable factors that Bloom found to be related to enhanced learning. Note that on Bloom's scale a score of 2.0 indicates the level of improvement that would occur under individualized tutoring. This is Bloom's "ideal" score, and other pedagogical strategies can be regarded as effective to the extent that they approach this ideal. For example, when teachers assign homework, there is an average effect size of .30 compared to similar classes in which there is no homework assigned. When teachers not only assign but also grade homework, there is an effect size of .80 compared to similar classes in which homework is not assigned.



Table 2.7. Selected Alterable Variables That Influence Student Achievement
Effect Size
Percentile*
Strategy
 2.00
98
Tutorial instruction
 1.20
86
Reinforcement
 1.00
84
Corrective feedback
 1.00
84
Cues and explanations
 1.00
84
Student classroom participation
 1.00
84
Student time-on-task
 1.00
84
Improved reading / study skills
.80
79
Cooperative learning
 .80
79
Homework (graded)
 .60
73
 Classroom morale
 .60
73
Initial cognitive prerequisites
 .50
69
Home environment intervention
 .40
66
Peer and cross-age remedial tutoring
 30
 62
Homework (assigned)
 .30
 62
Higher order questions
 .30
 62
New science and math curricula
 .30
62
Teacher expectancy
 .20
58
Peer group influence
 .20
58
Advance organizers
.25
60
Socioeconomic status (Included for contrast - SES is not easily alterable by teachers.)
*The percentile indicates the percentile at which the "average" student would typically score if he/she received this treatment instead of "traditional" instruction. (Ordinarily, the "average" student would score at the 50th percentile.)
(Adapted from Walberg, 1984)
 Vockell (1994) has reversed Bloom's logic and has discussed the "minus two-sigma problem." He reasons that if teachers teach really incompetently, they will lower students' performance by an effect size of 2.0. (Having no teacher at all could be perceived as the opposite of having an individual tutor.) He suggests that various activities in which teachers sometimes engage hurt student performance to the extent that they approximate a truly do-nothing teacher.
Plainly, nothing can replace the impact of the highly interactive small group or especially one on one tutoring. 
[--> hint, hint on the importance of "cell groups" for discipleship and ministry training . . . similarly on organisation by "squads" led by competent and committed "NCO's" in getting capacity built through training and in getting effective work done . . . ]
However, a combination of interventions that promote interactive, active learning, that diagnoses and addresses gaps in required base, as well as responds to the diverse ways people learn, can make a big cumulative difference. We should not overlook the impact of time on task, graded homework (which motivates effort and provides hopefully rapid feedback) and enhanced reading and study skills. 

This last may help explain a puzzling experience I had in teaching High School physics: one of the most effective learning interventions I made was to spend time in the classroom simply reading the textbook with students in rounds, paragraph by paragraph -- randomising who reads next -- and then pausing to discuss what we were reading and to work through examples interactively.

I now think that one factor at work was that students probably often find reading the textbook on their own a dreary, boring and often puzzling exercise that therefore naturally gets postponed again and again [until the "cram before the exam" rush which drastically shifts degree of motivation . . . ], reducing the book to a repository of homework problems. Which then became much more difficult challenges.

Interactive group work with people one likes probably dramatically enhances enjoyability, and it also sets up interaction, feedback, and mutual support and accountability. Video, animated computer simulations and multimedia would multiply that effect. However, I have more than enough experience of student project and study groups where one or two of the students seemed to be carrying a circle of free-loaders with them to think that small groups are a cure-all.

Can I plug for the homework notebook that can form a point of step by step accountability over work assigned and done, at home and school alike?

Similarly, can I point out the advantages of the three-ring binder file folder with well-divided sections as a way to organise work, notes etc? (If one is worried about students losing pages, if spiral notebooks are inserted you can get the best of both worlds, or one can punch three holes in manilla file jackets and affix folder sheets using treasury tags. That forms a sort of flexible notebook in a file jacket. Cf. here. Another trick is to use shoelaces or the like and cut and punched cornflake boxes to stack and tie together clusters of folder sheets or three-hole punched computer printouts into simple, mechanically bound "books." That gives a handy permanently bound reference book, on the cheap.)

I also plug for one to two page diagram-heavy handouts that students can work through and read. Indeed, I have come to a point where I routinely prepare a 1 - 2 pp summary handout for classes I taught, written up like a magazine article. Cf here for an example. One possibility here is to use blogs to present course summaries for reading, with use of discussion fora for student interaction. I am now seriously considering Disqus as a managed blog forum technology, in a world where there are trolls. However, discussion fora can be hard to manage. [Commenting in this blog has been suspended due to troll and hate site activity.])

The next major cluster is the process of chunking and sequencing the scope of learning so that students can build, test, debug and correct then successfully master and apply knowledge and skills in manageable steps in a context where they also have the big picture thanks to a well-structured introduction. The significance of cues and explanations on this should not be overlooked.

All of this is pointing to the significance of a group-oriented, individually responsive and adaptable, interactive, media-rich, easy to use digital learning platform as a powerful base for moving education towards the two sigma result envisioned by Bloom.

 Hence, the potential of the 7" Android tablet in a folio with its own keyboard for perhaps US$ 120, as already highlighted in this blog. Let me show a typical picture yet again -- my Mom long ago stressed how it takes about ten exposures to break through the filters that block out messages in our environment:


But, again, it is not just a matter of getting machines into students' hands and expecting magic to happen: the above tablet is also a great gaming machine (or worse, a Youtube and porn viewing or Facebook etc machine . . . ) and students who zone out may be using this to waste their time. That is where the use of an interactive, tutor facilitated structured step by step learning process with accountability through needing to do and present effective work becomes key.

That's not all: we are here implying a considerable developmental effort to get together digitally based training materials that work in support of the sort of learning we need. That will call for educators, it will call for techies, it will call for research to ascertain and incrementally improve the needed features for maximum effectiveness, and more.

It will call for a fair degree of financial investment too.

But the alternative needs to be considered in light of its destructive consequences.

I think it was the United Negro College Fund of old had a saying that is apt: if you think education is too expensive, you need to consider the cost of ignorance. END