Don't Let Data Drive Your Dialogue by Dr. Bruce Beairsto

Don't Let Data Drive Your Dialogue

Dr. Bruce Beairsto
4 November 2010

Figures often beguile me, particularly when I have the arranging of them myself; in which case the remark attributed to Disraeli would often apply with justice and force: ‘There are three kinds of lies: lies, damned lies, and statistics.’” - Mark Twain

Why should our dialogue be “driven” by data? I certainly understand that data can provide a provocation, challenge, affirmation or contradiction that sparks dialogue - but why should it “drive” that dialogue? Data itself has no meaning, until it is organized and displayed in charts or graphs that can be interpreted, usually in multiple ways. These interpretations may usefully inform our dialogue, decisions and subsequent actions so data definitely can be valuable, but it often seems to be granted undue reverence simply because it is numerical. Although insight can derive from analysis of data, equally it can arise out of intuition and, in fact, I wonder if some analyses are not actually rationalizations subconsciously imposed on data to justify intuitive speculations.

The notion of “data-driven dialogue” was introduced to counter the perception of an excessive reliance on unjustified opinion and personal preference in educational discourse. I think this correction was required and believe there is more work to be done to reduce the aversion to data that still exists for some. However, evidence can take many forms and wisdom has many roots. All should be valued. Numerical data is only one form.

Some not only revere numerical data but argue that data is only useful if it is derived from the self-declared “gold standard” of randomized controlled trial methodology - for example, the American government’s What’s Working Clearinghouse has this bias. This fanaticism arises from a hyper-rational perspective on human experience. Positivist science can be highly informative, but I cannot imagine why one would not also welcome the insights that have been distilled from experience through more qualitative processes.

At the school level, richer insights will arise through triangulation based on multiple methods than through any one avenue alone. Data should be used to inform our dialogue at every opportunity but it does not speak for itself. Data is created through an imperfect and incomplete recording and codification of experience and only acquires meaning through fallible human interpretation.  

It is in this interpretive process and in the subsequent discussion of what to do about what one has learned that dialogue is required, and this dialogue is the process through which understanding is constructed and commitment to action develops. Data informs the dialogue but does not determine its outcomes. The insights, questions and perspectives that teachers bring to the interpretive process are the source of its power and consequence as much as the data that instigates the dialogue.

So let’s not let data drive us, but also let’s not denigrate it. Professional dialogue is more powerful when it is informed by evidence of all sorts, including numerical data, as well as the intuition and wisdom of experience.

Views: 275

Comment

You need to be a member of School Leadership 2.0 to add comments!

Join School Leadership 2.0

Comment by Katie Zahedi on November 25, 2012 at 11:56am

Well said!

As a principal charged with implementing the APPR, I am often speechless at the absurd conclusions that we are asked to derive from discrete bits of data (such as test scores).  The U.S. infatuation with data is embarrassing! If  we are "driven" by anything, it should be sound educational philosophy based on sage experience. Isolated batches of data should only contribute to the more general picture.

JOIN SL 2.0

SUBSCRIBE TO

SCHOOL LEADERSHIP 2.0

School Leadership 2.0 is the premier virtual learning community for school leaders from around the globe.  Our community is a subscription based paid service ($19.95/year or only $1.99 per month for a trial membership)  which will provide school leaders with outstanding resources. Learn more about membership to this service by clicking one our links below.

 

Click HERE to subscribe as an individual.

 

Click HERE to learn about group membership (i.e. association, leadership teams)

__________________

CREATE AN EMPLOYER PROFILE AND GET JOB ALERTS AT 

SCHOOLLEADERSHIPJOBS.COM

FOLLOW SL 2.0

© 2024   Created by William Brennan and Michael Keany   Powered by

Badges  |  Report an Issue  |  Terms of Service