Putting a face on Data (aka ‘How NAPLAN can be your friend…’)

“The single most important factor common to successful change is that relationships improve. If relationships improve, schools get better.”(Michael Fullan)

“…in order to build success in schools, we need to see the data not as numbers but as the names and faces of every single student” (Sharratt and Fullan in G Whitby, Bluyonder, 30/4/12)

Over the past few months, I’ve presented the following information to a few different groups. In preparation for a small group workshop this week, I thought I’d finally follow through and write up the process…

Part of my current role as a LOP is to ensure that a number of students have a functioning Individual Education Plan – IEP – (students who are at or below benchmarks for Literacy and/or Numeracy (NAPLAN), new arrivals to Australia from a non-English speaking country, deemed at risk by the school, and/or from an ATSI background). Last year, this meant 1:1 meetings with 47 students and their parents, and subsequent feedback to teachers regarding student learning needs and implications for classroom teaching. I don’t like doing anything for the sake of ticking a box, so whilst last year’s process was good in terms of the value of the parent/student dialogue, this didn’t necessarily translate into changed classroom practice.

I was also struggling to get any traction around what the data was telling us in terms of student literacy needs. I could put up the numbers, jump up and down, even plead, but they were just numbers…

This year, I wanted to explore something that would be manageable for me (given there would be 137 IEPs required), but primarily more meaningful for the kids and the teachers. I had also read Greg Whitby’s post about “Putting a face to data” and that resonated with me. I crowd-sourced (thru emailing LOPS) who was doing what for IEPs. My lovely friend Jenny (@jcsymington) offered a process she had started involving Learning Surveys with all students. With permission, I pinched her survey and got started. Here’s what we did:

All students were asked to complete the Learning Survey. (Not perfect, but gave us a good overview of students needs, wishes, successes, etc.) We used google forms because this meant we could translate the data into graphics, but also convert the data into an Excel spreadsheet so it could be sorted. One of the survey questions explained that some students would have a follow-up survey and asked students to nominate a particular teacher for this process, should they be chosen.

The results of the Learning Survey itself were shared in list and graphical form with middle leaders – both Pastoral (Year Coordinators) and KLA (Subject) coordinators. Text-based responses were collected in a word document and captured in a Wordle to emphasise more common responses. The conversation at that level around what students reported was quite healthy – what they did to achieve their “proud moments” (most common answer, ‘work hard’) and what they struggled with (literacy, answering questions).

The next step was to involve ALL teachers in one-to-one “Individual Learning Conversations” with the students identified as needing IEPs. I set up a secondary survey, also on Google forms, which would give us more specific information about how these students in need were learning, and what they self-identified as helpful for them. Teachers were introduced to the process at a staff meeting where we talked through possible scenarios and talked about setting the scene, warming into the survey (small talk, etc.)

Using the data from the first survey, exported to Excel (“File/Download as/Microsoft Excel”), I was able to create a mail-merge document to provide each teacher with some background information on their allocated students. (Before this process, I had NEVER mastered mail-merge, but googling “how to’ made it doable for a tech flunky!) Teachers were given approximately four weeks to conduct the 10-20 minute survey with their allocated students. Teachers could do the learning survey on paper, and upload results at a later time, or they could complete the survey online using their laptops whilst talking to the students. Teachers were cautioned about merely administering a survey – the point was to engage in dialogue and make a connection with their students.

During the Individual Learning Conversations, students were asked to identify what aspect of school or study they found most difficult, what strategies or approaches teachers used that were helpful, and they were also asked to nominate things they could do to help themselves.

The students reported in general that time management, reading comprehension, grammar usage, career assistance, and use of academic English were areas of primary difficulty. What they appreciated most in a teacher were clear feedback, demonstrations, checking for understanding, modelling of writing, and “having fun with us”.

Using the data from this second survey, graphics and text summaries of student responses were collated (“Form/Show summary of responses”). This collated data formed the basis for a subsequent staff meeting where teachers not only examined the data, but asked questions of it: Questions to ask of data from Student Learning Conversations. The teacher feedback was also collated and shared and used to inform planning and dialogue at faculty and middle leader levels.

Sorry this is getting a bit long here, but it WAS a valuable process! The data and feedback informed subsequent professional development around meeting student learning needs. It was also used to inform pastoral programs for the coming year. The teachers’ exposure to individual students and their learning needs paved the way for a deeper reflection on the 2012 NAPLAN results and subsequent planning/programming/professional learning. It was  a long process, but putting a face to data in this manner helped make the connection between the numbers and the kids behind them. Teachers want their kids to learn. This process made that connection more real, and added to the quality of many student-teacher relationships as well.

But wait! There’s more! The second survey data was ALSO exported into Excel. The data this time was used in the following ways, depending on the audience for the information:

  • merged to create profiles on individual students who received specialist support
  • merged to provide information about Year 7 learning needs and approaches for a consultant working with the school
  • merged to provide ALL teachers with Individual Learning Profiles on the students in their own classes
  • merged into letter to the parents to inform them that their child had had a Learning Conversation, results/goals/what helps them – and suggestions for what the parents might do at home to assist their child.

It was a less than perfect process. Teacher feedback indicated it would be valuable for ALL students to have the second survey and conversation, but time constraints were an issue. Teachers generally preferred completing the survey on paper and later entering results online as the laptop served a physical barrier between student and teacher. The process needs to be started earlier in the year so the data can be used in more meaningful ways. Information sharing with parents would be better face to face at parent-teacher interviews, for instance. But on the whole, it was a successful approach. It was a way that we used the NAPLAN data NOT as a means to condemn or label, but as a means to leverage real conversations, leading to real adjustments and real awareness of the needs of individual students in our care. NAPLAN can be your friend when it is used to look at the individual faces behind the numbers…

To finish – quotes from two of the teachers involved:

“I like having that rapport, that one on one, they can see that someone else cares about their learning.  The care is really important. But we can’t just do this one off. We need to check in; it will be really important to keep that connection in the long run.”DT

“It was such a powerful experience, having that sort of a conversation with students about their learning. And when they would say, ‘Mrs So and So really helps me when she does this or that,’ I could then go back to that teacher and pass on the positive feedback. This really helps create a community of learners and contributes to great conversations about students and their learning.”JD

What are your thoughts? Would love to hear from you!

Advertisements

7 thoughts on “Putting a face on Data (aka ‘How NAPLAN can be your friend…’)

  1. Hi Denise,
    I agree with what you say. NAPLAN data can useful if used wisely. I really like the process you are using to create your IEPs – the online data collection is a great idea and the survey questions are excellent. Thanks for all the links and info too. I’m in the process of developing a better system for creating IEPs at my school too – this couldn’t have come at a better time!

    • Thanks for that, Corinne. I wanted to share the process more broadly because it worked well for us, but also because the process has the potential to be tweaked to suit so many different contexts. Hope it helps, and if you want any more help or templates or anything, just yell out!

  2. Thanks for taking the time to share this. Your work is an inspiration. I hope you know how grateful I am to you for sitting with me and explaining the process. We are ‘first followers’ of the work you are doing.
    The responses from the teachers is perhaps the most powerful aspect. You have changed their beliefs and perceptions which, as we all know, is the key to sustaining improvement in our schools. Your energy and drive is truly astonishing so the question is … ‘Where to next with ‘putting a face’ to data at DLS?’ Please keep me posted.

    • Thanks, Penny. As you know, it all came together and worked well, but not by design! There are many things I’d tweak for next year, but the response from the teachers is where the value lies – changing hearts and minds, making connections. Thanks again for your support and kind words!

  3. Denise, great work collaborating with colleagues to have those guided conversations with students to better understand their learning needs. There’s so many benefits to this process – it builds the social and decisional capital that Andy Hargreaves talks about, provides good data to inform practice and strengthens the relationship between teachers and students. Look forward to following your journey with it.

    • Many thanks for your comments, Greg. My own practice is truly enriched by reading what others write and sharing with others what they do – and this process was definitely the result of many influences, including your own posts. Thank you for taking the time to comment… will keep you posted how it goes with round two and adjustments next year.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s