Neil Allison presents part 3 of his 3 part investigation to uncover more about the problems of poor coherence in student writing, particularly East Asian writers. This post summarises the experiments/tasks he used in class and the observations and implications for student awareness of and improvement in writing coherent texts.
You’ll recall, if you read my previous 2 posts on Coherence (Part 1 and Part 2), that I have been puzzled for some time about the ‘logical’ structuring of ideas in east Asian student writing in English. I mentioned at the beginning of post 2 on coherence that in order to solve the puzzle I was following (slightly clumsily) a sort of action research process of: plan – act – develop – reflect. Here’s a bit more information:
Plan: in basic terms, a kind of puzzle identified from observing hundreds of Chinese English learners’ academic writing where their level is 5 to 6.5 i.e. the type of students I encounter most on pre-sessional or in-sessional University courses. However, I didn’t read the literature at this stage (more on this in a minute).
Act: carry out an experiment in my lab (classroom) on the guinea pigs (the students), being careful to ensure no one is harmed. Then, read the literature.
Develop: Based on a comparison of findings between the two sources of information in the ‘action’ stage above, develop an approach to teaching or improving student coherence in academic writing.
OK, so why no literature review during the planning stage? Two reasons: The first one will resonate with most of you, readers:-
- On a busy teaching load it’s extremely difficult for university tutors/teachers to take a highly structured approach to any of their research. It’s possible, but my feeling is that you’d be at it so long, the moment would be lost or you’d move onto something else before you completed it.
- Kolb’s learning process and the styles developed by Honey and Mumford lead me to label myself (if required) in the ‘accommodating’ category, meaning I’m the kind of person that tries to build things without instructions and learn the hard way.
Let’s look at what I actually did and what I found out. If you’re in a hurry, jump to the bold statements at the end of each activity, entitled ‘general comments and coherence remarks’. For succinctness I’ll skim over the experiment design, which was slightly ad hoc but made some attempt to isolate independent and controlled variables, so the dependent variable – COHERENCE – was measurable. This attempt wasn’t particularly pure though because I allowed other things to drift in, so that I ended up with a lot of material for further research (primary and secondary).
- What seems to cause poor coherence in Chinese students’ writing
- How best to explain to students what coherence actually means and why it’s important?
- How interesting for students are the activities that are supposed to improve coherence?
- Do students think their writing coherence is improving?
- What can the above tell me so that the next writing course I teach can more efficiently train students in improved coherence, assuming it is even possible to train such a thing.
Here’s what I did. I’ll arrange this as follows: Brief summary of what I did in class (without any theory or justifications; feel free to ask about that if you want); key finding.
The class, by the way, had 12 students: 7 Chinese, 1 Japanese, 4 Arabic speakers.
Activity 1 (week 2 of the course)
- Students did reading on learning styles in English. They read a text in their student book and also similar info from a website.
- Students wrote on the same topic in L1 (inspired by statement by student in class that he would be able to explain to another Chinese student what the English texts were about in Chinese, but not in English). They were to bring these L1 texts to the next class.
- Next class, we looked at linking words and how they related to coherence and cohesion in IELTS assessment and then students identified their use of linking words (adverbs, prepositional phrases e.g. however, in terms of) in their L1 texts.
- We counted the linkers in their texts. In 100 word texts, average number was 6 though just Chinese it was less than 5 average.
- Students considered the meaning of these discourse markers (translation to English) and whether
- there were a variety of options in their language as with English e.g. but/however/whereas;
- there was a difference in ‘register/style’ between these options.
- We discovered that students weren’t really able to see a distinction for register/style in their translation media e.g. between consequently and so.
- We used wordandphrase.info to consider formality/academic style
- Students translated all their text into English.
- We highlighted examples of informal grammar that came out of the translation.
- I used socrative to gather feedback on the activity. 11/12 enjoyed translating and 12/12 thought it was useful.
Students enjoyed writing in their language and translating. They also thought it was useful. Reasons for it being useful were thinking about formality and risks with translation. Some thought translation was interesting and useful because they were getting writing practice.
Nothing major. Linking words seem to be used frequently in their own languages. Really, this activity became an academic register comparison with L1 domain focused on linkers (cohesion).
Activity 2 (week 3)
- Students read text about bees.
- I gave students an outline (basic notes) of the bee text (to control the type of information they took from the text).
- Students wrote a paragraph based on the notes but translated (into their language) and made it as ‘academic’ and well written as possible.
- I presented an example of theme and rheme (and constant and linear progression) and topic sentences (to be first sentence of paragraph).
- Students identified theme rheme (known – new) and topic sentences in their translated (to L1) texts to compare the pattern in their text with the presented one.
- I asked students on socrative if they had an idea how to take ideas from this lesson to improve their writing. I gave them the following options
- I don’t need to change my writing process/approach
- I need to change my approach and the best option would be
- I should plan my writing in detail, making notes first and at that stage thinking about coherence
- I should write as normal but then review each paragraph for theme and rheme
- I should write/think in my language first, then translate
- Something else
Students enjoyed translating (10/12). 7/12 students thought that reviewing theme/rheme and topic sentences after they’d written something was the best thing for them to improve coherence. Other felt they have no particular issue with coherence.
I imagined that thinking first in L1 might improve coherence as it would reduce demands on short term memory/reduce levels of cognitive load. Sadly, I can’t judge this based on one experiment and would possibly want to try this activity with different groups, sometimes thinking in L1, sometimes L2.
Activity 3 (week 3)
- Students wrote a fairly controlled text: data description with speculation. It was controlled in the sense that the first part was describing two items in the data, the second part we brainstormed on the board so they can chose key points/ideas from there.
- After writing, revision/ presentation on theme – rheme
- Students placed a ‘C’ above any part of their text where they were concerned they hadn’t followed the thematic progressions constant or linear.
Students often put C’s in places where there were no coherence issues and generally coherence was fine. Perhaps this was because the text was pretty controlled, so cognitive challenges were less and lower demand on working memory.
Activity 4 (week 4)
Its aim was to test whether higher cognitive challenge saw decrease in coherence.
- Students wrote an essay at home on effect of technology on young people.
- I selected two Chinese students (Student Tea and Student Coffee) for follow-up interview because both these students had weaker coherence from classroom activity 3 and an earlier essay task prior to any of these activities, and also because one student, Tea, now had good coherence, the other, Coffee, still not.
- I interviewed these students.
Tea had good coherence. She brainstormed and thought in Chinese, then wrote in English. She spent 1 hour. Student Coffee spent 40 minutes, thought and wrote in English. Neither student reviewed their texts for coherence or even gave it explicit thought. Neither did a detailed plan/outline.
The biggest issue with Coffee text was poor topic sentences. We discussed whether topic sentence should be a detail/more specific than the rest of the paragraph. Both she and I thought it should be more general. However, we disagreed what her ‘topic sentence’ was: I thought it was more specific than the second sentence, she disagreed!
Activity 5 (week 6)
I gave a writing task that a) was conceptually complicated and b) was brainstormed and written without translations (no use of L1 in brainstorming or writing, although dictionaries used in actual drafting stage) c) written under time pressure i.e. increase pressure and cognitive load.
- Students brainstormed on a complicated essay topic.
- Students wrote paragraph 2 i.e. body paragraph 1.
- Students put under time pressure: 15 minutes to write their paragraph
- Students wrote again on separate pieces of paper each of their sentences but removing any discourse markers and replacing any referencing and substitution with repetition. Repetition to be highlighted, underlined, so that later it was easier to follow theme rheme, though focus for this activity was mostly topic sentences.
- Essay passed in pieces to partner who put them in order. Then check with writer if it was correct.
- Investigate whether there is agreement on the topic sentences.
- Feedback via socrative.
10/12 students enjoyed the activity, one neutral, one negative. The neutral one felt they didn’t learn anything new and the negative one had become more confused.
Activity 6 (week 8)
Students asked to make notes to help define coherence 6/12 were able to do so adequately i.e. including theme/rheme; order of ideas; topic sentences. 3 were unable to do anything. 3 were confused with cohesion and wrote phrases such as ‘discourse markers’, ‘linkers’, ‘pronouns’.
3 of the Chinese students were slightly (or very) confused about suitable topic sentences – they often selected something that was too detailed.
Activity 7 (week 9)
Students produced a timed writing that they had the opportunity to brainstorm on at home. Topic was There are many ethical and legal issues associated with information technology and the use of computers. Briefly summarise a range of these issues and then outline one specific issue and evaluate the impact it has on different stakeholders. You must focus only on 1 context for this essay e.g. a particular type of workplace (hospital, government agency, law firm, medical research laboratory etc), university, school.
Students were given the macro structure so the remaining independent variables were writing under pressure and producing grammar and vocabulary. Students were asked to put a ‘C’ next to sections of their completed essay that had C&C concerns about and give a key word or phrase e.g. topic sentence, linker, etc.
Students put lots of C’s but mostly related to topic sentences. Chinese students (5/7) said they were not confident their topic sentences were good. All students produced essays that showed good coherence.
This is where we have to cross reference with the literature review, which I summarised in my 2nd post of coherence a few weeks ago.
Although I learned from these experiments that Chinese students were often confused about topic sentences, they appeared to benefit from a variety of activities that asked them to think about them either before or after drafting. I also learned that it takes a lot of repetition of coherence related activities to embed an awareness and understanding. Thirdly, I learned that explicit teaching of thematic progression appears to speed up the process of writing coherently but that I need to experiment and read more on paragraph functions and topic sentences in Chinese texts. Finally, I learned that thinking in L1 or translating may be a strategy students can employ to reduce cognitive load and improve coherence. I imagine this last ‘conclusion’ will prove the most controversial and superficially shaky, but they certainly seem to like it!
HONEY P. and MUMFORD A. Manual of Learning Styles, London: P Honey 1982.