Can you trust the data?

How often do government departments have to reissue press notices? Following intervention from the Office for Statistics Regulation, the DfE have been placed in that position. The OSR letter can be read at
https://www.statisticsauthority.gov.uk/wp-content/uploads/2017/09/DfE-statistics-Ed-Humpherson-to-Mike-Jones.pdf The revised press notice and the other issue about MAT transfers raised by OSR concern matters dear to the policy objectives of Ministers, so any potentially misleading data are of concern.

However, the DfE statisticians also have to battle with others that don’t always provide data that is of top quality. As reported in an earlier post, about local authority expenditure per pupil, there are a couple of local authorities in one table in that Statistical First Release where the data must be suspect because of the reported level: it both cases, way too low.

Then there is the case of under-reporting by schools in areas such as fixed term exclusions and more specifically for the number of pupils placed on reduced timetables, but not excluded. This is an area where more work is needed to discover what is actually happening, not least in the academy sector. This work is important because of the potential safeguarding aspect.

Local authorities and the local Safeguarding Board may not be in full possession of the facts if academies do not fully report to the DfE. It would be a simple change to add to the funding letter that academies are required to report all statistics via the local authority where they are located unless the Regional School Commissioner has explicitly provided for an alternative system that is as rigorous. At present, this is an issue with one part of the dual system not working as well as the other and creating potential risks for young people.

At least these days, as with the re-issued DfE Press notice mistakes can be rectified when noticed. In the former days before the internet such mistakes could become set in stone. One of my first communications with government was to point out that pupil teacher ratios provided in a written parliamentary answer and reported in Hansard were wrong. I think the first local authority in the list missed the PTR and was allocated that of the next by mistake. It wasn’t picked up before printing and went into the record. An error notice appeared later, but who checks written PQs for later revisions? Nobody, I would hazard a guess. As a result, anyone using that data source would have inaccurate data. It doesn’t matter now, but might have then. One year, the Department had to re-issue a whole Statistical Volume because of the number of printer’s errors.

Today, the record can be set straight quickly and easily, even if the original error is retained as well.

Statistics are important as a source of information under-pinning decision making and debate, hence the need for accuracy. The question of management information that is separate from statistics is one that has always interested me. In some areas, such as the labour market for teachers, I have always believed up to the minute information is important to spot changes in trends as early as possible. However, this data is often in a raw state and not 100% accurate. Where to draw the line between management information and statistics is an interesting and ever changing debate as technology provides ever more exciting tools for data collection and analysis.

A new Teacher Supply index from the DfE

Hot on the heels of yesterday’s report form the National Audit Office comes the DfE’s Analysis of school and teacher level factors relating to teacher supply. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/643974/SFR86_2017_Main_Text.pdf

So hot off the press that the early on-line version still had formatting errors in the table of contents. There is now far more statistical information around about the teacher labour market than at any time since the 1980s although most is about teachers and we need more on leadership turnover. However, as in the 1980s, it is still largely statistics and not management information that is available from the DfE.

I have sent the last forty years, ever since I began counting head teacher turnover in the early 1980s, arguing that management information, what is happening in the labour market now, is at least as important and in some case more important than what happened in the past. This is especially important when trends are changing. If the relaxation of the pay cap attracts more teachers to remain or return in the 2018 recruitment cycle for September 2018 vacancies then we should not have to wait until spring 2019 to discover that fact when the results of the 2018 School Workforce Census will first appear; too late to influence recruitment in 2019.

TeachVac, the free national vacancy service was created to cut the cost of recruitment to schools in a period of austerity, but also to develop tools in real time that the DfE has provided historical data about in today’s report. If for 2017, the DfE publishes the outcome of the ITT census in line with the information in Figures 2.1-2.3 of today’s report, then TeachVac can translate that data into an analysis of the 2018 recruitment round and provide guidance to schools on the local labour market.

The lack of complete data in the School Workforce Census of 2016 from almost a third of secondary schools in London must raise issues with the quality of the data for the capital. TeachVac records more secondary vacancies in London than elsewhere. TeachVac has the data to update the DfE’s supply index for the 2018 recruitment round as a further reams of verification. The supply index needs to take into account future pupil growth and the effects of major policy changes such as the introduction of a National Funding formula and changes to the Pupil Premium. Not to do so makes it less of a policy tool and more of a historical record of what has been happened. In creating TeachVac, the decision was that there was a need for information in real time. That said, the factors identified are not by themselves a surprise, what matters is the need to be aware of what is happening now. The tools are available, as TeachVac has demonstrated, the DfE should not shy away from recognising that now local authorities cannot as easily provide information to all local schools there is a need for someone else to be able to do so. The focus should switch from a statistical unit to one that handles both statistics and management information.

 

Changing the Guard

One of the last vestiges of the coalition government is disappearing from the DfE. Sir Paul Marshall, the recently knighted Lib Dem donor and chairman of ARK, has announced his resignation from the DfE Board. Should you wish to apply for the £20,000 a year post – 24 days of work officially required, but probably more expected – you have until the 4th July. The advert is on the Cabinet office website at https://publicappointments.cabinetoffice.gov.uk/appointment/lead-non-executive-director-department-for-education/ I am sure you will need experience at a high level and need to be in sympathy with government proposals for education.

With a new Permanent Secretary, a new Chief Inspector and relatively new Head of OfQual, the Secretary of State will have a relatively new team around her. Of course, after Thursday and the resulting fallout, whatever the outcome of the referendum, there might also be a new ministerial team as well.

All these changes can mean the start of a new era for education in England, especially if they are accompanied by changes in personnel in the leadership of some of the associations representing staff working in the sector. Or, they could mean a period of uncertainty as the new team takes up the reins.

Nowhere may change be needed more than in the supply and training of teachers. The fig leaf of the NCTL, with its chairman without a Board; the recent unfavourable reports from the NAO and Public Accounts Committee about the training and recruitment of teachers; not mention a White Paper with lots of ideas, but short on detail, means this is an area that needs urgent attention.

The creation of the long-awaited National Teaching Service and a decision on what to do about a national recruitment site as well as a consideration of the future shape of the teacher preparation market all require urgent attention in Whitehall. It is interesting to note that in asking for bids from providers for the 2017 teacher trainee cohort the NCTL has required bidders, whether schools, higher education or private providers, to include evidence of local demand in support of their bids. TeachVac is offering a service to providers to help with the evidence they need. (Interested organisations should email data@teachvac.com).

An announcement on the next stage of the National Teaching Service must surely follow quickly after the ending of purdah if timescales for the service to be any use in 2017 are to be met. Of course, the cutting of funds for schools through increased NI and pension costs may reduce the need for teachers, as many any slowdown in the economy, should it arise for any reason, with the possible effect of making recruitment less of an issue than it has been over the past two years.

However, the fact that Ofsted are now apparently looking at recruitment issues in their inspections http://schoolsweek.co.uk/ofsted-judging-schools-negatively-for-teacher-shortages/ suggests action is being taken to consider what schools and MATs are doing about recruitment. As a result, schools being inspected will be in need of comparative data for their area and they should contact data@teachvac.com about what is on offer.

Needless to say, one defence must be: we could have recruited if the government had met its target in Design & Technology (or insert appropriate subject or phase), so it is not entirely our fault. But it will help to have the evidence.

 

Good, bad and indifferent (coasting)

The headline  of this blog sort of sums up my view of the performance of academy chains as I read it in the Sutton trust Report issued today. http://www.suttontrust.com/wp-content/uploads/2015/07/Chain-Effects-2015.pdf

As a local politician, I might be forgiven for saying that such a judgement might have been made about local authorities when they were more directly responsible for schools and not, as now, just the education young people living in their communities receive. Even though that battle for local authorities to be allowed to act as academy chains was lost, at least with the two historically large political parties, some time ago, the need for an understanding of the effects of geography on academy chains and their performance is worth monitoring.

The Sutton Trust report seems somewhat light on the effects of funding. Where chains have schools in different funding bands – Ark has most schools in London, but some in Birmingham and on the south coast – do schools with different funding levels perform differently?  This might suggest that either the Pupil Premium or a national funding formula would be the better policy initiative to support.

The Sutton Trust accepts that generally London schools do better than schools elsewhere and academy chains with a strong London focus seem to do well. Is that because they are better funded; because they are nearer the DfE and can meet officials more often; have better leadership; or some other factor perhaps related to how we measure disadvantage?

I think, as in the days of local authorities there is a clear message about both leadership and purpose in this report. By itself neither is sufficient. Perhaps a score on leadership turnover might be added to a future report. Both Harris and Ark have strong central direction and some continuity of leadership. The best Chief Education Officers ran authorities where they knew what was wanted and set out to do more than just manage their schools. To the extent that hasn’t yet happened with the academy chain model means that governments seem to have replaced one system regarded as failing by another that probably isn’t yet any better overall. Whether the loss of democratic accountability is a price worth paying for the cost of the change is a matter for debate.

In defence of some academy chains they have taken on some very challenging schools. There may have been a degree of self-belief in the academy process that verged on naivety among all concerned. Changing the label on the door and upgrading the uniform may be necessary but not sufficient requirements for changing a school, but every academy chain needs to understand what works for the type of schools it is managing. The DfE needs to make sure they do so: hence the need for Ofsted to inspect academy chains in the same way as they do local authorities.

Finally, it would be interesting to rank academy chains on the central costs of running the chain compared with outcomes. I don’t know whether better performing chains are leaner or whether less well preforming chains need higher overheads to manage support for challenging schools? Certainly, salary costs needs looking at when some chains are paying their directors more than Directors of Childrens’ Services that are responsible for both far more schools and a social services arm of their service. Both, after all, are being paid with public money.

Where the long grass grows

It doesn’t look like there will be rapid action on coasting schools. Neither, despite it having been an issue for many years, does it seem as if the DfE has yet completed work on a scheme for a national funding formula for schools; another two years work is estimated to be required. With coasting schools being judged on outcomes up to 2016 that presumably won’t be available until early in 2017, schools that can do so have time to meet the criteria announced yesterday by the Secretary of State.

I had suggested using data for two years in my earlier post on coasting schools, so measuring progress over three years up to and including 2016 provides an even longer time scale.

The DfE announcement suggests:

The new measure … sets out a clear definition of what a coasting school is.

Those secondary schools that fail to ensure 60% of pupils achieve five good GCSE grades and have a below average proportion of pupils making expected progress over three years, will be classed as coasting.

From 2016 onwards those secondary schools who fail to score highly enough (over a three year period) on Progress 8 – our new accountability measure that shows how much progress pupils in a particular school make between the end of primary school and their GCSEs – will be deemed to be coasting.

At primary level the definition will apply to those schools that for three years have seen fewer than 85% of children achieving level 4, the secondary ready standard, in reading, writing and maths and which have also seen below average proportions of pupils making expected progress between age seven and age eleven.

Of course, the Bill Committee might amend the definitions in some way or at least put a clear appeal procedure in place; perhaps for small schools where the introduction of one child not speaking English  late in the day might tip the balance for the school. As I suggested last time, schools must be able to recruit the staff to teach pupils effectively. It would be silly for the government to create a staffing crisis and then penalise schools that suffered as a result.

I was amused to read of the Regional Commissioners that the Secretary of State’s announcement said that the eight education experts had in-depth local insight supported by elected head teacher boards from the local community. How local is the knowledge for the Commissioner and associated Board of six about Oxfordshire when their remit stretches from Brimsdown in Enfield to Burford on the Gloucestershire borders seems questionable, but perhaps this statement is just government hyperbole.

However, of more importance is where the cash to pay for extra powers for Commissioners will come from? Surely, it is time that the Treasury asked how we can afford to run two parallel system of local authorities and Commissioners, not to mention the costs of transferring schools between the two systems. Money is still tight, yet the education department and the Conservative government seems willing to waste money on a governance system no longer fit for purpose. Either schools are run by elected officials or they aren’t: if not, then should the government not put all schools under the control of Commissioners and treat the issue of ‘coasting’ as a problem to be solved and not a reason to change the governance of individual schools.

No good with numbers

This blog has always contented that numeracy wasn’t Michael Gove’s strong point during his time as Secretary of State for Education. Today the National Audit Office seemed to affirm that view when it produced an adverse opinion on the financial handling of Mr Gove’s flagship academy schools policy. The NAO concluded that the DfE failed to meet Parliament’s accountability requirements on academy spending. The NAO said that ‘the inability of the Department for Education to prepare financial statements providing a true and fair view of financial activity by its group of bodies means that it is not meeting the accountability requirements of Parliament.’ Their analysis continued, ‘In particular, if the challenge posed by consolidating the accounts of so many bodies and the fact that so many have a different reporting period is to be surmounted, the department and Treasury need to work together to find a solution.’

Much of the problem stems around the fact that academies have the same financial year as their academic year but the department reports on a government financial year to end of March so don’t know the absolute state of finances at the end of the financial year in academy trusts, but must make some assumptions. This isn’t a new problem for government since universities have had academic years as their financial years for a long time and the department could no doubt have learnt from that experience. But, as universities are now in the business department and not the DfE, perhaps they didn’t think to ask for advice in the headlong rush to get the 2010 Academies Act on to the statute book.

A Secretary of State interested in the finances of the department might have seen this issue coming. His hedge fund managers and others on the department’s board must also answer as to why they either hadn’t noticed or weren’t bothered by the reporting arrangements for academy trusts’ use of public money. As the following extract from the department’s consolidated accounts shows, there was in fact an awareness of the issue.

Followings discussion with Ministers, the Group has chosen not to compel ATs to adopt its 31 March financial year end, both to avoid misalignment of ATs’ financial and academic years, and on the principle of giving ATs as much operational independence as reasonably possible. This allows synchronisation of both their business and financial decision making: alignment of an AT financial year to the academic year enables the accounts to be more useful at a local level, as factors such as budgeting, recruiting and funding are usually based on the academic year.

This decision makes operational sense for ATs but it means that the Group accounts now have to be constructed through the application of a number of significant and material adjustments. This is to cope with problems that arise from having different financial year ends within the Group, and from ATs and the rest of the Group preparing financial statements using different accounting standards. As the number of Academies increase, there is a growing risk that this will give rise to material error or uncertainty within the financial statements. This risk has been realised for both the Group’s 2012-13 and 2013-14 accounts, as set out in the C&AG’s audit certificates and reports, which issued a qualified audit opinion for 2012-13 and an adverse audit opinion for 2013-14.

One wonders what those schools that are not academies make of this justification since their budgeting and funding would also be more usefully based upon an academic year as is most of their recruitment. The operation of two different sets of reporting years is surely not a long-term solution for a government that claims to want to reduce costs. A process of harmonization should be high on the agenda of the department after the general election.

Finally, buried in the depth of the report, is the fact that spending on international air travel has increased from £30,000 in 2010-11 to £234,000 in 2013-14. Even more worrying is the associated comment that ‘reasons for this are being investigated.’ This seems to be another area where financial controls don’t allow for immediate explanations.

Still looking for teachers

As of Sunday three-quarters of the undergraduate teacher training courses in England were still in ‘clearing’. That was just over 30 courses. What was interesting was the large number of church universities that weren’t in clearing. Indeed, even if you exclude the University of Durham from the list of church universities, despite the historical association between its teacher education college and the Church of England, more than half the list of institutions not in clearing were church universities, with Reading, Leeds and London Metropolitan Universities being the three exceptions.

From a quick look through the clearing courses, secondary design and technology and some of the sports Science courses related to teaching, as well as primary teacher training courses are looking to fill their remaining places. Of course, the clearing lists don’t tell anything about how many places are still available. Is it one at each institution, a tiny percentage of the overall total, or a more substantial number? Perhaps how many courses are still in clearing in a couple of weeks time will provide a better indication of what is happening?

With the skills tests to pass, and most courses starting around the 15th of September, although one or two start at the beginning of the month, there is little time to spare, especially  with the bank holiday to be taken account of as well.

How far the switch of numbers resulting from some providers returning places, and the National College having had to reallocate them in the early summer to different providers, has led to so many institutions offering at least one teacher training place in clearing cannot be ascertain from the raw figures. However, as I have constantly said in the past, we need to ensure the best possible candidates are recruited into teaching.

The DfE is undertaking a study into recruitment and retention, and it might be helpful if they evaluate as a part of that study whether there are differential retention rates from the different types of training. We do need to know the true costs of all training routes if some have a lower retention rate than others.

If we assume a training cost of £10,000 per student per year allowing for expenditure not currently recovered through fees, then a five per cent difference in retention rates might cost several million pounds extra in training. For this reason alone, it is worth monitoring the different routes. However, since one route is never likely to be able to supply all the need for new entrants, it may be necessary to accept some differential wastage rates; but work to reduce them.

Nevertheless, if the main reasons for leaving the profession are retirement and for family reasons, it is worth looking hard at those other cases where some malfunction in the system has caused a person to quit the profession that they trained for. Teachers are a precious resource; we cannot afford to discard them lightly.  

Minister hides his light under a Select Committee

I needs must start this post with an apology, and a confession. Despite my interest in teacher supply and training, I missed the Minister for Schools announcement about the changes to the Teacher Supply Model. By way of mitigation, I would point out that the announcement appeared in a reply to the Education Select Committee following his appearance in front of the Committee in February to talk about underachievement by white working class children, and has seemingly been documented as DfE supplementary evidence to that inquiry. For those of you having difficulty finding what he said, the link is http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/education-committee/underachievement-in-education-of-white-working-class-children/written/7989.html

What is of interest is David Laws updating of the Committee about the Teacher Supply Model. After all the usual platitudes about how well the Department and NCTL are doing on teacher recruitment and retention, and that School Direct is proving popular on the basis that schools have been signing up for places, David Laws confirmed to the Committee that the Teacher Supply Model was being redeveloped, and that the replacement is expected to be ready by autumn 2014; presumably in time to run the numbers for teacher preparation courses starting in 2016. The Minister didn’t say whether the work on the Model was being done entirely in-house or whether the DfE had convened a group of experts to help with the necessary changes.

However, that may not matter because the Minster also told the Committee that the new Model would be available online, as previously recommended by the Committee, and advocated by myself since I first appeared in front of a Select Committee to discuss the modelling of teacher supply in 1996.

David Laws went further by stating that publication of the Model will enable public examination of the assumptions and working of the Model to help estimations of future teacher demand and projected ITT recruitment. Furthermore, he told the Committee, worked up examples will be included in the online model. This is good news, as it will help the current debate about why so few teachers of English are needed when fewer pupils are being taught by teachers qualified in the subject.

However, the fact that David Laws then went on to offer the Committee data from as far back as 2009-10 about teacher stocks and flows as if this is the latest available to the DfE raises considerable concern in my mind about his understanding of the function of planning. And there may be revealed one of the serious issues in the debate about whether we should be planning teacher training or leaving it to the market as Mr Taylor of the NCTL would seem to prefer. As I have pointed out in the past, information gleaned at one stage of an economic cycle may not be helpful in planning for another stage, so using information about teacher flows during a recession, and the deepest post-war recession there has been, may not be helpful in projecting training numbers needed in 2016, when the economy is still hopefully motoring forward, unless that is teacher supply is entirely disconnected from the wider economy.

Finally, it will be interesting to see how the teacher supply model copes with shortfalls in recruitment to training. Exposing this issue, and making sure it is debated, is a key feature that will make the current discussion about creating sufficient teacher numbers different from past periods of teacher shortage. This letter to the Select Committee has placed one more brick in the wall.

 

Pay rise for Maths teachers?

Rather late in the life of this government the DfE seems to be learning some basic economic truths. Mostly notably they have discovered that when there is a shortage, the price goes up. However you dress up the announcement (made on a bank holiday Monday) that the DfE has done a deal with big business to deprive them of maths PhDs and to divert these scare resources into teaching at a price of perhaps £40,000 plus on-costs per year it must be a reaction to a shortage somewhere.

Indeed, just last week the DfE published an interesting paper on Indicator 19 of the School Workforce Survey showing the percentage of teachers with a relevant qualification teaching in English, mathematics, and the sciences across secondary schools had declined in all three subjects between the first School Workforce survey of 2010 and the latest conducted in 2013. This is despite improved coverage of the curriculum indicator across schools meaning that teacher coverage has increased from 66% to 81%, although the effective coverage rate has remained static at just under 75%.

The decline in the percentage of maths and science lessons taught by teachers with a relevant qualification – at least an ‘A’ level in the subject – is not a surprise. In view of the reductions in training numbers for teachers of English the fall from 88.4% to 84.8% in the percentage of English lessons taught by those with a relevant qualification must be a wake-up call, and vindicates some of the comments made on this blog over the past year. This is not a case of needing to pay more, but of increasing the training numbers to meet demand.

If I were a current maths teacher, or one in training, I would be paying special attention to the details of the DfE announcement when they appear and deciding what line I would take tomorrow with my head teacher. Now that schools have been removed from the shackles of a rigid pay scale, and left to fight out salaries with their staff many maths teachers may now find it worthwhile asking for a pay rise on the back of today’s announcement. This is especially if they teach Years 11-13. Their colleagues in the FE sector might also look to see whether the announcement is enough to seek a transfer into the school sector.

A helpful HEFCE publication http://www.hefce.ac.uk/media/hefce/content/pubs/2011/201133/11_33.pdf shows that there were just 255 UK domiciled starters of full-time PhDs in the mathematical sciences in 2009-10, plus a small number of starters on part-time courses. Allowing for non-completion, this might generate around 200 possible new maths teachers, if all new UK domiciled PhDs in the mathematical sciences were diverted into teaching. As a morale booster, it certainly sounds good, but those sorts of numbers are only half the figure the DfE calculated in its evidence to the STRB that would be needed to extend maths teaching to all post-16 year-old pupils just in schools. This number would do nothing to alleviate the growing shortage of qualified maths teachers for years 7-11 in secondary schools.

Although worth a try, especially as it probably isn’t costing the government much in hard cash, this scheme seems more of a gimmick than a solution to a problem the government seemingly now acknowledges needs solving.

This blog has been based upon press reports and will be updated after the DfE publishes the details of the Scheme.

Academies: the DfE charm offensive starts here

Now it may be entirely coincidental, but over the past couple of weeks there has been discussion on the internet about the powers of academies, and specifically about their control of the assets in the Trust deed, and then yesterday the DfE have published a paper entitled Academies; a myth buster. https://www.gov.uk/government/publications/academies-a-myth-buster Hopefully, this document will survive in the public domain longer than the last DfE publication reviewed on this blog.

The DfE document addresses the land point as follows:

When a community school becomes an academy, the new academy trust takes on the legal title to the land from the council, doesn’t it?

Wrong. When a community school becomes an academy, legal title is not transferred from the council to the academy trust. The freehold is retained by the council and a lease is granted to the trust.

Note, that the DfE only mentions community schools. My understanding is that if a school is a Foundation School the situation over the title to the land may be different. Indeed, there have been suggestions that some schools have looked into a two stage process of becoming a Foundation School, and then becoming an academy specifically because of the land issue. If there is a loophole with regard to ownership of the land and buildings that must remain public assets, then it should be closed forthwith.

There is another part of the document that reads rather clumsily in the present world of Commissioners and the central control of all schools from Westminster.

There isn’t much financial accountability around academies though, is there?

Wrong: the financial accountability systems in place for academies are more rigorous than those for local authority-run schools and they mean that not only do any problems get uncovered but also that there can be swift resolution of any issues. The spotlight of this accountability system demonstrates that academies cannot hide from their responsibilities and are held to account for their actions. There have been almost 200 detected cases of fraud in council-run schools.

By locally-authority run schools the DfE author presumably means community and voluntary schools. But, to describe then as locally-authority run is an insult to reality. Perhaps that’s why they are later called council-run schools, a quaintly archaic term. Interestingly, although in 200 of these schools, that set and control their own budgets, there have been cases of fraud over an undefined period of time the document doesn’t say how many cases of fraud, if any, there have been in academies during the same period, thus perhaps creating a new myth that academies don’t have any cases of detected fraud.

Finally, the DfE is categorical about profit answering that:

Oh right – but academy trusts are private companies and can make a profit.

That’s not true either: all academy trusts are charitable trusts and they cannot make a profit.

But, the DfE doesn’t say anything about either academies accumulating surpluses or the need for arm’s length contracting, especially where the academy is part of a chain that may encourage individual schools towards particular contractors.

One myth that isn’t addressed in the DfE document is that councils cannot force academies to help when pupil numbers in an area increase and the academy has spare places. Perhaps because academies can behave in that way, so it isn’t a myth, even if it could cost the council thousands of pounds in extra transport charges finding other schools for the pupils further away from the academy with spare places.