Posts Tagged ‘freedom of information’

It’s been a while since I liberated any data and that’s because I’ve been wrestling with a scraper of Government Salaries. I’ve only looked at pay floor for the tables below. This is the minimum pay with ceiling pay being £4,999 more than the floor. Salaries ranged from £35,000 to £235,000.

There was the coding to deal with of course. I’ve had my third formal lesson. Lists, ooh er. But the main difficulty came from the awful state the data was in. All CSV files but spread over the web with a blatant disregard for consistency. Anyway, you can download the data for yourself. There are 440 rows so looking back at the poor quality of the data one could easily have done a copy and paste job, but a scraper that trawls a site for the links to the pages that has the download ensures you get all the data sets and makes the next collection a matter of hitting a button (hopefully).

Here is the top 10 for pay:

If you’re looking to climb your way up to the top pay band then here’s the top 10 departments:

And since the Information Commissioner has ordered release of names of high-paid civil servants who did not want their salaries disclosed the data shows 48 names have been withheld amounting to £508,000 in cumulative pay. Most of these redactions came from the Cabinet and Home Office. I can understand why names from the Office for Security and Counter-Terrorism Unit were not disclosed. One consistency with the withholding of names is from the lawyers. The entire list of names for the Office of the Parliamentary Counsel is N/D as is the legal advisers branch of the Cabinet Office. Also not named are the Media Director and Communication and Change Director. Here are the details where the names are not disclosed: