About Nesta

Nesta is an innovation foundation. For us, innovation means turning bold ideas into reality and changing lives for the better. We use our expertise, skills and funding in areas where there are big challenges facing society.

Open Jobs is a programme of work that focuses on improving labour market information. The programme shows how cutting-edge data science methods, when applied to large sources of text data, can provide new insights on a range of labour market issues, including skill shortages, job quality, automation risk and green jobs.

Each project within the Open Jobs programme was funded externally and the team are extremely grateful for support from the following organisations: the Department of Education, the Gatsby Foundation, the JP Morgan Chase Foundation, the Economic and Social Research Council, the Economic Statistics Centre of Excellence, the Productivity Insights Network and SkillsFuture Singapore.

The outputs of the programme included research papers, open tools, interactive data visualisations and reports.

How you can use our tools

We have developed some example use cases that can be tackled using our tools:

  • Analysing trends in pay and skills asked for in a particular industry over time.
  • Identifying shared skills between different occupations and building an understanding of potential career paths or switches.
  • Analysing how aspects of job quality, such as remote working, vary with location.
  • Identifying new and emerging skills that are being asked for in a given occupation, industry or region.
  • Identifying green occupations and seeing the skills typically asked for in job adverts.

You can access the following tools below:

  • Skills extractor - this is an open source python library that extracts the skills mentioned within job adverts and then matches these terms to skills from a standard list or ‘skills taxonomy’. View a demo of our skills extractor
  • Standard occupational classification (SOC) mapper - uses occupation name to assign a SOC code.
  • Standard industrial classification (SIC) mapper - uses job advert text to assign a SIC code.
  • Job quality extractor - this open-source codebase can be used to automatically identify aspects of job quality as they appear in online job adverts, allowing extraction of information relevant to job quality, including location, hours and benefits.
  • Salary annualisation - converts salaries to a standardised annual format with a minimum and maximum range.
  • Green Jobs Explorer - this tool harnesses job advert data to offer new insights into the green labour market. Users can explore and compare the environmental aspects of different occupations to build a more nuanced picture of green jobs in the UK. We plan to update the tool with new data twice a year. You can look at the code behind this tool in our open-source code.

Other outputs

Building a skills taxonomy for the UK

This paper is Nesta’s second data-driven skills taxonomy. The improved method does not rely on a predetermined list of skills, and can instead automatically detect previously unseen skills. The resulting taxonomy contains three levels and 6,685 separate skills. It could be used as a base for the first UK-specific skills taxonomy, to spot regional skill clusters, and for rapid assessments of skill changes following shocks such as the Covid-19 pandemic.

The Open Jobs Observatory

The Observatory is where Nesta’s collection of online job adverts are stored. Nesta started gathering online job adverts in 2021, collecting adverts on a daily basis. As of mid 2024, the Observatory contained over 8 million UK online job adverts. This article illustrates new insights about skills that can be unearthed from these advertisements.

The first publicly available data-driven skills taxonomy for the UK

Nesta’s first research paper on skills taxonomy shows how job adverts can be used to create a data-driven taxonomy that is independent of expert-derived taxonomies. The paper illustrates how the taxonomy can be automatically and quickly updated to reflect changes in labour demand, providing timely insights to support labour market decision-making. 

Measuring regional skill mismatches: can big data help?

This research paper explores how workers’ skills vary across the UK. The analysis uses a purchased dataset of 53 million job adverts, combined with Nesta’s first skills taxonomy.

How green is your job, really?

This article outlines some key findings from the Green Jobs explorer and provides ideas for how the tool can be used. 

Measuring workforce greenness via job adverts

This technical article explains how green skills, mentioned within job adverts, are automatically identified and extracted. It also presents high-level analysis of green skills across the UK. Green skills are just one of three dimensions that are measured within the Green Jobs Explorer. There is also a technical article describing how we extracted SOC codes and one on how we extracted SIC codes from job adverts – algorithms pivotal to our two other dimensions of greenness

Greening the job market

This article, published in Recruiter magazine, explains how the lack of monitoring and information on green skills threatens to slow the transition to net zero. It argues that this ‘data gap’ takes the pressure off sectors sitting outside the ‘green’ economy, risks hampering workers and job seekers from driving change, and prevents policymakers from identifying regions or sectors where firms may be struggling to adapt.

Extracting dimensions of job quality from online employee reviews

This research paper uses millions of online employee reviews, from Indeed’s UK website, to enhance our understanding of job quality. Keywords within the reviews are extracted and then clustered to form a taxonomy of job quality. It is the first UK taxonomy that is derived from employee reviews and the first to be updatable in real time. 

Identifying drivers of job quality in online job adverts

This project provides a method of analysing dimensions of job quality as they appear in online job advertisements. We extracted and classified a range of aspects mentioned within the job adverts, including employment terms (eg, offers to work flexible hours), benefits (eg, life assurance) and job design (eg, mentions of career progression). Two data stories were also produced, one focussing on offered job quality in the UK, and the other on job quality in adverts for early-years practitioners.

Mapping Career Causeways

In this report, machine learning is used to create a ‘map of the labour market’ that captures the similarities between over 1,600 jobs, based on the skills and work activities that make up each role. The resulting map shows how a worker's skills and experience can be transferred to a range of nearby jobs. 

SkillsMatcher

This demonstrator tool allows a user to find occupations that are similar to their current role (in relation to the skills that their role requires). The tool leverages the algorithms developed in Mapping Career Causeways and aims to show how they can help career advisors recommend suitable career paths to their advisees. This technical article describes how the demonstrator works in more detail.  

The UK needs a skills framework - Lessons from Singapore

Shortly before Covid-19 shook the world, Nesta began a collaboration with SkillsFuture Singapore to extract novel insights from their Skills Frameworks. These frameworks detail the competencies required in almost 1,500 job roles, covering 30 different sectors in Singapore. This article showcases the findings and puts forward the case for developing a skills framework in the UK.

The automation risk of apprenticeships

This report compares the automation risk among UK apprenticeships and identifies the drivers of risk. Specifically, it estimates the suitability of the tasks within an apprenticeship for machine learning. The estimates of automation risk come from a US study by Brynjolfsson, Mitchell and Rock. The US occupations are then mapped to UK apprenticeships.

Project partners

Team

Cath Sleeman

Cath Sleeman

Cath Sleeman

Head of Data Science, Data Science Practice

Dr Cath Sleeman was the Head of Data Science.

View profile
Liz Gallagher

Liz Gallagher

Liz Gallagher

Principal Data Scientist, Data Science Practice

Liz is a principal data scientist working in the Data Science Practice.

View profile
India Kerle

India Kerle

India Kerle

Data Scientist, Data Analytics Practice

India was a data scientist in the Data Science Practice.

View profile
Zayn Meghji

Zayn Meghji

Zayn Meghji

Programme Manager, Data Analytics Practice

Zayn works as a programme manager in Nesta's Data Analytics Practice, providing project management support and programmatic oversight to the team.

View profile
Rosie Oxbury

Rosie Oxbury

Rosie Oxbury

Data Scientist, Data Science Practice

Rosie is a data scientist in the Data Science Practice.

View profile
Jyldyz Djumalieva

Jyldyz Djumalieva

Jyldyz Djumalieva

Data Science Technical Lead, Data Analytics Practice

Jyldyz Djumalieva was the Data Science Technical Lead working in Data Analytics

View profile
Karlis Kanders

Karlis Kanders

Karlis Kanders

Head of Data Science for Discovery and Innovation

Karlis is the Head of Data Science for Discovery and Innovation, working in the Discovery and data science teams.

View profile
Jack Vines

Jack Vines

Jack Vines

Data Engineer, Data Analytics Practice

Jack is a Data Engineer in the Data Analytics Practice.

View profile
Genna Barnett

Genna Barnett

Genna Barnett

Programme Manager, Data Analytics Practice

Genna is the Programme Manager for the Data Analytics Practice at Nesta.

View profile
Emily Bicks

Emily Bicks

Emily Bicks

Principal Data Scientist, Data Analytics Practice

Emily was a principal data scientist in the Data Analytics practice.

View profile
Lauren Orso

Lauren Orso

Lauren Orso

Group Data Journalist

Lauren was a data journalist who researched, produced and published data stories.

View profile
Suraj Vadgama

Suraj Vadgama

Suraj Vadgama

Director of Design, Design & Technology

Suraj leads the Design & Technology practice at Nesta.

View profile
Jack Orlik

Jack Orlik

Jack Orlik

Programme Manager - Open Jobs, Data Analytics Practice

Jack was a Programme Manager for Open Jobs.

View profile
Joel Klinger

Joel Klinger

Joel Klinger

Data Engineering Senior Lead, Data Analytics

Joel is Nesta’s Data Engineering Senior Lead

View profile
Stef Garasto

Stef Garasto

Stef Garasto

Principal Researcher, Data Science, Creative Economy & Data Analytics

Stef's work involved using novel sources of data and machine learning techniques to better understand the labour market.

View profile